Skip to main content

Mango LLMBoost

LLMBoost is a ready-to-deploy full stack AI inferencing server offering unprecedented performance and flexibility.

There are two deployement methods:

  • In-Process via the Python API
  • Inferencing Server

Installation​

Currently LLMBoost is only avaiable on the AWS marketplace.