LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3955 GitHub stars · SourceCategory
2 sourced tools with this topic.
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3955 GitHub stars · SourceOfficial SDK for the Maybind Digital Twin Platform — interact with AI twins via a powerful API.
14 GitHub stars · Source