serving AI tools

1 sourced tool with this topic.

LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

3955 GitHub stars · Source