ai.ml: one endpoint for every model, with routing and failover built in

Кратко

ai.ml is an LLM gateway. Keep the OpenAI, Anthropic or Gemini SDK you already use, change the base URL, and every request is translated, routed to the best host, streamed back and metered to the to...

Описание

ai.ml is an LLM gateway. Keep the OpenAI, Anthropic or Gemini SDK you already use, change the base URL, and every request is translated, routed to the best host, streamed back and metered to the token.