Open source alternatives to LiteLLM

2 projects on starwire do the same job. Ranked by how much of what LiteLLM does each one covers, read from its README and website. Ties go to the most active.

What LiteLLM does

  1. One API for many LLM providerscore
  2. Self-hosted LLM gatewaycore
  3. Virtual keys and budgets
  4. Cost and usage tracking
  5. Fallbacks, retries and load balancing
  6. Logging and observability hooks

Each dot in the table is one job, in this order. Square dots are core jobs and count double. Full means yes, half means partly. "See the evidence" under a project shows the line behind each one. Coverage is what a project documents, not how well it works or how hard it is to move to. How we score this

ProjectCoversStarsCommits, 12 weeksLast releaseClosed vs openedSetupLicense
otariSelf-run AI gateway with one endpoint for 40+ providers, keys and budgets Replaces it94%930+54
1,829
 yesterday80% Hosted version Apache-2.0
Covers all 2 core jobs. Partly: Logging and observability hooks.See the evidence
  • One API for many LLM providerscoreYesOne OpenAI and Anthropic-compatible endpoint for many providers
  • Self-hosted LLM gatewaycoreYesRun Otari with your own database and provider keys.
  • Virtual keys and budgetsYesissue virtual keys, enforce budgets
  • Cost and usage trackingYesCost, tokens and requests by model, person or API key
  • Fallbacks, retries and load balancingYesLocal routing policies for failover, conditional selection, traffic splitting
  • Logging and observability hooksPartlyEvery request with its tokens, cost and errors.
litelmSlimmer alternative to litellm for calling many LLM providers from Python Covers one part25%237
35
 11 days ago100% For developers MIT
Covers 1 of 2 core jobs. Not shown: Self-hosted LLM gateway; Virtual keys and budgets; Cost and usage tracking; Fallbacks, retries and load balancing; Logging and observability hooks.See the evidence
  • One API for many LLM providerscoreYesRoutes to 19 providers via "provider/model-name" syntax.
  • Self-hosted LLM gatewaycoreNot shownNeither the README nor the website mentions it.
  • Virtual keys and budgetsNot shownNeither the README nor the website mentions it.
  • Cost and usage trackingNot shownNeither the README nor the website mentions it.
  • Fallbacks, retries and load balancingNot shownNeither the README nor the website mentions it.
  • Logging and observability hooksNot shownNeither the README nor the website mentions it.

Vital signs from GitHub, checked weekly. How we read these · How setup is read

All repos

New repos every two days, stars refreshed daily. Visits are counted without cookies, and the numbers are public. How it works Data RSS Newsletter

The best new open source, once a weekOne short email: the repo everyone is suddenly starring, a handful worth trying, and one hidden gem, each with a plain note on what it does. Free, with no tracking pixels.

Read past issues

↑ ↓ to move   Enter to choose   Esc to close
Follow starwire by RSSCopy an address into your feed reader.
The day's bestOne item a day: the repos rising fastest and the biggest new picks.starwire.foo/top.xml
Every new pickAll of them as they are added, up to 60 a day.starwire.foo/feed.xml
The weekly emailEach issue of the newsletter, once a week.list.starwire.foo/archive.xml