LiteLLM

660Minstalls/mo · pypi54kstars9.9kforks

How to install LiteLLM?

litellm

$pip install litellm

Installs into the current project.

Summary

One OpenAI-compatible interface for 100+ providers, with budgets, caching, fallbacks, and observability. The gateway layer most multi-model stacks standardize on.

Files · 1

View on GitHub

README.md

1	# LiteLLM
2	One interface, every provider.
3	Budgets, caching, fallbacks, observability.

People who liked this also viewed

3 picks

Type

tiktokenFast BPE tokenizer, count before you spendTools8 weeks ago213M19k
OutlinesGuaranteed-valid generation: regex, JSON schema, grammarsToolstoday—15k
InstructorStructured outputs for LLMs, typed, validated, retriedToolslast week—14k

LiteLLM

660Minstalls/mo · pypi54kstars9.9kforks

View on GitHub

How to install LiteLLM?

litellm

$pip install litellm

Installs into the current project.

Summary

One OpenAI-compatible interface for 100+ providers, with budgets, caching, fallbacks, and observability. The gateway layer most multi-model stacks standardize on.

Files · 1

View on GitHub

README.md

1	# LiteLLM
2	One interface, every provider.
3	Budgets, caching, fallbacks, observability.

People who liked this also viewed

3 picks

Type

tiktokenFast BPE tokenizer, count before you spendTools8 weeks ago213M19k
OutlinesGuaranteed-valid generation: regex, JSON schema, grammarsToolstoday—15k
InstructorStructured outputs for LLMs, typed, validated, retriedToolslast week—14k