Outlines

15kstars793forks

How to install Outlines?

outlines

$pip install outlines

Installs into the current project.

Summary

Constrained decoding that structurally cannot emit invalid JSON: regex, JSON Schema, and full grammars enforced at sampling time. When 'usually valid' is not good enough.

Files · 1

View on GitHub

README.md

1	# Outlines
2	Constrained decoding that cannot emit
3	invalid JSON. Ever.

People who liked this also viewed

3 picks

Type

LiteLLMCall 100+ LLM APIs through one OpenAI-compatible interfaceToolstoday660M54k
tiktokenFast BPE tokenizer, count before you spendTools8 weeks ago213M19k
InstructorStructured outputs for LLMs, typed, validated, retriedToolslast week—14k

Outlines

15kstars793forks

View on GitHub

How to install Outlines?

outlines

$pip install outlines

Installs into the current project.

Summary

Constrained decoding that structurally cannot emit invalid JSON: regex, JSON Schema, and full grammars enforced at sampling time. When 'usually valid' is not good enough.

Files · 1

View on GitHub

README.md

1	# Outlines
2	Constrained decoding that cannot emit
3	invalid JSON. Ever.

People who liked this also viewed

3 picks

Type

LiteLLMCall 100+ LLM APIs through one OpenAI-compatible interfaceToolstoday660M54k
tiktokenFast BPE tokenizer, count before you spendTools8 weeks ago213M19k
InstructorStructured outputs for LLMs, typed, validated, retriedToolslast week—14k