Constrained method

Implementing constrained decoding from scratch is non-trivial. While we're all for building our own software, we recommend using existing implementations. This section covers them.

🗃️ Schema input

3 items

🗃️ Backends

4 items

📄️ The full stack

Where you run your backends

📄️ Inference engines

Where you run your backends

📄️ Libraries

Libraries for DX, built on top of backends

📄️ Models

Constrained decoding as a service

📄️ Commercial APIs

Constrained decoding as a service

📄️ Choosing the right method

Some pointers and recommendations

Subscribe to our newsletter

Updates from the LLM developer community in your inbox. Twice a month.

• Developer insights
• Latest breakthroughs
• Useful tools & techniques