Structured Outputs

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

Fast, Flexible and Portable Structured Generation

Faster structured generation

AI辅助长篇小说创作，卡片式创作，支持基于 JSON Schema的结构化 AI 生成与上下文引用，可扩展性强。

Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models

Query language for blending SQL and LLMs across structured + unstructured data, with type constraints.

Plug-and-play document processing pipelines with zero-shot models.

Building Agents with LLM structured generation (BAML), MCP Tools, and 12-Factor Agents principles

Extract structured data from local or remote LLM models

The developper starter pack for document processing

Structured Generation Evals

Use `outlines` generators with Haystack.

A guide to structured generation using constrained decoding

Speculative grammar backtracking algorithm for LLM decoding conforming to some lark context-free grammar (CFG)

Presentation at PyData Global: Building Knowledge Graph-Based Agents with Structured Text Generation and Open-Weights Models

Presentación en la conferencia IADevs 2024: Potenciando la Generación Aumentada usando Recuperación con Grafos de Conocimiento

Fast structured data extraction from text using LLMs. Pre-built templates for common use cases + custom schema support.

A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.