Get structured, fully typed, and validated JSON outputs from OpenAI and Anthropic models. Under the hood, zod-gpt uses functions to coerce the model to always respond as function calls.

A powerful local RAG (Retrieval Augmented Generation) application that lets you chat with your PDF documents using Ollama and LangChain. This project includes multiple interfaces: a modern Next.js web app, a Streamlit interface, and Jupyter notebooks for experimentation.

Prompt Decorators extend the functionality of large language models by allowing structured, modular control over reasoning, style, and behavior. Each decorator enforces specific response rules, enabling users to declaratively modify how the model thinks and writes — without retraining.

For embeddings, please see examples/embeddings/index.html WebGPU support is introduced via PR #215. Upon updating to V3.1, WebGPU will be enabled automatically.

⚠️ Warning: Not Actively Maintained This repository is no longer actively maintained. For a more up-to-date alternative, please visit the LitGPT project: https://github.com/Lightning-AI/litgpt , which serves as the successor to this repository.

In a nutshell, we aim to generate polyphonic music of multiple tracks (instruments). The proposed models are able to generate music either from scratch, or by accompanying a track given a priori by the user.

An open-source visual environment for battle-testing prompts to LLMs. ChainForge is a data flow prompt engineering environment for analyzing and evaluating LLM responses.

We also introduce a diffusion-based value model that reduces variance and improves stability during optimization. Based on TraceRL, we derive a series of diffusion language models, TraDo, which achieve state-of-the-art performance on math and coding reasoning tasks.

RouteLLM is a framework for serving and evaluating LLM routers. [Blog ] [Paper ] Our core features include: From PyPI From source Let's walkthrough replacing an existing OpenAI client to route queries between LLMs instead of using only a single model.

MASFactory is a graph-centric framework for orchestrating Multi-Agent Systems with Vibe Graphing: Start from intent, generate a graph design, preview and refine it in a visual environment, compile it into an executable workflow, and trace node states, messages, and shared state at runtime. Turn natural-language intent into a structural design, then iteratively converge to an executable, reusable workflow.