A Rust, Python and gRPC server for text generation inference. Used in production at Hugging Face to power Hugging Chat, the Inference API and Inference Endpoints.

Version, test, and monitor every prompt and agent with robust evals, tracing, and regression sets. --- This library provides convenient access to the PromptLayer API from applications written in python.

I've started to work on reimplementation of the library here: FastTensors Please star it if you'd like to see GGML-compatible implementation in pure Go. Please check out my related project Booster We dream of a world where fellow ML hackers are grokking REALLY BIG GPT models in their homelabs without having GPU clusters consuming a shit tons of $$$.

Designed for research exploration and industrial prototyping, UltraRAG standardizes core RAG components (Retriever, Generation, etc.) as independent MCP Servers, combined with the powerful workflow orchestration capabilities of the MCP Client. Developers can achieve precise orchestration of complex control structures such as conditional branches and loops simply through YAML configuration.

🦞 OpenClaw is a great personal AI assistant — connecting all major IMs as conversation channels, supporting any LLM, running autonomously 24/7. But when we bring it into an enterprise context, new challenges naturally emerge: data scattered across individual accounts, no budget guardrails, output that stops at plain text, high-risk actions without an approval gate.

P enetration testing A rtificial G eneral I ntelligence ⠀ PentAGI is an innovative tool for automated security testing that leverages cutting-edge artificial intelligence technologies. The project is designed for information security professionals, researchers, and enthusiasts who need a powerful and flexible solution for conducting penetration tests.

Awesome Prompt Engineering 🧙‍♂️ A hand-curated collection of resources for Prompt Engineering and Context Engineering — covering papers, tools, models, APIs, benchmarks, courses, and communities for working with Large Language Models. https://promptslab.github.io --- New to prompt engineering?