Simple Python bindings for @ggerganov's llama.cpp library. This package provides:. Use it to ground design choices in named patterns, trade-offs and examples.

React Native binding of llama.cpp - LLM inference in C/C++ Key Features: llama.rn downloads the pre-built ios/rnllama.xcframework and android/src/main/jniLibs from the matching GitHub release during postinstall. Existing downloads are reused, and each archive is verified with SHA-256 before extraction.

Osmantic Deployment System Turn your PC, Mac, or Linux box into a private AI server. AI server and homelab setup is rapidly becoming a solved problem.