CUSTOM KNOWLEDGE FEED

#llmtools

1 cards

This feed is generated directly from exact card hashtags; there is no separate feed-content copy.

Subscribe to this viewRSSJSON

LLMTools: Run & Finetune LLMs on Consumer GPUs

LLMTools is a user-friendly library for running and finetuning LLMs in low-resource settings. Features include: 🔨 LLM finetuning in 2-bit, 3-bit, 4-bit precision using the ModuLoRA algorithm 🐍 Easy-to-use Python API for quantization, inference, and finetuning 🤖 Modular supp. Use it to navigate the topic and choose relevant methods, papers or tools.

llm-engineering/inference-and-quantizationreference#llm-ml-engineering #inference-and-quantization #llmtools #finetune

#llm-engineering · by Collider.club

★ 0◌ 0

CUSTOM KNOWLEDGE FEED