🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Large Language Model Text Generation Inference

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

An open-source and enterprise-level monitoring system.

Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

Free, open-source SQL client for Windows and Mac 🦅

A familiar HTTP Service Framework for Python.

中文nlp解决方案(大模型、数据、模型、训练、推理)

A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.

LLM Finetuning with peft

A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.

🩹Editing large language models within 10 seconds⚡

🦙 Integrating LLMs into structured NLP pipelines

The simplest way to serve AI/ML models in production

🤖 A PyTorch library of curated Transformer models and their composable components

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

a Python web framework generator supports Flask, Tornado, Falcon, Sanic

Repo for fine-tuning Casual LLMs

Take Android screenshots with Falcons bright eye!

Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型