Pinned Loading

1. PygmalionAI/aphrodite-engine PygmalionAI/aphrodite-engine Public

   Large-scale LLM inference engine

   Python 1.1k 123

2. pygmalion.cpp pygmalion.cpp Public archive

   C/C++ implementation of PygmalionAI/pygmalion-6b

   C 56 5

3. sparsegpt-for-LLaMA sparsegpt-for-LLaMA Public

   Forked from IST-DASLab/sparsegpt

   Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

   Python 70 4

4. tplib tplib Public

   A torch-based, universal tensor-parallel library.

   Python 3

5. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 135k 27.1k

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 30.4k 4.6k