Quantizing LLMs using GPTQ

This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).

LLM quantization techniques: absmax, zero-point, GPTQ and GGUF

Run gguf LLM models in Latest Version TextGen-webui

ChatSakura：Open-source multilingual conversational model.（开源多语言对话大模型）

Personal GitHub repository for stashing resources on Large Language Models (LLM), including Jupyter Notebooks on open source LLMs, use-cases with Langchain and R&D paper review.

Hands on some LLMs

Private self-improvement coaching with open-source LLMs

This project will develop a NEPSE chatbot using an open-source LLM, incorporating sentence transformers, vector database and reranking.

A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system

Conversation AI model for open domain dialogs

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

zero零训练llm调参

A guide about how to use GPTQ models with langchain

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

Large Language Models for All, 🦙 Cult and More, Stay in touch !

Run any Large Language Model behind a unified API

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime