ChatSakura：Open-source multilingual conversational model.（开源多语言对话大模型）

Large Language Models for All, 🦙 Cult and More, Stay in touch !

Personal GitHub repository for stashing resources on Large Language Models (LLM), including Jupyter Notebooks on open source LLMs, use-cases with Langchain and R&D paper review.

zero零训练llm调参

A guide about how to use GPTQ models with langchain

Run any Large Language Model behind a unified API

Conversation AI model for open domain dialogs

A.L.I.C.E (Artificial Labile Intelligence Cybernated Existence). A REST API of A.I companion for creating more complex system

This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).

Quantizing LLMs using GPTQ

This project will develop a NEPSE chatbot using an open-source LLM, incorporating sentence transformers, vector database and reranking.

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

Private self-improvement coaching with open-source LLMs

Hands on some LLMs

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

LLM quantization techniques: absmax, zero-point, GPTQ and GGUF

Run gguf LLM models in Latest Version TextGen-webui

Advanced Quantization Algorithm for LLMs. This is official implementation of "Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs"

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime