Visual inference exploration & experimentation playground

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT or Ollama to enhance email management.

LLM inference server implementation based on llama.cpp.

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.

LLM based assistant running as a Telegram Bot.

A Discordjs bot that uses OpenAI compatible endpoints for chatting.

Achieve search sovereignty with Toledo1, a high performance multi-LLM browser