Skip to content
@gpustack

GPUStack

Open-source GPU cluster manager for running large language models(LLMs)

Pinned Loading

  1. gpustack gpustack Public

    Manage GPU clusters for running LLMs

    Python 588 51

  2. gguf-parser-go gguf-parser-go Public

    Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

    Go 46 4

  3. llama-box llama-box Public

    LLM inference server implementation based on llama.cpp.

    C++ 31 3

Repositories

Showing 8 of 8 repositories
  • gpustack Public

    Manage GPU clusters for running LLMs

    gpustack/gpustack’s past year of commit activity
    Python 588 Apache-2.0 51 68 (1 issue needs help) 2 Updated Nov 15, 2024
  • llama-box Public

    LLM inference server implementation based on llama.cpp.

    gpustack/llama-box’s past year of commit activity
    C++ 31 MIT 3 2 0 Updated Nov 15, 2024
  • gpustack-ui Public
    gpustack/gpustack-ui’s past year of commit activity
    TypeScript 2 5 0 0 Updated Nov 14, 2024
  • gpustack.github.io Public
    gpustack/gpustack.github.io’s past year of commit activity
    HTML 0 1 0 0 Updated Nov 7, 2024
  • fastfetch Public Forked from fastfetch-cli/fastfetch

    Like neofetch, but much faster because written mostly in C.

    gpustack/fastfetch’s past year of commit activity
    C 0 MIT 422 0 0 Updated Oct 24, 2024
  • gguf-parser-go Public

    Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

    gpustack/gguf-parser-go’s past year of commit activity
    Go 46 MIT 4 0 0 Updated Oct 24, 2024
  • gguf-packer-go Public

    Deliver LLMs of GGUF format via Dockerfile.

    gpustack/gguf-packer-go’s past year of commit activity
    Go 4 MIT 1 0 0 Updated Oct 24, 2024
  • .github Public

    Meta-Github repository for all GPUStack repositories.

    gpustack/.github’s past year of commit activity
    0 Apache-2.0 0 0 0 Updated Oct 24, 2024

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

gguf llama go