Skip to content

Releases: BobaZooba/xllm

Single GPU DeepSpeed, download model without loading to RAM

06 Dec 11:17
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.1.7...0.1.8

Tokenizer hotfix

17 Nov 07:57
Compare
Choose a tag to compare

What's Changed

Int8 fusing

16 Nov 13:54
Compare
Choose a tag to compare

What's Changed

Full Changelog: 0.1.1...0.1.2

Stable release

15 Nov 08:18
Compare
Choose a tag to compare

🎉 Code and documents done!

Useful materials

  • Quickstart: basics of xllm
  • Examples: minimal examples of using xllm
  • Guide: here, we go into detail about everything the library can
    do
  • Demo project: here's a minimal step-by-step example of how to use X—LLM and fit it
    into your own project
  • WeatherGPT: this repository features an example of how to utilize the xllm library. Included is a solution for a common type of assessment given to LLM engineers, who typically earn between $120,000 to $140,000 annually
  • Shurale: project with the finetuned 7B Mistal model

Init Release

13 Nov 12:14
Compare
Choose a tag to compare

Code done and tested. Time to docs