Running large language models on a single GPU for throughput-oriented scenarios.

Run Mixtral-8x7B models in Colab or consumer desktops

PyTorch native quantization and sparsity for training and inference

dpdk infrastructure for software acceleration. Currently working on RX and ACL pre-filter

DPU-Powered File System Virtualization over virtio-fs

A collection of tests for the Open vSwitch HW offload.

A Dynamic Programming Offloading Algorithm for Mobile Cloud Computing

A lightweight framework that enables serverless users to reduce their bills by harvesting non-serverless compute resources such as their VMs, on-premise servers, or personal computers.

A framework for IoT devices to offload tasks to the cloud, resulting in efficient computation and decreased cloud costs.

LeapIO: Efficient and Portable Virtual NVMe Storage on ARM SoCs (ASPLOS'20)

Monero hardware wallet protocol implementation for Trezor, agent

The container-based cloud platform for mobile code offloading

Code for paper "Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI" (MobiCom'22)

Monero wallet Trezor integration documentation

Implementation of the RTSS'23 paper Progressive Neural Compression for Adaptive Image Offloading under Timing Constraints

Backend.AI Client Library for Python

基于 DPDK 和智能网卡的流量卸载试验. A flow offloading prototype base on DPDK and Mellanox/Nvidia SmartNIC.

A Pandas-inspired data analysis project with lazy semantics and query-offloading to SQLite