Popular repositories Loading

1. Nanoflow Nanoflow Public

   A throughput-oriented high-performance serving framework for LLMs

   Jupyter Notebook 945 46

2. Atom Atom Public

   [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

   Cuda 335 29

3. fiddler fiddler Public

   [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration

   Python 258 30

4. LiteASR LiteASR Public

   [EMNLP Main '25] LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation

   Python 147 5

5. lapidary lapidary Public archive

   Creating beautiful gem5 simulations

   C++ 49 13

6. DMon-AE DMon-AE Public

   DMon Prototype for OSDI 2021 Artifact Evaluation

   C++ 24 1