Popular repositories Loading

1. TRTLLM-w4afp8-fp8-mix-inference TRTLLM-w4afp8-fp8-mix-inference Public

   Python 3 1

2. FasterTransformer FasterTransformer Public

   Forked from NVIDIA/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++

3. Swin-Transformer Swin-Transformer Public

   Forked from microsoft/Swin-Transformer

   This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

   Python

4. smoothquant smoothquant Public

   Forked from mit-han-lab/smoothquant

   SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

   Python

5. apex apex Public

   Forked from NVIDIA/apex

   A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

   Python

6. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++