nvfuser

Here are 2 public repositories matching this topic...

stochasticai / x-stable-diffusion

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

docker notebook cuda inference pytorch automl tensorrt onnx onnxruntime stable-diffusion aitemplate nvfuser

Updated Dec 4, 2023
Jupyter Notebook

elvinagam / benchmarking_gpu_inference

Star

Scripts from Neural network inference on Pytorch with tools like ONNX, TensorRT, nvFuser, TorchDynamo, Triton

amp transformers pytorch tensorrt onnx nvfuser torchdynamo

Updated Nov 15, 2022
Jupyter Notebook

Improve this page

Add a description, image, and links to the nvfuser topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the nvfuser topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly