Skip to content

A repository designed to quickly guide you in writing custom TensorRT plugins.πŸš€

Notifications You must be signed in to change notification settings

Phoenix8215/Learn-TensorRT-Plugin-From-Scratch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

20 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

still work in process

This repository provides a step-by-step guide on how to write TensorRT plugins and conduct unit tests to ensure that the program's output aligns with our expectations.πŸ™ˆ

This repository will be regularly updated and contains the following custom plugins:

  • Scalar
  • Slice
  • LeakyRELU
  • Mish

The test directory contains unit tests for various plugins, while the src folder mainly demonstrates parsing ONNX files with custom operators during model inference, allowing them to be compiled by TensorRT for accelerated execution on the GPU.🀧

About

A repository designed to quickly guide you in writing custom TensorRT plugins.πŸš€

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published