Discussions

• 1 You must be logged in to vote

  #️⃣

  Support AOTInductor compilation and packaging with Torch-TensorRT modules

  peri044 started Nov 19, 2024 in RFCs

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Automatic plugin generation using custom kernels and host code

  bowang007 started Oct 1, 2024 in RFCs

  

  

  2
• 2 You must be logged in to vote

  #️⃣

  Support data dependent shapes (no fallback)

  bowang007 started Feb 28, 2023 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Building Refittable Engines by Default

  narendasan started Oct 2, 2024 in RFCs

  

  

  

  

  7
• 3 You must be logged in to vote

  🙏

  ❓ [Question] How do you convert part of the model to TRT?

  question Further information is requested

  MarekPokropinski asked Feb 18, 2022 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  Support for loading multiple LORA adapters at runtime

  naiveen asked Feb 26, 2024 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  CUDAGraphs in Torch-TRT

  gs-olive started Apr 9, 2024 in RFCs

  

  

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  Multi node support in Torch-TRT

  apbose started Aug 7, 2024 in RFCs

  

  

  0
• 1 You must be logged in to vote

  💬

  torch_tensorrt.dynamo.compile creates flawed output

  AIManifest started Aug 6, 2024 in General

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Engine Caching

  zewenli98 started Jun 26, 2024 in RFCs

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  Model Weight Refit

  cehongwang started Jun 7, 2024 in RFCs

  

  

  2
• 1 You must be logged in to vote

  🙏

  How can I use bfloat16 with tensorrt?

  vedantroy asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to save results of using torch.compile with tensorrt backend?

  ved-genmo asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to enable fp16 with torch-tensorrt backend?

  vedantroy asked Jun 17, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v2.3.0

  narendasan started Jun 7, 2024 in Show and tell

  

  

  0
• 3 You must be logged in to vote

  #️⃣

  Model Weight Refit in FX

  RFC: Under Review This RFC is under review

  gs-olive started Feb 17, 2023 in RFCs

  

  

  1
• 2 You must be logged in to vote

  🙏

  Can't convert torchvision MaskRCNN model to TensorRT

  nxlitvin asked Nov 1, 2023 in Q&A · Unanswered

  

  

  

  

  13
• 1 You must be logged in to vote

  🙏

  Fails intermittently when intermediate layers produce large tensors

  naiveen asked Feb 29, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙌

  Torch-TensorRT v2.2.0

  narendasan started Feb 14, 2024 in Show and tell

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Dynamic shapes support for tensorrt backend in torch.compile

  peri044 started Feb 2, 2024 in RFCs

  

  

  1
• 1 You must be logged in to vote

  💬

  release torch-tensorrt >= v2.1.0

  bjaeger1 started Feb 5, 2024 in General · Closed

  

  

  0
• 1 You must be logged in to vote

  🙏

  Converting classification model from pytorch to onnx to tensorrt , and following tensorrt pynb for inference and using tensorrt 8.6

  Abiganesh asked Dec 13, 2023 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  ⚙️

  Torch-TensorRT Dynamo Design Documentation for Developers

  gs-olive started Nov 17, 2023 in Internals

  

  

  2
• 4 You must be logged in to vote

  #️⃣

  INT8 support in dynamo workflows

  peri044 started Nov 13, 2023 in RFCs

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Dynamic shapes for torch.export

  peri044 started Oct 23, 2023 in RFCs

  

  

  2