an example for QAT with PyTorch framework
- you must apply qat and ptq convert on CPU, after you get the quantized int8 model, you can do inference on CUDA device
- usage:
python qat.py
-
Notifications
You must be signed in to change notification settings - Fork 1
RussWong/PyTorch-QAT
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published