Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Question about running INT4 example #8

Open
ThisisBillhe opened this issue Mar 17, 2023 · 0 comments
Open

Question about running INT4 example #8

ThisisBillhe opened this issue Mar 17, 2023 · 0 comments

Comments

@ThisisBillhe
Copy link

Thanks for your excellent work! However, I got some problems running this example

  1. Do I have to install TensorRT in order to run this example? If so, where can I find a guide to install it (e.g. what version of TensorRT should I use)?
  2. Can I running this INT4 example on my RTX3090 GPU? or it has to be A2?
  3. When I running this example, I got an error of
    File "/home/hyf/anaconda3/lib/python3.9/site-packages/megengine/utils/comp_graph_tools.py", line 499, in run
    self._func.execute()
    RuntimeError: var sanity check failed: var: {id:516, layout:{512(2048),32(64),1(64),1(64),64(1) @ LOWBITS{4,8} QuantizedS4}, QuantizedS4, owner:fuse():dimshuffle(reshape[3158])[3160]@3161{ImmutableTensor}, name:fuse():dimshuffle(reshape[3158])[3160]@3161, slot:0, CompNode("gpu0:0" from "xpux:0"), s, 2, 2} (checksum: expect={checksum:0x2d819168, last_int:1412490702, last_float:3.03908e+12} got={checksum:0x9b352857, last_int:1412490702, last_float:3.03908e+12}); receiver: conv_bias(conv_bias[4275],fuse[3160]@3161,const{1,8,1,1,64}[3182])[4282]{ConvBiasForward}(864); you can set MGB_DEBUG_VAR_SANITY_CHECK_LOG=516 to get more details; pass=0
    How can I fix this?

Looking forward to your reply!!

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant