Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

errors in executing in LSUN-bed w8a8 quantization #24

Open
Sugar929 opened this issue Oct 12, 2023 · 0 comments
Open

errors in executing in LSUN-bed w8a8 quantization #24

Sugar929 opened this issue Oct 12, 2023 · 0 comments

Comments

@Sugar929
Copy link

my cmd:
python scripts/sample_diffusion_ldm.py -r models/ldm/lsun_beds256/model.ckpt -n 32 --batch_size 16 -c 50 -e 0.0 --seed 41 --ptq --weight_bit 8 --quant_act --act_bit 8 --a_sym --resume -l log/ --cali_ckpt bedroom_w8a8_ckpt.pth

the error:

RuntimeError: Error(s) in loading state_dict for QuantModel:
        Unexpected key(s) in state_dict: "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_q.delta", "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_q.zero_point", "model.input_blocks.4.1.attention.qkv_matmul.act_quantizer_k.delta",....

I guess the w8a8.pth aren't updated in the cloud?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant