AttributeError: 'MPLUGOwl2Config' object has no attribute 'mlp_bias'

[senp98]

Thank you for your excellent work!
I met this problem when I ran the test using the metric qalign_8bit. I think this is due to the conflict between this work and the newest transformers package. Is this version of transformers not supported yet? You may try to reproduce this bug by installing the transformers=4.46.3.

[chaofengc]

Yes, qalign depends on MPLUGOwl2 and needs specific transformer version transformers==4.37.2 as in requirements.txt

[JaneWu423]

If you need newer version of transformers, maybe try to fix following this reply from QAlign issues, this works for me with transformers==4.45.0.