Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Add Internlm2 support #576

Merged
merged 6 commits into from
Aug 12, 2024
Merged

Add Internlm2 support #576

merged 6 commits into from
Aug 12, 2024

Conversation

Crystalcareai
Copy link
Contributor

@Crystalcareai Crystalcareai commented Aug 8, 2024

This pull request implements support for InterLM2 in AutoAWQ. The integration has been successfully tested and generates high-quality output.

Changes include:

Added InterLM2 configurations to:
    models/init.py
    models/auto.py
    models/base.py

Created a new file_: models/internlm2.py

Updated setup.py to include additional dependencies:
    protobuf
    sentencepiece
    einops

Note: If there's a more efficient way to manage model-specific dependencies, it might be preferable to the current approach of adding them to the global requirements.

@casper-hansen casper-hansen merged commit 6f14fc7 into casper-hansen:main Aug 12, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants