New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

使用deepspeed lora 4bit 微调完，如何多卡4bit推理呢？ #64

Open

Baitlo opened this issue Feb 14, 2025 · 0 comments

Baitlo commented Feb 14, 2025

可以给一个deepspeed lora 4bit 微调完的推理脚本吗？

順頌時祺～

Baitlo changed the title ~~使用deepspeed lora 4bit 微调完，如何推理呢？~~ 使用deepspeed lora 4bit 微调完，如何多卡4bit推理呢？

# for free to join this conversation on GitHub. Already have an account? # to comment