This repository was archived by the owner on May 15, 2023. It is now read-only.

FAQs

Can you train StableLM with this? Yes, but only with a single GPU atm. Multi GPU support is coming soon! Just waiting on this PR
Will this work with Deepspeed? That's still a WIP, but setting export ACCELERATE_USE_DEEPSPEED=true should work in some cases