Skip to content

Official v1.0.0 Release - Preprocessing & XLA Pretraining Pipeline
Compare
Choose a tag to compare
@siddk siddk released this 07 Mar 01:44
· 8 commits to main since this release
v1.0.0
ed19236
This commit was created on github.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Completes the preprocessing -> pretraining -> model usage pipeline, by adding the full reference scripts for preprocessing the entire Sth-Sth-v2 dataset (for pretraining MVP, R3M, and Voltron models), as well as the PyTorch XLA pretraining script (again, for all models).

A "standard" PyTorch GPU/DDP pretraining implementation is in the works, but hopefully the logic transfers!

What's Changed

  • Add Preprocessing Pipeline for Sth-Sth-v2 by @siddk in #8
  • Add XLA Pretraining Script by @siddk in #10

Full Changelog: v0.0.1...v1.0.0

Contributors

siddk
Assets 4
Loading