Code

Auto convert moe param groups#5354

Code

Merged

loadams merged 9 commits intomicrosoft:mastermicrosoft/DeepSpeed:masterfrom Snowflake-Labs:auto-param-groupSnowflake-Labs/DeepSpeed:auto-param-groupCopy head branch name to clipboardApr 5, 2024

+69-1

Commits

Commits on Apr 2, 2024

• ensure capacity does not exceed number of tokens

  jeffra

  committed
  d6d1bfe

  Copy full SHA for d6d1bfe

• auto convert moe param groups

  jeffra

  committed
  c96e350

  Copy full SHA for c96e350

• remove unrelated test

  jeffra

  committed
  e942e76

  Copy full SHA for e942e76

• Update test_moe.py

  jeffra

  authored
  2c42ef1

  Copy full SHA for 2c42ef1

• Merge branch 'master' into auto-param-group

  jeffra

  authored
  5905f9b

  Copy full SHA for 5905f9b

Commits on Apr 4, 2024

• Merge branch 'master' into auto-param-group

  jeffra

  authored
  955e37c

  Copy full SHA for 955e37c

Commits on Apr 5, 2024

• address comments

  jeffra

  authored
  9bd9a1f

  Copy full SHA for 9bd9a1f

• Merge branch 'master' into auto-param-group

  jeffra

  authored
  0fc1020

  Copy full SHA for 0fc1020

• formatting

  sfc-gh-jrasley

  committed
  54a8a32

  Copy full SHA for 54a8a32