Code

[torch.compile] support moe models#9632

Code

Merged

youkaichao merged 7 commits intovllm-project:mainvllm-project/vllm:mainfrom youkaichao:compile_moeyoukaichao/vllm:compile_moeCopy head branch name to clipboardOct 28, 2024

Commits

Commits on Oct 23, 2024

• register custom op

  Show description for 7addc59
  youkaichao

  committed
  7addc59

  Copy full SHA for 7addc59

• add support for moe

  Show description for b44ecde
  youkaichao

  committed
  b44ecde

  Copy full SHA for b44ecde

• avoid import for platforms

  Show description for 395dcc8
  youkaichao

  committed
  395dcc8

  Copy full SHA for 395dcc8

• add support

  Show description for 92bd7a5
  youkaichao

  committed
  92bd7a5

  Copy full SHA for 92bd7a5

• switch tests

  Show description for 6cd914f
  youkaichao

  committed
  6cd914f

  Copy full SHA for 6cd914f

Commits on Oct 28, 2024

• Merge branch 'main' into compile_moe

  youkaichao

  committed
  13a1033

  Copy full SHA for 13a1033

• trigger register

  Show description for 0bd5c5f
  youkaichao

  committed
  0bd5c5f

  Copy full SHA for 0bd5c5f