Code

speculative decoding#630

Code

Merged

research4pan merged 4 commits intoOptimalScale:mainOptimalScale/LMFlow:mainfrom wheresmyhair:mainwheresmyhair/LMFlow-speculative-decoding:mainCopy head branch name to clipboardSep 6, 2023

+275

Commits

Commits on Aug 29, 2023

• spec inf

  wheresmyhair

  committed
  fc6fc68

  Copy full SHA for fc6fc68

Commits on Aug 30, 2023

• spec inf tested

  wheresmyhair

  committed
  97f79c6

  Copy full SHA for 97f79c6

Commits on Sep 5, 2023

• Merge branch 'OptimalScale:main' into main

  wheresmyhair

  authored
  832613d

  Copy full SHA for 832613d

Commits on Sep 6, 2023

• SpeculativeInferencer bug fix

  wheresmyhair

  committed
  0d5cc9d

  Copy full SHA for 0d5cc9d