Skip to content

[WIP][Speculative Decoding] Enable batch size > 1 - #26875

Closed
patrickvonplaten wants to merge 9 commits into
mainfrom
assistant_decoding_batch
Closed

[WIP][Speculative Decoding] Enable batch size > 1#26875
patrickvonplaten wants to merge 9 commits into
mainfrom
assistant_decoding_batch

Commits

  1. Commits on Oct 16, 2023

  2. Commits on Oct 17, 2023

  3. Commits on Nov 2, 2023