Code

Speculative decoding using hf#3

Code

Open

JRosenkranz wants to merge 3 commits intospeculative-decodingtdoublep/text-generation-inference:speculative-decodingfrom speculative-decoding-using-hftdoublep/text-generation-inference:speculative-decoding-using-hfCopy head branch name to clipboard

+5-8

Commits

Commits on Apr 2, 2024

• added speculator as hf model

  JRosenkranz

  committed
  821d1c2

  Copy full SHA for 821d1c2

• fixed merge conflicts

  JRosenkranz

  committed
  3234828

  Copy full SHA for 3234828

• re-added sample

  JRosenkranz

  committed
  0b25d59

  Copy full SHA for 0b25d59