[Usage]: 怎么得到每一个输出token的logits，而不是softmax之后的logprob？

[TonyUSTC]

Your current environment

我需要softmax之前的logits，但是目前vllm好像返回不了logits，huggingface transformer是可以的。请问vllm怎么实现呢？

How would you like to use vllm

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[TonyUSTC]

我修改了下model_executor/layers/sampler.py，在Sample the next tokens之后，重置logprobs = logits。不够优雅，但是推理结果可以返回logits了

[youkaichao]

cc @DarkLight1337 can you give a usage example and then close the issue?

[DarkLight1337]

Please refer to the more detailed discussion in #11397.