Skip to content

[Frontend] OpenAI server: propagate usage accounting to FastAPI middleware layer#8672

Merged
DarkLight1337 merged 2 commits intovllm-project:mainfrom agt:pr/usage-propagationSep 25, 2024
+57-11

Commits

Commits on Sep 24, 2024