Code

Server: try to refactor server.cpp#5065

Code

Merged

ggerganov merged 8 commits intoggerganov:masterggerganov/llama.cpp:masterfrom ngxson:xsn/clean_up_serverngxson/llama.cpp:xsn/clean_up_serverCopy head branch name to clipboardJan 26, 2024

+869-685

Commits

Commits on Jan 19, 2024

• server: add llama_server_queue struct

  ngxson

  committed
  6e29f4c

Commits on Jan 21, 2024

• server: add llama_server_response_event

  ngxson

  committed
  12829b2

• server: add comments

  ngxson

  committed
  906afe7

Commits on Jan 22, 2024

• Merge branch 'master' into xsn/clean_up_server

  ngxson

  committed
  58fe9cf

• server: move all mutexes away from server.cpp

  ngxson

  committed
  d87b48f

• server: correct multitask response

  ngxson

  committed
  1bd8678

• server: only add back deferred tasks when one slot is available

  ngxson

  committed
  d083c81

Commits on Jan 23, 2024

• server: fix a race condition cause by "request_completion"

  ngxson

  committed
  8f36df8