Commit Graph

8 Commits

Author SHA1 Message Date
Adam Treat
f29d50eeef Better name for database results. 2023-06-01 17:14:17 -04:00
Adam Treat
8c6ee9d02e Make localdocs work with server mode. 2023-06-01 17:14:17 -04:00
AT
9c6c09cbd2 Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
2023-05-31 17:04:01 -04:00
Adam Treat
26afbde1ae Get rid of blocking behavior for regenerate response. 2023-05-30 18:17:59 -04:00
FoivosC
0e82d87032 construct and return the correct reponse when the request is a chat completion 2023-05-30 16:34:23 -04:00
Adam Treat
04d405b47f Generate the new prompt/response pair before model loading in server mode. 2023-05-16 10:31:55 -04:00
Adam Treat
b9c063053a The server has different lifetime mgmt than the other chats. 2023-05-13 19:34:54 -04:00
Adam Treat
e67b021948 httpserver 2023-05-13 19:07:06 -04:00