Adam Treat
f29d50eeef
Better name for database results.
2023-06-01 17:14:17 -04:00
Adam Treat
8c6ee9d02e
Make localdocs work with server mode.
2023-06-01 17:14:17 -04:00
AT
9c6c09cbd2
Dlopen backend 5 ( #779 )
...
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
2023-05-31 17:04:01 -04:00
Adam Treat
26afbde1ae
Get rid of blocking behavior for regenerate response.
2023-05-30 18:17:59 -04:00
FoivosC
0e82d87032
construct and return the correct reponse when the request is a chat completion
2023-05-30 16:34:23 -04:00
Adam Treat
04d405b47f
Generate the new prompt/response pair before model loading in server mode.
2023-05-16 10:31:55 -04:00
Adam Treat
b9c063053a
The server has different lifetime mgmt than the other chats.
2023-05-13 19:34:54 -04:00
Adam Treat
e67b021948
httpserver
2023-05-13 19:07:06 -04:00