Commit Graph

9 Commits (8203d654450548ba2333ae510b3691d72eed91a0)

Author SHA1 Message Date
niansa/tuxifan 8203d65445 Fixed tons of warnings and clazy findings (#811) 1 year ago
Adam Treat f29d50eeef Better name for database results. 1 year ago
Adam Treat 8c6ee9d02e Make localdocs work with server mode. 1 year ago
AT 9c6c09cbd2 Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
1 year ago
Adam Treat 26afbde1ae Get rid of blocking behavior for regenerate response. 1 year ago
FoivosC 0e82d87032 construct and return the correct reponse when the request is a chat completion 1 year ago
Adam Treat 04d405b47f Generate the new prompt/response pair before model loading in server mode. 1 year ago
Adam Treat b9c063053a The server has different lifetime mgmt than the other chats. 1 year ago
Adam Treat e67b021948 httpserver 1 year ago