Adam Treat
a84bcccb3a
Better error handling when the model fails to load.
2023-06-04 14:55:05 -04:00
niansa/tuxifan
8203d65445
Fixed tons of warnings and clazy findings ( #811 )
2023-06-02 15:46:41 -04:00
Adam Treat
e0dcf6a14f
Fix bug with resetting context with chatgpt model.
2023-06-01 17:34:13 -04:00
Adam Treat
f29d50eeef
Better name for database results.
2023-06-01 17:14:17 -04:00
Adam Treat
8c6ee9d02e
Make localdocs work with server mode.
2023-06-01 17:14:17 -04:00
Adam Treat
ae20274a1d
Fix compile
2023-06-01 10:58:31 -04:00
niansa
b68d359b4f
Dlopen better implementation management (Version 2)
2023-06-01 07:44:15 -04:00
AT
9c6c09cbd2
Dlopen backend 5 ( #779 )
...
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
2023-05-31 17:04:01 -04:00
Adam Treat
26afbde1ae
Get rid of blocking behavior for regenerate response.
2023-05-30 18:17:59 -04:00
Adam Treat
c33bf0e895
Add prompt processing and localdocs to the busy indicator in UI.
2023-05-25 11:28:06 -04:00
Adam Treat
837ece220f
Turn off the debugging messages by default.
2023-05-25 11:28:06 -04:00
Adam Treat
75a90399a7
localdocs
2023-05-25 11:28:06 -04:00
Adam Treat
04d405b47f
Generate the new prompt/response pair before model loading in server mode.
2023-05-16 10:31:55 -04:00
Adam Treat
62ccd95f3d
Add save/restore to chatgpt chats and allow serialize/deseralize from disk.
2023-05-16 10:31:55 -04:00
Adam Treat
97e1813494
Add large network icon background for chatgpt and server modes.
2023-05-16 10:31:55 -04:00
Adam Treat
fc6ab1f776
Preliminary support for chatgpt models.
2023-05-16 10:31:55 -04:00
Adam Treat
b9c063053a
The server has different lifetime mgmt than the other chats.
2023-05-13 19:34:54 -04:00
Adam Treat
4448600e60
Much better memory mgmt for multi-threaded model loading/unloading.
2023-05-13 19:10:56 -04:00
Adam Treat
e67b021948
httpserver
2023-05-13 19:07:06 -04:00
Adam Treat
e781aaa4c5
Cleanup the chatllm properly.
2023-05-12 17:11:52 -04:00
Adam Treat
8e7b96bd92
Move the llmodel C API to new top-level directory and version it.
2023-05-10 11:46:40 -04:00
Adam Treat
3bc9fee16e
Moving everything to subdir for monorepo merge.
2023-05-10 10:26:55 -04:00