Commit Graph

64 Commits

Author SHA1 Message Date
Adam Treat
04d405b47f Generate the new prompt/response pair before model loading in server mode. 2023-05-16 10:31:55 -04:00
Adam Treat
62ccd95f3d Add save/restore to chatgpt chats and allow serialize/deseralize from disk. 2023-05-16 10:31:55 -04:00
Adam Treat
97e1813494 Add large network icon background for chatgpt and server modes. 2023-05-16 10:31:55 -04:00
Adam Treat
fc6ab1f776 Preliminary support for chatgpt models. 2023-05-16 10:31:55 -04:00
Adam Treat
22dc2bc5d2 Use compact json format. 2023-05-16 10:31:55 -04:00
Adam Treat
b9c063053a The server has different lifetime mgmt than the other chats. 2023-05-13 19:34:54 -04:00
Adam Treat
4448600e60 Much better memory mgmt for multi-threaded model loading/unloading. 2023-05-13 19:10:56 -04:00
Adam Treat
e67b021948 httpserver 2023-05-13 19:07:06 -04:00
Adam Treat
e781aaa4c5 Cleanup the chatllm properly. 2023-05-12 17:11:52 -04:00
Adam Treat
4d16fe0aad Fix typo. 2023-05-11 16:48:20 -04:00
AT
5f07494b2f Update README.md 2023-05-11 15:31:01 -04:00
AT
d1a940ea3b Update README.md 2023-05-10 12:10:33 -04:00
Adam Treat
8e7b96bd92 Move the llmodel C API to new top-level directory and version it. 2023-05-10 11:46:40 -04:00
Adam Treat
3bc9fee16e Moving everything to subdir for monorepo merge. 2023-05-10 10:26:55 -04:00