Commit Graph

18 Commits (45d796743801d6e3f4d4e516655d99fa69226b72)

Author SHA1 Message Date
Adam Treat 2206fa7f8c Provide a user default model setting and honor it. 1 year ago
Adam Treat 9c008fb677 Simplify. 1 year ago
Adam Treat 53a39b9ecf Don't keep this in memory when it is not needed. 1 year ago
Adam Treat 5f372bd881 Gracefully handle when we have a previous chat where the model that it used has gone away. 1 year ago
Adam Treat 8c4b8f215f Fix gptj to have lower memory requirements for kv cache and add versioning to the internal state to smoothly handle such a fix in the future. 1 year ago
Zach Nussbaum 6a56bcaf06 feat: load model 1 year ago
Zach Nussbaum 58069dc8b9 chore: import for mpt 1 year ago
Adam Treat 40b976436a Only generate three words max. 1 year ago
Adam Treat 3c30310539 Convert the old format properly. 1 year ago
Adam Treat 7b66cb7119 Add debug for chatllm model loading and fix order of getting rid of the
dummy chat when no models are restored.
1 year ago
Adam Treat e397fda250 Bump the version and save up to an order of magnitude of disk space for chat files. 1 year ago
Adam Treat 5b71d39024 Don't crash if state has not been set. 1 year ago
Adam Treat f291853e51 First attempt at providing a persistent chat list experience.
Limitations:

1) Context is not restored for gpt-j models
2) When you switch between different model types in an existing chat
   the context and all the conversation is lost
3) The settings are not chat or conversation specific
4) The sizes of the chat persisted files are very large due to how much
   data the llama.cpp backend tries to persist. Need to investigate how
   we can shrink this.
1 year ago
Adam Treat 081d32bd97 Restore the model when switching chats. 1 year ago
Adam Treat 4a09f0f0ec More extensive usage stats to help diagnose errors and problems in the ui. 1 year ago
Adam Treat f13f4f4700 Generate names via llm. 1 year ago
Adam Treat 412cad99f2 Hot swapping of conversations. Destroys context for now. 1 year ago
Adam Treat 4d87c46948 Major refactor in prep for multiple conversations. 1 year ago