Commit Graph

5 Commits (53a39b9ecf6c190e93788843277a482373d95036)

Author SHA1 Message Date
Zach Nussbaum 6a56bcaf06 feat: load model 1 year ago
Adam Treat f291853e51 First attempt at providing a persistent chat list experience.
Limitations:

1) Context is not restored for gpt-j models
2) When you switch between different model types in an existing chat
   the context and all the conversation is lost
3) The settings are not chat or conversation specific
4) The sizes of the chat persisted files are very large due to how much
   data the llama.cpp backend tries to persist. Need to investigate how
   we can shrink this.
1 year ago
Adam Treat ba4b28fcd5 Move the promptCallback to own function. 1 year ago
Adam Treat 0e9f85bcda Provide an initial impl. of the C interface. NOTE: has not been tested. 1 year ago
Adam Treat b19d2f2c21 Add this and unbreak the build. 1 year ago