Commit Graph

10 Commits (eb77d5157b6166d7a2034001628ef92a41e6bb06)

Author SHA1 Message Date
Zach Nussbaum 6a56bcaf06 feat: load model 1 year ago
Adam Treat f291853e51 First attempt at providing a persistent chat list experience.
Limitations:

1) Context is not restored for gpt-j models
2) When you switch between different model types in an existing chat
   the context and all the conversation is lost
3) The settings are not chat or conversation specific
4) The sizes of the chat persisted files are very large due to how much
   data the llama.cpp backend tries to persist. Need to investigate how
   we can shrink this.
1 year ago
Adam Treat ba4b28fcd5 Move the promptCallback to own function. 1 year ago
Adam Treat 0e9f85bcda Provide an initial impl. of the C interface. NOTE: has not been tested. 1 year ago
Adam Treat fd0f92a94e Clean up the docs a bit more still. 1 year ago
Adam Treat c89096ccb4 Clean up the docs a bit more. 1 year ago
Adam Treat ac7ecd2cef Clean up the docs a bit. 1 year ago
Adam Treat 832b5d1a96 Only need one opaque pointer. 1 year ago
Adam Treat 102f68b18c Fixup the api a bit. 1 year ago
Adam Treat 3c9139b5d2 Move the backend code into own subdirectory and make it a shared library. Begin fleshing out the C api wrapper that bindings can use. 1 year ago