Commit Graph

5 Commits (a548448fcfbba369e13595c8232609e174e1a3d8)

Author SHA1 Message Date
Aaron Miller 56e9fd7e63 include <cstdint> in llmodel.h 1 year ago
Adam Treat 01e582f15b First attempt at providing a persistent chat list experience.
Limitations:

1) Context is not restored for gpt-j models
2) When you switch between different model types in an existing chat
   the context and all the conversation is lost
3) The settings are not chat or conversation specific
4) The sizes of the chat persisted files are very large due to how much
   data the llama.cpp backend tries to persist. Need to investigate how
   we can shrink this.
1 year ago
Adam Treat 2a5b34b193 Load models from filepath only. 1 year ago
Adam Treat 9a65f73392 Move the promptCallback to own function. 1 year ago
Adam Treat 4b47478626 Move the backend code into own subdirectory and make it a shared library. Begin fleshing out the C api wrapper that bindings can use. 1 year ago