Commit Graph

5 Commits (53a39b9ecf6c190e93788843277a482373d95036)

Author SHA1 Message Date
Aaron Miller 019f6d0103 include <cstdint> in llmodel.h 1 year ago
Adam Treat f291853e51 First attempt at providing a persistent chat list experience.
Limitations:

1) Context is not restored for gpt-j models
2) When you switch between different model types in an existing chat
   the context and all the conversation is lost
3) The settings are not chat or conversation specific
4) The sizes of the chat persisted files are very large due to how much
   data the llama.cpp backend tries to persist. Need to investigate how
   we can shrink this.
1 year ago
Adam Treat 69f92d8ea8 Load models from filepath only. 1 year ago
Adam Treat ba4b28fcd5 Move the promptCallback to own function. 1 year ago
Adam Treat 3c9139b5d2 Move the backend code into own subdirectory and make it a shared library. Begin fleshing out the C api wrapper that bindings can use. 1 year ago