Commit Graph

18 Commits (01e582f15b0a617c46b131a00c499cdbf201482e)

Author SHA1 Message Date
Adam Treat 01e582f15b First attempt at providing a persistent chat list experience.
Limitations:

1) Context is not restored for gpt-j models
2) When you switch between different model types in an existing chat
   the context and all the conversation is lost
3) The settings are not chat or conversation specific
4) The sizes of the chat persisted files are very large due to how much
   data the llama.cpp backend tries to persist. Need to investigate how
   we can shrink this.
1 year ago
Adam Treat 97ec9074e5 Add reverse prompts for llama models. 1 year ago
Adam Treat 34407f1563 Don't set the app version in the llmodel. 1 year ago
Adam Treat 2a5b34b193 Load models from filepath only. 1 year ago
Adam Treat 70ab18f644 Update to latest llama.cpp 1 year ago
Adam Treat a3253c4ab1 Move the saving of the tokens to the impl and not the callbacks responsibility. 1 year ago
Adam Treat 9a65f73392 Move the promptCallback to own function. 1 year ago
Adam Treat ebf660d2bd Provide an initial impl. of the C interface. NOTE: has not been tested. 1 year ago
Adam Treat 368cd8e119 Add this and unbreak the build. 1 year ago
Adam Treat eafb98b3a9 Initial support for opt-in telemetry. 1 year ago
Adam Treat 70e6b45123 Don't crash when prompt is too large. 1 year ago
Adam Treat b04ab8fb5c Update llama.cpp submodule to latest. 1 year ago
Adam Treat ebc51b3e8d Clean up the docs a bit more still. 1 year ago
Adam Treat ae7ca04408 Clean up the docs a bit more. 1 year ago
Adam Treat 4e5c4927fc Clean up the docs a bit. 1 year ago
Adam Treat 04190e6107 Only need one opaque pointer. 1 year ago
Adam Treat d86b441c5d Fixup the api a bit. 1 year ago
Adam Treat 4b47478626 Move the backend code into own subdirectory and make it a shared library. Begin fleshing out the C api wrapper that bindings can use. 1 year ago