Commit Graph

18 Commits (53cf2da5f7184d2351b66e2a0622bdee8c16d073)

Author SHA1 Message Date
Adam Treat 80024a029c Add new reverse prompt for new localdocs context feature. 1 year ago
Juuso Alasuutari 8d822f9898 llmodel: constify some casts in LLModelWrapper 1 year ago
Juuso Alasuutari f2528e6f62 llmodel: constify LLModel::threadCount() 1 year ago
Juuso Alasuutari f0b942d323 llmodel: fix wrong and/or missing prompt callback type
Fix occurrences of the prompt callback being incorrectly specified, or
the response callback's prototype being incorrectly used in its place.

Signed-off-by: Juuso Alasuutari <juuso.alasuutari@gmail.com>
1 year ago
Adam Treat 9e13f813d5 Only default mlock on macOS where swap seems to be a problem. 1 year ago
Adam Treat d5dd4e87de Always default mlock to true. 1 year ago
aaron miller 08f3bd2a82 backend: fix buffer overrun in repeat penalty code
Caught with AddressSanitizer running a basic prompt test against llmodel
standalone. This fix allows ASan builds to complete a simple prompt
without illegal accesses but there are still notably several leaks.
1 year ago
kuvaus 4f2b7f7be4 Bugfix on llmodel_model_create function
Fixes the bug where llmodel_model_create prints "Invalid model file" even though the model is loaded correctly. Credits and thanks to @serendipity for the fix.
1 year ago
kuvaus a0b98dc55d gpt4all-backend: Add llmodel create and destroy functions (#554)
* Add llmodel create and destroy functions

* Fix capitalization

* Fix capitalization

* Fix capitalization

* Update CMakeLists.txt

---------

Co-authored-by: kuvaus <kuvaus@users.noreply.github.com>
1 year ago
kuvaus 4f021ebcbb gpt4all-backend: Add MSVC support to backend (#595)
* Add MSVC compatibility

* Add _MSC_VER macro

---------

Co-authored-by: kuvaus <kuvaus@users.noreply.github.com>
1 year ago
Aaron Miller 9aaa355d41 backend: dedupe tokenizing code in mpt/gptj 1 year ago
Aaron Miller fc2869f0b7 backend: dedupe tokenizing code in gptj/mpt 1 year ago
Aaron Miller 16b7bf01a8 backend: make initial buf_size const in model impls
more unifying mpt and gptj code - this one's never written so also
changing the name to be clearer
1 year ago
Aaron Miller 0c9b7a6ae8 mpt: use buf in model struct (thread safety) 1 year ago
AT 48ca4a047c Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
1 year ago
Zach Nussbaum 53730c5f7f fix: use right conversion script 1 year ago
Adam Treat 8e7b96bd92 Move the llmodel C API to new top-level directory and version it. 1 year ago
Richard Guo 6304f6d322 mono repo structure 1 year ago