Commit Graph

12 Commits (21df8a771eea4c4a000ff9a383c08ed4ddc9b757)

Author SHA1 Message Date
Peter Gagarinov 21df8a771e Only default mlock on macOS where swap seems to be a problem
Repeating the change that once was done in https://github.com/nomic-ai/gpt4all/pull/663 but then was overriden by 9c6c09cbd2

Signed-off-by: Peter Gagarinov <pgagarinov@users.noreply.github.com>
1 year ago
niansa/tuxifan 8203d65445 Fixed tons of warnings and clazy findings (#811) 1 year ago
Adam Treat 7ee32d605f Trying to shrink the copy+paste code and do more code sharing between backend model impl. 1 year ago
niansa b68d359b4f Dlopen better implementation management (Version 2) 1 year ago
AT 9c6c09cbd2 Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
1 year ago
Adam Treat 80024a029c Add new reverse prompt for new localdocs context feature. 1 year ago
Juuso Alasuutari f2528e6f62 llmodel: constify LLModel::threadCount() 1 year ago
Adam Treat 9e13f813d5 Only default mlock on macOS where swap seems to be a problem. 1 year ago
Adam Treat d5dd4e87de Always default mlock to true. 1 year ago
aaron miller 08f3bd2a82 backend: fix buffer overrun in repeat penalty code
Caught with AddressSanitizer running a basic prompt test against llmodel
standalone. This fix allows ASan builds to complete a simple prompt
without illegal accesses but there are still notably several leaks.
1 year ago
kuvaus 4f021ebcbb gpt4all-backend: Add MSVC support to backend (#595)
* Add MSVC compatibility

* Add _MSC_VER macro

---------

Co-authored-by: kuvaus <kuvaus@users.noreply.github.com>
1 year ago
Adam Treat 8e7b96bd92 Move the llmodel C API to new top-level directory and version it. 1 year ago