Commit Graph

11 Commits (b36ea3dde56335cbf4489934ab3b961a7265870d)

Author SHA1 Message Date
Adam Treat b36ea3dde5 Fix up for newer models on reset context. This fixes the model from totally failing after a reset context. 1 year ago
AT b5971b0d41 Backend prompt dedup (#822)
* Deduplicated prompt() function code
1 year ago
Richard Guo 67b7641390 fixed finding model libs 1 year ago
Adam Treat 7ee32d605f Trying to shrink the copy+paste code and do more code sharing between backend model impl. 1 year ago
niansa ab56119470 Fixed double-free in LLModel::Implementation destructor 1 year ago
niansa/tuxifan 8aa707fdb4 Cleaned up implementation management (#787)
* Cleaned up implementation management

* Initialize LLModel::m_implementation to nullptr

* llmodel.h: Moved dlhandle fwd declare above LLModel class
1 year ago
Adam Treat 8be42683ac Add fixme's and clean up a bit. 1 year ago
niansa b68d359b4f Dlopen better implementation management (Version 2) 1 year ago
AT 9c6c09cbd2 Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
1 year ago
Juuso Alasuutari f2528e6f62 llmodel: constify LLModel::threadCount() 1 year ago
Adam Treat 8e7b96bd92 Move the llmodel C API to new top-level directory and version it. 1 year ago