Commit Graph

9 Commits (d3984e532a480395950a3422680c221c994fa01d)

Author SHA1 Message Date
Richard Guo 67b7641390 fixed finding model libs 1 year ago
Adam Treat 7ee32d605f Trying to shrink the copy+paste code and do more code sharing between backend model impl. 1 year ago
niansa ab56119470 Fixed double-free in LLModel::Implementation destructor 1 year ago
niansa/tuxifan 8aa707fdb4 Cleaned up implementation management (#787)
* Cleaned up implementation management

* Initialize LLModel::m_implementation to nullptr

* llmodel.h: Moved dlhandle fwd declare above LLModel class
1 year ago
Adam Treat 8be42683ac Add fixme's and clean up a bit. 1 year ago
niansa b68d359b4f Dlopen better implementation management (Version 2) 1 year ago
AT 9c6c09cbd2 Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
1 year ago
Juuso Alasuutari f2528e6f62 llmodel: constify LLModel::threadCount() 1 year ago
Adam Treat 8e7b96bd92 Move the llmodel C API to new top-level directory and version it. 1 year ago