Commit Graph

9 Commits (426aa5eb478ff63a59355a3b9c2338fabc1d21df)

Author SHA1 Message Date
Jared Van Bortel d2a99d9bc6
support the llama.cpp CUDA backend (#2310)
* rebase onto llama.cpp commit ggerganov/llama.cpp@d46dbc76f
* support for CUDA backend (enabled by default)
* partial support for Occam's Vulkan backend (disabled by default)
* partial support for HIP/ROCm backend (disabled by default)
* sync llama.cpp.cmake with upstream llama.cpp CMakeLists.txt
* changes to GPT4All backend, bindings, and chat UI to handle choice of llama.cpp backend (Kompute or CUDA)
* ship CUDA runtime with installed version
* make device selection in the UI on macOS actually do something
* model whitelist: remove dbrx, mamba, persimmon, plamo; add internlm and starcoder2

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
4 months ago
Jared Van Bortel 1427ef7195
chat: fix window icon on Windows (#2321)
* chat: fix window icon on Windows

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* chat: remove redundant copy of macOS app icon

This has been redundant since PR #2180.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
4 months ago
Adam Treat ecfeba2710 Revert "Speculative fix for windows llama models with installer."
This reverts commit c99e03e22e.
1 year ago
Adam Treat c99e03e22e Speculative fix for windows llama models with installer. 1 year ago
Adam Treat 969ff0ee6b Fix installers for windows and linux. 1 year ago
Adam Treat 812b2f4b29 Make installers work with mac/windows for big backend change. 1 year ago
Adam Treat afe3870b7a Libraries named differently on msvc. 1 year ago
Adam Treat a86a1aea6b Fix for windows/mac installers. 1 year ago
Adam Treat 6015154bef Moving everything to subdir for monorepo merge. 1 year ago