Commit Graph

26 Commits (4193533154fc227bf6ce40ec1dff19aba1ee3929)

Author SHA1 Message Date
Jared Van Bortel 406e88b59a
implement local Nomic Embed via llama.cpp (#2086)
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
6 months ago
Adam Treat f36a2874eb Clean up settings properly for removed models and also when user manually deletes.
Signed-off-by: Adam Treat <treat.adam@gmail.com>
6 months ago
Adam Treat 08b5dc8598 Batch all operations for updateData to avoid excessive sort.
Signed-off-by: Adam Treat <treat.adam@gmail.com>
7 months ago
Jared Van Bortel 5a874be7c1
modellist: rename "deprecated" to "removedIn", disable if equal (#2063)
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
7 months ago
Adam Treat 83c76be68a Model discovery.
Signed-off-by: Adam Treat <treat.adam@gmail.com>
7 months ago
Jared Van Bortel f500bcf6e5
llmodel: default to a blank line between reply and next prompt (#1996)
Also make some related adjustments to the provided Alpaca-style prompt templates
and system prompts.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
7 months ago
chrisbarrera f8b1069a1c
add min_p sampling parameter (#2014)
Signed-off-by: Christopher Barrera <cb@arda.tx.rr.com>
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
7 months ago
Adam Treat d14b95f4bd Add Nomic Embed model for atlas with localdocs. 8 months ago
Jared Van Bortel 061d1969f8
expose n_gpu_layers parameter of llama.cpp (#1890)
Also dynamically limit the GPU layers and context length fields to the maximum supported by the model.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
8 months ago
Jared Van Bortel d1c56b8b28
Implement configurable context length (#1749) 9 months ago
Adam Treat 9a3dd8815d Fix GUI hang with localdocs by removing file system watcher in modellist. 10 months ago
Adam Treat 371e2a5cbc LocalDocs version 2 with text embeddings. 10 months ago
Cebtenzzre 31b20f093a modellist: fix the system prompt 12 months ago
AMOGUS 4974ae917c Update default TopP to 0.4
TopP 0.1 was found to be somewhat too aggressive, so a more moderate default of 0.4 would be better suited for general use.

Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>
1 year ago
Adam Treat 60627bd41f Prefer 7b models in order of default model load. 1 year ago
Adam Treat e9897518d1 Show busy if models.json download taking longer than expected. 1 year ago
Adam Treat 98dd2ab4bc Provide backup options if models.json does not download synchronously. 1 year ago
Adam Treat 27981c0d21 Fix broken download/remove/install. 1 year ago
Adam Treat 6d9cdf228c Huge change that completely revamps the settings dialog and implements
per model settings as well as the ability to clone a model into a "character."
This also implements system prompts as well as quite a few bugfixes for
instance this fixes chatgpt.
1 year ago
Adam Treat 285aa50b60 Consolidate generation and application settings on the new settings object. 1 year ago
Adam Treat e70899a26c Make the retrieval/parsing of models.json sync on startup. We were jumping to many hoops to mitigate the async behavior. 1 year ago
Adam Treat c24ad02a6a Wait just a bit to set the model name so that we can display the proper name instead of filename. 1 year ago
Adam Treat d0a3e82ffc Restore feature I accidentally erased in modellist update. 1 year ago
Adam Treat 64e98b8ea9 Fix bug with model loading on initial load. 1 year ago
Adam Treat 27f25d5878 Get rid of recursive mutex. 1 year ago
Adam Treat 7f01b153b3 Modellist temp 1 year ago