Commit Graph

26 Commits

Author SHA1 Message Date
Adam Treat
795715fb59 Don't crash starting with no model. 2023-04-20 07:17:07 -04:00
Adam Treat
71b308e914 Add llama.cpp support for loading llama based models in the gui. We now
support loading both gptj derived models and llama derived models.
2023-04-20 06:19:09 -04:00
Aaron Miller
00cb5fe2a5 Add thread count setting 2023-04-19 08:33:13 -04:00
Adam Treat
169afbdc80 Add a new model download feature. 2023-04-18 21:10:06 -04:00
Adam Treat
2b1cae5a7e Allow unloading/loading/changing of models. 2023-04-18 11:42:38 -04:00
Adam Treat
f73fbf28a4 Fix the context. 2023-04-17 14:11:41 -04:00
Adam Treat
a7c2d65824 Don't allow empty prompts. Context past always equal or greater than zero. 2023-04-16 14:57:58 -04:00
Adam Treat
4bf4b2a080 Trim trailing whitespace at the end of generation. 2023-04-16 14:19:59 -04:00
Adam Treat
9381a69b2b Remove newlines too. 2023-04-16 14:04:25 -04:00
Adam Treat
b39acea516 More conservative default params and trim leading whitespace from response. 2023-04-16 13:56:56 -04:00
Aaron Miller
5bfb3f8229 use the settings dialog settings when generating 2023-04-16 11:16:30 -04:00
Adam Treat
a77946e745 Provide an instruct/chat template. 2023-04-15 16:33:37 -04:00
Aaron Miller
391904efae Use completeBaseName to display model name
this cuts the filename at the *final* dot instead of the first, allowing
model names with version numbers to be displayed correctly.
2023-04-15 13:29:51 -04:00
Adam Treat
078b755ab8 Erase the correct amount of logits when regenerating which is not the same
as the number of tokens.
2023-04-15 09:19:54 -04:00
Adam Treat
b1bb9866ab Fix crash with recent change to erase context. 2023-04-15 09:10:34 -04:00
Adam Treat
1c5dd6710d When regenerating erase the previous response and prompt from the context. 2023-04-15 09:10:27 -04:00
Adam Treat
a9eced2d1e Add an abstraction around gpt-j that will allow other arch models to be loaded in ui. 2023-04-13 22:15:40 -04:00
Adam Treat
661191ce12 Fix the check for updates on mac. 2023-04-12 17:57:02 -04:00
Adam Treat
a06fd8a487 Provide a busy indicator if we're processing a long prompt and make the
stop button work in the middle of processing a long prompt as well.
2023-04-12 15:31:32 -04:00
Adam Treat
1e13f8648c Fix the name of the updates tool. 2023-04-11 12:16:04 -04:00
Adam Treat
01dee6f20d Programmatically get the model name from the LLM. The LLM now searches
for applicable models in the directory of the executable given a pattern
match and then loads the first one it finds.

Also, add a busy indicator for model loading.
2023-04-11 08:29:55 -04:00
Adam Treat
f1bbe97a5c Big updates to the UI. 2023-04-10 23:34:34 -04:00
Adam Treat
c62ebdb81c Add a reset context feature to clear the chat history and the context for now. 2023-04-10 17:13:22 -04:00
Adam Treat
b088929df4 Fixes for linux and macosx. 2023-04-10 16:33:14 -04:00
Adam Treat
c763d4737d Prelim support for past context. 2023-04-09 13:01:29 -04:00
Adam Treat
ff2fdecce1 Initial commit. 2023-04-08 23:28:39 -04:00