Archives/gpt4all
2
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all synced 2024-11-06 09:20:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
370 Commits 540 Branches 59 Tags 51 MiB
27599d4a0a
Commit Graph

370 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Adam Treat
27599d4a0a Fix some usage events. 2023-05-09 23:43:16 -04:00
Adam Treat
c8e9259bd1 Default to true for compat hardware. 2023-05-09 23:17:36 -04:00
AT
dd71513309 Update README.md 2023-05-09 23:10:53 -04:00
AT
148225372d Update README.md 2023-05-09 23:10:06 -04:00
AT
ec81db43df Update README.md 2023-05-09 23:04:54 -04:00
Adam Treat
dcea2f3491 Rename to build_and_run.md 2023-05-09 23:02:41 -04:00
AT
ac665f3739 Update dev_setup.md 2023-05-09 23:00:50 -04:00
AT
bb2ac26459 Update dev_setup.md 2023-05-09 22:36:02 -04:00
AT
37ea0f6c29 Update dev_setup.md 2023-05-09 22:00:42 -04:00
AT
f14458db44 Update dev_setup.md 2023-05-09 21:59:11 -04:00
Adam Treat
3b802fb0f5 Add a page to fill in for setting up a dev environment. 2023-05-09 21:38:24 -04:00
Adam Treat
dfe641222b Shorten text. 2023-05-09 20:54:16 -04:00
Adam Treat
09b5f87b8d Couple of bugfixes. 2023-05-09 19:15:18 -04:00
Adam Treat
f3c81c42a7 Provide a user default model setting and honor it. 2023-05-09 17:10:47 -04:00
Adam Treat
ff257eb52c Add MPT info to the download list and fix it so that isDefault will work even if the required version isn't there. 2023-05-09 12:09:49 -04:00
Adam Treat
5d95085cbe Move this script and rename. 2023-05-09 11:48:32 -04:00
Adam Treat
8eeca20fd7 Simplify. 2023-05-09 11:46:33 -04:00
Adam Treat
8d295550eb Don't keep this in memory when it is not needed. 2023-05-08 21:05:50 -04:00
Adam Treat
7094fd0788 Gracefully handle when we have a previous chat where the model that it used has gone away. 2023-05-08 20:51:03 -04:00
Adam Treat
ad82aaebb1 Copy pasta. 2023-05-08 19:10:22 -04:00
Adam Treat
9c66308922 Fix for special im_end token in mpt-7b-chat model. 2023-05-08 18:57:40 -04:00
Adam Treat
a4bec78ec6 Allow these to load for gptj too. 2023-05-08 18:31:20 -04:00
Aaron Miller
821b28a4fa mpt: allow q4_2 quantized models to load 2023-05-08 18:23:36 -04:00
Aaron Miller
49fc7b315a mpt tokenizer: better special token handling 
closer to the behavior of huggingface `tokenizers`,
do not attempt to handle additional tokens as if they were part
of the original vocabulary as this cannot prevent them from being
split into smaller chunks - handle added tokens *before*
the regular tokenizing pass

note this is still necessary even with a "proper" tokenizer implementation
 2023-05-08 18:23:36 -04:00
Adam Treat
9da4fac023 Fix gptj to have lower memory requirements for kv cache and add versioning to the internal state to smoothly handle such a fix in the future. 2023-05-08 17:23:02 -04:00
Adam Treat
c7f5280f9f Fix the version. 2023-05-08 16:50:21 -04:00
Adam Treat
be9e748abe Remove as upstream has removed. 2023-05-08 15:09:23 -04:00
Adam Treat
126dd97b0a This shouldn't have snuck in. 2023-05-08 15:09:23 -04:00
Adam Treat
3a8ad1f700 Update to the alibi version that Zach made. 2023-05-08 12:27:01 -04:00
Adam Treat
90b2bcfebe Match Helly's impl of kv cache. 2023-05-08 12:21:30 -04:00
Adam Treat
368886015d Use F16 for kv cache on mpt. 2023-05-08 12:21:30 -04:00
Adam Treat
00804c4e3e Fix for special tokens. 2023-05-08 12:21:30 -04:00
Adam Treat
98e19ebc25 Fix up mpt. 2023-05-08 12:21:30 -04:00
Zach Nussbaum
712aeb8866 fix: helly changes 2023-05-08 12:21:30 -04:00
Zach Nussbaum
d14b93222f fix: model loading 2023-05-08 12:21:30 -04:00
Zach Nussbaum
28f0f76b9f fix: convert script working 2023-05-08 12:21:30 -04:00
Zach Nussbaum
d928540a08 feat: load model 2023-05-08 12:21:30 -04:00
Zach Nussbaum
f8f248c18a chore: import for mpt 2023-05-08 12:21:30 -04:00
Zach Nussbaum
e3f17c8e82 feat: mpt convert from hf to ggml 2023-05-08 12:21:30 -04:00
Zach Nussbaum
285e57ca68 feat: build works + tokenizer 2023-05-08 12:21:30 -04:00
Zach Nussbaum
199a585ad1 feat: add ln 2, rename vars 2023-05-08 12:21:30 -04:00
Zach Nussbaum
21f2aa4911 feat: mpt wip 2023-05-08 12:21:30 -04:00
Adam Treat
a066cba17d Scaffolding for the mpt <-> ggml project. 2023-05-08 12:21:30 -04:00
Adam Treat
da5b057041 Only generate three words max. 2023-05-08 12:21:30 -04:00
Adam Treat
2b76fa6b20 Restore defaults for repeat penalty too. 2023-05-08 12:21:30 -04:00
Adam Treat
ee016e10ab Send info on how many are running into this error. 2023-05-08 08:31:35 -04:00
Adam Treat
e0c9d7f8e0 Fail early/gracefully if incompatible hardware detected. And default to universal builds on mac. 2023-05-08 08:23:00 -04:00
Adam Treat
4bcc88b051 Convert the old format properly. 2023-05-08 05:53:16 -04:00
Adam Treat
fb464bb60e Add debug for chatllm model loading and fix order of getting rid of the 
dummy chat when no models are restored.
 2023-05-07 14:40:02 -04:00
Adam Treat
3a039c8dc1 Deserialize one at a time and don't block gui until all of them are done. 2023-05-07 09:20:09 -04:00