Archives/gpt4all
2
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all synced 2024-11-08 07:10:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
799 Commits 542 Branches 59 Tags 51 MiB
120fbbf67d
Commit Graph

799 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Adam Treat
d918b02c29 Move the llmodel C API to new top-level directory and version it. 2023-05-10 11:46:40 -04:00
Andriy Mulyar
2e89a1847a
Merge pull request #520 from nomic-ai/monorepo 
Make Monorepos Cool Again 2023
 2023-05-10 11:16:36 -04:00
Adam Treat
b00684bb91 Fix ignore for build dirs. 2023-05-10 10:51:47 -04:00
Adam Treat
a971831ed2 Merge commit gpt4all-chat into monorepo 2023-05-10 10:28:36 -04:00
Adam Treat
6015154bef Moving everything to subdir for monorepo merge. 2023-05-10 10:26:55 -04:00
AT
bd0250a6f0
Update README.md 
Signed-off-by: AT <manyoso@users.noreply.github.com>
 2023-05-10 09:09:29 -04:00
AT
c3062425be
Update README.md 
Signed-off-by: AT <manyoso@users.noreply.github.com>
 2023-05-10 09:09:04 -04:00
Adam Treat
0f1d4eaa90 Bump the version to 2.4.2 2023-05-10 09:05:39 -04:00
AT
88a0ee3509
Update issue templates 2023-05-09 23:57:06 -04:00
Adam Treat
14412996e3 Fix some usage events. 2023-05-09 23:43:16 -04:00
Adam Treat
45d7967438 Default to true for compat hardware. 2023-05-09 23:17:36 -04:00
AT
8afae10808
Update README.md 2023-05-09 23:10:53 -04:00
AT
b9669a3f10
Update README.md 2023-05-09 23:10:06 -04:00
AT
dd3e0f8679
Update README.md 2023-05-09 23:04:54 -04:00
Adam Treat
64aff8a35b Rename to build_and_run.md 2023-05-09 23:02:41 -04:00
AT
b185b9da0d
Update dev_setup.md 2023-05-09 23:00:50 -04:00
AT
cf61b8259f
Update dev_setup.md 2023-05-09 22:36:02 -04:00
AT
daa0801555
Update dev_setup.md 2023-05-09 22:00:42 -04:00
AT
1a40be68fd
Update dev_setup.md 2023-05-09 21:59:11 -04:00
Adam Treat
999ed1b560 Add a page to fill in for setting up a dev environment. 2023-05-09 21:38:24 -04:00
Adam Treat
80bd55590f Shorten text. 2023-05-09 20:54:16 -04:00
Adam Treat
42926a484f Couple of bugfixes. 2023-05-09 19:15:18 -04:00
Adam Treat
2206fa7f8c Provide a user default model setting and honor it. 2023-05-09 17:10:47 -04:00
Adam Treat
069c243f1a Add MPT info to the download list and fix it so that isDefault will work even if the required version isn't there. 2023-05-09 12:09:49 -04:00
Adam Treat
a13dcfb13b Move this script and rename. 2023-05-09 11:48:32 -04:00
Adam Treat
9c008fb677 Simplify. 2023-05-09 11:46:33 -04:00
Adam Treat
53a39b9ecf Don't keep this in memory when it is not needed. 2023-05-08 21:05:50 -04:00
Adam Treat
5f372bd881 Gracefully handle when we have a previous chat where the model that it used has gone away. 2023-05-08 20:51:03 -04:00
Adam Treat
8b80345c98 Copy pasta. 2023-05-08 19:10:22 -04:00
Adam Treat
af4a67c109 Fix for special im_end token in mpt-7b-chat model. 2023-05-08 18:57:40 -04:00
Adam Treat
d3ec333314 Allow these to load for gptj too. 2023-05-08 18:31:20 -04:00
Aaron Miller
5002614b20 mpt: allow q4_2 quantized models to load 2023-05-08 18:23:36 -04:00
Aaron Miller
832720dd27 mpt tokenizer: better special token handling 
closer to the behavior of huggingface `tokenizers`,
do not attempt to handle additional tokens as if they were part
of the original vocabulary as this cannot prevent them from being
split into smaller chunks - handle added tokens *before*
the regular tokenizing pass

note this is still necessary even with a "proper" tokenizer implementation
 2023-05-08 18:23:36 -04:00
Adam Treat
8c4b8f215f Fix gptj to have lower memory requirements for kv cache and add versioning to the internal state to smoothly handle such a fix in the future. 2023-05-08 17:23:02 -04:00
Adam Treat
ccbd16cf18 Fix the version. 2023-05-08 16:50:21 -04:00
Adam Treat
a549871220 Remove as upstream has removed. 2023-05-08 15:09:23 -04:00
Adam Treat
dfe85386b5 This shouldn't have snuck in. 2023-05-08 15:09:23 -04:00
Adam Treat
992e553cfa Update to the alibi version that Zach made. 2023-05-08 12:27:01 -04:00
Adam Treat
98aedd2173 Match Helly's impl of kv cache. 2023-05-08 12:21:30 -04:00
Adam Treat
eb77d5157b Use F16 for kv cache on mpt. 2023-05-08 12:21:30 -04:00
Adam Treat
dc559c1575 Fix for special tokens. 2023-05-08 12:21:30 -04:00
Adam Treat
b6886c0e31 Fix up mpt. 2023-05-08 12:21:30 -04:00
Zach Nussbaum
61e2aabadb fix: helly changes 2023-05-08 12:21:30 -04:00
Zach Nussbaum
d30be81506 fix: model loading 2023-05-08 12:21:30 -04:00
Zach Nussbaum
f732ba2d56 fix: convert script working 2023-05-08 12:21:30 -04:00
Zach Nussbaum
6a56bcaf06 feat: load model 2023-05-08 12:21:30 -04:00
Zach Nussbaum
58069dc8b9 chore: import for mpt 2023-05-08 12:21:30 -04:00
Zach Nussbaum
03bde18e49 feat: mpt convert from hf to ggml 2023-05-08 12:21:30 -04:00
Zach Nussbaum
2f6ecbe798 feat: build works + tokenizer 2023-05-08 12:21:30 -04:00
Zach Nussbaum
525b703984 feat: add ln 2, rename vars 2023-05-08 12:21:30 -04:00