Commit Graph

829 Commits (5e61008424508511d0ecab9d43a002ec113141ae)
 

Author SHA1 Message Date
Adam Treat 80bd55590f Shorten text. 1 year ago
Adam Treat 42926a484f Couple of bugfixes. 1 year ago
Adam Treat 2206fa7f8c Provide a user default model setting and honor it. 1 year ago
Adam Treat 069c243f1a Add MPT info to the download list and fix it so that isDefault will work even if the required version isn't there. 1 year ago
Adam Treat a13dcfb13b Move this script and rename. 1 year ago
Adam Treat 9c008fb677 Simplify. 1 year ago
Adam Treat 53a39b9ecf Don't keep this in memory when it is not needed. 1 year ago
Adam Treat 5f372bd881 Gracefully handle when we have a previous chat where the model that it used has gone away. 1 year ago
Adam Treat 8b80345c98 Copy pasta. 1 year ago
Adam Treat af4a67c109 Fix for special im_end token in mpt-7b-chat model. 1 year ago
Adam Treat d3ec333314 Allow these to load for gptj too. 1 year ago
Aaron Miller 5002614b20 mpt: allow q4_2 quantized models to load 1 year ago
Aaron Miller 832720dd27 mpt tokenizer: better special token handling
closer to the behavior of huggingface `tokenizers`,
do not attempt to handle additional tokens as if they were part
of the original vocabulary as this cannot prevent them from being
split into smaller chunks - handle added tokens *before*
the regular tokenizing pass

note this is still necessary even with a "proper" tokenizer implementation
1 year ago
Adam Treat 8c4b8f215f Fix gptj to have lower memory requirements for kv cache and add versioning to the internal state to smoothly handle such a fix in the future. 1 year ago
Adam Treat ccbd16cf18 Fix the version. 1 year ago
Adam Treat a549871220 Remove as upstream has removed. 1 year ago
Adam Treat dfe85386b5 This shouldn't have snuck in. 1 year ago
Adam Treat 992e553cfa Update to the alibi version that Zach made. 1 year ago
Adam Treat 98aedd2173 Match Helly's impl of kv cache. 1 year ago
Adam Treat eb77d5157b Use F16 for kv cache on mpt. 1 year ago
Adam Treat dc559c1575 Fix for special tokens. 1 year ago
Adam Treat b6886c0e31 Fix up mpt. 1 year ago
Zach Nussbaum 61e2aabadb fix: helly changes 1 year ago
Zach Nussbaum d30be81506 fix: model loading 1 year ago
Zach Nussbaum f732ba2d56 fix: convert script working 1 year ago
Zach Nussbaum 6a56bcaf06 feat: load model 1 year ago
Zach Nussbaum 58069dc8b9 chore: import for mpt 1 year ago
Zach Nussbaum 03bde18e49 feat: mpt convert from hf to ggml 1 year ago
Zach Nussbaum 2f6ecbe798 feat: build works + tokenizer 1 year ago
Zach Nussbaum 525b703984 feat: add ln 2, rename vars 1 year ago
Zach Nussbaum aef524b460 feat: mpt wip 1 year ago
Adam Treat 159053be5a Scaffolding for the mpt <-> ggml project. 1 year ago
Adam Treat 40b976436a Only generate three words max. 1 year ago
Adam Treat 49a6a6ed65 Restore defaults for repeat penalty too. 1 year ago
Adam Treat c054efa6ac Send info on how many are running into this error. 1 year ago
Adam Treat 6d943917f1 Fail early/gracefully if incompatible hardware detected. And default to universal builds on mac. 1 year ago
Adam Treat 3c30310539 Convert the old format properly. 1 year ago
Adam Treat 7b66cb7119 Add debug for chatllm model loading and fix order of getting rid of the
dummy chat when no models are restored.
1 year ago
Adam Treat 9bd5609ba0 Deserialize one at a time and don't block gui until all of them are done. 1 year ago
Adam Treat 86da175e1c Use last lts for this. 1 year ago
Adam Treat ab13148430 The GUI should come up immediately and not wait on deserializing from disk. 1 year ago
Adam Treat eb7b61a76d Move the location of the chat files to the model download directory and add a magic+version. 1 year ago
Aaron Miller 7a8f437f8f add name to LICENSE 1 year ago
Adam Treat e397fda250 Bump the version and save up to an order of magnitude of disk space for chat files. 1 year ago
Adam Treat 8d2c8c8cb0 Turn off saving chats to disk by default as it eats so much disk space. 1 year ago
Adam Treat 6d4d86d07c Bump the version. 1 year ago
Adam Treat d0d5d84e06 Add reverse prompt support for gptj too. 1 year ago
Adam Treat 06bb6960d4 Add about dialog. 1 year ago
Adam Treat 659442394f Persistent state for gpt-j models too. 1 year ago
Adam Treat 5b71d39024 Don't crash if state has not been set. 1 year ago