gpt4all

Commit Graph

Author	SHA1	Message	Date
Adam Treat	1eca524171	Add fixme's and clean up a bit.	1 year ago
niansa	a3d08cdcd5	Dlopen better implementation management (Version 2)	1 year ago
niansa/tuxifan	92407438c8	Advanced avxonly autodetection (#744 ) * Advanced avxonly requirement detection	1 year ago
AT	48275d0dcc	Dlopen backend 5 (#779 ) Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.	1 year ago
Adam Treat	7f9f91ad94	Revert "New tokenizer implementation for MPT and GPT-J" This reverts commit `bbcee1ced5`.	1 year ago
Adam Treat	cdc7d6ccc4	Revert "buf_ref.into() can be const now" This reverts commit `d59c77ac55`.	1 year ago
Adam Treat	b5edaa2656	Revert "add tokenizer readme w/ instructions for convert script" This reverts commit `5063c2c1b2`.	1 year ago
aaron miller	5063c2c1b2	add tokenizer readme w/ instructions for convert script	1 year ago
Aaron Miller	d59c77ac55	buf_ref.into() can be const now	1 year ago
Aaron Miller	bbcee1ced5	New tokenizer implementation for MPT and GPT-J Improves output quality by making these tokenizers more closely match the behavior of the huggingface `tokenizers` based BPE tokenizers these models were trained with. Featuring: * Fixed unicode handling (via ICU) * Fixed BPE token merge handling * Complete added vocabulary handling	1 year ago
Adam Treat	474c5387f9	Get the backend as well as the client building/working with msvc.	1 year ago
Adam Treat	9bfff8bfcb	Add new reverse prompt for new localdocs context feature.	1 year ago
Juuso Alasuutari	ef052aed84	llmodel: constify some casts in LLModelWrapper	1 year ago
Juuso Alasuutari	81fdc28e58	llmodel: constify LLModel::threadCount()	1 year ago
Juuso Alasuutari	08ece43f0d	llmodel: fix wrong and/or missing prompt callback type Fix occurrences of the prompt callback being incorrectly specified, or the response callback's prototype being incorrectly used in its place. Signed-off-by: Juuso Alasuutari <juuso.alasuutari@gmail.com>	1 year ago
Adam Treat	8204c2eb80	Only default mlock on macOS where swap seems to be a problem.	1 year ago
Adam Treat	aba1147a22	Always default mlock to true.	1 year ago
aaron miller	e6fd0a240d	backend: fix buffer overrun in repeat penalty code Caught with AddressSanitizer running a basic prompt test against llmodel standalone. This fix allows ASan builds to complete a simple prompt without illegal accesses but there are still notably several leaks.	1 year ago
kuvaus	26cb31c4e6	Bugfix on llmodel_model_create function Fixes the bug where llmodel_model_create prints "Invalid model file" even though the model is loaded correctly. Credits and thanks to @serendipity for the fix.	1 year ago
kuvaus	3cb6dd7a66	gpt4all-backend: Add llmodel create and destroy functions (#554 ) * Add llmodel create and destroy functions * Fix capitalization * Fix capitalization * Fix capitalization * Update CMakeLists.txt --------- Co-authored-by: kuvaus <kuvaus@users.noreply.github.com>	1 year ago
kuvaus	507e913faf	gpt4all-backend: Add MSVC support to backend (#595 ) * Add MSVC compatibility * Add _MSC_VER macro --------- Co-authored-by: kuvaus <kuvaus@users.noreply.github.com>	1 year ago
Aaron Miller	d14936bfd6	backend: dedupe tokenizing code in mpt/gptj	1 year ago
Aaron Miller	6182026c70	backend: dedupe tokenizing code in gptj/mpt	1 year ago
Aaron Miller	4cd8bdf9a1	backend: make initial buf_size const in model impls more unifying mpt and gptj code - this one's never written so also changing the name to be clearer	1 year ago
Aaron Miller	08402a1b64	mpt: use buf in model struct (thread safety)	1 year ago
AT	4920816c90	Update README.md Signed-off-by: AT <manyoso@users.noreply.github.com>	1 year ago
Zach Nussbaum	1ed71fbbf8	fix: use right conversion script	1 year ago
Adam Treat	d918b02c29	Move the llmodel C API to new top-level directory and version it.	1 year ago
Richard Guo	02d1bdb0be	mono repo structure	1 year ago

29 Commits (5220356273cfe3ff685f5a5b918c6e0520c51900)