gpt4all

Commit Graph

Author	SHA1	Message	Date
Jared Van Bortel	26acdebafa	convert: replace GPTJConfig with AutoConfig (#1866 ) Signed-off-by: Jared Van Bortel <jared@nomic.ai>	8 months ago
cebtenzzre	4338e72a51	MPT: use upstream llama.cpp implementation (#1515 )	11 months ago
cebtenzzre	22de3c56bd	convert scripts: fix AutoConfig typo (#1512 )	11 months ago
Cebtenzzre	f9deb87d20	convert scripts: add feed-forward length for better compatiblilty This GGUF key is used by all llama.cpp models with upstream support.	12 months ago
Cebtenzzre	cc7675d432	convert scripts: make gptj script executable	12 months ago
Cebtenzzre	0493e6eb07	convert scripts: use bytes_to_unicode from transformers	12 months ago
Cebtenzzre	050e7f076e	backend: port GPT-J to GGUF	12 months ago
Cebtenzzre	4219c0e2e7	convert scripts: make them directly executable	12 months ago
Cebtenzzre	ce7be1db48	backend: use llamamodel.cpp for Falcon	12 months ago
Cebtenzzre	cca9e6ce81	convert_mpt_hf_to_gguf.py: better tokenizer decoding	12 months ago
Cebtenzzre	25297786db	convert scripts: load model as late as possible	12 months ago
Cebtenzzre	fd47088f2b	conversion scripts: cleanup	12 months ago
Cebtenzzre	17fc9e3e58	backend: port Replit to GGUF	12 months ago
Cebtenzzre	7c67262a13	backend: port MPT to GGUF	12 months ago
Cebtenzzre	42bcb814b3	backend: port BERT to GGUF	12 months ago
Adam Treat	0efdbfcffe	Bert	1 year ago
Zach Nussbaum	2565f6a94a	feat: add conversion script	1 year ago
Richard Guo	c4706d0c14	Replit Model (#713 ) * porting over replit code model to gpt4all * replaced memory with kv_self struct * continuing debug * welp it built but lot of sus things * working model loading and somewhat working generate.. need to format response? * revert back to semi working version * finally got rid of weird formatting * figured out problem is with python bindings - this is good to go for testing * addressing PR feedback * output refactor * fixed prompt reponse collection * cleanup * addressing PR comments * building replit backend with new ggmlver code * chatllm replit and clean python files * cleanup * updated replit to match new llmodel api * match llmodel api and change size_t to Token * resolve PR comments * replit model commit comment	1 year ago
Adam Treat	7f9f91ad94	Revert "New tokenizer implementation for MPT and GPT-J" This reverts commit `bbcee1ced5`.	1 year ago
Aaron Miller	bbcee1ced5	New tokenizer implementation for MPT and GPT-J Improves output quality by making these tokenizers more closely match the behavior of the huggingface `tokenizers` based BPE tokenizers these models were trained with. Featuring: * Fixed unicode handling (via ICU) * Fixed BPE token merge handling * Complete added vocabulary handling	1 year ago
Zach Nussbaum	1ed71fbbf8	fix: use right conversion script	1 year ago
Adam Treat	d918b02c29	Move the llmodel C API to new top-level directory and version it.	1 year ago

22 Commits (53fc2d56f6585043191a7a333504f01821936be2)