gpt4all

Commit Graph

Author	SHA1	Message	Date
Jared Van Bortel	061d1969f8	expose n_gpu_layers parameter of llama.cpp (#1890 ) Also dynamically limit the GPU layers and context length fields to the maximum supported by the model. Signed-off-by: Jared Van Bortel <jared@nomic.ai>	8 months ago
Jared Van Bortel	d1c56b8b28	Implement configurable context length (#1749 )	10 months ago
Adam Treat	0efdbfcffe	Bert	1 year ago
Adam Treat	4f9e489093	Don't use a local event loop which can lead to recursion and crashes.	1 year ago
Aaron Miller	b19a3e5b2c	add requiredMem method to llmodel impls most of these can just shortcut out of the model loading logic llama is a bit worse to deal with because we submodule it so I have to at least parse the hparams, and then I just use the size on disk as an estimate for the mem size (which seems reasonable since we mmap() the llama files anyway)	1 year ago
Aaron Miller	88616fde7f	llmodel: change tokenToString to not use string_view (#968 ) fixes a definite use-after-free and likely avoids some other potential ones - std::string will convert to a std::string_view automatically but as soon as the std::string in question goes out of scope it is already freed and the string_view is pointing at freed memory - this is mostly fine if its returning a reference to the tokenizer's internal vocab table but it's, imo, too easy to return a reference to a dynamically constructed string with this as replit is doing (and unfortunately needs to do to convert the internal whitespace replacement symbol back to a space)	1 year ago
Adam Treat	301d2fdbea	Fix up for newer models on reset context. This fixes the model from totally failing after a reset context.	1 year ago
AT	bbe195ee02	Backend prompt dedup (#822 ) * Deduplicated prompt() function code	1 year ago
Adam Treat	a41bd6ac0a	Trying to shrink the copy+paste code and do more code sharing between backend model impl.	1 year ago
Juuso Alasuutari	81fdc28e58	llmodel: constify LLModel::threadCount()	1 year ago
Adam Treat	f931de21c5	Add save/restore to chatgpt chats and allow serialize/deseralize from disk.	1 year ago
Adam Treat	dd27c10f54	Preliminary support for chatgpt models.	1 year ago

12 Commits (7810b757c9120a93533fbcf56d169272b881d6bb)