4 Commits

Author	SHA1	Message	Date
Jared Van Bortel	4fc4d94be4	fix chat-style prompt templates (#1970) ... Also use a new version of Mistral OpenOrca. Signed-off-by: Jared Van Bortel <jared@nomic.ai>	2024-02-21 15:45:32 -05:00
Jared Van Bortel	061d1969f8	expose n_gpu_layers parameter of llama.cpp (#1890) ... Also dynamically limit the GPU layers and context length fields to the maximum supported by the model. Signed-off-by: Jared Van Bortel <jared@nomic.ai>	2024-01-31 14:17:44 -05:00
Jared Van Bortel	d1c56b8b28	Implement configurable context length (#1749)	2023-12-16 17:58:15 -05:00
Adam Treat	0efdbfcffe	Bert	2023-07-13 14:21:46 -04:00