5 Commits

Author	SHA1	Message	Date
Adam Treat	b6937c39db	Infinite context window through trimming.	2023-04-25 11:20:51 -04:00
Adam Treat	8b1ddabe3e	Implement repeat penalty for both llama and gptj in gui.	2023-04-25 08:38:29 -04:00
Adam Treat	bfee4994f3	Back out the prompt/response finding in gptj since it doesn't seem to help. ... Guard against reaching the end of the context window which we don't handle gracefully except for avoiding a crash.	2023-04-20 17:15:46 -04:00
Adam Treat	d7f1214bf1	Use default params unless we override them.	2023-04-20 12:07:43 -04:00
Adam Treat	71b308e914	Add llama.cpp support for loading llama based models in the gui. We now ... support loading both gptj derived models and llama derived models.	2023-04-20 06:19:09 -04:00