10 Commits

Author	SHA1	Message	Date
Adam Treat	9da4fac023	Fix gptj to have lower memory requirements for kv cache and add versioning to the internal state to smoothly handle such a fix in the future.	2023-05-08 17:23:02 -04:00
Adam Treat	be9e748abe	Remove as upstream has removed.	2023-05-08 15:09:23 -04:00
Adam Treat	fb464bb60e	Add debug for chatllm model loading and fix order of getting rid of the ... dummy chat when no models are restored.	2023-05-07 14:40:02 -04:00
Adam Treat	b7b2ff8bab	Add reverse prompt support for gptj too.	2023-05-05 11:16:24 -04:00
Adam Treat	cd83723ed7	Persistent state for gpt-j models too.	2023-05-05 10:00:17 -04:00
Adam Treat	2a5b34b193	Load models from filepath only.	2023-04-28 20:15:10 -04:00
Adam Treat	a3253c4ab1	Move the saving of the tokens to the impl and not the callbacks responsibility.	2023-04-27 11:16:51 -04:00
Adam Treat	9a65f73392	Move the promptCallback to own function.	2023-04-27 11:08:15 -04:00
Adam Treat	70e6b45123	Don't crash when prompt is too large.	2023-04-26 19:08:37 -04:00
Adam Treat	4b47478626	Move the backend code into own subdirectory and make it a shared library. Begin fleshing out the C api wrapper that bindings can use.	2023-04-26 08:22:38 -04:00