175 Commits (397f3ba2d72cfdd64ac8e1d8871e83bb7bb7ee21)

Author	SHA1	Message	Date
Jacob Nguyen	0e866a0e8f	Refactor(typescript)/error handling (#1283) ... * actually display error if it occurs while instantiating * bump version	1 year ago
Jacob Nguyen	545c23b4bd	typescript: fix final bugs and polishing, circle ci documentation (#960) ... * fix: esm and cjs compatibility Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update prebuild.js Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix gpt4all.js Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Fix compile for windows and linux again. PLEASE DON'T REVERT THISgit gui! * version bump * polish up spec and build scripts * lock file refresh * fix: proper resource closing and error handling * check make sure libPath not null * add msvc build script and update readme requirements * python workflows in circleci * dummy python change * no need for main * second hold for pypi deploy * let me deploy pls * bring back when condition * Typo, ignore list (#967) Fix typo in javadoc, Add word to ignore list for codespellrc --------- Co-authored-by: felix <felix@zaslavskiy.net> * llmodel: change tokenToString to not use string_view (#968) fixes a definite use-after-free and likely avoids some other potential ones - std::string will convert to a std::string_view automatically but as soon as the std::string in question goes out of scope it is already freed and the string_view is pointing at freed memory - this is *mostly* fine if its returning a reference to the tokenizer's internal vocab table but it's, imo, too easy to return a reference to a dynamically constructed string with this as replit is doing (and unfortunately needs to do to convert the internal whitespace replacement symbol back to a space) * Initial Library Loader for .NET Bindings / Update bindings to support newest changes (#763) * Initial Library Loader * Load library as part of Model factory * Dynamically search and find the dlls * Update tests to use locally built runtimes * Fix dylib loading, add macos runtime support for sample/tests * Bypass automatic loading by default. * Only set CMAKE_OSX_ARCHITECTURES if not already set, allow cross-compile * Switch Loading again * Update build scripts for mac/linux * Update bindings to support newest breaking changes * Fix build * Use llmodel for Windows * Actually, it does need to be libllmodel * Name * Remove TFMs, bypass loading by default * Fix script * Delete mac script --------- Co-authored-by: Tim Miller <innerlogic4321@ghmail.com> * bump llama.cpp mainline to latest (#964) * fix prompt context so it's preserved in class * update setup.py * metal replit (#931) metal+replit makes replit work with Metal and removes its use of `mem_per_token` in favor of fixed size scratch buffers (closer to llama.cpp) * update documentation scripts and generation to include readme.md * update readme and documentation for source * begin tests, import jest, fix listModels export * fix typo * chore: update spec * fix: finally, reduced potential of empty string * chore: add stub for createTokenSream * refactor: protecting resources properly * add basic jest tests * update * update readme * refactor: namespace the res variable * circleci integration to automatically build docs * add starter docs * typo * more circle ci typo * forgot to add nodejs circle ci orb * fix circle ci * feat: @iimez verify download and fix prebuild script * fix: oops, option name wrong * fix: gpt4all utils not emitting docs * chore: fix up scripts * fix: update docs and typings for md5 sum * fix: macos compilation * some refactoring * Update index.cc Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * update readme and enable exceptions on mac * circle ci progress * basic embedding with sbert (not tested & cpp side only) * fix circle ci * fix circle ci * update circle ci script * bruh * fix again * fix * fixed required workflows * fix ci * fix pwd * fix pwd * update ci * revert * fix * prevent rebuild * revmove noop * Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update binding.gyp Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix fs not found * remove cpp 20 standard * fix warnings, safer way to calculate arrsize * readd build backend * basic embeddings and yarn test" * fix circle ci Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> fix macos paths update readme and roadmap split up spec update readme check for url in modelsjson update docs and inline stuff update yarn configuration and readme update readme readd npm publish script add exceptions bruh one space broke the yaml codespell oops forgot to add runtimes folder bump version try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images add fallback for unknown architectures attached to wrong workspace hopefuly fix moving everything under backend to persist should work now * update circle ci script * prevent rebuild * revmove noop * Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update binding.gyp Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix fs not found * remove cpp 20 standard * fix warnings, safer way to calculate arrsize * readd build backend * basic embeddings and yarn test" * fix circle ci Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> fix macos paths update readme and roadmap split up spec update readme check for url in modelsjson update docs and inline stuff update yarn configuration and readme update readme readd npm publish script add exceptions bruh one space broke the yaml codespell oops forgot to add runtimes folder bump version try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images add fallback for unknown architectures attached to wrong workspace hopefuly fix moving everything under backend to persist should work now * Update README.md Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> --------- Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Co-authored-by: Adam Treat <treat.adam@gmail.com> Co-authored-by: Richard Guo <richardg7890@gmail.com> Co-authored-by: Felix Zaslavskiy <felix.zaslavskiy@gmail.com> Co-authored-by: felix <felix@zaslavskiy.net> Co-authored-by: Aaron Miller <apage43@ninjawhale.com> Co-authored-by: Tim Miller <drasticactions@users.noreply.github.com> Co-authored-by: Tim Miller <innerlogic4321@ghmail.com>	1 year ago
Andriy Mulyar	41f640577c	Update setup.py (#1263) ... Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
cosmic-snow	6431d46776	Fix models not getting downloaded in Python bindings (#1262) ... - custom callbacks & session improvements PR (v1.0.6) had one too many checks - remove the problematic config['url'] check - add a crude test - fixes #1261	1 year ago
385olt	b4dbbd1485	Python bindings: Custom callbacks, chat session improvement, refactoring (#1145) ... * Added the following features: \n 1) Now prompt_model uses the positional argument callback to return the response tokens. \n 2) Due to the callback argument of prompt_model, prompt_model_streaming only manages the queue and threading now, which reduces duplication of the code. \n 3) Added optional verbose argument to prompt_model which prints out the prompt that is passed to the model. \n 4) Chat sessions can now have a header, i.e. an instruction before the transcript of the conversation. The header is set at the creation of the chat session context. \n 5) generate function now accepts an optional callback. \n 6) When streaming and using chat session, the user doesn't need to save assistant's messages by himself. This is done automatically. * added _empty_response_callback so I don't have to check if callback is None * added docs * now if the callback stop generation, the last token is ignored * fixed type hints, reimplemented chat session header as a system prompt, minor refactoring, docs: removed section about manual update of chat session for streaming * forgot to add some type hints! * keep the config of the model in GPT4All class which is taken from models.json if the download is allowed * During chat sessions, the model-specific systemPrompt and promptTemplate are applied. * implemented the changes * Fixed typing. Now the user can set a prompt template that will be applied even outside of a chat session. The template can also have multiple placeholders that can be filled by passing a dictionary to the generate function * reversed some changes concerning the prompt templates and their functionality * fixed some type hints, changed list[float] to List[Float] * fixed type hints, changed List[Float] to List[float] * fix typo in the comment: Pepare => Prepare --------- Signed-off-by: 385olt <385olt@gmail.com>	1 year ago
AMOGUS	5f0aaf8bdb	python binding's TopP also needs some love ... Changed the Python binding's TopP from 0.1 to 0.4 Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>	1 year ago
cosmic-snow	2d02c65177	Handle edge cases when generating embeddings (#1215) ... * Handle edge cases when generating embeddings * Improve Python handling & add llmodel_c.h note - In the Python bindings fail fast with a ValueError when text is empty - Advice other bindings authors to do likewise in llmodel_c.h	1 year ago
Felix Zaslavskiy	1e74171a7b	Java binding - Improve error check before loading Model file (#1206) ... * Javav binding - Add check for Model file be Readable. * add todo for java binding. --------- Co-authored-by: Feliks Zaslavskiy <feliks.zaslavskiy@optum.com> Co-authored-by: felix <felix@zaslavskiy.net>	1 year ago
Andriy Mulyar	cfd70b69fc	Update gpt4all_python_embedding.md ... Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Andriy Mulyar	306105e62f	Update gpt4all_python_embedding.md ... Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Andriy Mulyar	89e277bb3c	Update gpt4all_python_embedding.md ... Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Adam Treat	f543affa9a	Add better docs and threading support to bert.	1 year ago
Adam Treat	0c0a4f2c22	Add the docs.	1 year ago
Adam Treat	6656f0f41e	Fix the test to work and not do timings.	1 year ago
Adam Treat	bb2b82e1b9	Add docs and bump version since we changed python api again.	1 year ago
Aaron Miller	c77ab849c0	LLModel objects should hold a reference to the library ... prevents llmodel lib from being gc'd before live model objects	1 year ago
Aaron Miller	936dcd2bfc	use default n_threads	1 year ago
Aaron Miller	15f1fe5445	rename embedder	1 year ago
Adam Treat	ee4186d579	Fixup bert python bindings.	1 year ago
Adam Treat	4963db8f43	Bump the version numbers for both python and c backend.	1 year ago
Adam Treat	0efdbfcffe	Bert	1 year ago
cosmic-snow	00a945eaee	Update gpt4all_faq.md ... - Add information about AVX/AVX2. - Update supported architectures. Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>	1 year ago
mvenditto	8a31239e90	bump version	1 year ago
mvenditto	7efb43c2e4	copy metal kernels on macos builds	1 year ago
mvenditto	991b7468c9	fix native lib loader tests	1 year ago
mvenditto	c92c1af697	nuget pack and push	1 year ago
mvenditto	4b7b9975c5	add lib loading tests + remove dummy test	1 year ago
mvenditto	c3ad76dcd1	update deps for test project	1 year ago
mvenditto	1d570bfe76	bump test to net 7	1 year ago
mvenditto	d3831f7dbe	first attempt to store test results	1 year ago
mvenditto	5fe4f25d64	fix curr working directory	1 year ago
mvenditto	7c67134b8c	try to sort out ci only error on build related to CA2101	1 year ago
mvenditto	2cbe791e5c	add a SkipOnCI trait fore tests	1 year ago
felix	6630bf2f13	update to 2.4.11 gpt4all ... falcon model support. Developer docs included for Java.	1 year ago
cosmic-snow	d611d10747	Update index.md (#1157) ... Some minor touch-ups to the documentation landing page. Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>	1 year ago
Aaron Miller	ed470e18b3	python: Only eval latest message in chat sessions (#1149) ... * python: Only eval latest message in chat sessions * python: version bump	1 year ago
cosmic-snow	affd0af51f	Fix CLI to work with 1.x.y version of the Python bindings (#1120) ... * Fix CLI to work with 1.x.y version of the Python bindings (tentative) - Adapted to bindings API changes - Version selection based on package information - Does not currently work with 1.x.y however, as it's not fully implemented: "NotImplementedError: Streaming tokens in a chat session is not currently supported." * Adapt to the completed streaming API with session support * Bump CLI version to 1.0.2	1 year ago
felix	8dcf68dbf4	Add note about running in Docker containers	1 year ago
felix	77f435a77e	Put singing plugin under seperate profile.	1 year ago
felix	4e274baee1	bump version a few more doc fixes. ... add macos metal files Add check for Prompt is too long. add logging statement for gpt4all version of the binding add version string, readme update Add unit tests for Java code of the java bindings.	1 year ago
Andriy Mulyar	71a7032421	python bindings v1.0.2 ... Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Aaron Miller	6987910668	python bindings: typing fixes, misc fixes (#1131) ... * python: do not mutate locals() * python: fix (some) typing complaints * python: queue sentinel need not be a str * python: make long inference tests opt in	1 year ago
Andriy Mulyar	01bd3d6802	Python chat streaming (#1127) ... * Support streaming in chat session * Uncommented tests	1 year ago
Andriy Mulyar	aced5e6615	Update README.md to python bindings ... Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Andriy Mulyar	19412cfa5d	Clear chat history between chat sessions (#1116)	1 year ago
Aaron Miller	3599663a22	bindings/python: type assert	1 year ago
Aaron Miller	958c8d4fa5	bindings/python: long input tests	1 year ago
Aaron Miller	6a74e515e1	bindings/python: make target to set up env	1 year ago
Aaron Miller	ac5c8e964f	bindings/python: fix typo (#1111)	1 year ago
Andriy Mulyar	46a0762bd5	Python Bindings: Improved unit tests, documentation and unification of API (#1090) ... * Makefiles, black, isort * Black and isort * unit tests and generation method * chat context provider * context does not reset * Current state * Fixup * Python bindings with unit tests * GPT4All Python Bindings: chat contexts, tests * New python bindings and backend fixes * Black and Isort * Documentation error * preserved n_predict for backwords compat with langchain --------- Co-authored-by: Adam Treat <treat.adam@gmail.com>	1 year ago