gpt4all

Commit Graph

Author	SHA1	Message	Date
patcher9	71c957f8ee	Update monitoring.md (#2724 ) Signed-off-by: patcher9 <patcher99@dokulabs.com>	2 months ago
abhisomala	df510ef869	added tutorial and images for it (#2717 ) * added tutorial and images for it Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * updated images Signed-off-by: abhisomala <68791501+abhisomala@users.noreply.github.com> Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * Minor updates Signed-off-by: abhisomala <68791501+abhisomala@users.noreply.github.com> Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * fix link & indent note callouts Signed-off-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Signed-off-by: Max Cembalest <mbcembalest@gmail.com> * added obsidian tutorial to sidebar and fixed formatting of note boxes Signed-off-by: Max Cembalest <mbcembalest@gmail.com> --------- Signed-off-by: Max Cembalest <mbcembalest@gmail.com> Signed-off-by: abhisomala <68791501+abhisomala@users.noreply.github.com> Signed-off-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Co-authored-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Co-authored-by: Max Cembalest <mbcembalest@gmail.com>	2 months ago
mcembalest	62abecaec8	fixed link to embeddings docs on localdocs page (#2687 ) Signed-off-by: Max Cembalest <mbcembalest@gmail.com>	2 months ago
akgom	214499ce84	Update use-local-ai-models-to-privately-chat-with-google-drive.md (#2647 ) Updated screenshots for google drive guide with new app images Signed off by Max Cembalest	2 months ago
akgom	df5d374187	Update use-local-ai-models-to-privately-chat-with-One-Drive.md (#2646 ) Signed-off-by: akgom <132290469+akgom@users.noreply.github.com>	2 months ago
akgom	7ec67eab15	Create using-local-ai-models-to-privately-chat-with-One-Drive.md (#2637 ) * Create using-local-ai-models-to-privately-chat-with-One-Drive.md Signed-off-by: Max Cembalest	2 months ago
mcembalest	0de6eba69e	formatted note callouts (#2633 ) Signed-off-by: Max Cembalest <mbcembalest@gmail.com>	2 months ago
Andriy Mulyar	62d423c554	typo (#2629 ) Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	2 months ago
akgom	7f2ceff5c8	Create googledrive.md (#2621 ) * Create googledrive.md Signed-off-by: akgom <132290469+akgom@users.noreply.github.com> * updates Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> --------- Signed-off-by: akgom <132290469+akgom@users.noreply.github.com> Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>	2 months ago
Hampus	b9103892b6	fix: incomplete sentence in faq (#2611 ) Signed-off-by: Hampus <16954508+xdHampus@users.noreply.github.com>	2 months ago
mcembalest	69102a2859	small edits and placeholder gif (#2513 ) * small edits and placeholder gif Signed-off-by: Max Cembalest <max@nomic.ai> * jul2 docs updates Signed-off-by: Max Cembalest <max@nomic.ai> * added video Signed-off-by: mcembalest <70534565+mcembalest@users.noreply.github.com> Signed-off-by: Max Cembalest <max@nomic.ai> * quantization nits Signed-off-by: Max Cembalest <max@nomic.ai> --------- Signed-off-by: Max Cembalest <max@nomic.ai> Signed-off-by: mcembalest <70534565+mcembalest@users.noreply.github.com>	3 months ago
mcembalest	5306595176	V3 docs max (#2488 ) * new skeleton Signed-off-by: Max Cembalest <max@nomic.ai> * v3 docs Signed-off-by: Max Cembalest <max@nomic.ai> --------- Signed-off-by: Max Cembalest <max@nomic.ai>	3 months ago
patcher9	986d9d9bb8	docs: add description of OpenLIT GPU monitoring (#2436 ) Signed-off-by: patcher9 <patcher99@dokulabs.com>	3 months ago
patcher9	d43bfa0a53	docs: document OpenLIT integration (#2386 ) Signed-off-by: patcher9 <patcher99@dokulabs.com> Co-authored-by: Jared Van Bortel <jared@nomic.ai>	4 months ago
Jared Van Bortel	86560f3952	maint: remove Docker API server and related references (#2314 ) Signed-off-by: Jared Van Bortel <jared@nomic.ai>	4 months ago
Jacob Nguyen	55f3b056b7	typescript!: chatSessions, fixes, tokenStreams (#2045 ) Signed-off-by: jacob <jacoobes@sern.dev> Signed-off-by: limez <limez@protonmail.com> Signed-off-by: Jared Van Bortel <jared@nomic.ai> Co-authored-by: limez <limez@protonmail.com> Co-authored-by: Jared Van Bortel <jared@nomic.ai>	6 months ago
Jared Van Bortel	0455b80b7f	Embed4All: optionally count tokens, misc fixes (#2145 ) Key changes: * python: optionally return token count in Embed4All.embed * python and docs: models2.json -> models3.json * Embed4All: require explicit prefix for unknown models * llamamodel: fix shouldAddBOS for Bert and Nomic Bert Signed-off-by: Jared Van Bortel <jared@nomic.ai>	6 months ago
Jared Van Bortel	a1bb6084ed	python: documentation update and typing improvements (#2129 ) Key changes: * revert "python: tweak constructor docstrings" * docs: update python GPT4All and Embed4All documentation * breaking: require keyword args to GPT4All.generate Signed-off-by: Jared Van Bortel <jared@nomic.ai>	6 months ago
Jared Van Bortel	255568fb9a	python: various fixes for GPT4All and Embed4All (#2130 ) Key changes: * honor empty system prompt argument * current_chat_session is now read-only and defaults to None * deprecate fallback prompt template for unknown models * fix mistakes from #2086 Signed-off-by: Jared Van Bortel <jared@nomic.ai>	6 months ago
Jared Van Bortel	f500bcf6e5	llmodel: default to a blank line between reply and next prompt (#1996 ) Also make some related adjustments to the provided Alpaca-style prompt templates and system prompts. Signed-off-by: Jared Van Bortel <jared@nomic.ai>	7 months ago
TareHimself	a153cc5b25	typescript: async generator and token stream (#1897 ) Signed-off-by: Tare Ebelo <75279482+TareHimself@users.noreply.github.com> Signed-off-by: jacob <jacoobes@sern.dev> Signed-off-by: Jared Van Bortel <jared@nomic.ai> Co-authored-by: jacob <jacoobes@sern.dev> Co-authored-by: Jared Van Bortel <jared@nomic.ai>	7 months ago
Jared Van Bortel	4fc4d94be4	fix chat-style prompt templates (#1970 ) Also use a new version of Mistral OpenOrca. Signed-off-by: Jared Van Bortel <jared@nomic.ai>	7 months ago
Jared Van Bortel	ec13ba2818	docs: update list of supported localdocs formats (#1944 ) Signed-off-by: Jared Van Bortel <jared@nomic.ai>	8 months ago
Jacob Nguyen	a1f27072c2	fix/macm1ts (#1746 ) * make runtime library backend universal searchable * corepack enable * fix * pass tests * simpler * add more jsdoc * fix testS * fix up circle ci * bump version * remove false positive warning * add disclaimer * update readme * revert * update ts docs --------- Co-authored-by: Matthew Nguyen <matthewpnguyen@Matthews-MacBook-Pro-7.local>	9 months ago
AT	84749a4ced	Update gpt4all_chat.md Signed-off-by: AT <manyoso@users.noreply.github.com>	10 months ago
AT	f1c58d0e2c	Update gpt4all_chat.md Signed-off-by: AT <manyoso@users.noreply.github.com>	10 months ago
cebtenzzre	37b007603a	bindings: replace references to GGMLv3 models with GGUF (#1547 )	11 months ago
cebtenzzre	245c5ce5ea	update default model URLs (#1538 )	11 months ago
cebtenzzre	fd3014016b	docs: clarify Vulkan dep in build instructions for bindings (#1525 )	11 months ago
Adam Treat	ea66669cef	Switch to new models2.json for new gguf release and bump our version to 2.5.0.	12 months ago
Jacob Nguyen	4e55940edf	feat(typescript)/dynamic template (#1287 ) (#1326 ) * feat(typescript)/dynamic template (#1287) * remove packaged yarn * prompt templates update wip * prompt template update * system prompt template, update types, remove embed promises, cleanup * support both snakecased and camelcased prompt context * fix #1277 libbert, libfalcon and libreplit libs not being moved into the right folder after build * added support for modelConfigFile param, allowing the user to specify a local file instead of downloading the remote models.json. added a warning message if code fails to load a model config. included prompt context docs by amogus. * snakecase warning, put logic for loading local models.json into listModels, added constant for the default remote model list url, test improvements, simpler hasOwnProperty call * add DEFAULT_PROMPT_CONTEXT, export new constants * add md5sum testcase and fix constants export * update types * throw if attempting to list models without a source * rebuild docs * fix download logging undefined url, toFixed typo, pass config filesize in for future progress report * added overload with union types * bump to 2.2.0, remove alpha * code speling --------- Co-authored-by: Andreas Obersteiner <8959303+iimez@users.noreply.github.com>	1 year ago
cosmic-snow	af6fe5fbb5	Update gpt4all_faq.md - minor oversight: there are now six supported architectures - LLAMA -> LLaMA (for v1) - note about Llama 2 and link to license - limit some of the paragraphs to 150 chars Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>	1 year ago
Cosmic Snow	55f96aacc6	Move FAQ entries to general FAQ and adjust, plus minor improvements	1 year ago
Cosmic Snow	19d6460282	Extend & Update Python documentation - Expand Quickstart - Add Examples & Explanations: - Info on generation parameters - Model folder examples - Templates - Introspection with logging - Notes on allow_download=False - Interrupting generation (response callback) - FAQ	1 year ago
Jacob Nguyen	545c23b4bd	typescript: fix final bugs and polishing, circle ci documentation (#960 ) * fix: esm and cjs compatibility Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update prebuild.js Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix gpt4all.js Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Fix compile for windows and linux again. PLEASE DON'T REVERT THISgit gui! * version bump * polish up spec and build scripts * lock file refresh * fix: proper resource closing and error handling * check make sure libPath not null * add msvc build script and update readme requirements * python workflows in circleci * dummy python change * no need for main * second hold for pypi deploy * let me deploy pls * bring back when condition * Typo, ignore list (#967) Fix typo in javadoc, Add word to ignore list for codespellrc --------- Co-authored-by: felix <felix@zaslavskiy.net> * llmodel: change tokenToString to not use string_view (#968) fixes a definite use-after-free and likely avoids some other potential ones - std::string will convert to a std::string_view automatically but as soon as the std::string in question goes out of scope it is already freed and the string_view is pointing at freed memory - this is mostly fine if its returning a reference to the tokenizer's internal vocab table but it's, imo, too easy to return a reference to a dynamically constructed string with this as replit is doing (and unfortunately needs to do to convert the internal whitespace replacement symbol back to a space) * Initial Library Loader for .NET Bindings / Update bindings to support newest changes (#763) * Initial Library Loader * Load library as part of Model factory * Dynamically search and find the dlls * Update tests to use locally built runtimes * Fix dylib loading, add macos runtime support for sample/tests * Bypass automatic loading by default. * Only set CMAKE_OSX_ARCHITECTURES if not already set, allow cross-compile * Switch Loading again * Update build scripts for mac/linux * Update bindings to support newest breaking changes * Fix build * Use llmodel for Windows * Actually, it does need to be libllmodel * Name * Remove TFMs, bypass loading by default * Fix script * Delete mac script --------- Co-authored-by: Tim Miller <innerlogic4321@ghmail.com> * bump llama.cpp mainline to latest (#964) * fix prompt context so it's preserved in class * update setup.py * metal replit (#931) metal+replit makes replit work with Metal and removes its use of `mem_per_token` in favor of fixed size scratch buffers (closer to llama.cpp) * update documentation scripts and generation to include readme.md * update readme and documentation for source * begin tests, import jest, fix listModels export * fix typo * chore: update spec * fix: finally, reduced potential of empty string * chore: add stub for createTokenSream * refactor: protecting resources properly * add basic jest tests * update * update readme * refactor: namespace the res variable * circleci integration to automatically build docs * add starter docs * typo * more circle ci typo * forgot to add nodejs circle ci orb * fix circle ci * feat: @iimez verify download and fix prebuild script * fix: oops, option name wrong * fix: gpt4all utils not emitting docs * chore: fix up scripts * fix: update docs and typings for md5 sum * fix: macos compilation * some refactoring * Update index.cc Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * update readme and enable exceptions on mac * circle ci progress * basic embedding with sbert (not tested & cpp side only) * fix circle ci * fix circle ci * update circle ci script * bruh * fix again * fix * fixed required workflows * fix ci * fix pwd * fix pwd * update ci * revert * fix * prevent rebuild * revmove noop * Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update binding.gyp Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix fs not found * remove cpp 20 standard * fix warnings, safer way to calculate arrsize * readd build backend * basic embeddings and yarn test" * fix circle ci Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> fix macos paths update readme and roadmap split up spec update readme check for url in modelsjson update docs and inline stuff update yarn configuration and readme update readme readd npm publish script add exceptions bruh one space broke the yaml codespell oops forgot to add runtimes folder bump version try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images add fallback for unknown architectures attached to wrong workspace hopefuly fix moving everything under backend to persist should work now * update circle ci script * prevent rebuild * revmove noop * Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * Update binding.gyp Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> * fix fs not found * remove cpp 20 standard * fix warnings, safer way to calculate arrsize * readd build backend * basic embeddings and yarn test" * fix circle ci Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Update continue_config.yml Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> fix macos paths update readme and roadmap split up spec update readme check for url in modelsjson update docs and inline stuff update yarn configuration and readme update readme readd npm publish script add exceptions bruh one space broke the yaml codespell oops forgot to add runtimes folder bump version try code snippet https://support.circleci.com/hc/en-us/articles/8325075309339-How-to-install-NPM-on-Windows-images add fallback for unknown architectures attached to wrong workspace hopefuly fix moving everything under backend to persist should work now * Update README.md Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> --------- Signed-off-by: Jacob Nguyen <76754747+jacoobes@users.noreply.github.com> Co-authored-by: Adam Treat <treat.adam@gmail.com> Co-authored-by: Richard Guo <richardg7890@gmail.com> Co-authored-by: Felix Zaslavskiy <felix.zaslavskiy@gmail.com> Co-authored-by: felix <felix@zaslavskiy.net> Co-authored-by: Aaron Miller <apage43@ninjawhale.com> Co-authored-by: Tim Miller <drasticactions@users.noreply.github.com> Co-authored-by: Tim Miller <innerlogic4321@ghmail.com>	1 year ago
385olt	b4dbbd1485	Python bindings: Custom callbacks, chat session improvement, refactoring (#1145 ) * Added the following features: \n 1) Now prompt_model uses the positional argument callback to return the response tokens. \n 2) Due to the callback argument of prompt_model, prompt_model_streaming only manages the queue and threading now, which reduces duplication of the code. \n 3) Added optional verbose argument to prompt_model which prints out the prompt that is passed to the model. \n 4) Chat sessions can now have a header, i.e. an instruction before the transcript of the conversation. The header is set at the creation of the chat session context. \n 5) generate function now accepts an optional callback. \n 6) When streaming and using chat session, the user doesn't need to save assistant's messages by himself. This is done automatically. * added _empty_response_callback so I don't have to check if callback is None * added docs * now if the callback stop generation, the last token is ignored * fixed type hints, reimplemented chat session header as a system prompt, minor refactoring, docs: removed section about manual update of chat session for streaming * forgot to add some type hints! * keep the config of the model in GPT4All class which is taken from models.json if the download is allowed * During chat sessions, the model-specific systemPrompt and promptTemplate are applied. * implemented the changes * Fixed typing. Now the user can set a prompt template that will be applied even outside of a chat session. The template can also have multiple placeholders that can be filled by passing a dictionary to the generate function * reversed some changes concerning the prompt templates and their functionality * fixed some type hints, changed list[float] to List[Float] * fixed type hints, changed List[Float] to List[float] * fix typo in the comment: Pepare => Prepare --------- Signed-off-by: 385olt <385olt@gmail.com>	1 year ago
Andriy Mulyar	cfd70b69fc	Update gpt4all_python_embedding.md Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Andriy Mulyar	306105e62f	Update gpt4all_python_embedding.md Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Andriy Mulyar	89e277bb3c	Update gpt4all_python_embedding.md Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Adam Treat	f543affa9a	Add better docs and threading support to bert.	1 year ago
Adam Treat	0c0a4f2c22	Add the docs.	1 year ago
cosmic-snow	00a945eaee	Update gpt4all_faq.md - Add information about AVX/AVX2. - Update supported architectures. Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>	1 year ago
cosmic-snow	d611d10747	Update index.md (#1157 ) Some minor touch-ups to the documentation landing page. Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>	1 year ago
Andriy Mulyar	01bd3d6802	Python chat streaming (#1127 ) * Support streaming in chat session * Uncommented tests	1 year ago
Andriy Mulyar	46a0762bd5	Python Bindings: Improved unit tests, documentation and unification of API (#1090 ) * Makefiles, black, isort * Black and isort * unit tests and generation method * chat context provider * context does not reset * Current state * Fixup * Python bindings with unit tests * GPT4All Python Bindings: chat contexts, tests * New python bindings and backend fixes * Black and Isort * Documentation error * preserved n_predict for backwords compat with langchain --------- Co-authored-by: Adam Treat <treat.adam@gmail.com>	1 year ago
AMOGUS	b8464073b8	Update gpt4all_chat.md (#1050 ) * Update gpt4all_chat.md Cleaned up and made the sideloading part more readable, also moved Replit architecture to supported ones. (+ renamed all "ggML" to "GGML" because who calls it "ggML"??) Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com> * Removed the prefixing part Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com> * Bump version Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> --------- Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com> Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
cosmic-snow	ee26e8f271	CLI Improvements (#1021 ) * Add gpt4all-bindings/cli/README.md * Unify version information - Was previously split; base one on the other - Add VERSION_INFO as the "source of truth": - Modelled after sys.version_info. - Implemented as a tuple, because it's much easier for (partial) programmatic comparison. - Previous API is kept intact. * Add gpt4all-bindings/cli/developer_notes.md - A few notes on what's what, especially regarding docs * Add gpt4all-bindings/python/docs/gpt4all_cli.md - The CLI user documentation * Bump CLI version to 0.3.5 * Finalise docs & add to index.md - Amend where necessary - Fix typo in gpt4all_cli.md - Mention and add link to CLI doc in index.md * Add docstings to gpt4all-bindings/cli/app.py * Better 'groovy' link & fix typo - Documentation: point to the Hugging Face model card for 'groovy' - Correct typo in app.py	1 year ago
Martin Mauch	af28173a25	Parse Org Mode files (#1038 )	1 year ago
Andriy Mulyar	266f13aee9	Update gpt4all_faq.md (#861 ) Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago
Andriy Mulyar	01071efc9c	Documentation for model sideloading (#851 ) * Documentation for model sideloading Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> * Update gpt4all_chat.md Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com> --------- Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>	1 year ago

1 2

71 Commits (b70d68977db50c1266c80129dcc1cbb0080fd4d6)