Commit Graph

325 Commits (a5b93cf0957607b658648f51b17859477e516659)

Author SHA1 Message Date
Adam Treat c1794597a7 Revert "Enable Wayland in build"
This reverts commit d686a583f9.
1 year ago
Akarshan Biswas d686a583f9 Enable Wayland in build
# Describe your changes
The patch include support for running natively on a Linux Wayland display server/compositor which is successor to old Xorg.
Cmakelist was missing WaylandClient so added it back.

Will fix #1047 .

Signed-off-by: Akarshan Biswas <akarshan.biswas@gmail.com>
1 year ago
AMOGUS 3417a37c54
Change "web server" to "API server" for less confusion (#1039)
* Change "Web server" to "API server"

* Changed "API server" to "OpenAPI server"

* Reversed back to "API server" and updated tooltip
1 year ago
cosmic-snow a423075403
Allow Cross-Origin Resource Sharing (CORS) (#1008) 1 year ago
Martin Mauch af28173a25
Parse Org Mode files (#1038) 1 year ago
niansa/tuxifan 01acb8d250 Update download speed less often
To not show every little tiny network spike to the user

Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
1 year ago
Adam Treat 09ae04cee9 This needs to work even when localdocs and codeblocks are detected. 1 year ago
Adam Treat ce7333029f Make the copy button a little more tolerant. 1 year ago
Adam Treat 508993de75 Exit early when no chats are saved. 1 year ago
Adam Treat 85bc861835 Fix the alignment. 1 year ago
Adam Treat eebfe642c4 Add an error message to download dialog if models.json can't be retrieved. 1 year ago
Adam Treat 968868415e Move saving chats to a thread and display what we're doing to the user. 1 year ago
Adam Treat c8a590bc6f Get rid of last blocking operations and make the chat/llm thread safe. 1 year ago
Adam Treat 84ec4311e9 Remove duplicated state tracking for chatgpt. 1 year ago
Adam Treat 7d2ce06029 Start working on more thread safety and model load error handling. 1 year ago
Adam Treat d5f56d3308 Forgot to add a signal handler. 1 year ago
Adam Treat aa2c824258 Initialize these. 1 year ago
Adam Treat d018b4c821 Make this atomic. 1 year ago
Adam Treat a3a6a20146 Don't store db results in ChatLLM. 1 year ago
Adam Treat 0cfe225506 Remove this as unnecessary. 1 year ago
Adam Treat 7c28e79644 Fix regenerate response with references. 1 year ago
AT f76df0deac
Typescript (#1022)
* Show token generation speed in gui.

* Add typescript/javascript to list of highlighted languages.
1 year ago
AT 2b6cc99a31
Show token generation speed in gui. (#1020) 1 year ago
cosmic-snow fd419caa55
Minor models.json description corrections. (#1013)
Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>
1 year ago
Adam Treat 42e8049564 Bump version and new release notes for metal bugfix edition. 1 year ago
Adam Treat e2c807d4df Always install metal on apple. 1 year ago
Adam Treat d5179ac0c0 Fix cmake build. 1 year ago
Adam Treat d4283c0053 Fix metal and replit. 1 year ago
Adam Treat 0a0d4a714e New release and bump the version. 1 year ago
Adam Treat 782e1e77a4 Fix up model names that don't begin with 'ggml-' 1 year ago
Adam Treat b39a7d4fd9 Fix json. 1 year ago
Adam Treat 6690b49a9f Converts the following to Q4_0
* Snoozy
* Nous Hermes
* Wizard 13b uncensored

Uses the filenames from actual download for these three.
1 year ago
AT a576220b18
Support loading files if 'ggml' is found anywhere in the name not just at (#1001)
the beginning and add deprecated flag to models.json so older versions will
show a model, but later versions don't. This will allow us to transition
away from models < ggmlv2 and still allow older installs of gpt4all to work.
1 year ago
Adam Treat 8953b7f6a6 Fix regression in checked of db and network. 1 year ago
Aaron Miller 88616fde7f
llmodel: change tokenToString to not use string_view (#968)
fixes a definite use-after-free and likely avoids some other
potential ones - std::string will convert to a std::string_view
automatically but as soon as the std::string in question goes out of
scope it is already freed and the string_view is pointing at freed
memory - this is *mostly* fine if its returning a reference to the
tokenizer's internal vocab table but it's, imo, too easy to return a
reference to a dynamically constructed string with this as replit is
doing (and unfortunately needs to do to convert the internal whitespace
replacement symbol back to a space)
1 year ago
Adam Treat 68ff7001ad Bugfixes for prompt syntax highlighting. 1 year ago
Adam Treat 60d95cdd9b Fix some bugs with bash syntax and add some C23 keywords. 1 year ago
Adam Treat e986f18904 Add c++/c highighting support. 1 year ago
Adam Treat ae46234261 Spelling error. 1 year ago
Adam Treat 318c51c141 Add code blocks and python syntax highlighting. 1 year ago
Adam Treat b67cba19f0 Don't interfere with selection. 1 year ago
Adam Treat 50c5b82e57 Clean up the context links a bit. 1 year ago
AT a9c2f47303
Add new solution for context links that does not force regular markdown (#938)
in responses which is disruptive to code completions in responses.
1 year ago
Aaron Miller d3ba1295a7
Metal+LLama take two (#929)
Support latest llama with Metal
---------

Co-authored-by: Adam Treat <adam@nomic.ai>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
1 year ago
Adam Treat b162b5c64e Revert "llama on Metal (#885)"
This reverts commit c55f81b860.
1 year ago
Aaron Miller c55f81b860
llama on Metal (#885)
Support latest llama with Metal

---------

Co-authored-by: Adam Treat <adam@nomic.ai>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
1 year ago
pingpongching 0d0fae0ca8 Change the default values for generation in GUI 1 year ago
Adam Treat 8fb73c2114 Forgot to bump. 1 year ago
Richard Guo be2310322f update models json with replit model 1 year ago
Andriy Mulyar eb26293205
Update CollectionsDialog.qml (#856)
Phrasing for localdocs

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Richard Guo c4706d0c14
Replit Model (#713)
* porting over replit code model to gpt4all

* replaced memory with kv_self struct

* continuing debug

* welp it built but lot of sus things

* working model loading and somewhat working generate.. need to format response?

* revert back to semi working version

* finally got rid of weird formatting

* figured out problem is with python bindings - this is good to go for testing

* addressing PR feedback

* output refactor

* fixed prompt reponse collection

* cleanup

* addressing PR comments

* building replit backend with new ggmlver code

* chatllm replit and clean python files

* cleanup

* updated replit to match new llmodel api

* match llmodel api and change size_t to Token

* resolve PR comments

* replit model commit comment
1 year ago
Adam Treat fdffad9efe New release notes 1 year ago
Adam Treat f5bdf7c94c Bump the version. 1 year ago
Andriy Mulyar d8e821134e
Revert "Fix bug with resetting context with chatgpt model." (#859)
This reverts commit 031d7149a7.
1 year ago
Adam Treat ecfeba2710 Revert "Speculative fix for windows llama models with installer."
This reverts commit c99e03e22e.
1 year ago
Adam Treat c99e03e22e Speculative fix for windows llama models with installer. 1 year ago
AT da757734ea
Release notes for version 2.4.5 (#853) 1 year ago
Adam Treat 969ff0ee6b Fix installers for windows and linux. 1 year ago
Adam Treat 1d4c8e7091 These need to be installed for them to be packaged and work for both mac and windows. 1 year ago
Adam Treat 3a9cc329b1 Fix compile on mac. 1 year ago
Adam Treat 25eec33bda Try and fix mac. 1 year ago
Adam Treat 91f20becef Need this so the linux installer packages it as a dependency. 1 year ago
Adam Treat 812b2f4b29 Make installers work with mac/windows for big backend change. 1 year ago
Andriy Mulyar 2e5b114364
Update models.json
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 0db6fd6867
Update models.json (#838)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
AT d5cf584f8d
Remove older models that are not as popular. (#837)
* Remove older models that are not as popular.

* Update models.json

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Adam Treat 301d2fdbea Fix up for newer models on reset context. This fixes the model from totally failing after a reset context. 1 year ago
Adam Treat bdba2e8de6 Allow for download of models hosted on third party hosts. 1 year ago
Adam Treat 5073630759 Try again with the url. 1 year ago
Adam Treat 6ba37f47c1 Trying out a new feature to download directly from huggingface. 1 year ago
AT be3c63ffcd
Update build_and_run.md (#834)
Signed-off-by: AT <manyoso@users.noreply.github.com>
1 year ago
AT 5f95aa9fc6
We no longer have an avx_only repository and better error handling for minimum hardware requirements. (#833) 1 year ago
Adam Treat 9f590db98d Better error handling when the model fails to load. 1 year ago
AT bbe195ee02
Backend prompt dedup (#822)
* Deduplicated prompt() function code
1 year ago
Adam Treat bc624f5389 Add a collection immediately and show a placeholder + busy indicator in localdocs settings. 1 year ago
Adam Treat 55055ca983 Add the ability to change the directory via text field not just 'browse' button. 1 year ago
Adam Treat 25ee51e2ca Actually use the theme dark color for window background. 1 year ago
Adam Treat d9ddd373d6 Prevent flashing of white on resize. 1 year ago
Adam Treat 8aba76ad05 Min constraints on about dialog. 1 year ago
Adam Treat a7f74e9d01 Some tweaks to UI to make window resizing smooth and flow nicely. 1 year ago
niansa/tuxifan f3564ac6b9
Fixed tons of warnings and clazy findings (#811) 1 year ago
niansa/tuxifan f0be66a221 Fixed spelling error in models.json
to make CI happy

Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
1 year ago
Adam Treat be9f6ad543 Add models/release.json to github repo to allow PRs 1 year ago
Adam Treat 188770c92a Remove this as it is no longer useful. 1 year ago
Adam Treat a41bd6ac0a Trying to shrink the copy+paste code and do more code sharing between backend model impl. 1 year ago
Adam Treat 031d7149a7 Fix bug with resetting context with chatgpt model. 1 year ago
Adam Treat 94633da2d7 Don't hardcode these. 1 year ago
Adam Treat 28944ac01b Fix for stale references after we regenerate. 1 year ago
Adam Treat aea94f756d Better name for database results. 1 year ago
Adam Treat f62e439a2d Make localdocs work with server mode. 1 year ago
Adam Treat 20eff29432 Logger should also output to stderr 1 year ago
Adam Treat f74363bb3a Fix compile 1 year ago
niansa/tuxifan ddb5fa718d
Implemented logging mechanism (#785) 1 year ago
niansa a3d08cdcd5 Dlopen better implementation management (Version 2) 1 year ago
Adam Treat cae757aacd Make all the toolbuttons highlight on hover. 1 year ago
Adam Treat 93a05c8834 Fixup the plus new chat button. 1 year ago
Adam Treat ae51e3f6fa Use the proper text color for sending messages. 1 year ago
Adam Treat 95244a4d78 Fix warning. 1 year ago
Adam Treat 220e5547db Draw the indicator for combobox to ensure it looks the same on all platforms. 1 year ago
Adam Treat 1370995b92 Add a custom busy indicator to further align look and feel across platforms. 1 year ago
AT 48275d0dcc
Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
1 year ago
Adam Treat f4a1f7340c Fix offset of prompt/response icons for smaller text. 1 year ago
Adam Treat 5f940208e4 Make the comboboxes align in UI. 1 year ago
Adam Treat 64ec93d59b Some color and theme enhancements to make the UI contrast a bit better. 1 year ago
Adam Treat e756675d56 Fix wording of this accessible description. 1 year ago
Adam Treat 3e828e1e4b Add a hover and pressed to the visual indication of MyButton. 1 year ago
Adam Treat 122b14d526 Use the new MyButton for the regenerate response button. 1 year ago
Adam Treat 7aed367c68 Add a label to the model loading visual indicator. 1 year ago
Adam Treat 912cb2a842 Get rid of blocking behavior for regenerate response. 1 year ago
FoivosC 337c7fecac construct and return the correct reponse when the request is a chat completion 1 year ago
Adam Treat d9f5626481 Fix remove model from model download for regular models. 1 year ago
Adam Treat 810a3b12cc This time remember to bump the version right after a release. 1 year ago
Adam Treat d1ff7132c5 Bump the version number. 1 year ago
Adam Treat afe3870b7a Libraries named differently on msvc. 1 year ago
Adam Treat 474c5387f9 Get the backend as well as the client building/working with msvc. 1 year ago
Adam Treat 265488e54a Add a newline 1 year ago
Adam Treat 98201540a2 Various fixes to remove unnecessary warnings. 1 year ago
Adam Treat 0403a122ca Don't use the full path in reference text. 1 year ago
Adam Treat 9b0629db8b Add context link to references. 1 year ago
Adam Treat db9eecdce4 Store the references separately so they are not sent to datalake. 1 year ago
Adam Treat b5380c9b7f Adds the collections to serialize and implement references for localdocs. 1 year ago
Adam Treat d81302950e Complete the settings for localdocs. 1 year ago
Adam Treat 01b8c7617f Add more of the UI for selecting collections for chats. 1 year ago
Adam Treat 2827c5876c Clean up the settings dialog for localdocs a bit. 1 year ago
Adam Treat d555ed3b07 Begin implementing the localdocs ui in earnest. 1 year ago
Adam Treat 120fbbf67d Start fleshing out the localdocs ui. 1 year ago
Adam Treat af33be7b3e Add a localdocs tab. 1 year ago
Adam Treat d9eddbec45 Add a collection list to support a UI. 1 year ago
Adam Treat 68ba9c564b Specify a large number of suffixes we will search for now. 1 year ago
Adam Treat c800291e7f Add prompt processing and localdocs to the busy indicator in UI. 1 year ago
Adam Treat 618895f0a1 Turn off the debugging messages by default. 1 year ago
Adam Treat c6df4645c8 Add a new muted text color. 1 year ago
Adam Treat 54fc980cb5 Cleanup of the database, better chunking, better matching. 1 year ago
Adam Treat 5f533e76a1 Remove this signal as unnecessary for now. 1 year ago
Adam Treat e70a1c458b Add remove folder implementation. 1 year ago
Adam Treat d88eddbc20 Fixup the rescan. Fix debug output. 1 year ago
Adam Treat 7e42af5f33 localdocs 1 year ago
Adam Treat b36a520207 Fix the build. 1 year ago
Adam Treat bcce93555a Small cleanups for settings dialog. 1 year ago
Justin Wang 5305bce59a fix typo so padding can be accessed 1 year ago
Justin Wang d7ab4c0e2d change accessible description for thumbs up button 1 year ago
Justin Wang a19ef751dc add missing accessible props for buttons, remove forgotten duplicate accessible props 1 year ago
Justin Wang e3d6eb334b dedup qml: move accessible properties to MyButton 1 year ago
Justin Wang eb6a7cca47 dedup qml: convert more buttons to MyButton 1 year ago
Adam Treat 8e705d730d Minor tweaks to look and feel for some dialogs and button. 1 year ago
Justin Wang 2ce22208a3 deduplicate qml: create and use MyCheckBox and MyTextField 1 year ago
Justin Wang 15b3e0d3f6 remove padding 1 year ago
Justin Wang 28b0455451 replace buttons with MyButton 1 year ago
Adam Treat 5c1cf69b8b Start to deduplicate code in qml. 1 year ago
Adam Treat cfb45274e0 Fix the tabs so they don't have a double border on the bottom. 1 year ago
Adam Treat d9698436df Fix the dialog so it opens on the correct folder. 1 year ago
Juuso Alasuutari 81fdc28e58 llmodel: constify LLModel::threadCount() 1 year ago
Andriy Mulyar 914519e772
Update build_and_run.md (#636)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Shukri bce2b3025b Fix typo in README 1 year ago
Adam Treat a86a1aea6b Fix for windows/mac installers. 1 year ago
Adam Treat 7221169eff Remove davinci-003 option. 1 year ago
Adam Treat 86b6d40d08 Bump the version. 1 year ago
Yaroslav Halchenko e4bc9c0c3b fix ambigous typo 1 year ago
Adam Treat 79d6243fe1 Use the default for max_tokens to avoid errors. 1 year ago
Adam Treat b24ace372b Add ability to remove models. 1 year ago
Adam Treat 47059ad9f1 Send the prompt template with conversations to the datalake. 1 year ago
Adam Treat 748e7977ca Generate the new prompt/response pair before model loading in server mode. 1 year ago
Adam Treat f931de21c5 Add save/restore to chatgpt chats and allow serialize/deseralize from disk. 1 year ago
Adam Treat 0cd509d530 Add large network icon background for chatgpt and server modes. 1 year ago
Adam Treat dd27c10f54 Preliminary support for chatgpt models. 1 year ago
Adam Treat da3828af89 Use compact json format. 1 year ago
Adam Treat b71c0ac3bd The server has different lifetime mgmt than the other chats. 1 year ago
Adam Treat ddc24acf33 Much better memory mgmt for multi-threaded model loading/unloading. 1 year ago
Adam Treat 2989b74d43 httpserver 1 year ago
Adam Treat 76675536b0 Cleanup the chatllm properly. 1 year ago
Adam Treat 4a2e3e55ae Fix typo. 1 year ago
AT 2c5e2bf1ee
Update README.md 1 year ago
AT 507a96b2f3
Update README.md 1 year ago
Adam Treat d918b02c29 Move the llmodel C API to new top-level directory and version it. 1 year ago
Adam Treat 6015154bef Moving everything to subdir for monorepo merge. 1 year ago