Commit Graph

1121 Commits (2a6c673c25d49243c6f708ec468b5872f064ca38)
 

Author SHA1 Message Date
Adam Treat 2a6c673c25 Begin redesign of settings dialog. 1 year ago
Adam Treat dedb0025be Refactor the settings dialog so that it uses a set of components/abstractions
for all of the tabs and stacks
1 year ago
Lakshay Kansal b3c29e4179
implemented support for bash and go highlighting rules (#1138)
* implemented support for bash and go

* add more commands to bash

* gave precedence to variables over strings in bash
1 year ago
matthew-gill fd4081aed8 Update codeblock font 1 year ago
Andriy Mulyar 71a7032421
python bindings v1.0.2
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Aaron Miller 6987910668
python bindings: typing fixes, misc fixes (#1131)
* python: do not mutate locals()

* python: fix (some) typing complaints

* python: queue sentinel need not be a str

* python: make long inference tests opt in
1 year ago
Andriy Mulyar 01bd3d6802
Python chat streaming (#1127)
* Support streaming in chat session

* Uncommented tests
1 year ago
Andriy Mulyar aced5e6615
Update README.md to python bindings
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 13f0f546ed
Update makefile gpt4all-api
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 19412cfa5d
Clear chat history between chat sessions (#1116) 1 year ago
Aaron Miller 4a24b586df llama.cpp: metal buffer freeing 1 year ago
Aaron Miller 137bc2c367 replit: free metal context 1 year ago
Aaron Miller 3599663a22 bindings/python: type assert 1 year ago
Aaron Miller 57dc0c8953 adjust eval buf sizes to pass long input test 1 year ago
Aaron Miller 7a5f6e4726 limit prompt batch size to 128 1 year ago
Aaron Miller 958c8d4fa5 bindings/python: long input tests 1 year ago
Aaron Miller 883775bc5f move 230511 submodule to nomic fork, fix alibi assert 1 year ago
Aaron Miller 6a74e515e1 bindings/python: make target to set up env 1 year ago
Aaron Miller ac5c8e964f
bindings/python: fix typo (#1111) 1 year ago
Andriy Mulyar 46a0762bd5
Python Bindings: Improved unit tests, documentation and unification of API (#1090)
* Makefiles, black, isort

* Black and isort

* unit tests and generation method

* chat context provider

* context does not reset

* Current state

* Fixup

* Python bindings with unit tests

* GPT4All Python Bindings: chat contexts, tests

* New python bindings and backend fixes

* Black and Isort

* Documentation error

* preserved n_predict for backwords compat with langchain

---------

Co-authored-by: Adam Treat <treat.adam@gmail.com>
1 year ago
Aaron Miller 40a3faeb05
Use ggml scratch bufs for mpt and gptj models (#1104)
* backend/gptj: use scratch buffers

reduces total memory required and makes eval buf not grow with n_past

* backend/mpt: use scratch bufs

* fix format-related compile warnings
1 year ago
Lakshay Kansal 70cbff70cc created highlighting rules for java using regex for the gpt4all chat interface 1 year ago
Adam Treat 1cd734efdc Provide an abstraction to break up the settings dialog into managable pieces. 1 year ago
Adam Treat 7f252b4970 This completes the work of consolidating all settings that can be changed by the user on new settings object. 1 year ago
Aaron Miller 8d19ef3909
backend: factor out common elements in model code (#1089)
* backend: factor out common structs in model code

prepping to hack on these by hopefully making there be fewer places to fix the same bug

rename

* use common buffer wrapper instead of manual malloc

* fix replit compile warnings
1 year ago
Adam Treat 285aa50b60 Consolidate generation and application settings on the new settings object. 1 year ago
Adam Treat 7f66c28649 Use the new settings for response generation. 1 year ago
Adam Treat a8baa4da52 The sync for save should be after. 1 year ago
Adam Treat 705b480d72 Start moving toward a single authoritative class for all settings. This
is necessary to get rid of technical debt before we drastically increase
the complexity of settings by adding per model settings and mirostat and
other fun things. Right now the settings are divided between QML and C++
and some convenience methods to deal with settings sync and so on that are
in other singletons. This change consolidates all the logic for settings
into a single class with a single API for both C++ and QML.
1 year ago
Andriy Mulyar 390994ea5e
Update README.md to include inference example
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar a67f8132e1
Update README.md
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 633e2a2137
GPT4All API Scaffolding. Matches OpenAI OpenAPI spec for chats and completions (#839)
* GPT4All API Scaffolding. Matches OpenAI OpenAI spec for engines, chats and completions

* Edits for docker building

* FastAPI app builds and pydantic models are accurate

* Added groovy download into dockerfile

* improved dockerfile

* Chat completions endpoint edits

* API uni test sketch

* Working example of groovy inference with open ai api

* Added lines to test

* Set default to mpt
1 year ago
Andriy Mulyar 6b8456bf99
Update README.md (#1086)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Adam Treat e70899a26c Make the retrieval/parsing of models.json sync on startup. We were jumping to many hoops to mitigate the async behavior. 1 year ago
Adam Treat 9560336490 Match on the filename too for server mode. 1 year ago
Aaron Miller 28d41d4f6d
falcon: use *model-local* eval & scratch bufs (#1079)
fixes memory leaks copied from ggml/examples based implementation
1 year ago
Adam Treat 58cd346686 Bump release again and new release notes. 1 year ago
Adam Treat 0f8f364d76 Fix mac again for falcon. 1 year ago
Adam Treat 8aae4e52b3 Fix for falcon on mac. 1 year ago
Adam Treat 9375c71aa7 New release notes for 2.4.9 and bump version. 1 year ago
Adam Treat 71449bbc4b Fix this correctly? 1 year ago
Adam Treat 07a5405618 Make it clear this is our finetune. 1 year ago
Adam Treat 189ac82277 Fix server mode. 1 year ago
Adam Treat b56cc61ca2 Don't allow setting an invalid prompt template. 1 year ago
Adam Treat 0780393d00 Don't use local. 1 year ago
Adam Treat 924efd9e25 Add falcon to our models.json 1 year ago
Adam Treat d3b8234106 Fix spelling. 1 year ago
Adam Treat 42c0a6673a Don't persist the force metal setting. 1 year ago
Adam Treat 267601d670 Enable the force metal setting. 1 year ago
Zach Nussbaum 2565f6a94a feat: add conversion script 1 year ago