Commit Graph

89 Commits (9560336490e950ca353d4ed81ed09d5f94f2e441)

Author SHA1 Message Date
AMOGUS b8464073b8
Update gpt4all_chat.md (#1050)
* Update gpt4all_chat.md

Cleaned up and made the sideloading part more readable, also moved Replit architecture to supported ones. (+ renamed all "ggML" to "GGML" because who calls it "ggML"??)

Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>

* Removed the prefixing part

Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>

* Bump version

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Aaron Miller b19a3e5b2c add requiredMem method to llmodel impls
most of these can just shortcut out of the model loading logic llama is a bit worse to deal with because we submodule it so I have to at least parse the hparams, and then I just use the size on disk as an estimate for the mem size (which seems reasonable since we mmap() the llama files anyway)
1 year ago
cosmic-snow ee26e8f271
CLI Improvements (#1021)
* Add gpt4all-bindings/cli/README.md

* Unify version information
- Was previously split; base one on the other
- Add VERSION_INFO as the "source of truth":
  - Modelled after sys.version_info.
  - Implemented as a tuple, because it's much easier for (partial)
    programmatic comparison.
- Previous API is kept intact.

* Add gpt4all-bindings/cli/developer_notes.md
- A few notes on what's what, especially regarding docs

* Add gpt4all-bindings/python/docs/gpt4all_cli.md
- The CLI user documentation

* Bump CLI version to 0.3.5

* Finalise docs & add to index.md
- Amend where necessary
- Fix typo in gpt4all_cli.md
- Mention and add link to CLI doc in index.md

* Add docstings to gpt4all-bindings/cli/app.py

* Better 'groovy' link & fix typo
- Documentation: point to the Hugging Face model card for 'groovy'
- Correct typo in app.py
1 year ago
EKal-aa aed7b43143
set n_threads in GPT4All python bindings (#1042)
* set n_threads in GPT4All

* changed default n_threads to None
1 year ago
Martin Mauch af28173a25
Parse Org Mode files (#1038) 1 year ago
Richard Guo a39a897e34 0.3.5 bump 1 year ago
Richard Guo 25ce8c6a1e revert version 1 year ago
Richard Guo 282a3b5498 setup.py update 1 year ago
cosmic-snow b00ac632e3
Update python/README.md with troubleshooting info (#1012)
- Add some notes about common Windows problems when trying to make a local build (MinGW and MSVC).

Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>
1 year ago
standby24x7 cdea838671
Fix spelling typo in gpt4all.py (#1007)
Signed-off-by: Masanari Iida <standby24x7@gmail.com>
1 year ago
Richard Guo a9b33c3d10 update setup.py 1 year ago
Richard Guo a99cc34efb fix prompt context so it's preserved in class 1 year ago
Richard Guo 5a0b348219 second hold for pypi deploy 1 year ago
Richard Guo 014205a916 dummy python change 1 year ago
Richard Guo e9449190cd version bump 1 year ago
Aaron Miller d3ba1295a7
Metal+LLama take two (#929)
Support latest llama with Metal
---------

Co-authored-by: Adam Treat <adam@nomic.ai>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
1 year ago
Richard Guo e0a8480c0e
Generator in Python Bindings - streaming yields tokens at a time (#895)
* generator method

* cleanup

* bump version number for clarity

* added replace in decode to avoid unicodedecode exception

* revert back to _build_prompt
1 year ago
Claudius Ellsel 3c1b59f5c6
Move usage in Python bindings readme to own section (#907)
Have own section for short usage example, as it is not specific to local build

Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
1 year ago
Claudius Ellsel 39a7c35d03
Update README.md (#906)
Add PyPI link and add clickable, more specific link to documentation

Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
1 year ago
Richard Guo c4706d0c14
Replit Model (#713)
* porting over replit code model to gpt4all

* replaced memory with kv_self struct

* continuing debug

* welp it built but lot of sus things

* working model loading and somewhat working generate.. need to format response?

* revert back to semi working version

* finally got rid of weird formatting

* figured out problem is with python bindings - this is good to go for testing

* addressing PR feedback

* output refactor

* fixed prompt reponse collection

* cleanup

* addressing PR comments

* building replit backend with new ggmlver code

* chatllm replit and clean python files

* cleanup

* updated replit to match new llmodel api

* match llmodel api and change size_t to Token

* resolve PR comments

* replit model commit comment
1 year ago
Andriy Mulyar ef35eb496f Supports downloading officially supported models not hosted on gpt4all R2 1 year ago
Andriy Mulyar 266f13aee9
Update gpt4all_faq.md (#861)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 01071efc9c
Documentation for model sideloading (#851)
* Documentation for model sideloading

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

* Update gpt4all_chat.md

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Richard Guo f5f9f28f74 updated pypi version 1 year ago
Richard Guo 9d2b20f6cd small typo fix 1 year ago
Richard Guo e709e58603 more cleanup 1 year ago
Richard Guo 13fc50f2d3 cleanup 1 year ago
Richard Guo c54c42e3fb fixed finding model libs 1 year ago
Richard Guo ab56364da8 load libs correctly 1 year ago
Richard Guo 5490af5a2c model creation is failing... debugging 1 year ago
Richard Guo 9f203c211f load all model libs 1 year ago
Richard Guo ae42805d49 updated bindings code for updated C api 1 year ago
Andriy Mulyar cf07ca3951
Update gpt4all_chat.md (#800)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar fca2578a81
Documentation improvements on LocalDocs (#790)
* Update gpt4all_chat.md

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

* typo

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 05d156fb97
Fixed formatting of localdocs docs (#770) 1 year ago
Andriy Mulyar 6ed9c1a8d8
Improved localdocs documentation (#762)
* Improved localdocs documentation

* Improved localdocs documentation

* Improved localdocs documentation

* Improved localdocs documentation
1 year ago
Andriy Mulyar 02290fd881
LocalDocs documentation initial (#761)
* LocalDocs documentation initial
1 year ago
Richard Guo 73db20ba85 hotfix default verbose optioin 1 year ago
Konstantin Gukov a6f3e94458 one funcion to append .bin suffix 1 year ago
Konstantin Gukov 659244f0a2 Correct indentation of the multiline error message 1 year ago
Konstantin Gukov 5e61008424 Add optional verbosity 1 year ago
Konstantin Gukov e05ee9466a Correct return type 1 year ago
Konstantin Gukov dcbdd369ad Redundant else 1 year ago
Konstantin Gukov ace34afef2 1. Cleanup the interrupted download
2. with-syntax
1 year ago
Konstantin Gukov 8053dc014b less magic number 1 year ago
Konstantin Gukov e98cfd97b3 convert to f-strings 1 year ago
Konstantin Gukov 2b6fb7b95e reduce nesting, better error reporting 1 year ago
Konstantin Gukov a067f38544 Concise model matching 1 year ago
Konstantin Gukov c1f3dd310c Log where the model was found 1 year ago
Konstantin Gukov f96300534b Nicer handling of missing model directory.
Correct exception message.
1 year ago