Commit Graph

88 Commits (985d3bbfa4b496e48ea21d5a22e8c8ff68278573)

Author SHA1 Message Date
Aaron Miller b19a3e5b2c add requiredMem method to llmodel impls
most of these can just shortcut out of the model loading logic llama is a bit worse to deal with because we submodule it so I have to at least parse the hparams, and then I just use the size on disk as an estimate for the mem size (which seems reasonable since we mmap() the llama files anyway)
1 year ago
cosmic-snow ee26e8f271
CLI Improvements (#1021)
* Add gpt4all-bindings/cli/README.md

* Unify version information
- Was previously split; base one on the other
- Add VERSION_INFO as the "source of truth":
  - Modelled after sys.version_info.
  - Implemented as a tuple, because it's much easier for (partial)
    programmatic comparison.
- Previous API is kept intact.

* Add gpt4all-bindings/cli/developer_notes.md
- A few notes on what's what, especially regarding docs

* Add gpt4all-bindings/python/docs/gpt4all_cli.md
- The CLI user documentation

* Bump CLI version to 0.3.5

* Finalise docs & add to index.md
- Amend where necessary
- Fix typo in gpt4all_cli.md
- Mention and add link to CLI doc in index.md

* Add docstings to gpt4all-bindings/cli/app.py

* Better 'groovy' link & fix typo
- Documentation: point to the Hugging Face model card for 'groovy'
- Correct typo in app.py
1 year ago
EKal-aa aed7b43143
set n_threads in GPT4All python bindings (#1042)
* set n_threads in GPT4All

* changed default n_threads to None
1 year ago
Martin Mauch af28173a25
Parse Org Mode files (#1038) 1 year ago
Richard Guo a39a897e34 0.3.5 bump 1 year ago
Richard Guo 25ce8c6a1e revert version 1 year ago
Richard Guo 282a3b5498 setup.py update 1 year ago
cosmic-snow b00ac632e3
Update python/README.md with troubleshooting info (#1012)
- Add some notes about common Windows problems when trying to make a local build (MinGW and MSVC).

Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>
1 year ago
standby24x7 cdea838671
Fix spelling typo in gpt4all.py (#1007)
Signed-off-by: Masanari Iida <standby24x7@gmail.com>
1 year ago
Richard Guo a9b33c3d10 update setup.py 1 year ago
Richard Guo a99cc34efb fix prompt context so it's preserved in class 1 year ago
Richard Guo 5a0b348219 second hold for pypi deploy 1 year ago
Richard Guo 014205a916 dummy python change 1 year ago
Richard Guo e9449190cd version bump 1 year ago
Aaron Miller d3ba1295a7
Metal+LLama take two (#929)
Support latest llama with Metal
---------

Co-authored-by: Adam Treat <adam@nomic.ai>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
1 year ago
Richard Guo e0a8480c0e
Generator in Python Bindings - streaming yields tokens at a time (#895)
* generator method

* cleanup

* bump version number for clarity

* added replace in decode to avoid unicodedecode exception

* revert back to _build_prompt
1 year ago
Claudius Ellsel 3c1b59f5c6
Move usage in Python bindings readme to own section (#907)
Have own section for short usage example, as it is not specific to local build

Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
1 year ago
Claudius Ellsel 39a7c35d03
Update README.md (#906)
Add PyPI link and add clickable, more specific link to documentation

Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
1 year ago
Richard Guo c4706d0c14
Replit Model (#713)
* porting over replit code model to gpt4all

* replaced memory with kv_self struct

* continuing debug

* welp it built but lot of sus things

* working model loading and somewhat working generate.. need to format response?

* revert back to semi working version

* finally got rid of weird formatting

* figured out problem is with python bindings - this is good to go for testing

* addressing PR feedback

* output refactor

* fixed prompt reponse collection

* cleanup

* addressing PR comments

* building replit backend with new ggmlver code

* chatllm replit and clean python files

* cleanup

* updated replit to match new llmodel api

* match llmodel api and change size_t to Token

* resolve PR comments

* replit model commit comment
1 year ago
Andriy Mulyar ef35eb496f Supports downloading officially supported models not hosted on gpt4all R2 1 year ago
Andriy Mulyar 266f13aee9
Update gpt4all_faq.md (#861)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 01071efc9c
Documentation for model sideloading (#851)
* Documentation for model sideloading

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

* Update gpt4all_chat.md

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Richard Guo f5f9f28f74 updated pypi version 1 year ago
Richard Guo 9d2b20f6cd small typo fix 1 year ago
Richard Guo e709e58603 more cleanup 1 year ago
Richard Guo 13fc50f2d3 cleanup 1 year ago
Richard Guo c54c42e3fb fixed finding model libs 1 year ago
Richard Guo ab56364da8 load libs correctly 1 year ago
Richard Guo 5490af5a2c model creation is failing... debugging 1 year ago
Richard Guo 9f203c211f load all model libs 1 year ago
Richard Guo ae42805d49 updated bindings code for updated C api 1 year ago
Andriy Mulyar cf07ca3951
Update gpt4all_chat.md (#800)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar fca2578a81
Documentation improvements on LocalDocs (#790)
* Update gpt4all_chat.md

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

* typo

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
1 year ago
Andriy Mulyar 05d156fb97
Fixed formatting of localdocs docs (#770) 1 year ago
Andriy Mulyar 6ed9c1a8d8
Improved localdocs documentation (#762)
* Improved localdocs documentation

* Improved localdocs documentation

* Improved localdocs documentation

* Improved localdocs documentation
1 year ago
Andriy Mulyar 02290fd881
LocalDocs documentation initial (#761)
* LocalDocs documentation initial
1 year ago
Richard Guo 73db20ba85 hotfix default verbose optioin 1 year ago
Konstantin Gukov a6f3e94458 one funcion to append .bin suffix 1 year ago
Konstantin Gukov 659244f0a2 Correct indentation of the multiline error message 1 year ago
Konstantin Gukov 5e61008424 Add optional verbosity 1 year ago
Konstantin Gukov e05ee9466a Correct return type 1 year ago
Konstantin Gukov dcbdd369ad Redundant else 1 year ago
Konstantin Gukov ace34afef2 1. Cleanup the interrupted download
2. with-syntax
1 year ago
Konstantin Gukov 8053dc014b less magic number 1 year ago
Konstantin Gukov e98cfd97b3 convert to f-strings 1 year ago
Konstantin Gukov 2b6fb7b95e reduce nesting, better error reporting 1 year ago
Konstantin Gukov a067f38544 Concise model matching 1 year ago
Konstantin Gukov c1f3dd310c Log where the model was found 1 year ago
Konstantin Gukov f96300534b Nicer handling of missing model directory.
Correct exception message.
1 year ago
Konstantin Gukov 59d7db9aad More precise condition 1 year ago