Commit Graph

776 Commits

Author SHA1 Message Date
Adam Treat
a7f24eb46e Use the default for max_tokens to avoid errors. 2023-05-16 10:31:55 -04:00
Adam Treat
53c5d761a5 Add ability to remove models. 2023-05-16 10:31:55 -04:00
Adam Treat
8cdee4b0cb Send the prompt template with conversations to the datalake. 2023-05-16 10:31:55 -04:00
Adam Treat
04d405b47f Generate the new prompt/response pair before model loading in server mode. 2023-05-16 10:31:55 -04:00
Adam Treat
62ccd95f3d Add save/restore to chatgpt chats and allow serialize/deseralize from disk. 2023-05-16 10:31:55 -04:00
Adam Treat
97e1813494 Add large network icon background for chatgpt and server modes. 2023-05-16 10:31:55 -04:00
Adam Treat
fc6ab1f776 Preliminary support for chatgpt models. 2023-05-16 10:31:55 -04:00
Adam Treat
22dc2bc5d2 Use compact json format. 2023-05-16 10:31:55 -04:00
Aaron Miller
9aaa355d41 backend: dedupe tokenizing code in mpt/gptj 2023-05-16 10:30:19 -04:00
Aaron Miller
fc2869f0b7 backend: dedupe tokenizing code in gptj/mpt 2023-05-16 10:30:19 -04:00
Aaron Miller
16b7bf01a8 backend: make initial buf_size const in model impls
more unifying mpt and gptj code - this one's never written so also
changing the name to be clearer
2023-05-16 10:30:19 -04:00
Aaron Miller
0c9b7a6ae8 mpt: use buf in model struct (thread safety) 2023-05-16 10:30:19 -04:00
AT
75c212ec0d Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-15 19:00:11 -04:00
Andriy Mulyar
ae54ae9c76 Golang Bindings in README (#586)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-15 12:59:32 -04:00
Ettore Di Giacinto
d3c9c47bd2 Golang bindings initial working version(#534)
* WIP

* Fix includes

* Try to fix linking issues

* Refinements

* allow to load MPT and llama models too

* cleanup, add example, add README
2023-05-15 12:45:56 -04:00
Richard Guo
ccce9f02cc label tag warning and moved PR template out of subdir (#584)
Co-authored-by: Richard Guo <richardguo@Richards-MacBook-Pro.local>
2023-05-15 10:15:17 -04:00
Andriy Mulyar
34a26ad0c5 Update path for build and run demo (#578)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 17:26:28 -04:00
AT
6318fb7d34 Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 15:48:17 -04:00
AT
aa5b507dd2 Create README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 15:43:18 -04:00
AT
48ca4a047c Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 15:26:00 -04:00
Andriy Mulyar
cc2df0fbcf Rename README to README.md (#575)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 14:12:38 -04:00
Andriy Mulyar
8c56d26488 Typescript Bindings README (#574)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 13:59:03 -04:00
Andriy Mulyar
c53a0f51e4 Updated Bindings Links (#573)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 13:57:00 -04:00
AT
072bdea0ce Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 07:59:50 -04:00
AT
66a5234d17 Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 07:41:45 -04:00
Adam Treat
b9c063053a The server has different lifetime mgmt than the other chats. 2023-05-13 19:34:54 -04:00
Adam Treat
4448600e60 Much better memory mgmt for multi-threaded model loading/unloading. 2023-05-13 19:10:56 -04:00
Adam Treat
e67b021948 httpserver 2023-05-13 19:07:06 -04:00
Richard Guo
5071b07977 Update README.md (#561)
Signed-off-by: Richard Guo <richardg7890@gmail.com>
2023-05-13 14:43:46 -04:00
Andriy Mulyar
44ed64e564 Modal labs python docs (#558)
* Added modal labs example to documentation

* Modal snippet update docs

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-13 13:52:37 -04:00
Andriy Mulyar
438529c222 Added modal labs example to documentation (#556) 2023-05-13 11:10:18 -04:00
AT
9be43f4dc9 Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-13 08:30:11 -04:00
Adam Treat
e781aaa4c5 Cleanup the chatllm properly. 2023-05-12 17:11:52 -04:00
Richard Guo
adabc20a00 fixed bug in readme 2023-05-12 15:21:56 -04:00
Richard Guo
7534df410e comment out pypi job 2023-05-12 15:21:56 -04:00
Richard Guo
9add5fa364 mpt pypi job 2023-05-12 15:21:56 -04:00
Richard Guo
ca7cc57440 gpt4all mpt bindings 2023-05-12 15:21:56 -04:00
Richard Guo
35e8b3984f mpt bindings 2023-05-12 15:21:56 -04:00
Andriy Mulyar
77fc90dd4c Merge pull request #547 from nomic-ai/clear-cloudfront-cache
CircleCI Step to Clear Cloudfront Cache
2023-05-12 12:27:48 -04:00
Richard Guo
f7e10957b5 clear cache 2023-05-12 11:18:55 -04:00
Richard Guo
658466b6a9 working circleci and updated readme 2023-05-12 10:47:46 -04:00
Richard Guo
32f031a643 include own branch for now 2023-05-12 10:47:46 -04:00
Richard Guo
6b44e1283a working circleci and updated readme 2023-05-12 10:47:46 -04:00
Richard Guo
cc1d3c6a09 include own branch for now 2023-05-12 10:47:46 -04:00
Richard Guo
083032cc12 working circleci and updated readme 2023-05-12 10:47:46 -04:00
Richard Guo
760290ede5 change path 2023-05-12 10:47:46 -04:00
Richard Guo
e7183ed142 python handler mkdocstrings 2023-05-12 10:47:46 -04:00
Richard Guo
854bce1f29 include own branch for now 2023-05-12 10:47:46 -04:00
Richard Guo
0e5189c934 docs build 2023-05-12 10:47:46 -04:00
Richard Guo
3667da931f forgot obvious things 2023-05-12 10:21:13 -04:00