Commit Graph

33 Commits (main)

Author SHA1 Message Date
Laurel Orr 49f51952df
fix: dummy client to output tokens and random responses (#106) 11 months ago
Laurel Orr 6324e0fe43
feat: streaming support completions (#99) 1 year ago
Laurel Orr fd6e3d965b
Laurel/chatgpt hotfix (#96)
* fix: chatgpt hotfix

* chore: fix retry test
1 year ago
Laurel Orr 147436c9b2
feat: unify run_chat and run (#92) 1 year ago
Laurel Orr 8548329be9
feat: added run_chat for chat models (#88) 1 year ago
Laurel Orr afe0fc5a1d
feat: added run_chat for chat models (#87) 1 year ago
Laurel Orr d7401c6ec5
fix: added pydantic types to response (#84) 1 year ago
Laurel Orr db963cf4a7 fix: added client pool support (#81)
* fix: added client pool support

* Added async across client pool
1 year ago
Laurel Orr 0fb192a0a2 feat: add local huggingface embedding models (#76) 1 year ago
Laurel Orr 40de0e7f59 feat: openai embedding support (#75) 1 year ago
Laurel Orr c7906bead5 fix: add retry to client for ratelimit (#73) 1 year ago
Laurel Orr e4d3a57f92 fix: added openai usage back (#69) 1 year ago
Laurel Orr 395ac06a95 feat: async support, openai chatgpt, batch cache fix (#68) 1 year ago
Sabri Eyuboglu e00d285e21 Add PostgreSQL cache (#53)
Add a Cache for PostgreSQL with GCP. 

Co-authored-by: Laurel Orr <lorr1@cs.stanford.edu>
1 year ago
Laurel Orr c4ad007f02 feat: support token_logprobs (#59) 1 year ago
Laurel Orr 8ced666df8 fix: add dtype to cache (#52) 1 year ago
Laurel Orr 94b57a6e6f feat: remove choice logits and use prompt scoring (#50) 1 year ago
Laurel Orr defc63bf36 feat: web app for manifest (#46)
Also fixed typing issues in tests
1 year ago
Laurel Orr 6f5b64f0df Laurel/diffusion (#40)
* Sketch of diffusers added

* [WIP] Array caching implemented with end2end diffusion working

* [WIP] Make initial pass on CLIP model

* [WIP] Get endpoint running for CLIP

* Add support for clip images

* [chore] merge main

* chore: fix xxhash install

Co-authored-by: Sabri Eyuboglu <eyuboglu@stanford.edu>
1 year ago
Laurel Orr e86b8e81bf [feat] batch run; remove prompt batch_run zoo and opt; refactor to us… (#39)
* [feat] batch run; remove prompt batch_run zoo and opt; refactor to use standard request inputs

* [chore] test rounding fix
2 years ago
Laurel Orr a4cd201b8e Deepspeed (#38)
* [feat] deepspeed and batch support huggingface api

* [chore] add deepspeed to readme

* [chore] fix hf api test
2 years ago
Laurel 073f8117c8 [chore] add runid test 2 years ago
Laurel Orr a846b72be0 Session id None 2 years ago
Laurel Orr 55e0be83e2 Add max logits with T0 only (#22) 2 years ago
Laurel Orr d610e3c800 Laurel/dev (#20)
* fix: added perc gpu memory reduction flag app

* fix: removed poetry and standardized api inputs

* Removed poetry and use setup.py
* Addressing https://github.com/HazyResearch/manifest/issues/16
2 years ago
Laurel Orr 99bcc76fde Laurel/multigpuhf (#15)
* feat: added user session logging

* fix: removed raw queries in tests

* build: move torch to dev dependency

* fix: adding accelerate to api

Addresses https://github.com/HazyResearch/manifest/issues/14

* build: fix torch github
2 years ago
Laurel Orr d29d10de28 feat: added user session logging (#13)
* feat: added user session logging

* fix: removed raw queries in tests

* build: move torch to dev dependency
2 years ago
Laurel Orr c04aa1e62c fix: ai21 prompt added with logprobs 2 years ago
Laurel Orr f568875e57 fix: fixing https://github.com/HazyResearch/manifest/issues/7 and https://github.com/HazyResearch/manifest/issues/5 2 years ago
Laurel Orr 894042c370 [feature] added opt; better kwargs for errors 2 years ago
Laurel Orr bf16963f3d [feature] redis DB, flask API, tests 2 years ago
ANarayan 15e712b060 remove circular imports in client, manifest; add prompt serialization and dill dep 2 years ago
Laurel Orr ed301be2a7 First main commit 2 years ago