Laurel Orr
49f51952df
fix: dummy client to output tokens and random responses ( #106 )
1 year ago
Laurel Orr
6324e0fe43
feat: streaming support completions ( #99 )
1 year ago
Laurel Orr
fd6e3d965b
Laurel/chatgpt hotfix ( #96 )
...
* fix: chatgpt hotfix
* chore: fix retry test
1 year ago
Laurel Orr
147436c9b2
feat: unify run_chat and run ( #92 )
1 year ago
Laurel Orr
8548329be9
feat: added run_chat for chat models ( #88 )
1 year ago
Laurel Orr
afe0fc5a1d
feat: added run_chat for chat models ( #87 )
1 year ago
Laurel Orr
d7401c6ec5
fix: added pydantic types to response ( #84 )
1 year ago
Laurel Orr
db963cf4a7
fix: added client pool support ( #81 )
...
* fix: added client pool support
* Added async across client pool
1 year ago
Laurel Orr
0fb192a0a2
feat: add local huggingface embedding models ( #76 )
2 years ago
Laurel Orr
40de0e7f59
feat: openai embedding support ( #75 )
2 years ago
Laurel Orr
c7906bead5
fix: add retry to client for ratelimit ( #73 )
2 years ago
Laurel Orr
e4d3a57f92
fix: added openai usage back ( #69 )
2 years ago
Laurel Orr
395ac06a95
feat: async support, openai chatgpt, batch cache fix ( #68 )
2 years ago
Sabri Eyuboglu
e00d285e21
Add PostgreSQL cache ( #53 )
...
Add a Cache for PostgreSQL with GCP.
Co-authored-by: Laurel Orr <lorr1@cs.stanford.edu>
2 years ago
Laurel Orr
c4ad007f02
feat: support token_logprobs ( #59 )
2 years ago
Laurel Orr
8ced666df8
fix: add dtype to cache ( #52 )
2 years ago
Laurel Orr
94b57a6e6f
feat: remove choice logits and use prompt scoring ( #50 )
2 years ago
Laurel Orr
defc63bf36
feat: web app for manifest ( #46 )
...
Also fixed typing issues in tests
2 years ago
Laurel Orr
6f5b64f0df
Laurel/diffusion ( #40 )
...
* Sketch of diffusers added
* [WIP] Array caching implemented with end2end diffusion working
* [WIP] Make initial pass on CLIP model
* [WIP] Get endpoint running for CLIP
* Add support for clip images
* [chore] merge main
* chore: fix xxhash install
Co-authored-by: Sabri Eyuboglu <eyuboglu@stanford.edu>
2 years ago
Laurel Orr
e86b8e81bf
[feat] batch run; remove prompt batch_run zoo and opt; refactor to us… ( #39 )
...
* [feat] batch run; remove prompt batch_run zoo and opt; refactor to use standard request inputs
* [chore] test rounding fix
2 years ago
Laurel Orr
a4cd201b8e
Deepspeed ( #38 )
...
* [feat] deepspeed and batch support huggingface api
* [chore] add deepspeed to readme
* [chore] fix hf api test
2 years ago
Laurel
073f8117c8
[chore] add runid test
2 years ago
Laurel Orr
a846b72be0
Session id None
2 years ago
Laurel Orr
55e0be83e2
Add max logits with T0 only ( #22 )
2 years ago
Laurel Orr
d610e3c800
Laurel/dev ( #20 )
...
* fix: added perc gpu memory reduction flag app
* fix: removed poetry and standardized api inputs
* Removed poetry and use setup.py
* Addressing https://github.com/HazyResearch/manifest/issues/16
2 years ago
Laurel Orr
99bcc76fde
Laurel/multigpuhf ( #15 )
...
* feat: added user session logging
* fix: removed raw queries in tests
* build: move torch to dev dependency
* fix: adding accelerate to api
Addresses https://github.com/HazyResearch/manifest/issues/14
* build: fix torch github
2 years ago
Laurel Orr
d29d10de28
feat: added user session logging ( #13 )
...
* feat: added user session logging
* fix: removed raw queries in tests
* build: move torch to dev dependency
2 years ago
Laurel Orr
c04aa1e62c
fix: ai21 prompt added with logprobs
2 years ago
Laurel Orr
f568875e57
fix: fixing https://github.com/HazyResearch/manifest/issues/7 and https://github.com/HazyResearch/manifest/issues/5
2 years ago
Laurel Orr
894042c370
[feature] added opt; better kwargs for errors
2 years ago
Laurel Orr
bf16963f3d
[feature] redis DB, flask API, tests
2 years ago
ANarayan
15e712b060
remove circular imports in client, manifest; add prompt serialization and dill dep
2 years ago
Laurel Orr
ed301be2a7
First main commit
2 years ago