Laurel Orr
49f51952df
fix: dummy client to output tokens and random responses ( #106 )
12 months ago
Laurel Orr
6324e0fe43
feat: streaming support completions ( #99 )
1 year ago
Laurel Orr
afe0fc5a1d
feat: added run_chat for chat models ( #87 )
1 year ago
Laurel Orr
e559c8fa59
fix: logprobs from openai ( #85 )
1 year ago
Laurel Orr
d7401c6ec5
fix: added pydantic types to response ( #84 )
1 year ago
Laurel Orr
db963cf4a7
fix: added client pool support ( #81 )
...
* fix: added client pool support
* Added async across client pool
1 year ago
Laurel Orr
0fb192a0a2
feat: add local huggingface embedding models ( #76 )
1 year ago
Laurel Orr
40de0e7f59
feat: openai embedding support ( #75 )
1 year ago
Laurel Orr
e4d3a57f92
fix: added openai usage back ( #69 )
1 year ago
Laurel Orr
395ac06a95
feat: async support, openai chatgpt, batch cache fix ( #68 )
1 year ago
Laurel Orr
c4ad007f02
feat: support token_logprobs ( #59 )
1 year ago
Laurel Orr
6f5b64f0df
Laurel/diffusion ( #40 )
...
* Sketch of diffusers added
* [WIP] Array caching implemented with end2end diffusion working
* [WIP] Make initial pass on CLIP model
* [WIP] Get endpoint running for CLIP
* Add support for clip images
* [chore] merge main
* chore: fix xxhash install
Co-authored-by: Sabri Eyuboglu <eyuboglu@stanford.edu>
2 years ago
Laurel Orr
e86b8e81bf
[feat] batch run; remove prompt batch_run zoo and opt; refactor to us… ( #39 )
...
* [feat] batch run; remove prompt batch_run zoo and opt; refactor to use standard request inputs
* [chore] test rounding fix
2 years ago
Laurel Orr
c5f00b9f73
Request cache refactor ( #37 )
...
* [wip] cache import clean up and removed api imports
* [chore] add timeout to requests
* [chore] toma heartbeats to logger
2 years ago
yichern
52f489fe99
add cohere client ( #31 )
...
Co-authored-by: yichern <32623504+tanyichern@users.noreply.github.com>
2 years ago
Laurel Orr
55e0be83e2
Add max logits with T0 only ( #22 )
2 years ago
Laurel Orr
532481390e
fix: response log probs and max memory ( #19 )
2 years ago
Laurel Orr
d29d10de28
feat: added user session logging ( #13 )
...
* feat: added user session logging
* fix: removed raw queries in tests
* build: move torch to dev dependency
2 years ago
Laurel Orr
c04aa1e62c
fix: ai21 prompt added with logprobs
2 years ago
Laurel Orr
f568875e57
fix: fixing https://github.com/HazyResearch/manifest/issues/7 and https://github.com/HazyResearch/manifest/issues/5
2 years ago
Laurel Orr
bf16963f3d
[feature] redis DB, flask API, tests
2 years ago