Yuval
b775d15f2e
fix: Updated AI21 models from J1 to J2 ( #104 )
...
also, added ai21 example to README
Co-authored-by: Yuval Belfer <yuvalb@ai21.com>
12 months ago
Laurel Orr
6324e0fe43
feat: streaming support completions ( #99 )
1 year ago
Laurel Orr
147436c9b2
feat: unify run_chat and run ( #92 )
1 year ago
Laurel Orr
8548329be9
feat: added run_chat for chat models ( #88 )
1 year ago
Laurel Orr
afe0fc5a1d
feat: added run_chat for chat models ( #87 )
1 year ago
Laurel Orr
d7401c6ec5
fix: added pydantic types to response ( #84 )
1 year ago
Laurel Orr
4602fb919b
chore: update readme ( #82 )
1 year ago
Laurel Orr
db963cf4a7
fix: added client pool support ( #81 )
...
* fix: added client pool support
* Added async across client pool
1 year ago
Laurel Orr
40de0e7f59
feat: openai embedding support ( #75 )
1 year ago
Laurel Orr
395ac06a95
feat: async support, openai chatgpt, batch cache fix ( #68 )
1 year ago
Laurel Orr
ace3ad4324
chore: fix manifest imports ( #56 )
1 year ago
Laurel Orr
e351bd5315
Update README.md citation
1 year ago
Laurel Orr
56eae406ce
feat: chatgpt client added ( #47 )
1 year ago
Laurel Orr
6f5b64f0df
Laurel/diffusion ( #40 )
...
* Sketch of diffusers added
* [WIP] Array caching implemented with end2end diffusion working
* [WIP] Make initial pass on CLIP model
* [WIP] Get endpoint running for CLIP
* Add support for clip images
* [chore] merge main
* chore: fix xxhash install
Co-authored-by: Sabri Eyuboglu <eyuboglu@stanford.edu>
1 year ago
Laurel Orr
e86b8e81bf
[feat] batch run; remove prompt batch_run zoo and opt; refactor to us… ( #39 )
...
* [feat] batch run; remove prompt batch_run zoo and opt; refactor to use standard request inputs
* [chore] test rounding fix
2 years ago
Laurel Orr
a4cd201b8e
Deepspeed ( #38 )
...
* [feat] deepspeed and batch support huggingface api
* [chore] add deepspeed to readme
* [chore] fix hf api test
2 years ago
Laurel
8b423d6962
v0.0.1 release
2 years ago
Laurel
37a232ef7d
[chore] fix readme install
2 years ago
Laurel Orr
c5f00b9f73
Request cache refactor ( #37 )
...
* [wip] cache import clean up and removed api imports
* [chore] add timeout to requests
* [chore] toma heartbeats to logger
2 years ago
yichern
e42f335b14
Fix typo in README (run_batch returns list) ( #27 )
...
In `result_object = manifest.run_batch(prompt, ["Laurel", "Avanika"], return_response=True)`, the return type of `run_batch` is a list of response objects, not a response object. This PR fixes a bug in the demo code to print only after looping through the response objects.
Co-authored-by: Laurel Orr <57237365+lorr1@users.noreply.github.com>
2 years ago
yichern
c351d7fa5e
Fix typo in README (batch_run -> run_batch) ( #26 )
...
As in title!
2 years ago
Ben Newman
9f313c6f12
Fix typo in README ("Boom" -> "Bloom") ( #24 )
2 years ago
Laurel Orr
a68ee63c18
[docs] update readme.md
2 years ago
Laurel Orr
a846b72be0
Session id None
2 years ago
Laurel Orr
d610e3c800
Laurel/dev ( #20 )
...
* fix: added perc gpu memory reduction flag app
* fix: removed poetry and standardized api inputs
* Removed poetry and use setup.py
* Addressing https://github.com/HazyResearch/manifest/issues/16
2 years ago
Laurel Orr
99bcc76fde
Laurel/multigpuhf ( #15 )
...
* feat: added user session logging
* fix: removed raw queries in tests
* build: move torch to dev dependency
* fix: adding accelerate to api
Addresses https://github.com/HazyResearch/manifest/issues/14
* build: fix torch github
2 years ago
Laurel Orr
d29d10de28
feat: added user session logging ( #13 )
...
* feat: added user session logging
* fix: removed raw queries in tests
* build: move torch to dev dependency
2 years ago
Laurel Orr
c04aa1e62c
fix: ai21 prompt added with logprobs
2 years ago
Laurel Orr
b34e2a714b
Fix readme and separate dev
2 years ago
Laurel Orr
a82c8c89df
[feature] better naming models in cache
2 years ago
Laurel Orr
894042c370
[feature] added opt; better kwargs for errors
2 years ago
Laurel Orr
bf16963f3d
[feature] redis DB, flask API, tests
2 years ago
ANarayan
15e712b060
remove circular imports in client, manifest; add prompt serialization and dill dep
2 years ago
Laurel Orr
ed301be2a7
First main commit
2 years ago
Laurel Orr
6ada1f2d2c
Initial commit
2 years ago