Latest version of HazyResearch/manifest doesn't support accessing "client" directly (#10389)

**Description:** 
The latest version of HazyResearch/manifest doesn't support accessing
the "client" directly. The latest version supports connection pools and
a client has to be requested from the client pool.
**Issue:**
No matching issue was found
**Dependencies:** 
The manifest.ipynb file in docs/extras/integrations/llms need to be
updated
**Twitter handle:** 
@hrk_cbe
pull/10465/head
Rajesh Kumar 1 year ago committed by GitHub
parent 31739577c2
commit 737b75d278
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -57,7 +57,7 @@
"manifest = Manifest(\n",
" client_name=\"huggingface\", client_connection=\"http://127.0.0.1:5000\"\n",
")\n",
"print(manifest.client.get_model_params())"
"print(manifest.client_pool.get_current_client().get_model_params())"
]
},
{

@ -34,7 +34,10 @@ class ManifestWrapper(LLM):
@property
def _identifying_params(self) -> Mapping[str, Any]:
kwargs = self.llm_kwargs or {}
return {**self.client.client.get_model_params(), **kwargs}
return {
**self.client.client_pool.get_current_client().get_model_params(),
**kwargs,
}
@property
def _llm_type(self) -> str:

Loading…
Cancel
Save