Archives/gpt4free
2
0
Fork 0
mirror of https://github.com/xtekky/gpt4free.git synced 2024-11-05 00:01:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
4b41a8f4e8
gpt4free/g4f/Provider/HuggingChat.py

79 lines
3.0 KiB
Python
Raw Normal View History

type hints Use `from __future__ import annotations avoid `dict` and `list` cause "TypeErro: 'type' object is not subscriptable". Refer to the following Stack Overflow discussions for more information: 1. https://stackoverflow.com/questions/75202610/typeerror-type-object-is-not-subscriptable-python 2. https://stackoverflow.com/questions/59101121/type-hint-for-a-dict-gives-typeerror-type-object-is-not-subscriptable
2023-09-03 08:26:26 +00:00
from __future__ import annotations
Update HuggingChat to new api Impersonate Aivvm Provider Add ChatForAi and FreeGpt Provider Update AItianhuSpace Provider Improve StreamRequest Support Update get_event_loop Helper
2023-10-01 04:38:11 +00:00
import json, uuid
type hints Use `from __future__ import annotations avoid `dict` and `list` cause "TypeErro: 'type' object is not subscriptable". Refer to the following Stack Overflow discussions for more information: 1. https://stackoverflow.com/questions/75202610/typeerror-type-object-is-not-subscriptable-python 2. https://stackoverflow.com/questions/59101121/type-hint-for-a-dict-gives-typeerror-type-object-is-not-subscriptable
2023-09-03 08:26:26 +00:00
Add aiohttp_socks support
2024-01-23 22:48:11 +00:00
from aiohttp import ClientSession, BaseConnector
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
Improve CreateImagesBing Sort providers by category
2024-01-22 02:38:11 +00:00
from ..typing import AsyncResult, Messages
Add ProviderModelMixin for model selection
2024-01-23 18:44:48 +00:00
from .base_provider import AsyncGeneratorProvider, ProviderModelMixin
Add get_connector helper
2024-01-23 23:46:35 +00:00
from .helper import format_prompt, get_cookies, get_connector
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
Add ProviderModelMixin for model selection
2024-01-23 18:44:48 +00:00
class HuggingChat(AsyncGeneratorProvider, ProviderModelMixin):
Improve Vercel Provider: - Fix endless loop - Add proxy, async support - Add default model Fix HuggingChat Provider
2023-09-23 09:42:30 +00:00
url = "https://huggingface.co/chat"
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
working = True
Cleanup model list
2024-01-23 04:02:14 +00:00
default_model = "meta-llama/Llama-2-70b-chat-hf"
models = [
"mistralai/Mixtral-8x7B-Instruct-v0.1",
"meta-llama/Llama-2-70b-chat-hf",
"NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO",
"codellama/CodeLlama-34b-Instruct-hf",
"mistralai/Mistral-7B-Instruct-v0.2",
"openchat/openchat-3.5-0106"
]
Add ProviderModelMixin for model selection
2024-01-23 18:44:48 +00:00
model_aliases = {
Cleanup model list
2024-01-23 04:02:14 +00:00
"openchat/openchat_3.5": "openchat/openchat-3.5-1210",
"mistralai/Mixtral-8x7B-Instruct-v0.1": "mistralai/Mistral-7B-Instruct-v0.2"
}
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
@classmethod
async def create_async_generator(
cls,
model: str,
Add Proxy Support and Create Provider to Readme Add proxy support to many providers
2023-10-09 11:33:20 +00:00
messages: Messages,
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
stream: bool = True,
proxy: str = None,
Add aiohttp_socks support
2024-01-23 22:48:11 +00:00
connector: BaseConnector = None,
Add selenium to dockerfile Load model and provider list in gui Remove needs_auth in HuggingChat Add default model and login url in gui
2023-12-06 08:35:36 +00:00
web_search: bool = False,
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
cookies: dict = None,
**kwargs
Add Proxy Support and Create Provider to Readme Add proxy support to many providers
2023-10-09 11:33:20 +00:00
) -> AsyncResult:
Cache "snlm0e" in Bard Improve error handling in ChatgptLogin Fix async example in readme
2023-09-20 04:12:34 +00:00
if not cookies:
New minimum requirements (#1515) * New minimum requirements * Add ConversationStyleOptionSets to Bing * Add image.ImageRequest * Improve python version support * Improve unittests
2024-01-26 06:54:13 +00:00
cookies = get_cookies(".huggingface.co", False)
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
headers = {
'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/111.0.0.0 Safari/537.36',
}
async with ClientSession(
cookies=cookies,
Add aiohttp_socks support
2024-01-23 22:48:11 +00:00
headers=headers,
Add get_connector helper
2024-01-23 23:46:35 +00:00
connector=get_connector(connector, proxy)
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
) as session:
Add ProviderModelMixin for model selection
2024-01-23 18:44:48 +00:00
async with session.post(f"{cls.url}/conversation", json={"model": cls.get_model(model)}, proxy=proxy) as response:
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
conversation_id = (await response.json())["conversationId"]
send = {
Update HuggingChat to new api Impersonate Aivvm Provider Add ChatForAi and FreeGpt Provider Update AItianhuSpace Provider Improve StreamRequest Support Update get_event_loop Helper
2023-10-01 04:38:11 +00:00
"id": str(uuid.uuid4()),
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
"inputs": format_prompt(messages),
Update HuggingChat to new api Impersonate Aivvm Provider Add ChatForAi and FreeGpt Provider Update AItianhuSpace Provider Improve StreamRequest Support Update get_event_loop Helper
2023-10-01 04:38:11 +00:00
"is_retry": False,
"response_id": str(uuid.uuid4()),
Add selenium to dockerfile Load model and provider list in gui Remove needs_auth in HuggingChat Add default model and login url in gui
2023-12-06 08:35:36 +00:00
"web_search": web_search
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
}
Update HuggingChat to new api Impersonate Aivvm Provider Add ChatForAi and FreeGpt Provider Update AItianhuSpace Provider Improve StreamRequest Support Update get_event_loop Helper
2023-10-01 04:38:11 +00:00
async with session.post(f"{cls.url}/conversation/{conversation_id}", json=send, proxy=proxy) as response:
HuggingChat: Strip leading whitespace from the first token in the stream For some reason first token from the stream on HuggingChat always starts with a whitespace. This commit strips the leading whitespace from the first token in the stream to fix this issue.
2023-12-15 22:58:13 +00:00
first_token = True
Update HuggingChat to new api Impersonate Aivvm Provider Add ChatForAi and FreeGpt Provider Update AItianhuSpace Provider Improve StreamRequest Support Update get_event_loop Helper
2023-10-01 04:38:11 +00:00
async for line in response.content:
line = json.loads(line[:-1])
if "type" not in line:
raise RuntimeError(f"Response: {line}")
elif line["type"] == "stream":
HuggingChat: Strip leading whitespace from the first token in the stream For some reason first token from the stream on HuggingChat always starts with a whitespace. This commit strips the leading whitespace from the first token in the stream to fix this issue.
2023-12-15 22:58:13 +00:00
token = line["token"]
if first_token:
token = token.lstrip()
first_token = False
yield token
Update HuggingChat to new api Impersonate Aivvm Provider Add ChatForAi and FreeGpt Provider Update AItianhuSpace Provider Improve StreamRequest Support Update get_event_loop Helper
2023-10-01 04:38:11 +00:00
elif line["type"] == "finalAnswer":
break
Add async support for H2o Add format_prompt helper Fix create_completion in AsyncGeneratorProvider Move get_cookies from constructor to function Add ow HuggingChat implement Remove need auth form Liabots Add staic cache for access_token in OpenaiChat Add OpenAssistant provider Support stream and async in You Support async and add userId in Yqcloud Add log_time module
2023-08-27 23:43:45 +00:00
Cache "snlm0e" in Bard Improve error handling in ChatgptLogin Fix async example in readme
2023-09-20 04:12:34 +00:00
async with session.delete(f"{cls.url}/conversation/{conversation_id}", proxy=proxy) as response:
HuggingChat: Strip leading whitespace from the first token in the stream For some reason first token from the stream on HuggingChat always starts with a whitespace. This commit strips the leading whitespace from the first token in the stream to fix this issue.
2023-12-15 22:58:13 +00:00
response.raise_for_status()
Reference in New Issue Copy Permalink