groq[patch]: update model used for llama tests (#25542)

`llama-3.1-8b-instant` often fails some of the tool calling standard
tests. Here we update to `llama-3.1-70b-versatile`.
This commit is contained in:
ccurme 2024-08-19 09:58:06 -04:00 committed by GitHub
parent 75c3c81b8c
commit 5a3aaae6dc
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -28,7 +28,7 @@ class TestGroqLlama(BaseTestGroq):
@property
def chat_model_params(self) -> dict:
return {
"model": "llama-3.1-8b-instant",
"model": "llama-3.1-70b-versatile",
"temperature": 0,
"rate_limiter": rate_limiter,
}