mirror of
https://github.com/hwchase17/langchain
synced 2024-10-29 17:07:25 +00:00
539672a7fd
This pull request aims to ensure that the `OpenAICallbackHandler` can properly calculate the total cost for Azure OpenAI chat models. The following changes have resolved this issue: - The `model_name` has been added to the ChatResult llm_output. Without this, the default values of `gpt-35-turbo` were applied. This was causing the total cost for Azure OpenAI's GPT-4 to be significantly inaccurate. - A new parameter `model_version` has been added to `AzureChatOpenAI`. Azure does not include the model version in the response. With the addition of `model_name`, this is not a significant issue for GPT-4 models, but it's an issue for GPT-3.5-Turbo. Version 0301 (default) of GPT-3.5-Turbo on Azure has a flat rate of 0.002 per 1k tokens for both prompt and completion. However, version 0613 introduced a split in pricing for prompt and completion tokens. - The `OpenAICallbackHandler` implementation has been updated with the proper model names, versions, and cost per 1k tokens. Unit tests have been added to ensure the functionality works as expected; the Azure ChatOpenAI notebook has been updated with examples. Maintainers: @hwchase17, @baskaryan Twitter handle: @jjczopek --------- Co-authored-by: Jerzy Czopek <jerzy.czopek@avanade.com> Co-authored-by: Bagatur <baskaryan@gmail.com> |
||
|---|---|---|
| .. | ||
| anthropic_functions.ipynb | ||
| anthropic.ipynb | ||
| anyscale.ipynb | ||
| azure_chat_openai.ipynb | ||
| azureml_chat_endpoint.ipynb | ||
| google_vertex_ai_palm.ipynb | ||
| index.mdx | ||
| jinachat.ipynb | ||
| llama_api.ipynb | ||
| openai.ipynb | ||
| promptlayer_chatopenai.ipynb | ||