mirror of https://github.com/hwchase17/langchain
add openai logit bias (#553)
Add [`logit_bias`](https://beta.openai.com/docs/api-reference/completions/create#completions/create-logit_bias) params to OpenAI See [here](https://beta.openai.com/tokenizer) for the tokenizer. NB: I see that others (like Cohere) have the same parameter, but since I don't have an access to it, I don't want to make a mistake. --- Just to make sure the default "{}" works for openai: ``` from langchain.llms import OpenAI OPENAI_API_KEY="XXX" llm = OpenAI(openai_api_key=OPENAI_API_KEY) llm.generate('Write "test":') llm = OpenAI(openai_api_key=OPENAI_API_KEY, logit_bias={'9288': -100, '1332': -100, '14402': -100, '6208': -100}) llm.generate('Write "test":') ```pull/556/head^2
parent
9833fcfe32
commit
42d5d988fa
Loading…
Reference in New Issue