mirror of https://github.com/sigoden/aichat
feat: add `extra_fields` to models of localai/ollama clients (#298)
* Add an "extra_fields" config to localai models Because there are so many local AIs out there with a bunch of custom parameters you can set, this allows users to send in extra parameters to a local LLM runner, such as, e.g. `instruction_template: Alpaca`, so that Mixtral can take a system prompt. * support ollama --------- Co-authored-by: sigoden <sigoden@gmail.com>pull/303/head
parent
a30c3cc4c1
commit
176ff6f83e
Loading…
Reference in New Issue