Commit Graph

120 Commits (c0eae1c55c0d48ed1c6f9f6cb2d8990deb163b37)

Author SHA1 Message Date
Kelvie Wong 176ff6f83e
feat: add `extra_fields` to models of localai/ollama clients (#298)
* Add an "extra_fields" config to localai models

Because there are so many local AIs out there with a bunch of custom
parameters you can set, this allows users to send in extra parameters to
a local LLM runner, such as, e.g. `instruction_template: Alpaca`, so
that Mixtral can take a system prompt.

* support ollama

---------

Co-authored-by: sigoden <sigoden@gmail.com>
9 months ago
sigoden a30c3cc4c1
feat: add openai.api_base config (#302) 9 months ago
sigoden fe35cfd941
feat: supports model capabilities (#297)
1. automatically switch to the model that has the necessary capabilities.
2. throw an error if the client does not have a model with the necessary capabilities
9 months ago
sigoden 0e5c8567d4
refactor: ollam api_base configuration (#285) 10 months ago
sigoden 1c9ca1b002
feat: custom REPL prompt (#283) 10 months ago
sigoden 64c4edf7c8
feat: support ollama (#276) 10 months ago
sigoden 6fb13359f4
feat: abandon PaLM2 (#274) 10 months ago
sigoden 6286251d32
feat: support gemini (#273) 10 months ago
sigoden 6bb2ec05be
feat: add `config.prelude` to allow setting default role/session (#224) 12 months ago
sigoden 7627771e2d
feat: support Qianwen (#211) 12 months ago
sigoden ec1f99fbf5
feat: support Ernie (#210) 12 months ago
sigoden bba5028615
feat: support PaLM (#209) 12 months ago
sigoden 4380b4f20b
refactor: rename azure to azure_openai, improve register_client! (#208) 12 months ago
sigoden b34e40e25f
refactor: rename azure-openai to azure (#204) 12 months ago
sigoden 7f2210dbca
refactor: clients/* and config.rs (#193)
- add register_clients macro to make it easier to add a new client
- no create_client_config, just add const PROMPTS
- move ModelInfo from clients/ to config/
- model's max_tokens are optional
- improve code quanity on config/mod.rs
- add/use macro config_get_fn
12 months ago
sigoden 64202758ec
chore: move split_line_* from repl/cmd.rs to utils/ (#190) 12 months ago
sigoden bd3fc8e657 chore: refactor config description 12 months ago
sigoden a137483b03
feat: improve client (#189) 12 months ago
sigoden 36380475d5
feat: support azure-openai (#166) 12 months ago
sigoden eb023e5759 chore: rename config.yaml to config.example.yaml 12 months ago