Archives/fabric
2
0
Fork 0
mirror of https://github.com/danielmiessler/fabric synced 2024-11-08 07:11:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md for #324

Browse Source 
Closes #324 , showing how to connect to another server
This commit is contained in:
Alexandre Strube 2024-04-05 12:34:49 +02:00 committed by GitHub
parent 24f44b41f2
commit 17fce1bea5
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 9 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
README.md
View File

@ -203,6 +203,15 @@ fabric --help
### Using the `fabric` client
If you want to use it with OpenAI API compatible inference servers, such as [FastChat](https://github.com/lm-sys/FastChat) or [Helmholtz Blablador](http://helmholtz-blablador.fz-juelich.de), simply export the following environment variables:
- `export OPENAI_BASE_URL=https://YOUR-SERVER:8000/v1/`
- `export DEFAULT_MODEL="YOUR_MODEL"`
And if your server needs authentication tokens, like Blablador does, you export the token the same way you would with OpenAI:
- `export OPENAI_API_KEY="YOUR TOKEN"`
Once you have it all set up, here's how to use it.
1. Check out the options