Archives/petals
2
0
Fork 0
mirror of https://github.com/bigscience-workshop/petals synced 2024-11-16 06:12:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

extended run_serverexample

Browse Source
This commit is contained in:
justheuristic 2022-06-17 11:40:49 +03:00
parent 20497f81d1
commit 7fba411dff
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -30,5 +30,5 @@ pip install https://github.com/huggingface/transformers/archive/224bde91caff4ccf
python -m cli.inference_one_block --config cli/config.json # see other args
# minimalistic server with non-trained bloom blocks
python -m cli.run_server --block_config bigscience/bloom-6b3 --num_blocks 2
python -m cli.run_server --prefix smol --block_config bigscience/bloom-6b3 --num_blocks 2 --identity_path ./server1.id --host_maddrs /ip4/127.0.0.1/tcp/31337
```