Archives
/
petals
mirror of https://github.com/bigscience-workshop/petals
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

stupid, slow, fragile, but correct full model inference

Browse Source
client
justheuristic 2 years ago
parent a6c4a606e0
commit d688cb0d22
1 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File

4
README.md
Unescape Escape View File

@ -94,7 +94,9 @@ python -m cli.run_server --prefix bloom6b3 --converted_model_name_or_path bigsci
export PYTHONPATH=. INITIAL_PEERS="/ip4/TODO_COPY_INITIAL_PEERS_FROM_SERVER_OUTPUT" export PYTHONPATH=. INITIAL_PEERS="/ip4/TODO_COPY_INITIAL_PEERS_FROM_SERVER_OUTPUT"
BLOCK_UID=bloom6b3.3 pytest tests/test_block_exact_match.py BLOCK_UID=bloom6b3.3 pytest tests/test_block_exact_match.py
BLOCK_UID=bloom6b3.4 pytest tests/test_block_exact_match.py BLOCK_UID=bloom6b3.4 pytest tests/test_block_exact_match.py
# the test below will fail because there is no server that serves layer 7 # the test below will fail because there is no server that serves layer 7
# BLOCK_UID=bloom6b3.7 pytest tests/test_block_exact_match.py # BLOCK_UID=bloom6b3.7 pytest tests/test_block_exact_match.py
# test full model exact match
MODEL_NAME=bigscience/test-bloomd-6b3 REF_NAME=bigscience/bloom-6b3 pytest tests/test_full_model.py
``` ```

Write Preview
Loading…
Cancel
Save