mirror of
https://github.com/bigscience-workshop/petals
synced 2024-10-31 09:20:41 +00:00
6137b1b4b0
We need to sample the next server using its throughput as the weight to actually achieve max throughput for fine-tuning. As an example, imagine a situation where we have 3 servers with throughputs [1000, 500, 1] hosting the same blocks, then compare the uniform and weighted sampling strategies. |
||
---|---|---|
.. | ||
scripts | ||
conftest.py | ||
test_aux_functions.py | ||
test_block_exact_match.py | ||
test_chained_calls.py | ||
test_full_model.py | ||
test_priority_pool.py | ||
test_remote_sequential.py | ||
test_sequence_manager.py | ||
test_server_stats.py | ||
test_tensor_parallel.py | ||
test_utils.py | ||
test.id |