You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
petals/src
Aleksandr Borzunov 5578378202 Lower --max_batch_size and --inference_max_length defaults to 2048 2 years ago
..
bloom [Fix] make distributed seq cls to not create the full bloom model (#49) 2 years ago
client Add Beam Search decoding algorithm (#87) 2 years ago
server Lower --max_batch_size and --inference_max_length defaults to 2048 2 years ago
utils Enable PETALS_8BIT_BACKWARD by default 2 years ago
__init__.py Measure and cache network & compute throughput (#21) 2 years ago
constants.py Use public swarm by default (#92) 2 years ago
data_structures.py Implement RemoteSequential slicing and extra repr, add tests (#30) 2 years ago
dht_utils.py remove transformer block, implement as sequential of size 1 (#54) 2 years ago