You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Alexander Borzunov ee4e69c254 Enable rebalancing by default (#84)		2 years ago
..
__init__.py	add quantization script for cpu	2 years ago
config.json	add minimalistic benchmarks	2 years ago
convert_model.py	Reduce vocabulary size in test model, fix bug in routing when overlapped (#45)	2 years ago
deploy_server.sh	integrate mixed-8bit model (#39)	2 years ago
inference_one_block.py	WIP: make DistributedBloom compliant with HF interface	2 years ago
local_server_config_example.cfg	deploy swarm on local & remote machines	2 years ago
remote_server_config_example.cfg	deploy swarm on local & remote machines	2 years ago
run_local_servers.sh	integrate mixed-8bit model (#39)	2 years ago
run_remote_servers.sh	Sequential and parallel forward / backward (#36)	2 years ago
run_server.py	Enable rebalancing by default (#84)	2 years ago
speed_test.py	Add automated tests (#23)	2 years ago