You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
petals/src/petals/server
Alexander Borzunov fd19c21859
Update --update_period and --expiration defaults (#410)
11 months ago
..
__init__.py Make Petals a pip-installable package (attempt 2) (#102) 2 years ago
backend.py Split long sequences into chunks (#403) 11 months ago
block_selection.py Use get_logger(__name__) instead of get_logger(__file__) (#265) 1 year ago
block_utils.py Support loading blocks in 4-bit (QLoRA NF4 format, disabled by default) (#333) 11 months ago
from_pretrained.py Fix routing through relay, default network RPS, --token, logging, readme (#399) 11 months ago
handler.py Fix routing through relay, default network RPS, --token, logging, readme (#399) 11 months ago
memory_cache.py Fix deadlocks in MemoryCache (#396) 11 months ago
reachability.py Update to petals.dev (#390) 11 months ago
server.py Update --update_period and --expiration defaults (#410) 11 months ago
task_pool.py Use get_logger(__name__) instead of get_logger(__file__) (#265) 1 year ago
task_prioritizer.py Merge inference pools into one to increase inference speed (#225) 1 year ago
throughput.py If speedtest fails, assume network speed of 100 Mbit/s (#404) 11 months ago