You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
petals/src/petals/server
Alexander Borzunov 5ce4f1a159
Store (start_block, end_block) in each DHT record for reliability (#510)
This PR fixes gaps in the DHT server info caused by unavailable DHT keys. Now, one DHT key is enough to get info about all blocks hosted by a server - so we'll see info until all keys are unavailable.

Also, this PR refactors `petals.client.routing` and `petals.server.block_selection` modules to use the common `compute_spans()` function (defined in `petals.utils.dht`) and `RemoteSpanInfo` class (defined in `petals.data_structures`).
8 months ago
..
__init__.py Make Petals a pip-installable package (attempt 2) (#102) 1 year ago
backend.py Rewrite MemoryCache alloc_timeout logic (#434) 9 months ago
block_functions.py Make client compatible with transformers' GenerationMixin (#464) 9 months ago
block_selection.py Store (start_block, end_block) in each DHT record for reliability (#510) 8 months ago
block_utils.py Rewrite MemoryCache alloc_timeout logic (#434) 9 months ago
from_pretrained.py Hide excess key message (#476) 9 months ago
handler.py Rewrite MemoryCache alloc_timeout logic (#434) 9 months ago
memory_cache.py Fix race condition in MemoryCache (#487) 9 months ago
reachability.py Support macOS (#477) 9 months ago
server.py Store (start_block, end_block) in each DHT record for reliability (#510) 8 months ago
task_pool.py Remove no-op process in PrioritizedTaskPool (#484) 9 months ago
task_prioritizer.py Make client compatible with transformers' GenerationMixin (#464) 9 months ago
throughput.py Support macOS (#477) 9 months ago