justheuristic a2066a4096 Optimize RemoteSequenceManager (#106) ... - [x] made RemoteSequenceManager into a background thread that pre-fetches information instead of running just in time - [x] moved routing-related stuff to petals.client.routing - [x] extract remote peer routing information to RemoteSequenceInfo - [x] made sure that the code survives continued use (e.g. one hour) - [x] updated every spot where update_ is called manually - [x] modified get_sequence to check that the thread is alive, warn if not - [x] removed max_retries, switched rpc_info to exponential backoff - [x] fixed a bg that causes RemoteSeq* to lose user-defined hyperparameters (e.g. timeout) upon subsequencing (sequential[3:5]) - [x] moved client-side points strategy to client.routing - [x] ensured that RemoteSequenceManager thread created in get_remote_module properly shuts down when the module is destroyed - [x] resolved minor affected todos - [x] modified tests to no longer use PYTHONPATH - [x] worked around protocol error in rpc_info Co-authored-by: Aleksandr Borzunov <borzunov.alexander@gmail.com> Co-authored-by: Artem Chumachenko <artek.chumak@gmail.com>		2022-12-01 10:25:55 +03:00
..
check-style.yaml	Clean up readme (#24)	2022-07-16 02:11:17 +03:00
push-docker-image.yaml	Add Dockerfile (#82)	2022-12-01 04:31:55 +03:00
run-tests.yaml	Optimize RemoteSequenceManager (#106)	2022-12-01 10:25:55 +03:00