petals

Commit Graph

Author	SHA1	Message	Date
Alexander Borzunov	668b736031	Fix logging: do not duplicate lines, enable colors in Colab (#156 )	1 year ago
justheuristic	b04982c1a2	Bump transformers to 4.25.1 (#151 ) - latest accelerate, transformers, huggingface_hub - rearrange attention caches to support https://github.com/huggingface/transformers/pull/18344 - remove unused code - fix edge case where session crashes when receiving seq length 0 - assert transformer version when importing WrappedBloomBlock Co-authored-by: Alexander Borzunov <borzunov.alexander@gmail.com> Co-authored-by: Max Ryabinin <mryabinin0@gmail.com>	1 year ago
Alexander Borzunov	84fec81543	Suppress asyncio error logs by default (#142 )	2 years ago
Alexander Borzunov	e1d8793f00	Show route on client (#139 )	2 years ago
Alexander Borzunov	1fe3716589	Don't ban servers in case of client-caused handler errors (#134 )	2 years ago
Alexander Borzunov	f56edaa13f	Fix inference and rpc_info() fault tolerance (#131 )	2 years ago
justheuristic	79a4308992	Clear trigger before engaging in update (#130 ) Update sequence_manager.py	2 years ago
justheuristic	68c85e7492	Avoid synchronous updates, ban peers based on request outcome (#127 ) - sequence_manager now takes care for its own updated-ness - no need to manually update it - if a peer fails a request, sequence manager will ban this peer temporarily. Ban times increase with failure streaks Co-authored-by: Alexander Borzunov <borzunov.alexander@gmail.com>	2 years ago
Max Ryabinin	3ca8b4f082	Fix typos with codespell (#126 )	2 years ago
justheuristic	a2066a4096	Optimize RemoteSequenceManager (#106 ) - [x] made RemoteSequenceManager into a background thread that pre-fetches information instead of running just in time - [x] moved routing-related stuff to petals.client.routing - [x] extract remote peer routing information to RemoteSequenceInfo - [x] made sure that the code survives continued use (e.g. one hour) - [x] updated every spot where update_ is called manually - [x] modified get_sequence to check that the thread is alive, warn if not - [x] removed max_retries, switched rpc_info to exponential backoff - [x] fixed a bg that causes RemoteSeq* to lose user-defined hyperparameters (e.g. timeout) upon subsequencing (sequential[3:5]) - [x] moved client-side points strategy to client.routing - [x] ensured that RemoteSequenceManager thread created in get_remote_module properly shuts down when the module is destroyed - [x] resolved minor affected todos - [x] modified tests to no longer use PYTHONPATH - [x] worked around protocol error in rpc_info Co-authored-by: Aleksandr Borzunov <borzunov.alexander@gmail.com> Co-authored-by: Artem Chumachenko <artek.chumak@gmail.com>	2 years ago

10 Commits (668b736031c87679db91f4bf453b4acc95623b0e)