petals/tests/test_utils.py

import os

INITIAL_PEERS = os.environ.get("INITIAL_PEERS")
if not INITIAL_PEERS:
    raise RuntimeError("Must specify INITIAL_PEERS environment variable with one or more peer ids")
INITIAL_PEERS = INITIAL_PEERS.split()


MODEL_NAME = os.environ.get("MODEL_NAME")
if not MODEL_NAME:
    raise RuntimeError("Must specify MODEL_NAME as an index of a transformer block to be tested")

REF_NAME = os.environ.get("REF_NAME")

ADAPTER_NAME = os.environ.get("ADAPTER_NAME")
Implement RemoteSequential slicing and extra repr, add tests (#30) - finish renaming RemoteSequenceInfo -> RemoteSequenceManager (why: if it was an *Info, user would expect it to be similar - to a dataclass; whereas in actuality, the class is doing heavy network interactions on its own) - implement RemoteSequenceManager.make_sequence (from https://pastebin.com/uXgy2U8B ) - make RemoteSequentialInferenceSession use RemoteSequenceManager.make_sequence - make tests pass again - make it possible to create inference session without RemoteTransformerBlock - make a standalone test for RemoteSequential - rollback convert-model Co-authored-by: Tim Dettmers <tim.dettmers@gmail.com> 2022-07-19 01:28:04 +00:00			`import os`

			`INITIAL_PEERS = os.environ.get("INITIAL_PEERS")`
			`if not INITIAL_PEERS:`
			`raise RuntimeError("Must specify INITIAL_PEERS environment variable with one or more peer ids")`
			`INITIAL_PEERS = INITIAL_PEERS.split()`


			`MODEL_NAME = os.environ.get("MODEL_NAME")`
			`if not MODEL_NAME:`
			`raise RuntimeError("Must specify MODEL_NAME as an index of a transformer block to be tested")`

			`REF_NAME = os.environ.get("REF_NAME")`
Support peft LoRA adapters (#335) Implement an option to deploy PEFT adapters to a server. Clients can set active_adapter=... to use these adapters. --------- Co-authored-by: Aleksandr Borzunov <borzunov.alexander@gmail.com> Co-authored-by: justheuristic <justheuristic@gmail.com> 2023-07-12 12:22:28 +00:00
			`ADAPTER_NAME = os.environ.get("ADAPTER_NAME")`