You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
petals/src/petals/utils
Max Ryabinin 57119bb201 Merge query/key/value projection layers 9 months ago
..
__init__.py Move SequenceManagerConfig -> ClientConfig, petals.dht_utils -> petals.utils.dht (#463) 10 months ago
asyncio.py Shield alloc & free from cancellation (#163) 1 year ago
auto_config.py Fix routing through relay, default network RPS, --token, logging, readme (#399) 10 months ago
convert_block.py Merge query/key/value projection layers 9 months ago
dht.py Move SequenceManagerConfig -> ClientConfig, petals.dht_utils -> petals.utils.dht (#463) 10 months ago
disk_cache.py Allow free_disk_space_for() remove arbitrary files from Petals cache (#339) 11 months ago
hf_auth.py Support Llama 2 (#379) 10 months ago
logging.py Remove unused imports and attributes (#324) 12 months ago
misc.py Rewrite MemoryCache alloc_timeout logic (#434) 9 months ago
packaging.py Add customizable input tensors (#445) 10 months ago
peft.py Rewrite MemoryCache alloc_timeout logic (#434) 9 months ago
ping.py Fix petals.utils.ping for servers with client-mode DHT (#430) 10 months ago
random.py Implement shortest-path routing for inference (#362) 11 months ago
version.py Add LLaMA support (#323) 11 months ago