You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
petals/src/petals/utils
Denis Mazur 0d91bbdac3
Bump transformers and accelerate versions (#554)
Bump versions for transformers and accelerate, remove falcon-rw-1b CI tests
3 months ago
..
__init__.py Move SequenceManagerConfig -> ClientConfig, petals.dht_utils -> petals.utils.dht (#463) 10 months ago
asyncio.py Shield alloc & free from cancellation (#163) 1 year ago
auto_config.py Add Falcon support (#499) 9 months ago
convert_block.py Support Llama 2 (#379) 10 months ago
cuda_graphs.py Optimize LLaMA for inference (#513) 7 months ago
dht.py Store (start_block, end_block) in each DHT record for reliability (#510) 9 months ago
disk_cache.py Fix file locks in NFS-mounted directories (#517) 8 months ago
hf_auth.py Support Llama 2 (#379) 10 months ago
logging.py Remove unused imports and attributes (#324) 12 months ago
misc.py Rewrite MemoryCache alloc_timeout logic (#434) 9 months ago
packaging.py Add customizable input tensors (#445) 10 months ago
peft.py Bump transformers and accelerate versions (#554) 3 months ago
ping.py Fix petals.utils.ping for servers with client-mode DHT (#430) 10 months ago
random.py Implement shortest-path routing for inference (#362) 11 months ago
version.py Add LLaMA support (#323) 11 months ago