petals

Commit Graph

Author	SHA1	Message	Date
Alexander Borzunov	10c72acdf4	Fix warmup steps and minor issues in benchmarks (#334 ) The previous code was incorrect for the case of `warmup_steps != 1` (this mode was never used, but can be used in future).	11 months ago
Alexander Borzunov	d126ee3053	Add benchmark scripts (#319 ) This PR: - Adds benchmark scripts for inference, forward pass, and full training step (e.g. used for experiments in our paper). - Fixes bug with dtypes in `petals.DistributedBloomForSequenceClassification`. - (minor refactor) Moves `DTYPE_MAP` to `petals.constants` as a useful constant.	11 months ago

Author

SHA1

Message

Date

Alexander Borzunov

10c72acdf4

Fix warmup steps and minor issues in benchmarks (#334 )

The previous code was incorrect for the case of `warmup_steps != 1` (this mode was never used, but can be used in future).

Alexander Borzunov

d126ee3053

Add benchmark scripts (#319 )

This PR:

- Adds benchmark scripts for inference, forward pass, and full training step (e.g. used for experiments in our paper).
- Fixes bug with dtypes in `petals.DistributedBloomForSequenceClassification`.
- (minor refactor) Moves `DTYPE_MAP` to `petals.constants` as a useful constant.

2 Commits (amd-gpus)