Archives/petals
2
0
Fork 0
mirror of https://github.com/bigscience-workshop/petals synced 2024-10-31 09:20:41 +00:00
Code Issues Packages Projects Releases Wiki Activity
463 Commits 137 Branches 15 Tags 6.6 MiB
amd-gpus
Commit Graph

2 Commits

Author SHA1 Message Date
Alexander Borzunov
10c72acdf4
Fix warmup steps and minor issues in benchmarks (#334) 
The previous code was incorrect for the case of `warmup_steps != 1` (this mode was never used, but can be used in future).
 2023-06-30 04:18:43 +04:00
Alexander Borzunov
d126ee3053
Add benchmark scripts (#319) 
This PR:

- Adds benchmark scripts for inference, forward pass, and full training step (e.g. used for experiments in our paper).
- Fixes bug with dtypes in `petals.DistributedBloomForSequenceClassification`.
- (minor refactor) Moves `DTYPE_MAP` to `petals.constants` as a useful constant.
 2023-06-30 01:12:59 +04:00