Commit Graph

43 Commits

Author SHA1 Message Date
Dmitry Baranchuk
6573076883
Sequential and parallel forward / backward (#36) 2022-07-23 14:32:39 +03:00
justheuristic
e2711a033b
Add automated tests (#23)
This PR will run basic tests automatically on each subsequent PR

- convert a small model on every PR
- run existing tests on every PR
- enforce black / isort
- require checks on merge
- make sure tests are not flappy

Co-authored-by: Alexander Borzunov <hxrussia@gmail.com>
Co-authored-by: Dmitry Baranchuk <dmitrybaranchuk@gmail.com>
2022-07-16 01:59:23 +03:00
Dmitry Baranchuk
f114a6d417
set default num_handlers=16 2022-07-14 02:32:58 +03:00
Alexander Borzunov
75856e4769
Measure and cache network & compute throughput (#21) 2022-07-13 05:46:26 +04:00
Alexander Borzunov
aba43f1308
Implement block selection on servers (#20) 2022-07-12 14:42:30 +04:00
Dmitry Baranchuk
f055135b08
rm prefix 2022-07-08 21:59:25 +03:00
justheuristic
5695897620 fix imports 2022-07-07 04:13:20 +03:00
justheuristic
de556c99be straighten import order 2022-07-07 03:49:04 +03:00
justheuristic
90d65e58aa set default DHT prefix 2022-07-07 03:34:58 +03:00
justheuristic
41e5a95e8e set client branch to main by default;
remove the concept of base branch (redundant)
2022-07-07 03:18:10 +03:00
justheuristic
899cefe588 set client branch to main by default;
remove the concept of base branch (redundant)
2022-07-07 03:16:47 +03:00
justheuristic
4695071ad2 WIP: make DistributedBloom compliant with HF interface 2022-07-07 03:11:28 +03:00
justheuristic
4ad845bce3 black-isort 2022-07-07 01:04:47 +03:00
Dmitry Baranchuk
be83e6d0cb refactoring 2022-07-04 22:43:51 +03:00
Dmitry Baranchuk
d969172208 set requires_grad=False, lm_layer -> h @ word_embeddings, rm lm_layer from comverted_model 2022-07-04 21:18:29 +03:00
justheuristic
d42e8abd38 Merge branch 'client' into main 2022-07-01 03:53:54 +03:00
Dmitry Baranchuk
d7baa9997d rm deprecated files 2022-06-29 13:56:44 +03:00
Dmitry Baranchuk
f60a7dd183 deploy swarm on local & remote machines 2022-06-29 13:52:43 +03:00
justheuristic
9c492bbe8c Infer prefix by defaukt 2022-06-29 11:28:13 +03:00
justheuristic
6e3db6bed6 black-isort 2022-06-28 13:16:03 +03:00
justheuristic
894cd5d586 Merge branch 'fix-auth-token' into main 2022-06-28 13:15:34 +03:00
Dmitry Baranchuk
4d27080ccc add scripts to deploy a swarm 2022-06-27 17:26:08 +03:00
justheuristic
d5c410bb1f fix auth token 2022-06-27 15:51:58 +03:00
justheuristic
ce9556dcb0 deprecation warning 2022-06-23 16:26:54 +03:00
justheuristic
83cd4412a1 black-isort 2022-06-20 16:50:22 +03:00
justheuristic
1ab5fb1630 fetch a specific bloom block without downloading the entire model 2022-06-20 15:33:17 +03:00
justheuristic
6047a2ffe0 push config and tokenizer separately 2022-06-20 14:28:31 +03:00
justheuristic
b6f3bbfd97 black 2022-06-19 19:18:46 +03:00
justheuristic
84de19fb1a better status logs 2022-06-19 19:17:44 +03:00
justheuristic
1555d98f66 push converted model to hub 2022-06-19 19:13:48 +03:00
justheuristic
736f1d1085 push converted model to hub 2022-06-19 19:06:35 +03:00
justheuristic
e8241d2915 black everything 2022-06-19 17:23:08 +03:00
justheuristic
3b9351de1c isort 2022-06-19 17:22:57 +03:00
justheuristic
20497f81d1 switch to hivemind-master 2022-06-17 11:34:50 +03:00
Pavel Samygin
57f4e0a899 add identity path 2022-06-17 10:15:15 +03:00
justheuristic
a798ea04a6 add minimalistic benchmarks 2022-06-14 15:18:11 +03:00
justheuristic
14e316b52a black-isort 2022-06-14 09:46:14 +03:00
justheuristic
7ce7cd7a97 basic backend 2022-06-14 08:49:42 +03:00
justheuristic
1c49bcb741 basic backend 2022-06-14 08:26:05 +03:00
justheuristic
3215945882 use logger 2022-06-14 08:25:06 +03:00
justheuristic
ce5dedd2c7 rename 2022-06-14 05:09:13 +03:00
justheuristic
324ea2dc96 save non-transformer params separately 2022-06-12 09:35:58 +03:00
justheuristic
05faa0b3c8 add quantization script for cpu 2022-06-12 05:59:11 +03:00