Commit Graph

199 Commits

Author SHA1 Message Date
Alexander Borzunov
aba43f1308
Implement block selection on servers (#20) 2022-07-12 14:42:30 +04:00
dbaranchuk
21e1f42f04 mv set_requires_grad to remote_model 2022-07-10 23:41:05 +03:00
dbaranchuk
5168a3405a fix comments 2022-07-10 20:35:13 +03:00
dbaranchuk
79280c4371 refactoring 2022-07-10 20:27:38 +03:00
dbaranchuk
6bffeff0a1 fix 2022-07-10 20:17:11 +03:00
dbaranchuk
b3cc9e0d99 add LM head for DistributedBloomCausalLM 2022-07-10 15:13:46 +03:00
dbaranchuk
df42822f26 LM head for CausalLM & chunked forward 2022-07-10 15:10:13 +03:00
Dmitry Baranchuk
f055135b08
rm prefix 2022-07-08 21:59:25 +03:00
justheuristic
4eadd00a2c rm prefix from tests 2022-07-08 19:11:55 +03:00
justheuristic
1c68670d06 it works 2022-07-08 19:05:57 +03:00
justheuristic
2e90ac30a0 use default prefix in readme 2022-07-07 13:22:03 +03:00
justheuristic
5695897620 fix imports 2022-07-07 04:13:20 +03:00
justheuristic
88c1bf9896 black-isort 2022-07-07 03:49:53 +03:00
justheuristic
3223e8b19b straighten import order 2022-07-07 03:49:19 +03:00
justheuristic
de556c99be straighten import order 2022-07-07 03:49:04 +03:00
justheuristic
c792f50b9c fix import order 2022-07-07 03:42:28 +03:00
justheuristic
90d65e58aa set default DHT prefix 2022-07-07 03:34:58 +03:00
justheuristic
41e5a95e8e set client branch to main by default;
remove the concept of base branch (redundant)
2022-07-07 03:18:10 +03:00
justheuristic
899cefe588 set client branch to main by default;
remove the concept of base branch (redundant)
2022-07-07 03:16:47 +03:00
justheuristic
4695071ad2 WIP: make DistributedBloom compliant with HF interface 2022-07-07 03:11:28 +03:00
justheuristic
6c437c9249 use main as client branch 2022-07-07 03:08:41 +03:00
justheuristic
e32208c954 black-isort 2022-07-07 01:06:03 +03:00
justheuristic
4ad845bce3 black-isort 2022-07-07 01:04:47 +03:00
justheuristic
0f9cd687d4
Merge pull request #18 from learning-at-home/rpc
Chained rpc_forward & rpc_backward
2022-07-07 00:58:10 +03:00
Dmitry Baranchuk
4cb986f680 add chained rpc_forward & rpc_backward 2022-07-06 19:44:28 +03:00
Dmitry Baranchuk
0b5a68983f
Merge pull request #17 from learning-at-home/update-model
Update client and model
2022-07-05 16:41:36 +03:00
Dmitry Baranchuk
29999a6691 rm debug print 2022-07-05 02:02:19 +03:00
Dmitry Baranchuk
e66ab6f1f2 design interface & refactoring 2022-07-05 01:54:47 +03:00
Dmitry Baranchuk
be83e6d0cb refactoring 2022-07-04 22:43:51 +03:00
Dmitry Baranchuk
6a603f9cd6 set requires_grad=False, lm_layer -> h @ word_embeddings, rm lm_layer from comverted_model 2022-07-04 21:26:06 +03:00
Dmitry Baranchuk
d969172208 set requires_grad=False, lm_layer -> h @ word_embeddings, rm lm_layer from comverted_model 2022-07-04 21:18:29 +03:00
justheuristic
30d8bf3301 Merge branch 'main' of github.com:learning-at-home/bloom-demo into main 2022-07-01 16:58:28 +03:00
Aleksandr Borzunov
792dc4bcf8 review 2022-07-01 11:55:48 +03:00
justheuristic
8de7c1687b
list latest additions 2022-07-01 03:57:21 +03:00
justheuristic
d42e8abd38 Merge branch 'client' into main 2022-07-01 03:53:54 +03:00
justheuristic
d688cb0d22 stupid, slow, fragile, but correct full model inference 2022-07-01 03:53:08 +03:00
justheuristic
a6c4a606e0 compare logits to logits 2022-07-01 03:48:36 +03:00
justheuristic
d0c7f2a886 test full model exact match 2022-07-01 03:38:38 +03:00
justheuristic
3f42b3fb8d run inference with no grad 2022-07-01 02:49:02 +03:00
justheuristic
db3ad89c2e temporary fix for info 2022-07-01 02:42:56 +03:00
justheuristic
6113a7e955 create alibi inside each block 2022-07-01 02:36:14 +03:00
justheuristic
8ff45d136d check for absent args 2022-07-01 02:34:10 +03:00
justheuristic
f8b7aaece4 proper __len__ 2022-07-01 02:32:29 +03:00
justheuristic
dfc7449cd5 fix hanging 2022-07-01 02:23:33 +03:00
artek0chumak
9c31c16ecd review 2022-06-29 20:31:25 +03:00
justheuristic
75fdd9d2cd typo 2022-06-29 15:32:48 +03:00
justheuristic
4c92d8636f forward exc details 2022-06-29 15:31:11 +03:00
justheuristic
e7f716502c inference session 2022-06-29 15:30:36 +03:00
justheuristic
a7be94e6e7 debug-check 2022-06-29 15:27:17 +03:00
justheuristic
217f109723 fix reference 2022-06-29 15:06:10 +03:00