Commit Graph

508 Commits (main)
 

Author SHA1 Message Date
justheuristic e2711a033b
Add automated tests (#23)
This PR will run basic tests automatically on each subsequent PR

- convert a small model on every PR
- run existing tests on every PR
- enforce black / isort
- require checks on merge
- make sure tests are not flappy

Co-authored-by: Alexander Borzunov <hxrussia@gmail.com>
Co-authored-by: Dmitry Baranchuk <dmitrybaranchuk@gmail.com>
2 years ago
Dmitry Baranchuk f5463812ad
Shallow prompt tuning (#22) 2 years ago
Alexander Borzunov 7e9f337a63
Remove excess line from readme 2 years ago
Dmitry Baranchuk db966a76dd
rm heuristic for num_handlers 2 years ago
Dmitry Baranchuk f114a6d417
set default num_handlers=16 2 years ago
Aleksandr Borzunov f3cf5f4d8d Fix choose_best_blocks() 2 years ago
Alexander Borzunov 75856e4769
Measure and cache network & compute throughput (#21) 2 years ago
Dmitry Baranchuk ac7df18dfa
Merge pull request #19 from learning-at-home/lm_head
add a modified LM head
2 years ago
Dmitry Baranchuk fd0bf064f3
minor refactoring 2 years ago
Alexander Borzunov aba43f1308
Implement block selection on servers (#20) 2 years ago
dbaranchuk 21e1f42f04 mv set_requires_grad to remote_model 2 years ago
dbaranchuk 5168a3405a fix comments 2 years ago
dbaranchuk 79280c4371 refactoring 2 years ago
dbaranchuk 6bffeff0a1 fix 2 years ago
dbaranchuk b3cc9e0d99 add LM head for DistributedBloomCausalLM 2 years ago
dbaranchuk df42822f26 LM head for CausalLM & chunked forward 2 years ago
Dmitry Baranchuk f055135b08
rm prefix 2 years ago
justheuristic 4eadd00a2c rm prefix from tests 2 years ago
justheuristic 1c68670d06 it works 2 years ago
justheuristic 2e90ac30a0 use default prefix in readme 2 years ago
justheuristic 5695897620 fix imports 2 years ago
justheuristic 88c1bf9896 black-isort 2 years ago
justheuristic 3223e8b19b straighten import order 2 years ago
justheuristic de556c99be straighten import order 2 years ago
justheuristic c792f50b9c fix import order 2 years ago
justheuristic 90d65e58aa set default DHT prefix 2 years ago
justheuristic 41e5a95e8e set client branch to main by default;
remove the concept of base branch (redundant)
2 years ago
justheuristic 899cefe588 set client branch to main by default;
remove the concept of base branch (redundant)
2 years ago
justheuristic 4695071ad2 WIP: make DistributedBloom compliant with HF interface 2 years ago
justheuristic 6c437c9249 use main as client branch 2 years ago
justheuristic e32208c954 black-isort 2 years ago
justheuristic 4ad845bce3 black-isort 2 years ago
justheuristic 0f9cd687d4
Merge pull request #18 from learning-at-home/rpc
Chained rpc_forward & rpc_backward
2 years ago
Dmitry Baranchuk 4cb986f680 add chained rpc_forward & rpc_backward 2 years ago
Dmitry Baranchuk 0b5a68983f
Merge pull request #17 from learning-at-home/update-model
Update client and model
2 years ago
Dmitry Baranchuk 29999a6691 rm debug print 2 years ago
Dmitry Baranchuk e66ab6f1f2 design interface & refactoring 2 years ago
Dmitry Baranchuk be83e6d0cb refactoring 2 years ago
Dmitry Baranchuk 6a603f9cd6 set requires_grad=False, lm_layer -> h @ word_embeddings, rm lm_layer from comverted_model 2 years ago
Dmitry Baranchuk d969172208 set requires_grad=False, lm_layer -> h @ word_embeddings, rm lm_layer from comverted_model 2 years ago
justheuristic 30d8bf3301 Merge branch 'main' of github.com:learning-at-home/bloom-demo into main 2 years ago
Aleksandr Borzunov 792dc4bcf8 review 2 years ago
justheuristic 8de7c1687b
list latest additions 2 years ago
justheuristic d42e8abd38 Merge branch 'client' into main 2 years ago
justheuristic d688cb0d22 stupid, slow, fragile, but correct full model inference 2 years ago
justheuristic a6c4a606e0 compare logits to logits 2 years ago
justheuristic d0c7f2a886 test full model exact match 2 years ago
justheuristic 3f42b3fb8d run inference with no grad 2 years ago
justheuristic db3ad89c2e temporary fix for info 2 years ago
justheuristic 6113a7e955 create alibi inside each block 2 years ago