Commit Graph

244 Commits

Author SHA1 Message Date
Dmitry Baranchuk
f60a7dd183 deploy swarm on local & remote machines 2022-06-29 13:52:43 +03:00
justheuristic
331591c915 less intrusive warnings 2022-06-29 11:31:23 +03:00
justheuristic
9c492bbe8c Infer prefix by defaukt 2022-06-29 11:28:13 +03:00
justheuristic
19ae71e8fc from_pretrained 2022-06-29 11:21:18 +03:00
justheuristic
eea6fbb318 check for past key values properly 2022-06-29 11:09:49 +03:00
justheuristic
3f32912937 check for past key values properly 2022-06-29 11:08:00 +03:00
justheuristic
7903bd8f9f check for none 2022-06-29 11:05:21 +03:00
justheuristic
471e47c0f5 black-isort 2022-06-29 10:55:13 +03:00
justheuristic
7d68f6b9a4 fix model creation 2022-06-29 10:53:21 +03:00
justheuristic
828291788e fix import cycle 2022-06-29 10:47:11 +03:00
justheuristic
5849cea28c prototype remote sequential 2022-06-29 10:45:08 +03:00
Dmitry Baranchuk
775f5b25cb
fix use_auth_token 2022-06-28 21:00:34 +03:00
justheuristic
6e3db6bed6 black-isort 2022-06-28 13:16:03 +03:00
justheuristic
894cd5d586 Merge branch 'fix-auth-token' into main 2022-06-28 13:15:34 +03:00
Dmitry Baranchuk
4d27080ccc add scripts to deploy a swarm 2022-06-27 17:26:08 +03:00
justheuristic
f9b6b67b09 [typo] fix typo where run_server with blocks with index 0 would cause server.create to NOT start (start=0) 2022-06-27 15:55:47 +03:00
justheuristic
d5c410bb1f fix auth token 2022-06-27 15:51:58 +03:00
justheuristic
ca3c08acc1
Update README.md 2022-06-24 10:05:39 +03:00
justheuristic
34b8b86673 disclaimer: this part is a work-in-progress 2022-06-23 16:38:54 +03:00
justheuristic
1cdf8a77fb basic chained inference (multiple blocks per one RPC call) 2022-06-23 16:33:16 +03:00
justheuristic
ce9556dcb0 deprecation warning 2022-06-23 16:26:54 +03:00
justheuristic
d03b38b9eb black-isort 2022-06-23 14:40:57 +03:00
justheuristic
01b9bced78 black-isort 2022-06-22 22:13:21 +03:00
justheuristic
0e7afea026 Merge remote-tracking branch 'origin/main' into main 2022-06-22 22:02:27 +03:00
justheuristic
2eb47cbedd support hosting multiple instances of the same block 2022-06-22 22:00:55 +03:00
justheuristic
14b6d04b0f install hivemind from pip 2022-06-22 17:32:13 +03:00
justheuristic
f3722d52cf
Update README.md 2022-06-20 17:02:29 +03:00
justheuristic
aaaf0c2dad better testing readme 2022-06-20 16:51:20 +03:00
justheuristic
83cd4412a1 black-isort 2022-06-20 16:50:22 +03:00
justheuristic
2bf83b42e5 add testing guide 2022-06-20 16:50:12 +03:00
justheuristic
b843328b65 mask 2022-06-20 16:31:36 +03:00
justheuristic
5d8f7be546 causal mask by default 2022-06-20 16:24:29 +03:00
justheuristic
1ab5fb1630 fetch a specific bloom block without downloading the entire model 2022-06-20 15:33:17 +03:00
justheuristic
a6fca51212 fetch a specific bloom block without downloading the entire model 2022-06-20 15:11:22 +03:00
justheuristic
6047a2ffe0 push config and tokenizer separately 2022-06-20 14:28:31 +03:00
justheuristic
2d55e6e4fe instructions to test distributed inference 2022-06-19 22:25:57 +03:00
justheuristic
9be7c81b78 instructions to test distributed inference 2022-06-19 22:22:01 +03:00
justheuristic
cc9a76625d warn about long runtime 2022-06-19 22:14:52 +03:00
justheuristic
82214699f2 notes on hosting servers 2022-06-19 19:34:18 +03:00
justheuristic
b6f3bbfd97 black 2022-06-19 19:18:46 +03:00
justheuristic
84de19fb1a better status logs 2022-06-19 19:17:44 +03:00
justheuristic
1555d98f66 push converted model to hub 2022-06-19 19:13:48 +03:00
justheuristic
736f1d1085 push converted model to hub 2022-06-19 19:06:35 +03:00
justheuristic
15d0ea7129 fix black 2022-06-19 17:24:11 +03:00
justheuristic
e8241d2915 black everything 2022-06-19 17:23:08 +03:00
justheuristic
3b9351de1c isort 2022-06-19 17:22:57 +03:00
justheuristic
ed468af8d6 leave a todo for attention mask 2022-06-19 17:22:29 +03:00
justheuristic
33358bc52b rpc_inference works 2022-06-19 17:20:22 +03:00
justheuristic
47c308306a TODOs were moved to https://github.com/learning-at-home/bloom-demo/issues/3#issuecomment-1159686069 2022-06-19 16:56:21 +03:00
justheuristic
a00ec56ade basic multi-step inference session 2022-06-19 16:55:51 +03:00