Commit Graph

69 Commits

Author SHA1 Message Date
Tim Dettmers
43fdcac6aa Loading a bloom block working. 2022-06-20 10:07:42 -07:00
justheuristic
f3722d52cf
Update README.md 2022-06-20 17:02:29 +03:00
justheuristic
aaaf0c2dad better testing readme 2022-06-20 16:51:20 +03:00
justheuristic
83cd4412a1 black-isort 2022-06-20 16:50:22 +03:00
justheuristic
2bf83b42e5 add testing guide 2022-06-20 16:50:12 +03:00
justheuristic
b843328b65 mask 2022-06-20 16:31:36 +03:00
justheuristic
5d8f7be546 causal mask by default 2022-06-20 16:24:29 +03:00
justheuristic
1ab5fb1630 fetch a specific bloom block without downloading the entire model 2022-06-20 15:33:17 +03:00
justheuristic
a6fca51212 fetch a specific bloom block without downloading the entire model 2022-06-20 15:11:22 +03:00
justheuristic
6047a2ffe0 push config and tokenizer separately 2022-06-20 14:28:31 +03:00
justheuristic
2d55e6e4fe instructions to test distributed inference 2022-06-19 22:25:57 +03:00
justheuristic
9be7c81b78 instructions to test distributed inference 2022-06-19 22:22:01 +03:00
justheuristic
cc9a76625d warn about long runtime 2022-06-19 22:14:52 +03:00
justheuristic
82214699f2 notes on hosting servers 2022-06-19 19:34:18 +03:00
justheuristic
b6f3bbfd97 black 2022-06-19 19:18:46 +03:00
justheuristic
84de19fb1a better status logs 2022-06-19 19:17:44 +03:00
justheuristic
1555d98f66 push converted model to hub 2022-06-19 19:13:48 +03:00
justheuristic
736f1d1085 push converted model to hub 2022-06-19 19:06:35 +03:00
justheuristic
15d0ea7129 fix black 2022-06-19 17:24:11 +03:00
justheuristic
e8241d2915 black everything 2022-06-19 17:23:08 +03:00
justheuristic
3b9351de1c isort 2022-06-19 17:22:57 +03:00
justheuristic
ed468af8d6 leave a todo for attention mask 2022-06-19 17:22:29 +03:00
justheuristic
33358bc52b rpc_inference works 2022-06-19 17:20:22 +03:00
justheuristic
47c308306a TODOs were moved to https://github.com/learning-at-home/bloom-demo/issues/3#issuecomment-1159686069 2022-06-19 16:56:21 +03:00
justheuristic
a00ec56ade basic multi-step inference session 2022-06-19 16:55:51 +03:00
justheuristic
c4d508c00e remove some unnecessary debugprints 2022-06-19 14:14:11 +03:00
justheuristic
a44cb84f06 basic cache checks (via debugprint) 2022-06-19 14:13:45 +03:00
justheuristic
fee63bd440 rpc_inference works! 2022-06-19 13:51:55 +03:00
justheuristic
8092bd31ff swap to int64 (rationale: pytorch does not support uint64) 2022-06-19 13:37:13 +03:00
justheuristic
62d7fde8af pre-check type 2022-06-19 12:58:31 +03:00
justheuristic
7fba411dff extended run_serverexample 2022-06-17 11:40:49 +03:00
justheuristic
20497f81d1 switch to hivemind-master 2022-06-17 11:34:50 +03:00
justheuristic
5a15c13ca7 switch to hivemind-master 2022-06-17 10:36:34 +03:00
Pavel Samygin
57f4e0a899 add identity path 2022-06-17 10:15:15 +03:00
justheuristic
35310698f0 newer hivemind version 2022-06-17 10:12:09 +03:00
justheuristic
8959727dea add minimalistic benchmarks 2022-06-14 15:18:38 +03:00
justheuristic
a798ea04a6 add minimalistic benchmarks 2022-06-14 15:18:11 +03:00
justheuristic
e3a7d5af30 inference mode 2022-06-14 14:51:06 +03:00
justheuristic
3b16d6ffdb black-isort 2022-06-14 13:33:25 +03:00
justheuristic
a28ea0aa6f
Merge pull request #9 from learning-at-home/rpc
Rudimentary decentralization
2022-06-14 09:46:42 +03:00
justheuristic
14e316b52a black-isort 2022-06-14 09:46:14 +03:00
justheuristic
eea9287182 RemoteTransformerBlock 2022-06-14 09:45:22 +03:00
justheuristic
3e9fd63a02 RemoteTransformerBlock 2022-06-14 09:45:06 +03:00
justheuristic
1cca611c9f undo rename 2022-06-14 09:23:32 +03:00
justheuristic
7ce7cd7a97 basic backend 2022-06-14 08:49:42 +03:00
justheuristic
1c49bcb741 basic backend 2022-06-14 08:26:05 +03:00
justheuristic
3215945882 use logger 2022-06-14 08:25:06 +03:00
justheuristic
ce5dedd2c7 rename 2022-06-14 05:09:13 +03:00
justheuristic
8f5d022d18 save hidden size 2022-06-14 05:09:07 +03:00
justheuristic
e2e9d0e94c memory cache for attention KVs 2022-06-13 00:47:55 +03:00