Archives/petals
2
0
Fork 0
mirror of https://github.com/bigscience-workshop/petals synced 2024-11-16 06:12:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
424 Commits 137 Branches 15 Tags 6.6 MiB
398a384075
Commit Graph

282 Commits

Author SHA1 Message Date
justheuristic
47c308306a TODOs were moved to https://github.com/learning-at-home/bloom-demo/issues/3#issuecomment-1159686069 2022-06-19 16:56:21 +03:00
justheuristic
a00ec56ade basic multi-step inference session 2022-06-19 16:55:51 +03:00
justheuristic
c4d508c00e remove some unnecessary debugprints 2022-06-19 14:14:11 +03:00
justheuristic
a44cb84f06 basic cache checks (via debugprint) 2022-06-19 14:13:45 +03:00
justheuristic
fee63bd440 rpc_inference works! 2022-06-19 13:51:55 +03:00
justheuristic
8092bd31ff swap to int64 (rationale: pytorch does not support uint64) 2022-06-19 13:37:13 +03:00
justheuristic
62d7fde8af pre-check type 2022-06-19 12:58:31 +03:00
justheuristic
20497f81d1 switch to hivemind-master 2022-06-17 11:34:50 +03:00
justheuristic
5a15c13ca7 switch to hivemind-master 2022-06-17 10:36:34 +03:00
justheuristic
e3a7d5af30 inference mode 2022-06-14 14:51:06 +03:00
justheuristic
3b16d6ffdb black-isort 2022-06-14 13:33:25 +03:00
justheuristic
14e316b52a black-isort 2022-06-14 09:46:14 +03:00
justheuristic
eea9287182 RemoteTransformerBlock 2022-06-14 09:45:22 +03:00
justheuristic
3e9fd63a02 RemoteTransformerBlock 2022-06-14 09:45:06 +03:00
justheuristic
1cca611c9f undo rename 2022-06-14 09:23:32 +03:00
justheuristic
7ce7cd7a97 basic backend 2022-06-14 08:49:42 +03:00
justheuristic
1c49bcb741 basic backend 2022-06-14 08:26:05 +03:00
justheuristic
8f5d022d18 save hidden size 2022-06-14 05:09:07 +03:00
justheuristic
e2e9d0e94c memory cache for attention KVs 2022-06-13 00:47:55 +03:00
justheuristic
e5e8c9ed12 expel all bloom-specific files to src.bloom 2022-06-12 21:44:36 +03:00
justheuristic
54cf292374 backend schema 2022-06-12 08:40:33 +03:00
justheuristic
3ccd0b5e2d account for layer_past in alibi 2022-06-12 07:21:17 +03:00
justheuristic
fb3bfbb78f optimization TODOs for later 2022-06-12 06:54:12 +03:00
justheuristic
902bf6400a [temp workaround] create alibi 2022-06-12 06:50:19 +03:00
justheuristic
05faa0b3c8 add quantization script for cpu 2022-06-12 05:59:11 +03:00
justheuristic
ffb56a65ed keep hidden_size as property 2022-06-12 05:11:28 +03:00
justheuristic
ffce7718ac layer.py -> block.py 2022-06-12 05:09:28 +03:00
justheuristic
9c929b6f3b layer.py -> bloom_block.py 2022-06-12 05:08:18 +03:00
justheuristic
79925fc5f7 [more disclaimers] 2022-06-12 05:03:16 +03:00
justheuristic
fde9d50850 remove slow_but_exact, add quantization 2022-06-12 05:00:01 +03:00
justheuristic
43399d7898 remove slow_but_exact, add quantization 2022-06-12 04:56:26 +03:00
justheuristic
51e96ac19b adopt transformers bloom model 
Co-authored-by: Thomwolf <thomwolf@gmail.com>
Co-authored-by: Thomas Wolf <thomas@huggingface.co>
Co-authored-by: thomasw21 <24695242+thomasw21@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: sIncerass <sheng.s@berkeley.edu>
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
Co-authored-by: Niklas Muennighoff <n.muennighoff@gmail.com>
Co-authored-by: Nicolas Patry <Narsil@users.noreply.github.com>
Co-authored-by: thomasw21 <thomasw21@users.noreply.github.com>
Co-authored-by: sgugger <sgugger@users.noreply.github.com>
Co-authored-by: patrickvonplaten <patrickvonplaten@users.noreply.github.com>
Co-authored-by: LysandreJik <LysandreJik@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: justheuristic <justheuristic@gmail.com>
Co-authored-by: Stas Bekman <stas@stason.org>
 2022-06-12 04:24:12 +03:00