petals

Commit Graph

Select branches

Hide Pull Requests

8bit-model

8bit_backward

8bit_blocks

8bit_model_inference

CI

add-sst2-example

amd-gpus

beamsearch

beat-docker-into-submission

bnb-0-41-1

bootstrap-peers

borzunov-patch-1

borzunov-patch-2

bump

cache

client

client-attempt2

client-convenience

dbaranchuk-patch-1

debug-leak

declare_adapters

deep-prompt-tuning

deep_prompt_inference

demo-1

diff

diff-compression

distributed-deep-ptune

download_8bit_weights

efficient-forward-backward

empty-weights

enable-rebalancing

examples_fix_hivemind

extract-module-container

facelift

fault-tolerant-inference

fix-auth-token

fix-branch-name

fix-cache

fix-ci

fix-convert-8bit

fix-distr-seq-cls

fix-docker

fix-inference-retry

fix-joining-announce

fix-master-ci

fix-nf4-and-dtypes

fix-pb2

fix-protobuf

fix-ptune

fix-readme

fix-rebalancing-issues

fix-requirements

fix-seq-backward-recovery

fix-too-many-open-files

fix3

forward-backward-timeouts

forward_backward

forward_kwargs

friendly-timeout-errors

generation

generation-inference

get_sequence

hivemind-1.1.4

hivemind-dht-fork-process

hotfix_bnb

inference_chain

instruction-readability-style

investigate-segfault

justheuristic-patch-1

justheuristic-patch-2

justheuristic-patch-3

justheuristic-patch-4

justheuristic-patch-5

lm_head

load-balancing

lora_from_hub

lru

main

main_fix

measure-throughput

measurements

memory_savings

mockup

multiple-experts

no-cpufeature

no_qkv_merge

optimize_seq

partial_rollback

payload-size

peft_update

petals-readme-title

pip-installable

pip-installable-v2

priority-tasks

processing_attention

prompt-inference

prompt-tuning

ptune-example-personachat

ptune-wip

pytest-verbose

qkv_merge

readme-clarifications

readme-release

remove-remote-block

rename-test-model

repetition-penalty

rpc

rtfd

sequence

server-dtypes

server-increase-startup-timeout

server-logging

server-timeouts

standardize

support-backend-dtypes

test-push

test_main

test_opt_serving

upd-deps

update-bullet-points

update-hivemind

update-model

update-readme-disclaimers-faq

update-readme-pics

update_example_1

vectorized_beam_search

versions

warn-about-6b-instructions

wip_triton

yozh-dev-branch

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#120

#121

#122

#123

#124

#125

#126

#127

#128

#129

#130

#131

#132

#133

#134

#135

#136

#137

#138

#139

#140

#141

#142

#143

#144

#145

#148

#149

#150

#151

#152

#153

#154

#155

#156

#157

#159

#160

#161

#162

#163

#165

#166

#168

#169

#17

#170

#171

#172

#173

#175

#176

#177

#179

#18

#180

#181

#182

#183

#184

#185

#186

#187

#188

#189

#19

#190

#191

#194

#195

#196

#197

#198

#199

#20

#200

#204

#205

#206

#209

#21

#210

#211

#212

#213

#214

#215

#217

#218

#219

#22

#221

#224

#225

#227

#229

#23

#230

#231

#232

#234

#235

#24

#243

#244

#245

#247

#248

#249

#25

#251

#252

#253

#257

#259

#26

#260

#263

#264

#265

#266

#267

#27

#273

#273

#275

#276

#277

#278

#28

#284

#285

#286

#287

#29

#290

#292

#297

#298

#299

#30

#300

#301

#302

#304

#305

#306

#307

#309

#31

#310

#311

#312

#313

#314

#315

#316

#319

#32

#323

#324

#325

#329

#33

#330

#331

#332

#333

#334

#335

#336

#337

#339

#34

#340

#341

#342

#343

#344

#345

#346

#348

#349

#35

#350

#351

#352

#353

#354

#355

#356

#357

#358

#36

#360

#362

#364

#365

#369

#37

#370

#371

#373

#374

#377

#378

#379

#38

#380

#383

#384

#385

#39

#390

#391

#392

#393

#396

#397

#399

#40

#402

#403

#404

#406

#407

#409

#41

#410

#411

#418

#42

#422

#423

#424

#428

#43

#430

#431

#434

#435

#436

#437

#438

#438

#44

#440

#441

#442

#443

#445

#448

#45

#451

#452

#454

#456

#458

#459

#46

#461

#462

#463

#464

#467

#467

#47

#470

#471

#472

#473

#474

#475

#476

#477

#478

#479

#48

#480

#482

#484

#485

#486

#487

#489

#49

#490

#491

#493

#493

#496

#497

#498

#498

#499

#50

#500

#501

#502

#504

#505

#505

#506

#506

#510

#513

#516

#517

#52

#520

#523

#523

#525

#53

#530

#531

#535

#537

#538

#539

#54

#543

#544

#544

#545

#545

#547

#547

#55

#552

#553

#554

#555

#555

#557

#557

#558

#559

#560

#560

#563

#567

#57

#570

#572

#574

#577

#579

#58

#580

#59

#60

#61

#62

#63

#64

#65

#66

#69

#70

#71

#72

#73

#74

#75

#76

#77

#80

#81

#82

#83

#84

#85

#86

#87

#88

#89

#9

#90

#91

#92

#93

#94

#95

#96

#97

#98

#99

v1.0.0

v1.1.0

v1.1.1

v1.1.2

v1.1.3

v1.1.4

v1.1.5

v2.0.0.post1

v2.0.0.post2

v2.0.0.post3

v2.0.1

v2.0.1.post1

v2.0.1.post2

v2.1.0

v2.2.0

f8f13c7845 make the entire test run in inference mode justheuristic 2022-07-19 02:25:35 +0300
628e168897 black/isort justheuristic 2022-07-19 02:07:16 +0300
f670aaf11b implement rpc_info in sequence manager justheuristic 2022-07-19 02:02:31 +0300
2d62151309 make_sequence that finished in finite time justheuristic 2022-07-19 01:29:03 +0300
2729f9b5b9 remove mark justheuristic 2022-07-19 01:16:25 +0300
475c63db98 undo refactor justheuristic 2022-07-19 01:01:18 +0300
e365ab4e17 undo move justheuristic 2022-07-19 01:00:01 +0300
07f38a551d Merge remote-tracking branch 'origin/main' into get_sequence justheuristic 2022-07-19 00:55:29 +0300
6ed9ee2d3a extract remote block inference justheuristic 2022-07-19 00:52:40 +0300
6ee942e915

Add GenerationMixin class (#29) Artem Chumachenko 2022-07-19 01:44:16 +0400
a652260793 move block choice from InferenceSession to RemoteSequenceManager justheuristic 2022-07-19 00:42:59 +0300
c16d73bda3 intermediate black/isort justheuristic 2022-07-19 00:42:07 +0300
6df55d6bd9 disentangle inference session from RemoteTransformerBlock justheuristic 2022-07-19 00:41:18 +0300
39884cb37d intermediate black/isort justheuristic 2022-07-19 00:22:07 +0300
ac62df8606 temporarily fuse off convert_model justheuristic 2022-07-19 00:21:22 +0300
1d72f1890e sequence_info -> sequence_manager justheuristic 2022-07-19 00:19:54 +0300
53dcd39d8a Merge branch 'main' of github.com:bigscience-workshop/bloom-demo into main justheuristic 2022-07-19 00:14:54 +0300
1d7c550485 Fix tests generation Artem Chumachenko 2022-07-18 12:00:15 +0000
d351431e95 style Artem Chumachenko 2022-07-18 08:57:07 +0000
7ea1ea043b black Artem Chumachenko 2022-07-16 13:01:30 +0000
a3be17a36e Add multibatch mode Artem Chumachenko 2022-07-16 12:49:31 +0000
e6884291b7 more hf like artek0chumak 2022-07-11 00:28:38 +0400
aee079981a working one batch artek0chumak 2022-07-10 17:35:12 +0400
526942c67d fix imports artek0chumak 2022-07-10 17:21:52 +0400
285080f3d8 after style fixes artek0chumak 2022-07-10 17:04:13 +0400
389d220d2d remove batch_ids artek0chumak 2022-07-10 17:02:20 +0400
2e0abe48ae fix generate artek0chumak 2022-07-10 16:53:42 +0400
12d874f195 batch_ids artek0chumak 2022-07-08 11:31:41 +0400
b29937b74c Init inference generation artek0chumak 2022-07-07 00:37:22 +0400
177d81bea6

CI: use GIT_REF_NAME instead of GIT_HEAD_REF (#28) justheuristic 2022-07-16 11:43:24 +0300
d0c502bd21 specify tag separately fix-ci justheuristic 2022-07-16 04:29:01 +0300
85015c6a1f specify tag separately justheuristic 2022-07-16 04:24:40 +0300
c3c1ed4f17 use GIT_REF_NAME instead of GIT_HEAD_REF justheuristic 2022-07-16 04:16:38 +0300
fe4e64be50 Merge branch 'main' of github.com:bigscience-workshop/bloom-demo into main justheuristic 2022-07-16 04:15:56 +0300
49242d8100

[WIP] Fix CI runs in master (#27) justheuristic 2022-07-16 04:06:37 +0300
aa67333a7a

Merge branch 'main' into fix-master-ci fix-master-ci justheuristic 2022-07-16 03:53:32 +0300
6476e641b3 check branch justheuristic 2022-07-16 03:52:25 +0300
01ed4db750

Fix default branch in CI (#26) justheuristic 2022-07-16 03:11:27 +0300
f4ef3e4218 check for head ref justheuristic 2022-07-16 03:00:02 +0300
f77549041a Add instructions to test the full model (#25) justheuristic 2022-07-16 02:45:10 +0300
dd4f1554c6 set default head ref justheuristic 2022-07-16 02:58:36 +0300
ccdcefe405

Add instructions to test the full model (#25) justheuristic 2022-07-16 02:45:10 +0300
6c56d326f6 add instructions to test the full model test-push justheuristic 2022-07-16 02:20:14 +0300
eb0a6be716

Clean up readme (#24) justheuristic 2022-07-16 02:11:17 +0300
646c6600b9 clean up readme facelift justheuristic 2022-07-16 02:00:49 +0300
e2711a033b

Add automated tests (#23) justheuristic 2022-07-16 01:59:23 +0300
e2f16268b1 fix yaml formatting CI justheuristic 2022-07-16 01:47:21 +0300
4a9d57d0ba fix yaml formatting justheuristic 2022-07-16 01:46:33 +0300
929d73f99c delete model before converting justheuristic 2022-07-16 01:44:52 +0300
87b6f4c0bd incorporate github ref into model name justheuristic 2022-07-16 01:20:53 +0300
8684d6402c branch name justheuristic 2022-07-16 01:15:50 +0300
def769ec9f branch name justheuristic 2022-07-16 01:14:44 +0300
699f55d3d6 check for branch name justheuristic 2022-07-16 01:09:12 +0300
28ca88330d check for branch name justheuristic 2022-07-16 01:08:03 +0300
9ef52f3421 black, isort justheuristic 2022-07-16 01:06:21 +0300
a1a89396c1 make chained test actually pass justheuristic 2022-07-16 01:05:28 +0300
d82e2b9af5 merge test_chained_forward_backward.py and test_chained_inference into one file Dmitry Baranchuk 2022-07-16 00:58:55 +0300
b1892df55e run full model test justheuristic 2022-07-16 00:47:34 +0300
9f72a2417b fix "some weights of DistributedBloomForCausalLM were not initialized from the model checkpoint at bloom-testing/test-bloomd-350m and are newly initialized: ['lm_head.word_embeddings.weight']"" justheuristic 2022-07-16 00:46:37 +0300
e3ec9d31f6 finish dataclass conversion justheuristic 2022-07-16 00:11:48 +0300
e8e56a8ca6 unuser parameter justheuristic 2022-07-16 00:07:56 +0300
29fc70981c remove debugprints (no longer flappy!) justheuristic 2022-07-15 23:59:57 +0300
f5bb75fc00 use fixed address and port for server 1 justheuristic 2022-07-15 23:55:14 +0300
68650a9aff wait less justheuristic 2022-07-15 23:01:54 +0300
4d7d092e9e check flappiness justheuristic 2022-07-15 22:53:13 +0300
b0bb08e0b9 check flappiness justheuristic 2022-07-15 22:51:35 +0300
b234b861f8 disable fail-fast justheuristic 2022-07-15 22:43:32 +0300
2c1d0cd71c try fixed port justheuristic 2022-07-15 22:42:51 +0300
69e5e4e915 debugprint justheuristic 2022-07-15 22:32:47 +0300
9283abe8cc do not import literal justheuristic 2022-07-15 22:28:18 +0300
a2016d8011 debug: extract branch id, remove kill justheuristic 2022-07-15 22:04:13 +0300
1c6291eb77 ensure localhost justheuristic 2022-07-15 21:59:19 +0300
d31f97142d more debugprints justheuristic 2022-07-15 21:58:11 +0300
bdd61b1b9c convert model justheuristic 2022-07-15 21:51:48 +0300
0164504389 Merge branch 'CI' of github.com:learning-at-home/bloom-demo into CI justheuristic 2022-07-15 21:51:15 +0300
166ad0bf68 convert model justheuristic 2022-07-15 21:47:06 +0300
2bb166322e

Remove typing.Literal (not supported in Python 3.7) Alexander Borzunov 2022-07-15 22:45:17 +0400
78e8d23387 more debugprints justheuristic 2022-07-15 21:44:08 +0300
73a79cfd30 more debugprints justheuristic 2022-07-15 21:31:08 +0300
dad8e025ac debugprint justheuristic 2022-07-15 21:28:11 +0300
69fcac5bb8 make tests pass justheuristic 2022-07-15 21:22:37 +0300
3db3769e98 export initial peers justheuristic 2022-07-15 21:05:12 +0300
5d28ae1af3 make tests run after model is converted justheuristic 2022-07-15 21:03:49 +0300
0acfc84cad run test inside CI justheuristic 2022-07-15 21:01:40 +0300
ff6e90e66a check that conversion does not break down on a second try justheuristic 2022-07-15 18:05:15 +0300
14903e76fa fix username justheuristic 2022-07-15 18:00:39 +0300
3ce609a0d5 black, isort justheuristic 2022-07-15 17:50:56 +0300
54ba92dbe3 fix imports justheuristic 2022-07-15 17:49:38 +0300
3b1873a0bf bump transformers justheuristic 2022-07-15 17:46:45 +0300
f0081edc30 re-apply black, isort justheuristic 2022-07-15 17:42:42 +0300
bdd29cf6a9

Merge branch 'main' into CI justheuristic 2022-07-15 17:42:26 +0300
6210b1a1d0 check versions justheuristic 2022-07-15 17:40:43 +0300
f5463812ad

Shallow prompt tuning (#22) Dmitry Baranchuk 2022-07-15 17:37:26 +0300
fc47b55d7a add token justheuristic 2022-07-15 17:31:05 +0300
acabd5e51f

Delete prompt_tuning_example.ipynb prompt-tuning Dmitry Baranchuk 2022-07-15 17:28:51 +0300
fbd60d89b6 convert model as a CI job justheuristic 2022-07-15 17:24:41 +0300
5cd563995d apply isort justheuristic 2022-07-15 17:16:34 +0300
56cbd088ed switch to torch 1.12 justheuristic 2022-07-15 17:16:04 +0300
1680484799 enforce black / isort justheuristic 2022-07-15 17:15:22 +0300
ea5ace246a leave only one CI job justheuristic 2022-07-15 17:14:39 +0300