Commit Graph

Select branches

Hide Pull Requests

8bit-model

8bit_backward

8bit_blocks

8bit_model_inference

CI

add-sst2-example

amd-gpus

beamsearch

beat-docker-into-submission

bnb-0-41-1

bootstrap-peers

borzunov-patch-1

borzunov-patch-2

bump

cache

client

client-attempt2

client-convenience

dbaranchuk-patch-1

debug-leak

declare_adapters

deep-prompt-tuning

deep_prompt_inference

demo-1

diff

diff-compression

distributed-deep-ptune

download_8bit_weights

efficient-forward-backward

empty-weights

enable-rebalancing

examples_fix_hivemind

extract-module-container

facelift

fault-tolerant-inference

fix-auth-token

fix-branch-name

fix-cache

fix-ci

fix-convert-8bit

fix-distr-seq-cls

fix-docker

fix-inference-retry

fix-joining-announce

fix-master-ci

fix-nf4-and-dtypes

fix-pb2

fix-protobuf

fix-ptune

fix-readme

fix-rebalancing-issues

fix-requirements

fix-seq-backward-recovery

fix-too-many-open-files

fix3

forward-backward-timeouts

forward_backward

forward_kwargs

friendly-timeout-errors

generation

generation-inference

get_sequence

hivemind-1.1.4

hivemind-dht-fork-process

hotfix_bnb

inference_chain

instruction-readability-style

investigate-segfault

justheuristic-patch-1

justheuristic-patch-2

justheuristic-patch-3

justheuristic-patch-4

justheuristic-patch-5

lm_head

load-balancing

lora_from_hub

lru

main

main_fix

measure-throughput

measurements

memory_savings

mockup

multiple-experts

no-cpufeature

no_qkv_merge

optimize_seq

partial_rollback

payload-size

peft_update

petals-readme-title

pip-installable

pip-installable-v2

priority-tasks

processing_attention

prompt-inference

prompt-tuning

ptune-example-personachat

ptune-wip

pytest-verbose

qkv_merge

readme-clarifications

readme-release

remove-remote-block

rename-test-model

repetition-penalty

rpc

rtfd

sequence

server-dtypes

server-increase-startup-timeout

server-logging

server-timeouts

standardize

support-backend-dtypes

test-push

test_main

test_opt_serving

upd-deps

update-bullet-points

update-hivemind

update-model

update-readme-disclaimers-faq

update-readme-pics

update_example_1

vectorized_beam_search

versions

warn-about-6b-instructions

wip_triton

yozh-dev-branch

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#120

#121

#122

#123

#124

#125

#126

#127

#128

#129

#130

#131

#132

#133

#134

#135

#136

#137

#138

#139

#140

#141

#142

#143

#144

#145

#148

#149

#150

#151

#152

#153

#154

#155

#156

#157

#159

#160

#161

#162

#163

#165

#166

#168

#169

#17

#170

#171

#172

#173

#175

#176

#177

#179

#18

#180

#181

#182

#183

#184

#185

#186

#187

#188

#189

#19

#190

#191

#194

#195

#196

#197

#198

#199

#20

#200

#204

#205

#206

#209

#21

#210

#211

#212

#213

#214

#215

#217

#218

#219

#22

#221

#224

#225

#227

#229

#23

#230

#231

#232

#234

#235

#24

#243

#244

#245

#247

#248

#249

#25

#251

#252

#253

#257

#259

#26

#260

#263

#264

#265

#266

#267

#27

#273

#273

#275

#276

#277

#278

#28

#284

#285

#286

#287

#29

#290

#292

#297

#298

#299

#30

#300

#301

#302

#304

#305

#306

#307

#309

#31

#310

#311

#312

#313

#314

#315

#316

#319

#32

#323

#324

#325

#329

#33

#330

#331

#332

#333

#334

#335

#336

#337

#339

#34

#340

#341

#342

#343

#344

#345

#346

#348

#349

#35

#350

#351

#352

#353

#354

#355

#356

#357

#358

#36

#360

#362

#364

#365

#369

#37

#370

#371

#373

#374

#377

#378

#379

#38

#380

#383

#384

#385

#39

#390

#391

#392

#393

#396

#397

#399

#40

#402

#403

#404

#406

#407

#409

#41

#410

#411

#418

#42

#422

#423

#424

#428

#43

#430

#431

#434

#435

#436

#437

#438

#438

#44

#440

#441

#442

#443

#445

#448

#45

#451

#452

#454

#456

#458

#459

#46

#461

#462

#463

#464

#467

#467

#47

#470

#471

#472

#473

#474

#475

#476

#477

#478

#479

#48

#480

#482

#484

#485

#486

#487

#489

#49

#490

#491

#493

#493

#496

#497

#498

#498

#499

#50

#500

#501

#502

#504

#505

#505

#506

#506

#510

#513

#516

#517

#52

#520

#523

#523

#525

#53

#530

#531

#535

#537

#538

#539

#54

#543

#544

#544

#545

#545

#547

#547

#55

#552

#553

#554

#555

#555

#557

#557

#558

#559

#560

#560

#563

#567

#57

#570

#572

#574

#577

#579

#58

#580

#59

#60

#61

#62

#63

#64

#65

#66

#69

#70

#71

#72

#73

#74

#75

#76

#77

#80

#81

#82

#83

#84

#85

#86

#87

#88

#89

#9

#90

#91

#92

#93

#94

#95

#96

#97

#98

#99

v1.0.0

v1.1.0

v1.1.1

v1.1.2

v1.1.3

v1.1.4

v1.1.5

v2.0.0.post1

v2.0.0.post2

v2.0.0.post3

v2.0.1

v2.0.1.post1

v2.0.1.post2

v2.1.0

v2.2.0

Mono Color

• c243ba8251
  Update README.md petals-readme-title Alexander Borzunov 2022-08-02 17:11:20 +0400
• 443b2c0261 add pseudo efficient inference: debug dbaranchuk 2022-08-01 00:50:50 +0300
• 564f6edb07 set throughput=1.0 to fix zero throughput problem dbaranchuk 2022-07-31 06:17:48 +0300
• 8b3d66167f set throughput=1 to fix 0 throughput problem dbaranchuk 2022-07-31 06:13:59 +0300
• 123e57a5fc update initial peer dbaranchuk 2022-07-31 04:29:39 +0300
• 2aa236a88e fix typos dbaranchuk 2022-07-31 04:28:38 +0300
• 1ea397a88b black dbaranchuk 2022-07-31 04:00:24 +0300
• fced9a8f30 fix typo dbaranchuk 2022-07-31 03:54:19 +0300
• 805e71a35b update demo deploy scripts dbaranchuk 2022-07-31 03:53:07 +0300
• 66ce6d9669 make it compatible with low_cpu_mem_usage=True dbaranchuk 2022-07-31 03:52:02 +0300
• afc1de2627 add script for remote benchmarks dbaranchuk 2022-07-31 01:02:43 +0300
• ffeceebd4b Fix bug with model duplication in RAM dbaranchuk 2022-07-30 02:50:07 +0300
• 02619d307d black & isort dbaranchuk 2022-07-29 01:04:03 +0300
• a621549c06 integrate mixed-8bit model dbaranchuk 2022-07-29 01:01:05 +0300
• 04a2b6f5e3
  Support various backend dtypes & async serialization (#38) Dmitry Baranchuk 2022-07-28 18:33:58 +0300
• 1bca7f37ef rm occasional comment support-backend-dtypes dbaranchuk 2022-07-28 18:10:09 +0300
• 7d5348b10b refactoring dbaranchuk 2022-07-28 17:52:46 +0300
• 04117d5b44 rm redundant imports dbaranchuk 2022-07-28 17:52:13 +0300
• 5c17ef3d66 rm redundant imports dbaranchuk 2022-07-28 17:48:55 +0300
• 648a5d6e1d fix autograd backward & black & isort dbaranchuk 2022-07-28 17:46:31 +0300
• 0e8b7490f7 revert changes dbaranchuk 2022-07-28 05:59:05 +0300
• e8f84e7747 revert changes dbaranchuk 2022-07-28 05:57:34 +0300
• 682c6711df revert changes dbaranchuk 2022-07-28 05:56:30 +0300
• 3151c1d48d Merge branch 'support-backend-dtypes' of github.com:learning-at-home/bloom-demo into support-backend-dtypes dbaranchuk 2022-07-28 05:52:55 +0300
• bfeddb5463 revert changes dbaranchuk 2022-07-28 05:52:42 +0300
• c6c064abc4
  Delete ptune_v2_model.py Dmitry Baranchuk 2022-07-28 05:44:06 +0300
• acdd95ff0b
  Delete shallow_prompt_tuning_sst2.ipynb Dmitry Baranchuk 2022-07-28 05:43:47 +0300
• 364ecfbb29
  Delete shallow_prompt_tuning_cola.ipynb Dmitry Baranchuk 2022-07-28 05:43:41 +0300
• 36e3da4e80
  Delete deep_prompt_tuning_sst2.ipynb Dmitry Baranchuk 2022-07-28 05:43:33 +0300
• 0e6e4ae192
  Delete deep_prompt_tuning_cola.ipynb Dmitry Baranchuk 2022-07-28 05:43:26 +0300
• 6898f7bfa8
  Delete requirements-notebook.txt Dmitry Baranchuk 2022-07-28 05:43:10 +0300
• 2d2ad31e5f update the hivemind version that support bfloat16 dbaranchuk 2022-07-28 04:19:17 +0300
• c23034a468 async serialization & cast to the scheme dtype dbaranchuk 2022-07-28 04:04:38 +0300
• beacf25c5c cast incoming tensors to backend dtype dbaranchuk 2022-07-28 04:01:54 +0300
• e8114fbef2 Merge remote-tracking branch 'origin/main' into support-backend-dtypes dbaranchuk 2022-07-28 03:54:34 +0300
• d989b94614
  Pack of Inference Changes (#37) Artem Chumachenko 2022-07-27 10:19:45 +0400
• b7e6a4f12e fixes Artem Chumachenko 2022-07-27 05:58:52 +0000
• 5b06dc2255 renaming deep-prompt-tuning dbaranchuk 2022-07-27 05:44:50 +0300
• 1477bdc471 add preliminary notebooks dbaranchuk 2022-07-26 19:10:33 +0300
• c6e26864da add requirements for notebooks dbaranchuk 2022-07-26 19:06:48 +0300
• cf4acd007e add p-tuning v2 only for _non-distributed_ case dbaranchuk 2022-07-26 19:03:19 +0300
• 81422fdfc2 add deep p-tuning only for _non-distributed_ case dbaranchuk 2022-07-26 19:02:39 +0300
• f005d0a287 WIP mockup justheuristic 2022-07-26 18:52:57 +0300
• 81ea014bf5 WIP justheuristic 2022-07-26 18:47:34 +0300
• 9123ce57ac Add tests Artem Chumachenko 2022-07-24 09:32:35 +0000
• f10b05f912 Return multibatch mode Artem Chumachenko 2022-07-24 06:24:40 +0000
• 6573076883
  Sequential and parallel forward / backward (#36) Dmitry Baranchuk 2022-07-23 14:32:39 +0300
• d94008311d add todo & black efficient-forward-backward dbaranchuk 2022-07-23 14:00:51 +0300
• a2d020afcd rename functions & add descriptions dbaranchuk 2022-07-23 13:57:15 +0300
• d9d73cb0da isort dbaranchuk 2022-07-23 03:05:11 +0300
• 3dfa95636e address comments & black & isort dbaranchuk 2022-07-23 03:02:46 +0300
• c925f4d45b black & isort dbaranchuk 2022-07-23 02:50:15 +0300
• 44e33f9ea6 Merge branch 'efficient-forward-backward' of github.com:learning-at-home/bloom-demo into efficient-forward-backward dbaranchuk 2022-07-23 02:45:53 +0300
• 180d91bc7a remove redundant imports dbaranchuk 2022-07-23 02:43:51 +0300
• ba9f3aec16
  Delete async_forward_backward.py Dmitry Baranchuk 2022-07-23 02:40:44 +0300
• d1abb2f169 address the comments dbaranchuk 2022-07-23 02:39:17 +0300
• ed86b36911 address the comments dbaranchuk 2022-07-23 02:34:27 +0300
• b60eedc8ad Merge remote-tracking branch 'origin/main' into efficient-forward-backward dbaranchuk 2022-07-23 02:17:46 +0300
• f0cffbf67e
  Miscellaneous fixes to automatic tests (#35) justheuristic 2022-07-22 22:38:40 +0300
• abd3da6f3a
  Update .github/workflows/run-tests.yaml fix-branch-name Dmitry Baranchuk 2022-07-22 22:26:53 +0300
• 84532ee5f9 revert debug changes justheuristic 2022-07-22 22:21:47 +0300
• dc277b34da minimize peak CPU memory usage justheuristic 2022-07-22 22:15:57 +0300
• 3cc4e0b9f0 update server deployment scripts dbaranchuk 2022-07-22 21:53:49 +0300
• f976191551 efficient forward & backward dbaranchuk 2022-07-22 21:50:13 +0300
• 996104abeb [WIP] disable conversion justheuristic 2022-07-22 21:49:24 +0300
• 3f048e5016 undo half justheuristic 2022-07-22 21:45:02 +0300
• 05fed964a3 remove torch_dtype on converted model justheuristic 2022-07-22 21:42:16 +0300
• dfe57ebf9a set dtype='auto' justheuristic 2022-07-22 21:30:21 +0300
• aee295f0db
  de-flappify: give servers more time to download the model justheuristic 2022-07-22 21:02:31 +0300
• 6583763ed9
  remove debugprint justheuristic 2022-07-22 20:37:18 +0300
• 375f5adc8f
  [WIP] justheuristic 2022-07-22 20:32:58 +0300
• 39dd3d990e
  wait for the first server to initialize DHT justheuristic 2022-07-22 20:25:11 +0300
• c322865dc3
  Fix branch name in CI justheuristic 2022-07-22 20:20:14 +0300
• 5a4ac2fa71 change tag name justheuristic 2022-07-22 20:17:53 +0300
• e1454e4448 make tests pass for now justheuristic 2022-07-22 05:19:17 +0300
• a87be914f3 make tests pass for now justheuristic 2022-07-22 05:14:00 +0300
• 32dc9649ca routing strategy interface justheuristic 2022-07-22 05:00:23 +0300
• 6af1572a43 update imports justheuristic 2022-07-22 04:50:17 +0300
• f31f3eb3af update imports justheuristic 2022-07-22 04:49:57 +0300
• ab732886e3 update imports justheuristic 2022-07-22 04:49:40 +0300
• 3f4cbdd1d0 List -> Sequence justheuristic 2022-07-22 04:49:30 +0300
• ab2fc03f30 decouple tests justheuristic 2022-07-22 04:46:33 +0300
• c7eda494bf WIP justheuristic 2022-07-22 02:28:13 +0300
• 7de3acf909
  Fix is_subsequence (#32) Dmitry Baranchuk 2022-07-19 22:37:19 +0300
• 1f6c02903e
  fix is_subsequence dbaranchuk-patch-1 Dmitry Baranchuk 2022-07-19 22:26:26 +0300
• f0c7383181
  Implement RemoteSequential slicing and extra repr, add tests (#30) justheuristic 2022-07-19 04:28:04 +0300
• b02d09dd31 use conftest to clean up child processes get_sequence justheuristic 2022-07-19 03:58:58 +0300
• 57a3a065a9 run each test in a forked process justheuristic 2022-07-19 03:50:49 +0300
• 31163a95f8 black-isort justheuristic 2022-07-19 03:40:23 +0300
• 25a4b23640 unify environment variable names in all tests justheuristic 2022-07-19 03:40:07 +0300
• b737a60be4 run all ./tests automatically (instead of calling each one manually) justheuristic 2022-07-19 03:36:58 +0300
• 52238e8e5c black-isort justheuristic 2022-07-19 03:21:40 +0300
• c597f4d520 make a test for remote sequential with grads justheuristic 2022-07-19 03:21:25 +0300
• dd4e792937 print minimalistic remote server info Tim Dettmers 2022-07-19 02:54:49 +0300
• ec20fa6ec5 black/isort justheuristic 2022-07-19 02:49:58 +0300
• 1b314f64db refactor: extract both inference sessions into a dedicated file (rationale: otherwise, their original files become hard to read) justheuristic 2022-07-19 02:48:47 +0300
• 93bc211ec6 rm unused imports justheuristic 2022-07-19 02:41:39 +0300
• d99ca3f383 prepare for merge justheuristic 2022-07-19 02:33:19 +0300
• d7742cfca7 fix undefined variable justheuristic 2022-07-19 02:32:27 +0300
• 653a85e6a2 fix decorator; avoid loading model and ref_model at the same time justheuristic 2022-07-19 02:31:32 +0300