Commit Graph

Select branches

Hide Pull Requests

8bit-model

8bit_backward

8bit_blocks

8bit_model_inference

CI

add-sst2-example

amd-gpus

beamsearch

beat-docker-into-submission

bnb-0-41-1

bootstrap-peers

borzunov-patch-1

borzunov-patch-2

bump

cache

client

client-attempt2

client-convenience

dbaranchuk-patch-1

debug-leak

declare_adapters

deep-prompt-tuning

deep_prompt_inference

demo-1

diff

diff-compression

distributed-deep-ptune

download_8bit_weights

efficient-forward-backward

empty-weights

enable-rebalancing

examples_fix_hivemind

extract-module-container

facelift

fault-tolerant-inference

fix-auth-token

fix-branch-name

fix-cache

fix-ci

fix-convert-8bit

fix-distr-seq-cls

fix-docker

fix-inference-retry

fix-joining-announce

fix-master-ci

fix-nf4-and-dtypes

fix-pb2

fix-protobuf

fix-ptune

fix-readme

fix-rebalancing-issues

fix-requirements

fix-seq-backward-recovery

fix-too-many-open-files

fix3

forward-backward-timeouts

forward_backward

forward_kwargs

friendly-timeout-errors

generation

generation-inference

get_sequence

hivemind-1.1.4

hivemind-dht-fork-process

hotfix_bnb

inference_chain

instruction-readability-style

investigate-segfault

justheuristic-patch-1

justheuristic-patch-2

justheuristic-patch-3

justheuristic-patch-4

justheuristic-patch-5

lm_head

load-balancing

lora_from_hub

lru

main

main_fix

measure-throughput

measurements

memory_savings

mockup

multiple-experts

no-cpufeature

no_qkv_merge

optimize_seq

partial_rollback

payload-size

peft_update

petals-readme-title

pip-installable

pip-installable-v2

priority-tasks

processing_attention

prompt-inference

prompt-tuning

ptune-example-personachat

ptune-wip

pytest-verbose

qkv_merge

readme-clarifications

readme-release

remove-remote-block

rename-test-model

repetition-penalty

rpc

rtfd

sequence

server-dtypes

server-increase-startup-timeout

server-logging

server-timeouts

standardize

support-backend-dtypes

test-push

test_main

test_opt_serving

upd-deps

update-bullet-points

update-hivemind

update-model

update-readme-disclaimers-faq

update-readme-pics

update_example_1

vectorized_beam_search

versions

warn-about-6b-instructions

wip_triton

yozh-dev-branch

#100

#101

#102

#103

#104

#105

#106

#107

#108

#109

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#120

#121

#122

#123

#124

#125

#126

#127

#128

#129

#130

#131

#132

#133

#134

#135

#136

#137

#138

#139

#140

#141

#142

#143

#144

#145

#148

#149

#150

#151

#152

#153

#154

#155

#156

#157

#159

#160

#161

#162

#163

#165

#166

#168

#169

#17

#170

#171

#172

#173

#175

#176

#177

#179

#18

#180

#181

#182

#183

#184

#185

#186

#187

#188

#189

#19

#190

#191

#194

#195

#196

#197

#198

#199

#20

#200

#204

#205

#206

#209

#21

#210

#211

#212

#213

#214

#215

#217

#218

#219

#22

#221

#224

#225

#227

#229

#23

#230

#231

#232

#234

#235

#24

#243

#244

#245

#247

#248

#249

#25

#251

#252

#253

#257

#259

#26

#260

#263

#264

#265

#266

#267

#27

#273

#273

#275

#276

#277

#278

#28

#284

#285

#286

#287

#29

#290

#292

#297

#298

#299

#30

#300

#301

#302

#304

#305

#306

#307

#309

#31

#310

#311

#312

#313

#314

#315

#316

#319

#32

#323

#324

#325

#329

#33

#330

#331

#332

#333

#334

#335

#336

#337

#339

#34

#340

#341

#342

#343

#344

#345

#346

#348

#349

#35

#350

#351

#352

#353

#354

#355

#356

#357

#358

#36

#360

#362

#364

#365

#369

#37

#370

#371

#373

#374

#377

#378

#379

#38

#380

#383

#384

#385

#39

#390

#391

#392

#393

#396

#397

#399

#40

#402

#403

#404

#406

#407

#409

#41

#410

#411

#418

#42

#422

#423

#424

#428

#43

#430

#431

#434

#435

#436

#437

#438

#438

#44

#440

#441

#442

#443

#445

#448

#45

#451

#452

#454

#456

#458

#459

#46

#461

#462

#463

#464

#467

#467

#47

#470

#471

#472

#473

#474

#475

#476

#477

#478

#479

#48

#480

#482

#484

#485

#486

#487

#489

#49

#490

#491

#493

#493

#496

#497

#498

#498

#499

#50

#500

#501

#502

#504

#505

#505

#506

#506

#510

#513

#516

#517

#52

#520

#523

#523

#525

#53

#530

#531

#535

#537

#538

#539

#54

#543

#544

#544

#545

#545

#547

#547

#55

#552

#553

#554

#555

#555

#557

#557

#558

#559

#560

#560

#563

#567

#57

#570

#572

#574

#577

#579

#58

#580

#59

#60

#61

#62

#63

#64

#65

#66

#69

#70

#71

#72

#73

#74

#75

#76

#77

#80

#81

#82

#83

#84

#85

#86

#87

#88

#89

#9

#90

#91

#92

#93

#94

#95

#96

#97

#98

#99

v1.0.0

v1.1.0

v1.1.1

v1.1.2

v1.1.3

v1.1.4

v1.1.5

v2.0.0.post1

v2.0.0.post2

v2.0.0.post3

v2.0.1

v2.0.1.post1

v2.0.1.post2

v2.1.0

v2.2.0

Mono Color

• 7fdbc84b95 issue #389 mitigation Danny Boy 2023-09-01 00:15:08 +0900
• f6be1f7ec2 Merge branch 'main' of https://github.com/bigscience-workshop/petals into danO Danny Boy 2023-09-01 00:11:42 +0900
• 6ef6bf5fa2
  Create model index in DHT (#491) Alexander Borzunov 2023-08-31 10:31:03 +0400
• 2a9e134ed2 Create model index in DHT Aleksandr Borzunov 2023-08-31 06:10:55 +0000
• c17b2fbcaf
  [don't merge] Test with hivemind@dht-fork-process branch hivemind-dht-fork-process Alexander Borzunov 2023-08-31 09:08:06 +0400
• 6bb3f54e39
  Replace dots in repo names when building DHT prefixes (#489) Alexander Borzunov 2023-08-30 23:31:39 +0400
• cf1ce6d158 Replace dots in repo names when building DHT prefixes Aleksandr Borzunov 2023-08-30 18:33:40 +0000
• 02fc71eb25
  Fix race condition in MemoryCache (#487) Alexander Borzunov 2023-08-30 14:13:43 +0400
• 15314cb40a Fix race condition in MemoryCache Aleksandr Borzunov 2023-08-30 09:38:01 +0000
• dc0072fde1
  Wait for DHT storing state OFFLINE on shutdown (#486) Alexander Borzunov 2023-08-30 07:48:11 +0400
• 9e7cc17faf Wait for DHT storing state OFFLINE on shutdown Aleksandr Borzunov 2023-08-30 03:08:08 +0000
• a26559ff65
  Fix `.generate(input_ids=...)` (#485) Alexander Borzunov 2023-08-30 06:59:33 +0400
• 4ed2d0bffb Fix test Aleksandr Borzunov 2023-08-30 02:48:27 +0000
• 06accbcf40 Remove inputs_embeds support Aleksandr Borzunov 2023-08-30 02:47:10 +0000
• 7fe2635ee6 Fix test Aleksandr Borzunov 2023-08-30 02:38:52 +0000
• 13e61a7921 black Aleksandr Borzunov 2023-08-30 02:37:18 +0000
• 68ff865660 Fix flapping test Aleksandr Borzunov 2023-08-30 02:36:51 +0000
• b3136becf2 Fix .generate(input_ids=...) and .generate(inputs_embeds=...) Aleksandr Borzunov 2023-08-30 02:35:36 +0000
• 459933f846
  Remove no-op process in PrioritizedTaskPool (#484) Alexander Borzunov 2023-08-30 06:07:04 +0400
• 5afaf6446c Remove no-op process in PrioritizedTaskPool Aleksandr Borzunov 2023-08-30 00:30:15 +0000
• 9027270240 Merge branch 'main' of https://github.com/bigscience-workshop/petals into danO Danny Boy 2023-08-29 15:59:57 +0900
• 26ebbfe8f0
  Support macOS (#477) Alexander Borzunov 2023-08-29 07:49:27 +0400
• 7bdf6e80c1 Skip flapping test_priority_pools() on macOS Aleksandr Borzunov 2023-08-29 03:29:49 +0000
• 1f10d7ba80 Shut down runtime, remove sleep Aleksandr Borzunov 2023-08-29 01:07:53 +0000
• ef5df2b24f
  Update README.md Alexander Borzunov 2023-08-29 00:52:39 +0400
• 69d5665acf test_priority_pools: Add time.sleep(1) Aleksandr Borzunov 2023-08-28 20:45:45 +0000
• 44a8b586b5 test_priority_pools: Add runtime_ready.wait() Aleksandr Borzunov 2023-08-28 19:29:32 +0000
• 20a9b20871 Add Python 3.11 category to setup.cfg Aleksandr Borzunov 2023-08-28 19:20:00 +0000
• 4534c6ed1f Fill most MPS memory with blocks by default Aleksandr Borzunov 2023-08-28 19:05:02 +0000
• b79c357d5d torch.set_num_threads(1) in run_server.py if OpenMP not available Aleksandr Borzunov 2023-08-28 17:51:17 +0000
• 490f42cdf2 OMP_NUM_THREADS -> torch.set_num_threads() on server Aleksandr Borzunov 2023-08-28 17:04:34 +0000
• 7e30377ba2 Don't use 2>&1 Aleksandr Borzunov 2023-08-28 16:54:18 +0000
• 8dbe5341db increase_file_limit() by default Aleksandr Borzunov 2023-08-28 16:30:03 +0000
• d55bae37d9
  Update README.md Alexander Borzunov 2023-08-28 19:17:52 +0400
• 6a1c230d7b
  Merge branch 'main' into macos-support Alexander Borzunov 2023-08-28 19:09:26 +0400
• 75e516a8c1
  Refactor readme (#482) Alexander Borzunov 2023-08-28 19:09:13 +0400
• 2781da87e4 test_cache_usage(): Use mp.context.ForkProcess Aleksandr Borzunov 2023-08-28 15:06:51 +0000
• d4db258ba5
  Merge branch 'main' into macos-support Alexander Borzunov 2023-08-28 18:47:46 +0400
• 80d5984d54
  Merge branch 'main' into borzunov-patch-3 Alexander Borzunov 2023-08-28 18:45:39 +0400
• ea76451c65
  Update README.md Alexander Borzunov 2023-08-28 18:44:32 +0400
• 5fa5b8ba1b
  Update README.md Alexander Borzunov 2023-08-28 18:41:05 +0400
• bd5dc45248
  Update README.md Alexander Borzunov 2023-08-28 18:40:25 +0400
• 6099db0caf
  Update README.md Alexander Borzunov 2023-08-28 18:35:26 +0400
• c08d09c4d3
  Rewrite MemoryCache alloc_timeout logic (#434) justheuristic 2023-08-28 16:01:50 +0300
• 58e0166c0e black Your Name 2023-08-28 06:51:59 +0300
• 4caae8f8b9 review Aleksandr Borzunov 2023-08-28 06:49:41 +0300
• 79245587fe rollback Your Name 2023-08-28 06:15:00 +0300
• 49ff759d30 undo Your Name 2023-08-28 06:03:59 +0300
• 84ebd57105 WIP, switching to another PR Your Name 2023-08-28 06:03:33 +0300
• 7f118e8547
  Update src/petals/server/memory_cache.py justheuristic 2023-08-28 05:51:18 +0300
• 0cf174b410
  Update README.md Alexander Borzunov 2023-08-28 06:41:32 +0400
• 90973079ad
  Update README.md Alexander Borzunov 2023-08-28 06:29:40 +0400
• e9e0e63370
  Update README.md Alexander Borzunov 2023-08-28 06:21:00 +0400
• 83bd9c7be6
  Update README.md Alexander Borzunov 2023-08-28 06:19:32 +0400
• 1e2e4d49e8
  Update README.md Alexander Borzunov 2023-08-28 06:18:15 +0400
• c43da9682c
  Update README.md Alexander Borzunov 2023-08-28 06:17:37 +0400
• b93d6d059c
  Update README.md Alexander Borzunov 2023-08-28 06:15:52 +0400
• 076050a1bf
  Refactor readme Alexander Borzunov 2023-08-28 06:14:52 +0400
• 07312e334f
  Refactor readme Alexander Borzunov 2023-08-28 05:34:38 +0400
• 6932c96526 Create Runtime after ConnectionHandlers Aleksandr Borzunov 2023-08-28 00:39:45 +0000
• e7019e6f51 Try fixing test_priority_pools() Aleksandr Borzunov 2023-08-27 23:37:54 +0000
• 8a6d264a2e Check for unsupported types on CPU and MPS Aleksandr Borzunov 2023-08-27 23:33:55 +0000
• 08d0a2c8e7 _choose_num_blocks() for MPS Aleksandr Borzunov 2023-08-27 23:22:53 +0000
• fd4d1ee8b7 Set OMP_NUM_THREADS=1 Aleksandr Borzunov 2023-08-27 22:39:20 +0000
• 37153699fd Hide "Reachability service started" message Aleksandr Borzunov 2023-08-27 22:39:06 +0000
• 5177079239 Fix calling torch.mps.synchronize() Aleksandr Borzunov 2023-08-27 20:56:24 +0000
• 9f3671114e import torch.mps Aleksandr Borzunov 2023-08-27 20:54:48 +0000
• 85c0f521a9 Merge branch 'main' of https://github.com/bigscience-workshop/petals into danO Danny Boy 2023-08-27 18:57:50 +0900
• 80828e612d Use hivemind@master Aleksandr Borzunov 2023-08-27 02:17:50 +0000
• 2d0634d8ae Set env vars for pytest.mark.forked Aleksandr Borzunov 2023-08-26 23:57:06 +0000
• 0a034e355d Always set env vars on macOS Aleksandr Borzunov 2023-08-26 23:48:05 +0000
• 2fa0e68e8e Add basic support for device.type == "mps" Aleksandr Borzunov 2023-08-26 23:40:23 +0000
• 92287b24a3
  Merge branch 'main' into macos-support Alexander Borzunov 2023-08-27 03:33:40 +0400
• e4fcad87b3 Try removing magic env vars Aleksandr Borzunov 2023-08-26 23:32:54 +0000
• 180e65b34b Test Python 3.10, 3.11 on macOS Aleksandr Borzunov 2023-08-26 23:32:37 +0000
• 9809b0ad37
  Merge branch 'main' into memcache_touchup Alexander Borzunov 2023-08-26 05:37:02 +0400
• 6910c532e0
  Update src/petals/server/handler.py Alexander Borzunov 2023-08-26 05:34:05 +0400
• 90840dfea2
  Fix requiring transformers>=4.32.0 (#480) Alexander Borzunov 2023-08-26 05:32:16 +0400
• c46d53f275
  Require transformers>=4.32.0 (2) Alexander Borzunov 2023-08-25 21:18:38 +0400
• 09e9da6eb1 serialize outputs structure Your Name 2023-08-25 17:36:47 +0300
• 6d62057f08
  Merge branch 'main' into memcache_touchup justheuristic 2023-08-25 17:31:23 +0300
• 6e35731397 extra test Your Name 2023-08-25 17:25:54 +0300
• de6b00e4f2 extra test Aleksandr Borzunov 2023-08-25 17:25:45 +0300
• 5b26ba198e
  Update src/petals/server/memory_cache.py justheuristic 2023-08-25 17:18:24 +0300
• ecedd5e8c2
  Update src/petals/server/handler.py justheuristic 2023-08-25 17:18:05 +0300
• 176f5b8675 Show stderr Aleksandr Borzunov 2023-08-24 22:47:12 +0000
• fff784f7cc
  Merge branch 'main' into macos-support Alexander Borzunov 2023-08-25 01:59:26 +0400
• 364966eb4e Update run-tests.yaml Aleksandr Borzunov 2023-08-24 21:41:52 +0000
• 7d51966e0b Use hivemind@macos-binary branch Aleksandr Borzunov 2023-08-24 21:39:23 +0000
• 915b357740
  Require transformers>=4.32.0 (#479) Alexander Borzunov 2023-08-25 01:37:30 +0400
• 95c239b8ed
  Update __init__.py Alexander Borzunov 2023-08-25 01:16:30 +0400
• 559ace33e8
  Require transformers>=4.32.0 Alexander Borzunov 2023-08-25 01:16:08 +0400
• 6c8838a997
  Update src/petals/server/memory_cache.py justheuristic 2023-08-24 22:44:25 +0300
• 94a1e0a05d
  Update src/petals/server/memory_cache.py justheuristic 2023-08-24 22:44:04 +0300
• b227825b41 pytest: Don't capture outputs Aleksandr Borzunov 2023-08-24 19:07:50 +0000
• 18e93afc73
  Don't install cpufeature on non-x86_64 machines (#478) v2.1.0 Alexander Borzunov 2023-08-24 19:57:15 +0400
• 8fe451fbb5
  Don't install cpufeature on non-x86_64 machines Alexander Borzunov 2023-08-24 19:44:38 +0400
• 6967904590
  Bump version to 2.1.0 (#474) Alexander Borzunov 2023-08-24 19:42:19 +0400
• a076ff6046
  Merge branch 'main' into bump-2-1-0 Alexander Borzunov 2023-08-24 19:08:42 +0400
• 22bcbb34fd
  Merge branch 'main' into forward_kwargs justheuristic 2023-08-24 15:53:27 +0300