Archives
/
petals
mirror of https://github.com/bigscience-workshop/petals
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
pull/482/head
Alexander Borzunov 9 months ago committed by GitHub
parent b93d6d059c
commit c43da9682c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 1 deletions
Show Stats Download Patch File Download Diff File

4
README.md
Unescape Escape View File

@ -41,7 +41,9 @@ print(tokenizer.decode(outputs[0])) # A cat sat on a mat...
## Connect your GPU and increase Petals capacity
Petals is a community-run system — we rely on people sharing their GPUs. You can check out available models on our [swarm monitor](https://health.petals.dev) and connect your GPU to help serving one of them! As an example, we show how to host a part of [Stable Beluga 2](https://huggingface.co/stabilityai/StableBeluga2) below:
Petals is a community-run system — we rely on people sharing their GPUs. You can check out available models on our [swarm monitor](https://health.petals.dev) and connect your GPU to help serving one of them!
As an example, here is how you can host a part of [Stable Beluga 2](https://huggingface.co/stabilityai/StableBeluga2) on your GPU:
🐧 **Linux + Anaconda.** Run these commands for NVIDIA GPUs (or follow [this](https://github.com/bigscience-workshop/petals/wiki/Running-on-AMD-GPU) for AMD):

Write Preview
Loading…
Cancel
Save