Commit Graph

1 Commits (10fab97e2b70c9a9abcd32aa1b711625dc48ef5e)

Author SHA1 Message Date
Artem Chumachenko b9f0a5467f
Support peft LoRA adapters (#335)
Implement an option to deploy PEFT adapters to a server. Clients can set active_adapter=... to use these adapters.

---------

Co-authored-by: Aleksandr Borzunov <borzunov.alexander@gmail.com>
Co-authored-by: justheuristic <justheuristic@gmail.com>
1 year ago