mirror of https://github.com/hwchase17/langchain
fix(petals) allows to run models that aren't Bloom (Support for LLama and newer models) (#8356)
In this PR: - Removed restricted model loading logic for Petals-Bloom - Removed petals imports (DistributedBloomForCausalLM, BloomTokenizerFast) - Instead imported more generalized versions of loader (AutoDistributedModelForCausalLM, AutoTokenizer) - Updated the Petals example notebook to allow for a successful installation of Petals in Apple Silicon Macs - Tag maintainer: @hwchase17, @baskaryan --------- Co-authored-by: Bagatur <baskaryan@gmail.com>pull/8395/head
parent
e758e9e7f5
commit
a003a0baf6
Loading…
Reference in New Issue