langchain

Commit Graph

Author	SHA1	Message	Date
Harrison Chase	a7084ad6e4	Harrison/version 0040 (#366 )	1 year ago
mrbean	fe6695b9e7	Add HuggingFacePipeline LLM (#353 ) https://github.com/hwchase17/langchain/issues/354 Add support for running your own HF pipeline locally. This would allow you to get a lot more dynamic with what HF features and models you support since you wouldn't be beholden to what is hosted in HF hub. You could also do stuff with HF Optimum to quantize your models and stuff to get pretty fast inference even running on a laptop.	1 year ago

Author

SHA1

Message

Date

Harrison Chase

a7084ad6e4

Harrison/version 0040 (#366 )

mrbean

fe6695b9e7

Add HuggingFacePipeline LLM (#353 )

https://github.com/hwchase17/langchain/issues/354

Add support for running your own HF pipeline locally. This would allow
you to get a lot more dynamic with what HF features and models you
support since you wouldn't be beholden to what is hosted in HF hub. You
could also do stuff with HF Optimum to quantize your models and stuff to
get pretty fast inference even running on a laptop.

2 Commits (a7084ad6e447148ba49e2c04006237692eda4a50)