mirror of https://github.com/hwchase17/langchain
Add 'download_dir' argument to VLLM (#9754)
- Description: Add a 'download_dir' argument to VLLM model (to change the cache download directotu when retrieving a model from HF hub) - Issue: On some remote machine, I want the cache dir to be in a volume where I have space (models are heavy nowadays). Sometimes the default HF cache dir might not be what we want. - Dependencies: None --------- Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>pull/10194/head
parent
8bba69ffd0
commit
bb8c095127
Loading…
Reference in New Issue