mirror of
https://github.com/hwchase17/langchain
synced 2024-11-18 09:25:54 +00:00
langchain_community: Update documentation for installing llama-cpp-python on windows (#16666)
**Description** : This PR updates the documentation for installing llama-cpp-python on Windows. - Updates install command to support pyproject.toml - Makes CPU/GPU install instructions clearer - Adds reinstall with GPU support command **Issue**: Existing [documentation](https://python.langchain.com/docs/integrations/llms/llamacpp#compiling-and-installing) lists the following commands for installing llama-cpp-python ``` python setup.py clean python setup.py install ```` The current version of the repo does not include a `setup.py` and uses a `pyproject.toml` instead. This can be replaced with ``` python -m pip install -e . ``` As explained in https://github.com/abetlen/llama-cpp-python/issues/965#issuecomment-1837268339 **Dependencies**: None **Twitter handle**: None --------- Co-authored-by: blacksmithop <angstycoder101@gmaii.com>
This commit is contained in:
parent
d3d9244fee
commit
8e44363ec9
@ -144,24 +144,40 @@
|
|||||||
"git clone --recursive -j8 https://github.com/abetlen/llama-cpp-python.git\n",
|
"git clone --recursive -j8 https://github.com/abetlen/llama-cpp-python.git\n",
|
||||||
"```\n",
|
"```\n",
|
||||||
"\n",
|
"\n",
|
||||||
"2. Open up command Prompt (or anaconda prompt if you have it installed), set up environment variables to install. Follow this if you do not have a GPU, you must set both of the following variables.\n",
|
"2. Open up a command Prompt and set the following environment variables.\n",
|
||||||
|
"\n",
|
||||||
"\n",
|
"\n",
|
||||||
"```\n",
|
"```\n",
|
||||||
"set FORCE_CMAKE=1\n",
|
"set FORCE_CMAKE=1\n",
|
||||||
"set CMAKE_ARGS=-DLLAMA_CUBLAS=OFF\n",
|
"set CMAKE_ARGS=-DLLAMA_CUBLAS=OFF\n",
|
||||||
"```\n",
|
"```\n",
|
||||||
"You can ignore the second environment variable if you have an NVIDIA GPU.\n",
|
"If you have an NVIDIA GPU make sure `DLLAMA_CUBLAS` is set to `ON`\n",
|
||||||
"\n",
|
"\n",
|
||||||
"#### Compiling and installing\n",
|
"#### Compiling and installing\n",
|
||||||
"\n",
|
"\n",
|
||||||
"In the same command prompt (anaconda prompt) you set the variables, you can `cd` into `llama-cpp-python` directory and run the following commands.\n",
|
"Now you can `cd` into the `llama-cpp-python` directory and install the package\n",
|
||||||
"\n",
|
"\n",
|
||||||
"```\n",
|
"```\n",
|
||||||
"python setup.py clean\n",
|
"python -m pip install -e .\n",
|
||||||
"python setup.py install\n",
|
|
||||||
"```"
|
"```"
|
||||||
]
|
]
|
||||||
},
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "markdown",
|
||||||
|
"metadata": {},
|
||||||
|
"source": [
|
||||||
|
"**IMPORTANT**: If you have already installed a cpu only version of the package, you need to reinstall it from scratch: consider the following command: "
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": [
|
||||||
|
"!python -m pip install -e . --force-reinstall --no-cache-dir"
|
||||||
|
]
|
||||||
|
},
|
||||||
{
|
{
|
||||||
"cell_type": "markdown",
|
"cell_type": "markdown",
|
||||||
"metadata": {},
|
"metadata": {},
|
||||||
|
Loading…
Reference in New Issue
Block a user