You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/docs
Shengsheng Huang fd1061e7bf
community[patch]: add more data types support to ipex-llm llm integration (#20833)
- **Description**:  
- **add support for more data types**: by default `IpexLLM` will load
the model in int4 format. This PR adds more data types support such as
`sym_in5`, `sym_int8`, etc. Data formats like NF3, NF4, FP4 and FP8 are
only supported on GPU and will be added in future PR.
    - Fix a small issue in saving/loading, update api docs
- **Dependencies**: `ipex-llm` library
- **Document**: In `docs/docs/integrations/llms/ipex_llm.ipynb`, added
instructions for saving/loading low-bit model.
- **Tests**: added new test cases to
`libs/community/tests/integration_tests/llms/test_ipex_llm.py`, added
config params.
- **Contribution maintainer**: @shane-huang
5 months ago
..
api_reference experimental[minor]: upgrade the prompt injection model (#20783) 5 months ago
data
docs community[patch]: add more data types support to ipex-llm llm integration (#20833) 5 months ago
scripts docs: update chat model feature table (#20899) 5 months ago
src
static
.gitignore
.local_build.sh docs: automatically add api ref links (#20755) 5 months ago
.yarnrc.yml
README.md
babel.config.js
code-block-loader.js
docusaurus.config.js
package.json
settings.ini
sidebars.js
vercel.json
vercel_build.sh upstage: Add Upstage partner package LA and GC (#20651) 5 months ago
vercel_requirements.txt docs: install partner pkgs vercel (#20761) 5 months ago
yarn.lock

README.md

LangChain Documentation

For more information on contributing to our documentation, see the Documentation Contributing Guide