Shengsheng Huang fd1061e7bf community[patch]: add more data types support to ipex-llm llm integration (#20833) ... - **Description**: - **add support for more data types**: by default `IpexLLM` will load the model in int4 format. This PR adds more data types support such as `sym_in5`, `sym_int8`, etc. Data formats like NF3, NF4, FP4 and FP8 are only supported on GPU and will be added in future PR. - Fix a small issue in saving/loading, update api docs - **Dependencies**: `ipex-llm` library - **Document**: In `docs/docs/integrations/llms/ipex_llm.ipynb`, added instructions for saving/loading low-bit model. - **Tests**: added new test cases to `libs/community/tests/integration_tests/llms/test_ipex_llm.py`, added config params. - **Contribution maintainer**: @shane-huang		2024-04-25 12:58:18 -07:00
..
examples	community[minor]: Add SQLDatabaseLoader document loader (#18281)	2024-02-28 21:02:28 +00:00
integration_tests	community[patch]: add more data types support to ipex-llm llm integration (#20833)	2024-04-25 12:58:18 -07:00
unit_tests	community[minor]: Add relyt vector database (#20316)	2024-04-25 19:49:29 +00:00
__init__.py
data.py	community[minor]: Add SQLDatabaseLoader document loader (#18281)	2024-02-28 21:02:28 +00:00