You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Shengsheng Huang fd1061e7bf community[patch]: add more data types support to ipex-llm llm integration (#20833) ... - **Description**: - **add support for more data types**: by default `IpexLLM` will load the model in int4 format. This PR adds more data types support such as `sym_in5`, `sym_int8`, etc. Data formats like NF3, NF4, FP4 and FP8 are only supported on GPU and will be added in future PR. - Fix a small issue in saving/loading, update api docs - **Dependencies**: `ipex-llm` library - **Document**: In `docs/docs/integrations/llms/ipex_llm.ipynb`, added instructions for saving/loading low-bit model. - **Tests**: added new test cases to `libs/community/tests/integration_tests/llms/test_ipex_llm.py`, added config params. - **Contribution maintainer**: @shane-huang		5 months ago
..
__init__.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_ai21.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_aleph_alpha.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_anthropic.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_anyscale.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_arcee.py	infra: add print rule to ruff (#16221)	8 months ago
test_aviary.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_azure_openai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_azureml_endpoint.py	infra: add -p to mkdir in lint steps (#17013)	8 months ago
test_baichuan.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_banana.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_baseten.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_beam.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_bedrock.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_bigdl_llm.py	community[patch]: add more data types support to ipex-llm llm integration (#20833)	5 months ago
test_bittensor.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_cerebriumai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_chatglm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_clarifai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_cloudflare_workersai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_cohere.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_confident.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_ctransformers.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_deepinfra.py	community[minor]: DeepInfra support for chat models (#16380)	8 months ago
test_deepsparse.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_edenai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_fireworks.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_forefrontai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_friendli.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_google_palm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_gooseai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_gpt4all.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_gradient_ai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_huggingface_endpoint.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_huggingface_hub.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_huggingface_pipeline.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_huggingface_text_gen_inference.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_ipex_llm.py	community[patch]: add more data types support to ipex-llm llm integration (#20833)	5 months ago
test_konko.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_layerup_security.py	community[minor]: add Layerup Security integration (#19787)	6 months ago
test_llamacpp.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_llamafile.py	community[minor]: Adds Llamafile as an LLM (#17431)	8 months ago
test_manifest.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_minimax.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_mlx_pipeline.py	community[minor]: Add support for MLX models (chat & llm) (#18152)	6 months ago
test_modal.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_mosaicml.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_nlpcloud.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_octoai_endpoint.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_opaqueprompts.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_openai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_openllm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_openlm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_pai_eas_endpoint.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_petals.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_pipelineai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_predictionguard.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_promptlayer_openai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_propmptlayer_openai_chat.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_qianfan_endpoint.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_replicate.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_rwkv.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_self_hosted_llm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_sparkllm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_stochasticai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_symblai_nebula.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago
test_titan_takeoff.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_together.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_tongyi.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_vertexai.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_volcengine_maas.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_watsonxllm.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_weight_only_quantization.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_writer.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_xinference.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
test_yuan2.py	patch: remove usage of llm, chat model __call__ (#20788)	5 months ago
utils.py	community[major], core[patch], langchain[patch], experimental[patch]: Create langchain-community (#14463)	10 months ago