langchain/libs/partners/nvidia-trt/tests/unit_tests/test_llms.py
William FH 583696732c
[Partner] NVIDIA TRT Package (#14733)
Simplify #13976 and add as a separate package.

- [] Add README
- [X] Add doc notebook
- [X] Add simple LLM integration

---------

Co-authored-by: Jeremy Dyer <jdye64@gmail.com>
2023-12-18 19:08:25 -08:00

8 lines
256 B
Python

"""Test TritonTensorRT Chat API wrapper."""
from langchain_nvidia_trt import TritonTensorRTLLM
def test_initialization() -> None:
"""Test integration initialization."""
TritonTensorRTLLM(model_name="ensemble", server_url="http://localhost:8001")