langchain/docs/modules/models/llms
Zander Chase d85b04be7f
Add RELLM and JSONFormer experimental LLM decoding (#4185)
[RELLM](https://github.com/r2d4/rellm) is a library that wraps local
HuggingFace pipeline models for structured decoding.

RELLM works by generating tokens one at a time. At each step, it masks
tokens that don't conform to the provided partial regular expression.

[JSONFormer](https://github.com/1rgs/jsonformer) is a bit different, where it sequentially adds the keys then decodes each value directly
2023-05-14 22:40:03 +00:00
..
examples Optimize the initialization method of GPTCache (#4522) 2023-05-11 16:15:23 -07:00
integrations Add RELLM and JSONFormer experimental LLM decoding (#4185) 2023-05-14 22:40:03 +00:00
getting_started.ipynb docs: update getting_started.ipynb (#2883) 2023-04-14 07:40:26 -07:00
how_to_guides.rst big docs refactor (#1978) 2023-03-26 19:49:46 -07:00
integrations.rst big docs refactor (#1978) 2023-03-26 19:49:46 -07:00