Extraction with LLaMA2 Function Calling

This template shows how to do extraction of structured data from unstructured data, using LLaMA2 fine-tuned for grammars and jsonschema.

Specify the scehma you want to extract in chain.py

By default, it will extract the title and author of papers.

LLM

This template will use a Replicate hosted version of LLaMA2 that has support for grammars and jsonschema.

Based on the Replicate example, these are supplied directly in the prompt.

Be sure that REPLICATE_API_TOKEN is set in your environment.