langchain/docs/extras/integrations/providers/airbyte.mdx

# Airbyte

>[Airbyte](https://github.com/airbytehq/airbyte) is a data integration platform for ELT pipelines from APIs, 
> databases & files to warehouses & lakes. It has the largest catalog of ELT connectors to data warehouses and databases.

## Installation and Setup

This instruction shows how to load any source from `Airbyte` into a local `JSON` file that can be read in as a document.

**Prerequisites:**
Have `docker desktop` installed.

**Steps:**
1. Clone Airbyte from GitHub - `git clone https://github.com/airbytehq/airbyte.git`.
2. Switch into Airbyte directory - `cd airbyte`.
3. Start Airbyte - `docker compose up`.
4. In your browser, just visit http://localhost:8000. You will be asked for a username and password. By default, that's username `airbyte` and password `password`.
5. Setup any source you wish.
6. Set destination as Local JSON, with specified destination path - lets say `/json_data`. Set up a manual sync.
7. Run the connection.
8. To see what files are created, navigate to: `file:///tmp/airbyte_local/`.

## Document Loader

See a [usage example](/docs/integrations/document_loaders/airbyte_json).

```python
from langchain.document_loaders import AirbyteJSONLoader
```
docs: cleaning (#5413) # docs cleaning Changed docs to consistent format (probably, we need an official doc integration template): - ClearML - added product descriptions; changed title/headers - Rebuff - added product descriptions; changed title/headers - WhyLabs - added product descriptions; changed title/headers - Docugami - changed title/headers/structure - Airbyte - fixed title - Wolfram Alpha - added descriptions, fixed title - OpenWeatherMap - - added product descriptions; changed title/headers - Unstructured - changed description ## Who can review? Community members can review the PR once tests pass. Tag maintainers/contributors who might be interested: @hwchase17 @dev2049 2023-05-30 20:58:16 +00:00			`# Airbyte`
docs: `ecosystem/integrations` update 1 (#5219) # docs: ecosystem/integrations update It is the first in a series of `ecosystem/integrations` updates. The ecosystem/integrations list is missing many integrations. I'm adding the missing integrations in a consistent format: 1. description of the integrated system 2. `Installation and Setup` section with 'pip install ...`, Key setup, and other necessary settings 3. Sections like `LLM`, `Text Embedding Models`, `Chat Models`... with links to correspondent examples and imports of the used classes. This PR keeps new docs, that are presented in the `docs/modules/models/text_embedding/examples` but missed in the `ecosystem/integrations`. The next PRs will cover the next example sections. Also updated `integrations.rst`: added the `Dependencies` section with a link to the packages used in LangChain. ## Who can review? @hwchase17 @eyurtsev @dev2049 2023-05-29 14:25:17 +00:00
			`>[Airbyte](https://github.com/airbytehq/airbyte) is a data integration platform for ELT pipelines from APIs,`
			`> databases & files to warehouses & lakes. It has the largest catalog of ELT connectors to data warehouses and databases.`

			`## Installation and Setup`

			This instruction shows how to load any source from `Airbyte` into a local `JSON` file that can be read in as a document.

			`Prerequisites:`
			Have `docker desktop` installed.

			`Steps:`
			1. Clone Airbyte from GitHub - `git clone https://github.com/airbytehq/airbyte.git`.
			2. Switch into Airbyte directory - `cd airbyte`.
			3. Start Airbyte - `docker compose up`.
			4. In your browser, just visit http://localhost:8000. You will be asked for a username and password. By default, that's username `airbyte` and password `password`.
			`5. Setup any source you wish.`
			6. Set destination as Local JSON, with specified destination path - lets say `/json_data`. Set up a manual sync.
			`7. Run the connection.`
			8. To see what files are created, navigate to: `file:///tmp/airbyte_local/`.

			`## Document Loader`

Update Integrations links (#8206) 2023-07-25 04:20:32 +00:00			`See a [usage example](/docs/integrations/document_loaders/airbyte_json).`
docs: `ecosystem/integrations` update 1 (#5219) # docs: ecosystem/integrations update It is the first in a series of `ecosystem/integrations` updates. The ecosystem/integrations list is missing many integrations. I'm adding the missing integrations in a consistent format: 1. description of the integrated system 2. `Installation and Setup` section with 'pip install ...`, Key setup, and other necessary settings 3. Sections like `LLM`, `Text Embedding Models`, `Chat Models`... with links to correspondent examples and imports of the used classes. This PR keeps new docs, that are presented in the `docs/modules/models/text_embedding/examples` but missed in the `ecosystem/integrations`. The next PRs will cover the next example sections. Also updated `integrations.rst`: added the `Dependencies` section with a link to the packages used in LangChain. ## Who can review? @hwchase17 @eyurtsev @dev2049 2023-05-29 14:25:17 +00:00
			```python
			`from langchain.document_loaders import AirbyteJSONLoader`
			```