You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/libs/community/tests/examples
Eugene Yurtsev cd52433ba0
community[minor]: Add `SQLDatabaseLoader` document loader (#18281)
- **Description:** A generic document loader adapter for SQLAlchemy on
top of LangChain's `SQLDatabaseLoader`.
  - **Needed by:** https://github.com/crate-workbench/langchain/pull/1
  - **Depends on:** GH-16655
  - **Addressed to:** @baskaryan, @cbornet, @eyurtsev

Hi from CrateDB again,

in the same spirit like GH-16243 and GH-16244, this patch breaks out
another commit from https://github.com/crate-workbench/langchain/pull/1,
in order to reduce the size of this patch before submitting it, and to
separate concerns.

To accompany the SQLAlchemy adapter implementation, the patch includes
integration tests for both SQLite and PostgreSQL. Let me know if
corresponding utility resources should be added at different spots.

With kind regards,
Andreas.


### Software Tests

```console
docker compose --file libs/community/tests/integration_tests/document_loaders/docker-compose/postgresql.yml up
```

```console
cd libs/community
pip install psycopg2-binary
pytest -vvv tests/integration_tests -k sqldatabase
```

```
14 passed
```



![image](https://github.com/langchain-ai/langchain/assets/453543/42be233c-eb37-4c76-a830-474276e01436)

---------

Co-authored-by: Andreas Motl <andreas.motl@crate.io>
7 months ago
..
README.org
README.rst
brandfetch-brandfetch-2.0.0-resolved.json
default-encoding.py
docusaurus-sitemap.xml
duplicate-chars.pdf
example-utf8.html
example.html
example.json
example.mht
facebook_chat.json
factbook.xml
fake-email-attachment.eml
fake.odt
fake.vsdx
hello.msg
hello.pdf
hello_world.js
hello_world.py infra: add print rule to ruff (#16221) 7 months ago
layout-parser-paper.pdf
mlb_teams_2012.csv community[minor]: Add `SQLDatabaseLoader` document loader (#18281) 7 months ago
mlb_teams_2012.sql community[minor]: Add `SQLDatabaseLoader` document loader (#18281) 7 months ago
multi-page-forms-sample-2-page.pdf
non-utf8-encoding.py
sample_rss_feeds.opml
sitemap.xml
slack_export.zip
stanley-cups.csv
stanley-cups.tsv
stanley-cups.xlsx
test_empty.csv community[minor]: Add pebblo safe document loader (#16862) 7 months ago
test_nominal.csv community[minor]: Add pebblo safe document loader (#16862) 7 months ago
whatsapp_chat.txt

README.rst

Example Docs
------------

The sample docs directory contains the following files:

-  ``example-10k.html`` - A 10-K SEC filing in HTML format
-  ``layout-parser-paper.pdf`` - A PDF copy of the layout parser paper
-  ``factbook.xml``/``factbook.xsl`` - Example XML/XLS files that you
   can use to test stylesheets

These documents can be used to test out the parsers in the library. In
addition, here are instructions for pulling in some sample docs that are
too big to store in the repo.

XBRL 10-K
^^^^^^^^^

You can get an example 10-K in inline XBRL format using the following
``curl``. Note, you need to have the user agent set in the header or the
SEC site will reject your request.

.. code:: bash

   curl -O \
     -A '${organization} ${email}'
     https://www.sec.gov/Archives/edgar/data/311094/000117184321001344/0001171843-21-001344.txt

You can parse this document using the HTML parser.