17 Commits (main)

Author	SHA1	Message	Date
Jon Luo	ac1320aae8	fix sqlite internal tables breaking table_info (#1224) ... With the current method used to get the SQL table info, sqlite internal schema tables are being included and are not being handled correctly by sqlalchemy because the columns have no types. This is easy to see with the Chinook database: ```python db = SQLDatabase.from_uri("sqlite:///Chinook.db") print(db.table_info) ``` ```python ... sqlalchemy.exc.CompileError: (in table 'sqlite_sequence', column 'name'): Can't generate DDL for NullType(); did you forget to specify a type on this Column? ``` SQLAlchemy 2.0 [ignores these by default](63d90b0f44/lib/sqlalchemy/dialects/sqlite/base.py (L856-L880)): 63d90b0f44/lib/sqlalchemy/dialects/sqlite/base.py (L2096-L2123)	1 year ago
Harrison Chase	45b5640fe5	fix sql (#1141)	1 year ago
Francisco Ingham	3f29742adc	Sql alchemy commands used in table info (#1135) ... This approach has several advantages: * it improves the readability of the code * removes incompatibilities between SQL dialects * fixes a bug with `datetime` values in rows and `ast.literal_eval` Huge thanks and credits to @jzluo for finding the weaknesses in the current approach and for the thoughtful discussion on the best way to implement this. --------- Co-authored-by: Francisco Ingham <> Co-authored-by: Jon Luo <20971593+jzluo@users.noreply.github.com>	1 year ago
Jon Luo	c39ef70aa4	fix for database compatibility when getting table DDL (#1129) ... #1081 introduced a method to get DDL (table definitions) in a manner specific to sqlite3, thus breaking compatibility with other non-sqlite3 databases. This uses the sqlite3 command if the detected dialect is sqlite, and otherwise uses the standard SQL `SHOW CREATE TABLE`. This should fix #1103.	1 year ago
Harrison Chase	5e10e19bfe	Harrison/align table (#1081) ... Co-authored-by: Francisco Ingham <fpingham@gmail.com>	1 year ago
Harrison Chase	ec727bf166	Align table info (#999) (#1034) ... Currently the chain is getting the column names and types on the one side and the example rows on the other. It is easier for the llm to read the table information if the column name and examples are shown together so that it can easily understand to which columns do the examples refer to. For an instantiation of this, please refer to the changes in the `sqlite.ipynb` notebook. Also changed `eval` for `ast.literal_eval` when interpreting the results from the sample row query since it is a better practice. --------- Co-authored-by: Francisco Ingham <> --------- Co-authored-by: Francisco Ingham <fpingham@gmail.com>	1 year ago
Harrison Chase	3d639d1539	update lint (#975) ... Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>	1 year ago
Kevin Huo	512c523368	remove sample_row_in_table_info and simplify set operations in SQLDB (#932) ... -Address TODO: deprecate for sample_row_in_table_info -Simplify set operations by casting to sets to not need multiple set casts + .difference() calls	1 year ago
Harrison Chase	f95cedc443	Harrison/sql rows (#915) ... Co-authored-by: Jon Luo <20971593+jzluo@users.noreply.github.com>	1 year ago
Harrison Chase	248c297f1b	Sample row in table info for SQLDatabase (#769) (#782) ... The agents usually benefit from understanding what the data looks like to be able to filter effectively. Sending just one row in the table info allows the agent to understand the data before querying and get better results. --------- Co-authored-by: Francisco Ingham <> --------- Co-authored-by: Francisco Ingham <fpingham@gmail.com>	1 year ago
Amos Ng	fa6826e417	Fix sqlalchemy warnings when running tests (#733) ... This has been bugging me when running my own tests that call langchain methods :P	1 year ago
Harrison Chase	1c71fadfdc	more complex sql chain (#619) ... add a more complex sql chain that first subsets the necessary tables	1 year ago
Harrison Chase	95157d0aad	Add schema property to sql database utility class (#448) (#462) ... Co-authored-by: Harrison Chase <hw.chase.17@gmail.com> Signed-off-by: Diwank Singh Tomer <diwank.singh@gmail.com> Co-authored-by: Nuno Campos <nuno@boringbits.io> Co-authored-by: Diwank Singh Tomer <diwank.singh@gmail.com>	1 year ago
Xupeng (Tony) Tong	bb4bf9d6d0	chore: minor clean up / formatting (#233) ... to get familiarize with the project	1 year ago
Andrew Gleave	ea67c049f0	Support SQL statements that return no results (#222) ... Adds support for statements such as insert, update etc which do not return any rows. `engine.execute` is deprecated and so execution has been updated to use `connection.exec_driver_sql` as-per: https://docs.sqlalchemy.org/en/14/core/connections.html#sqlalchemy.engine.Engine.execute	1 year ago
Nicholas Larus-Stone	ca4b10bb74	feat: add option to ignore or restrict to SQL tables (#151) ... `SQLDatabase` now accepts two `init` arguments: 1. `ignore_tables` to pass in a list of tables to not search over 2. `include_tables` to restrict to a list of tables to consider	2 years ago
Harrison Chase	af81e9ca9c	add sql database (#35)	2 years ago