Commit Graph

105 Commits (main)

Author SHA1 Message Date
Patrick Shriwise 64fb36b3de Adding location argument to ingest scripts 1 year ago
Alex 08215248d7 Inputs folder change 1 year ago
monkish54 c94866e9e9 Add cost estimate feature
Calculates number of tokens/user cost and requires user permission to proceed.

User permission bypass is built-in to allow for non-human users.
1 year ago
Pavel 1c734727a1 Ingest rst with sphinx
Transforms all rst files in provided folder to txt format first (utilising sphinx library). In my tests size of raw sample decreased 2-3 times.
1 year ago
Alex b71a9bf5ee init2 1 year ago