Commit Graph

105 Commits

Author SHA1 Message Date
Patrick Shriwise
64fb36b3de Adding location argument to ingest scripts 2023-02-07 10:20:07 -06:00
Alex
08215248d7 Inputs folder change 2023-02-07 10:52:03 +00:00
monkish54
c94866e9e9 Add cost estimate feature
Calculates number of tokens/user cost and requires user permission to proceed.

User permission bypass is built-in to allow for non-human users.
2023-02-06 18:32:06 -08:00
Pavel
1c734727a1 Ingest rst with sphinx
Transforms all rst files in provided folder to txt format first (utilising sphinx library). In my tests size of raw sample decreased 2-3 times.
2023-02-06 23:43:23 +04:00
Alex
b71a9bf5ee init2 2023-02-03 12:45:29 +00:00