Commit Graph

60 Commits (8380858a82a41eca833f634e05516d7c9ee991bd)

Author SHA1 Message Date
Alex e49dd0cc6a metadata on ingestion 1 year ago
Alex 059ffe09ea
Merge pull request #232 from larinam/lint
Lint
1 year ago
GH Action - Upstream Sync ce6f0dab56 Merge branch 'main' of https://github.com/arc53/DocsGPT 1 year ago
Alex 3001688e0e Update requirements.txt 1 year ago
dependabot[bot] b28676d52c
Bump flask from 2.2.2 to 2.2.5 in /scripts
Bumps [flask](https://github.com/pallets/flask) from 2.2.2 to 2.2.5.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.2.2...2.2.5)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Anton Larin 962becb9a5
Linting
* validate python formatting on every build with Ruff
* fix lint warnings
1 year ago
Anton Larin 168648e789 Proper PEP8 formatting 1 year ago
dependabot[bot] 80dfdd1cb9
Bump redis from 4.5.3 to 4.5.4 in /scripts
Bumps [redis](https://github.com/redis/redis-py) from 4.5.3 to 4.5.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.3...v4.5.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
dependabot[bot] b7f1a94ba4
Bump redis from 4.5.1 to 4.5.3 in /scripts
Bumps [redis](https://github.com/redis/redis-py) from 4.5.1 to 4.5.3.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.1...v4.5.3)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
1 year ago
Pavel ce8f0ef9e1
Merge pull request #168 from arc53/feature/backend-uploads
Feature/backend uploads
1 year ago
Pavel c9e1c326f5 - index.plk 1 year ago
Pavel 4532b6cd8c print minus 1 year ago
Pavel 53424a5c19 Added cli commands 1 year ago
Pavel b6c02c850a token ingeest 1 year ago
Alex 20a0800aa7 Create test_ingestion.py 1 year ago
Pavel bac25112b7 v1 1 year ago
Alex 1d2162705d uploads backend first 1 year ago
Alex ac0224b687 mdx format 1 year ago
Alex 0799728000 Create requirements.txt 1 year ago
Alex 1f02f3b376 Update rst_parser.py 1 year ago
Alex f7d7244588 chunks rst 1 year ago
Alex 63e35fbdbc env vars 1 year ago
Alex 1af4ca2340
Merge pull request #129 from arc53/code-ingestion
Code_to_dict
1 year ago
Pavel 2c364d3c00 Code_to_dict
3 languages added, works well with python. Java and Js require additional revieving
1 year ago
Alex 5c2a537393
Merge pull request #116 from arc53/code-ingestion
Code ingestion
1 year ago
Pavel 0fb28e5213 Calc + structure 1 year ago
Manan 524e0f6f01 fix | Chunk creation error when
title not the first element in HTML
1 year ago
Manan 16eb503e36 Added HTML Support. read, clean-up, filter return 1 year ago
Manan e8baa46eb6 Merge branch 'main' of https://github.com/arc53/DocsGPT into main 1 year ago
Alex c92f5dba32 New docs gen 1 year ago
Alex 962be4d8ec
Merge pull request #109 from arc53/main
updates
1 year ago
Manan d0b472ad38 Implemented html_parser: cleaning & chunk creation 1 year ago
Alex 8a5e1e8d98 cleanups 1 year ago
Alex 4d1ff8238d switching between llms 1 year ago
Alex f9fe3f2f48 Merge branch 'main' into custom-llm 1 year ago
EricGao888 aeac186484 Add retry strategy to increase stability 1 year ago
Pavel d57c7b0296 -y-description 1 year ago
冯不游 b83589a308 feat: add support for directory list
example: `python ingest.py --dir inputs1 --dir another --dir ../inputs`,
the outputs will be in `outputs/input_folder_name/`
1 year ago
Alex d4ede13747 Merge branch 'main' into code-ingestion 1 year ago
Alex 5883ce2685
Merge pull request #87 from arc53/ingest-cli
Ingest cli
1 year ago
Pavel af20c7298a new-ingest
Ingest with a CLI
1 year ago
冯不游 636783ca8a fix: avoid second error issue 1 year ago
冯不游 458f2a3ff3 fix: restore index back when continue process 1 year ago
Alex 046fbebf56 Enable other llm's 1 year ago
冯不游 3ab02ca959 feat: compatible with markdown 1 year ago
Alex e88ff885fe
Merge pull request #75 from arc53/rst-interpreters 1 year ago
Pavel b1a6ebffba Directives + Interpreted
Some additional filters for rst parsing
1 year ago
Alex 205be538a3 fix dbqa, with new chain type, also fix for doc export 1 year ago
Alex 9228005a7e chunked embedding 1 year ago
vintro 2a203aa547
Create __init__.py
otherwise running `python ingest.py` complains about `parser` not being a package
1 year ago