Archives/DocsGPT
2
0
Fork 0
mirror of https://github.com/arc53/DocsGPT synced 2024-11-09 19:10:53 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,687 Commits 44 Branches 12 Tags 95 MiB
e07df29ab9
Commit Graph

325 Commits

Author SHA1 Message Date
staticGuru
95fe103718 add the conversation in the result response 2023-10-09 15:17:32 +05:30
staticGuru
a032164a99 Add update conversation name API 2023-10-09 10:25:38 +05:30
Alex
ffb7ad1417
Merge pull request #463 from jbampton/remove-duplicate-words 
Remove unneeded duplicate words
 2023-10-07 14:12:00 +01:00
Alex
17edaa0e1f Update faiss.py 2023-10-06 16:05:10 +01:00
John Bampton
32ea0213f7 Remove unneeded duplicate words 2023-10-07 00:11:03 +10:00
Alex
43a22f84d9 Update sagemaker.py 2023-10-06 14:43:05 +01:00
Alex
b3a0368b95 Update app.py 2023-10-06 13:54:03 +01:00
Alex
cd79330c4c
Merge pull request #449 from arc53/feature/sage-streaming 
sagemaker streaming
 2023-10-06 13:49:32 +01:00
Alex
495728593f sagemaker fixes + test 2023-10-06 13:22:51 +01:00
Alex
4f5e363452 sagemaker streaming 2023-10-06 01:52:29 +01:00
Amogha Kancharla
48f9997ea9
Update app.py 
This version of code uses a concise syntax and reduces redundancy.
 2023-10-05 23:35:47 +05:30
dependabot[bot]
ef9e9809e2
Bump langchain from 0.0.263 to 0.0.308 in /application 
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.263 to 0.0.308.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.263...v0.0.308)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-05 14:38:51 +00:00
Alex
c4fc49553c
Merge pull request #396 from arc53/dependabot/pip/application/pillow-10.0.1 
Bump pillow from 9.4.0 to 10.0.1 in /application
 2023-10-05 15:36:07 +01:00
Archit-Kohli
7ce1dc9069
Update huggingface.py add import torch statement 
Added import torch statement
 2023-10-05 14:27:15 +05:30
Archit-Kohli
5b4e517d9d
Update huggingface.py 
Added quantization support using bitsandbytes
 2023-10-05 11:03:51 +05:30
Alex
1336010bb2 Update .env_sample 2023-10-04 23:54:53 +01:00
Alex
8320cca5cd minor fixes on deleting 2023-10-04 13:57:40 +01:00
dependabot[bot]
53171bafec
Bump pillow from 9.4.0 to 10.0.1 in /application 
Bumps [pillow](https://github.com/python-pillow/Pillow) from 9.4.0 to 10.0.1.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/9.4.0...10.0.1)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-03 22:46:06 +00:00
John Bampton
034d73a4eb misc: fix spelling 2023-10-04 05:18:15 +10:00
Alex
b38459439d
Merge pull request #338 from arc53/dependabot/pip/application/cryptography-41.0.4 
Bump cryptography from 41.0.3 to 41.0.4 in /application
 2023-10-03 11:12:02 +01:00
Alex
a2eddb3580
Merge pull request #373 from arc53/dependabot/pip/application/urllib3-1.26.17 
Bump urllib3 from 1.26.14 to 1.26.17 in /application
 2023-10-03 11:07:34 +01:00
prithvi2k2
94f81caf28 Removed redundant files as discussed at #376 2023-10-03 14:11:52 +05:30
dependabot[bot]
6d2bc2929a
Bump urllib3 from 1.26.14 to 1.26.17 in /application 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.14 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.14...1.26.17)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-03 02:47:59 +00:00
Alex
cd9b03bdb9 celery syncs 2023-10-01 20:05:13 +01:00
Alex
a619269502 celery bugs 2023-10-01 19:55:11 +01:00
Alex
9a33bf2210 script + cpu optimisations 2023-10-01 19:16:13 +01:00
Alex
6045cbbc62
Merge pull request #355 from arc53/feature/cpu-llm 
llama-cpp local
 2023-10-01 17:55:26 +01:00
Alex
9bbf4044e0 script 2023-10-01 17:20:47 +01:00
John Bampton
2c6ab18e41 Fix spelling 2023-10-02 01:25:23 +10:00
Alex
2fea294b13 Update settings.py 2023-10-01 11:28:06 +01:00
Pavel
b47ecab1a9 llama-cpp local 2023-09-30 23:38:48 +04:00
Alex
3eacfb91aa fix314 2023-09-30 15:32:37 +01:00
Alex
94164c2a71
Merge branch 'main' into featue/elasticsearch 2023-09-30 15:30:23 +01:00
Alex
d85eb83ea2 elastic search fixes 2023-09-30 15:25:31 +01:00
Alex
b2002639db
Merge pull request #353 from arc53/bug/fix-aes-pdf 
Update requirements.txt
 2023-09-29 17:34:17 +01:00
Alex
347cfe253f elastic2 2023-09-29 17:17:48 +01:00
Alex
e4be38b9f7 sagemaker + llm creator class 2023-09-29 01:09:01 +01:00
Alex
783e7f6939 working es 2023-09-29 00:32:19 +01:00
Alex
32a019c0d6 Update requirements.txt 2023-09-27 22:39:48 +01:00
Alex
852de8bdfc ruff linting 2023-09-27 18:01:40 +01:00
Alex
b8acb860aa some tests 2023-09-27 17:54:57 +01:00
Alex
e6849b85d1 Create huggingface.py 2023-09-27 17:02:47 +01:00
Alex
8fa9657ba6 working full 2023-09-27 16:25:57 +01:00
Alex
025549ebf8 fixes to make it work 2023-09-26 13:00:17 +01:00
Alex
e85a583f0a testings 2023-09-26 10:03:22 +01:00
dependabot[bot]
0ffb40f4c1
Bump cryptography from 41.0.3 to 41.0.4 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.3 to 41.0.4.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.3...41.0.4)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-21 21:13:00 +00:00
Anton Larin
e1b49c3fb4 remove old static resources from the Flask application, forgotten leftover. 2023-09-07 18:32:45 +02:00
Anton Larin
adb4bfa10b remove old static resources from the Flask application, update the routing in app.py 2023-09-07 10:19:58 +02:00
Alex
909f0afa69 ruff fixes 2023-08-15 14:33:17 +01:00
Alex
e593241d75 Support for hf models optimised for docsgpt 2023-08-15 14:14:49 +01:00
Alex
fcdc7b7aeb
Merge pull request #292 from arc53/dependabot/pip/application/cryptography-41.0.3 
Bump cryptography from 41.0.2 to 41.0.3 in /application
 2023-08-15 00:15:09 +01:00
Anton Larin
85f9ae5a0a fix packaging and imports and introduce tests with pytest. 
still issues with celery worker.
 2023-08-14 18:53:25 +02:00
Anton Larin
98a97f34f5 fix packaging and imports and introduce tests with pytest. 
still issues with celery worker.
 2023-08-14 18:20:25 +02:00
dependabot[bot]
98d647a3fe
Bump cryptography from 41.0.2 to 41.0.3 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.2 to 41.0.3.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.2...41.0.3)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-13 20:33:47 +00:00
Anton Larin
88d74235e1 1. remove unnecessary dependencies to speed up the build and reduce the downloads volume. 
2. upgrade a couple of libraries
 2023-08-13 21:48:24 +02:00
Anton Larin
36fa470348 1. remove unnecessary dependencies to speed up the build and reduce the downloads volume. 
2. upgrade a couple of libraries
 2023-08-13 21:28:48 +02:00
Alex
33dce10bc3
Merge pull request #296 from larinam/revert_breaking_renaming_azure_change 
Revert "Changed environment variable names OPENAI_API_BASE and OPENAI…
 2023-08-08 18:15:45 +01:00
Anton Larin
ac5ac3e9f1 Revert "Changed environment variable names OPENAI_API_BASE and OPENAI_API_VERSION to AZURE_OPENAI_API_BASE and AZURE_OPENAI_API_VERSION" 
This reverts commit ce8b29e9d0.
 2023-08-05 14:08:51 +02:00
Anton Larin
bed25b317c Fix min_tokens logic for grouping documents: documents with (lengh >= min_tokens) should not be grouped into one document for indexing 2023-08-05 13:18:52 +02:00
Pavel
1687e6682a
Merge pull request #290 from arc53/feature/hisotry 
history
 2023-07-26 22:26:11 +01:00
Alex
22572c8ed1 ruff fixes 2023-07-26 22:21:32 +01:00
Alex
382c3930a2 history 2023-07-26 22:14:54 +01:00
Alex
a64a30c088 fix 2023-07-24 16:23:49 +01:00
Alex
dac76a867f fix tokens for header 2023-07-24 16:14:08 +01:00
dependabot[bot]
a55280b941
Bump cryptography from 41.0.0 to 41.0.2 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.0 to 41.0.2.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.0...41.0.2)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-15 01:25:02 +00:00
Rik Schoonbeek
ce8b29e9d0 Changed environment variable names OPENAI_API_BASE and OPENAI_API_VERSION to AZURE_OPENAI_API_BASE and AZURE_OPENAI_API_VERSION 2023-07-12 17:37:56 +02:00
Alex
b1a5068fd6
Merge pull request #254 from arc53/dependabot/pip/application/cryptography-41.0.0 
Bump cryptography from 39.0.2 to 41.0.0 in /application
 2023-06-28 00:40:17 +07:00
Alex
01fbd5d702
Merge pull request #247 from arc53/dependabot/pip/application/flask-2.2.5 
Bump flask from 2.2.3 to 2.2.5 in /application
 2023-06-28 00:31:30 +07:00
Alex
5e45268f68
Merge pull request #244 from arc53/dependabot/pip/application/requests-2.31.0 
Bump requests from 2.28.2 to 2.31.0 in /application
 2023-06-28 00:26:50 +07:00
Alex
c216bea031 Update app.py 2023-06-25 10:51:45 +07:00
Idan
2404899e28 Fixed request length bug, changed to as less used port 2023-06-23 14:56:14 +03:00
Anton Larin
0ff5f408d6 fix configuration to support streaming answer with Azure 2023-06-17 17:40:31 +02:00
Anton Larin
5eda42ff31 fix configuration to support streaming answer with Azure 2023-06-17 17:31:21 +02:00
Anton Larin
f5e287ffa6 optimized imports 2023-06-17 13:38:50 +02:00
Anton Larin
006897f1c0 Azure support for streaming output. 2023-06-17 13:20:29 +02:00
Anton Larin
968849e52b code readability, formatting, minor version bump 2023-06-17 12:42:05 +02:00
Alex
43c016f024 Update requirements.txt 2023-06-16 01:35:05 +01:00
dependabot[bot]
f2d2478dee
Bump transformers from 4.27.2 to 4.30.0 in /application 
Bumps [transformers](https://github.com/huggingface/transformers) from 4.27.2 to 4.30.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v4.27.2...v4.30.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-15 16:53:40 +00:00
dependabot[bot]
87a5c8894a
Bump flask from 2.2.3 to 2.2.5 in /application 
Bumps [flask](https://github.com/pallets/flask) from 2.2.3 to 2.2.5.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.2.3...2.2.5)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-15 16:53:35 +00:00
Alex
a57cdfff1e Update requirements.txt 2023-06-15 17:52:16 +01:00
Alex
d4ff6d4d7a minor fix 2023-06-15 17:40:58 +01:00
Levente Csoke
fce7d34171 Improve dev setup in README 
Add needed packages in for dev setup in requirements.txt
 2023-06-15 17:02:52 +02:00
Alex
94cc18bd71 fix for sending sources + azure embeddings issue 2023-06-15 11:35:21 +01:00
Alex
f209eebaf8
Merge pull request #255 from larinam/azure 
Azure support #199
 2023-06-12 20:15:18 +01:00
Alex
4889db78c9 Update .env_sample 2023-06-12 20:13:58 +01:00
Alex
bff200fede Sources by filename if available 2023-06-12 14:56:42 +01:00
Alex
610adcbefc Sources in responses 2023-06-11 22:56:34 +01:00
Anton Larin
0630504664
Merge branch 'main' into azure 2023-06-04 10:34:14 +02:00
Alex
577d58c92b less token less issues 2023-06-03 16:31:10 +01:00
Anton Larin
b4bd34fb96 fix arc53/DocsGPT#199 2023-06-03 10:58:31 +02:00
dependabot[bot]
014971262d
Bump cryptography from 39.0.2 to 41.0.0 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 39.0.2 to 41.0.0.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/39.0.2...41.0.0)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-02 20:20:32 +00:00
Alex
3f88b04c4a Update app.py 2023-05-31 23:49:41 +01:00
Alex
f8910ba136 Added history in streaming convo + fixed little bug with message margins on loading state 2023-05-31 23:47:16 +01:00
Alex
e6bccaaf4e Update app.py 2023-05-31 22:20:47 +01:00
Alex
3b8039a580
Merge branch 'main' into feature/streaming 2023-05-31 22:15:53 +01:00
Alex
fae3f55010 Working streaming 2023-05-31 17:44:20 +01:00
Alex
20c877f75b working fe 2023-05-31 15:42:17 +01:00
Alex
d2358c399d working version 2023-05-30 19:43:06 +01:00
Alex
c3af8a77af working streams 2023-05-29 17:55:43 +01:00
Alex
0b94f1717f
Merge pull request #246 from arc53/feature/gpt4all 
Feature/gpt4all
 2023-05-25 19:42:20 +01:00
Alex
aaa1249a41 model fix + env var 2023-05-25 19:33:37 +01:00
Alex
ffaa22c49b reverse history order to use latest history firts 
Co-Authored-By: Pavel <32868631+pabik@users.noreply.github.com>
 2023-05-25 16:40:11 +01:00
Alex
0b78480977 init 2023-05-25 15:14:47 +01:00
dependabot[bot]
78b85fb664
Bump requests from 2.28.2 to 2.31.0 in /application 
Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.2...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-23 06:07:55 +00:00
Alex
6a68b63192 history fix 2023-05-19 13:09:41 +01:00
Alex
ff2e79fe7b streaming experiments 2023-05-18 23:52:59 +01:00
Alex
bc9f1c17ed History 
Co-Authored-By: riccardofresi <89981746+riccardofresi@users.noreply.github.com>
 2023-05-18 18:42:23 +01:00
Alex
74845aed64 history init 2023-05-18 14:27:13 +01:00
Alex
e49dd0cc6a metadata on ingestion 2023-05-17 21:41:24 +01:00
Alex
059ffe09ea
Merge pull request #232 from larinam/lint 
Lint
 2023-05-15 13:53:09 +01:00
GH Action - Upstream Sync
a73774099e Merge branch 'main' of https://github.com/arc53/DocsGPT 2023-05-15 11:03:45 +00:00
Alex
eef012b4d1
Merge pull request #225 from arc53/dependabot/pip/application/flask-2.3.2 
Bump flask from 2.2.3 to 2.3.2 in /application
 2023-05-15 11:58:54 +01:00
Alex
1417a1c020 Update requirements.txt 2023-05-15 11:49:41 +01:00
Anton Larin
962becb9a5
Linting 
* validate python formatting on every build with Ruff
* fix lint warnings
 2023-05-13 10:36:17 +02:00
Anton Larin
168648e789 Proper PEP8 formatting 2023-05-12 12:02:25 +02:00
dependabot[bot]
15fd54eac4
Bump flask from 2.2.3 to 2.3.2 in /application 
Bumps [flask](https://github.com/pallets/flask) from 2.2.3 to 2.3.2.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.2.3...2.3.2)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-02 00:27:05 +00:00
Serj
31350e6302 Set celery and mongo urls as default 2023-04-30 11:03:09 +01:00
Serj
8742cdae0a Refactored url join 2023-04-30 10:46:52 +01:00
Serj
4efcb388ff Added settings usage to the worker 2023-04-29 15:58:02 +01:00
Serj
2d92e95c8a Added settings usage to the worker 2023-04-29 15:56:32 +01:00
Serj
47e5d5684a Replace other env variables in the file 2023-04-29 15:50:02 +01:00
Serj
b723e14d98 Added embeddings name variable 2023-04-29 15:46:09 +01:00
Serj
c9d24b8f42 Added llm model variable 2023-04-29 15:44:47 +01:00
Serj
43622e7ab1 Added settings file 2023-04-29 15:40:55 +01:00
Serge Kozloff
db4cdc901c
Merge pull request #1 from arc53/main 
t
 2023-04-26 18:55:39 +01:00
Serj
16a540b89b Expand readme and added port in wsgi 2023-04-26 18:54:59 +01:00
Alex
e00ec9ac3f Update chat_combine_prompt.txt 2023-04-26 15:01:46 +01:00
Alex
fc760afdfc Update chat_combine_prompt.txt 2023-04-26 14:54:26 +01:00
Alex
dbe9c4dc18 init 2023-04-25 17:01:44 +01:00
Alex
0c1a6a918d web widget 2023-04-23 15:07:55 +01:00
Alex
9395d2c091 celery load 2023-04-06 12:16:30 +01:00
Alex
60bb264663 async calls 2023-04-03 14:37:09 +01:00
dependabot[bot]
8a0f700563
Bump redis from 4.5.3 to 4.5.4 in /application 
Bumps [redis](https://github.com/redis/redis-py) from 4.5.3 to 4.5.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.3...v4.5.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 14:31:03 +00:00
Alex
3d0c6eafec gpt4- compatable 2023-03-31 10:45:40 +01:00
Alex
09c7fe0565
Merge pull request #193 from arc53/dependabot/pip/application/redis-4.5.3 
Bump redis from 4.5.2 to 4.5.3 in /application
 2023-03-30 12:48:35 +01:00
Alex
b6dfb2c856 map_reduce 2023-03-30 12:44:25 +01:00
Alex
ab46ba521f different prompts 2023-03-29 18:36:58 +01:00
Alex
4a7670f2aa Update app.py 2023-03-29 17:32:00 +01:00
dependabot[bot]
24e98abd15
Bump redis from 4.5.2 to 4.5.3 in /application 
Bumps [redis](https://github.com/redis/redis-py) from 4.5.2 to 4.5.3.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.2...v4.5.3)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-27 21:36:39 +00:00
Alex
65c2568427 Update app.py 2023-03-27 22:23:36 +01:00
Alex
186e7bf402 update for better runs + storage sync 2023-03-27 22:07:26 +01:00
Alex
c3c0e643d2 Update chat_combine_prompt.txt 2023-03-27 21:42:06 +01:00
Alex
d5522e7c08 prep things 2023-03-27 19:29:10 +01:00
Alex
3dab4b0b1e Update .env_sample 2023-03-23 15:52:47 +00:00
Alex
92993ee105 Small fixes + polishing 2023-03-21 22:16:09 +00:00
Alex
ce579293fb
Merge pull request #185 from arc53/feature/upload 2023-03-20 15:53:36 +00:00
Alex
3e98f9e6bd Button working now 2023-03-20 14:34:51 +00:00
Alex
796b4899aa Fixed progress + new path + combined new 
Co-Authored-By: Ajay Thapliyal <ajaythapliyal1703@gmail.com>
 2023-03-19 14:39:21 +00:00
Alex
620a7c6db2 Botichello 2023-03-17 18:44:12 +00:00
Alex
dff87b5fa3 chatwoot, label + id checks 2023-03-16 23:02:54 +00:00