Archives/DocsGPT
2
0
Fork 0
mirror of https://github.com/arc53/DocsGPT synced 2024-11-17 21:26:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,806 Commits 46 Branches 13 Tags 95 MiB
1d1ea7b6f2
Commit Graph

366 Commits

Author SHA1 Message Date
Alex
d6dcbb63d4 fix ruff 2023-11-22 23:57:47 +00:00
Alex
b2770f67a1 custom prompts 2023-11-22 23:55:41 +00:00
Alex
e9a9cbbd07 feedback local 2023-11-22 12:16:37 +00:00
Alex
58b2970b19
Merge pull request #778 from arc53/dependabot/pip/application/aiohttp-3.8.6 
Bump aiohttp from 3.8.5 to 3.8.6 in /application
 2023-11-22 09:28:20 +00:00
Alex
852b016111 fix path bug on default 2023-11-17 15:33:51 +00:00
Alex
ba77a67ba7 fix path 2023-11-17 15:31:53 +00:00
dependabot[bot]
5203db6c9c
Bump aiohttp from 3.8.5 to 3.8.6 in /application 
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.8.5 to 3.8.6.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.8.5...v3.8.6)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-11-14 23:45:14 +00:00
Alex
0974085c6f prompts 2023-11-14 01:16:06 +00:00
Alex
ae5e484506 fix docx file 2023-11-02 18:25:43 +00:00
Arnav Kohli
4c6b8b4173
Update worker.py 
Added comments in difficult to understand areas
 2023-10-31 20:00:07 +05:30
Guspan Tanadi
d81838dfc4
docs: close parentheses EMBEDDINGS_KEY comment settings 2023-10-31 16:40:41 +07:00
Pavel
71fdff17de
Merge pull request #721 from arc53/feature/anthropic 
anthropic LLM
 2023-10-28 22:58:30 +04:00
Alex
04b4001277 anthropic working 2023-10-28 19:51:12 +01:00
dependabot[bot]
1bee088fe6 Bump urllib3 from 1.26.17 to 1.26.18 in /application 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.17 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.17...1.26.18)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-28 16:52:37 +02:00
Alex
f3c626c800
Merge pull request #556 from Exterminator11/openapi3_parser 
Parser for OpenAPI3(Swagger)
 2023-10-25 21:27:45 +01:00
Exterminator11
f3540aac0f Changed import 2023-10-25 17:07:47 +05:30
Exterminator11
889ce984a9 Made changes 2023-10-25 16:50:01 +05:30
Shivanand
21ba1e3958
Merge branch 'main' into faiss_delete_index 2023-10-17 17:35:30 +05:30
Alex
d899b6a7e1
Merge pull request #588 from asoderlind/fix/as/embedding-size-mismatch 
raise more legible error if the word embedding dimensions don't match
 2023-10-16 12:53:08 -05:00
asoderlind
e73636bef3 remove trailing whitespace, sort imports, remove unused arguments 2023-10-16 11:22:42 +02:00
asoderlind
4e81f98927 add dependency 2023-10-16 06:13:15 +02:00
shivanandmn
2e95666939 added new endpoint 2023-10-16 02:46:48 +05:30
asoderlind
0ca96130c8 remove trailing whitespace 2023-10-15 10:23:09 +02:00
asoderlind
60cd6a455a refactor 2023-10-15 10:22:00 +02:00
asoderlind
4752ce5250 fix linting error 2023-10-15 09:12:00 +02:00
Pavel
381a2740ee change input 2023-10-13 21:52:56 +04:00
Alex
8b3b16bce4 inputs 2023-10-13 08:46:35 +01:00
Pavel
024674eef3 List check 2023-10-13 11:42:42 +04:00
asoderlind
9b6ae46e92 raise more legible error if the embedding vector dims don't match 2023-10-12 20:24:25 +02:00
Pavel
b7d88b4c0f fix wrong link 2023-10-12 19:45:36 +04:00
Pavel
719ca63ec1 fixes 2023-10-12 19:40:23 +04:00
Pavel
2cfb416fd0 Desc loader 2023-10-12 13:44:32 +04:00
Pavel
50f07f9ef5 limit crawler 2023-10-12 12:53:33 +04:00
Pavel
c517bdd2e1 Crawler + sitemap 2023-10-12 12:35:26 +04:00
shivanandmn
ca3e549dd4 added delete index of vector store in faiss 2023-10-12 13:29:52 +05:30
Pavel
658867cb46 No crawler, no sitemap 2023-10-12 01:03:40 +04:00
Alex
8f2ad38503 tests 2023-10-11 10:13:51 +01:00
dependabot[bot]
31fb1801d2
Bump langchain from 0.0.308 to 0.0.312 in /application 
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.308 to 0.0.312.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.308...v0.0.312)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-10 21:18:11 +00:00
Alex
64a8857884
Merge pull request #529 from staticGuru/chatroom-rename-#495 
Chatroom rename feature
 2023-10-09 23:42:45 +01:00
staticGuru
72481e8453 Fix the post API issues 2023-10-09 16:16:20 +05:30
Robbie Walmsley
57fb29b600
Update worker.py 2023-10-09 10:55:34 +01:00
staticGuru
95fe103718 add the conversation in the result response 2023-10-09 15:17:32 +05:30
staticGuru
a032164a99 Add update conversation name API 2023-10-09 10:25:38 +05:30
Alex
ffb7ad1417
Merge pull request #463 from jbampton/remove-duplicate-words 
Remove unneeded duplicate words
 2023-10-07 14:12:00 +01:00
Alex
17edaa0e1f Update faiss.py 2023-10-06 16:05:10 +01:00
John Bampton
32ea0213f7 Remove unneeded duplicate words 2023-10-07 00:11:03 +10:00
Alex
43a22f84d9 Update sagemaker.py 2023-10-06 14:43:05 +01:00
Alex
b3a0368b95 Update app.py 2023-10-06 13:54:03 +01:00
Alex
cd79330c4c
Merge pull request #449 from arc53/feature/sage-streaming 
sagemaker streaming
 2023-10-06 13:49:32 +01:00
Alex
495728593f sagemaker fixes + test 2023-10-06 13:22:51 +01:00
Alex
4f5e363452 sagemaker streaming 2023-10-06 01:52:29 +01:00
Amogha Kancharla
48f9997ea9
Update app.py 
This version of code uses a concise syntax and reduces redundancy.
 2023-10-05 23:35:47 +05:30
dependabot[bot]
ef9e9809e2
Bump langchain from 0.0.263 to 0.0.308 in /application 
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.263 to 0.0.308.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.263...v0.0.308)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-05 14:38:51 +00:00
Alex
c4fc49553c
Merge pull request #396 from arc53/dependabot/pip/application/pillow-10.0.1 
Bump pillow from 9.4.0 to 10.0.1 in /application
 2023-10-05 15:36:07 +01:00
Archit-Kohli
7ce1dc9069
Update huggingface.py add import torch statement 
Added import torch statement
 2023-10-05 14:27:15 +05:30
Archit-Kohli
5b4e517d9d
Update huggingface.py 
Added quantization support using bitsandbytes
 2023-10-05 11:03:51 +05:30
Alex
1336010bb2 Update .env_sample 2023-10-04 23:54:53 +01:00
Alex
8320cca5cd minor fixes on deleting 2023-10-04 13:57:40 +01:00
dependabot[bot]
53171bafec
Bump pillow from 9.4.0 to 10.0.1 in /application 
Bumps [pillow](https://github.com/python-pillow/Pillow) from 9.4.0 to 10.0.1.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/9.4.0...10.0.1)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-03 22:46:06 +00:00
John Bampton
034d73a4eb misc: fix spelling 2023-10-04 05:18:15 +10:00
Alex
b38459439d
Merge pull request #338 from arc53/dependabot/pip/application/cryptography-41.0.4 
Bump cryptography from 41.0.3 to 41.0.4 in /application
 2023-10-03 11:12:02 +01:00
Alex
a2eddb3580
Merge pull request #373 from arc53/dependabot/pip/application/urllib3-1.26.17 
Bump urllib3 from 1.26.14 to 1.26.17 in /application
 2023-10-03 11:07:34 +01:00
prithvi2k2
94f81caf28 Removed redundant files as discussed at #376 2023-10-03 14:11:52 +05:30
dependabot[bot]
6d2bc2929a
Bump urllib3 from 1.26.14 to 1.26.17 in /application 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.14 to 1.26.17.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.14...1.26.17)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-10-03 02:47:59 +00:00
Alex
cd9b03bdb9 celery syncs 2023-10-01 20:05:13 +01:00
Alex
a619269502 celery bugs 2023-10-01 19:55:11 +01:00
Alex
9a33bf2210 script + cpu optimisations 2023-10-01 19:16:13 +01:00
Alex
6045cbbc62
Merge pull request #355 from arc53/feature/cpu-llm 
llama-cpp local
 2023-10-01 17:55:26 +01:00
Alex
9bbf4044e0 script 2023-10-01 17:20:47 +01:00
John Bampton
2c6ab18e41 Fix spelling 2023-10-02 01:25:23 +10:00
Alex
2fea294b13 Update settings.py 2023-10-01 11:28:06 +01:00
Pavel
b47ecab1a9 llama-cpp local 2023-09-30 23:38:48 +04:00
Alex
3eacfb91aa fix314 2023-09-30 15:32:37 +01:00
Alex
94164c2a71
Merge branch 'main' into featue/elasticsearch 2023-09-30 15:30:23 +01:00
Alex
d85eb83ea2 elastic search fixes 2023-09-30 15:25:31 +01:00
Alex
b2002639db
Merge pull request #353 from arc53/bug/fix-aes-pdf 
Update requirements.txt
 2023-09-29 17:34:17 +01:00
Alex
347cfe253f elastic2 2023-09-29 17:17:48 +01:00
Alex
e4be38b9f7 sagemaker + llm creator class 2023-09-29 01:09:01 +01:00
Alex
783e7f6939 working es 2023-09-29 00:32:19 +01:00
Alex
32a019c0d6 Update requirements.txt 2023-09-27 22:39:48 +01:00
Alex
852de8bdfc ruff linting 2023-09-27 18:01:40 +01:00
Alex
b8acb860aa some tests 2023-09-27 17:54:57 +01:00
Alex
e6849b85d1 Create huggingface.py 2023-09-27 17:02:47 +01:00
Alex
8fa9657ba6 working full 2023-09-27 16:25:57 +01:00
Alex
025549ebf8 fixes to make it work 2023-09-26 13:00:17 +01:00
Alex
e85a583f0a testings 2023-09-26 10:03:22 +01:00
dependabot[bot]
0ffb40f4c1
Bump cryptography from 41.0.3 to 41.0.4 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.3 to 41.0.4.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.3...41.0.4)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-09-21 21:13:00 +00:00
Anton Larin
e1b49c3fb4 remove old static resources from the Flask application, forgotten leftover. 2023-09-07 18:32:45 +02:00
Anton Larin
adb4bfa10b remove old static resources from the Flask application, update the routing in app.py 2023-09-07 10:19:58 +02:00
Alex
909f0afa69 ruff fixes 2023-08-15 14:33:17 +01:00
Alex
e593241d75 Support for hf models optimised for docsgpt 2023-08-15 14:14:49 +01:00
Alex
fcdc7b7aeb
Merge pull request #292 from arc53/dependabot/pip/application/cryptography-41.0.3 
Bump cryptography from 41.0.2 to 41.0.3 in /application
 2023-08-15 00:15:09 +01:00
Anton Larin
85f9ae5a0a fix packaging and imports and introduce tests with pytest. 
still issues with celery worker.
 2023-08-14 18:53:25 +02:00
Anton Larin
98a97f34f5 fix packaging and imports and introduce tests with pytest. 
still issues with celery worker.
 2023-08-14 18:20:25 +02:00
dependabot[bot]
98d647a3fe
Bump cryptography from 41.0.2 to 41.0.3 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.2 to 41.0.3.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.2...41.0.3)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-08-13 20:33:47 +00:00
Anton Larin
88d74235e1 1. remove unnecessary dependencies to speed up the build and reduce the downloads volume. 
2. upgrade a couple of libraries
 2023-08-13 21:48:24 +02:00
Anton Larin
36fa470348 1. remove unnecessary dependencies to speed up the build and reduce the downloads volume. 
2. upgrade a couple of libraries
 2023-08-13 21:28:48 +02:00
Alex
33dce10bc3
Merge pull request #296 from larinam/revert_breaking_renaming_azure_change 
Revert "Changed environment variable names OPENAI_API_BASE and OPENAI…
 2023-08-08 18:15:45 +01:00
Anton Larin
ac5ac3e9f1 Revert "Changed environment variable names OPENAI_API_BASE and OPENAI_API_VERSION to AZURE_OPENAI_API_BASE and AZURE_OPENAI_API_VERSION" 
This reverts commit ce8b29e9d0.
 2023-08-05 14:08:51 +02:00
Anton Larin
bed25b317c Fix min_tokens logic for grouping documents: documents with (lengh >= min_tokens) should not be grouped into one document for indexing 2023-08-05 13:18:52 +02:00
Pavel
1687e6682a
Merge pull request #290 from arc53/feature/hisotry 
history
 2023-07-26 22:26:11 +01:00
Alex
22572c8ed1 ruff fixes 2023-07-26 22:21:32 +01:00
Alex
382c3930a2 history 2023-07-26 22:14:54 +01:00
Alex
a64a30c088 fix 2023-07-24 16:23:49 +01:00
Alex
dac76a867f fix tokens for header 2023-07-24 16:14:08 +01:00
dependabot[bot]
a55280b941
Bump cryptography from 41.0.0 to 41.0.2 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.0 to 41.0.2.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.0...41.0.2)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-07-15 01:25:02 +00:00
Rik Schoonbeek
ce8b29e9d0 Changed environment variable names OPENAI_API_BASE and OPENAI_API_VERSION to AZURE_OPENAI_API_BASE and AZURE_OPENAI_API_VERSION 2023-07-12 17:37:56 +02:00
Alex
b1a5068fd6
Merge pull request #254 from arc53/dependabot/pip/application/cryptography-41.0.0 
Bump cryptography from 39.0.2 to 41.0.0 in /application
 2023-06-28 00:40:17 +07:00
Alex
01fbd5d702
Merge pull request #247 from arc53/dependabot/pip/application/flask-2.2.5 
Bump flask from 2.2.3 to 2.2.5 in /application
 2023-06-28 00:31:30 +07:00
Alex
5e45268f68
Merge pull request #244 from arc53/dependabot/pip/application/requests-2.31.0 
Bump requests from 2.28.2 to 2.31.0 in /application
 2023-06-28 00:26:50 +07:00
Alex
c216bea031 Update app.py 2023-06-25 10:51:45 +07:00
Idan
2404899e28 Fixed request length bug, changed to as less used port 2023-06-23 14:56:14 +03:00
Anton Larin
0ff5f408d6 fix configuration to support streaming answer with Azure 2023-06-17 17:40:31 +02:00
Anton Larin
5eda42ff31 fix configuration to support streaming answer with Azure 2023-06-17 17:31:21 +02:00
Anton Larin
f5e287ffa6 optimized imports 2023-06-17 13:38:50 +02:00
Anton Larin
006897f1c0 Azure support for streaming output. 2023-06-17 13:20:29 +02:00
Anton Larin
968849e52b code readability, formatting, minor version bump 2023-06-17 12:42:05 +02:00
Alex
43c016f024 Update requirements.txt 2023-06-16 01:35:05 +01:00
dependabot[bot]
f2d2478dee
Bump transformers from 4.27.2 to 4.30.0 in /application 
Bumps [transformers](https://github.com/huggingface/transformers) from 4.27.2 to 4.30.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v4.27.2...v4.30.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-15 16:53:40 +00:00
dependabot[bot]
87a5c8894a
Bump flask from 2.2.3 to 2.2.5 in /application 
Bumps [flask](https://github.com/pallets/flask) from 2.2.3 to 2.2.5.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.2.3...2.2.5)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-15 16:53:35 +00:00
Alex
a57cdfff1e Update requirements.txt 2023-06-15 17:52:16 +01:00
Alex
d4ff6d4d7a minor fix 2023-06-15 17:40:58 +01:00
Levente Csoke
fce7d34171 Improve dev setup in README 
Add needed packages in for dev setup in requirements.txt
 2023-06-15 17:02:52 +02:00
Alex
94cc18bd71 fix for sending sources + azure embeddings issue 2023-06-15 11:35:21 +01:00
Alex
f209eebaf8
Merge pull request #255 from larinam/azure 
Azure support #199
 2023-06-12 20:15:18 +01:00
Alex
4889db78c9 Update .env_sample 2023-06-12 20:13:58 +01:00
Alex
bff200fede Sources by filename if available 2023-06-12 14:56:42 +01:00
Alex
610adcbefc Sources in responses 2023-06-11 22:56:34 +01:00
Anton Larin
0630504664
Merge branch 'main' into azure 2023-06-04 10:34:14 +02:00
Alex
577d58c92b less token less issues 2023-06-03 16:31:10 +01:00
Anton Larin
b4bd34fb96 fix arc53/DocsGPT#199 2023-06-03 10:58:31 +02:00
dependabot[bot]
014971262d
Bump cryptography from 39.0.2 to 41.0.0 in /application 
Bumps [cryptography](https://github.com/pyca/cryptography) from 39.0.2 to 41.0.0.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/39.0.2...41.0.0)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-06-02 20:20:32 +00:00
Alex
3f88b04c4a Update app.py 2023-05-31 23:49:41 +01:00
Alex
f8910ba136 Added history in streaming convo + fixed little bug with message margins on loading state 2023-05-31 23:47:16 +01:00
Alex
e6bccaaf4e Update app.py 2023-05-31 22:20:47 +01:00
Alex
3b8039a580
Merge branch 'main' into feature/streaming 2023-05-31 22:15:53 +01:00
Alex
fae3f55010 Working streaming 2023-05-31 17:44:20 +01:00
Alex
20c877f75b working fe 2023-05-31 15:42:17 +01:00
Alex
d2358c399d working version 2023-05-30 19:43:06 +01:00
Alex
c3af8a77af working streams 2023-05-29 17:55:43 +01:00
Alex
0b94f1717f
Merge pull request #246 from arc53/feature/gpt4all 
Feature/gpt4all
 2023-05-25 19:42:20 +01:00
Alex
aaa1249a41 model fix + env var 2023-05-25 19:33:37 +01:00
Alex
ffaa22c49b reverse history order to use latest history firts 
Co-Authored-By: Pavel <32868631+pabik@users.noreply.github.com>
 2023-05-25 16:40:11 +01:00
Alex
0b78480977 init 2023-05-25 15:14:47 +01:00
dependabot[bot]
78b85fb664
Bump requests from 2.28.2 to 2.31.0 in /application 
Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.2...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-05-23 06:07:55 +00:00
Alex
6a68b63192 history fix 2023-05-19 13:09:41 +01:00
Alex
ff2e79fe7b streaming experiments 2023-05-18 23:52:59 +01:00
Alex
bc9f1c17ed History 
Co-Authored-By: riccardofresi <89981746+riccardofresi@users.noreply.github.com>
 2023-05-18 18:42:23 +01:00
Alex
74845aed64 history init 2023-05-18 14:27:13 +01:00
Alex
e49dd0cc6a metadata on ingestion 2023-05-17 21:41:24 +01:00