Commit Graph

236 Commits

Author SHA1 Message Date
Alex
852de8bdfc ruff linting 2023-09-27 18:01:40 +01:00
Alex
b8acb860aa some tests 2023-09-27 17:54:57 +01:00
Alex
e6849b85d1 Create huggingface.py 2023-09-27 17:02:47 +01:00
Alex
8fa9657ba6 working full 2023-09-27 16:25:57 +01:00
Alex
025549ebf8 fixes to make it work 2023-09-26 13:00:17 +01:00
Alex
e85a583f0a testings 2023-09-26 10:03:22 +01:00
dependabot[bot]
0ffb40f4c1
Bump cryptography from 41.0.3 to 41.0.4 in /application
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.3 to 41.0.4.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.3...41.0.4)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-09-21 21:13:00 +00:00
Anton Larin
e1b49c3fb4 remove old static resources from the Flask application, forgotten leftover. 2023-09-07 18:32:45 +02:00
Anton Larin
adb4bfa10b remove old static resources from the Flask application, update the routing in app.py 2023-09-07 10:19:58 +02:00
Alex
909f0afa69 ruff fixes 2023-08-15 14:33:17 +01:00
Alex
e593241d75 Support for hf models optimised for docsgpt 2023-08-15 14:14:49 +01:00
Alex
fcdc7b7aeb
Merge pull request #292 from arc53/dependabot/pip/application/cryptography-41.0.3
Bump cryptography from 41.0.2 to 41.0.3 in /application
2023-08-15 00:15:09 +01:00
Anton Larin
85f9ae5a0a fix packaging and imports and introduce tests with pytest.
still issues with celery worker.
2023-08-14 18:53:25 +02:00
Anton Larin
98a97f34f5 fix packaging and imports and introduce tests with pytest.
still issues with celery worker.
2023-08-14 18:20:25 +02:00
dependabot[bot]
98d647a3fe
Bump cryptography from 41.0.2 to 41.0.3 in /application
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.2 to 41.0.3.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.2...41.0.3)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-08-13 20:33:47 +00:00
Anton Larin
88d74235e1 1. remove unnecessary dependencies to speed up the build and reduce the downloads volume.
2. upgrade a couple of libraries
2023-08-13 21:48:24 +02:00
Anton Larin
36fa470348 1. remove unnecessary dependencies to speed up the build and reduce the downloads volume.
2. upgrade a couple of libraries
2023-08-13 21:28:48 +02:00
Alex
33dce10bc3
Merge pull request #296 from larinam/revert_breaking_renaming_azure_change
Revert "Changed environment variable names OPENAI_API_BASE and OPENAI…
2023-08-08 18:15:45 +01:00
Anton Larin
ac5ac3e9f1 Revert "Changed environment variable names OPENAI_API_BASE and OPENAI_API_VERSION to AZURE_OPENAI_API_BASE and AZURE_OPENAI_API_VERSION"
This reverts commit ce8b29e9d0.
2023-08-05 14:08:51 +02:00
Anton Larin
bed25b317c Fix min_tokens logic for grouping documents: documents with (lengh >= min_tokens) should not be grouped into one document for indexing 2023-08-05 13:18:52 +02:00
Pavel
1687e6682a
Merge pull request #290 from arc53/feature/hisotry
history
2023-07-26 22:26:11 +01:00
Alex
22572c8ed1 ruff fixes 2023-07-26 22:21:32 +01:00
Alex
382c3930a2 history 2023-07-26 22:14:54 +01:00
Alex
a64a30c088 fix 2023-07-24 16:23:49 +01:00
Alex
dac76a867f fix tokens for header 2023-07-24 16:14:08 +01:00
dependabot[bot]
a55280b941
Bump cryptography from 41.0.0 to 41.0.2 in /application
Bumps [cryptography](https://github.com/pyca/cryptography) from 41.0.0 to 41.0.2.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/41.0.0...41.0.2)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-07-15 01:25:02 +00:00
Rik Schoonbeek
ce8b29e9d0 Changed environment variable names OPENAI_API_BASE and OPENAI_API_VERSION to AZURE_OPENAI_API_BASE and AZURE_OPENAI_API_VERSION 2023-07-12 17:37:56 +02:00
Alex
b1a5068fd6
Merge pull request #254 from arc53/dependabot/pip/application/cryptography-41.0.0
Bump cryptography from 39.0.2 to 41.0.0 in /application
2023-06-28 00:40:17 +07:00
Alex
01fbd5d702
Merge pull request #247 from arc53/dependabot/pip/application/flask-2.2.5
Bump flask from 2.2.3 to 2.2.5 in /application
2023-06-28 00:31:30 +07:00
Alex
5e45268f68
Merge pull request #244 from arc53/dependabot/pip/application/requests-2.31.0
Bump requests from 2.28.2 to 2.31.0 in /application
2023-06-28 00:26:50 +07:00
Alex
c216bea031 Update app.py 2023-06-25 10:51:45 +07:00
Idan
2404899e28 Fixed request length bug, changed to as less used port 2023-06-23 14:56:14 +03:00
Anton Larin
0ff5f408d6 fix configuration to support streaming answer with Azure 2023-06-17 17:40:31 +02:00
Anton Larin
5eda42ff31 fix configuration to support streaming answer with Azure 2023-06-17 17:31:21 +02:00
Anton Larin
f5e287ffa6 optimized imports 2023-06-17 13:38:50 +02:00
Anton Larin
006897f1c0 Azure support for streaming output. 2023-06-17 13:20:29 +02:00
Anton Larin
968849e52b code readability, formatting, minor version bump 2023-06-17 12:42:05 +02:00
Alex
43c016f024 Update requirements.txt 2023-06-16 01:35:05 +01:00
dependabot[bot]
f2d2478dee
Bump transformers from 4.27.2 to 4.30.0 in /application
Bumps [transformers](https://github.com/huggingface/transformers) from 4.27.2 to 4.30.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v4.27.2...v4.30.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-15 16:53:40 +00:00
dependabot[bot]
87a5c8894a
Bump flask from 2.2.3 to 2.2.5 in /application
Bumps [flask](https://github.com/pallets/flask) from 2.2.3 to 2.2.5.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.2.3...2.2.5)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-15 16:53:35 +00:00
Alex
a57cdfff1e Update requirements.txt 2023-06-15 17:52:16 +01:00
Alex
d4ff6d4d7a minor fix 2023-06-15 17:40:58 +01:00
Levente Csoke
fce7d34171 Improve dev setup in README
Add needed packages in for dev setup in requirements.txt
2023-06-15 17:02:52 +02:00
Alex
94cc18bd71 fix for sending sources + azure embeddings issue 2023-06-15 11:35:21 +01:00
Alex
f209eebaf8
Merge pull request #255 from larinam/azure
Azure support #199
2023-06-12 20:15:18 +01:00
Alex
4889db78c9 Update .env_sample 2023-06-12 20:13:58 +01:00
Alex
bff200fede Sources by filename if available 2023-06-12 14:56:42 +01:00
Alex
610adcbefc Sources in responses 2023-06-11 22:56:34 +01:00
Anton Larin
0630504664
Merge branch 'main' into azure 2023-06-04 10:34:14 +02:00
Alex
577d58c92b less token less issues 2023-06-03 16:31:10 +01:00
Anton Larin
b4bd34fb96 fix arc53/DocsGPT#199 2023-06-03 10:58:31 +02:00
dependabot[bot]
014971262d
Bump cryptography from 39.0.2 to 41.0.0 in /application
Bumps [cryptography](https://github.com/pyca/cryptography) from 39.0.2 to 41.0.0.
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/39.0.2...41.0.0)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-06-02 20:20:32 +00:00
Alex
3f88b04c4a Update app.py 2023-05-31 23:49:41 +01:00
Alex
f8910ba136 Added history in streaming convo + fixed little bug with message margins on loading state 2023-05-31 23:47:16 +01:00
Alex
e6bccaaf4e Update app.py 2023-05-31 22:20:47 +01:00
Alex
3b8039a580
Merge branch 'main' into feature/streaming 2023-05-31 22:15:53 +01:00
Alex
fae3f55010 Working streaming 2023-05-31 17:44:20 +01:00
Alex
20c877f75b working fe 2023-05-31 15:42:17 +01:00
Alex
d2358c399d working version 2023-05-30 19:43:06 +01:00
Alex
c3af8a77af working streams 2023-05-29 17:55:43 +01:00
Alex
0b94f1717f
Merge pull request #246 from arc53/feature/gpt4all
Feature/gpt4all
2023-05-25 19:42:20 +01:00
Alex
aaa1249a41 model fix + env var 2023-05-25 19:33:37 +01:00
Alex
ffaa22c49b reverse history order to use latest history firts
Co-Authored-By: Pavel <32868631+pabik@users.noreply.github.com>
2023-05-25 16:40:11 +01:00
Alex
0b78480977 init 2023-05-25 15:14:47 +01:00
dependabot[bot]
78b85fb664
Bump requests from 2.28.2 to 2.31.0 in /application
Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.2...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-05-23 06:07:55 +00:00
Alex
6a68b63192 history fix 2023-05-19 13:09:41 +01:00
Alex
ff2e79fe7b streaming experiments 2023-05-18 23:52:59 +01:00
Alex
bc9f1c17ed History
Co-Authored-By: riccardofresi <89981746+riccardofresi@users.noreply.github.com>
2023-05-18 18:42:23 +01:00
Alex
74845aed64 history init 2023-05-18 14:27:13 +01:00
Alex
e49dd0cc6a metadata on ingestion 2023-05-17 21:41:24 +01:00
Alex
059ffe09ea
Merge pull request #232 from larinam/lint
Lint
2023-05-15 13:53:09 +01:00
GH Action - Upstream Sync
a73774099e Merge branch 'main' of https://github.com/arc53/DocsGPT 2023-05-15 11:03:45 +00:00
Alex
eef012b4d1
Merge pull request #225 from arc53/dependabot/pip/application/flask-2.3.2
Bump flask from 2.2.3 to 2.3.2 in /application
2023-05-15 11:58:54 +01:00
Alex
1417a1c020 Update requirements.txt 2023-05-15 11:49:41 +01:00
Anton Larin
962becb9a5
Linting
* validate python formatting on every build with Ruff
* fix lint warnings
2023-05-13 10:36:17 +02:00
Anton Larin
168648e789 Proper PEP8 formatting 2023-05-12 12:02:25 +02:00
dependabot[bot]
15fd54eac4
Bump flask from 2.2.3 to 2.3.2 in /application
Bumps [flask](https://github.com/pallets/flask) from 2.2.3 to 2.3.2.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](https://github.com/pallets/flask/compare/2.2.3...2.3.2)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-05-02 00:27:05 +00:00
Serj
31350e6302 Set celery and mongo urls as default 2023-04-30 11:03:09 +01:00
Serj
8742cdae0a Refactored url join 2023-04-30 10:46:52 +01:00
Serj
4efcb388ff Added settings usage to the worker 2023-04-29 15:58:02 +01:00
Serj
2d92e95c8a Added settings usage to the worker 2023-04-29 15:56:32 +01:00
Serj
47e5d5684a Replace other env variables in the file 2023-04-29 15:50:02 +01:00
Serj
b723e14d98 Added embeddings name variable 2023-04-29 15:46:09 +01:00
Serj
c9d24b8f42 Added llm model variable 2023-04-29 15:44:47 +01:00
Serj
43622e7ab1 Added settings file 2023-04-29 15:40:55 +01:00
Serge Kozloff
db4cdc901c
Merge pull request #1 from arc53/main
t
2023-04-26 18:55:39 +01:00
Serj
16a540b89b Expand readme and added port in wsgi 2023-04-26 18:54:59 +01:00
Alex
e00ec9ac3f Update chat_combine_prompt.txt 2023-04-26 15:01:46 +01:00
Alex
fc760afdfc Update chat_combine_prompt.txt 2023-04-26 14:54:26 +01:00
Alex
dbe9c4dc18 init 2023-04-25 17:01:44 +01:00
Alex
0c1a6a918d web widget 2023-04-23 15:07:55 +01:00
Alex
9395d2c091 celery load 2023-04-06 12:16:30 +01:00
Alex
60bb264663 async calls 2023-04-03 14:37:09 +01:00
dependabot[bot]
8a0f700563
Bump redis from 4.5.3 to 4.5.4 in /application
Bumps [redis](https://github.com/redis/redis-py) from 4.5.3 to 4.5.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.3...v4.5.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-31 14:31:03 +00:00
Alex
3d0c6eafec gpt4- compatable 2023-03-31 10:45:40 +01:00
Alex
09c7fe0565
Merge pull request #193 from arc53/dependabot/pip/application/redis-4.5.3
Bump redis from 4.5.2 to 4.5.3 in /application
2023-03-30 12:48:35 +01:00
Alex
b6dfb2c856 map_reduce 2023-03-30 12:44:25 +01:00
Alex
ab46ba521f different prompts 2023-03-29 18:36:58 +01:00
Alex
4a7670f2aa Update app.py 2023-03-29 17:32:00 +01:00
dependabot[bot]
24e98abd15
Bump redis from 4.5.2 to 4.5.3 in /application
Bumps [redis](https://github.com/redis/redis-py) from 4.5.2 to 4.5.3.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.2...v4.5.3)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-03-27 21:36:39 +00:00