Commit Graph

767 Commits

Author SHA1 Message Date
Will DePue
61de0c3b02 Improve code_search and get_embedding notebooks. (#717)
Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-15 16:54:29 -07:00
Will DePue
ddb0b1f6c2 Remove legacy transition guides from 2021/2022 (#718) 2023-09-15 16:47:08 -07:00
Nirant
57ecc44a0f 5x Error Reduction in RAG with gpt-3.5-turbo-0613 Finetuning (#678) 2023-09-12 09:09:23 +01:00
Simón Fishman
259757ea26 configure stale workflow (#708)
automatically close stale pull requests
2023-09-11 17:02:43 -07:00
dependabot[bot]
3eccaf6990 Bump ipython from 8.8.0 to 8.10.0 in /apps/web-crawl-q-and-a (#707)
Bumps [ipython](https://github.com/ipython/ipython) from 8.8.0 to 8.10.0.
- [Release notes](https://github.com/ipython/ipython/releases)
- [Commits](https://github.com/ipython/ipython/compare/8.8.0...8.10.0)

---
updated-dependencies:
- dependency-name: ipython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:45:35 -07:00
dependabot[bot]
3ef1adad6d Bump certifi from 2022.12.7 to 2023.7.22 in /apps/web-crawl-q-and-a (#693)
Bumps [certifi](https://github.com/certifi/python-certifi) from 2022.12.7 to 2023.7.22.
- [Commits](https://github.com/certifi/python-certifi/compare/2022.12.07...2023.07.22)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:37 -07:00
dependabot[bot]
ede95fea5a Bump semver from 6.3.0 to 6.3.1 in /apps/file-q-and-a/nextjs (#701)
Bumps [semver](https://github.com/npm/node-semver) from 6.3.0 to 6.3.1.
- [Release notes](https://github.com/npm/node-semver/releases)
- [Changelog](https://github.com/npm/node-semver/blob/v6.3.1/CHANGELOG.md)
- [Commits](https://github.com/npm/node-semver/compare/v6.3.0...v6.3.1)

---
updated-dependencies:
- dependency-name: semver
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:29 -07:00
dependabot[bot]
c3cabc1247 Bump word-wrap from 1.2.3 to 1.2.5 in /apps/file-q-and-a/nextjs (#700)
Bumps [word-wrap](https://github.com/jonschlinkert/word-wrap) from 1.2.3 to 1.2.5.
- [Release notes](https://github.com/jonschlinkert/word-wrap/releases)
- [Commits](https://github.com/jonschlinkert/word-wrap/compare/1.2.3...1.2.5)

---
updated-dependencies:
- dependency-name: word-wrap
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:22 -07:00
dependabot[bot]
79bdcf3fad Bump pygments from 2.14.0 to 2.15.0 in /apps/web-crawl-q-and-a (#699)
Bumps [pygments](https://github.com/pygments/pygments) from 2.14.0 to 2.15.0.
- [Release notes](https://github.com/pygments/pygments/releases)
- [Changelog](https://github.com/pygments/pygments/blob/master/CHANGES)
- [Commits](https://github.com/pygments/pygments/compare/2.14.0...2.15.0)

---
updated-dependencies:
- dependency-name: pygments
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:14 -07:00
dependabot[bot]
43d47e3835 Bump aiohttp from 3.8.3 to 3.8.5 in /apps/web-crawl-q-and-a (#696)
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.8.3 to 3.8.5.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/v3.8.5/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.8.3...v3.8.5)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:44:01 -07:00
dependabot[bot]
5e21010ac0 Bump requests from 2.28.1 to 2.31.0 in /apps/web-crawl-q-and-a (#706)
Bumps [requests](https://github.com/psf/requests) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:43:04 -07:00
dependabot[bot]
ec84d933d9 Bump redis from 4.5.1 to 4.5.4 in /apps/chatbot-kickstarter (#705)
Bumps [redis](https://github.com/redis/redis-py) from 4.5.1 to 4.5.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.1...v4.5.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:42:55 -07:00
dependabot[bot]
f96261cdd9 Bump transformers from 4.25.1 to 4.30.0 in /apps/web-crawl-q-and-a (#704)
Bumps [transformers](https://github.com/huggingface/transformers) from 4.25.1 to 4.30.0.
- [Release notes](https://github.com/huggingface/transformers/releases)
- [Commits](https://github.com/huggingface/transformers/compare/v4.25.1...v4.30.0)

---
updated-dependencies:
- dependency-name: transformers
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:42:17 -07:00
dependabot[bot]
466b262db9 Bump pipreqs from 0.4.11 to 0.4.12 in /apps/web-crawl-q-and-a (#703)
Bumps [pipreqs](https://github.com/bndr/pipreqs) from 0.4.11 to 0.4.12.
- [Release notes](https://github.com/bndr/pipreqs/releases)
- [Changelog](https://github.com/bndr/pipreqs/blob/master/HISTORY.rst)
- [Commits](https://github.com/bndr/pipreqs/compare/v0.4.11...v0.4.12)

---
updated-dependencies:
- dependency-name: pipreqs
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:41:47 -07:00
dependabot[bot]
37fae9af7e Bump tornado from 6.3.2 to 6.3.3 in /apps/web-crawl-q-and-a (#694)
Bumps [tornado](https://github.com/tornadoweb/tornado) from 6.3.2 to 6.3.3.
- [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst)
- [Commits](https://github.com/tornadoweb/tornado/compare/v6.3.2...v6.3.3)

---
updated-dependencies:
- dependency-name: tornado
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:41:38 -07:00
dependabot[bot]
6c4e65e604 Bump requests from 2.28.2 to 2.31.0 in /apps/chatbot-kickstarter (#702)
Bumps [requests](https://github.com/psf/requests) from 2.28.2 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.2...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:41:23 -07:00
dependabot[bot]
d9bee21797 Bump langchain in /apps/enterprise-knowledge-retrieval (#695)
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.158 to 0.0.246.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/commits)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:39:25 -07:00
dependabot[bot]
aadad4b5e0 Bump word-wrap in /apps/file-q-and-a/nextjs-with-flask-server/client (#697)
Bumps [word-wrap](https://github.com/jonschlinkert/word-wrap) from 1.2.3 to 1.2.5.
- [Release notes](https://github.com/jonschlinkert/word-wrap/releases)
- [Commits](https://github.com/jonschlinkert/word-wrap/compare/1.2.3...1.2.5)

---
updated-dependencies:
- dependency-name: word-wrap
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:39:14 -07:00
dependabot[bot]
dfd04222b7 Bump semver in /apps/file-q-and-a/nextjs-with-flask-server/client (#698)
Bumps [semver](https://github.com/npm/node-semver) from 6.3.0 to 6.3.1.
- [Release notes](https://github.com/npm/node-semver/releases)
- [Changelog](https://github.com/npm/node-semver/blob/v6.3.1/CHANGELOG.md)
- [Commits](https://github.com/npm/node-semver/compare/v6.3.0...v6.3.1)

---
updated-dependencies:
- dependency-name: semver
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:39:03 -07:00
Farzad Sunavala
792d0a2b31 Add Azure Cognitive Search vector database (#569)
* get started azuresearch

* master docs reference

* pablo comments

* replace placeholders with "_"

* azs latest sdk updates

* deep dive link

* openai feedback

* not print the whole vector in console

* cleanup outputs

* cleanup outputs pip
2023-09-11 16:34:15 -07:00
Matthew Jericho Go Sy
df231de7ff Fix File Q&A build error due to removed way of assigning options to the Formidable instance (#372)
* Pass maxFileSize attribute when instantiating IncomingForm()

Assigning a value through `form.maxFileSize` directly no longer works and will result in `Type error: Property 'maxFileSize' does not exist on type 'IncomingForm'.`

* Refactor Formidable instantiation acdg. to example shown in docs

Example usage acdg. to docs: e5e25d2fd9/README.md (formidable--incomingform)
2023-09-11 16:09:00 -07:00
dependabot[bot]
6ea0fa309a Bump tornado from 6.2 to 6.3.2 in /apps/web-crawl-q-and-a (#459)
Bumps [tornado](https://github.com/tornadoweb/tornado) from 6.2 to 6.3.2.
- [Changelog](https://github.com/tornadoweb/tornado/blob/master/docs/releases.rst)
- [Commits](https://github.com/tornadoweb/tornado/compare/v6.2.0...v6.3.2)

---
updated-dependencies:
- dependency-name: tornado
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-11 16:05:37 -07:00
DevilsWorkShop
88ef55ec0d Catch the exception thrown by the With.Open and continue with the queue (#155)
Co-authored-by: Ashok Manghat <amanghat@rmplc.net>
2023-09-11 15:55:57 -07:00
Alvaro Videla
5cb3f99f78 adds devcontainer support for file-q-and-a app (#218) 2023-09-11 15:51:02 -07:00
dongqqcom
c0b73ad88f Add Tair to examples of vector database (#609)
* Add Tair to examples of vector database

* remove hardcoding API keys

* Update examples/vector_databases/tair/Getting_started_with_Tair_and_OpenAI.ipynb

Co-authored-by: Simón Fishman <simonpfish@gmail.com>

* fix: input api key by getpass

* update: input api key by getpass

* update: Adding output of code cells

---------

Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-09-11 15:16:00 -07:00
Krista Pratico
02ca6194d0 [azure] bring your own data example (#654)
* initial commit for bring your own data notebook

* fix words

* add version

* add output from stream

* address review feedback

* edit intro
2023-09-11 15:12:37 -07:00
Puneet Dhiman
d835b8dfef Correct spelling mistake in Search_reranking_with_cross-encoders.ipynb (#675) 2023-09-11 15:10:17 -07:00
Stefano Lottini
b46cba2a23 Updates to CassIO notebook (#684) 2023-09-11 14:59:09 -07:00
Steven Pousty
3f567dad34 small typoe fix (#688) 2023-09-11 14:57:09 -07:00
Shawn Yuxuan Tong
00eb708905 Update readme specifying Java support of Sematic Kernel (#689)
Sematic Kernel now supports Java.
2023-09-11 14:56:22 -07:00
ys64
e25e475035 add the last chunk to the list of chunks in web-qa.ipynb (#691) 2023-09-11 14:54:40 -07:00
Simón Fishman
68772a70ae add descriptions to fine-tuning dataprep notebook (#673) 2023-09-02 08:26:55 -07:00
Simón Fishman
3119e772b9 clarify title (#672) 2023-09-01 10:14:11 -07:00
Will DePue
6fa65ef615 Update Customizing_embeddings.ipynb to be delete long cache output. (#667)
* patch

* remove print statement

---------

Co-authored-by: simonpfish <simonpfish@gmail.com>
2023-08-29 17:50:15 -07:00
Simón Fishman
d0c9afcac0 Revert "File name sanitization (#630)" (#668)
This reverts commit 169f5e02c8.
2023-08-29 17:45:47 -07:00
Stefano Lottini
f3990b8a8f Add Cassandra/Astra DB to the vector databases README (#665)
* Add Cassandra/Astra DB to the vector databases overall README

* Linking to a basic quickstart instead
2023-08-29 15:20:51 -07:00
Liam Thompson
cafe312611 Add elasticsearch examples to vector databases folder (#622)
* Add Elasticsearch to vector databases, add notebooks

* Update prompt

* Make intro verbiage more neutral

* Add semantic search notebook outputs

* Add RAG notebook output

* Update query

* Remove unreadable vector output
2023-08-29 10:54:08 -07:00
Safa Asgar
80a2307be0 File name sanitization (#630)
* File name sanitization

URL containing reserved characters blocks file name creation.

* Regular Expression fix for Sanitized URL

Co-authored-by: Simón Fishman <simonpfish@gmail.com>

---------

Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-08-29 10:49:23 -07:00
Stefano Lottini
dc5bf03450 Add Astra DB (/Cassandra) to vector databases with example notebooks (#655)
* first commit for the Astra DB / Cassandra notebooks

* add json with quotes

* towards the final cassIO pilot notebook

* small changes to the copy

* cassIO pilot completed and its readme done

* fix silly markdown error

* fix silly markdown error 2

* astra vector link change and vector search picture improved

* added link to docs for connecting to Cassandra cluster

* CQL version of the flow

* revised readme

* final adjustments around metrics/distances

* links' final version assumes files in openai's main branch

* Add ref to QA+vector general guide; fix prompt; clarified conclusion paragraph; typos
2023-08-29 10:27:49 -07:00
Simón Fishman
88d47a1678 update semantic kernel link (#662)
the previous link pointed to a blog with multiple articles. this is a clearer link to point to
2023-08-28 18:32:29 -07:00
recordcrash
d9b4acd1b8 Fix UTF-8 encoding in Chat_finetuning_data_prep.ipynb (#648) 2023-08-28 18:12:30 -07:00
Eliah Kagan
1b3ef07d3e Add Tiktokenizer link in "How to count tokens" (#604)
This adds a link to Tiktokenizer webapp as another tool, in
addition to the OpenAI Tokenizer.
2023-08-28 10:28:19 -07:00
Christine Belzie
a4913d39dd [revise] small edits and fixed typos (#510)
* [revise] made small edits and fixed typos

* fix: revert back to original descriptions

* small language updates

---------

Co-authored-by: Simón Fishman <simonpfish@gmail.com>
2023-08-25 13:08:49 -07:00
Viet Hoang Tran Duong
7e40a56075 fix undefined variables in fine tune example (#660)
`create_user_message` and `test_df` are not defined.
2023-08-25 13:03:06 -07:00
Simón Fishman
c6c92acb2b update titles (#653) 2023-08-22 16:32:43 -07:00
Simón Fishman
bda60c1008 more fine-tuning improvements (#652)
* more fine-tuning improvements

* add links to other resources
2023-08-22 16:27:08 -07:00
Simón Fishman
3fac4b95d2 small improvements to the fine-tuning cookbook (#651) 2023-08-22 15:30:03 -07:00
Logan Kilpatrick
843ac20701 update readme to link fine-tuning guide (#650) 2023-08-22 14:09:03 -07:00
simonpfish
aa2b5ba709 update fine-tuning cookbook 2023-08-22 13:48:39 -07:00
Michael Wu
d639ac8f27 add ft data prep notebook (#647) 2023-08-22 12:24:42 -07:00