Archives
/
openai-cookbook
mirror of https://github.com/openai/openai-cookbook
2
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
main
revert-1014-origin/jbeutler/embeddings-sdk-update
charu/assistants_streaming
ankur/fix-pinecone-embeddings-notebook
katia/pdf-analysis
james/sdk_updates
james/quick_fix_notebook
katia/graphdb
colin/testing_sql_generation
jhills20-patch-1
james/making_slides
colin/guardrails
james/even_more_sdk_updates
feature/rz/UpdateToUsePythonSDK
ilan/assistants_overview_bugs
ilan/assistants_api_overview
applied-research/custom-tokenizer-model
ilan/structured_output
shyamal-chained-func-spec
chained-func-calling
cathykc/add-py-file
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'f1e13cfcc7'
${ noResults }
openai-cookbook/examples/vector_databases/pinecone/Semantic_Search.ipynb

4639 lines
208 KiB
Plaintext
Raw Blame History Unescape Escape

This file contains invisible Unicode characters!

This file contains invisible Unicode characters that may be processed differently from what appears below. If your use case is intentional and legitimate, you can safely ignore this warning. Use the Escape button to reveal hidden characters.

{
"cells": [
{
"attachments": {},
"cell_type": "markdown",
"metadata": {
"id": "izNeUi--hSSA"
},
"source": [
"# Semantic Search with Pinecone and OpenAI"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "LI76-BMFhUmS"
},
"source": [
"In this guide you will learn how to use the OpenAI Embedding API to generate language embeddings, and then index those embeddings in the Pinecone vector database for fast and scalable vector search.\n",
"\n",
"This is a powerful and common combination for building semantic search, question-answering, threat-detection, and other applications that rely on NLP and search over a large corpus of text data.\n",
"\n",
"The basic workflow looks like this:\n",
"\n",
"**Embed and index**\n",
"\n",
"* Use the OpenAI Embedding API to generate vector embeddings of your documents (or any text data).\n",
"* Upload those vector embeddings into Pinecone, which can store and index millions/billions of these vector embeddings, and search through them at ultra-low latencies.\n",
"\n",
"**Search**\n",
"\n",
"* Pass your query text or document through the OpenAI Embedding API again.\n",
"* Take the resulting vector embedding and send it as a query to Pinecone.\n",
"* Get back semantically similar documents, even if they don't share any keywords with the query.\n",
"\n",
"![Architecture overview](https://files.readme.io/6a3ea5a-pinecone-openai-overview.png)\n",
"\n",
"Let's get started..."
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "nXzzYE0hhU64"
},
"source": [
"## Setup"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "FNk3hfyAtRNj"
},
"source": [
"We first need to setup our environment and retrieve API keys for OpenAI and Pinecone. Let's start with our environment, we need HuggingFace *Datasets* for our data, and the OpenAI and Pinecone clients:"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "SGQoz_JmtRNh",
"outputId": "389c79fc-2ee9-452b-fc58-9598899090c2"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n",
"Collecting pinecone-client\n",
" Downloading pinecone_client-2.0.13-py3-none-any.whl (175 kB)\n",
"\u001b[K |████████████████████████████████| 175 kB 4.9 MB/s \n",
"\u001b[?25hCollecting openai\n",
" Downloading openai-0.25.0.tar.gz (44 kB)\n",
"\u001b[K |████████████████████████████████| 44 kB 2.1 MB/s \n",
"\u001b[?25h Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n",
" Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n",
" Preparing wheel metadata ... \u001b[?25l\u001b[?25hdone\n",
"Collecting datasets\n",
" Downloading datasets-2.8.0-py3-none-any.whl (452 kB)\n",
"\u001b[K |████████████████████████████████| 452 kB 59.5 MB/s \n",
"\u001b[?25hRequirement already satisfied: urllib3>=1.21.1 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (1.24.3)\n",
"Requirement already satisfied: python-dateutil>=2.5.3 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (2.8.2)\n",
"Collecting loguru>=0.5.0\n",
" Downloading loguru-0.6.0-py3-none-any.whl (58 kB)\n",
"\u001b[K |████████████████████████████████| 58 kB 4.9 MB/s \n",
"\u001b[?25hRequirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (2.23.0)\n",
"Requirement already satisfied: dnspython>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (2.2.1)\n",
"Requirement already satisfied: pyyaml>=5.4 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (6.0)\n",
"Requirement already satisfied: typing-extensions>=3.7.4 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (4.4.0)\n",
"Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.5.3->pinecone-client) (1.15.0)\n",
"Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pinecone-client) (2022.12.7)\n",
"Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pinecone-client) (2.10)\n",
"Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pinecone-client) (3.0.4)\n",
"Requirement already satisfied: numpy in /usr/local/lib/python3.8/dist-packages (from openai) (1.21.6)\n",
"Requirement already satisfied: pandas>=1.2.3 in /usr/local/lib/python3.8/dist-packages (from openai) (1.3.5)\n",
"Requirement already satisfied: openpyxl>=3.0.7 in /usr/local/lib/python3.8/dist-packages (from openai) (3.0.10)\n",
"Collecting pandas-stubs>=1.1.0.11\n",
" Downloading pandas_stubs-1.5.2.221213-py3-none-any.whl (147 kB)\n",
"\u001b[K |████████████████████████████████| 147 kB 60.7 MB/s \n",
"\u001b[?25hRequirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from openai) (4.64.1)\n",
"Requirement already satisfied: et-xmlfile in /usr/local/lib/python3.8/dist-packages (from openpyxl>=3.0.7->openai) (1.1.0)\n",
"Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas>=1.2.3->openai) (2022.6)\n",
"Collecting types-pytz>=2022.1.1\n",
" Downloading types_pytz-2022.7.0.0-py3-none-any.whl (4.7 kB)\n",
"Collecting responses<0.19\n",
" Downloading responses-0.18.0-py3-none-any.whl (38 kB)\n",
"Requirement already satisfied: pyarrow>=6.0.0 in /usr/local/lib/python3.8/dist-packages (from datasets) (9.0.0)\n",
"Requirement already satisfied: dill<0.3.7 in /usr/local/lib/python3.8/dist-packages (from datasets) (0.3.6)\n",
"Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from datasets) (21.3)\n",
"Requirement already satisfied: aiohttp in /usr/local/lib/python3.8/dist-packages (from datasets) (3.8.3)\n",
"Collecting huggingface-hub<1.0.0,>=0.2.0\n",
" Downloading huggingface_hub-0.11.1-py3-none-any.whl (182 kB)\n",
"\u001b[K |████████████████████████████████| 182 kB 44.4 MB/s \n",
"\u001b[?25hRequirement already satisfied: fsspec[http]>=2021.11.1 in /usr/local/lib/python3.8/dist-packages (from datasets) (2022.11.0)\n",
"Collecting multiprocess\n",
" Downloading multiprocess-0.70.14-py38-none-any.whl (132 kB)\n",
"\u001b[K |████████████████████████████████| 132 kB 66.5 MB/s \n",
"\u001b[?25hCollecting xxhash\n",
" Downloading xxhash-3.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (212 kB)\n",
"\u001b[K |████████████████████████████████| 212 kB 70.9 MB/s \n",
"\u001b[?25hRequirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (22.1.0)\n",
"Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (1.3.1)\n",
"Requirement already satisfied: charset-normalizer<3.0,>=2.0 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (2.1.1)\n",
"Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (1.8.2)\n",
"Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (1.3.3)\n",
"Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (6.0.3)\n",
"Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (4.0.2)\n",
"Requirement already satisfied: filelock in /usr/local/lib/python3.8/dist-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets) (3.8.2)\n",
"Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->datasets) (3.0.9)\n",
"Collecting urllib3>=1.21.1\n",
" Downloading urllib3-1.25.11-py2.py3-none-any.whl (127 kB)\n",
"\u001b[K |████████████████████████████████| 127 kB 45.2 MB/s \n",
"\u001b[?25hBuilding wheels for collected packages: openai\n",
" Building wheel for openai (PEP 517) ... \u001b[?25l\u001b[?25hdone\n",
" Created wheel for openai: filename=openai-0.25.0-py3-none-any.whl size=55880 sha256=f688888b29b707528c920841652705ab00a881bb4221ec48325e82d2b59d05a5\n",
" Stored in directory: /root/.cache/pip/wheels/4b/92/33/6f57c7aae0b16875267999a50570e81f15eecec577ebe05a2e\n",
"Successfully built openai\n",
"Installing collected packages: urllib3, types-pytz, xxhash, responses, pandas-stubs, multiprocess, loguru, huggingface-hub, pinecone-client, openai, datasets\n",
" Attempting uninstall: urllib3\n",
" Found existing installation: urllib3 1.24.3\n",
" Uninstalling urllib3-1.24.3:\n",
" Successfully uninstalled urllib3-1.24.3\n",
"Successfully installed datasets-2.8.0 huggingface-hub-0.11.1 loguru-0.6.0 multiprocess-0.70.14 openai-0.25.0 pandas-stubs-1.5.2.221213 pinecone-client-2.0.13 responses-0.18.0 types-pytz-2022.7.0.0 urllib3-1.25.11 xxhash-3.1.0\n"
]
}
],
"source": [
"!pip install -qU pinecone-client openai datasets"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "IMp0TQ24tRNm"
},
"source": [
"### Creating Embeddings\n",
"\n",
"Then we initialize our connection to OpenAI Embeddings *and* Pinecone vector DB. Sign up for an API key over at [OpenAI](https://beta.openai.com/signup) and [Pinecone](https://app.pinecone.io)."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "yo5uw4sPtRNn",
"outputId": "92914528-696d-4598-dbb3-04457a0eba86"
},
"outputs": [
{
"data": {
"text/plain": [
"<OpenAIObject list at 0x7f98f1d704a0> JSON: {\n",
" \"data\": [\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"babbage\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"ada\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"davinci\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"babbage-code-search-code\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-similarity-babbage-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-davinci-003\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-internal\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-davinci-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"curie-instruct-beta\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"babbage-code-search-text\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"babbage-similarity\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"curie-search-query\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-search-babbage-text-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-cushman-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-search-babbage-code-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-ada-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-similarity-ada-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-davinci-insert-002\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-embedding-ada-002\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-internal\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"ada-code-search-code\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"ada-similarity\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-search-ada-text-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-ada-query-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-curie-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-davinci-edit-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"davinci-search-document\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"ada-code-search-text\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-ada-doc-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-davinci-edit-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"davinci-instruct-beta\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-babbage-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-similarity-curie-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-search-ada-code-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"ada-search-query\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-davinci-query-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"curie-similarity\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"davinci-search-query\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-davinci-insert-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"babbage-search-document\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"ada-search-document\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"curie\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-babbage-doc-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-davinci-002\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-curie-doc-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-curie-query-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"babbage-search-query\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-davinci-doc-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"code-davinci-002\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-search-babbage-query-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"curie-search-document\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"text-similarity-davinci-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"audio-transcribe-001\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" },\n",
" {\n",
" \"created\": null,\n",
" \"id\": \"davinci-similarity\",\n",
" \"object\": \"engine\",\n",
" \"owner\": \"openai-dev\",\n",
" \"permissions\": null,\n",
" \"ready\": true\n",
" }\n",
" ],\n",
" \"object\": \"list\"\n",
"}"
]
},
"execution_count": 3,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"import openai\n",
"\n",
"openai.api_key = \"OPENAI_API_KEY\"\n",
"# get API key from top-right dropdown on OpenAI website\n",
"\n",
"openai.Engine.list() # check we have authenticated"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "pw8cbO3HtRNo"
},
"source": [
"We can now create embeddings with the OpenAI Ada similarity model like so:"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "Hg0yIGu3tRNo",
"outputId": "58fb10c1-53f0-4dd1-b0fd-14491d4decf3"
},
"outputs": [
{
"data": {
"text/plain": [
"<OpenAIObject list at 0x7f98efba5130> JSON: {\n",
" \"data\": [\n",
" {\n",
" \"embedding\": [\n",
" -0.003040769835934043,\n",
" 0.011684642173349857,\n",
" -0.005026957020163536,\n",
" -0.027237210422754288,\n",
" -0.016361193731427193,\n",
" 0.03234503045678139,\n",
" -0.016159038990736008,\n",
" -0.001036894042044878,\n",
" -0.025822116062045097,\n",
" -0.00666779326274991,\n",
" 0.02014825865626335,\n",
" 0.016657691448926926,\n",
" -0.009164425544440746,\n",
" 0.023423193022608757,\n",
" -0.0101212989538908,\n",
" 0.01344340294599533,\n",
" 0.02522912435233593,\n",
" -0.016873324289917946,\n",
" 0.012115909717977047,\n",
" -0.016361193731427193,\n",
" -0.00426887022331357,\n",
" -0.006502698641270399,\n",
" -0.004369948524981737,\n",
" 0.020808637142181396,\n",
" -0.01053908932954073,\n",
" -0.003652293002232909,\n",
" 0.01369272917509079,\n",
" -0.026361199095845222,\n",
" -0.0003171329153701663,\n",
" -0.0022186669521033764,\n",
" 0.005822105333209038,\n",
" -0.010087606497108936,\n",
" -0.028221039101481438,\n",
" -0.016159038990736008,\n",
" -0.0042183310724794865,\n",
" 0.007466311100870371,\n",
" -0.0029228453058749437,\n",
" -0.031455542892217636,\n",
" 0.023881414905190468,\n",
" -0.03328842669725418,\n",
" -0.0003649345017038286,\n",
" 0.013072783127427101,\n",
" 0.00707547552883625,\n",
" -0.005680595990270376,\n",
" 0.003106470685452223,\n",
" -0.02981133572757244,\n",
" 0.026293814182281494,\n",
" -0.0046428595669567585,\n",
" 0.006607146468013525,\n",
" 0.017493270337581635,\n",
" 0.027331551536917686,\n",
" 0.01578168012201786,\n",
" -0.022196777164936066,\n",
" 0.0028537751641124487,\n",
" -0.006489221937954426,\n",
" 0.00639151269569993,\n",
" -0.01698114164173603,\n",
" 0.020067395642399788,\n",
" 0.0034838293213397264,\n",
" -0.003507414134219289,\n",
" -0.001061321352608502,\n",
" 0.0035781690385192633,\n",
" -0.0026583571452647448,\n",
" -0.012473052367568016,\n",
" -0.018072785809636116,\n",
" -0.03520217537879944,\n",
" -0.03172508254647255,\n",
" 0.007574127987027168,\n",
" 0.00706199835985899,\n",
" 0.005582887213677168,\n",
" 0.02067386545240879,\n",
" 0.011010787449777126,\n",
" -0.011590302921831608,\n",
" -0.01738545298576355,\n",
" 0.00665431609377265,\n",
" 0.010181945748627186,\n",
" -0.012075478211045265,\n",
" -0.012419143691658974,\n",
" 0.0002756487228907645,\n",
" -0.0010975409531965852,\n",
" 0.004612536169588566,\n",
" -0.026603788137435913,\n",
" -0.002378707518801093,\n",
" 0.032048534601926804,\n",
" 0.00907682441174984,\n",
" 0.014083565212786198,\n",
" 0.018261464312672615,\n",
" 0.029029665514826775,\n",
" -0.02107817865908146,\n",
" -0.017277637496590614,\n",
" -0.005960245616734028,\n",
" 0.015822110697627068,\n",
" -0.004326147958636284,\n",
" 0.016994617879390717,\n",
" -0.013234508223831654,\n",
" 0.022008098661899567,\n",
" -0.005380730610340834,\n",
" 0.02433963492512703,\n",
" 0.0037938025780022144,\n",
" -0.04102427884936333,\n",
" 0.008456877432763577,\n",
" 0.009885449893772602,\n",
" -0.01210917066782713,\n",
" -0.010256069712340832,\n",
" -0.03935312107205391,\n",
" 0.005710919387638569,\n",
" 0.016226423904299736,\n",
" -0.014824805781245232,\n",
" 0.01609165221452713,\n",
" 0.014407015405595303,\n",
" -0.021401628851890564,\n",
" 0.012628039345145226,\n",
" -0.004541781265288591,\n",
" -0.03326147422194481,\n",
" 0.014218335971236229,\n",
" 0.004636120982468128,\n",
" -0.004423856735229492,\n",
" -0.021927235648036003,\n",
" 0.0011666110949590802,\n",
" -0.005215635988861322,\n",
" -0.0133086321875453,\n",
" 0.02609165757894516,\n",
" 0.04000002145767212,\n",
" -0.016442056745290756,\n",
" 0.014029656536877155,\n",
" 0.023679258301854134,\n",
" -0.005117927212268114,\n",
" -0.031859856098890305,\n",
" 0.0127695482224226,\n",
" -0.005963615141808987,\n",
" 0.018099740147590637,\n",
" 0.042479805648326874,\n",
" 0.024258773773908615,\n",
" 0.02055257186293602,\n",
" -0.02824799343943596,\n",
" 0.01880054920911789,\n",
" -0.04541781544685364,\n",
" 0.01913747563958168,\n",
" -0.021832896396517754,\n",
" -0.01747979409992695,\n",
" 0.00892183743417263,\n",
" 0.03493263199925423,\n",
" -0.0062028332613408566,\n",
" -0.0062702191062271595,\n",
" 0.006856472697108984,\n",
" 0.011192727833986282,\n",
" 0.0006890165386721492,\n",
" -0.021051224321126938,\n",
" 0.010862539522349834,\n",
" -0.013840978033840656,\n",
" 0.010849062353372574,\n",
" 0.002424192614853382,\n",
" -0.007082214113324881,\n",
" 0.012021569535136223,\n",
" 0.0036792471073567867,\n",
" 0.026239905506372452,\n",
" 0.012432620860636234,\n",
" -0.0038712958339601755,\n",
" -0.011327499523758888,\n",
" -0.0205256175249815,\n",
" 0.008119950070977211,\n",
" 0.014528309926390648,\n",
" 0.019393540918827057,\n",
" -0.010040436871349812,\n",
" 0.010424533858895302,\n",
" 0.04137468338012695,\n",
" 0.002656672615557909,\n",
" -0.010761461220681667,\n",
" 0.00036177580477669835,\n",
" -0.01762804202735424,\n",
" -0.024474406614899635,\n",
" 0.016940709203481674,\n",
" -0.04568735510110855,\n",
" 0.004164422862231731,\n",
" -0.03309974819421768,\n",
" 0.024622654542326927,\n",
" 0.014932622201740742,\n",
" 0.014986530877649784,\n",
" -0.00907682441174984,\n",
" -0.02316712774336338,\n",
" -0.01978437788784504,\n",
" 0.008018871769309044,\n",
" 0.01183289010077715,\n",
" 0.03725069388747215,\n",
" -0.0365498848259449,\n",
" -0.003682616399601102,\n",
" -0.015606476925313473,\n",
" 0.0004885447560809553,\n",
" 0.002633087569847703,\n",
" 0.0006751182954758406,\n",
" 0.008018871769309044,\n",
" 0.010417794808745384,\n",
" 0.004989895038306713,\n",
" -0.023531010374426842,\n",
" -0.690889835357666,\n",
" -0.02119947224855423,\n",
" -0.003746632719412446,\n",
" -0.011731811799108982,\n",
" 0.025714298710227013,\n",
" 0.020660387352108955,\n",
" 0.011711596511304379,\n",
" 0.010168468579649925,\n",
" -0.010404318571090698,\n",
" 0.01413747388869524,\n",
" -0.02314017340540886,\n",
" 0.005343668628484011,\n",
" -0.01093666348606348,\n",
" -0.0029683304019272327,\n",
" -0.017574133351445198,\n",
" -0.01892184279859066,\n",
" 0.0001869947009254247,\n",
" 0.003780325409024954,\n",
" -0.0191644299775362,\n",
" 0.007863885723054409,\n",
" 0.00020205114560667425,\n",
" 0.013497311621904373,\n",
" -0.028975756838917732,\n",
" 0.01375337690114975,\n",
" 0.01249326765537262,\n",
" -0.0008625341579318047,\n",
" 0.004986525513231754,\n",
" -0.016442056745290756,\n",
" 0.002911052666604519,\n",
" 0.024326158687472343,\n",
" -0.037493281066417694,\n",
" -0.011111865751445293,\n",
" -0.005070757586508989,\n",
" 0.022466318681836128,\n",
" 0.053800567984580994,\n",
" -0.00015077501302585006,\n",
" -0.00010065706010209396,\n",
" -0.00733154034242034,\n",
" 0.01130728330463171,\n",
" 0.013221031054854393,\n",
" -0.018315372988581657,\n",
" -0.017466315999627113,\n",
" 0.0060950168408453465,\n",
" -0.015916449949145317,\n",
" -0.0014260452007874846,\n",
" 0.0016214631032198668,\n",
" 0.029946107417345047,\n",
" 0.011617256328463554,\n",
" 0.01772238127887249,\n",
" 0.02726416476070881,\n",
" -0.005569410044699907,\n",
" 0.0010242592543363571,\n",
" 0.015552569180727005,\n",
" -0.005997307598590851,\n",
" 0.011913753114640713,\n",
" 0.001964286668226123,\n",
" 0.036657702177762985,\n",
" -0.024407021701335907,\n",
" 0.016509443521499634,\n",
" 0.026805944740772247,\n",
" 0.005215635988861322,\n",
" 0.022668475285172462,\n",
" -0.014501355588436127,\n",
" -0.017870629206299782,\n",
" -0.005842321086674929,\n",
" 0.006758763454854488,\n",
" -0.009946096688508987,\n",
" 0.003857818664982915,\n",
" 0.027466321364045143,\n",
" -0.014743942767381668,\n",
" 0.011132081039249897,\n",
" 0.018867934122681618,\n",
" -0.020916452631354332,\n",
" -0.024326158687472343,\n",
" 0.005609841085970402,\n",
" 0.011893536895513535,\n",
" 0.013760115019977093,\n",
" -0.00504717230796814,\n",
" -0.011266852729022503,\n",
" 0.016657691448926926,\n",
" 0.018544483929872513,\n",
" 0.007944747805595398,\n",
" -0.03700810670852661,\n",
" -0.015539092011749744,\n",
" 0.018787071108818054,\n",
" -0.0038679265417158604,\n",
" -0.04196767881512642,\n",
" -0.006495960522443056,\n",
" 0.0021041117142885923,\n",
" 0.009097039699554443,\n",
" 0.009959573857486248,\n",
" 0.021522922441363335,\n",
" -0.006563345901668072,\n",
" 0.006933965720236301,\n",
" 0.005020218435674906,\n",
" 0.01147574745118618,\n",
" -0.0029733842238783836,\n",
" 0.006526283919811249,\n",
" 0.009245287626981735,\n",
" -0.0056401644833385944,\n",
" 0.002274259924888611,\n",
" 0.024353113025426865,\n",
" -0.0141509510576725,\n",
" 0.006994612980633974,\n",
" 0.030566053465008736,\n",
" 0.0018547853687778115,\n",
" -0.0020518878009170294,\n",
" 0.011226421222090721,\n",
" 0.016967663541436195,\n",
" -0.01401618029922247,\n",
" 0.0027459582779556513,\n",
" -0.0002371126611251384,\n",
" -0.008605125360190868,\n",
" -0.024110523983836174,\n",
" -0.01695418730378151,\n",
" -0.031455542892217636,\n",
" 0.011792458593845367,\n",
" 0.00040431288653053343,\n",
" 0.015309981070458889,\n",
" 0.009656338952481747,\n",
" 0.019757423549890518,\n",
" 0.010181945748627186,\n",
" -0.0026920498348772526,\n",
" 0.0007361863972619176,\n",
" 0.015539092011749744,\n",
" 0.006677900906652212,\n",
" -0.010721029713749886,\n",
" -0.03239893913269043,\n",
" -0.0028672521002590656,\n",
" -0.011974399909377098,\n",
" -0.011933968402445316,\n",
" 0.002774597145617008,\n",
" 0.04528304189443588,\n",
" -0.0163072869181633,\n",
" 0.013497311621904373,\n",
" 0.004285716451704502,\n",
" 0.01913747563958168,\n",
" -0.006320758257061243,\n",
" -0.005384099669754505,\n",
" -0.014110519550740719,\n",
" -0.02350405603647232,\n",
" 0.014946099370718002,\n",
" -0.006893534678965807,\n",
" -0.011098388582468033,\n",
" 0.009770894423127174,\n",
" -0.020296506583690643,\n",
" -0.024663085117936134,\n",
" -0.0022136131301522255,\n",
" 0.003948789089918137,\n",
" -0.004474395886063576,\n",
" -0.011226421222090721,\n",
" -0.010518873110413551,\n",
" -0.0234771016985178,\n",
" 0.006485852412879467,\n",
" 0.004140837583690882,\n",
" -0.004979786928743124,\n",
" 0.006071431562304497,\n",
" -0.028140176087617874,\n",
" -0.010343670845031738,\n",
" -0.013018874451518059,\n",
" 0.004083560314029455,\n",
" 0.018544483929872513,\n",
" -0.022722383961081505,\n",
" -0.0006540603353641927,\n",
" -0.009225072339177132,\n",
" -0.020714296028017998,\n",
" -0.026266859844326973,\n",
" 0.020498663187026978,\n",
" -0.011711596511304379,\n",
" -0.030566053465008736,\n",
" -0.005087603814899921,\n",
" -0.012567391619086266,\n",
" -0.00113460305146873,\n",
" -0.0010453172726556659,\n",
" 0.0146900350227952,\n",
" -0.015175210312008858,\n",
" -0.02043127827346325,\n",
" 0.0011447108117863536,\n",
" 0.027398936450481415,\n",
" -0.02587602473795414,\n",
" 0.011502701789140701,\n",
" 0.014528309926390648,\n",
" 0.016940709203481674,\n",
" 0.01590297371149063,\n",
" 0.021320765838027,\n",
" 0.012985181994736195,\n",
" 0.0015776625368744135,\n",
" 0.01597035862505436,\n",
" -0.015552569180727005,\n",
" -0.0023669148795306683,\n",
" 0.02086254395544529,\n",
" -0.0060208928771317005,\n",
" -0.010390841402113438,\n",
" 0.013086260296404362,\n",
" -0.005616579670459032,\n",
" 0.004299193620681763,\n",
" -0.02270890772342682,\n",
" 0.017398931086063385,\n",
" 0.018867934122681618,\n",
" 0.0002486945304553956,\n",
" 0.021495968103408813,\n",
" 0.0082479827105999,\n",
" 0.014110519550740719,\n",
" -0.010026959702372551,\n",
" 0.003158694365993142,\n",
" -0.03398923575878143,\n",
" -0.0035411070566624403,\n",
" -0.025929933413863182,\n",
" 0.009433967061340809,\n",
" 0.012041785754263401,\n",
" 0.0033372659236192703,\n",
" -0.02033693715929985,\n",
" -0.02698114700615406,\n",
" 0.0040060668252408504,\n",
" 0.010188684798777103,\n",
" 0.020053919404745102,\n",
" -0.0038746651262044907,\n",
" -0.0036960935685783625,\n",
" -0.001314859138801694,\n",
" 0.001159030245617032,\n",
" 0.008611864410340786,\n",
" -0.006297172978520393,\n",
" 0.017924537882208824,\n",
" -0.0069811358116567135,\n",
" -0.007749330252408981,\n",
" 0.019460925832390785,\n",
" 0.016159038990736008,\n",
" 0.037493281066417694,\n",
" 0.011051218956708908,\n",
" -0.014609172008931637,\n",
" -0.0009273926843889058,\n",
" 0.0055289785377681255,\n",
" -0.0012744278647005558,\n",
" -0.00035609013866633177,\n",
" 0.027062008157372475,\n",
" 0.013261462561786175,\n",
" 0.0192587710916996,\n",
" -0.016792461276054382,\n",
" 0.03894880786538124,\n",
" -0.005946768447756767,\n",
" -0.0163072869181633,\n",
" 0.021320765838027,\n",
" 0.021361196413636208,\n",
" -0.013274939730763435,\n",
" 0.014433969743549824,\n",
" -0.02199462056159973,\n",
" 0.015175210312008858,\n",
" 0.01997305639088154,\n",
" -0.008119950070977211,\n",
" 0.00042705549276433885,\n",
" 0.0014075142098590732,\n",
" 0.01350405067205429,\n",
" -0.008025610819458961,\n",
" 0.013557958416640759,\n",
" 0.026698127388954163,\n",
" -0.0068598417565226555,\n",
" -0.0015936666168272495,\n",
" 0.010080867446959019,\n",
" 0.004905662965029478,\n",
" 0.016266854479908943,\n",
" 0.01858491636812687,\n",
" -0.013092998415231705,\n",
" -0.0033204194623976946,\n",
" 0.004949463531374931,\n",
" 0.02086254395544529,\n",
" -0.006832887884229422,\n",
" -0.0023534379433840513,\n",
" -0.004962940700352192,\n",
" -0.017857152968645096,\n",
" 0.0005925710429437459,\n",
" 0.005033695604652166,\n",
" -0.012850411236286163,\n",
" 0.012917796149849892,\n",
" -0.0172911137342453,\n",
" 0.021832896396517754,\n",
" 0.008450139313936234,\n",
" 0.016253378242254257,\n",
" 0.008915099315345287,\n",
" 0.0015540776075795293,\n",
" -0.005117927212268114,\n",
" -0.017115911468863487,\n",
" -0.037924546748399734,\n",
" 0.0013527635019272566,\n",
" 0.011064696125686169,\n",
" 0.005980461370199919,\n",
" -0.0015481814043596387,\n",
" -0.00771563732996583,\n",
" 0.016684645786881447,\n",
" -0.014528309926390648,\n",
" -0.0005445589195005596,\n",
" 0.0061489250510931015,\n",
" 0.005518870893865824,\n",
" 0.007836931385099888,\n",
" -0.011266852729022503,\n",
" 0.0041071451269090176,\n",
" 0.012836934067308903,\n",
" 0.0039319428615272045,\n",
" 0.003632077481597662,\n",
" -0.01870620995759964,\n",
" 0.010417794808745384,\n",
" 0.011266852729022503,\n",
" -0.002100742422044277,\n",
" -0.023989230394363403,\n",
" -0.02424529567360878,\n",
" 0.04363883659243584,\n",
" -0.013712945394217968,\n",
" -0.007115906570106745,\n",
" 0.0019407018553465605,\n",
" -0.009292458184063435,\n",
" -0.021239902824163437,\n",
" 0.012035046704113483,\n",
" 0.0024107154458761215,\n",
" -0.02196766622364521,\n",
" -0.0008760112687014043,\n",
" 0.019339632242918015,\n",
" 0.0009400274720974267,\n",
" -0.011239898391067982,\n",
" 0.015013485215604305,\n",
" 0.02575473114848137,\n",
" 0.007978441193699837,\n",
" 0.0017975076334550977,\n",
" -0.028571443632245064,\n",
" -0.013854454271495342,\n",
" 0.012250680476427078,\n",
" 0.060161758214235306,\n",
" 0.05129382759332657,\n",
" 0.005751350894570351,\n",
" 0.003921834751963615,\n",
" 0.008322106674313545,\n",
" -0.005373992025852203,\n",
" -0.013463619165122509,\n",
" -0.013463619165122509,\n",
" 0.017398931086063385,\n",
" -0.02119947224855423,\n",
" -0.0061388174071908,\n",
" -0.004686660133302212,\n",
" 0.01947440393269062,\n",
" 0.0026398261543363333,\n",
" 0.02221025340259075,\n",
" -0.006735178641974926,\n",
" 0.010390841402113438,\n",
" 0.013800546526908875,\n",
" -0.011529656127095222,\n",
" -0.018261464312672615,\n",
" 0.007924532517790794,\n",
" 0.010458226315677166,\n",
" 0.0009349735337309539,\n",
" 0.008611864410340786,\n",
" 0.020754728466272354,\n",
" -0.022560657933354378,\n",
" 0.010067391209304333,\n",
" 0.014380061067640781,\n",
" -0.006634100340306759,\n",
" -0.024514837190508842,\n",
" -0.016442056745290756,\n",
" 0.01645553484559059,\n",
" 0.01685984805226326,\n",
" 0.023652303963899612,\n",
" -0.0037938025780022144,\n",
" 0.030943412333726883,\n",
" -0.010950140655040741,\n",
" -0.013827500864863396,\n",
" 0.005195420701056719,\n",
" 0.0036994628608226776,\n",
" 0.00842992402613163,\n",
" 0.0060208928771317005,\n",
" 0.010970355942845345,\n",
" 0.003298519179224968,\n",
" -0.002168127801269293,\n",
" 0.0031418479047715664,\n",
" -0.021981144323945045,\n",
" 0.0032075487542897463,\n",
" -0.013376018032431602,\n",
" -0.00333052733913064,\n",
" 0.0017284376081079245,\n",
" -0.00745283393189311,\n",
" 0.018167125061154366,\n",
" -0.013025613501667976,\n",
" 0.017681950703263283,\n",
" 0.018557962030172348,\n",
" 0.00946092139929533,\n",
" 0.010525612160563469,\n",
" -0.006526283919811249,\n",
" -0.025835592299699783,\n",
" -0.005549194291234016,\n",
" -0.001648417324759066,\n",
" -0.00956873781979084,\n",
" -0.009285719133913517,\n",
" -0.004363209940493107,\n",
" -0.024690039455890656,\n",
" -0.010667121969163418,\n",
" -0.0013544481480494142,\n",
" -0.02580863982439041,\n",
" 0.010330193676054478,\n",
" 0.0074056643061339855,\n",
" 0.002183289499953389,\n",
" -0.014541787095367908,\n",
" 0.0033692740835249424,\n",
" 0.011192727833986282,\n",
" 0.0014353106962516904,\n",
" -0.0035849076230078936,\n",
" -0.004750676453113556,\n",
" -0.010687337256968021,\n",
" -0.00024637815658934414,\n",
" -0.006927227135747671,\n",
" -0.014272244647145271,\n",
" 0.01147574745118618,\n",
" -0.02273586019873619,\n",
" -0.0008566378965042531,\n",
" 0.015943404287099838,\n",
" 0.0005938345566391945,\n",
" 0.001143026165664196,\n",
" 0.0003407178446650505,\n",
" 0.02698114700615406,\n",
" -0.004983156453818083,\n",
" 0.008584910072386265,\n",
" -0.00983154121786356,\n",
" -0.03161726891994476,\n",
" -0.002240567235276103,\n",
" -0.018167125061154366,\n",
" 0.006044477690011263,\n",
" -0.012668469920754433,\n",
" -0.004504719283431768,\n",
" -0.020808637142181396,\n",
" -0.010876016691327095,\n",
" -0.0002609081566333771,\n",
" -0.0004047340480610728,\n",
" -0.006155663635581732,\n",
" 0.003510783426463604,\n",
" 0.0009947781218215823,\n",
" -0.0014748997054994106,\n",
" 0.012863888405263424,\n",
" -0.008059303276240826,\n",
" -0.0019053244031965733,\n",
" 0.004723722115159035,\n",
" -0.0111994668841362,\n",
" -0.0011741919443011284,\n",
" -0.013349063694477081,\n",
" 0.011381407268345356,\n",
" 0.01303235162049532,\n",
" -0.006169140804558992,\n",
" 0.02498653531074524,\n",
" 0.0022911063861101866,\n",
" -0.01543127465993166,\n",
" 0.012850411236286163,\n",
" -0.019730469211935997,\n",
" 0.013402972370386124,\n",
" 0.024905674159526825,\n",
" 0.009319411590695381,\n",
" 0.023180605843663216,\n",
" -0.022601090371608734,\n",
" -0.004885447211563587,\n",
" 0.0036219696048647165,\n",
" -0.012991921044886112,\n",
" -0.007938009686768055,\n",
" 0.00841644685715437,\n",
" -0.0021866587921977043,\n",
" -0.018625346943736076,\n",
" -0.02640163153409958,\n",
" -0.0019524942617863417,\n",
" 0.001314016873948276,\n",
" 0.009272241964936256,\n",
" -0.023086264729499817,\n",
" -0.011880059726536274,\n",
" -0.01880054920911789,\n",
" 0.005006741266697645,\n",
" 0.009548522531986237,\n",
" -0.00372304767370224,\n",
" -0.011246636509895325,\n",
" -0.02587602473795414,\n",
" -0.0032024949323385954,\n",
" -0.002478101057931781,\n",
" -0.01229111198335886,\n",
" 0.016576828435063362,\n",
" 0.005245959851890802,\n",
" -0.004602428525686264,\n",
" -0.008288414217531681,\n",
" -0.0028436672873795033,\n",
" 0.004693398717790842,\n",
" -0.0255390964448452,\n",
" 0.009575476869940758,\n",
" 0.010586258955299854,\n",
" 0.018544483929872513,\n",
" 0.017978446558117867,\n",
" 0.026051227003335953,\n",
" -0.000489808211568743,\n",
" 0.015566046349704266,\n",
" 0.01196766085922718,\n",
" -0.008935314603149891,\n",
" -0.002633087569847703,\n",
" 0.004935986362397671,\n",
" -0.010700814425945282,\n",
" -0.016698122024536133,\n",
" -0.002725742757320404,\n",
" 0.010545827448368073,\n",
" 0.011563348583877087,\n",
" 0.010747984051704407,\n",
" -0.018881412222981453,\n",
" 0.013180599547922611,\n",
" 0.005107819568365812,\n",
" -0.004481134470552206,\n",
" 0.003138478845357895,\n",
" 0.004780999850481749,\n",
" -0.023005403578281403,\n",
" -0.008342322893440723,\n",
" 0.011435315944254398,\n",
" -0.01321429293602705,\n",
" 0.014649603515863419,\n",
" -0.029083574190735817,\n",
" 0.0027004731819033623,\n",
" 0.05194072797894478,\n",
" -0.005751350894570351,\n",
" 0.0065566073171794415,\n",
" 0.0046057975850999355,\n",
" 0.008672511205077171,\n",
" -0.015714293345808983,\n",
" -0.0017132757930085063,\n",
" -0.02018868923187256,\n",
" -0.00044432299910113215,\n",
" -0.013126691803336143,\n",
" 0.016913754865527153,\n",
" -0.021253380924463272,\n",
" 0.003473721444606781,\n",
" 0.046172529458999634,\n",
" 0.016657691448926926,\n",
" 0.003318734932690859,\n",
" 0.003387805074453354,\n",
" 0.019703514873981476,\n",
" 0.00733154034242034,\n",
" -0.01904313638806343,\n",
" 0.010134776122868061,\n",
" 0.0024022923316806555,\n",
" -0.003401282010599971,\n",
" 0.0005744612426497042,\n",
" -0.03215635195374489,\n",
" 0.002868936862796545,\n",
" -0.003049192950129509,\n",
" -0.011239898391067982,\n",
" -0.002371968934312463,\n",
" 0.019097045063972473,\n",
" 0.006421836093068123,\n",
" 0.005970353726297617,\n",
" -0.03657683730125427,\n",
" -0.013975748792290688,\n",
" -0.0028167131822556257,\n",
" -0.013564697466790676,\n",
" 0.05196768417954445,\n",
" 0.01762804202735424,\n",
" -0.0020872652530670166,\n",
" 0.013881408609449863,\n",
" -0.008281675167381763,\n",
" -0.015471706166863441,\n",
" 0.0164959654211998,\n",
" -0.007938009686768055,\n",
" -0.011145558208227158,\n",
" 0.043207570910453796,\n",
" 0.031832899898290634,\n",
" -0.007169815246015787,\n",
" 0.0027779664378613234,\n",
" 0.010464965365827084,\n",
" 0.024474406614899635,\n",
" 0.012129386886954308,\n",
" -0.013194076716899872,\n",
" 0.010020220652222633,\n",
" 0.01765499636530876,\n",
" -0.0013662405544891953,\n",
" -0.021698124706745148,\n",
" -0.009009438566863537,\n",
" -0.052722398191690445,\n",
" 0.026940714567899704,\n",
" 0.005946768447756767,\n",
" 0.0018312004394829273,\n",
" -0.011718334630131721,\n",
" -0.00907682441174984,\n",
" -0.019986532628536224,\n",
" 0.005842321086674929,\n",
" -0.01726415939629078,\n",
" 0.019528312608599663,\n",
" 0.00864555686712265,\n",
" -0.01202830858528614,\n",
" -0.011563348583877087,\n",
" 0.013840978033840656,\n",
" -0.024393543601036072,\n",
" -0.004329517018049955,\n",
" -0.005131404381245375,\n",
" 0.018072785809636116,\n",
" -0.02405661717057228,\n",
" 0.004622643813490868,\n",
" 0.008625341579318047,\n",
" 0.01947440393269062,\n",
" -0.01266173180192709,\n",
" 0.00041126200812868774,\n",
" 0.0005319241317920387,\n",
" 0.028840985149145126,\n",
" -0.016266854479908943,\n",
" -0.0070350440219044685,\n",
" -0.0026752036064863205,\n",
" -0.0008878036751411855,\n",
" 0.010006743483245373,\n",
" -0.0047169835306704044,\n",
" -0.004076821729540825,\n",
" -0.005495286080986261,\n",
" -0.011482485570013523,\n",
" -0.014433969743549824,\n",
" 0.005623318254947662,\n",
" 0.008470354601740837,\n",
" -0.012742593884468079,\n",
" -0.017951492220163345,\n",
" -0.0054009463638067245,\n",
" -0.0211320873349905,\n",
" -0.012055261991918087,\n",
" -0.013153646141290665,\n",
" 0.0002680678735487163,\n",
" -0.030134785920381546,\n",
" -0.036630745977163315,\n",
" 0.016388148069381714,\n",
" 0.010431271977722645,\n",
" 0.013369278982281685,\n",
" 0.005997307598590851,\n",
" -0.019865239039063454,\n",
" 0.020390845835208893,\n",
" 0.03997306525707245,\n",
" -0.0049292477779090405,\n",
" 0.005057280417531729,\n",
" 0.0034501366317272186,\n",
" 0.004383425693958998,\n",
" -0.022574136033654213,\n",
" -0.0016037743771448731,\n",
" -0.008187335915863514,\n",
" 0.001644205767661333,\n",
" 0.021307289600372314,\n",
" -0.018140170723199844,\n",
" -0.027681956067681313,\n",
" -0.011839629150927067,\n",
" -0.0005037064547650516,\n",
" 0.013638821430504322,\n",
" 0.0038376031443476677,\n",
" -0.015512137673795223,\n",
" 0.004710244946181774,\n",
" 0.005424531176686287,\n",
" 0.0037735868245363235,\n",
" 0.0183692816644907,\n",
" -0.025741253048181534,\n",
" 0.022695429623126984,\n",
" -0.0009737201617099345,\n",
" -0.006431944202631712,\n",
" -0.001196092227473855,\n",
" -0.023706212639808655,\n",
" -0.00035693246172741055,\n",
" 0.004828169476240873,\n",
" 0.007520219776779413,\n",
" 0.011435315944254398,\n",
" -0.0402965173125267,\n",
" -0.01812669448554516,\n",
" -0.0023618610575795174,\n",
" 0.01533693540841341,\n",
" -0.0033692740835249424,\n",
" -0.010336932726204395,\n",
" -0.02184637263417244,\n",
" -0.0010941717773675919,\n",
" -0.009380058385431767,\n",
" -0.0033979129511862993,\n",
" 0.018167125061154366,\n",
" -0.014555263333022594,\n",
" -0.007951486855745316,\n",
" 0.009885449893772602,\n",
" -0.0044305953197181225,\n",
" 0.008557955734431744,\n",
" -0.007580866571515799,\n",
" 0.010997310280799866,\n",
" -0.03525608405470848,\n",
" -0.01683289371430874,\n",
" -0.016536395996809006,\n",
" -0.01851752959191799,\n",
" -0.006401620805263519,\n",
" 0.025714298710227013,\n",
" 0.00865903403609991,\n",
" -0.0073517560958862305,\n",
" -0.016172515228390694,\n",
" -0.012681947089731693,\n",
" -0.03919139504432678,\n",
" -0.022964971140027046,\n",
" -0.006182617973536253,\n",
" -0.0023669148795306683,\n",
" 0.021320765838027,\n",
" 0.030593007802963257,\n",
" -0.0015683970414102077,\n",
" 0.030539099127054214,\n",
" -0.0010065706446766853,\n",
" 0.03323451802134514,\n",
" -0.035363901406526566,\n",
" -0.011172512546181679,\n",
" 0.017250683158636093,\n",
" -0.019285723567008972,\n",
" -0.007567389402538538,\n",
" 0.006829518359154463,\n",
" -0.01950135827064514,\n",
" -0.006826149299740791,\n",
" 0.03894880786538124,\n",
" 0.004555258434265852,\n",
" -0.0036725087556988,\n",
" 0.033369291573762894,\n",
" -0.0019440711475908756,\n",
" -0.02762804739177227,\n",
" -0.008086257614195347,\n",
" 0.006954181473702192,\n",
" 0.0010705868480727077,\n",
" -0.007702160160988569,\n",
" 0.001126179820857942,\n",
" -0.007190030533820391,\n",
" -0.010801892727613449,\n",
" -0.0023231145460158587,\n",
" -0.013221031054854393,\n",
" -0.007257416378706694,\n",
" 0.004093667957931757,\n",
" 0.010471703484654427,\n",
" 0.0019255400402471423,\n",
" 0.005801890045404434,\n",
" -0.02707548625767231,\n",
" -0.012985181994736195,\n",
" -0.01849057525396347,\n",
" -0.014757419936358929,\n",
" 0.0274124126881361,\n",
" 0.004626013338565826,\n",
" -0.014973053708672523,\n",
" 0.03690028935670853,\n",
" -0.00906334724277258,\n",
" -0.0030053923837840557,\n",
" -0.016226423904299736,\n",
" 0.023328853771090508,\n",
" -0.016603782773017883,\n",
" -0.012479790486395359,\n",
" 0.002633087569847703,\n",
" -0.023315375670790672,\n",
" -0.023450147360563278,\n",
" -0.0031772253569215536,\n",
" -0.005124665796756744,\n",
" -0.021684646606445312,\n",
" 0.007277631666511297,\n",
" -0.005043803248554468,\n",
" -0.010134776122868061,\n",
" -0.015768202021718025,\n",
" -0.008793804794549942,\n",
" 0.006543130148202181,\n",
" -0.02477090246975422,\n",
" -0.04568735510110855,\n",
" -0.02304583415389061,\n",
" 0.018409714102745056,\n",
" -0.0006502699106931686,\n",
" -0.009373320266604424,\n",
" -0.011792458593845367,\n",
" -0.014878714457154274,\n",
" 0.021401628851890564,\n",
" 0.010835585184395313,\n",
" -0.011900275945663452,\n",
" -0.007553912233561277,\n",
" 0.01993262581527233,\n",
" 0.011886798776686192,\n",
" -0.01904313638806343,\n",
" 0.021051224321126938,\n",
" 0.22964972257614136,\n",
" -0.00021447535254992545,\n",
" 0.012991921044886112,\n",
" 0.040754739195108414,\n",
" 0.013288416899740696,\n",
" 0.01239892840385437,\n",
" 0.014946099370718002,\n",
" 0.0015111194225028157,\n",
" -0.010687337256968021,\n",
" 0.007574127987027168,\n",
" 0.007095691282302141,\n",
" 0.003965635318309069,\n",
" -0.0014117257669568062,\n",
" -0.00031439537997357547,\n",
" 0.027358505874872208,\n",
" 0.012870626524090767,\n",
" -0.02083558961749077,\n",
" -0.04021565616130829,\n",
" -0.011603780090808868,\n",
" -0.0293800700455904,\n",
" -0.000714286114089191,\n",
" -0.0044474415481090546,\n",
" -0.00025290611665695906,\n",
" -0.010619951412081718,\n",
" 0.00586927542462945,\n",
" -0.008982484228909016,\n",
" -0.011118603870272636,\n",
" -0.003824125975370407,\n",
" 0.01898922771215439,\n",
" 0.015242595225572586,\n",
" -0.01038410235196352,\n",
" -0.013376018032431602,\n",
" 0.01037062518298626,\n",
" 0.007641513366252184,\n",
" -0.04223721846938133,\n",
" 0.02095688506960869,\n",
" 0.014946099370718002,\n",
" 0.011482485570013523,\n",
" 0.0223989337682724,\n",
" 0.014366584829986095,\n",
" 0.0014951153425499797,\n",
" -0.01731806807219982,\n",
" -0.02314017340540886,\n",
" -0.01892184279859066,\n",
" -0.0016644214047119021,\n",
" 0.0141509510576725,\n",
" 0.007991918362677097,\n",
" -0.01978437788784504,\n",
" 0.008483831770718098,\n",
" 0.0022995295003056526,\n",
" -0.00984501838684082,\n",
" 0.014191382564604282,\n",
" 0.020390845835208893,\n",
" 0.012351758778095245,\n",
" 0.008955529890954494,\n",
" -0.007223723456263542,\n",
" 0.016630737110972404,\n",
" 0.013672513887286186,\n",
" -0.024070093408226967,\n",
" 0.010485180653631687,\n",
" -0.008099734783172607,\n",
" 0.015795156359672546,\n",
" -0.005117927212268114,\n",
" 0.017493270337581635,\n",
" -0.011253375560045242,\n",
" -0.005161727778613567,\n",
" -0.015377366915345192,\n",
" -0.02095688506960869,\n",
" -0.014460924081504345,\n",
" -0.0020872652530670166,\n",
" 0.002885783091187477,\n",
" 0.005431269761174917,\n",
" -0.0017941384576261044,\n",
" 0.0013333902461454272,\n",
" -0.006347712129354477,\n",
" -0.014528309926390648,\n",
" 0.006718332413583994,\n",
" 0.02873316965997219,\n",
" 0.01769542694091797,\n",
" 0.027560660615563393,\n",
" -0.020134782418608665,\n",
" 0.0009678239584900439,\n",
" 0.01870620995759964,\n",
" -0.02335580810904503,\n",
" -0.025714298710227013,\n",
" -0.022843677550554276,\n",
" -0.0026516185607761145,\n",
" 0.0009543468477204442,\n",
" -0.009804587811231613,\n",
" -0.017088957130908966,\n",
" -0.01784367486834526,\n",
" -0.012500006705522537,\n",
" -0.012560653500258923,\n",
" -0.01597035862505436,\n",
" 0.017708905041217804,\n",
" 0.0018278311472386122,\n",
" -0.015983836725354195,\n",
" 0.016078175976872444,\n",
" -0.006627361755818129,\n",
" -0.0009989897953346372,\n",
" -0.032506756484508514,\n",
" 0.03964961692690849,\n",
" 0.004019543994218111,\n",
" 0.014757419936358929,\n",
" 0.0038746651262044907,\n",
" 0.00012940117449034005,\n",
" -0.00453167362138629,\n",
" 0.006886796094477177,\n",
" -0.009433967061340809,\n",
" -0.011799197643995285,\n",
" 0.019514834508299828,\n",
" 0.0063982512801885605,\n",
" 0.015673862770199776,\n",
" -0.008254721760749817,\n",
" -0.012365235947072506,\n",
" 0.021145563572645187,\n",
" 0.002660041907802224,\n",
" -0.01704852655529976,\n",
" 0.002114219358190894,\n",
" 0.003965635318309069,\n",
" -0.01990567147731781,\n",
" -0.005303237121552229,\n",
" -0.016805939376354218,\n",
" 0.004312670789659023,\n",
" -0.016536395996809006,\n",
" -0.013052567839622498,\n",
" -0.0055289785377681255,\n",
" -0.004821430891752243,\n",
" 0.012486529536545277,\n",
" -0.01490566786378622,\n",
" 0.0035781690385192633,\n",
" 0.007486526854336262,\n",
" 0.006613885052502155,\n",
" 0.0034113898873329163,\n",
" -0.007163076661527157,\n",
" 3.271880996180698e-05,\n",
" 0.0005382415256462991,\n",
" 0.011388146318495274,\n",
" -0.019730469211935997,\n",
" 0.015471706166863441,\n",
" 0.010053914040327072,\n",
" -0.008072780445218086,\n",
" 0.001987871713936329,\n",
" -0.013389495201408863,\n",
" 0.0016172515461221337,\n",
" -0.005026957020163536,\n",
" 0.009649600833654404,\n",
" -0.01923181675374508,\n",
" -0.0019154322799295187,\n",
" -0.017008095979690552,\n",
" -0.027223734185099602,\n",
" -0.013288416899740696,\n",
" -0.0082479827105999,\n",
" 0.008045826107263565,\n",
" 0.028814030811190605,\n",
" -0.01671159826219082,\n",
" -0.018962273374199867,\n",
" -0.027250688523054123,\n",
" 0.016361193731427193,\n",
" -0.014649603515863419,\n",
" -0.034043144434690475,\n",
" -0.0005424531409516931,\n",
" 0.026805944740772247,\n",
" -0.01882750354707241,\n",
" 0.003335581161081791,\n",
" -0.002836928702890873,\n",
" -0.17617259919643402,\n",
" 0.0017419146606698632,\n",
" 0.01760108768939972,\n",
" -0.022722383961081505,\n",
" 0.00880054384469986,\n",
" -0.012405666522681713,\n",
" 0.026051227003335953,\n",
" 0.006974397227168083,\n",
" -0.0006228945567272604,\n",
" 0.003253034083172679,\n",
" -0.007473049685359001,\n",
" -0.015283026732504368,\n",
" -0.035363901406526566,\n",
" -0.00625337241217494,\n",
" -0.013699468225240707,\n",
" 0.0062230490148067474,\n",
" -0.03479786217212677,\n",
" 0.010849062353372574,\n",
" 0.018975751474499702,\n",
" 0.02916443534195423,\n",
" 0.003743263427168131,\n",
" -0.010707552544772625,\n",
" 0.01911052130162716,\n",
" -0.03110513836145401,\n",
" 0.00852426327764988,\n",
" -0.005704180803149939,\n",
" -0.006927227135747671,\n",
" 0.026994623243808746,\n",
" -0.00440701050683856,\n",
" -0.007823454216122627,\n",
" 0.0035950152669101954,\n",
" -0.004690029192715883,\n",
" -0.0022388824727386236,\n",
" 0.005222374573349953,\n",
" 0.011994615197181702,\n",
" -0.0024292466696351767,\n",
" 0.010694075375795364,\n",
" -0.0029245298355817795,\n",
" -0.009487875737249851,\n",
" 0.020822113379836082,\n",
" 0.014353107661008835,\n",
" 0.041212961077690125,\n",
" 0.003261457197368145,\n",
" -0.02421834133565426,\n",
" 0.0018194079166278243,\n",
" 0.007304586004465818,\n",
" 0.01990567147731781,\n",
" -0.00467655248939991,\n",
" 0.0017739228205755353,\n",
" -0.013342324644327164,\n",
" 0.02230459451675415,\n",
" -0.03436659649014473,\n",
" -0.00612197071313858,\n",
" -0.0025825484190136194,\n",
" 0.0001508802961325273,\n",
" -0.0006932281539775431,\n",
" 0.0032917805947363377,\n",
" -0.01332210935652256,\n",
" -0.0061388174071908,\n",
" 0.00835579913109541,\n",
" 0.015835586935281754,\n",
" -0.03528303653001785,\n",
" 0.010761461220681667,\n",
" 0.02599731832742691,\n",
" -0.010619951412081718,\n",
" -0.01196766085922718,\n",
" -0.02685985155403614,\n",
" 0.013072783127427101,\n",
" -0.00816712062805891,\n",
" 0.009669816121459007,\n",
" -0.01846362091600895,\n",
" -0.021671170368790627,\n",
" -0.008281675167381763,\n",
" -0.005902967881411314,\n",
" 0.0028790447395294905,\n",
" -0.009973051026463509,\n",
" -0.026145566254854202,\n",
" 0.0223989337682724,\n",
" -0.01067386008799076,\n",
" -0.009022915735840797,\n",
" -0.02611861191689968,\n",
" 0.024636130779981613,\n",
" -0.007412402890622616,\n",
" 0.019339632242918015,\n",
" 0.004366578999906778,\n",
" 0.015080870129168034,\n",
" -0.020539093762636185,\n",
" -0.008126689121127129,\n",
" 0.005478439386934042,\n",
" 0.013382756151258945,\n",
" 0.044717006385326385,\n",
" -0.008712942712008953,\n",
" -0.01580863445997238,\n",
" -0.004053236450999975,\n",
" 0.003682616399601102,\n",
" 0.01880054920911789,\n",
" -0.0017890845192596316,\n",
" 0.019487880170345306,\n",
" 0.003955527674406767,\n",
" 0.002309637377038598,\n",
" -0.001693902537226677,\n",
" -0.02067386545240879,\n",
" -0.0095822149887681,\n",
" 0.010249331593513489,\n",
" 0.029245298355817795,\n",
" 0.014757419936358929,\n",
" 0.013814023695886135,\n",
" -0.003611861728131771,\n",
" 0.021954189985990524,\n",
" -0.0003476669662632048,\n",
" -0.045768219977617264,\n",
" 0.004336255602538586,\n",
" 0.015242595225572586,\n",
" 0.01229111198335886,\n",
" -0.005966984201222658,\n",
" 0.037762824445962906,\n",
" -0.022843677550554276,\n",
" -0.03347710520029068,\n",
" 0.005997307598590851,\n",
" -0.002313006669282913,\n",
" 0.04094341769814491,\n",
" 0.007412402890622616,\n",
" -0.0021698125638067722,\n",
" 0.011556609533727169,\n",
" 0.010229116305708885,\n",
" -0.008497308939695358,\n",
" -0.08361190557479858,\n",
" -0.012654992751777172,\n",
" 0.018719686195254326,\n",
" 0.03460918366909027,\n",
" -0.018207557499408722,\n",
" 0.015202164649963379,\n",
" -0.011650949716567993,\n",
" 0.020714296028017998,\n",
" 0.004959571175277233,\n",
" 0.001922170864418149,\n",
" 0.0030542470049113035,\n",
" -0.018773594871163368,\n",
" -0.00827493704855442,\n",
" -0.022870631888508797,\n",
" 0.024353113025426865,\n",
" 0.012358496896922588,\n",
" -0.0006599565385840833,\n",
" -0.005798520520329475,\n",
" -0.0016105129616335034,\n",
" 0.02184637263417244,\n",
" -0.009784371592104435,\n",
" -0.002656672615557909,\n",
" 0.013369278982281685,\n",
" -0.013295155018568039,\n",
" 0.0024511469528079033,\n",
" -0.0059905690141022205,\n",
" -0.027547184377908707,\n",
" 0.023247990757226944,\n",
" 0.007412402890622616,\n",
" -0.011677904054522514,\n",
" -0.003574799746274948,\n",
" -0.00984501838684082,\n",
" 0.02095688506960869,\n",
" -0.013039090670645237,\n",
" -0.004797846078872681,\n",
" 0.017708905041217804,\n",
" -0.04280325770378113,\n",
" -0.009326150640845299,\n",
" 0.007082214113324881,\n",
" -0.007681944873183966,\n",
" 0.0024646238889545202,\n",
" 0.026603788137435913,\n",
" 0.01401618029922247,\n",
" -0.040134791284799576,\n",
" 0.0007277631666511297,\n",
" -0.011987877078354359,\n",
" -0.007884101010859013,\n",
" 0.03757414221763611,\n",
" 0.005256067495793104,\n",
" -0.027277642861008644,\n",
" -0.035552579909563065,\n",
" 0.01633424125611782,\n",
" -0.030269557610154152,\n",
" -0.009299196302890778,\n",
" 0.030080879107117653,\n",
" 0.016442056745290756,\n",
" 0.022345025092363358,\n",
" -0.0016543135279789567,\n",
" -0.00518531259149313,\n",
" -0.007688683457672596,\n",
" -0.0067688715644180775,\n",
" -0.009103778749704361,\n",
" -0.002673518843948841,\n",
" 0.03000001609325409,\n",
" -0.004797846078872681,\n",
" 0.0054009463638067245,\n",
" -0.01642858050763607,\n",
" 0.000922338746022433,\n",
" -0.0012390505289658904,\n",
" -0.013800546526908875,\n",
" 0.0040970370173454285,\n",
" 0.0022944756783545017,\n",
" -0.011219682171940804,\n",
" 0.020929930731654167,\n",
" -0.00790431722998619,\n",
" -0.004420487675815821,\n",
" -0.030107833445072174,\n",
" -0.024433976039290428,\n",
" 0.012971704825758934,\n",
" -0.0052796523086726665,\n",
" -0.01731806807219982,\n",
" -0.01628033258020878,\n",
" -0.010498657822608948,\n",
" 0.004086929373443127,\n",
" 0.021253380924463272,\n",
" 0.02338276244699955,\n",
" 0.004103775601834059,\n",
" 0.0047338297590613365,\n",
" 0.014555263333022594,\n",
" -0.035336945205926895,\n",
" 0.018625346943736076,\n",
" 0.04161727428436279,\n",
" -0.008969007059931755,\n",
" -0.021792463958263397,\n",
" -0.0045518893748521805,\n",
" 0.006664424203336239,\n",
" -0.0008301048655994236,\n",
" 0.00505391089245677,\n",
" 0.007237200625240803,\n",
" -0.004066713619977236,\n",
" -0.03954179957509041,\n",
" -0.026226429268717766,\n",
" -0.06517523527145386,\n",
" 0.011765505187213421,\n",
" 0.010626690462231636,\n",
" -0.02460917830467224,\n",
" -0.0036219696048647165,\n",
" 0.01830189675092697,\n",
" -0.004868600983172655,\n",
" -0.0041340989992022514,\n",
" -0.017345022410154343,\n",
" 0.006708224769681692,\n",
" -0.02602427266538143,\n",
" 0.00587601400911808,\n",
" 0.008787066675722599,\n",
" -0.0011354453163221478,\n",
" -0.026266859844326973,\n",
" -0.0036017538513988256,\n",
" 0.02057952620089054,\n",
" 0.0018648931290954351,\n",
" 0.025377372279763222,\n",
" 0.02587602473795414,\n",
" 0.0008869614102877676,\n",
" -0.021428583189845085,\n",
" -0.002978438278660178,\n",
" 0.010929924435913563,\n",
" -0.014326153323054314,\n",
" 0.005582887213677168,\n",
" -0.02978438138961792,\n",
" 0.026913760229945183,\n",
" -0.010283024050295353,\n",
" -0.021159041672945023,\n",
" -0.0020822114311158657,\n",
" -0.0390835776925087,\n",
" 0.0035411070566624403,\n",
" 0.011024264618754387,\n",
" -0.000971193250734359,\n",
" -0.0025657021906226873,\n",
" -0.004417118150740862,\n",
" 0.032938022166490555,\n",
" 0.005370622966438532,\n",
" 0.015202164649963379,\n",
" -0.008335583843290806,\n",
" -0.02249327301979065,\n",
" 0.006880057509988546,\n",
" -0.02520217001438141,\n",
" 0.0024006078019738197,\n",
" 0.028382765129208565,\n",
" -0.025862546637654305,\n",
" -0.019959580153226852,\n",
" 0.035579532384872437,\n",
" 0.009346365928649902,\n",
" 0.01196766085922718,\n",
" -0.003844341728836298,\n",
" -0.028328856453299522,\n",
" -0.02421834133565426,\n",
" -0.008652295917272568,\n",
" -0.008739897049963474,\n",
" 0.014420492574572563,\n",
" 0.0015035385731607676,\n",
" 0.017668472602963448,\n",
" -0.01103100273758173,\n",
" 0.035768214613199234,\n",
" -0.005886121653020382,\n",
" -0.0023652303498238325,\n",
" 0.008638818748295307,\n",
" -0.008706203661859035,\n",
" 0.009413751773536205,\n",
" -0.028571443632245064,\n",
" 0.005579517688602209,\n",
" -0.008510786108672619,\n",
" -0.021617261692881584,\n",
" -0.03517521917819977,\n",
" -0.02328842133283615,\n",
" -0.010485180653631687,\n",
" 0.038167137652635574,\n",
" 0.026994623243808746,\n",
" 0.016927232965826988,\n",
" -0.008160381577908993,\n",
" 0.02230459451675415,\n",
" 0.007102429401129484,\n",
" 0.02787063457071781,\n",
" 0.01966308243572712,\n",
" 0.021334243938326836,\n",
" -0.008052565157413483,\n",
" 0.009299196302890778,\n",
" 0.04218330979347229,\n",
" 0.01664421334862709,\n",
" -0.0225876122713089,\n",
" 0.004349732771515846,\n",
" -0.013450141996145248,\n",
" 0.009690032340586185,\n",
" -0.010896231979131699,\n",
" 0.010714291594922543,\n",
" 0.013840978033840656,\n",
" 0.001228942652232945,\n",
" -0.00852426327764988,\n",
" -0.013908362947404385,\n",
" 4.984814836461737e-07,\n",
" 0.004363209940493107,\n",
" 0.02194071188569069,\n",
" 0.018005400896072388,\n",
" 0.005134773440659046,\n",
" 0.009535045363008976,\n",
" -0.002845351817086339,\n",
" -0.023544486612081528,\n",
" -0.008969007059931755,\n",
" -0.003072777995839715,\n",
" -0.03668465465307236,\n",
" -0.047088973224163055,\n",
" -0.0006873318925499916,\n",
" 0.020849067717790604,\n",
" -0.007863885723054409,\n",
" -0.013362540863454342,\n",
" 0.015983836725354195,\n",
" 0.014487878419458866,\n",
" -0.0345822274684906,\n",
" 0.016698122024536133,\n",
" -0.013402972370386124,\n",
" -0.010485180653631687,\n",
" -0.03630729764699936,\n",
" 0.03129381686449051,\n",
" -0.014649603515863419,\n",
" -0.0017216990236192942,\n",
" 0.039433982223272324,\n",
" -0.008969007059931755,\n",
" 0.023490577936172485,\n",
" 0.008780327625572681,\n",
" 0.024663085117936134,\n",
" -0.01654987409710884,\n",
" -0.0001794138370314613,\n",
" 0.008180596865713596,\n",
" -0.0070350440219044685,\n",
" 0.018045831471681595,\n",
" -0.012803241610527039,\n",
" -0.026563355699181557,\n",
" 0.0026145565789192915,\n",
" -0.01101752556860447,\n",
" -0.01425876747816801,\n",
" 0.04463614150881767,\n",
" -0.00372304767370224,\n",
" 0.07493265718221664,\n",
" -0.002897575730457902,\n",
" -0.009049870073795319,\n",
" 0.01104447990655899,\n",
" -0.015592999756336212,\n",
" 0.02765500172972679,\n",
" 0.02138815075159073,\n",
" 0.014407015405595303,\n",
" -0.01230458915233612,\n",
" 0.007095691282302141,\n",
" 0.0225876122713089,\n",
" 0.007129383739084005,\n",
" -0.001028470927849412,\n",
" -0.016725076362490654,\n",
" -0.020849067717790604,\n",
" -0.01249326765537262,\n",
" -0.010020220652222633,\n",
" 0.011576825752854347,\n",
" 0.0031856484711170197,\n",
" 0.0020805266685783863,\n",
" 0.014272244647145271,\n",
" -0.005097711458802223,\n",
" 0.021118609234690666,\n",
" 0.01654987409710884,\n",
" -0.010350409895181656,\n",
" -0.0025000013411045074,\n",
" 0.028167130425572395,\n",
" -0.027237210422754288,\n",
" -0.01092318631708622,\n",
" -0.016603782773017883,\n",
" -0.0021091655362397432,\n",
" -0.003982482012361288,\n",
" -0.022264162078499794,\n",
" -0.025188691914081573,\n",
" 0.00041610535117797554,\n",
" 0.015417797490954399,\n",
" -0.008234505541622639,\n",
" -0.027237210422754288,\n",
" -0.0056873345747590065,\n",
" 0.009016177617013454,\n",
" 0.003958896733820438,\n",
" 0.028194084763526917,\n",
" -0.013814023695886135,\n",
" 0.002461254596710205,\n",
" -0.03412400558590889,\n",
" 0.011145558208227158,\n",
" -0.00935310497879982,\n",
" -0.0006279484368860722,\n",
" -0.01344340294599533\n",
" ],\n",
" \"index\": 0,\n",
" \"object\": \"embedding\"\n",
" },\n",
" {\n",
" \"embedding\": [\n",
" -0.033118706196546555,\n",
" -0.009973089210689068,\n",
" 0.007738340180367231,\n",
" 0.01987677626311779,\n",
" -0.005902653094381094,\n",
" 0.016267864033579826,\n",
" -0.007432970684021711,\n",
" -0.015684885904192924,\n",
" -0.034201379865407944,\n",
" -0.01390125136822462,\n",
" 0.006142090540379286,\n",
" 0.03406257554888725,\n",
" -0.016573233529925346,\n",
" 0.008140872232615948,\n",
" 0.007224764209240675,\n",
" 0.00477486802265048,\n",
" 0.019057830795645714,\n",
" 0.003567270701751113,\n",
" 0.0037164853420108557,\n",
" -0.022861069068312645,\n",
" 0.00337988487444818,\n",
" 0.0012926150811836123,\n",
" -0.010354801081120968,\n",
" -0.013200289569795132,\n",
" -0.025415068492293358,\n",
" 0.0065203323028981686,\n",
" 0.005437658634036779,\n",
" -0.011819186620414257,\n",
" -0.015351756475865841,\n",
" 0.009827344678342342,\n",
" -0.0061247400008141994,\n",
" 0.008890415541827679,\n",
" 0.001048840000294149,\n",
" -0.019460363313555717,\n",
" -0.013720805756747723,\n",
" -0.016406668350100517,\n",
" -0.018405450507998466,\n",
" -0.0063155959360301495,\n",
" 0.006818761583417654,\n",
" -0.009223545901477337,\n",
" 0.03872640058398247,\n",
" -0.0049553136341273785,\n",
" 0.0011347251711413264,\n",
" -0.0005855806521140039,\n",
" -0.006638315971940756,\n",
" -0.009355410002171993,\n",
" 0.006211492698639631,\n",
" -0.017697548493742943,\n",
" -0.020903928205370903,\n",
" 0.016101298853754997,\n",
" 0.03545061871409416,\n",
" -0.010292339138686657,\n",
" -0.019932297989726067,\n",
" -0.013970653526484966,\n",
" -0.0018807983724400401,\n",
" 0.02616461180150509,\n",
" 0.007696698885411024,\n",
" 0.010104953311383724,\n",
" -0.015226832590997219,\n",
" 0.0008918176754377782,\n",
" 0.018100081011652946,\n",
" 0.00840460043400526,\n",
" -0.004760987590998411,\n",
" 0.025345666334033012,\n",
" -0.02309703640639782,\n",
" -0.009633018635213375,\n",
" 0.0007556159398518503,\n",
" 0.006478691007941961,\n",
" -0.004073906224220991,\n",
" -0.0007152759353630245,\n",
" 0.019335439428687096,\n",
" -0.010743453167378902,\n",
" -0.012887979857623577,\n",
" -0.0021653471048921347,\n",
" 0.01760038547217846,\n",
" -0.015101908706128597,\n",
" -0.007911845110356808,\n",
" -0.00519475108012557,\n",
" 0.008578105829656124,\n",
" 0.005111468490213156,\n",
" 0.014865941368043423,\n",
" -0.020237667486071587,\n",
" -0.0015129669336602092,\n",
" 0.018627537414431572,\n",
" 0.020751243457198143,\n",
" 0.016309505328536034,\n",
" 0.00021471291256602854,\n",
" 0.012901860289275646,\n",
" -0.010035551153123379,\n",
" -0.003027668921276927,\n",
" 0.020279308781027794,\n",
" 0.020307069644331932,\n",
" 0.023818818852305412,\n",
" 0.01589309237897396,\n",
" -0.014727137051522732,\n",
" 0.009973089210689068,\n",
" 0.010118833743035793,\n",
" 0.05702080950140953,\n",
" 0.013783267699182034,\n",
" -0.024138068780303,\n",
" -0.017808591946959496,\n",
" 0.02051527611911297,\n",
" -0.02233361266553402,\n",
" -0.009445632807910442,\n",
" -0.03381272777915001,\n",
" 0.005704856943339109,\n",
" 0.0023527329321950674,\n",
" -0.0071553620509803295,\n",
" -0.0015311850002035499,\n",
" 0.010500545613467693,\n",
" 0.00840460043400526,\n",
" 0.04022548720240593,\n",
" 0.0032393455039709806,\n",
" -0.03414585813879967,\n",
" -0.013637523166835308,\n",
" 0.0048408000729978085,\n",
" 0.00618720194324851,\n",
" -0.026553263887763023,\n",
" -0.015684885904192924,\n",
" -0.021806156262755394,\n",
" -0.007120660971850157,\n",
" -0.005798549856990576,\n",
" 0.01851649396121502,\n",
" -0.014505050145089626,\n",
" 0.009889806620776653,\n",
" 0.015407278202474117,\n",
" -0.0226112212985754,\n",
" -0.017683668062090874,\n",
" -0.005014305468648672,\n",
" 0.013387675397098064,\n",
" 0.023638373240828514,\n",
" 0.026636546477675438,\n",
" 0.020459754392504692,\n",
" -0.015795929357409477,\n",
" -0.030009491369128227,\n",
" 0.004566661547869444,\n",
" -0.03470107540488243,\n",
" -0.004531960468739271,\n",
" -0.021486906334757805,\n",
" -0.021528547629714012,\n",
" 0.0077522206120193005,\n",
" 0.009390111081302166,\n",
" -0.0045111398212611675,\n",
" 0.014699376188218594,\n",
" 0.006541152950376272,\n",
" 0.025165220722556114,\n",
" 0.029287708923220634,\n",
" 0.017170092090964317,\n",
" -0.012596490792930126,\n",
" -0.0174477007240057,\n",
" 0.01943260245025158,\n",
" -0.013450137339532375,\n",
" 0.00994532834738493,\n",
" -0.0068499925546348095,\n",
" 0.005284973885864019,\n",
" -0.003095336025580764,\n",
" 0.011978811584413052,\n",
" 0.012887979857623577,\n",
" -0.03747716173529625,\n",
" 0.008057589642703533,\n",
" 0.016892483457922935,\n",
" 0.010646290145814419,\n",
" 0.022722264751791954,\n",
" 0.00023509979655500501,\n",
" 0.013186409138143063,\n",
" 0.02095944993197918,\n",
" 0.03561718389391899,\n",
" -0.01680920086801052,\n",
" 0.00443132733926177,\n",
" 0.0016153351170942187,\n",
" -0.019321558997035027,\n",
" 0.0016257454408332705,\n",
" -0.01898842863738537,\n",
" 0.01275611575692892,\n",
" 0.013651403598487377,\n",
" 0.016753679141402245,\n",
" 0.012624251656234264,\n",
" -0.007495432626456022,\n",
" -0.017059048637747765,\n",
" -0.04552781209349632,\n",
" 0.00864750798791647,\n",
" 0.01680920086801052,\n",
" 0.017503222450613976,\n",
" 0.007096370216459036,\n",
" -0.014407887123525143,\n",
" -0.006586264353245497,\n",
" 0.004295993130654097,\n",
" -0.011298670433461666,\n",
" 0.005101058166474104,\n",
" 0.01069487165659666,\n",
" -0.0025349135976284742,\n",
" 0.013741626404225826,\n",
" 0.012395224533975124,\n",
" 0.008432361297309399,\n",
" -0.6911343932151794,\n",
" -0.015962494537234306,\n",
" 0.011402773670852184,\n",
" -0.027608176693320274,\n",
" 0.016087418422102928,\n",
" -0.0008892150945030153,\n",
" 0.00012676736514549702,\n",
" -0.011999632231891155,\n",
" -0.020376471802592278,\n",
" 0.03012053482234478,\n",
" -0.0019901066552847624,\n",
" 0.002602580701932311,\n",
" -0.013373794965445995,\n",
" -0.012124556116759777,\n",
" -0.0006745021673850715,\n",
" -0.015851451084017754,\n",
" 0.002172287320718169,\n",
" -0.019002309069037437,\n",
" 0.010431143455207348,\n",
" 0.00802288856357336,\n",
" -0.02444343827664852,\n",
" 0.01399147417396307,\n",
" -0.0004532828170340508,\n",
" 0.027288926765322685,\n",
" -0.006919394712895155,\n",
" -0.007047788705676794,\n",
" 0.009577496908605099,\n",
" -0.0023232370149344206,\n",
" -0.026983557268977165,\n",
" -0.004153718706220388,\n",
" -0.015559962950646877,\n",
" 0.005163520108908415,\n",
" 0.01914111338555813,\n",
" -0.029870687052607536,\n",
" 0.04316813871264458,\n",
" 0.019793493673205376,\n",
" -0.006867343094199896,\n",
" 0.008453181944787502,\n",
" 0.029870687052607536,\n",
" 0.019779613241553307,\n",
" -0.02876025252044201,\n",
" -0.0011754989391192794,\n",
" 0.005926943849772215,\n",
" -0.003098806133493781,\n",
" -0.010375621728599072,\n",
" 0.02876025252044201,\n",
" 0.025331785902380943,\n",
" -5.1428080041659996e-05,\n",
" -0.010382561944425106,\n",
" -0.015795929357409477,\n",
" 0.0005799417267553508,\n",
" -0.006784060504287481,\n",
" 0.012485447339713573,\n",
" -0.0027448551263660192,\n",
" -5.012678957427852e-05,\n",
" 0.014199680648744106,\n",
" 0.02051527611911297,\n",
" -0.004032264929264784,\n",
" -0.001795780728571117,\n",
" -0.00645440025255084,\n",
" 0.012034333311021328,\n",
" 0.005899182986468077,\n",
" 0.00028086183010600507,\n",
" -0.01833604834973812,\n",
" -0.019085591658949852,\n",
" 0.012075974605977535,\n",
" -0.012436865828931332,\n",
" -0.024818209931254387,\n",
" 0.02479044906795025,\n",
" -0.014643854461610317,\n",
" -0.0002648125810083002,\n",
" 0.008286616764962673,\n",
" 0.010209056548774242,\n",
" -0.013720805756747723,\n",
" 0.009286007843911648,\n",
" -0.0032792517449706793,\n",
" -0.00288365944288671,\n",
" -0.01958528719842434,\n",
" 0.0077661010436713696,\n",
" 0.010118833743035793,\n",
" 0.0004801761533599347,\n",
" -0.00014856398047413677,\n",
" -0.04330694302916527,\n",
" 0.01116680633276701,\n",
" 0.012887979857623577,\n",
" 0.001958875684067607,\n",
" -9.309648157795891e-05,\n",
" -0.012853278778493404,\n",
" -0.019154993817210197,\n",
" -0.004528490360826254,\n",
" -0.012027393095195293,\n",
" -0.011583219282329082,\n",
" 0.0005166122573427856,\n",
" -0.041197117418050766,\n",
" 0.0031491226982325315,\n",
" -0.008807132951915264,\n",
" -0.007606476079672575,\n",
" 0.004368865396827459,\n",
" 0.01986289583146572,\n",
" -0.0388929657638073,\n",
" -0.007953486405313015,\n",
" 0.009390111081302166,\n",
" 0.002942651277408004,\n",
" 0.003128302050754428,\n",
" 0.04280724748969078,\n",
" -0.00014466010907199234,\n",
" -0.015046386979520321,\n",
" 0.00993144791573286,\n",
" 0.011437474749982357,\n",
" 6.609470437979326e-05,\n",
" 0.012478507123887539,\n",
" 0.016934124752879143,\n",
" -0.013477898202836514,\n",
" -0.007856323383748531,\n",
" -0.0015051591908559203,\n",
" -0.039531465619802475,\n",
" 0.025803720578551292,\n",
" -3.9662245399085805e-05,\n",
" 0.013699985109269619,\n",
" -0.01682308129966259,\n",
" 0.03025933913886547,\n",
" 0.0218477975577116,\n",
" 0.003256696043536067,\n",
" -0.006541152950376272,\n",
" 0.025040296837687492,\n",
" 0.006551563274115324,\n",
" -0.005656275432556868,\n",
" -0.006485631223767996,\n",
" 0.011021061800420284,\n",
" 0.008841834031045437,\n",
" 0.002111560432240367,\n",
" -0.016115179285407066,\n",
" 0.021348102018237114,\n",
" -0.0166842769831419,\n",
" 0.00979264359921217,\n",
" 0.0009421342401765287,\n",
" 0.019696330651640892,\n",
" -0.01223559956997633,\n",
" 0.033701684325933456,\n",
" -0.04164129123091698,\n",
" -0.004667294677346945,\n",
" 0.012152316980063915,\n",
" 0.0004439569020178169,\n",
" -0.0049934848211705685,\n",
" -0.002095944946631789,\n",
" -0.011742844246327877,\n",
" -0.018891265615820885,\n",
" -0.00011310382251394913,\n",
" -0.02494313381612301,\n",
" 0.004899791907519102,\n",
" 0.012825517915189266,\n",
" 0.0014860735973343253,\n",
" -0.009327649138867855,\n",
" 0.01345707755535841,\n",
" -0.0033018074464052916,\n",
" 0.014976984821259975,\n",
" 0.010535246692597866,\n",
" -0.004261292051523924,\n",
" -0.009161083959043026,\n",
" -0.023624492809176445,\n",
" 0.01757262460887432,\n",
" 0.02231973223388195,\n",
" 0.008661388419568539,\n",
" -0.019515885040163994,\n",
" -0.0033677394967526197,\n",
" -0.03467331454157829,\n",
" 0.0035447150003165007,\n",
" 0.017003526911139488,\n",
" -0.0011156395776197314,\n",
" -0.025775959715247154,\n",
" 0.0036227924283593893,\n",
" -0.036338966339826584,\n",
" 0.008085350506007671,\n",
" 0.015323995612561703,\n",
" 0.009952268563210964,\n",
" 0.026081329211592674,\n",
" -0.024804329499602318,\n",
" 0.01958528719842434,\n",
" 0.00887653511017561,\n",
" -0.020695721730589867,\n",
" 0.009383170865476131,\n",
" 0.03239692375063896,\n",
" -0.008911236189305782,\n",
" -0.003398970467969775,\n",
" 0.04591646417975426,\n",
" 0.022375253960490227,\n",
" 0.025609394535422325,\n",
" 0.023457927629351616,\n",
" -0.008911236189305782,\n",
" 0.028177274391055107,\n",
" 0.014699376188218594,\n",
" 0.006051867734640837,\n",
" -0.014033115468919277,\n",
" 0.006895103957504034,\n",
" 0.0038379391189664602,\n",
" 0.00603451719507575,\n",
" -0.004552781116217375,\n",
" 0.006485631223767996,\n",
" 0.004577071871608496,\n",
" 0.005437658634036779,\n",
" 0.05257907137274742,\n",
" 0.007467671763151884,\n",
" 0.0132141700014472,\n",
" -0.0011277849553152919,\n",
" -0.0021861677523702383,\n",
" -0.05840885266661644,\n",
" 0.00016374570259358734,\n",
" -0.02280554734170437,\n",
" 0.02387434057891369,\n",
" 0.01607353799045086,\n",
" -0.0020178675185889006,\n",
" -0.027455491945147514,\n",
" -0.016948005184531212,\n",
" -0.00841848086565733,\n",
" -0.026525503024458885,\n",
" 0.012395224533975124,\n",
" 0.0020074571948498487,\n",
" 0.003475312842056155,\n",
" 0.0008818411151878536,\n",
" 0.004858150612562895,\n",
" -0.004223120864480734,\n",
" -0.033590640872716904,\n",
" 0.027705339714884758,\n",
" 0.007849383167922497,\n",
" -0.039226096123456955,\n",
" 0.004643003921955824,\n",
" -0.0002806449483614415,\n",
" 0.02810787223279476,\n",
" 0.003709545126184821,\n",
" 0.001444432302378118,\n",
" 0.017961276695132256,\n",
" 0.025803720578551292,\n",
" 0.018932906910777092,\n",
" 0.006461340468376875,\n",
" 0.010139654390513897,\n",
" 0.007391329389065504,\n",
" 0.03620016202330589,\n",
" -0.01757262460887432,\n",
" 0.029704121872782707,\n",
" 0.01636502705514431,\n",
" -0.00523292226716876,\n",
" 0.022389134392142296,\n",
" 0.02781638316810131,\n",
" -0.011597099713981152,\n",
" 0.011409713886678219,\n",
" 0.004504199605435133,\n",
" 0.02356897108256817,\n",
" -0.006565443705767393,\n",
" -0.012714474461972713,\n",
" -0.001144267967902124,\n",
" 0.005944294389337301,\n",
" 0.012568729929625988,\n",
" -0.018780222162604332,\n",
" 0.004018384497612715,\n",
" -0.001021946663968265,\n",
" -0.015448919497430325,\n",
" 0.018127841874957085,\n",
" 0.009251306764781475,\n",
" 0.009154143743216991,\n",
" 0.013498718850314617,\n",
" -0.009188844822347164,\n",
" 0.00477486802265048,\n",
" 0.017558744177222252,\n",
" 0.00261646113358438,\n",
" 0.004674234893172979,\n",
" 0.0035412448924034834,\n",
" 0.012075974605977535,\n",
" 0.009403991512954235,\n",
" -0.02001558057963848,\n",
" -0.0014452998293563724,\n",
" 0.0031647381838411093,\n",
" -0.013734686188399792,\n",
" -0.009695480577647686,\n",
" -0.030342621728777885,\n",
" 0.011034942232072353,\n",
" -0.011125165037810802,\n",
" -0.0007252524956129491,\n",
" -0.007252525072544813,\n",
" 0.0014921462861821055,\n",
" 0.025317905470728874,\n",
" -0.03170290216803551,\n",
" -0.007578715216368437,\n",
" -0.02524850331246853,\n",
" 0.0029860276263207197,\n",
" -0.010826735757291317,\n",
" -0.011631800793111324,\n",
" -0.02430463396012783,\n",
" 0.014178860001266003,\n",
" 0.0050837076269090176,\n",
" -0.012894920073449612,\n",
" 0.009751002304255962,\n",
" 0.014005354605615139,\n",
" -0.011277849785983562,\n",
" -0.0050316560082137585,\n",
" -0.02628953568637371,\n",
" 0.005201691295951605,\n",
" 0.00963995885103941,\n",
" -0.012513208203017712,\n",
" -0.01697576604783535,\n",
" -0.008238035254180431,\n",
" 0.007203943561762571,\n",
" -0.0012527088401839137,\n",
" 0.009237426333129406,\n",
" -0.02552611194550991,\n",
" 0.01743382029235363,\n",
" -0.007453791331499815,\n",
" -0.027275046333670616,\n",
" -0.012207838706672192,\n",
" 0.0029686770867556334,\n",
" 0.004795688670128584,\n",
" 0.00462218327447772,\n",
" -0.001602322212420404,\n",
" -0.017072929069399834,\n",
" 0.010438083671033382,\n",
" 0.019182754680514336,\n",
" -0.003515219083055854,\n",
" 0.007349688094109297,\n",
" 0.0018790633184835315,\n",
" 0.036616574972867966,\n",
" 0.009556676261126995,\n",
" 0.004913672339171171,\n",
" -0.006856932770460844,\n",
" -0.019849015399813652,\n",
" 0.021820036694407463,\n",
" 0.05088565871119499,\n",
" 0.01772530935704708,\n",
" -0.006936745252460241,\n",
" -0.007314987014979124,\n",
" 0.0048789712600409985,\n",
" -0.008085350506007671,\n",
" -0.0060241068713366985,\n",
" -0.011666501872241497,\n",
" 0.018113961443305016,\n",
" -0.008827953599393368,\n",
" -0.01911335252225399,\n",
" -0.01866917870938778,\n",
" -0.003733835881575942,\n",
" -0.0036227924283593893,\n",
" 0.0031456525903195143,\n",
" -0.008730790577828884,\n",
" -0.0072317044250667095,\n",
" -0.012353583239018917,\n",
" 0.004538900684565306,\n",
" -0.012041273526847363,\n",
" -0.01789187453687191,\n",
" 0.010916958563029766,\n",
" 0.020723482593894005,\n",
" 0.01246462669223547,\n",
" 0.014213561080396175,\n",
" -0.014824300073087215,\n",
" 0.027941307052969933,\n",
" 0.024360155686736107,\n",
" 0.016004135832190514,\n",
" -0.010417263023555279,\n",
" -0.004295993130654097,\n",
" 0.010104953311383724,\n",
" 0.0018495674012228847,\n",
" 0.016184581443667412,\n",
" 0.004747107159346342,\n",
" 0.02476268820464611,\n",
" 0.017614265903830528,\n",
" -0.00834213849157095,\n",
" 0.017933515831828117,\n",
" -0.007550954353064299,\n",
" -0.0017489342717453837,\n",
" 0.008258855901658535,\n",
" 0.016489950940012932,\n",
" -0.013804088346660137,\n",
" -0.0037234255578368902,\n",
" -0.005895712878555059,\n",
" -0.0020560387056320906,\n",
" 0.016587113961577415,\n",
" 0.0010800709715113044,\n",
" -0.013713865540921688,\n",
" 0.017808591946959496,\n",
" -0.0069645061157643795,\n",
" -0.017655907198786736,\n",
" -0.022583460435271263,\n",
" 0.0021185006480664015,\n",
" 0.022291971370577812,\n",
" 0.014213561080396175,\n",
" 0.006614025216549635,\n",
" -0.02186167798936367,\n",
" -0.05288444086909294,\n",
" -0.017211733385920525,\n",
" -0.019654689356684685,\n",
" 0.022999873384833336,\n",
" 0.0002550529025029391,\n",
" -0.03178618475794792,\n",
" 0.010903078131377697,\n",
" -0.05288444086909294,\n",
" -0.002675452968105674,\n",
" -0.038754161447286606,\n",
" 0.005243332590907812,\n",
" -0.04130816087126732,\n",
" -0.011118224821984768,\n",
" -0.018849624320864677,\n",
" 0.010077192448079586,\n",
" 0.029898447915911674,\n",
" 0.015629364177584648,\n",
" 0.005701386835426092,\n",
" -0.007280285935848951,\n",
" -0.007981247268617153,\n",
" -0.0032029093708842993,\n",
" -0.013019843958318233,\n",
" -0.010306219570338726,\n",
" -0.007176182698458433,\n",
" -0.016031896695494652,\n",
" -0.0174477007240057,\n",
" 0.015823690220713615,\n",
" 0.002444690791890025,\n",
" -0.007391329389065504,\n",
" -0.0006983591592870653,\n",
" 0.0059477644972503185,\n",
" -0.012013512663543224,\n",
" -0.004080846440047026,\n",
" 0.012714474461972713,\n",
" -0.004084316547960043,\n",
" -0.008744671009480953,\n",
" 0.00979264359921217,\n",
" 0.02917666547000408,\n",
" 0.010805915109813213,\n",
" -0.0011234473204240203,\n",
" -0.019987819716334343,\n",
" -0.0013238460524007678,\n",
" -0.013047604821622372,\n",
" -0.0015936469426378608,\n",
" -0.004795688670128584,\n",
" 0.014796539209783077,\n",
" -0.015671005472540855,\n",
" 0.01698964647948742,\n",
" 0.014394006691873074,\n",
" -0.006655666511505842,\n",
" 0.0059720552526414394,\n",
" 0.015296234749257565,\n",
" -0.01972409151494503,\n",
" 0.009376230649650097,\n",
" 0.01635114662349224,\n",
" 0.004021854605525732,\n",
" 0.017322776839137077,\n",
" -0.005867952015250921,\n",
" 0.015337876044213772,\n",
" -0.006044927518814802,\n",
" 0.0070026773028075695,\n",
" -0.00721782399341464,\n",
" -0.017544863745570183,\n",
" 0.009147203527390957,\n",
" -0.003643613075837493,\n",
" -0.007585655432194471,\n",
" 0.019987819716334343,\n",
" -0.0009993909625336528,\n",
" -0.020987210795283318,\n",
" -0.006527272518724203,\n",
" 0.010916958563029766,\n",
" -0.019363200291991234,\n",
" 0.022208688780665398,\n",
" -0.0027014787774533033,\n",
" -0.01941872201859951,\n",
" -0.04111383482813835,\n",
" -0.010743453167378902,\n",
" -0.012964322231709957,\n",
" 0.013082305900752544,\n",
" -0.012943501584231853,\n",
" -0.013630582951009274,\n",
" 0.008883475326001644,\n",
" -0.014394006691873074,\n",
" 0.006523802410811186,\n",
" -0.018002917990088463,\n",
" 0.009306828491389751,\n",
" -0.020987210795283318,\n",
" -0.003398970467969775,\n",
" -0.010104953311383724,\n",
" 0.008737730793654919,\n",
" 0.023138677701354027,\n",
" 0.0023891690652817488,\n",
" 0.014824300073087215,\n",
" -0.017503222450613976,\n",
" -0.003733835881575942,\n",
" -0.023777177557349205,\n",
" -0.017072929069399834,\n",
" -0.003166473237797618,\n",
" -0.01414415892213583,\n",
" 0.015421158634126186,\n",
" 0.029010100290179253,\n",
" 0.04483379051089287,\n",
" -0.02048751525580883,\n",
" 0.012429925613105297,\n",
" 0.019043950363993645,\n",
" -0.016101298853754997,\n",
" 0.007835502736270428,\n",
" -0.024262992665171623,\n",
" -0.005555642303079367,\n",
" -0.008161692880094051,\n",
" 0.009737121872603893,\n",
" 0.017086809501051903,\n",
" -0.006870813202112913,\n",
" 0.003553390270099044,\n",
" -0.02903786115348339,\n",
" 0.02995396964251995,\n",
" 0.02658102475106716,\n",
" -0.0009950533276423812,\n",
" 0.007897964678704739,\n",
" -0.001700352760963142,\n",
" -0.006908984389156103,\n",
" -0.012964322231709957,\n",
" 0.004951843526214361,\n",
" -0.00013262317224871367,\n",
" 0.01589309237897396,\n",
" 0.009147203527390957,\n",
" -0.013422376476228237,\n",
" 0.024429557844996452,\n",
" 0.00311268656514585,\n",
" 0.010916958563029766,\n",
" 0.008959817700088024,\n",
" 0.013158648274838924,\n",
" -0.0036540233995765448,\n",
" 0.0063155959360301495,\n",
" 0.007710579317063093,\n",
" 0.016018016263842583,\n",
" -0.018558135256171227,\n",
" 0.009070861153304577,\n",
" -0.01229806151241064,\n",
" -0.00714148161932826,\n",
" 0.022403014823794365,\n",
" 0.0037546565290540457,\n",
" 0.016142940148711205,\n",
" -0.007634236942976713,\n",
" -0.006523802410811186,\n",
" -0.0029738822486251593,\n",
" -0.025137459859251976,\n",
" -0.04727674648165703,\n",
" -0.019043950363993645,\n",
" -0.012263360433280468,\n",
" 0.006600144784897566,\n",
" -0.01776695065200329,\n",
" -0.010111893527209759,\n",
" -0.01986289583146572,\n",
" -0.0044729686342179775,\n",
" -0.0008601529407314956,\n",
" 0.001425346708856523,\n",
" -0.0054133678786456585,\n",
" 0.028926817700266838,\n",
" -0.012180077843368053,\n",
" -0.013699985109269619,\n",
" -0.00993144791573286,\n",
" -0.005774259101599455,\n",
" 0.03270229324698448,\n",
" -0.0033486539032310247,\n",
" 0.005239862482994795,\n",
" 0.006232313346117735,\n",
" 0.014879821799695492,\n",
" -0.007731399964541197,\n",
" -0.01896066777408123,\n",
" -0.005378666799515486,\n",
" 0.007210883777588606,\n",
" 0.030176056548953056,\n",
" 0.011416654102504253,\n",
" -0.006915924604982138,\n",
" -0.019960058853030205,\n",
" 0.009730181656777859,\n",
" 0.025803720578551292,\n",
" -0.0180306788533926,\n",
" -0.03978131338953972,\n",
" 0.011541577987372875,\n",
" -0.005597283598035574,\n",
" 0.008293556980788708,\n",
" -0.01944648288190365,\n",
" -0.022083764895796776,\n",
" -0.018447091802954674,\n",
" 0.015101908706128597,\n",
" -0.015684885904192924,\n",
" 0.03239692375063896,\n",
" -0.0078702038154006,\n",
" -0.0022711853962391615,\n",
" -0.0014479024102911353,\n",
" 0.0004940565559081733,\n",
" -0.0345345102250576,\n",
" 0.006895103957504034,\n",
" 0.008522584103047848,\n",
" -0.017697548493742943,\n",
" -0.013477898202836514,\n",
" 0.02780250273644924,\n",
" -0.02386046014726162,\n",
" -0.01269365381449461,\n",
" 0.0030727803241461515,\n",
" 0.03658881410956383,\n",
" -0.013429316692054272,\n",
" -0.013790207915008068,\n",
" -0.0008970228373073041,\n",
" 0.02019602619111538,\n",
" -0.014477289281785488,\n",
" -0.0014288168167695403,\n",
" -0.017253374680876732,\n",
" 0.0281356330960989,\n",
" -0.02950979582965374,\n",
" -0.0039385720156133175,\n",
" 0.00855728518217802,\n",
" 0.004257821943610907,\n",
" 0.015171310864388943,\n",
" 0.011125165037810802,\n",
" -0.01214537676423788,\n",
" -0.015490560792386532,\n",
" 0.005073297303169966,\n",
" 0.001408863696269691,\n",
" 0.012728354893624783,\n",
" -0.00040643636020831764,\n",
" -0.011340311728417873,\n",
" 0.0021462615113705397,\n",
" -0.0033156878780573606,\n",
" -0.02950979582965374,\n",
" 0.0045354305766522884,\n",
" -0.003942042123526335,\n",
" 0.01025069784373045,\n",
" -0.024498960003256798,\n",
" 0.0013385940110310912,\n",
" 0.02311091683804989,\n",
" 0.019460363313555717,\n",
" 0.0013177733635529876,\n",
" -0.0017445966368541121,\n",
" 0.003515219083055854,\n",
" 0.0011781015200540423,\n",
" 0.02494313381612301,\n",
" 0.0026771880220621824,\n",
" 0.0036158522125333548,\n",
" 0.00028238000231795013,\n",
" -0.013526479713618755,\n",
" 0.0014956163940951228,\n",
" 0.027885785326361656,\n",
" -0.02766369841992855,\n",
" 0.0034406117629259825,\n",
" 0.012707534246146679,\n",
" -0.020862286910414696,\n",
" -0.0048546805046498775,\n",
" 0.016878603026270866,\n",
" 0.0026060508098453283,\n",
" 0.008411540649831295,\n",
" -0.0060865688137710094,\n",
" 0.0002385699044680223,\n",
" 0.030453665181994438,\n",
" -0.0029478564392775297,\n",
" 0.02001558057963848,\n",
" 0.014546691440045834,\n",
" -0.02097333036363125,\n",
" 0.0033035425003618,\n",
" -0.026511622592806816,\n",
" 0.005482770036906004,\n",
" 0.020765123888850212,\n",
" -0.010417263023555279,\n",
" -0.002422135090455413,\n",
" -0.011430534534156322,\n",
" 0.0005300589255057275,\n",
" 0.0032913971226662397,\n",
" -0.023818818852305412,\n",
" -0.001997046871110797,\n",
" -0.005163520108908415,\n",
" 0.02399926446378231,\n",
" -0.0005248537636362016,\n",
" -0.02250017784535885,\n",
" -0.0030970710795372725,\n",
" -0.0038067081477493048,\n",
" -0.00809923093765974,\n",
" 0.045055877417325974,\n",
" 0.023763297125697136,\n",
" -0.0004515477630775422,\n",
" 0.0024845970328897238,\n",
" 0.043057095259428024,\n",
" 0.011284790001809597,\n",
" 0.006603614892810583,\n",
" 0.0019849014934152365,\n",
" -0.013977593742311,\n",
" -0.016129059717059135,\n",
" -0.015559962950646877,\n",
" -0.012318882159888744,\n",
" -0.014852060936391354,\n",
" -0.034812118858098984,\n",
" 0.02615073136985302,\n",
" 0.00269280350767076,\n",
" -0.016476070508360863,\n",
" -0.0288990568369627,\n",
" -0.018252765759825706,\n",
" 0.003190763993188739,\n",
" -0.00802288856357336,\n",
" 0.003595031565055251,\n",
" -0.0025002125184983015,\n",
" 0.006260074209421873,\n",
" 0.007314987014979124,\n",
" -0.0006319933454506099,\n",
" 0.0212648194283247,\n",
" 0.004247411619871855,\n",
" 0.01382490899413824,\n",
" -0.03167514130473137,\n",
" 0.004216180648654699,\n",
" 0.0174477007240057,\n",
" 0.011055762879550457,\n",
" 0.010764273814857006,\n",
" 0.0027917015831917524,\n",
" -0.04849822446703911,\n",
" -0.019973939284682274,\n",
" 0.012631191872060299,\n",
" 0.02065408043563366,\n",
" 0.00046889830264262855,\n",
" 0.0218477975577116,\n",
" 0.021014971658587456,\n",
" -0.0030259338673204184,\n",
" -0.016462190076708794,\n",
" -0.00013912962458562106,\n",
" -0.014921463094651699,\n",
" 0.003051959676668048,\n",
" 0.02322196029126644,\n",
" -0.013450137339532375,\n",
" -0.023666134104132652,\n",
" -0.009501154534518719,\n",
" -0.006284364964812994,\n",
" -0.033562880009412766,\n",
" 0.011708143167197704,\n",
" 0.018572015687823296,\n",
" -0.0026147260796278715,\n",
" -0.010451964102685452,\n",
" -0.016129059717059135,\n",
" -0.029898447915911674,\n",
" -0.008772431872785091,\n",
" -0.0073843891732394695,\n",
" 0.025637155398726463,\n",
" 0.02631729654967785,\n",
" -0.025914764031767845,\n",
" 0.004990014713257551,\n",
" 0.0029582667630165815,\n",
" -0.008668328635394573,\n",
" -0.006600144784897566,\n",
" -0.006763239856809378,\n",
" -0.02215316705405712,\n",
" 0.011451355181634426,\n",
" 0.009938388131558895,\n",
" -0.0026615725364536047,\n",
" -0.022555699571967125,\n",
" -0.01275611575692892,\n",
" 0.00841848086565733,\n",
" -0.02093168906867504,\n",
" 0.0056423950009047985,\n",
" 0.018627537414431572,\n",
" -0.024734927341341972,\n",
" 0.0030883958097547293,\n",
" 0.022583460435271263,\n",
" 0.03381272777915001,\n",
" -0.03850431367754936,\n",
" 0.002444690791890025,\n",
" -0.0021670821588486433,\n",
" -0.0258453618735075,\n",
" -0.006856932770460844,\n",
" -0.003447551978752017,\n",
" -0.013068425469100475,\n",
" -0.032979901880025864,\n",
" 0.010833675973117352,\n",
" -0.008612806908786297,\n",
" -0.010882257483899593,\n",
" -0.016309505328536034,\n",
" -0.021070493385195732,\n",
" -0.008397660218179226,\n",
" -0.007557894568890333,\n",
" 0.002675452968105674,\n",
" 0.20676289498806,\n",
" -0.01368610467761755,\n",
" -0.010368681512773037,\n",
" 0.013894311152398586,\n",
" -0.005579933058470488,\n",
" 0.006211492698639631,\n",
" 0.01458833273500204,\n",
" 0.012443806044757366,\n",
" -0.006065748166292906,\n",
" 0.005430718418210745,\n",
" 0.0029062151443213224,\n",
" -0.008244975470006466,\n",
" -0.021056612953543663,\n",
" -0.005625044461339712,\n",
" -0.005010835360735655,\n",
" -0.0009325914434157312,\n",
" -0.01177754532545805,\n",
" -0.030037252232432365,\n",
" -0.00970242079347372,\n",
" 0.0007313251844607294,\n",
" 0.01776695065200329,\n",
" -0.01743382029235363,\n",
" 0.012797757051885128,\n",
" -0.0025678796228021383,\n",
" 0.011708143167197704,\n",
" -0.007863263599574566,\n",
" -0.0004840800247620791,\n",
" -0.014213561080396175,\n",
" 0.010930838994681835,\n",
" 0.01635114662349224,\n",
" -0.018460972234606743,\n",
" -0.005350905936211348,\n",
" -0.0007486757240258157,\n",
" 0.017031287774443626,\n",
" 0.0032011743169277906,\n",
" -0.0021289109718054533,\n",
" 0.021514667198061943,\n",
" -0.013602822087705135,\n",
" 0.028954578563570976,\n",
" 0.010146594606339931,\n",
" -0.003190763993188739,\n",
" -0.0016873398562893271,\n",
" -0.0007196135702542961,\n",
" -0.012860218994319439,\n",
" -0.02796906791627407,\n",
" 0.00614903075620532,\n",
" 0.0026199312414973974,\n",
" -0.015573843382298946,\n",
" 0.00878631230443716,\n",
" -0.012915740720927715,\n",
" -0.010257638059556484,\n",
" 0.012957382015883923,\n",
" 0.03869863972067833,\n",
" 0.02097333036363125,\n",
" 0.005330085288733244,\n",
" -0.003633202752098441,\n",
" -0.007995127700269222,\n",
" 0.00687428331002593,\n",
" -0.0035880913492292166,\n",
" 0.011742844246327877,\n",
" -0.001547668012790382,\n",
" 0.02219480834901333,\n",
" -0.02981516532599926,\n",
" 0.007301106583327055,\n",
" 0.007544014137238264,\n",
" 0.015323995612561703,\n",
" -0.009077801369130611,\n",
" -0.00032987710437737405,\n",
" 0.020709602162241936,\n",
" -0.017655907198786736,\n",
" 0.0025418538134545088,\n",
" -0.009633018635213375,\n",
" -0.017253374680876732,\n",
" 0.01683696173131466,\n",
" 0.0036609636154025793,\n",
" -0.020612439140677452,\n",
" 0.020529156550765038,\n",
" 0.036783140152692795,\n",
" 0.0037997679319232702,\n",
" 0.03595031425356865,\n",
" -0.012749175541102886,\n",
" 0.01682308129966259,\n",
" 0.003921221476048231,\n",
" -0.035256292670965195,\n",
" -0.013269691728055477,\n",
" -0.023360764607787132,\n",
" 0.03528405353426933,\n",
" -0.013887370936572552,\n",
" -0.02018214575946331,\n",
" -0.006499511655420065,\n",
" 0.0012501062592491508,\n",
" -0.048997920006513596,\n",
" -0.008834893815219402,\n",
" 0.022833308205008507,\n",
" 0.013346034102141857,\n",
" 0.016129059717059135,\n",
" 0.010521366260945797,\n",
" 0.006679957266896963,\n",
" -0.032646771520376205,\n",
" -0.04697137698531151,\n",
" -0.01775307022035122,\n",
" 0.019946178421378136,\n",
" -0.0034631674643605947,\n",
" 0.03361840173602104,\n",
" -0.014255202375352383,\n",
" -0.023166438564658165,\n",
" -0.021625710651278496,\n",
" 0.005663215648382902,\n",
" 0.0172672551125288,\n",
" -0.01776695065200329,\n",
" 0.0006094376440159976,\n",
" -0.014976984821259975,\n",
" 0.013783267699182034,\n",
" 0.011555458419024944,\n",
" 0.0029166254680603743,\n",
" 0.011361132375895977,\n",
" -0.02691415511071682,\n",
" -0.02138974331319332,\n",
" 0.0028524284716695547,\n",
" 0.01025069784373045,\n",
" -0.012867159210145473,\n",
" -0.039531465619802475,\n",
" 0.001441829721443355,\n",
" 0.009355410002171993,\n",
" 0.016031896695494652,\n",
" -0.00714148161932826,\n",
" -0.014178860001266003,\n",
" 0.009646899066865444,\n",
" -0.004747107159346342,\n",
" -0.007148421835154295,\n",
" 0.010819795541465282,\n",
" -0.03581150993704796,\n",
" 0.023749416694045067,\n",
" -0.020848406478762627,\n",
" -0.007419090252369642,\n",
" -0.002904480090364814,\n",
" -0.01116680633276701,\n",
" -0.006992266979068518,\n",
" -0.029537556692957878,\n",
" 0.012867159210145473,\n",
" -0.003246285719797015,\n",
" -5.533195144380443e-05,\n",
" 0.0032410805579274893,\n",
" -0.0014860735973343253,\n",
" 0.017503222450613976,\n",
" -0.034506749361753464,\n",
" 0.032036032527685165,\n",
" 0.0318417064845562,\n",
" -0.03597807511687279,\n",
" -0.02173675410449505,\n",
" -0.008335198275744915,\n",
" -0.0008796722977422178,\n",
" -0.021320341154932976,\n",
" -0.010361741296947002,\n",
" 0.03531181439757347,\n",
" -0.021750634536147118,\n",
" -0.04277948662638664,\n",
" -0.011728963814675808,\n",
" -0.012499327771365643,\n",
" 0.011062703095376492,\n",
" -0.04261292144656181,\n",
" -0.03414585813879967,\n",
" 0.00857116561383009,\n",
" -0.004771397914737463,\n",
" -0.02555387280881405,\n",
" -0.0027431200724095106,\n",
" -0.18144498765468597,\n",
" 0.00916802417486906,\n",
" 0.019529765471816063,\n",
" -0.013790207915008068,\n",
" 0.017711428925395012,\n",
" 0.00353256962262094,\n",
" 0.026386698707938194,\n",
" 0.0082519156858325,\n",
" -0.015559962950646877,\n",
" -0.0027066839393228292,\n",
" 0.013221110217273235,\n",
" -0.012055153958499432,\n",
" -0.028191154822707176,\n",
" -0.026400579139590263,\n",
" 0.005978995468467474,\n",
" -0.01093777921050787,\n",
" -0.008272736333310604,\n",
" 0.01712845079600811,\n",
" 0.02200048230588436,\n",
" 0.015421158634126186,\n",
" 0.009875926189124584,\n",
" -0.023652253672480583,\n",
" -0.009098622016608715,\n",
" 0.0023943742271512747,\n",
" 0.009882866404950619,\n",
" 0.009959208779036999,\n",
" -0.004112077411264181,\n",
" 0.010153534822165966,\n",
" -0.010833675973117352,\n",
" -0.007516253273934126,\n",
" -0.014255202375352383,\n",
" -0.002049098489806056,\n",
" 0.020848406478762627,\n",
" -0.003017258597537875,\n",
" 0.00832825805991888,\n",
" 0.013588941656053066,\n",
" 0.004934492986649275,\n",
" -0.008529524318873882,\n",
" -0.011749784462153912,\n",
" -0.005902653094381094,\n",
" 0.02123705856502056,\n",
" 0.016628755256533623,\n",
" -0.009751002304255962,\n",
" 0.022111525759100914,\n",
" 0.001578031457029283,\n",
" 0.008196393959224224,\n",
" 0.019335439428687096,\n",
" -0.01836380921304226,\n",
" 0.009050040505826473,\n",
" 0.009528915397822857,\n",
" 0.015546082518994808,\n",
" -0.028357720002532005,\n",
" 0.013089246116578579,\n",
" 0.0038691700901836157,\n",
" -0.0005322277429513633,\n",
" 0.013255811296403408,\n",
" 0.012422985397279263,\n",
" -0.0007681950810365379,\n",
" -0.009050040505826473,\n",
" -0.011312550865113735,\n",
" 0.0033104827161878347,\n",
" -0.013158648274838924,\n",
" 0.01711457036435604,\n",
" -0.0061247400008141994,\n",
" -0.02601192705333233,\n",
" 0.0009221811196766794,\n",
" -0.00954973604530096,\n",
" 0.007897964678704739,\n",
" -0.001029754406772554,\n",
" 0.009195785038173199,\n",
" 0.0008900826214812696,\n",
" 0.00011787522089434788,\n",
" 0.013658343814313412,\n",
" -0.011291730217635632,\n",
" 0.008085350506007671,\n",
" 0.014213561080396175,\n",
" 0.001027151825837791,\n",
" 0.010056371800601482,\n",
" 0.01046584453433752,\n",
" -0.009848165325820446,\n",
" -0.011902469210326672,\n",
" 0.03836550936102867,\n",
" -0.016004135832190514,\n",
" 0.01299902331084013,\n",
" 0.03120320849120617,\n",
" 0.01850261352956295,\n",
" 0.018141722306609154,\n",
" 0.01590697281062603,\n",
" -0.011590159498155117,\n",
" -0.010049431584775448,\n",
" 0.01521295215934515,\n",
" -0.012152316980063915,\n",
" -0.009938388131558895,\n",
" 0.00803676899522543,\n",
" -0.0023614082019776106,\n",
" 0.008689149282872677,\n",
" 0.000945604348089546,\n",
" -0.007432970684021711,\n",
" 0.006398878525942564,\n",
" -0.0025036826264113188,\n",
" 0.006051867734640837,\n",
" 0.0014053935883566737,\n",
" -0.012152316980063915,\n",
" 0.029287708923220634,\n",
" 0.02524850331246853,\n",
" 0.014852060936391354,\n",
" 0.003261901205405593,\n",
" 0.02169511280953884,\n",
" 0.03256348893046379,\n",
" -0.019918417558073997,\n",
" -0.020307069644331932,\n",
" -0.0014938813401386142,\n",
" 0.00902921985834837,\n",
" 0.021139895543456078,\n",
" 0.02399926446378231,\n",
" 0.012103735469281673,\n",
" 0.004146778490394354,\n",
" -0.006332946475595236,\n",
" 0.022833308205008507,\n",
" 0.007474611978977919,\n",
" 0.049775224179029465,\n",
" -0.005291914101690054,\n",
" 0.0010453698923811316,\n",
" 0.004844270180910826,\n",
" 0.027927426621317863,\n",
" -0.026039687916636467,\n",
" -0.12514595687389374,\n",
" -0.012561789713799953,\n",
" 0.002030012896284461,\n",
" 0.019182754680514336,\n",
" -0.0028437532018870115,\n",
" 0.002788231475278735,\n",
" 0.011083523742854595,\n",
" 0.02630341611802578,\n",
" -0.018447091802954674,\n",
" 0.015823690220713615,\n",
" 0.002512357896193862,\n",
" 0.001597117050550878,\n",
" -0.00948727410286665,\n",
" 0.0007625561556778848,\n",
" 0.008293556980788708,\n",
" 0.020612439140677452,\n",
" 0.006447460036724806,\n",
" -0.006326006259769201,\n",
" -0.014768778346478939,\n",
" 0.019696330651640892,\n",
" 0.0034544921945780516,\n",
" 0.017100689932703972,\n",
" 0.021209297701716423,\n",
" 0.003333038417622447,\n",
" -0.00653074262663722,\n",
" 0.004504199605435133,\n",
" -0.02767757885158062,\n",
" 0.014352365396916866,\n",
" 0.010091072879731655,\n",
" -0.010306219570338726,\n",
" 0.02308315597474575,\n",
" -0.009862045757472515,\n",
" -0.010889197699725628,\n",
" -0.012339702807366848,\n",
" -0.002030012896284461,\n",
" -0.01154851820319891,\n",
" -0.029398752376437187,\n",
" -0.005781199317425489,\n",
" 0.010410322807729244,\n",
" -0.013769387267529964,\n",
" -0.0008007273427210748,\n",
" -0.00397327309474349,\n",
" 0.024804329499602318,\n",
" 0.015268473885953426,\n",
" 0.0210843738168478,\n",
" -0.01460221316665411,\n",
" -0.015809809789061546,\n",
" -0.002512357896193862,\n",
" 0.007176182698458433,\n",
" -0.0227916669100523,\n",
" -0.02383269928395748,\n",
" -0.018474852666258812,\n",
" -0.023777177557349205,\n",
" -0.021820036694407463,\n",
" 0.02111213468015194,\n",
" 0.012318882159888744,\n",
" 0.010000850073993206,\n",
" 0.009528915397822857,\n",
" -0.018127841874957085,\n",
" 0.005951234605163336,\n",
" -0.00031751484493725,\n",
" -0.012013512663543224,\n",
" -0.015351756475865841,\n",
" 0.014227441512048244,\n",
" 0.005340495612472296,\n",
" 0.007398269604891539,\n",
" -0.03445122763514519,\n",
" -0.027941307052969933,\n",
" 0.009063920937478542,\n",
" -0.007356628309935331,\n",
" -0.0003285758139099926,\n",
" 0.03747716173529625,\n",
" -0.017086809501051903,\n",
" 0.017794711515307426,\n",
" -0.011048822663724422,\n",
" -0.001525979838334024,\n",
" -0.012978202663362026,\n",
" -0.0070026773028075695,\n",
" -0.0024672464933246374,\n",
" -0.0020751242991536856,\n",
" -0.011506876908242702,\n",
" -0.017017407342791557,\n",
" -0.001215405180118978,\n",
" -0.01061852928251028,\n",
" 0.01944648288190365,\n",
" 0.021792275831103325,\n",
" 0.02784414403140545,\n",
" -0.006409288849681616,\n",
" -0.017614265903830528,\n",
" -0.015532202087342739,\n",
" 0.003556860378012061,\n",
" 0.003695664694532752,\n",
" -0.025317905470728874,\n",
" -0.013505659066140652,\n",
" -0.04377887770533562,\n",
" 0.010611589066684246,\n",
" -0.015310115180909634,\n",
" -0.01712845079600811,\n",
" 0.008598926477134228,\n",
" -0.005323145072907209,\n",
" -0.013637523166835308,\n",
" -0.01376244705170393,\n",
" -0.013977593742311,\n",
" 0.022278090938925743,\n",
" -0.02077900432050228,\n",
" -0.009452573023736477,\n",
" -0.0007525795954279602,\n",
" -0.018752461299300194,\n",
" -0.003529099514707923,\n",
" -0.0005955572123639286,\n",
" -0.037699248641729355,\n",
" 0.007405209820717573,\n",
" -0.0007642912096343935,\n",
" 0.004115547519177198,\n",
" -0.033285271376371384,\n",
" -0.02447119913995266,\n",
" -0.010528306476771832,\n",
" 0.00515657989308238,\n",
" 0.01161098014563322,\n",
" -0.003962862771004438,\n",
" 0.01836380921304226,\n",
" 0.014768778346478939,\n",
" -0.0210843738168478,\n",
" -0.007009617518633604,\n",
" 0.02323584072291851,\n",
" 0.01790575496852398,\n",
" -0.024804329499602318,\n",
" 0.0022937410976737738,\n",
" -0.03717179223895073,\n",
" 0.027025198563933372,\n",
" -0.0020699191372841597,\n",
" 0.0005864481790922582,\n",
" 0.006725068669766188,\n",
" -0.02783026359975338,\n",
" -0.005659745540469885,\n",
" 0.003900401061400771,\n",
" -0.0010878787143155932,\n",
" -0.009695480577647686,\n",
" 0.015684885904192924,\n",
" 0.0033885601442307234,\n",
" 0.014616093598306179,\n",
" 0.007224764209240675,\n",
" -0.03620016202330589,\n",
" -0.015351756475865841,\n",
" -0.005618104245513678,\n",
" -9.152408892987296e-05,\n",
" -0.0288990568369627,\n",
" 0.004580541979521513,\n",
" 0.0024013144429773092,\n",
" 0.0040149143896996975,\n",
" 0.017530983313918114,\n",
" -0.003921221476048231,\n",
" 0.035422857850790024,\n",
" 0.013241930864751339,\n",
" 0.032036032527685165,\n",
" -0.041807856410741806,\n",
" -0.010278458707034588,\n",
" 0.0037026049103587866,\n",
" 0.0029443863313645124,\n",
" 0.00180445599835366,\n",
" 0.0031456525903195143,\n",
" -0.01605965755879879,\n",
" 0.016267864033579826,\n",
" 0.006069218274205923,\n",
" 0.029759643599390984,\n",
" -0.011041882447898388,\n",
" -0.01941872201859951,\n",
" 0.011812246404588223,\n",
" 0.01636502705514431,\n",
" -0.012894920073449612,\n",
" -0.004771397914737463,\n",
" -0.03625568374991417,\n",
" -0.0067354789935052395,\n",
" 0.0022243389394134283,\n",
" 0.012180077843368053,\n",
" 0.010118833743035793,\n",
" 0.015976374968886375,\n",
" 0.0026338116731494665,\n",
" 0.0009221811196766794,\n",
" 0.005264153238385916,\n",
" -0.014616093598306179,\n",
" 0.015504441224038601,\n",
" 0.014407887123525143,\n",
" 0.0022659802343696356,\n",
" -0.016795320436358452,\n",
" -0.0018964138580486178,\n",
" 0.02705295942723751,\n",
" 0.010333980433642864,\n",
" 0.004715876188129187,\n",
" 0.004039205145090818,\n",
" 0.004108607303351164,\n",
" 0.014643854461610317,\n",
" -0.0210843738168478,\n",
" -0.0011217122664675117,\n",
" 0.008120051585137844,\n",
" 0.005645865108817816,\n",
" 0.007391329389065504,\n",
" 0.02827443741261959,\n",
" -0.019321558997035027,\n",
" 0.012783876620233059,\n",
" -0.009730181656777859,\n",
" 0.016462190076708794,\n",
" -0.003461432410404086,\n",
" 0.006954095792025328,\n",
" -0.012138436548411846,\n",
" -0.003079720539972186,\n",
" -0.006579324137419462,\n",
" -0.007703639101237059,\n",
" -0.014727137051522732,\n",
" 0.0025036826264113188,\n",
" 0.007793861906975508,\n",
" 0.012499327771365643,\n",
" 0.0036262625362724066,\n",
" 0.006718128453940153,\n",
" 0.017197852954268456,\n",
" 0.01865529827773571,\n",
" -0.03869863972067833,\n",
" 0.022985992953181267,\n",
" -0.0010748658096417785,\n",
" -0.012166197411715984,\n",
" -0.010354801081120968,\n",
" 0.036644335836172104,\n",
" 0.025873122736811638,\n",
" 0.00857116561383009,\n",
" 0.012610371224582195,\n",
" 0.010882257483899593,\n",
" 0.03667209669947624,\n",
" 0.006346826907247305,\n",
" 0.0015112318797037005,\n",
" -0.010951659642159939,\n",
" 0.029121143743395805,\n",
" 0.008578105829656124,\n",
" 0.0029634719248861074,\n",
" -0.016476070508360863,\n",
" -0.007939605973660946,\n",
" -0.017350537702441216,\n",
" -0.021667351946234703,\n",
" -0.02735832892358303,\n",
" -0.0026615725364536047,\n",
" 0.05094118043780327,\n",
" -0.009744062088429928,\n",
" 0.06013002619147301,\n",
" 0.0009881131118163466,\n",
" -0.021292580291628838,\n",
" 0.012110675685107708,\n",
" -0.008751611225306988,\n",
" 0.02783026359975338,\n",
" -0.0057187373749911785,\n",
" 0.00918190460652113,\n",
" -0.004178009461611509,\n",
" -0.008911236189305782,\n",
" 0.011145985685288906,\n",
" -0.016781440004706383,\n",
" 0.003969802986830473,\n",
" -0.04466722533106804,\n",
" -0.013089246116578579,\n",
" -0.024651644751429558,\n",
" -0.0008415011106990278,\n",
" 0.004823449533432722,\n",
" -0.016295624896883965,\n",
" -0.008487883023917675,\n",
" 0.03350735828280449,\n",
" -0.009653839282691479,\n",
" 0.017059048637747765,\n",
" 0.0061004492454230785,\n",
" -0.007467671763151884,\n",
" -0.014095577411353588,\n",
" 0.013970653526484966,\n",
" -0.04286276921629906,\n",
" -0.018252765759825706,\n",
" -0.0339515320956707,\n",
" -0.0014652529498562217,\n",
" -0.008550344966351986,\n",
" -0.02906562201678753,\n",
" -0.019835134968161583,\n",
" -0.012117615900933743,\n",
" 0.030342621728777885,\n",
" 0.004094726871699095,\n",
" -0.01191634964197874,\n",
" 0.01604577712714672,\n",
" 0.013588941656053066,\n",
" -0.008050649426877499,\n",
" 0.008654448203742504,\n",
" -0.01222171913832426,\n",
" -0.02752489410340786,\n",
" 0.0038032380398362875,\n",
" -0.018752461299300194,\n",
" -0.01760038547217846,\n",
" 0.00030450194026343524,\n",
" -0.006398878525942564\n",
" ],\n",
" \"index\": 1,\n",
" \"object\": \"embedding\"\n",
" }\n",
" ],\n",
" \"model\": \"text-embedding-ada-002-v2\",\n",
" \"object\": \"list\",\n",
" \"usage\": {\n",
" \"prompt_tokens\": 13,\n",
" \"total_tokens\": 13\n",
" }\n",
"}"
]
},
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"MODEL = \"text-embedding-3-small\"\n",
"\n",
"res = openai.Embedding.create(\n",
" input=[\n",
" \"Sample document text goes here\",\n",
" \"there will be several phrases in each batch\"\n",
" ], engine=MODEL\n",
")\n",
"res"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "-Egz35DjtRNo",
"outputId": "78c4c022-d3a8-4fa7-8fa8-59c45eca1298"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"vector 0: 1536\n",
"vector 1: 1536\n"
]
}
],
"source": [
"print(f\"vector 0: {len(res['data'][0]['embedding'])}\\nvector 1: {len(res['data'][1]['embedding'])}\")"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "ZguN6obBtRNp",
"outputId": "bd20d4be-0772-4383-9d1e-9960d8b5f183"
},
"outputs": [
{
"data": {
"text/plain": [
"2"
]
},
"execution_count": 6,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# we can extract embeddings to a list\n",
"embeds = [record['embedding'] for record in res['data']]\n",
"len(embeds)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "U4WJwy58tRNp"
},
"source": [
"Next, we initialize our index to store vector embeddings with Pinecone."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "OnyoBu-BRNOs",
"outputId": "4d40b553-4ff2-4336-baab-24ff6424fead"
},
"outputs": [
{
"data": {
"text/plain": [
"1536"
]
},
"execution_count": 13,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"len(embeds[0])"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "I2KLRbN-tRNq"
},
"outputs": [],
"source": [
"import pinecone\n",
"\n",
"index_name = 'semantic-search-openai'\n",
"\n",
"# initialize connection to pinecone (get API key at app.pinecone.io)\n",
"pinecone.init(\n",
" api_key=\"PINECONE_API_KEY\",\n",
" environment=\"PINECONE_ENVIRONMENT\" # find next to api key in console\n",
")\n",
"# check if 'openai' index already exists (only create index if not)\n",
"if index_name not in pinecone.list_indexes():\n",
" pinecone.create_index(index_name, dimension=len(embeds[0]))\n",
"# connect to index\n",
"index = pinecone.Index(index_name)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "TLCLmeZRtRNq"
},
"source": [
"## Populating the Index\n",
"\n",
"Now we will take 1K questions from the TREC dataset"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "JiSfCTK-lhXx",
"outputId": "bcb82771-a0d5-4c63-d2ad-69a963f93620"
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"WARNING:datasets.builder:Found cached dataset trec (/root/.cache/huggingface/datasets/trec/default/2.0.0/f2469cab1b5fceec7249fda55360dfdbd92a7a5b545e91ea0f78ad108ffac1c2)\n"
]
},
{
"data": {
"text/plain": [
"Dataset({\n",
" features: ['text', 'coarse_label', 'fine_label'],\n",
" num_rows: 1000\n",
"})"
]
},
"execution_count": 16,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from datasets import load_dataset\n",
"\n",
"# load the first 1K rows of the TREC dataset\n",
"trec = load_dataset('trec', split='train[:1000]')\n",
"trec"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "2m7a_zl8lt2e",
"outputId": "7e2bc141-27bf-4580-c632-642a65c652d8"
},
"outputs": [
{
"data": {
"text/plain": [
"{'text': 'How did serfdom develop in and then leave Russia ?',\n",
" 'coarse_label': 2,\n",
" 'fine_label': 26}"
]
},
"execution_count": 17,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"trec[0]"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "sJwnszP0ljN6"
},
"source": [
"Then we create a vector embedding for each phrase using OpenAI, and `upsert` the ID, vector embedding, and original text for each phrase to Pinecone."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 49,
"referenced_widgets": [
"0d73abb4e43144b281b35cd7b26f4197",
"74e7f7ea3b0f45eca68d2af7e6c15957",
"d58f34488c9f433cafbbe72803096267",
"a791ec194e974ea6a4e18b4bc1c5bc49",
"de16af8ed7f84ce3a8b20b03f04ccd58",
"cc26431b7f64491fbc5189b6c88744b9",
"1b6caaee4ca144cbbc4650924ea34b27",
"0e9afbd797ee4d17a085c90c7b27bfc9",
"cfcfd1cf66a942788a6b9553a41c6c8e",
"3977aa60e81a4fb980087c8b479fd10a",
"b600da6475f34fbab3e249be8929591b"
]
},
"id": "B80PgNyytRNq",
"outputId": "57bfa165-72f2-46ca-9e51-fd7d0fb23b07"
},
"outputs": [
{
"data": {
"application/vnd.jupyter.widget-view+json": {
"model_id": "0d73abb4e43144b281b35cd7b26f4197",
"version_major": 2,
"version_minor": 0
},
"text/plain": [
" 0%| | 0/32 [00:00<?, ?it/s]"
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"from tqdm.auto import tqdm\n",
"\n",
"count = 0 # we'll use the count to create unique IDs\n",
"batch_size = 32 # process everything in batches of 32\n",
"for i in tqdm(range(0, len(trec['text']), batch_size)):\n",
" # set end position of batch\n",
" i_end = min(i+batch_size, len(trec['text']))\n",
" # get batch of lines and IDs\n",
" lines_batch = trec['text'][i: i+batch_size]\n",
" ids_batch = [str(n) for n in range(i, i_end)]\n",
" # create embeddings\n",
" res = openai.Embedding.create(input=lines_batch, engine=MODEL)\n",
" embeds = [record['embedding'] for record in res['data']]\n",
" # prep metadata and upsert batch\n",
" meta = [{'text': line} for line in lines_batch]\n",
" to_upsert = zip(ids_batch, embeds, meta)\n",
" # upsert to Pinecone\n",
" index.upsert(vectors=list(to_upsert))"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "iW_iM_M_tRNr"
},
"source": [
"---\n",
"\n",
"# Querying\n",
"\n",
"With our data indexed, we're now ready to move onto performing searches. This follows a similar process to indexing. We start with a text `query`, that we would like to use to find similar sentences. As before we encode this with OpenAI's text similarity Babbage model to create a *query vector* `xq`. We then use `xq` to query the Pinecone index."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "k80ASNMqtRNr"
},
"outputs": [],
"source": [
"query = \"What caused the 1929 Great Depression?\"\n",
"\n",
"xq = openai.Embedding.create(input=query, engine=MODEL)['data'][0]['embedding']"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "RxCKv-UktRNs"
},
"source": [
"Now query..."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "_cY3_rXytRNs",
"outputId": "539ac857-9980-4156-9344-4224cb54ff26"
},
"outputs": [
{
"data": {
"text/plain": [
"{'matches': [{'id': '932',\n",
" 'metadata': {'text': 'Why did the world enter a global '\n",
" 'depression in 1929 ?'},\n",
" 'score': 0.917971551,\n",
" 'sparseValues': {},\n",
" 'values': []},\n",
" {'id': '787',\n",
" 'metadata': {'text': \"When was `` the Great Depression '' ?\"},\n",
" 'score': 0.87167418,\n",
" 'sparseValues': {},\n",
" 'values': []},\n",
" {'id': '400',\n",
" 'metadata': {'text': 'What crop failure caused the Irish Famine '\n",
" '?'},\n",
" 'score': 0.812044263,\n",
" 'sparseValues': {},\n",
" 'values': []},\n",
" {'id': '775',\n",
" 'metadata': {'text': 'What historical event happened in Dogtown '\n",
" 'in 1899 ?'},\n",
" 'score': 0.798895657,\n",
" 'sparseValues': {},\n",
" 'values': []},\n",
" {'id': '481',\n",
" 'metadata': {'text': 'What caused the Lynmouth floods ?'},\n",
" 'score': 0.792350292,\n",
" 'sparseValues': {},\n",
" 'values': []}],\n",
" 'namespace': ''}"
]
},
"execution_count": 20,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"res = index.query([xq], top_k=5, include_metadata=True)\n",
"res"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "I2iydlXVjmMZ"
},
"source": [
"The response from Pinecone includes our original text in the `metadata` field, let's print out the `top_k` most similar questions and their respective similarity scores."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "WT1L2ogHjiO-",
"outputId": "50ecca3e-7d31-414e-b59a-7725a22ed864"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"0.92: Why did the world enter a global depression in 1929 ?\n",
"0.87: When was `` the Great Depression '' ?\n",
"0.81: What crop failure caused the Irish Famine ?\n",
"0.80: What historical event happened in Dogtown in 1899 ?\n",
"0.79: What caused the Lynmouth floods ?\n"
]
}
],
"source": [
"for match in res['matches']:\n",
" print(f\"{match['score']:.2f}: {match['metadata']['text']}\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "wu7LmvmIjqPq"
},
"source": [
"Looks good, let's make it harder and replace *\"depression\"* with the incorrect term *\"recession\"*."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "SaT9yMj7jq0u",
"outputId": "2841ae2b-957f-4ed2-8260-c89d0f2cbc8f"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"0.88: Why did the world enter a global depression in 1929 ?\n",
"0.83: When was `` the Great Depression '' ?\n",
"0.81: What crop failure caused the Irish Famine ?\n",
"0.80: When did World War I start ?\n",
"0.80: What were popular songs and types of songs in the 1920s ?\n"
]
}
],
"source": [
"query = \"What was the cause of the major recession in the early 20th century?\"\n",
"\n",
"# create the query embedding\n",
"xq = openai.Embedding.create(input=query, engine=MODEL)['data'][0]['embedding']\n",
"\n",
"# query, returning the top 5 most similar results\n",
"res = index.query([xq], top_k=5, include_metadata=True)\n",
"\n",
"for match in res['matches']:\n",
" print(f\"{match['score']:.2f}: {match['metadata']['text']}\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "FXFhFri0jzkG"
},
"source": [
"And again..."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/"
},
"id": "qOEvNweOj1AH",
"outputId": "9e5deb27-909b-4d88-b000-46a9e3b6486f"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"0.90: Why did the world enter a global depression in 1929 ?\n",
"0.84: When was `` the Great Depression '' ?\n",
"0.80: When did World War I start ?\n",
"0.80: What crop failure caused the Irish Famine ?\n",
"0.80: When did the Dow first reach ?\n"
]
}
],
"source": [
"query = \"Why was there a long-term economic downturn in the early 20th century?\"\n",
"\n",
"# create the query embedding\n",
"xq = openai.Embedding.create(input=query, engine=MODEL)['data'][0]['embedding']\n",
"\n",
"# query, returning the top 5 most similar results\n",
"res = index.query([xq], top_k=5, include_metadata=True)\n",
"\n",
"for match in res['matches']:\n",
" print(f\"{match['score']:.2f}: {match['metadata']['text']}\")"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"Looks great, our semantic search pipeline is clearly able to identify the meaning between each of our queries and return the most semantically similar questions from the already indexed questions.\n",
"\n",
"Once we're finished with the index we delete it to save resources."
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"pinecone.delete_index(index_name)"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {
"id": "ItsvY1lej6dz"
},
"source": [
"---"
]
}
],
"metadata": {
"colab": {
"provenance": []
},
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.10.9"
},
"orig_nbformat": 4,
"vscode": {
"interpreter": {
"hash": "b0fa6594d8f4cbf19f97940f81e996739fb7646882a419484c72d19e05852a7e"
}
},
"widgets": {
"application/vnd.jupyter.widget-state+json": {
"0d73abb4e43144b281b35cd7b26f4197": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HBoxModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HBoxModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HBoxView",
"box_style": "",
"children": [
"IPY_MODEL_74e7f7ea3b0f45eca68d2af7e6c15957",
"IPY_MODEL_d58f34488c9f433cafbbe72803096267",
"IPY_MODEL_a791ec194e974ea6a4e18b4bc1c5bc49"
],
"layout": "IPY_MODEL_de16af8ed7f84ce3a8b20b03f04ccd58"
}
},
"0e9afbd797ee4d17a085c90c7b27bfc9": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"1b6caaee4ca144cbbc4650924ea34b27": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"3977aa60e81a4fb980087c8b479fd10a": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"74e7f7ea3b0f45eca68d2af7e6c15957": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_cc26431b7f64491fbc5189b6c88744b9",
"placeholder": "​",
"style": "IPY_MODEL_1b6caaee4ca144cbbc4650924ea34b27",
"value": "100%"
}
},
"a791ec194e974ea6a4e18b4bc1c5bc49": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "HTMLModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "HTMLModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "HTMLView",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_3977aa60e81a4fb980087c8b479fd10a",
"placeholder": "​",
"style": "IPY_MODEL_b600da6475f34fbab3e249be8929591b",
"value": " 32/32 [00:16&lt;00:00, 2.11it/s]"
}
},
"b600da6475f34fbab3e249be8929591b": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "DescriptionStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "DescriptionStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"description_width": ""
}
},
"cc26431b7f64491fbc5189b6c88744b9": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
},
"cfcfd1cf66a942788a6b9553a41c6c8e": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "ProgressStyleModel",
"state": {
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "ProgressStyleModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "StyleView",
"bar_color": null,
"description_width": ""
}
},
"d58f34488c9f433cafbbe72803096267": {
"model_module": "@jupyter-widgets/controls",
"model_module_version": "1.5.0",
"model_name": "FloatProgressModel",
"state": {
"_dom_classes": [],
"_model_module": "@jupyter-widgets/controls",
"_model_module_version": "1.5.0",
"_model_name": "FloatProgressModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/controls",
"_view_module_version": "1.5.0",
"_view_name": "ProgressView",
"bar_style": "success",
"description": "",
"description_tooltip": null,
"layout": "IPY_MODEL_0e9afbd797ee4d17a085c90c7b27bfc9",
"max": 32,
"min": 0,
"orientation": "horizontal",
"style": "IPY_MODEL_cfcfd1cf66a942788a6b9553a41c6c8e",
"value": 32
}
},
"de16af8ed7f84ce3a8b20b03f04ccd58": {
"model_module": "@jupyter-widgets/base",
"model_module_version": "1.2.0",
"model_name": "LayoutModel",
"state": {
"_model_module": "@jupyter-widgets/base",
"_model_module_version": "1.2.0",
"_model_name": "LayoutModel",
"_view_count": null,
"_view_module": "@jupyter-widgets/base",
"_view_module_version": "1.2.0",
"_view_name": "LayoutView",
"align_content": null,
"align_items": null,
"align_self": null,
"border": null,
"bottom": null,
"display": null,
"flex": null,
"flex_flow": null,
"grid_area": null,
"grid_auto_columns": null,
"grid_auto_flow": null,
"grid_auto_rows": null,
"grid_column": null,
"grid_gap": null,
"grid_row": null,
"grid_template_areas": null,
"grid_template_columns": null,
"grid_template_rows": null,
"height": null,
"justify_content": null,
"justify_items": null,
"left": null,
"margin": null,
"max_height": null,
"max_width": null,
"min_height": null,
"min_width": null,
"object_fit": null,
"object_position": null,
"order": null,
"overflow": null,
"overflow_x": null,
"overflow_y": null,
"padding": null,
"right": null,
"top": null,
"visibility": null,
"width": null
}
}
}
}
},
"nbformat": 4,
"nbformat_minor": 0
}
Reference in New Issue View Git Blame Copy Permalink