{ "cells": [ { "attachments": {}, "cell_type": "markdown", "metadata": { "id": "izNeUi--hSSA" }, "source": [ "# Semantic Search with Pinecone and OpenAI" ] }, { "cell_type": "markdown", "metadata": { "id": "LI76-BMFhUmS" }, "source": [ "In this guide you will learn how to use the OpenAI Embedding API to generate language embeddings, and then index those embeddings in the Pinecone vector database for fast and scalable vector search.\n", "\n", "This is a powerful and common combination for building semantic search, question-answering, threat-detection, and other applications that rely on NLP and search over a large corpus of text data.\n", "\n", "The basic workflow looks like this:\n", "\n", "**Embed and index**\n", "\n", "* Use the OpenAI Embedding API to generate vector embeddings of your documents (or any text data).\n", "* Upload those vector embeddings into Pinecone, which can store and index millions/billions of these vector embeddings, and search through them at ultra-low latencies.\n", "\n", "**Search**\n", "\n", "* Pass your query text or document through the OpenAI Embedding API again.\n", "* Take the resulting vector embedding and send it as a query to Pinecone.\n", "* Get back semantically similar documents, even if they don't share any keywords with the query.\n", "\n", "![Architecture overview](https://files.readme.io/6a3ea5a-pinecone-openai-overview.png)\n", "\n", "Let's get started..." ] }, { "cell_type": "markdown", "metadata": { "id": "nXzzYE0hhU64" }, "source": [ "## Setup" ] }, { "cell_type": "markdown", "metadata": { "id": "FNk3hfyAtRNj" }, "source": [ "We first need to setup our environment and retrieve API keys for OpenAI and Pinecone. Let's start with our environment, we need HuggingFace *Datasets* for our data, and the OpenAI and Pinecone clients:" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "SGQoz_JmtRNh", "outputId": "389c79fc-2ee9-452b-fc58-9598899090c2" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Looking in indexes: https://pypi.org/simple, https://us-python.pkg.dev/colab-wheels/public/simple/\n", "Collecting pinecone-client\n", " Downloading pinecone_client-2.0.13-py3-none-any.whl (175 kB)\n", "\u001b[K |████████████████████████████████| 175 kB 4.9 MB/s \n", "\u001b[?25hCollecting openai\n", " Downloading openai-0.25.0.tar.gz (44 kB)\n", "\u001b[K |████████████████████████████████| 44 kB 2.1 MB/s \n", "\u001b[?25h Installing build dependencies ... \u001b[?25l\u001b[?25hdone\n", " Getting requirements to build wheel ... \u001b[?25l\u001b[?25hdone\n", " Preparing wheel metadata ... \u001b[?25l\u001b[?25hdone\n", "Collecting datasets\n", " Downloading datasets-2.8.0-py3-none-any.whl (452 kB)\n", "\u001b[K |████████████████████████████████| 452 kB 59.5 MB/s \n", "\u001b[?25hRequirement already satisfied: urllib3>=1.21.1 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (1.24.3)\n", "Requirement already satisfied: python-dateutil>=2.5.3 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (2.8.2)\n", "Collecting loguru>=0.5.0\n", " Downloading loguru-0.6.0-py3-none-any.whl (58 kB)\n", "\u001b[K |████████████████████████████████| 58 kB 4.9 MB/s \n", "\u001b[?25hRequirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (2.23.0)\n", "Requirement already satisfied: dnspython>=2.0.0 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (2.2.1)\n", "Requirement already satisfied: pyyaml>=5.4 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (6.0)\n", "Requirement already satisfied: typing-extensions>=3.7.4 in /usr/local/lib/python3.8/dist-packages (from pinecone-client) (4.4.0)\n", "Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.8/dist-packages (from python-dateutil>=2.5.3->pinecone-client) (1.15.0)\n", "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pinecone-client) (2022.12.7)\n", "Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pinecone-client) (2.10)\n", "Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.8/dist-packages (from requests>=2.19.0->pinecone-client) (3.0.4)\n", "Requirement already satisfied: numpy in /usr/local/lib/python3.8/dist-packages (from openai) (1.21.6)\n", "Requirement already satisfied: pandas>=1.2.3 in /usr/local/lib/python3.8/dist-packages (from openai) (1.3.5)\n", "Requirement already satisfied: openpyxl>=3.0.7 in /usr/local/lib/python3.8/dist-packages (from openai) (3.0.10)\n", "Collecting pandas-stubs>=1.1.0.11\n", " Downloading pandas_stubs-1.5.2.221213-py3-none-any.whl (147 kB)\n", "\u001b[K |████████████████████████████████| 147 kB 60.7 MB/s \n", "\u001b[?25hRequirement already satisfied: tqdm in /usr/local/lib/python3.8/dist-packages (from openai) (4.64.1)\n", "Requirement already satisfied: et-xmlfile in /usr/local/lib/python3.8/dist-packages (from openpyxl>=3.0.7->openai) (1.1.0)\n", "Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas>=1.2.3->openai) (2022.6)\n", "Collecting types-pytz>=2022.1.1\n", " Downloading types_pytz-2022.7.0.0-py3-none-any.whl (4.7 kB)\n", "Collecting responses<0.19\n", " Downloading responses-0.18.0-py3-none-any.whl (38 kB)\n", "Requirement already satisfied: pyarrow>=6.0.0 in /usr/local/lib/python3.8/dist-packages (from datasets) (9.0.0)\n", "Requirement already satisfied: dill<0.3.7 in /usr/local/lib/python3.8/dist-packages (from datasets) (0.3.6)\n", "Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from datasets) (21.3)\n", "Requirement already satisfied: aiohttp in /usr/local/lib/python3.8/dist-packages (from datasets) (3.8.3)\n", "Collecting huggingface-hub<1.0.0,>=0.2.0\n", " Downloading huggingface_hub-0.11.1-py3-none-any.whl (182 kB)\n", "\u001b[K |████████████████████████████████| 182 kB 44.4 MB/s \n", "\u001b[?25hRequirement already satisfied: fsspec[http]>=2021.11.1 in /usr/local/lib/python3.8/dist-packages (from datasets) (2022.11.0)\n", "Collecting multiprocess\n", " Downloading multiprocess-0.70.14-py38-none-any.whl (132 kB)\n", "\u001b[K |████████████████████████████████| 132 kB 66.5 MB/s \n", "\u001b[?25hCollecting xxhash\n", " Downloading xxhash-3.1.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (212 kB)\n", "\u001b[K |████████████████████████████████| 212 kB 70.9 MB/s \n", "\u001b[?25hRequirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (22.1.0)\n", "Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (1.3.1)\n", "Requirement already satisfied: charset-normalizer<3.0,>=2.0 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (2.1.1)\n", "Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (1.8.2)\n", "Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (1.3.3)\n", "Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (6.0.3)\n", "Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.8/dist-packages (from aiohttp->datasets) (4.0.2)\n", "Requirement already satisfied: filelock in /usr/local/lib/python3.8/dist-packages (from huggingface-hub<1.0.0,>=0.2.0->datasets) (3.8.2)\n", "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->datasets) (3.0.9)\n", "Collecting urllib3>=1.21.1\n", " Downloading urllib3-1.25.11-py2.py3-none-any.whl (127 kB)\n", "\u001b[K |████████████████████████████████| 127 kB 45.2 MB/s \n", "\u001b[?25hBuilding wheels for collected packages: openai\n", " Building wheel for openai (PEP 517) ... \u001b[?25l\u001b[?25hdone\n", " Created wheel for openai: filename=openai-0.25.0-py3-none-any.whl size=55880 sha256=f688888b29b707528c920841652705ab00a881bb4221ec48325e82d2b59d05a5\n", " Stored in directory: /root/.cache/pip/wheels/4b/92/33/6f57c7aae0b16875267999a50570e81f15eecec577ebe05a2e\n", "Successfully built openai\n", "Installing collected packages: urllib3, types-pytz, xxhash, responses, pandas-stubs, multiprocess, loguru, huggingface-hub, pinecone-client, openai, datasets\n", " Attempting uninstall: urllib3\n", " Found existing installation: urllib3 1.24.3\n", " Uninstalling urllib3-1.24.3:\n", " Successfully uninstalled urllib3-1.24.3\n", "Successfully installed datasets-2.8.0 huggingface-hub-0.11.1 loguru-0.6.0 multiprocess-0.70.14 openai-0.25.0 pandas-stubs-1.5.2.221213 pinecone-client-2.0.13 responses-0.18.0 types-pytz-2022.7.0.0 urllib3-1.25.11 xxhash-3.1.0\n" ] } ], "source": [ "!pip install -qU pinecone-client openai datasets" ] }, { "cell_type": "markdown", "metadata": { "id": "IMp0TQ24tRNm" }, "source": [ "### Creating Embeddings\n", "\n", "Then we initialize our connection to OpenAI Embeddings *and* Pinecone vector DB. Sign up for an API key over at [OpenAI](https://beta.openai.com/signup) and [Pinecone](https://app.pinecone.io)." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "yo5uw4sPtRNn", "outputId": "92914528-696d-4598-dbb3-04457a0eba86" }, "outputs": [ { "data": { "text/plain": [ " JSON: {\n", " \"data\": [\n", " {\n", " \"created\": null,\n", " \"id\": \"babbage\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"ada\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"davinci\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"babbage-code-search-code\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-similarity-babbage-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-davinci-003\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-internal\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-davinci-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"curie-instruct-beta\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"babbage-code-search-text\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"babbage-similarity\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"curie-search-query\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-search-babbage-text-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-cushman-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-search-babbage-code-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-ada-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-similarity-ada-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-davinci-insert-002\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-embedding-ada-002\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-internal\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"ada-code-search-code\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"ada-similarity\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-search-ada-text-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-ada-query-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-curie-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-davinci-edit-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"davinci-search-document\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"ada-code-search-text\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-ada-doc-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-davinci-edit-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"davinci-instruct-beta\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-babbage-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-similarity-curie-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-search-ada-code-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"ada-search-query\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-davinci-query-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"curie-similarity\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"davinci-search-query\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-davinci-insert-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"babbage-search-document\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"ada-search-document\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"curie\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-babbage-doc-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-davinci-002\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-curie-doc-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-curie-query-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"babbage-search-query\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-davinci-doc-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"code-davinci-002\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-search-babbage-query-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"curie-search-document\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"text-similarity-davinci-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"audio-transcribe-001\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " },\n", " {\n", " \"created\": null,\n", " \"id\": \"davinci-similarity\",\n", " \"object\": \"engine\",\n", " \"owner\": \"openai-dev\",\n", " \"permissions\": null,\n", " \"ready\": true\n", " }\n", " ],\n", " \"object\": \"list\"\n", "}" ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "import openai\n", "\n", "openai.api_key = \"OPENAI_API_KEY\"\n", "# get API key from top-right dropdown on OpenAI website\n", "\n", "openai.Engine.list() # check we have authenticated" ] }, { "cell_type": "markdown", "metadata": { "id": "pw8cbO3HtRNo" }, "source": [ "We can now create embeddings with the OpenAI Ada similarity model like so:" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "Hg0yIGu3tRNo", "outputId": "58fb10c1-53f0-4dd1-b0fd-14491d4decf3" }, "outputs": [ { "data": { "text/plain": [ " JSON: {\n", " \"data\": [\n", " {\n", " \"embedding\": [\n", " -0.003040769835934043,\n", " 0.011684642173349857,\n", " -0.005026957020163536,\n", " -0.027237210422754288,\n", " -0.016361193731427193,\n", " 0.03234503045678139,\n", " -0.016159038990736008,\n", " -0.001036894042044878,\n", " -0.025822116062045097,\n", " -0.00666779326274991,\n", " 0.02014825865626335,\n", " 0.016657691448926926,\n", " -0.009164425544440746,\n", " 0.023423193022608757,\n", " -0.0101212989538908,\n", " 0.01344340294599533,\n", " 0.02522912435233593,\n", " -0.016873324289917946,\n", " 0.012115909717977047,\n", " -0.016361193731427193,\n", " -0.00426887022331357,\n", " -0.006502698641270399,\n", " -0.004369948524981737,\n", " 0.020808637142181396,\n", " -0.01053908932954073,\n", " -0.003652293002232909,\n", " 0.01369272917509079,\n", " -0.026361199095845222,\n", " -0.0003171329153701663,\n", " -0.0022186669521033764,\n", " 0.005822105333209038,\n", " -0.010087606497108936,\n", " -0.028221039101481438,\n", " -0.016159038990736008,\n", " -0.0042183310724794865,\n", " 0.007466311100870371,\n", " -0.0029228453058749437,\n", " -0.031455542892217636,\n", " 0.023881414905190468,\n", " -0.03328842669725418,\n", " -0.0003649345017038286,\n", " 0.013072783127427101,\n", " 0.00707547552883625,\n", " -0.005680595990270376,\n", " 0.003106470685452223,\n", " -0.02981133572757244,\n", " 0.026293814182281494,\n", " -0.0046428595669567585,\n", " 0.006607146468013525,\n", " 0.017493270337581635,\n", " 0.027331551536917686,\n", " 0.01578168012201786,\n", " -0.022196777164936066,\n", " 0.0028537751641124487,\n", " -0.006489221937954426,\n", " 0.00639151269569993,\n", " -0.01698114164173603,\n", " 0.020067395642399788,\n", " 0.0034838293213397264,\n", " -0.003507414134219289,\n", " -0.001061321352608502,\n", " 0.0035781690385192633,\n", " -0.0026583571452647448,\n", " -0.012473052367568016,\n", " -0.018072785809636116,\n", " -0.03520217537879944,\n", " -0.03172508254647255,\n", " 0.007574127987027168,\n", " 0.00706199835985899,\n", " 0.005582887213677168,\n", " 0.02067386545240879,\n", " 0.011010787449777126,\n", " -0.011590302921831608,\n", " -0.01738545298576355,\n", " 0.00665431609377265,\n", " 0.010181945748627186,\n", " -0.012075478211045265,\n", " -0.012419143691658974,\n", " 0.0002756487228907645,\n", " -0.0010975409531965852,\n", " 0.004612536169588566,\n", " -0.026603788137435913,\n", " -0.002378707518801093,\n", " 0.032048534601926804,\n", " 0.00907682441174984,\n", " 0.014083565212786198,\n", " 0.018261464312672615,\n", " 0.029029665514826775,\n", " -0.02107817865908146,\n", " -0.017277637496590614,\n", " -0.005960245616734028,\n", " 0.015822110697627068,\n", " -0.004326147958636284,\n", " 0.016994617879390717,\n", " -0.013234508223831654,\n", " 0.022008098661899567,\n", " -0.005380730610340834,\n", " 0.02433963492512703,\n", " 0.0037938025780022144,\n", " -0.04102427884936333,\n", " 0.008456877432763577,\n", " 0.009885449893772602,\n", " -0.01210917066782713,\n", " -0.010256069712340832,\n", " -0.03935312107205391,\n", " 0.005710919387638569,\n", " 0.016226423904299736,\n", " -0.014824805781245232,\n", " 0.01609165221452713,\n", " 0.014407015405595303,\n", " -0.021401628851890564,\n", " 0.012628039345145226,\n", " -0.004541781265288591,\n", " -0.03326147422194481,\n", " 0.014218335971236229,\n", " 0.004636120982468128,\n", " -0.004423856735229492,\n", " -0.021927235648036003,\n", " 0.0011666110949590802,\n", " -0.005215635988861322,\n", " -0.0133086321875453,\n", " 0.02609165757894516,\n", " 0.04000002145767212,\n", " -0.016442056745290756,\n", " 0.014029656536877155,\n", " 0.023679258301854134,\n", " -0.005117927212268114,\n", " -0.031859856098890305,\n", " 0.0127695482224226,\n", " -0.005963615141808987,\n", " 0.018099740147590637,\n", " 0.042479805648326874,\n", " 0.024258773773908615,\n", " 0.02055257186293602,\n", " -0.02824799343943596,\n", " 0.01880054920911789,\n", " -0.04541781544685364,\n", " 0.01913747563958168,\n", " -0.021832896396517754,\n", " -0.01747979409992695,\n", " 0.00892183743417263,\n", " 0.03493263199925423,\n", " -0.0062028332613408566,\n", " -0.0062702191062271595,\n", " 0.006856472697108984,\n", " 0.011192727833986282,\n", " 0.0006890165386721492,\n", " -0.021051224321126938,\n", " 0.010862539522349834,\n", " -0.013840978033840656,\n", " 0.010849062353372574,\n", " 0.002424192614853382,\n", " -0.007082214113324881,\n", " 0.012021569535136223,\n", " 0.0036792471073567867,\n", " 0.026239905506372452,\n", " 0.012432620860636234,\n", " -0.0038712958339601755,\n", " -0.011327499523758888,\n", " -0.0205256175249815,\n", " 0.008119950070977211,\n", " 0.014528309926390648,\n", " 0.019393540918827057,\n", " -0.010040436871349812,\n", " 0.010424533858895302,\n", " 0.04137468338012695,\n", " 0.002656672615557909,\n", " -0.010761461220681667,\n", " 0.00036177580477669835,\n", " -0.01762804202735424,\n", " -0.024474406614899635,\n", " 0.016940709203481674,\n", " -0.04568735510110855,\n", " 0.004164422862231731,\n", " -0.03309974819421768,\n", " 0.024622654542326927,\n", " 0.014932622201740742,\n", " 0.014986530877649784,\n", " -0.00907682441174984,\n", " -0.02316712774336338,\n", " -0.01978437788784504,\n", " 0.008018871769309044,\n", " 0.01183289010077715,\n", " 0.03725069388747215,\n", " -0.0365498848259449,\n", " -0.003682616399601102,\n", " -0.015606476925313473,\n", " 0.0004885447560809553,\n", " 0.002633087569847703,\n", " 0.0006751182954758406,\n", " 0.008018871769309044,\n", " 0.010417794808745384,\n", " 0.004989895038306713,\n", " -0.023531010374426842,\n", " -0.690889835357666,\n", " -0.02119947224855423,\n", " -0.003746632719412446,\n", " -0.011731811799108982,\n", " 0.025714298710227013,\n", " 0.020660387352108955,\n", " 0.011711596511304379,\n", " 0.010168468579649925,\n", " -0.010404318571090698,\n", " 0.01413747388869524,\n", " -0.02314017340540886,\n", " 0.005343668628484011,\n", " -0.01093666348606348,\n", " -0.0029683304019272327,\n", " -0.017574133351445198,\n", " -0.01892184279859066,\n", " 0.0001869947009254247,\n", " 0.003780325409024954,\n", " -0.0191644299775362,\n", " 0.007863885723054409,\n", " 0.00020205114560667425,\n", " 0.013497311621904373,\n", " -0.028975756838917732,\n", " 0.01375337690114975,\n", " 0.01249326765537262,\n", " -0.0008625341579318047,\n", " 0.004986525513231754,\n", " -0.016442056745290756,\n", " 0.002911052666604519,\n", " 0.024326158687472343,\n", " -0.037493281066417694,\n", " -0.011111865751445293,\n", " -0.005070757586508989,\n", " 0.022466318681836128,\n", " 0.053800567984580994,\n", " -0.00015077501302585006,\n", " -0.00010065706010209396,\n", " -0.00733154034242034,\n", " 0.01130728330463171,\n", " 0.013221031054854393,\n", " -0.018315372988581657,\n", " -0.017466315999627113,\n", " 0.0060950168408453465,\n", " -0.015916449949145317,\n", " -0.0014260452007874846,\n", " 0.0016214631032198668,\n", " 0.029946107417345047,\n", " 0.011617256328463554,\n", " 0.01772238127887249,\n", " 0.02726416476070881,\n", " -0.005569410044699907,\n", " 0.0010242592543363571,\n", " 0.015552569180727005,\n", " -0.005997307598590851,\n", " 0.011913753114640713,\n", " 0.001964286668226123,\n", " 0.036657702177762985,\n", " -0.024407021701335907,\n", " 0.016509443521499634,\n", " 0.026805944740772247,\n", " 0.005215635988861322,\n", " 0.022668475285172462,\n", " -0.014501355588436127,\n", " -0.017870629206299782,\n", " -0.005842321086674929,\n", " 0.006758763454854488,\n", " -0.009946096688508987,\n", " 0.003857818664982915,\n", " 0.027466321364045143,\n", " -0.014743942767381668,\n", " 0.011132081039249897,\n", " 0.018867934122681618,\n", " -0.020916452631354332,\n", " -0.024326158687472343,\n", " 0.005609841085970402,\n", " 0.011893536895513535,\n", " 0.013760115019977093,\n", " -0.00504717230796814,\n", " -0.011266852729022503,\n", " 0.016657691448926926,\n", " 0.018544483929872513,\n", " 0.007944747805595398,\n", " -0.03700810670852661,\n", " -0.015539092011749744,\n", " 0.018787071108818054,\n", " -0.0038679265417158604,\n", " -0.04196767881512642,\n", " -0.006495960522443056,\n", " 0.0021041117142885923,\n", " 0.009097039699554443,\n", " 0.009959573857486248,\n", " 0.021522922441363335,\n", " -0.006563345901668072,\n", " 0.006933965720236301,\n", " 0.005020218435674906,\n", " 0.01147574745118618,\n", " -0.0029733842238783836,\n", " 0.006526283919811249,\n", " 0.009245287626981735,\n", " -0.0056401644833385944,\n", " 0.002274259924888611,\n", " 0.024353113025426865,\n", " -0.0141509510576725,\n", " 0.006994612980633974,\n", " 0.030566053465008736,\n", " 0.0018547853687778115,\n", " -0.0020518878009170294,\n", " 0.011226421222090721,\n", " 0.016967663541436195,\n", " -0.01401618029922247,\n", " 0.0027459582779556513,\n", " -0.0002371126611251384,\n", " -0.008605125360190868,\n", " -0.024110523983836174,\n", " -0.01695418730378151,\n", " -0.031455542892217636,\n", " 0.011792458593845367,\n", " 0.00040431288653053343,\n", " 0.015309981070458889,\n", " 0.009656338952481747,\n", " 0.019757423549890518,\n", " 0.010181945748627186,\n", " -0.0026920498348772526,\n", " 0.0007361863972619176,\n", " 0.015539092011749744,\n", " 0.006677900906652212,\n", " -0.010721029713749886,\n", " -0.03239893913269043,\n", " -0.0028672521002590656,\n", " -0.011974399909377098,\n", " -0.011933968402445316,\n", " 0.002774597145617008,\n", " 0.04528304189443588,\n", " -0.0163072869181633,\n", " 0.013497311621904373,\n", " 0.004285716451704502,\n", " 0.01913747563958168,\n", " -0.006320758257061243,\n", " -0.005384099669754505,\n", " -0.014110519550740719,\n", " -0.02350405603647232,\n", " 0.014946099370718002,\n", " -0.006893534678965807,\n", " -0.011098388582468033,\n", " 0.009770894423127174,\n", " -0.020296506583690643,\n", " -0.024663085117936134,\n", " -0.0022136131301522255,\n", " 0.003948789089918137,\n", " -0.004474395886063576,\n", " -0.011226421222090721,\n", " -0.010518873110413551,\n", " -0.0234771016985178,\n", " 0.006485852412879467,\n", " 0.004140837583690882,\n", " -0.004979786928743124,\n", " 0.006071431562304497,\n", " -0.028140176087617874,\n", " -0.010343670845031738,\n", " -0.013018874451518059,\n", " 0.004083560314029455,\n", " 0.018544483929872513,\n", " -0.022722383961081505,\n", " -0.0006540603353641927,\n", " -0.009225072339177132,\n", " -0.020714296028017998,\n", " -0.026266859844326973,\n", " 0.020498663187026978,\n", " -0.011711596511304379,\n", " -0.030566053465008736,\n", " -0.005087603814899921,\n", " -0.012567391619086266,\n", " -0.00113460305146873,\n", " -0.0010453172726556659,\n", " 0.0146900350227952,\n", " -0.015175210312008858,\n", " -0.02043127827346325,\n", " 0.0011447108117863536,\n", " 0.027398936450481415,\n", " -0.02587602473795414,\n", " 0.011502701789140701,\n", " 0.014528309926390648,\n", " 0.016940709203481674,\n", " 0.01590297371149063,\n", " 0.021320765838027,\n", " 0.012985181994736195,\n", " 0.0015776625368744135,\n", " 0.01597035862505436,\n", " -0.015552569180727005,\n", " -0.0023669148795306683,\n", " 0.02086254395544529,\n", " -0.0060208928771317005,\n", " -0.010390841402113438,\n", " 0.013086260296404362,\n", " -0.005616579670459032,\n", " 0.004299193620681763,\n", " -0.02270890772342682,\n", " 0.017398931086063385,\n", " 0.018867934122681618,\n", " 0.0002486945304553956,\n", " 0.021495968103408813,\n", " 0.0082479827105999,\n", " 0.014110519550740719,\n", " -0.010026959702372551,\n", " 0.003158694365993142,\n", " -0.03398923575878143,\n", " -0.0035411070566624403,\n", " -0.025929933413863182,\n", " 0.009433967061340809,\n", " 0.012041785754263401,\n", " 0.0033372659236192703,\n", " -0.02033693715929985,\n", " -0.02698114700615406,\n", " 0.0040060668252408504,\n", " 0.010188684798777103,\n", " 0.020053919404745102,\n", " -0.0038746651262044907,\n", " -0.0036960935685783625,\n", " -0.001314859138801694,\n", " 0.001159030245617032,\n", " 0.008611864410340786,\n", " -0.006297172978520393,\n", " 0.017924537882208824,\n", " -0.0069811358116567135,\n", " -0.007749330252408981,\n", " 0.019460925832390785,\n", " 0.016159038990736008,\n", " 0.037493281066417694,\n", " 0.011051218956708908,\n", " -0.014609172008931637,\n", " -0.0009273926843889058,\n", " 0.0055289785377681255,\n", " -0.0012744278647005558,\n", " -0.00035609013866633177,\n", " 0.027062008157372475,\n", " 0.013261462561786175,\n", " 0.0192587710916996,\n", " -0.016792461276054382,\n", " 0.03894880786538124,\n", " -0.005946768447756767,\n", " -0.0163072869181633,\n", " 0.021320765838027,\n", " 0.021361196413636208,\n", " -0.013274939730763435,\n", " 0.014433969743549824,\n", " -0.02199462056159973,\n", " 0.015175210312008858,\n", " 0.01997305639088154,\n", " -0.008119950070977211,\n", " 0.00042705549276433885,\n", " 0.0014075142098590732,\n", " 0.01350405067205429,\n", " -0.008025610819458961,\n", " 0.013557958416640759,\n", " 0.026698127388954163,\n", " -0.0068598417565226555,\n", " -0.0015936666168272495,\n", " 0.010080867446959019,\n", " 0.004905662965029478,\n", " 0.016266854479908943,\n", " 0.01858491636812687,\n", " -0.013092998415231705,\n", " -0.0033204194623976946,\n", " 0.004949463531374931,\n", " 0.02086254395544529,\n", " -0.006832887884229422,\n", " -0.0023534379433840513,\n", " -0.004962940700352192,\n", " -0.017857152968645096,\n", " 0.0005925710429437459,\n", " 0.005033695604652166,\n", " -0.012850411236286163,\n", " 0.012917796149849892,\n", " -0.0172911137342453,\n", " 0.021832896396517754,\n", " 0.008450139313936234,\n", " 0.016253378242254257,\n", " 0.008915099315345287,\n", " 0.0015540776075795293,\n", " -0.005117927212268114,\n", " -0.017115911468863487,\n", " -0.037924546748399734,\n", " 0.0013527635019272566,\n", " 0.011064696125686169,\n", " 0.005980461370199919,\n", " -0.0015481814043596387,\n", " -0.00771563732996583,\n", " 0.016684645786881447,\n", " -0.014528309926390648,\n", " -0.0005445589195005596,\n", " 0.0061489250510931015,\n", " 0.005518870893865824,\n", " 0.007836931385099888,\n", " -0.011266852729022503,\n", " 0.0041071451269090176,\n", " 0.012836934067308903,\n", " 0.0039319428615272045,\n", " 0.003632077481597662,\n", " -0.01870620995759964,\n", " 0.010417794808745384,\n", " 0.011266852729022503,\n", " -0.002100742422044277,\n", " -0.023989230394363403,\n", " -0.02424529567360878,\n", " 0.04363883659243584,\n", " -0.013712945394217968,\n", " -0.007115906570106745,\n", " 0.0019407018553465605,\n", " -0.009292458184063435,\n", " -0.021239902824163437,\n", " 0.012035046704113483,\n", " 0.0024107154458761215,\n", " -0.02196766622364521,\n", " -0.0008760112687014043,\n", " 0.019339632242918015,\n", " 0.0009400274720974267,\n", " -0.011239898391067982,\n", " 0.015013485215604305,\n", " 0.02575473114848137,\n", " 0.007978441193699837,\n", " 0.0017975076334550977,\n", " -0.028571443632245064,\n", " -0.013854454271495342,\n", " 0.012250680476427078,\n", " 0.060161758214235306,\n", " 0.05129382759332657,\n", " 0.005751350894570351,\n", " 0.003921834751963615,\n", " 0.008322106674313545,\n", " -0.005373992025852203,\n", " -0.013463619165122509,\n", " -0.013463619165122509,\n", " 0.017398931086063385,\n", " -0.02119947224855423,\n", " -0.0061388174071908,\n", " -0.004686660133302212,\n", " 0.01947440393269062,\n", " 0.0026398261543363333,\n", " 0.02221025340259075,\n", " -0.006735178641974926,\n", " 0.010390841402113438,\n", " 0.013800546526908875,\n", " -0.011529656127095222,\n", " -0.018261464312672615,\n", " 0.007924532517790794,\n", " 0.010458226315677166,\n", " 0.0009349735337309539,\n", " 0.008611864410340786,\n", " 0.020754728466272354,\n", " -0.022560657933354378,\n", " 0.010067391209304333,\n", " 0.014380061067640781,\n", " -0.006634100340306759,\n", " -0.024514837190508842,\n", " -0.016442056745290756,\n", " 0.01645553484559059,\n", " 0.01685984805226326,\n", " 0.023652303963899612,\n", " -0.0037938025780022144,\n", " 0.030943412333726883,\n", " -0.010950140655040741,\n", " -0.013827500864863396,\n", " 0.005195420701056719,\n", " 0.0036994628608226776,\n", " 0.00842992402613163,\n", " 0.0060208928771317005,\n", " 0.010970355942845345,\n", " 0.003298519179224968,\n", " -0.002168127801269293,\n", " 0.0031418479047715664,\n", " -0.021981144323945045,\n", " 0.0032075487542897463,\n", " -0.013376018032431602,\n", " -0.00333052733913064,\n", " 0.0017284376081079245,\n", " -0.00745283393189311,\n", " 0.018167125061154366,\n", " -0.013025613501667976,\n", " 0.017681950703263283,\n", " 0.018557962030172348,\n", " 0.00946092139929533,\n", " 0.010525612160563469,\n", " -0.006526283919811249,\n", " -0.025835592299699783,\n", " -0.005549194291234016,\n", " -0.001648417324759066,\n", " -0.00956873781979084,\n", " -0.009285719133913517,\n", " -0.004363209940493107,\n", " -0.024690039455890656,\n", " -0.010667121969163418,\n", " -0.0013544481480494142,\n", " -0.02580863982439041,\n", " 0.010330193676054478,\n", " 0.0074056643061339855,\n", " 0.002183289499953389,\n", " -0.014541787095367908,\n", " 0.0033692740835249424,\n", " 0.011192727833986282,\n", " 0.0014353106962516904,\n", " -0.0035849076230078936,\n", " -0.004750676453113556,\n", " -0.010687337256968021,\n", " -0.00024637815658934414,\n", " -0.006927227135747671,\n", " -0.014272244647145271,\n", " 0.01147574745118618,\n", " -0.02273586019873619,\n", " -0.0008566378965042531,\n", " 0.015943404287099838,\n", " 0.0005938345566391945,\n", " 0.001143026165664196,\n", " 0.0003407178446650505,\n", " 0.02698114700615406,\n", " -0.004983156453818083,\n", " 0.008584910072386265,\n", " -0.00983154121786356,\n", " -0.03161726891994476,\n", " -0.002240567235276103,\n", " -0.018167125061154366,\n", " 0.006044477690011263,\n", " -0.012668469920754433,\n", " -0.004504719283431768,\n", " -0.020808637142181396,\n", " -0.010876016691327095,\n", " -0.0002609081566333771,\n", " -0.0004047340480610728,\n", " -0.006155663635581732,\n", " 0.003510783426463604,\n", " 0.0009947781218215823,\n", " -0.0014748997054994106,\n", " 0.012863888405263424,\n", " -0.008059303276240826,\n", " -0.0019053244031965733,\n", " 0.004723722115159035,\n", " -0.0111994668841362,\n", " -0.0011741919443011284,\n", " -0.013349063694477081,\n", " 0.011381407268345356,\n", " 0.01303235162049532,\n", " -0.006169140804558992,\n", " 0.02498653531074524,\n", " 0.0022911063861101866,\n", " -0.01543127465993166,\n", " 0.012850411236286163,\n", " -0.019730469211935997,\n", " 0.013402972370386124,\n", " 0.024905674159526825,\n", " 0.009319411590695381,\n", " 0.023180605843663216,\n", " -0.022601090371608734,\n", " -0.004885447211563587,\n", " 0.0036219696048647165,\n", " -0.012991921044886112,\n", " -0.007938009686768055,\n", " 0.00841644685715437,\n", " -0.0021866587921977043,\n", " -0.018625346943736076,\n", " -0.02640163153409958,\n", " -0.0019524942617863417,\n", " 0.001314016873948276,\n", " 0.009272241964936256,\n", " -0.023086264729499817,\n", " -0.011880059726536274,\n", " -0.01880054920911789,\n", " 0.005006741266697645,\n", " 0.009548522531986237,\n", " -0.00372304767370224,\n", " -0.011246636509895325,\n", " -0.02587602473795414,\n", " -0.0032024949323385954,\n", " -0.002478101057931781,\n", " -0.01229111198335886,\n", " 0.016576828435063362,\n", " 0.005245959851890802,\n", " -0.004602428525686264,\n", " -0.008288414217531681,\n", " -0.0028436672873795033,\n", " 0.004693398717790842,\n", " -0.0255390964448452,\n", " 0.009575476869940758,\n", " 0.010586258955299854,\n", " 0.018544483929872513,\n", " 0.017978446558117867,\n", " 0.026051227003335953,\n", " -0.000489808211568743,\n", " 0.015566046349704266,\n", " 0.01196766085922718,\n", " -0.008935314603149891,\n", " -0.002633087569847703,\n", " 0.004935986362397671,\n", " -0.010700814425945282,\n", " -0.016698122024536133,\n", " -0.002725742757320404,\n", " 0.010545827448368073,\n", " 0.011563348583877087,\n", " 0.010747984051704407,\n", " -0.018881412222981453,\n", " 0.013180599547922611,\n", " 0.005107819568365812,\n", " -0.004481134470552206,\n", " 0.003138478845357895,\n", " 0.004780999850481749,\n", " -0.023005403578281403,\n", " -0.008342322893440723,\n", " 0.011435315944254398,\n", " -0.01321429293602705,\n", " 0.014649603515863419,\n", " -0.029083574190735817,\n", " 0.0027004731819033623,\n", " 0.05194072797894478,\n", " -0.005751350894570351,\n", " 0.0065566073171794415,\n", " 0.0046057975850999355,\n", " 0.008672511205077171,\n", " -0.015714293345808983,\n", " -0.0017132757930085063,\n", " -0.02018868923187256,\n", " -0.00044432299910113215,\n", " -0.013126691803336143,\n", " 0.016913754865527153,\n", " -0.021253380924463272,\n", " 0.003473721444606781,\n", " 0.046172529458999634,\n", " 0.016657691448926926,\n", " 0.003318734932690859,\n", " 0.003387805074453354,\n", " 0.019703514873981476,\n", " 0.00733154034242034,\n", " -0.01904313638806343,\n", " 0.010134776122868061,\n", " 0.0024022923316806555,\n", " -0.003401282010599971,\n", " 0.0005744612426497042,\n", " -0.03215635195374489,\n", " 0.002868936862796545,\n", " -0.003049192950129509,\n", " -0.011239898391067982,\n", " -0.002371968934312463,\n", " 0.019097045063972473,\n", " 0.006421836093068123,\n", " 0.005970353726297617,\n", " -0.03657683730125427,\n", " -0.013975748792290688,\n", " -0.0028167131822556257,\n", " -0.013564697466790676,\n", " 0.05196768417954445,\n", " 0.01762804202735424,\n", " -0.0020872652530670166,\n", " 0.013881408609449863,\n", " -0.008281675167381763,\n", " -0.015471706166863441,\n", " 0.0164959654211998,\n", " -0.007938009686768055,\n", " -0.011145558208227158,\n", " 0.043207570910453796,\n", " 0.031832899898290634,\n", " -0.007169815246015787,\n", " 0.0027779664378613234,\n", " 0.010464965365827084,\n", " 0.024474406614899635,\n", " 0.012129386886954308,\n", " -0.013194076716899872,\n", " 0.010020220652222633,\n", " 0.01765499636530876,\n", " -0.0013662405544891953,\n", " -0.021698124706745148,\n", " -0.009009438566863537,\n", " -0.052722398191690445,\n", " 0.026940714567899704,\n", " 0.005946768447756767,\n", " 0.0018312004394829273,\n", " -0.011718334630131721,\n", " -0.00907682441174984,\n", " -0.019986532628536224,\n", " 0.005842321086674929,\n", " -0.01726415939629078,\n", " 0.019528312608599663,\n", " 0.00864555686712265,\n", " -0.01202830858528614,\n", " -0.011563348583877087,\n", " 0.013840978033840656,\n", " -0.024393543601036072,\n", " -0.004329517018049955,\n", " -0.005131404381245375,\n", " 0.018072785809636116,\n", " -0.02405661717057228,\n", " 0.004622643813490868,\n", " 0.008625341579318047,\n", " 0.01947440393269062,\n", " -0.01266173180192709,\n", " 0.00041126200812868774,\n", " 0.0005319241317920387,\n", " 0.028840985149145126,\n", " -0.016266854479908943,\n", " -0.0070350440219044685,\n", " -0.0026752036064863205,\n", " -0.0008878036751411855,\n", " 0.010006743483245373,\n", " -0.0047169835306704044,\n", " -0.004076821729540825,\n", " -0.005495286080986261,\n", " -0.011482485570013523,\n", " -0.014433969743549824,\n", " 0.005623318254947662,\n", " 0.008470354601740837,\n", " -0.012742593884468079,\n", " -0.017951492220163345,\n", " -0.0054009463638067245,\n", " -0.0211320873349905,\n", " -0.012055261991918087,\n", " -0.013153646141290665,\n", " 0.0002680678735487163,\n", " -0.030134785920381546,\n", " -0.036630745977163315,\n", " 0.016388148069381714,\n", " 0.010431271977722645,\n", " 0.013369278982281685,\n", " 0.005997307598590851,\n", " -0.019865239039063454,\n", " 0.020390845835208893,\n", " 0.03997306525707245,\n", " -0.0049292477779090405,\n", " 0.005057280417531729,\n", " 0.0034501366317272186,\n", " 0.004383425693958998,\n", " -0.022574136033654213,\n", " -0.0016037743771448731,\n", " -0.008187335915863514,\n", " 0.001644205767661333,\n", " 0.021307289600372314,\n", " -0.018140170723199844,\n", " -0.027681956067681313,\n", " -0.011839629150927067,\n", " -0.0005037064547650516,\n", " 0.013638821430504322,\n", " 0.0038376031443476677,\n", " -0.015512137673795223,\n", " 0.004710244946181774,\n", " 0.005424531176686287,\n", " 0.0037735868245363235,\n", " 0.0183692816644907,\n", " -0.025741253048181534,\n", " 0.022695429623126984,\n", " -0.0009737201617099345,\n", " -0.006431944202631712,\n", " -0.001196092227473855,\n", " -0.023706212639808655,\n", " -0.00035693246172741055,\n", " 0.004828169476240873,\n", " 0.007520219776779413,\n", " 0.011435315944254398,\n", " -0.0402965173125267,\n", " -0.01812669448554516,\n", " -0.0023618610575795174,\n", " 0.01533693540841341,\n", " -0.0033692740835249424,\n", " -0.010336932726204395,\n", " -0.02184637263417244,\n", " -0.0010941717773675919,\n", " -0.009380058385431767,\n", " -0.0033979129511862993,\n", " 0.018167125061154366,\n", " -0.014555263333022594,\n", " -0.007951486855745316,\n", " 0.009885449893772602,\n", " -0.0044305953197181225,\n", " 0.008557955734431744,\n", " -0.007580866571515799,\n", " 0.010997310280799866,\n", " -0.03525608405470848,\n", " -0.01683289371430874,\n", " -0.016536395996809006,\n", " -0.01851752959191799,\n", " -0.006401620805263519,\n", " 0.025714298710227013,\n", " 0.00865903403609991,\n", " -0.0073517560958862305,\n", " -0.016172515228390694,\n", " -0.012681947089731693,\n", " -0.03919139504432678,\n", " -0.022964971140027046,\n", " -0.006182617973536253,\n", " -0.0023669148795306683,\n", " 0.021320765838027,\n", " 0.030593007802963257,\n", " -0.0015683970414102077,\n", " 0.030539099127054214,\n", " -0.0010065706446766853,\n", " 0.03323451802134514,\n", " -0.035363901406526566,\n", " -0.011172512546181679,\n", " 0.017250683158636093,\n", " -0.019285723567008972,\n", " -0.007567389402538538,\n", " 0.006829518359154463,\n", " -0.01950135827064514,\n", " -0.006826149299740791,\n", " 0.03894880786538124,\n", " 0.004555258434265852,\n", " -0.0036725087556988,\n", " 0.033369291573762894,\n", " -0.0019440711475908756,\n", " -0.02762804739177227,\n", " -0.008086257614195347,\n", " 0.006954181473702192,\n", " 0.0010705868480727077,\n", " -0.007702160160988569,\n", " 0.001126179820857942,\n", " -0.007190030533820391,\n", " -0.010801892727613449,\n", " -0.0023231145460158587,\n", " -0.013221031054854393,\n", " -0.007257416378706694,\n", " 0.004093667957931757,\n", " 0.010471703484654427,\n", " 0.0019255400402471423,\n", " 0.005801890045404434,\n", " -0.02707548625767231,\n", " -0.012985181994736195,\n", " -0.01849057525396347,\n", " -0.014757419936358929,\n", " 0.0274124126881361,\n", " 0.004626013338565826,\n", " -0.014973053708672523,\n", " 0.03690028935670853,\n", " -0.00906334724277258,\n", " -0.0030053923837840557,\n", " -0.016226423904299736,\n", " 0.023328853771090508,\n", " -0.016603782773017883,\n", " -0.012479790486395359,\n", " 0.002633087569847703,\n", " -0.023315375670790672,\n", " -0.023450147360563278,\n", " -0.0031772253569215536,\n", " -0.005124665796756744,\n", " -0.021684646606445312,\n", " 0.007277631666511297,\n", " -0.005043803248554468,\n", " -0.010134776122868061,\n", " -0.015768202021718025,\n", " -0.008793804794549942,\n", " 0.006543130148202181,\n", " -0.02477090246975422,\n", " -0.04568735510110855,\n", " -0.02304583415389061,\n", " 0.018409714102745056,\n", " -0.0006502699106931686,\n", " -0.009373320266604424,\n", " -0.011792458593845367,\n", " -0.014878714457154274,\n", " 0.021401628851890564,\n", " 0.010835585184395313,\n", " -0.011900275945663452,\n", " -0.007553912233561277,\n", " 0.01993262581527233,\n", " 0.011886798776686192,\n", " -0.01904313638806343,\n", " 0.021051224321126938,\n", " 0.22964972257614136,\n", " -0.00021447535254992545,\n", " 0.012991921044886112,\n", " 0.040754739195108414,\n", " 0.013288416899740696,\n", " 0.01239892840385437,\n", " 0.014946099370718002,\n", " 0.0015111194225028157,\n", " -0.010687337256968021,\n", " 0.007574127987027168,\n", " 0.007095691282302141,\n", " 0.003965635318309069,\n", " -0.0014117257669568062,\n", " -0.00031439537997357547,\n", " 0.027358505874872208,\n", " 0.012870626524090767,\n", " -0.02083558961749077,\n", " -0.04021565616130829,\n", " -0.011603780090808868,\n", " -0.0293800700455904,\n", " -0.000714286114089191,\n", " -0.0044474415481090546,\n", " -0.00025290611665695906,\n", " -0.010619951412081718,\n", " 0.00586927542462945,\n", " -0.008982484228909016,\n", " -0.011118603870272636,\n", " -0.003824125975370407,\n", " 0.01898922771215439,\n", " 0.015242595225572586,\n", " -0.01038410235196352,\n", " -0.013376018032431602,\n", " 0.01037062518298626,\n", " 0.007641513366252184,\n", " -0.04223721846938133,\n", " 0.02095688506960869,\n", " 0.014946099370718002,\n", " 0.011482485570013523,\n", " 0.0223989337682724,\n", " 0.014366584829986095,\n", " 0.0014951153425499797,\n", " -0.01731806807219982,\n", " -0.02314017340540886,\n", " -0.01892184279859066,\n", " -0.0016644214047119021,\n", " 0.0141509510576725,\n", " 0.007991918362677097,\n", " -0.01978437788784504,\n", " 0.008483831770718098,\n", " 0.0022995295003056526,\n", " -0.00984501838684082,\n", " 0.014191382564604282,\n", " 0.020390845835208893,\n", " 0.012351758778095245,\n", " 0.008955529890954494,\n", " -0.007223723456263542,\n", " 0.016630737110972404,\n", " 0.013672513887286186,\n", " -0.024070093408226967,\n", " 0.010485180653631687,\n", " -0.008099734783172607,\n", " 0.015795156359672546,\n", " -0.005117927212268114,\n", " 0.017493270337581635,\n", " -0.011253375560045242,\n", " -0.005161727778613567,\n", " -0.015377366915345192,\n", " -0.02095688506960869,\n", " -0.014460924081504345,\n", " -0.0020872652530670166,\n", " 0.002885783091187477,\n", " 0.005431269761174917,\n", " -0.0017941384576261044,\n", " 0.0013333902461454272,\n", " -0.006347712129354477,\n", " -0.014528309926390648,\n", " 0.006718332413583994,\n", " 0.02873316965997219,\n", " 0.01769542694091797,\n", " 0.027560660615563393,\n", " -0.020134782418608665,\n", " 0.0009678239584900439,\n", " 0.01870620995759964,\n", " -0.02335580810904503,\n", " -0.025714298710227013,\n", " -0.022843677550554276,\n", " -0.0026516185607761145,\n", " 0.0009543468477204442,\n", " -0.009804587811231613,\n", " -0.017088957130908966,\n", " -0.01784367486834526,\n", " -0.012500006705522537,\n", " -0.012560653500258923,\n", " -0.01597035862505436,\n", " 0.017708905041217804,\n", " 0.0018278311472386122,\n", " -0.015983836725354195,\n", " 0.016078175976872444,\n", " -0.006627361755818129,\n", " -0.0009989897953346372,\n", " -0.032506756484508514,\n", " 0.03964961692690849,\n", " 0.004019543994218111,\n", " 0.014757419936358929,\n", " 0.0038746651262044907,\n", " 0.00012940117449034005,\n", " -0.00453167362138629,\n", " 0.006886796094477177,\n", " -0.009433967061340809,\n", " -0.011799197643995285,\n", " 0.019514834508299828,\n", " 0.0063982512801885605,\n", " 0.015673862770199776,\n", " -0.008254721760749817,\n", " -0.012365235947072506,\n", " 0.021145563572645187,\n", " 0.002660041907802224,\n", " -0.01704852655529976,\n", " 0.002114219358190894,\n", " 0.003965635318309069,\n", " -0.01990567147731781,\n", " -0.005303237121552229,\n", " -0.016805939376354218,\n", " 0.004312670789659023,\n", " -0.016536395996809006,\n", " -0.013052567839622498,\n", " -0.0055289785377681255,\n", " -0.004821430891752243,\n", " 0.012486529536545277,\n", " -0.01490566786378622,\n", " 0.0035781690385192633,\n", " 0.007486526854336262,\n", " 0.006613885052502155,\n", " 0.0034113898873329163,\n", " -0.007163076661527157,\n", " 3.271880996180698e-05,\n", " 0.0005382415256462991,\n", " 0.011388146318495274,\n", " -0.019730469211935997,\n", " 0.015471706166863441,\n", " 0.010053914040327072,\n", " -0.008072780445218086,\n", " 0.001987871713936329,\n", " -0.013389495201408863,\n", " 0.0016172515461221337,\n", " -0.005026957020163536,\n", " 0.009649600833654404,\n", " -0.01923181675374508,\n", " -0.0019154322799295187,\n", " -0.017008095979690552,\n", " -0.027223734185099602,\n", " -0.013288416899740696,\n", " -0.0082479827105999,\n", " 0.008045826107263565,\n", " 0.028814030811190605,\n", " -0.01671159826219082,\n", " -0.018962273374199867,\n", " -0.027250688523054123,\n", " 0.016361193731427193,\n", " -0.014649603515863419,\n", " -0.034043144434690475,\n", " -0.0005424531409516931,\n", " 0.026805944740772247,\n", " -0.01882750354707241,\n", " 0.003335581161081791,\n", " -0.002836928702890873,\n", " -0.17617259919643402,\n", " 0.0017419146606698632,\n", " 0.01760108768939972,\n", " -0.022722383961081505,\n", " 0.00880054384469986,\n", " -0.012405666522681713,\n", " 0.026051227003335953,\n", " 0.006974397227168083,\n", " -0.0006228945567272604,\n", " 0.003253034083172679,\n", " -0.007473049685359001,\n", " -0.015283026732504368,\n", " -0.035363901406526566,\n", " -0.00625337241217494,\n", " -0.013699468225240707,\n", " 0.0062230490148067474,\n", " -0.03479786217212677,\n", " 0.010849062353372574,\n", " 0.018975751474499702,\n", " 0.02916443534195423,\n", " 0.003743263427168131,\n", " -0.010707552544772625,\n", " 0.01911052130162716,\n", " -0.03110513836145401,\n", " 0.00852426327764988,\n", " -0.005704180803149939,\n", " -0.006927227135747671,\n", " 0.026994623243808746,\n", " -0.00440701050683856,\n", " -0.007823454216122627,\n", " 0.0035950152669101954,\n", " -0.004690029192715883,\n", " -0.0022388824727386236,\n", " 0.005222374573349953,\n", " 0.011994615197181702,\n", " -0.0024292466696351767,\n", " 0.010694075375795364,\n", " -0.0029245298355817795,\n", " -0.009487875737249851,\n", " 0.020822113379836082,\n", " 0.014353107661008835,\n", " 0.041212961077690125,\n", " 0.003261457197368145,\n", " -0.02421834133565426,\n", " 0.0018194079166278243,\n", " 0.007304586004465818,\n", " 0.01990567147731781,\n", " -0.00467655248939991,\n", " 0.0017739228205755353,\n", " -0.013342324644327164,\n", " 0.02230459451675415,\n", " -0.03436659649014473,\n", " -0.00612197071313858,\n", " -0.0025825484190136194,\n", " 0.0001508802961325273,\n", " -0.0006932281539775431,\n", " 0.0032917805947363377,\n", " -0.01332210935652256,\n", " -0.0061388174071908,\n", " 0.00835579913109541,\n", " 0.015835586935281754,\n", " -0.03528303653001785,\n", " 0.010761461220681667,\n", " 0.02599731832742691,\n", " -0.010619951412081718,\n", " -0.01196766085922718,\n", " -0.02685985155403614,\n", " 0.013072783127427101,\n", " -0.00816712062805891,\n", " 0.009669816121459007,\n", " -0.01846362091600895,\n", " -0.021671170368790627,\n", " -0.008281675167381763,\n", " -0.005902967881411314,\n", " 0.0028790447395294905,\n", " -0.009973051026463509,\n", " -0.026145566254854202,\n", " 0.0223989337682724,\n", " -0.01067386008799076,\n", " -0.009022915735840797,\n", " -0.02611861191689968,\n", " 0.024636130779981613,\n", " -0.007412402890622616,\n", " 0.019339632242918015,\n", " 0.004366578999906778,\n", " 0.015080870129168034,\n", " -0.020539093762636185,\n", " -0.008126689121127129,\n", " 0.005478439386934042,\n", " 0.013382756151258945,\n", " 0.044717006385326385,\n", " -0.008712942712008953,\n", " -0.01580863445997238,\n", " -0.004053236450999975,\n", " 0.003682616399601102,\n", " 0.01880054920911789,\n", " -0.0017890845192596316,\n", " 0.019487880170345306,\n", " 0.003955527674406767,\n", " 0.002309637377038598,\n", " -0.001693902537226677,\n", " -0.02067386545240879,\n", " -0.0095822149887681,\n", " 0.010249331593513489,\n", " 0.029245298355817795,\n", " 0.014757419936358929,\n", " 0.013814023695886135,\n", " -0.003611861728131771,\n", " 0.021954189985990524,\n", " -0.0003476669662632048,\n", " -0.045768219977617264,\n", " 0.004336255602538586,\n", " 0.015242595225572586,\n", " 0.01229111198335886,\n", " -0.005966984201222658,\n", " 0.037762824445962906,\n", " -0.022843677550554276,\n", " -0.03347710520029068,\n", " 0.005997307598590851,\n", " -0.002313006669282913,\n", " 0.04094341769814491,\n", " 0.007412402890622616,\n", " -0.0021698125638067722,\n", " 0.011556609533727169,\n", " 0.010229116305708885,\n", " -0.008497308939695358,\n", " -0.08361190557479858,\n", " -0.012654992751777172,\n", " 0.018719686195254326,\n", " 0.03460918366909027,\n", " -0.018207557499408722,\n", " 0.015202164649963379,\n", " -0.011650949716567993,\n", " 0.020714296028017998,\n", " 0.004959571175277233,\n", " 0.001922170864418149,\n", " 0.0030542470049113035,\n", " -0.018773594871163368,\n", " -0.00827493704855442,\n", " -0.022870631888508797,\n", " 0.024353113025426865,\n", " 0.012358496896922588,\n", " -0.0006599565385840833,\n", " -0.005798520520329475,\n", " -0.0016105129616335034,\n", " 0.02184637263417244,\n", " -0.009784371592104435,\n", " -0.002656672615557909,\n", " 0.013369278982281685,\n", " -0.013295155018568039,\n", " 0.0024511469528079033,\n", " -0.0059905690141022205,\n", " -0.027547184377908707,\n", " 0.023247990757226944,\n", " 0.007412402890622616,\n", " -0.011677904054522514,\n", " -0.003574799746274948,\n", " -0.00984501838684082,\n", " 0.02095688506960869,\n", " -0.013039090670645237,\n", " -0.004797846078872681,\n", " 0.017708905041217804,\n", " -0.04280325770378113,\n", " -0.009326150640845299,\n", " 0.007082214113324881,\n", " -0.007681944873183966,\n", " 0.0024646238889545202,\n", " 0.026603788137435913,\n", " 0.01401618029922247,\n", " -0.040134791284799576,\n", " 0.0007277631666511297,\n", " -0.011987877078354359,\n", " -0.007884101010859013,\n", " 0.03757414221763611,\n", " 0.005256067495793104,\n", " -0.027277642861008644,\n", " -0.035552579909563065,\n", " 0.01633424125611782,\n", " -0.030269557610154152,\n", " -0.009299196302890778,\n", " 0.030080879107117653,\n", " 0.016442056745290756,\n", " 0.022345025092363358,\n", " -0.0016543135279789567,\n", " -0.00518531259149313,\n", " -0.007688683457672596,\n", " -0.0067688715644180775,\n", " -0.009103778749704361,\n", " -0.002673518843948841,\n", " 0.03000001609325409,\n", " -0.004797846078872681,\n", " 0.0054009463638067245,\n", " -0.01642858050763607,\n", " 0.000922338746022433,\n", " -0.0012390505289658904,\n", " -0.013800546526908875,\n", " 0.0040970370173454285,\n", " 0.0022944756783545017,\n", " -0.011219682171940804,\n", " 0.020929930731654167,\n", " -0.00790431722998619,\n", " -0.004420487675815821,\n", " -0.030107833445072174,\n", " -0.024433976039290428,\n", " 0.012971704825758934,\n", " -0.0052796523086726665,\n", " -0.01731806807219982,\n", " -0.01628033258020878,\n", " -0.010498657822608948,\n", " 0.004086929373443127,\n", " 0.021253380924463272,\n", " 0.02338276244699955,\n", " 0.004103775601834059,\n", " 0.0047338297590613365,\n", " 0.014555263333022594,\n", " -0.035336945205926895,\n", " 0.018625346943736076,\n", " 0.04161727428436279,\n", " -0.008969007059931755,\n", " -0.021792463958263397,\n", " -0.0045518893748521805,\n", " 0.006664424203336239,\n", " -0.0008301048655994236,\n", " 0.00505391089245677,\n", " 0.007237200625240803,\n", " -0.004066713619977236,\n", " -0.03954179957509041,\n", " -0.026226429268717766,\n", " -0.06517523527145386,\n", " 0.011765505187213421,\n", " 0.010626690462231636,\n", " -0.02460917830467224,\n", " -0.0036219696048647165,\n", " 0.01830189675092697,\n", " -0.004868600983172655,\n", " -0.0041340989992022514,\n", " -0.017345022410154343,\n", " 0.006708224769681692,\n", " -0.02602427266538143,\n", " 0.00587601400911808,\n", " 0.008787066675722599,\n", " -0.0011354453163221478,\n", " -0.026266859844326973,\n", " -0.0036017538513988256,\n", " 0.02057952620089054,\n", " 0.0018648931290954351,\n", " 0.025377372279763222,\n", " 0.02587602473795414,\n", " 0.0008869614102877676,\n", " -0.021428583189845085,\n", " -0.002978438278660178,\n", " 0.010929924435913563,\n", " -0.014326153323054314,\n", " 0.005582887213677168,\n", " -0.02978438138961792,\n", " 0.026913760229945183,\n", " -0.010283024050295353,\n", " -0.021159041672945023,\n", " -0.0020822114311158657,\n", " -0.0390835776925087,\n", " 0.0035411070566624403,\n", " 0.011024264618754387,\n", " -0.000971193250734359,\n", " -0.0025657021906226873,\n", " -0.004417118150740862,\n", " 0.032938022166490555,\n", " 0.005370622966438532,\n", " 0.015202164649963379,\n", " -0.008335583843290806,\n", " -0.02249327301979065,\n", " 0.006880057509988546,\n", " -0.02520217001438141,\n", " 0.0024006078019738197,\n", " 0.028382765129208565,\n", " -0.025862546637654305,\n", " -0.019959580153226852,\n", " 0.035579532384872437,\n", " 0.009346365928649902,\n", " 0.01196766085922718,\n", " -0.003844341728836298,\n", " -0.028328856453299522,\n", " -0.02421834133565426,\n", " -0.008652295917272568,\n", " -0.008739897049963474,\n", " 0.014420492574572563,\n", " 0.0015035385731607676,\n", " 0.017668472602963448,\n", " -0.01103100273758173,\n", " 0.035768214613199234,\n", " -0.005886121653020382,\n", " -0.0023652303498238325,\n", " 0.008638818748295307,\n", " -0.008706203661859035,\n", " 0.009413751773536205,\n", " -0.028571443632245064,\n", " 0.005579517688602209,\n", " -0.008510786108672619,\n", " -0.021617261692881584,\n", " -0.03517521917819977,\n", " -0.02328842133283615,\n", " -0.010485180653631687,\n", " 0.038167137652635574,\n", " 0.026994623243808746,\n", " 0.016927232965826988,\n", " -0.008160381577908993,\n", " 0.02230459451675415,\n", " 0.007102429401129484,\n", " 0.02787063457071781,\n", " 0.01966308243572712,\n", " 0.021334243938326836,\n", " -0.008052565157413483,\n", " 0.009299196302890778,\n", " 0.04218330979347229,\n", " 0.01664421334862709,\n", " -0.0225876122713089,\n", " 0.004349732771515846,\n", " -0.013450141996145248,\n", " 0.009690032340586185,\n", " -0.010896231979131699,\n", " 0.010714291594922543,\n", " 0.013840978033840656,\n", " 0.001228942652232945,\n", " -0.00852426327764988,\n", " -0.013908362947404385,\n", " 4.984814836461737e-07,\n", " 0.004363209940493107,\n", " 0.02194071188569069,\n", " 0.018005400896072388,\n", " 0.005134773440659046,\n", " 0.009535045363008976,\n", " -0.002845351817086339,\n", " -0.023544486612081528,\n", " -0.008969007059931755,\n", " -0.003072777995839715,\n", " -0.03668465465307236,\n", " -0.047088973224163055,\n", " -0.0006873318925499916,\n", " 0.020849067717790604,\n", " -0.007863885723054409,\n", " -0.013362540863454342,\n", " 0.015983836725354195,\n", " 0.014487878419458866,\n", " -0.0345822274684906,\n", " 0.016698122024536133,\n", " -0.013402972370386124,\n", " -0.010485180653631687,\n", " -0.03630729764699936,\n", " 0.03129381686449051,\n", " -0.014649603515863419,\n", " -0.0017216990236192942,\n", " 0.039433982223272324,\n", " -0.008969007059931755,\n", " 0.023490577936172485,\n", " 0.008780327625572681,\n", " 0.024663085117936134,\n", " -0.01654987409710884,\n", " -0.0001794138370314613,\n", " 0.008180596865713596,\n", " -0.0070350440219044685,\n", " 0.018045831471681595,\n", " -0.012803241610527039,\n", " -0.026563355699181557,\n", " 0.0026145565789192915,\n", " -0.01101752556860447,\n", " -0.01425876747816801,\n", " 0.04463614150881767,\n", " -0.00372304767370224,\n", " 0.07493265718221664,\n", " -0.002897575730457902,\n", " -0.009049870073795319,\n", " 0.01104447990655899,\n", " -0.015592999756336212,\n", " 0.02765500172972679,\n", " 0.02138815075159073,\n", " 0.014407015405595303,\n", " -0.01230458915233612,\n", " 0.007095691282302141,\n", " 0.0225876122713089,\n", " 0.007129383739084005,\n", " -0.001028470927849412,\n", " -0.016725076362490654,\n", " -0.020849067717790604,\n", " -0.01249326765537262,\n", " -0.010020220652222633,\n", " 0.011576825752854347,\n", " 0.0031856484711170197,\n", " 0.0020805266685783863,\n", " 0.014272244647145271,\n", " -0.005097711458802223,\n", " 0.021118609234690666,\n", " 0.01654987409710884,\n", " -0.010350409895181656,\n", " -0.0025000013411045074,\n", " 0.028167130425572395,\n", " -0.027237210422754288,\n", " -0.01092318631708622,\n", " -0.016603782773017883,\n", " -0.0021091655362397432,\n", " -0.003982482012361288,\n", " -0.022264162078499794,\n", " -0.025188691914081573,\n", " 0.00041610535117797554,\n", " 0.015417797490954399,\n", " -0.008234505541622639,\n", " -0.027237210422754288,\n", " -0.0056873345747590065,\n", " 0.009016177617013454,\n", " 0.003958896733820438,\n", " 0.028194084763526917,\n", " -0.013814023695886135,\n", " 0.002461254596710205,\n", " -0.03412400558590889,\n", " 0.011145558208227158,\n", " -0.00935310497879982,\n", " -0.0006279484368860722,\n", " -0.01344340294599533\n", " ],\n", " \"index\": 0,\n", " \"object\": \"embedding\"\n", " },\n", " {\n", " \"embedding\": [\n", " -0.033118706196546555,\n", " -0.009973089210689068,\n", " 0.007738340180367231,\n", " 0.01987677626311779,\n", " -0.005902653094381094,\n", " 0.016267864033579826,\n", " -0.007432970684021711,\n", " -0.015684885904192924,\n", " -0.034201379865407944,\n", " -0.01390125136822462,\n", " 0.006142090540379286,\n", " 0.03406257554888725,\n", " -0.016573233529925346,\n", " 0.008140872232615948,\n", " 0.007224764209240675,\n", " 0.00477486802265048,\n", " 0.019057830795645714,\n", " 0.003567270701751113,\n", " 0.0037164853420108557,\n", " -0.022861069068312645,\n", " 0.00337988487444818,\n", " 0.0012926150811836123,\n", " -0.010354801081120968,\n", " -0.013200289569795132,\n", " -0.025415068492293358,\n", " 0.0065203323028981686,\n", " 0.005437658634036779,\n", " -0.011819186620414257,\n", " -0.015351756475865841,\n", " 0.009827344678342342,\n", " -0.0061247400008141994,\n", " 0.008890415541827679,\n", " 0.001048840000294149,\n", " -0.019460363313555717,\n", " -0.013720805756747723,\n", " -0.016406668350100517,\n", " -0.018405450507998466,\n", " -0.0063155959360301495,\n", " 0.006818761583417654,\n", " -0.009223545901477337,\n", " 0.03872640058398247,\n", " -0.0049553136341273785,\n", " 0.0011347251711413264,\n", " -0.0005855806521140039,\n", " -0.006638315971940756,\n", " -0.009355410002171993,\n", " 0.006211492698639631,\n", " -0.017697548493742943,\n", " -0.020903928205370903,\n", " 0.016101298853754997,\n", " 0.03545061871409416,\n", " -0.010292339138686657,\n", " -0.019932297989726067,\n", " -0.013970653526484966,\n", " -0.0018807983724400401,\n", " 0.02616461180150509,\n", " 0.007696698885411024,\n", " 0.010104953311383724,\n", " -0.015226832590997219,\n", " 0.0008918176754377782,\n", " 0.018100081011652946,\n", " 0.00840460043400526,\n", " -0.004760987590998411,\n", " 0.025345666334033012,\n", " -0.02309703640639782,\n", " -0.009633018635213375,\n", " 0.0007556159398518503,\n", " 0.006478691007941961,\n", " -0.004073906224220991,\n", " -0.0007152759353630245,\n", " 0.019335439428687096,\n", " -0.010743453167378902,\n", " -0.012887979857623577,\n", " -0.0021653471048921347,\n", " 0.01760038547217846,\n", " -0.015101908706128597,\n", " -0.007911845110356808,\n", " -0.00519475108012557,\n", " 0.008578105829656124,\n", " 0.005111468490213156,\n", " 0.014865941368043423,\n", " -0.020237667486071587,\n", " -0.0015129669336602092,\n", " 0.018627537414431572,\n", " 0.020751243457198143,\n", " 0.016309505328536034,\n", " 0.00021471291256602854,\n", " 0.012901860289275646,\n", " -0.010035551153123379,\n", " -0.003027668921276927,\n", " 0.020279308781027794,\n", " 0.020307069644331932,\n", " 0.023818818852305412,\n", " 0.01589309237897396,\n", " -0.014727137051522732,\n", " 0.009973089210689068,\n", " 0.010118833743035793,\n", " 0.05702080950140953,\n", " 0.013783267699182034,\n", " -0.024138068780303,\n", " -0.017808591946959496,\n", " 0.02051527611911297,\n", " -0.02233361266553402,\n", " -0.009445632807910442,\n", " -0.03381272777915001,\n", " 0.005704856943339109,\n", " 0.0023527329321950674,\n", " -0.0071553620509803295,\n", " -0.0015311850002035499,\n", " 0.010500545613467693,\n", " 0.00840460043400526,\n", " 0.04022548720240593,\n", " 0.0032393455039709806,\n", " -0.03414585813879967,\n", " -0.013637523166835308,\n", " 0.0048408000729978085,\n", " 0.00618720194324851,\n", " -0.026553263887763023,\n", " -0.015684885904192924,\n", " -0.021806156262755394,\n", " -0.007120660971850157,\n", " -0.005798549856990576,\n", " 0.01851649396121502,\n", " -0.014505050145089626,\n", " 0.009889806620776653,\n", " 0.015407278202474117,\n", " -0.0226112212985754,\n", " -0.017683668062090874,\n", " -0.005014305468648672,\n", " 0.013387675397098064,\n", " 0.023638373240828514,\n", " 0.026636546477675438,\n", " 0.020459754392504692,\n", " -0.015795929357409477,\n", " -0.030009491369128227,\n", " 0.004566661547869444,\n", " -0.03470107540488243,\n", " -0.004531960468739271,\n", " -0.021486906334757805,\n", " -0.021528547629714012,\n", " 0.0077522206120193005,\n", " 0.009390111081302166,\n", " -0.0045111398212611675,\n", " 0.014699376188218594,\n", " 0.006541152950376272,\n", " 0.025165220722556114,\n", " 0.029287708923220634,\n", " 0.017170092090964317,\n", " -0.012596490792930126,\n", " -0.0174477007240057,\n", " 0.01943260245025158,\n", " -0.013450137339532375,\n", " 0.00994532834738493,\n", " -0.0068499925546348095,\n", " 0.005284973885864019,\n", " -0.003095336025580764,\n", " 0.011978811584413052,\n", " 0.012887979857623577,\n", " -0.03747716173529625,\n", " 0.008057589642703533,\n", " 0.016892483457922935,\n", " 0.010646290145814419,\n", " 0.022722264751791954,\n", " 0.00023509979655500501,\n", " 0.013186409138143063,\n", " 0.02095944993197918,\n", " 0.03561718389391899,\n", " -0.01680920086801052,\n", " 0.00443132733926177,\n", " 0.0016153351170942187,\n", " -0.019321558997035027,\n", " 0.0016257454408332705,\n", " -0.01898842863738537,\n", " 0.01275611575692892,\n", " 0.013651403598487377,\n", " 0.016753679141402245,\n", " 0.012624251656234264,\n", " -0.007495432626456022,\n", " -0.017059048637747765,\n", " -0.04552781209349632,\n", " 0.00864750798791647,\n", " 0.01680920086801052,\n", " 0.017503222450613976,\n", " 0.007096370216459036,\n", " -0.014407887123525143,\n", " -0.006586264353245497,\n", " 0.004295993130654097,\n", " -0.011298670433461666,\n", " 0.005101058166474104,\n", " 0.01069487165659666,\n", " -0.0025349135976284742,\n", " 0.013741626404225826,\n", " 0.012395224533975124,\n", " 0.008432361297309399,\n", " -0.6911343932151794,\n", " -0.015962494537234306,\n", " 0.011402773670852184,\n", " -0.027608176693320274,\n", " 0.016087418422102928,\n", " -0.0008892150945030153,\n", " 0.00012676736514549702,\n", " -0.011999632231891155,\n", " -0.020376471802592278,\n", " 0.03012053482234478,\n", " -0.0019901066552847624,\n", " 0.002602580701932311,\n", " -0.013373794965445995,\n", " -0.012124556116759777,\n", " -0.0006745021673850715,\n", " -0.015851451084017754,\n", " 0.002172287320718169,\n", " -0.019002309069037437,\n", " 0.010431143455207348,\n", " 0.00802288856357336,\n", " -0.02444343827664852,\n", " 0.01399147417396307,\n", " -0.0004532828170340508,\n", " 0.027288926765322685,\n", " -0.006919394712895155,\n", " -0.007047788705676794,\n", " 0.009577496908605099,\n", " -0.0023232370149344206,\n", " -0.026983557268977165,\n", " -0.004153718706220388,\n", " -0.015559962950646877,\n", " 0.005163520108908415,\n", " 0.01914111338555813,\n", " -0.029870687052607536,\n", " 0.04316813871264458,\n", " 0.019793493673205376,\n", " -0.006867343094199896,\n", " 0.008453181944787502,\n", " 0.029870687052607536,\n", " 0.019779613241553307,\n", " -0.02876025252044201,\n", " -0.0011754989391192794,\n", " 0.005926943849772215,\n", " -0.003098806133493781,\n", " -0.010375621728599072,\n", " 0.02876025252044201,\n", " 0.025331785902380943,\n", " -5.1428080041659996e-05,\n", " -0.010382561944425106,\n", " -0.015795929357409477,\n", " 0.0005799417267553508,\n", " -0.006784060504287481,\n", " 0.012485447339713573,\n", " -0.0027448551263660192,\n", " -5.012678957427852e-05,\n", " 0.014199680648744106,\n", " 0.02051527611911297,\n", " -0.004032264929264784,\n", " -0.001795780728571117,\n", " -0.00645440025255084,\n", " 0.012034333311021328,\n", " 0.005899182986468077,\n", " 0.00028086183010600507,\n", " -0.01833604834973812,\n", " -0.019085591658949852,\n", " 0.012075974605977535,\n", " -0.012436865828931332,\n", " -0.024818209931254387,\n", " 0.02479044906795025,\n", " -0.014643854461610317,\n", " -0.0002648125810083002,\n", " 0.008286616764962673,\n", " 0.010209056548774242,\n", " -0.013720805756747723,\n", " 0.009286007843911648,\n", " -0.0032792517449706793,\n", " -0.00288365944288671,\n", " -0.01958528719842434,\n", " 0.0077661010436713696,\n", " 0.010118833743035793,\n", " 0.0004801761533599347,\n", " -0.00014856398047413677,\n", " -0.04330694302916527,\n", " 0.01116680633276701,\n", " 0.012887979857623577,\n", " 0.001958875684067607,\n", " -9.309648157795891e-05,\n", " -0.012853278778493404,\n", " -0.019154993817210197,\n", " -0.004528490360826254,\n", " -0.012027393095195293,\n", " -0.011583219282329082,\n", " 0.0005166122573427856,\n", " -0.041197117418050766,\n", " 0.0031491226982325315,\n", " -0.008807132951915264,\n", " -0.007606476079672575,\n", " 0.004368865396827459,\n", " 0.01986289583146572,\n", " -0.0388929657638073,\n", " -0.007953486405313015,\n", " 0.009390111081302166,\n", " 0.002942651277408004,\n", " 0.003128302050754428,\n", " 0.04280724748969078,\n", " -0.00014466010907199234,\n", " -0.015046386979520321,\n", " 0.00993144791573286,\n", " 0.011437474749982357,\n", " 6.609470437979326e-05,\n", " 0.012478507123887539,\n", " 0.016934124752879143,\n", " -0.013477898202836514,\n", " -0.007856323383748531,\n", " -0.0015051591908559203,\n", " -0.039531465619802475,\n", " 0.025803720578551292,\n", " -3.9662245399085805e-05,\n", " 0.013699985109269619,\n", " -0.01682308129966259,\n", " 0.03025933913886547,\n", " 0.0218477975577116,\n", " 0.003256696043536067,\n", " -0.006541152950376272,\n", " 0.025040296837687492,\n", " 0.006551563274115324,\n", " -0.005656275432556868,\n", " -0.006485631223767996,\n", " 0.011021061800420284,\n", " 0.008841834031045437,\n", " 0.002111560432240367,\n", " -0.016115179285407066,\n", " 0.021348102018237114,\n", " -0.0166842769831419,\n", " 0.00979264359921217,\n", " 0.0009421342401765287,\n", " 0.019696330651640892,\n", " -0.01223559956997633,\n", " 0.033701684325933456,\n", " -0.04164129123091698,\n", " -0.004667294677346945,\n", " 0.012152316980063915,\n", " 0.0004439569020178169,\n", " -0.0049934848211705685,\n", " -0.002095944946631789,\n", " -0.011742844246327877,\n", " -0.018891265615820885,\n", " -0.00011310382251394913,\n", " -0.02494313381612301,\n", " 0.004899791907519102,\n", " 0.012825517915189266,\n", " 0.0014860735973343253,\n", " -0.009327649138867855,\n", " 0.01345707755535841,\n", " -0.0033018074464052916,\n", " 0.014976984821259975,\n", " 0.010535246692597866,\n", " -0.004261292051523924,\n", " -0.009161083959043026,\n", " -0.023624492809176445,\n", " 0.01757262460887432,\n", " 0.02231973223388195,\n", " 0.008661388419568539,\n", " -0.019515885040163994,\n", " -0.0033677394967526197,\n", " -0.03467331454157829,\n", " 0.0035447150003165007,\n", " 0.017003526911139488,\n", " -0.0011156395776197314,\n", " -0.025775959715247154,\n", " 0.0036227924283593893,\n", " -0.036338966339826584,\n", " 0.008085350506007671,\n", " 0.015323995612561703,\n", " 0.009952268563210964,\n", " 0.026081329211592674,\n", " -0.024804329499602318,\n", " 0.01958528719842434,\n", " 0.00887653511017561,\n", " -0.020695721730589867,\n", " 0.009383170865476131,\n", " 0.03239692375063896,\n", " -0.008911236189305782,\n", " -0.003398970467969775,\n", " 0.04591646417975426,\n", " 0.022375253960490227,\n", " 0.025609394535422325,\n", " 0.023457927629351616,\n", " -0.008911236189305782,\n", " 0.028177274391055107,\n", " 0.014699376188218594,\n", " 0.006051867734640837,\n", " -0.014033115468919277,\n", " 0.006895103957504034,\n", " 0.0038379391189664602,\n", " 0.00603451719507575,\n", " -0.004552781116217375,\n", " 0.006485631223767996,\n", " 0.004577071871608496,\n", " 0.005437658634036779,\n", " 0.05257907137274742,\n", " 0.007467671763151884,\n", " 0.0132141700014472,\n", " -0.0011277849553152919,\n", " -0.0021861677523702383,\n", " -0.05840885266661644,\n", " 0.00016374570259358734,\n", " -0.02280554734170437,\n", " 0.02387434057891369,\n", " 0.01607353799045086,\n", " -0.0020178675185889006,\n", " -0.027455491945147514,\n", " -0.016948005184531212,\n", " -0.00841848086565733,\n", " -0.026525503024458885,\n", " 0.012395224533975124,\n", " 0.0020074571948498487,\n", " 0.003475312842056155,\n", " 0.0008818411151878536,\n", " 0.004858150612562895,\n", " -0.004223120864480734,\n", " -0.033590640872716904,\n", " 0.027705339714884758,\n", " 0.007849383167922497,\n", " -0.039226096123456955,\n", " 0.004643003921955824,\n", " -0.0002806449483614415,\n", " 0.02810787223279476,\n", " 0.003709545126184821,\n", " 0.001444432302378118,\n", " 0.017961276695132256,\n", " 0.025803720578551292,\n", " 0.018932906910777092,\n", " 0.006461340468376875,\n", " 0.010139654390513897,\n", " 0.007391329389065504,\n", " 0.03620016202330589,\n", " -0.01757262460887432,\n", " 0.029704121872782707,\n", " 0.01636502705514431,\n", " -0.00523292226716876,\n", " 0.022389134392142296,\n", " 0.02781638316810131,\n", " -0.011597099713981152,\n", " 0.011409713886678219,\n", " 0.004504199605435133,\n", " 0.02356897108256817,\n", " -0.006565443705767393,\n", " -0.012714474461972713,\n", " -0.001144267967902124,\n", " 0.005944294389337301,\n", " 0.012568729929625988,\n", " -0.018780222162604332,\n", " 0.004018384497612715,\n", " -0.001021946663968265,\n", " -0.015448919497430325,\n", " 0.018127841874957085,\n", " 0.009251306764781475,\n", " 0.009154143743216991,\n", " 0.013498718850314617,\n", " -0.009188844822347164,\n", " 0.00477486802265048,\n", " 0.017558744177222252,\n", " 0.00261646113358438,\n", " 0.004674234893172979,\n", " 0.0035412448924034834,\n", " 0.012075974605977535,\n", " 0.009403991512954235,\n", " -0.02001558057963848,\n", " -0.0014452998293563724,\n", " 0.0031647381838411093,\n", " -0.013734686188399792,\n", " -0.009695480577647686,\n", " -0.030342621728777885,\n", " 0.011034942232072353,\n", " -0.011125165037810802,\n", " -0.0007252524956129491,\n", " -0.007252525072544813,\n", " 0.0014921462861821055,\n", " 0.025317905470728874,\n", " -0.03170290216803551,\n", " -0.007578715216368437,\n", " -0.02524850331246853,\n", " 0.0029860276263207197,\n", " -0.010826735757291317,\n", " -0.011631800793111324,\n", " -0.02430463396012783,\n", " 0.014178860001266003,\n", " 0.0050837076269090176,\n", " -0.012894920073449612,\n", " 0.009751002304255962,\n", " 0.014005354605615139,\n", " -0.011277849785983562,\n", " -0.0050316560082137585,\n", " -0.02628953568637371,\n", " 0.005201691295951605,\n", " 0.00963995885103941,\n", " -0.012513208203017712,\n", " -0.01697576604783535,\n", " -0.008238035254180431,\n", " 0.007203943561762571,\n", " -0.0012527088401839137,\n", " 0.009237426333129406,\n", " -0.02552611194550991,\n", " 0.01743382029235363,\n", " -0.007453791331499815,\n", " -0.027275046333670616,\n", " -0.012207838706672192,\n", " 0.0029686770867556334,\n", " 0.004795688670128584,\n", " 0.00462218327447772,\n", " -0.001602322212420404,\n", " -0.017072929069399834,\n", " 0.010438083671033382,\n", " 0.019182754680514336,\n", " -0.003515219083055854,\n", " 0.007349688094109297,\n", " 0.0018790633184835315,\n", " 0.036616574972867966,\n", " 0.009556676261126995,\n", " 0.004913672339171171,\n", " -0.006856932770460844,\n", " -0.019849015399813652,\n", " 0.021820036694407463,\n", " 0.05088565871119499,\n", " 0.01772530935704708,\n", " -0.006936745252460241,\n", " -0.007314987014979124,\n", " 0.0048789712600409985,\n", " -0.008085350506007671,\n", " -0.0060241068713366985,\n", " -0.011666501872241497,\n", " 0.018113961443305016,\n", " -0.008827953599393368,\n", " -0.01911335252225399,\n", " -0.01866917870938778,\n", " -0.003733835881575942,\n", " -0.0036227924283593893,\n", " 0.0031456525903195143,\n", " -0.008730790577828884,\n", " -0.0072317044250667095,\n", " -0.012353583239018917,\n", " 0.004538900684565306,\n", " -0.012041273526847363,\n", " -0.01789187453687191,\n", " 0.010916958563029766,\n", " 0.020723482593894005,\n", " 0.01246462669223547,\n", " 0.014213561080396175,\n", " -0.014824300073087215,\n", " 0.027941307052969933,\n", " 0.024360155686736107,\n", " 0.016004135832190514,\n", " -0.010417263023555279,\n", " -0.004295993130654097,\n", " 0.010104953311383724,\n", " 0.0018495674012228847,\n", " 0.016184581443667412,\n", " 0.004747107159346342,\n", " 0.02476268820464611,\n", " 0.017614265903830528,\n", " -0.00834213849157095,\n", " 0.017933515831828117,\n", " -0.007550954353064299,\n", " -0.0017489342717453837,\n", " 0.008258855901658535,\n", " 0.016489950940012932,\n", " -0.013804088346660137,\n", " -0.0037234255578368902,\n", " -0.005895712878555059,\n", " -0.0020560387056320906,\n", " 0.016587113961577415,\n", " 0.0010800709715113044,\n", " -0.013713865540921688,\n", " 0.017808591946959496,\n", " -0.0069645061157643795,\n", " -0.017655907198786736,\n", " -0.022583460435271263,\n", " 0.0021185006480664015,\n", " 0.022291971370577812,\n", " 0.014213561080396175,\n", " 0.006614025216549635,\n", " -0.02186167798936367,\n", " -0.05288444086909294,\n", " -0.017211733385920525,\n", " -0.019654689356684685,\n", " 0.022999873384833336,\n", " 0.0002550529025029391,\n", " -0.03178618475794792,\n", " 0.010903078131377697,\n", " -0.05288444086909294,\n", " -0.002675452968105674,\n", " -0.038754161447286606,\n", " 0.005243332590907812,\n", " -0.04130816087126732,\n", " -0.011118224821984768,\n", " -0.018849624320864677,\n", " 0.010077192448079586,\n", " 0.029898447915911674,\n", " 0.015629364177584648,\n", " 0.005701386835426092,\n", " -0.007280285935848951,\n", " -0.007981247268617153,\n", " -0.0032029093708842993,\n", " -0.013019843958318233,\n", " -0.010306219570338726,\n", " -0.007176182698458433,\n", " -0.016031896695494652,\n", " -0.0174477007240057,\n", " 0.015823690220713615,\n", " 0.002444690791890025,\n", " -0.007391329389065504,\n", " -0.0006983591592870653,\n", " 0.0059477644972503185,\n", " -0.012013512663543224,\n", " -0.004080846440047026,\n", " 0.012714474461972713,\n", " -0.004084316547960043,\n", " -0.008744671009480953,\n", " 0.00979264359921217,\n", " 0.02917666547000408,\n", " 0.010805915109813213,\n", " -0.0011234473204240203,\n", " -0.019987819716334343,\n", " -0.0013238460524007678,\n", " -0.013047604821622372,\n", " -0.0015936469426378608,\n", " -0.004795688670128584,\n", " 0.014796539209783077,\n", " -0.015671005472540855,\n", " 0.01698964647948742,\n", " 0.014394006691873074,\n", " -0.006655666511505842,\n", " 0.0059720552526414394,\n", " 0.015296234749257565,\n", " -0.01972409151494503,\n", " 0.009376230649650097,\n", " 0.01635114662349224,\n", " 0.004021854605525732,\n", " 0.017322776839137077,\n", " -0.005867952015250921,\n", " 0.015337876044213772,\n", " -0.006044927518814802,\n", " 0.0070026773028075695,\n", " -0.00721782399341464,\n", " -0.017544863745570183,\n", " 0.009147203527390957,\n", " -0.003643613075837493,\n", " -0.007585655432194471,\n", " 0.019987819716334343,\n", " -0.0009993909625336528,\n", " -0.020987210795283318,\n", " -0.006527272518724203,\n", " 0.010916958563029766,\n", " -0.019363200291991234,\n", " 0.022208688780665398,\n", " -0.0027014787774533033,\n", " -0.01941872201859951,\n", " -0.04111383482813835,\n", " -0.010743453167378902,\n", " -0.012964322231709957,\n", " 0.013082305900752544,\n", " -0.012943501584231853,\n", " -0.013630582951009274,\n", " 0.008883475326001644,\n", " -0.014394006691873074,\n", " 0.006523802410811186,\n", " -0.018002917990088463,\n", " 0.009306828491389751,\n", " -0.020987210795283318,\n", " -0.003398970467969775,\n", " -0.010104953311383724,\n", " 0.008737730793654919,\n", " 0.023138677701354027,\n", " 0.0023891690652817488,\n", " 0.014824300073087215,\n", " -0.017503222450613976,\n", " -0.003733835881575942,\n", " -0.023777177557349205,\n", " -0.017072929069399834,\n", " -0.003166473237797618,\n", " -0.01414415892213583,\n", " 0.015421158634126186,\n", " 0.029010100290179253,\n", " 0.04483379051089287,\n", " -0.02048751525580883,\n", " 0.012429925613105297,\n", " 0.019043950363993645,\n", " -0.016101298853754997,\n", " 0.007835502736270428,\n", " -0.024262992665171623,\n", " -0.005555642303079367,\n", " -0.008161692880094051,\n", " 0.009737121872603893,\n", " 0.017086809501051903,\n", " -0.006870813202112913,\n", " 0.003553390270099044,\n", " -0.02903786115348339,\n", " 0.02995396964251995,\n", " 0.02658102475106716,\n", " -0.0009950533276423812,\n", " 0.007897964678704739,\n", " -0.001700352760963142,\n", " -0.006908984389156103,\n", " -0.012964322231709957,\n", " 0.004951843526214361,\n", " -0.00013262317224871367,\n", " 0.01589309237897396,\n", " 0.009147203527390957,\n", " -0.013422376476228237,\n", " 0.024429557844996452,\n", " 0.00311268656514585,\n", " 0.010916958563029766,\n", " 0.008959817700088024,\n", " 0.013158648274838924,\n", " -0.0036540233995765448,\n", " 0.0063155959360301495,\n", " 0.007710579317063093,\n", " 0.016018016263842583,\n", " -0.018558135256171227,\n", " 0.009070861153304577,\n", " -0.01229806151241064,\n", " -0.00714148161932826,\n", " 0.022403014823794365,\n", " 0.0037546565290540457,\n", " 0.016142940148711205,\n", " -0.007634236942976713,\n", " -0.006523802410811186,\n", " -0.0029738822486251593,\n", " -0.025137459859251976,\n", " -0.04727674648165703,\n", " -0.019043950363993645,\n", " -0.012263360433280468,\n", " 0.006600144784897566,\n", " -0.01776695065200329,\n", " -0.010111893527209759,\n", " -0.01986289583146572,\n", " -0.0044729686342179775,\n", " -0.0008601529407314956,\n", " 0.001425346708856523,\n", " -0.0054133678786456585,\n", " 0.028926817700266838,\n", " -0.012180077843368053,\n", " -0.013699985109269619,\n", " -0.00993144791573286,\n", " -0.005774259101599455,\n", " 0.03270229324698448,\n", " -0.0033486539032310247,\n", " 0.005239862482994795,\n", " 0.006232313346117735,\n", " 0.014879821799695492,\n", " -0.007731399964541197,\n", " -0.01896066777408123,\n", " -0.005378666799515486,\n", " 0.007210883777588606,\n", " 0.030176056548953056,\n", " 0.011416654102504253,\n", " -0.006915924604982138,\n", " -0.019960058853030205,\n", " 0.009730181656777859,\n", " 0.025803720578551292,\n", " -0.0180306788533926,\n", " -0.03978131338953972,\n", " 0.011541577987372875,\n", " -0.005597283598035574,\n", " 0.008293556980788708,\n", " -0.01944648288190365,\n", " -0.022083764895796776,\n", " -0.018447091802954674,\n", " 0.015101908706128597,\n", " -0.015684885904192924,\n", " 0.03239692375063896,\n", " -0.0078702038154006,\n", " -0.0022711853962391615,\n", " -0.0014479024102911353,\n", " 0.0004940565559081733,\n", " -0.0345345102250576,\n", " 0.006895103957504034,\n", " 0.008522584103047848,\n", " -0.017697548493742943,\n", " -0.013477898202836514,\n", " 0.02780250273644924,\n", " -0.02386046014726162,\n", " -0.01269365381449461,\n", " 0.0030727803241461515,\n", " 0.03658881410956383,\n", " -0.013429316692054272,\n", " -0.013790207915008068,\n", " -0.0008970228373073041,\n", " 0.02019602619111538,\n", " -0.014477289281785488,\n", " -0.0014288168167695403,\n", " -0.017253374680876732,\n", " 0.0281356330960989,\n", " -0.02950979582965374,\n", " -0.0039385720156133175,\n", " 0.00855728518217802,\n", " 0.004257821943610907,\n", " 0.015171310864388943,\n", " 0.011125165037810802,\n", " -0.01214537676423788,\n", " -0.015490560792386532,\n", " 0.005073297303169966,\n", " 0.001408863696269691,\n", " 0.012728354893624783,\n", " -0.00040643636020831764,\n", " -0.011340311728417873,\n", " 0.0021462615113705397,\n", " -0.0033156878780573606,\n", " -0.02950979582965374,\n", " 0.0045354305766522884,\n", " -0.003942042123526335,\n", " 0.01025069784373045,\n", " -0.024498960003256798,\n", " 0.0013385940110310912,\n", " 0.02311091683804989,\n", " 0.019460363313555717,\n", " 0.0013177733635529876,\n", " -0.0017445966368541121,\n", " 0.003515219083055854,\n", " 0.0011781015200540423,\n", " 0.02494313381612301,\n", " 0.0026771880220621824,\n", " 0.0036158522125333548,\n", " 0.00028238000231795013,\n", " -0.013526479713618755,\n", " 0.0014956163940951228,\n", " 0.027885785326361656,\n", " -0.02766369841992855,\n", " 0.0034406117629259825,\n", " 0.012707534246146679,\n", " -0.020862286910414696,\n", " -0.0048546805046498775,\n", " 0.016878603026270866,\n", " 0.0026060508098453283,\n", " 0.008411540649831295,\n", " -0.0060865688137710094,\n", " 0.0002385699044680223,\n", " 0.030453665181994438,\n", " -0.0029478564392775297,\n", " 0.02001558057963848,\n", " 0.014546691440045834,\n", " -0.02097333036363125,\n", " 0.0033035425003618,\n", " -0.026511622592806816,\n", " 0.005482770036906004,\n", " 0.020765123888850212,\n", " -0.010417263023555279,\n", " -0.002422135090455413,\n", " -0.011430534534156322,\n", " 0.0005300589255057275,\n", " 0.0032913971226662397,\n", " -0.023818818852305412,\n", " -0.001997046871110797,\n", " -0.005163520108908415,\n", " 0.02399926446378231,\n", " -0.0005248537636362016,\n", " -0.02250017784535885,\n", " -0.0030970710795372725,\n", " -0.0038067081477493048,\n", " -0.00809923093765974,\n", " 0.045055877417325974,\n", " 0.023763297125697136,\n", " -0.0004515477630775422,\n", " 0.0024845970328897238,\n", " 0.043057095259428024,\n", " 0.011284790001809597,\n", " 0.006603614892810583,\n", " 0.0019849014934152365,\n", " -0.013977593742311,\n", " -0.016129059717059135,\n", " -0.015559962950646877,\n", " -0.012318882159888744,\n", " -0.014852060936391354,\n", " -0.034812118858098984,\n", " 0.02615073136985302,\n", " 0.00269280350767076,\n", " -0.016476070508360863,\n", " -0.0288990568369627,\n", " -0.018252765759825706,\n", " 0.003190763993188739,\n", " -0.00802288856357336,\n", " 0.003595031565055251,\n", " -0.0025002125184983015,\n", " 0.006260074209421873,\n", " 0.007314987014979124,\n", " -0.0006319933454506099,\n", " 0.0212648194283247,\n", " 0.004247411619871855,\n", " 0.01382490899413824,\n", " -0.03167514130473137,\n", " 0.004216180648654699,\n", " 0.0174477007240057,\n", " 0.011055762879550457,\n", " 0.010764273814857006,\n", " 0.0027917015831917524,\n", " -0.04849822446703911,\n", " -0.019973939284682274,\n", " 0.012631191872060299,\n", " 0.02065408043563366,\n", " 0.00046889830264262855,\n", " 0.0218477975577116,\n", " 0.021014971658587456,\n", " -0.0030259338673204184,\n", " -0.016462190076708794,\n", " -0.00013912962458562106,\n", " -0.014921463094651699,\n", " 0.003051959676668048,\n", " 0.02322196029126644,\n", " -0.013450137339532375,\n", " -0.023666134104132652,\n", " -0.009501154534518719,\n", " -0.006284364964812994,\n", " -0.033562880009412766,\n", " 0.011708143167197704,\n", " 0.018572015687823296,\n", " -0.0026147260796278715,\n", " -0.010451964102685452,\n", " -0.016129059717059135,\n", " -0.029898447915911674,\n", " -0.008772431872785091,\n", " -0.0073843891732394695,\n", " 0.025637155398726463,\n", " 0.02631729654967785,\n", " -0.025914764031767845,\n", " 0.004990014713257551,\n", " 0.0029582667630165815,\n", " -0.008668328635394573,\n", " -0.006600144784897566,\n", " -0.006763239856809378,\n", " -0.02215316705405712,\n", " 0.011451355181634426,\n", " 0.009938388131558895,\n", " -0.0026615725364536047,\n", " -0.022555699571967125,\n", " -0.01275611575692892,\n", " 0.00841848086565733,\n", " -0.02093168906867504,\n", " 0.0056423950009047985,\n", " 0.018627537414431572,\n", " -0.024734927341341972,\n", " 0.0030883958097547293,\n", " 0.022583460435271263,\n", " 0.03381272777915001,\n", " -0.03850431367754936,\n", " 0.002444690791890025,\n", " -0.0021670821588486433,\n", " -0.0258453618735075,\n", " -0.006856932770460844,\n", " -0.003447551978752017,\n", " -0.013068425469100475,\n", " -0.032979901880025864,\n", " 0.010833675973117352,\n", " -0.008612806908786297,\n", " -0.010882257483899593,\n", " -0.016309505328536034,\n", " -0.021070493385195732,\n", " -0.008397660218179226,\n", " -0.007557894568890333,\n", " 0.002675452968105674,\n", " 0.20676289498806,\n", " -0.01368610467761755,\n", " -0.010368681512773037,\n", " 0.013894311152398586,\n", " -0.005579933058470488,\n", " 0.006211492698639631,\n", " 0.01458833273500204,\n", " 0.012443806044757366,\n", " -0.006065748166292906,\n", " 0.005430718418210745,\n", " 0.0029062151443213224,\n", " -0.008244975470006466,\n", " -0.021056612953543663,\n", " -0.005625044461339712,\n", " -0.005010835360735655,\n", " -0.0009325914434157312,\n", " -0.01177754532545805,\n", " -0.030037252232432365,\n", " -0.00970242079347372,\n", " 0.0007313251844607294,\n", " 0.01776695065200329,\n", " -0.01743382029235363,\n", " 0.012797757051885128,\n", " -0.0025678796228021383,\n", " 0.011708143167197704,\n", " -0.007863263599574566,\n", " -0.0004840800247620791,\n", " -0.014213561080396175,\n", " 0.010930838994681835,\n", " 0.01635114662349224,\n", " -0.018460972234606743,\n", " -0.005350905936211348,\n", " -0.0007486757240258157,\n", " 0.017031287774443626,\n", " 0.0032011743169277906,\n", " -0.0021289109718054533,\n", " 0.021514667198061943,\n", " -0.013602822087705135,\n", " 0.028954578563570976,\n", " 0.010146594606339931,\n", " -0.003190763993188739,\n", " -0.0016873398562893271,\n", " -0.0007196135702542961,\n", " -0.012860218994319439,\n", " -0.02796906791627407,\n", " 0.00614903075620532,\n", " 0.0026199312414973974,\n", " -0.015573843382298946,\n", " 0.00878631230443716,\n", " -0.012915740720927715,\n", " -0.010257638059556484,\n", " 0.012957382015883923,\n", " 0.03869863972067833,\n", " 0.02097333036363125,\n", " 0.005330085288733244,\n", " -0.003633202752098441,\n", " -0.007995127700269222,\n", " 0.00687428331002593,\n", " -0.0035880913492292166,\n", " 0.011742844246327877,\n", " -0.001547668012790382,\n", " 0.02219480834901333,\n", " -0.02981516532599926,\n", " 0.007301106583327055,\n", " 0.007544014137238264,\n", " 0.015323995612561703,\n", " -0.009077801369130611,\n", " -0.00032987710437737405,\n", " 0.020709602162241936,\n", " -0.017655907198786736,\n", " 0.0025418538134545088,\n", " -0.009633018635213375,\n", " -0.017253374680876732,\n", " 0.01683696173131466,\n", " 0.0036609636154025793,\n", " -0.020612439140677452,\n", " 0.020529156550765038,\n", " 0.036783140152692795,\n", " 0.0037997679319232702,\n", " 0.03595031425356865,\n", " -0.012749175541102886,\n", " 0.01682308129966259,\n", " 0.003921221476048231,\n", " -0.035256292670965195,\n", " -0.013269691728055477,\n", " -0.023360764607787132,\n", " 0.03528405353426933,\n", " -0.013887370936572552,\n", " -0.02018214575946331,\n", " -0.006499511655420065,\n", " 0.0012501062592491508,\n", " -0.048997920006513596,\n", " -0.008834893815219402,\n", " 0.022833308205008507,\n", " 0.013346034102141857,\n", " 0.016129059717059135,\n", " 0.010521366260945797,\n", " 0.006679957266896963,\n", " -0.032646771520376205,\n", " -0.04697137698531151,\n", " -0.01775307022035122,\n", " 0.019946178421378136,\n", " -0.0034631674643605947,\n", " 0.03361840173602104,\n", " -0.014255202375352383,\n", " -0.023166438564658165,\n", " -0.021625710651278496,\n", " 0.005663215648382902,\n", " 0.0172672551125288,\n", " -0.01776695065200329,\n", " 0.0006094376440159976,\n", " -0.014976984821259975,\n", " 0.013783267699182034,\n", " 0.011555458419024944,\n", " 0.0029166254680603743,\n", " 0.011361132375895977,\n", " -0.02691415511071682,\n", " -0.02138974331319332,\n", " 0.0028524284716695547,\n", " 0.01025069784373045,\n", " -0.012867159210145473,\n", " -0.039531465619802475,\n", " 0.001441829721443355,\n", " 0.009355410002171993,\n", " 0.016031896695494652,\n", " -0.00714148161932826,\n", " -0.014178860001266003,\n", " 0.009646899066865444,\n", " -0.004747107159346342,\n", " -0.007148421835154295,\n", " 0.010819795541465282,\n", " -0.03581150993704796,\n", " 0.023749416694045067,\n", " -0.020848406478762627,\n", " -0.007419090252369642,\n", " -0.002904480090364814,\n", " -0.01116680633276701,\n", " -0.006992266979068518,\n", " -0.029537556692957878,\n", " 0.012867159210145473,\n", " -0.003246285719797015,\n", " -5.533195144380443e-05,\n", " 0.0032410805579274893,\n", " -0.0014860735973343253,\n", " 0.017503222450613976,\n", " -0.034506749361753464,\n", " 0.032036032527685165,\n", " 0.0318417064845562,\n", " -0.03597807511687279,\n", " -0.02173675410449505,\n", " -0.008335198275744915,\n", " -0.0008796722977422178,\n", " -0.021320341154932976,\n", " -0.010361741296947002,\n", " 0.03531181439757347,\n", " -0.021750634536147118,\n", " -0.04277948662638664,\n", " -0.011728963814675808,\n", " -0.012499327771365643,\n", " 0.011062703095376492,\n", " -0.04261292144656181,\n", " -0.03414585813879967,\n", " 0.00857116561383009,\n", " -0.004771397914737463,\n", " -0.02555387280881405,\n", " -0.0027431200724095106,\n", " -0.18144498765468597,\n", " 0.00916802417486906,\n", " 0.019529765471816063,\n", " -0.013790207915008068,\n", " 0.017711428925395012,\n", " 0.00353256962262094,\n", " 0.026386698707938194,\n", " 0.0082519156858325,\n", " -0.015559962950646877,\n", " -0.0027066839393228292,\n", " 0.013221110217273235,\n", " -0.012055153958499432,\n", " -0.028191154822707176,\n", " -0.026400579139590263,\n", " 0.005978995468467474,\n", " -0.01093777921050787,\n", " -0.008272736333310604,\n", " 0.01712845079600811,\n", " 0.02200048230588436,\n", " 0.015421158634126186,\n", " 0.009875926189124584,\n", " -0.023652253672480583,\n", " -0.009098622016608715,\n", " 0.0023943742271512747,\n", " 0.009882866404950619,\n", " 0.009959208779036999,\n", " -0.004112077411264181,\n", " 0.010153534822165966,\n", " -0.010833675973117352,\n", " -0.007516253273934126,\n", " -0.014255202375352383,\n", " -0.002049098489806056,\n", " 0.020848406478762627,\n", " -0.003017258597537875,\n", " 0.00832825805991888,\n", " 0.013588941656053066,\n", " 0.004934492986649275,\n", " -0.008529524318873882,\n", " -0.011749784462153912,\n", " -0.005902653094381094,\n", " 0.02123705856502056,\n", " 0.016628755256533623,\n", " -0.009751002304255962,\n", " 0.022111525759100914,\n", " 0.001578031457029283,\n", " 0.008196393959224224,\n", " 0.019335439428687096,\n", " -0.01836380921304226,\n", " 0.009050040505826473,\n", " 0.009528915397822857,\n", " 0.015546082518994808,\n", " -0.028357720002532005,\n", " 0.013089246116578579,\n", " 0.0038691700901836157,\n", " -0.0005322277429513633,\n", " 0.013255811296403408,\n", " 0.012422985397279263,\n", " -0.0007681950810365379,\n", " -0.009050040505826473,\n", " -0.011312550865113735,\n", " 0.0033104827161878347,\n", " -0.013158648274838924,\n", " 0.01711457036435604,\n", " -0.0061247400008141994,\n", " -0.02601192705333233,\n", " 0.0009221811196766794,\n", " -0.00954973604530096,\n", " 0.007897964678704739,\n", " -0.001029754406772554,\n", " 0.009195785038173199,\n", " 0.0008900826214812696,\n", " 0.00011787522089434788,\n", " 0.013658343814313412,\n", " -0.011291730217635632,\n", " 0.008085350506007671,\n", " 0.014213561080396175,\n", " 0.001027151825837791,\n", " 0.010056371800601482,\n", " 0.01046584453433752,\n", " -0.009848165325820446,\n", " -0.011902469210326672,\n", " 0.03836550936102867,\n", " -0.016004135832190514,\n", " 0.01299902331084013,\n", " 0.03120320849120617,\n", " 0.01850261352956295,\n", " 0.018141722306609154,\n", " 0.01590697281062603,\n", " -0.011590159498155117,\n", " -0.010049431584775448,\n", " 0.01521295215934515,\n", " -0.012152316980063915,\n", " -0.009938388131558895,\n", " 0.00803676899522543,\n", " -0.0023614082019776106,\n", " 0.008689149282872677,\n", " 0.000945604348089546,\n", " -0.007432970684021711,\n", " 0.006398878525942564,\n", " -0.0025036826264113188,\n", " 0.006051867734640837,\n", " 0.0014053935883566737,\n", " -0.012152316980063915,\n", " 0.029287708923220634,\n", " 0.02524850331246853,\n", " 0.014852060936391354,\n", " 0.003261901205405593,\n", " 0.02169511280953884,\n", " 0.03256348893046379,\n", " -0.019918417558073997,\n", " -0.020307069644331932,\n", " -0.0014938813401386142,\n", " 0.00902921985834837,\n", " 0.021139895543456078,\n", " 0.02399926446378231,\n", " 0.012103735469281673,\n", " 0.004146778490394354,\n", " -0.006332946475595236,\n", " 0.022833308205008507,\n", " 0.007474611978977919,\n", " 0.049775224179029465,\n", " -0.005291914101690054,\n", " 0.0010453698923811316,\n", " 0.004844270180910826,\n", " 0.027927426621317863,\n", " -0.026039687916636467,\n", " -0.12514595687389374,\n", " -0.012561789713799953,\n", " 0.002030012896284461,\n", " 0.019182754680514336,\n", " -0.0028437532018870115,\n", " 0.002788231475278735,\n", " 0.011083523742854595,\n", " 0.02630341611802578,\n", " -0.018447091802954674,\n", " 0.015823690220713615,\n", " 0.002512357896193862,\n", " 0.001597117050550878,\n", " -0.00948727410286665,\n", " 0.0007625561556778848,\n", " 0.008293556980788708,\n", " 0.020612439140677452,\n", " 0.006447460036724806,\n", " -0.006326006259769201,\n", " -0.014768778346478939,\n", " 0.019696330651640892,\n", " 0.0034544921945780516,\n", " 0.017100689932703972,\n", " 0.021209297701716423,\n", " 0.003333038417622447,\n", " -0.00653074262663722,\n", " 0.004504199605435133,\n", " -0.02767757885158062,\n", " 0.014352365396916866,\n", " 0.010091072879731655,\n", " -0.010306219570338726,\n", " 0.02308315597474575,\n", " -0.009862045757472515,\n", " -0.010889197699725628,\n", " -0.012339702807366848,\n", " -0.002030012896284461,\n", " -0.01154851820319891,\n", " -0.029398752376437187,\n", " -0.005781199317425489,\n", " 0.010410322807729244,\n", " -0.013769387267529964,\n", " -0.0008007273427210748,\n", " -0.00397327309474349,\n", " 0.024804329499602318,\n", " 0.015268473885953426,\n", " 0.0210843738168478,\n", " -0.01460221316665411,\n", " -0.015809809789061546,\n", " -0.002512357896193862,\n", " 0.007176182698458433,\n", " -0.0227916669100523,\n", " -0.02383269928395748,\n", " -0.018474852666258812,\n", " -0.023777177557349205,\n", " -0.021820036694407463,\n", " 0.02111213468015194,\n", " 0.012318882159888744,\n", " 0.010000850073993206,\n", " 0.009528915397822857,\n", " -0.018127841874957085,\n", " 0.005951234605163336,\n", " -0.00031751484493725,\n", " -0.012013512663543224,\n", " -0.015351756475865841,\n", " 0.014227441512048244,\n", " 0.005340495612472296,\n", " 0.007398269604891539,\n", " -0.03445122763514519,\n", " -0.027941307052969933,\n", " 0.009063920937478542,\n", " -0.007356628309935331,\n", " -0.0003285758139099926,\n", " 0.03747716173529625,\n", " -0.017086809501051903,\n", " 0.017794711515307426,\n", " -0.011048822663724422,\n", " -0.001525979838334024,\n", " -0.012978202663362026,\n", " -0.0070026773028075695,\n", " -0.0024672464933246374,\n", " -0.0020751242991536856,\n", " -0.011506876908242702,\n", " -0.017017407342791557,\n", " -0.001215405180118978,\n", " -0.01061852928251028,\n", " 0.01944648288190365,\n", " 0.021792275831103325,\n", " 0.02784414403140545,\n", " -0.006409288849681616,\n", " -0.017614265903830528,\n", " -0.015532202087342739,\n", " 0.003556860378012061,\n", " 0.003695664694532752,\n", " -0.025317905470728874,\n", " -0.013505659066140652,\n", " -0.04377887770533562,\n", " 0.010611589066684246,\n", " -0.015310115180909634,\n", " -0.01712845079600811,\n", " 0.008598926477134228,\n", " -0.005323145072907209,\n", " -0.013637523166835308,\n", " -0.01376244705170393,\n", " -0.013977593742311,\n", " 0.022278090938925743,\n", " -0.02077900432050228,\n", " -0.009452573023736477,\n", " -0.0007525795954279602,\n", " -0.018752461299300194,\n", " -0.003529099514707923,\n", " -0.0005955572123639286,\n", " -0.037699248641729355,\n", " 0.007405209820717573,\n", " -0.0007642912096343935,\n", " 0.004115547519177198,\n", " -0.033285271376371384,\n", " -0.02447119913995266,\n", " -0.010528306476771832,\n", " 0.00515657989308238,\n", " 0.01161098014563322,\n", " -0.003962862771004438,\n", " 0.01836380921304226,\n", " 0.014768778346478939,\n", " -0.0210843738168478,\n", " -0.007009617518633604,\n", " 0.02323584072291851,\n", " 0.01790575496852398,\n", " -0.024804329499602318,\n", " 0.0022937410976737738,\n", " -0.03717179223895073,\n", " 0.027025198563933372,\n", " -0.0020699191372841597,\n", " 0.0005864481790922582,\n", " 0.006725068669766188,\n", " -0.02783026359975338,\n", " -0.005659745540469885,\n", " 0.003900401061400771,\n", " -0.0010878787143155932,\n", " -0.009695480577647686,\n", " 0.015684885904192924,\n", " 0.0033885601442307234,\n", " 0.014616093598306179,\n", " 0.007224764209240675,\n", " -0.03620016202330589,\n", " -0.015351756475865841,\n", " -0.005618104245513678,\n", " -9.152408892987296e-05,\n", " -0.0288990568369627,\n", " 0.004580541979521513,\n", " 0.0024013144429773092,\n", " 0.0040149143896996975,\n", " 0.017530983313918114,\n", " -0.003921221476048231,\n", " 0.035422857850790024,\n", " 0.013241930864751339,\n", " 0.032036032527685165,\n", " -0.041807856410741806,\n", " -0.010278458707034588,\n", " 0.0037026049103587866,\n", " 0.0029443863313645124,\n", " 0.00180445599835366,\n", " 0.0031456525903195143,\n", " -0.01605965755879879,\n", " 0.016267864033579826,\n", " 0.006069218274205923,\n", " 0.029759643599390984,\n", " -0.011041882447898388,\n", " -0.01941872201859951,\n", " 0.011812246404588223,\n", " 0.01636502705514431,\n", " -0.012894920073449612,\n", " -0.004771397914737463,\n", " -0.03625568374991417,\n", " -0.0067354789935052395,\n", " 0.0022243389394134283,\n", " 0.012180077843368053,\n", " 0.010118833743035793,\n", " 0.015976374968886375,\n", " 0.0026338116731494665,\n", " 0.0009221811196766794,\n", " 0.005264153238385916,\n", " -0.014616093598306179,\n", " 0.015504441224038601,\n", " 0.014407887123525143,\n", " 0.0022659802343696356,\n", " -0.016795320436358452,\n", " -0.0018964138580486178,\n", " 0.02705295942723751,\n", " 0.010333980433642864,\n", " 0.004715876188129187,\n", " 0.004039205145090818,\n", " 0.004108607303351164,\n", " 0.014643854461610317,\n", " -0.0210843738168478,\n", " -0.0011217122664675117,\n", " 0.008120051585137844,\n", " 0.005645865108817816,\n", " 0.007391329389065504,\n", " 0.02827443741261959,\n", " -0.019321558997035027,\n", " 0.012783876620233059,\n", " -0.009730181656777859,\n", " 0.016462190076708794,\n", " -0.003461432410404086,\n", " 0.006954095792025328,\n", " -0.012138436548411846,\n", " -0.003079720539972186,\n", " -0.006579324137419462,\n", " -0.007703639101237059,\n", " -0.014727137051522732,\n", " 0.0025036826264113188,\n", " 0.007793861906975508,\n", " 0.012499327771365643,\n", " 0.0036262625362724066,\n", " 0.006718128453940153,\n", " 0.017197852954268456,\n", " 0.01865529827773571,\n", " -0.03869863972067833,\n", " 0.022985992953181267,\n", " -0.0010748658096417785,\n", " -0.012166197411715984,\n", " -0.010354801081120968,\n", " 0.036644335836172104,\n", " 0.025873122736811638,\n", " 0.00857116561383009,\n", " 0.012610371224582195,\n", " 0.010882257483899593,\n", " 0.03667209669947624,\n", " 0.006346826907247305,\n", " 0.0015112318797037005,\n", " -0.010951659642159939,\n", " 0.029121143743395805,\n", " 0.008578105829656124,\n", " 0.0029634719248861074,\n", " -0.016476070508360863,\n", " -0.007939605973660946,\n", " -0.017350537702441216,\n", " -0.021667351946234703,\n", " -0.02735832892358303,\n", " -0.0026615725364536047,\n", " 0.05094118043780327,\n", " -0.009744062088429928,\n", " 0.06013002619147301,\n", " 0.0009881131118163466,\n", " -0.021292580291628838,\n", " 0.012110675685107708,\n", " -0.008751611225306988,\n", " 0.02783026359975338,\n", " -0.0057187373749911785,\n", " 0.00918190460652113,\n", " -0.004178009461611509,\n", " -0.008911236189305782,\n", " 0.011145985685288906,\n", " -0.016781440004706383,\n", " 0.003969802986830473,\n", " -0.04466722533106804,\n", " -0.013089246116578579,\n", " -0.024651644751429558,\n", " -0.0008415011106990278,\n", " 0.004823449533432722,\n", " -0.016295624896883965,\n", " -0.008487883023917675,\n", " 0.03350735828280449,\n", " -0.009653839282691479,\n", " 0.017059048637747765,\n", " 0.0061004492454230785,\n", " -0.007467671763151884,\n", " -0.014095577411353588,\n", " 0.013970653526484966,\n", " -0.04286276921629906,\n", " -0.018252765759825706,\n", " -0.0339515320956707,\n", " -0.0014652529498562217,\n", " -0.008550344966351986,\n", " -0.02906562201678753,\n", " -0.019835134968161583,\n", " -0.012117615900933743,\n", " 0.030342621728777885,\n", " 0.004094726871699095,\n", " -0.01191634964197874,\n", " 0.01604577712714672,\n", " 0.013588941656053066,\n", " -0.008050649426877499,\n", " 0.008654448203742504,\n", " -0.01222171913832426,\n", " -0.02752489410340786,\n", " 0.0038032380398362875,\n", " -0.018752461299300194,\n", " -0.01760038547217846,\n", " 0.00030450194026343524,\n", " -0.006398878525942564\n", " ],\n", " \"index\": 1,\n", " \"object\": \"embedding\"\n", " }\n", " ],\n", " \"model\": \"text-embedding-ada-002-v2\",\n", " \"object\": \"list\",\n", " \"usage\": {\n", " \"prompt_tokens\": 13,\n", " \"total_tokens\": 13\n", " }\n", "}" ] }, "execution_count": 4, "metadata": {}, "output_type": "execute_result" } ], "source": [ "MODEL = \"text-embedding-3-small\"\n", "\n", "res = openai.Embedding.create(\n", " input=[\n", " \"Sample document text goes here\",\n", " \"there will be several phrases in each batch\"\n", " ], engine=MODEL\n", ")\n", "res" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "-Egz35DjtRNo", "outputId": "78c4c022-d3a8-4fa7-8fa8-59c45eca1298" }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "vector 0: 1536\n", "vector 1: 1536\n" ] } ], "source": [ "print(f\"vector 0: {len(res['data'][0]['embedding'])}\\nvector 1: {len(res['data'][1]['embedding'])}\")" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "ZguN6obBtRNp", "outputId": "bd20d4be-0772-4383-9d1e-9960d8b5f183" }, "outputs": [ { "data": { "text/plain": [ "2" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# we can extract embeddings to a list\n", "embeds = [record['embedding'] for record in res['data']]\n", "len(embeds)" ] }, { "cell_type": "markdown", "metadata": { "id": "U4WJwy58tRNp" }, "source": [ "Next, we initialize our index to store vector embeddings with Pinecone." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "OnyoBu-BRNOs", "outputId": "4d40b553-4ff2-4336-baab-24ff6424fead" }, "outputs": [ { "data": { "text/plain": [ "1536" ] }, "execution_count": 13, "metadata": {}, "output_type": "execute_result" } ], "source": [ "len(embeds[0])" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "id": "I2KLRbN-tRNq" }, "outputs": [], "source": [ "import pinecone\n", "\n", "index_name = 'semantic-search-openai'\n", "\n", "# initialize connection to pinecone (get API key at app.pinecone.io)\n", "pinecone.init(\n", " api_key=\"PINECONE_API_KEY\",\n", " environment=\"PINECONE_ENVIRONMENT\" # find next to api key in console\n", ")\n", "# check if 'openai' index already exists (only create index if not)\n", "if index_name not in pinecone.list_indexes():\n", " pinecone.create_index(index_name, dimension=len(embeds[0]))\n", "# connect to index\n", "index = pinecone.Index(index_name)" ] }, { "cell_type": "markdown", "metadata": { "id": "TLCLmeZRtRNq" }, "source": [ "## Populating the Index\n", "\n", "Now we will take 1K questions from the TREC dataset" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "JiSfCTK-lhXx", "outputId": "bcb82771-a0d5-4c63-d2ad-69a963f93620" }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "WARNING:datasets.builder:Found cached dataset trec (/root/.cache/huggingface/datasets/trec/default/2.0.0/f2469cab1b5fceec7249fda55360dfdbd92a7a5b545e91ea0f78ad108ffac1c2)\n" ] }, { "data": { "text/plain": [ "Dataset({\n", " features: ['text', 'coarse_label', 'fine_label'],\n", " num_rows: 1000\n", "})" ] }, "execution_count": 16, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from datasets import load_dataset\n", "\n", "# load the first 1K rows of the TREC dataset\n", "trec = load_dataset('trec', split='train[:1000]')\n", "trec" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "2m7a_zl8lt2e", "outputId": "7e2bc141-27bf-4580-c632-642a65c652d8" }, "outputs": [ { "data": { "text/plain": [ "{'text': 'How did serfdom develop in and then leave Russia ?',\n", " 'coarse_label': 2,\n", " 'fine_label': 26}" ] }, "execution_count": 17, "metadata": {}, "output_type": "execute_result" } ], "source": [ "trec[0]" ] }, { "cell_type": "markdown", "metadata": { "id": "sJwnszP0ljN6" }, "source": [ "Then we create a vector embedding for each phrase using OpenAI, and `upsert` the ID, vector embedding, and original text for each phrase to Pinecone." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 49, "referenced_widgets": [ "0d73abb4e43144b281b35cd7b26f4197", "74e7f7ea3b0f45eca68d2af7e6c15957", "d58f34488c9f433cafbbe72803096267", "a791ec194e974ea6a4e18b4bc1c5bc49", "de16af8ed7f84ce3a8b20b03f04ccd58", "cc26431b7f64491fbc5189b6c88744b9", "1b6caaee4ca144cbbc4650924ea34b27", "0e9afbd797ee4d17a085c90c7b27bfc9", "cfcfd1cf66a942788a6b9553a41c6c8e", "3977aa60e81a4fb980087c8b479fd10a", "b600da6475f34fbab3e249be8929591b" ] }, "id": "B80PgNyytRNq", "outputId": "57bfa165-72f2-46ca-9e51-fd7d0fb23b07" }, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "0d73abb4e43144b281b35cd7b26f4197", "version_major": 2, "version_minor": 0 }, "text/plain": [ " 0%| | 0/32 [00:00