Archives/openai-cookbook
2
0
Fork 0
mirror of https://github.com/openai/openai-cookbook synced 2024-11-04 06:00:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
a7e107d9fc
openai-cookbook/examples/vector_databases/kusto
History
Logan Kilpatrick f1e13cfcc7
Misc updates (#1022)
2024-01-25 11:59:05 -06:00
..
images kusto vector sample added 2023-05-11 11:06:34 +08:00
Getting_started_with_kusto_and_openai_embeddings.ipynb Misc updates (#1022) 2024-01-25 11:59:05 -06:00
README.md kusto vector sample added 2023-05-11 11:06:34 +08:00

README.md

Kusto as a Vector database

Azure Data Explorer aka Kusto is a cloud-based data analytics service that enables users to perform advanced analytics on large datasets in real-time. It is particularly well-suited for handling large volumes of data, making it an excellent choice for storing and searching vectors.

Kusto supports a special data type called dynamic, which can store unstructured data such as arrays and properties bag. Dynamic data type is perfect for storing vector values. You can further augment the vector value by storing metadata related to the original object as separate columns in your table.
Kusto also supports in-built function series_cosine_similarity_fl to perform vector similarity searches.

Get started with Kusto for free.

Kusto_Vector

Getting started with Kusto and Open AI embedding

Demo Scenario

Wiki_embeddings

semantic_search_flow

If you’d like to try this demo, please follow the instructions in the Notebook.

It will allow you to -

  1. Use precomputed embeddings created by OpenAI API.

  2. Store the embeddings in Kusto.

  3. Convert raw text query to an embedding with OpenAI API.

  4. Use Kusto to perform cosine similarity search in the stored embeddings.