Commit Graph

3 Commits (d481d887bccea9ccbb1fecbfd053fe2acf078199)

Author SHA1 Message Date
Harrison Chase c4ae8c1d24
bump ver to 140 (#2895) 1 year ago
Harrison Chase 7aba18ea77
Harrison/docs cleanup (#2633) 1 year ago
Davit Buniatyan aaac7071a3
Deep Lake retriever example analyzing Twitter the-algorithm source code (#2602)
Improvements to Deep Lake Vector Store
- much faster view loading of embeddings after filters with
`fetch_chunks=True`
- 2x faster ingestion
- use np.float32 for embeddings to save 2x storage, LZ4 compression for
text and metadata storage (saves up to 4x storage for text data)
- user defined functions as filters

Docs
- Added retriever full example for analyzing twitter the-algorithm
source code with GPT4
- Added a use case for code analysis (please let us know your thoughts
how we can improve it)

---------

Co-authored-by: Davit Buniatyan <d@activeloop.ai>
1 year ago