Commit Graph

14 Commits (988cb51a7c357fa32a1a6baf889e4b61240865de)

Author SHA1 Message Date
Harrison Chase 1fe3a4f724
extra requires (#129)
add extra requires
2 years ago
Harrison Chase d87e73ddb1
huggingface tokenizer (#75) 2 years ago
Harrison Chase e43534d41c
add integration with manifest (#62) 2 years ago
Delip Rao 3ee6e332dd
Implements NLTK and Spacy-based TextSplitters (#103)
This PR is for Issue #88 

- [x] `make format`
- [x] `make lint`
- [x] `make tests`
2 years ago
Delip Rao bd462e9df0
Fix pip install issue due to FAISS (#102)
- change requirements.txt to fix Issue #101
- update .gitignore to support VSCode dev environment
2 years ago
Samantha Whitmore e48e562ea5
ElasticVectorSearch: Add in vector search backed by Elastic (#67)
![image](https://user-images.githubusercontent.com/6690839/200147455-33a68e20-c3c0-4045-9bff-598b38ae8fb2.png)

woo!

Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
2 years ago
Samantha Whitmore efbc03bda8
NLPCloud client integration (#81)
lots of kwargs! generation docs here:
https://docs.nlpcloud.com/#generation

This somewhat breaks the paradigm introduced in LLM base class as the
stop sequence isn't a list, and should rightfully be introduced at the
time of initialization of the class, along with the other kwargs that
depend on its presence (e.g. remove_end_sequence, etc.) curious if you'd
want to refactor LLM base class to take out stop as a specific named
kwarg?
2 years ago
Harrison Chase 6cff2837bb
Harrison/fix lint (#80) 2 years ago
issam9 990cd821cc
Issam/hf embeddings (#68)
Add support of HuggingFace embedding models
2 years ago
Harrison Chase 76aff023d7
FAISS and embedding support (#48)
also adds embeddings and an in memory docstore
2 years ago
Harrison Chase ce7b14b843
Harrison/add react chain (#24)
from https://arxiv.org/abs/2210.03629

still need to think if docstore abstraction makes sense
2 years ago
Harrison Chase 020c42dcae
Harrison/add huggingface hub (#23)
Add support for huggingface hub

I could not find a good way to enforce stop tokens over the huggingface
hub api - that needs to hopefully be cleaned up in the future
2 years ago
Harrison Chase 21b10ffb13
update readme (#21) 2 years ago
Harrison Chase 18aeb72012 initial commit 2 years ago