blob42
/
langchain
forked from Archives/langchain
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
708 Commits
75 Branches
13 Tags
33 MiB
multi_strategy_parser
master
searx_updates
chatconv_parser_exception
textloader_autodetect_encodings
docker
dynamic_agent_tools
parallel_dir_loader
parallel_dir_loader_back
fix_agent_callbacks
fix-readthedocs
doc
searx-async
searx
mine
agent-lookup-tool
agent-lookup-tool-bad
tool-patch
fix-searx
main
docker-utility
searx-doc
docker-utility-pexpect
searx-query-suffix
searx-search-suffix
searx-query-suffixy
searx-api
makefile
makefile-update-1
searx-api-pre
ankush/async-llmchain
harrison/deployments1
ankush/async-llm
ankush/retry-openai
harrison/image
scad/api-chain
harrison/document-split
harrison/prompt-bugs
harrison/sql-agent
harrison/pinecone-try-except
harrison/callback-updates
harrison/map-rerank
harrison/combine-docs-parse
fork-chains
harrison/azure-rfc
harrison/sequential_chain_from_prompts
harrison/agent-refactor
harrison/agent_intermediate_steps
harrison/agent_multi_inputs
harrison/promot-mrkl
harrison/fix_logging_api
harrison/use_output_parser
harrison/track_intermediate_steps
harrison/sql_error
harrison/logging_to_file
harrison/output_parser
harrison/flexible_model_args
harrison/agent-improvements
harrison/router_docs
harrison/docs
samantha/add_llm_to_example
harrison/reorg_smart_chains
mako-templates
harrison/save_metadatas
harrison/router
harrison/custom_pipeline
harrison/chain_pipeline
harrison/prompts_docs
harrison/attempt_citing_in_prompt
harrison/load_prompt
harrison/prompts_take_2
harrison/ape
harrison/prompt_examples
william/cot_sc
harrison/add_dependencies
v0.0.64
v0.0.65
v0.0.66
v0.0.67
v0.0.68
v0.0.69
v0.0.70
v0.0.71
v0.0.72
v0.0.73
v0.0.74
v0.0.75
v0.0.76
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'db2e9c2b0d'
${ noResults }
Commit Graph

36 Commits (db2e9c2b0d1192e589b5f74a17e30b516fe70637)

Author SHA1 Message Date
Tim Asp d22651d82a Add new iFixit document loader (#1333) 
iFixit is a wikipedia-like site that has a huge amount of open content
on how to fix things, questions/answers for common troubleshooting and
"things" related content that is more technical in nature. All content
is licensed under CC-BY-SA-NC 3.0

Adding docs from iFixit as context for user questions like "I dropped my
phone in water, what do I do?" or "My macbook pro is making a whining
noise, what's wrong with it?" can yield significantly better responses
than context free response from LLMs.
 2 years ago
Matt Robinson c46478d70e feat: document loader for image files (#1330) 
### Summary

Adds a document loader for image files such as `.jpg` and `.png` files.

### Testing

Run the following using the example document from the [`unstructured`
repo](https://github.com/Unstructured-IO/unstructured/tree/main/example-docs).

```python
from langchain.document_loaders.image import UnstructuredImageLoader

loader = UnstructuredImageLoader("layout-parser-paper-fast.jpg")
loader.load()
```
 2 years ago
Ingo Kleiber fd9975dad7
add CoNLL-U document loader (#1297) 
I've added a simple
[CoNLL-U](https://universaldependencies.org/format.html) document
loader. CoNLL-U is a common format for NLP tasks and is used, for
example, in the Universal Dependencies treebank corpora. The loader
reads a single file in standard CoNLL-U format and returns a document.
 2 years ago
Harrison Chase d29f74114e
copy paste loader (#1302) 2 years ago
Matt Robinson 2f15c11b87
feat: document loader for MS Word documents (#1282) 
### Summary

Adds a document loader for MS Word Documents. Works with both `.docx`
and `.doc` files as longer as the user has installed
`unstructured>=0.4.11`.

### Testing

The follow workflow test the loader for both `.doc` and `.docx` files
using example docs from the `unstructured` repo.

#### `.docx`

```python
from langchain.document_loaders import UnstructuredWordDocumentLoader

filename = "../unstructured/example-docs/fake.docx"
loader = UnstructuredWordDocumentLoader(filename)
loader.load()
```

#### `.doc`

```python
from langchain.document_loaders import UnstructuredWordDocumentLoader

filename = "../unstructured/example-docs/fake.doc"
loader = UnstructuredWordDocumentLoader(filename)
loader.load()
```
 2 years ago
Harrison Chase 96db6ed073
cleanup (#1274) 2 years ago
Harrison Chase 42167a1e24
Harrison/fb loader (#1277) 
Co-authored-by: Vairo Di Pasquale <vairo.dp@gmail.com>
 2 years ago
Klein Tahiraj 8a0751dadd
adding .ipynb loader and documentation Fixes #1248 (#1252) 
`NotebookLoader.load()` loads the `.ipynb` notebook file into a
`Document` object.

**Parameters**:

* `include_outputs` (bool): whether to include cell outputs in the
resulting document (default is False).
* `max_output_length` (int): the maximum number of characters to include
from each cell output (default is 10).
* `remove_newline` (bool): whether to remove newline characters from the
cell sources and outputs (default is False).
* `traceback` (bool): whether to include full traceback (default is
False).
 2 years ago
Matt Robinson 3d5f56a8a1
docs: add quotes to `unstructured[local-inference]` install instructions (#1208) 
### Summary

Corrects the install instruction for local inference to `pip install
"unstructured[local-inference]"`
 2 years ago
Harrison Chase d90a287d8f
Harrison/updating docs (#1196) 2 years ago
Dennis Antela Martinez 23243ae69c
add gitbook document loader (#1180) 
Added a GitBook document loader. It lets you both, (1) fetch text from
any single GitBook page, or (2) fetch all relative paths and return
their respective content in Documents.

I've modified the `scrape` method in the `WebBaseLoader` to accept
custom web paths if given, but happy to remove it and move that logic
into the `GitbookLoader` itself.
 2 years ago
Harrison Chase 65cc81c479
directory loader improvements (#1162) 2 years ago
Harrison Chase fb3c73d194
add srt loader (#1140) 2 years ago
Harrison Chase 483821ea3b
fix docs (#1133) 2 years ago
Harrison Chase d5f3dfa1e1
Harrison/hn loader (#1130) 
Co-authored-by: William X <william.y.xuan@gmail.com>
 2 years ago
Harrison Chase c60954d0f8
Harrison/telegram loader (#1080) 
Co-authored-by: Maxime Vidal <max.vidal@hotmail.fr>
 2 years ago
Harrison Chase 98186ef180
Harrison/evernote nb (#1078) 
Co-authored-by: Akshay <64036106+akshayvkt@users.noreply.github.com>
 2 years ago
Harrison Chase 7fb33fca47
chroma docs (#1012) 2 years ago
cragwolfe 05d8969c79
Unstructured example notebook: add a pdf, related deps (#1011) 
Updates the Unstructured example notebook with a PDF example. Includes
additional dependencies for PDF processing (and images, etc).
 2 years ago
Harrison Chase 0998577dfe
Harrison/unstructured structured (#1004) 2 years ago
Harrison Chase bbb06ca4cf
pdfminer (#1003) 2 years ago
Francisco Ingham 0b6aa6a024
Added initial capital letter to bullet points that had it missing (#1000) 
Co-authored-by: Francisco Ingham <>
 2 years ago
Harrison Chase 2e96704d59
Harrison/airbyte (#989) 
Co-authored-by: zanderchase <zanderchase@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MacBook-Pro.local>
 2 years ago
zanderchase c2d1d903fa
Zander/online pdf loader (#984) 2 years ago
Matt Robinson 07a407d89a
feat: adds `UnstructuredURLLoader` for loading data from urls (#979) 
### Summary

Adds a `UnstructuredURLLoader` that supports loading data from a list of
URLs.


### Testing

```python
from langchain.document_loaders import UnstructuredURLLoader

urls = [
    "https://www.understandingwar.org/backgrounder/russian-offensive-campaign-assessment-february-8-2023",
    "https://www.understandingwar.org/backgrounder/russian-offensive-campaign-assessment-february-9-2023"
]
loader = UnstructuredURLLoader(urls=urls)
raw_documents = loader.load()
```
 2 years ago
Harrison Chase c64f98e2bb
Harrison/format agent instructions (#973) 
Co-authored-by: Andrew White <white.d.andrew@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
Co-authored-by: Peng Qu <82029664+pengqu123@users.noreply.github.com>
 2 years ago
Harrison Chase 5469d898a9
Harrison/everynote (#974) 
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2 years ago
Harrison Chase 01fa2d8117
Harrison/youtube fixes (#955) 
Co-authored-by: Ji <jizhang.work@gmail.com>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2 years ago
zanderchase 8e126bc9bd
adding webpage loading logic (#942) 2 years ago
Harrison Chase 3e1901e1aa
gutenberg books (#946) 
Co-authored-by: zanderchase <zander@unfold.ag>
Co-authored-by: Harrison Chase <harrisonchase@Harrisons-MBP.attlocal.net>
 2 years ago
Harrison Chase 44ecec3896
Harrison/add roam loader (#939) 2 years ago
Harrison Chase 637c0d6508
Harrison/obsidian (#920) 2 years ago
Ankush Gola 6bd1529cb7
add GoogleDriveLoader (#914) 
only deal with docs files for now
 2 years ago
Harrison Chase 2ec25ddd4c
add unstructured examples (#913) 2 years ago
Harrison Chase 71e662e88d
update docs (#905) 2 years ago
Harrison Chase 53d56d7650
Harrison/unstructured support (#903) 2 years ago