langchain

Commit Graph

Author	SHA1	Message	Date
Predrag Gruevski	ade683c589	Rely on `WORKDIR` env var to avoid ugly ternary operators in workflows. (#9456 ) Ternary operators in GitHub Actions syntax are pretty ugly and hard to read: `inputs.working-directory == '' && '.' \|\| inputs.working-directory` means "if the condition is true, use `'.'` and otherwise use the expression after the `\|\|`". This PR performs the ternary as few times as possible, assigning its outcome to an env var we can then reuse as needed.	11 months ago
Predrag Gruevski	8976483f3a	Lint only on the min and max supported Python versions. (#9450 ) Only lint on the min and max supported Python versions. It's extremely unlikely that there's a lint issue on any version in between that doesn't show up on the min or max versions. GitHub rate-limits how many jobs can be running at any one time. Starting new jobs is also relatively slow, so linting on fewer versions makes CI faster.	11 months ago
Predrag Gruevski	463019ac3e	Cache black formatting information across CI runs. (#9413 ) Save and persist `black`'s formatted files cache across CI runs. Around a ~20s win, 21s -> 2s. Most cases should be close to this best case scenario, since most PRs don't modify most files — and this PR makes sure we don't re-check files that haven't changed. Before: ![image](https://github.com/langchain-ai/langchain/assets/2348618/6c5670c5-be70-4a18-aa2a-ece5e4425d1e) After: ![image](https://github.com/langchain-ai/langchain/assets/2348618/37810d27-c611-4f76-b9bd-e827cefbaa0a)	11 months ago
Predrag Gruevski	0dd2c21089	Do not bust `poetry install` cache when manually installing pydantic v2. (#9407 ) Using `poetry add` to install `pydantic@2.1` was also causing poetry to change its lockfile. This prevented dependency caching from working: - When attempting to restore a cache, it would hash the lockfile in git and use it as part of the cache key. Say this is a cache miss. - Then, it would attempt to save the cache -- but the lockfile will have changed, so the cache key would be different than the key in the lookup. So the cache save would succeed, but to a key that cannot be looked up in the next run -- meaning we never get a cache hit. In addition to busting the cache, the lockfile update itself is also non-trivially long, over 30s: ![image](https://github.com/langchain-ai/langchain/assets/2348618/d84d3b56-484d-45eb-818d-54126a094a40) This PR fixes the problems by using `pip` to perform the installation, avoiding the lockfile change.	11 months ago
Predrag Gruevski	8f2d321dd0	Cache .mypy_cache across lint runs. (#9405 ) Preserve the `.mypy_cache` directory across lint runs, to avoid having to re-parse all dependencies and their type information. Approximately a 1min perf win for CI. Before: ![image](https://github.com/langchain-ai/langchain/assets/2348618/6524f2a9-efc0-4588-a94c-69914b98b382) After: ![image](https://github.com/langchain-ai/langchain/assets/2348618/dd0af954-4dc9-43d3-8544-25846616d41d)	11 months ago
Predrag Gruevski	f2560188ec	Cache linting venv on CI. (#9342 ) Ensure that we cache the linting virtualenv as well as the pip cache for the `pip install -e langchain` step. This is a win of about 60-90s overall. Before: ![image](https://github.com/langchain-ai/langchain/assets/2348618/f55f8398-2c3a-4112-bad3-2c646d186183) After: ![image](https://github.com/langchain-ai/langchain/assets/2348618/984a9529-2431-41b4-97e5-7f5dd7742651)	11 months ago
Bagatur	995ef8a7fc	unpin pydantic (#9356 )	11 months ago
Bagatur	3eccd72382	pin pydantic (#9274 ) don't want default to be v2 yet	11 months ago
Eugene Yurtsev	a091b4bf4c	Update testing workflow to test with both pydantic versions (#9206 ) * PR updates test.yml to test with both pydantic versions * Code should be refactored to make it easier to do testing in matrix format w/ packages * Added steps to assert that pydantic version in the environment is as expected	11 months ago
Bagatur	206f809366	fix sched ci (more) (#9056 )	11 months ago
Bagatur	e5db8a16c0	Bagatur/fix sched (#9054 )	11 months ago
Bagatur	e162fd418a	fix sched ci (#9053 )	11 months ago
Bagatur	269f85b7b7	scheduled gha fix (#8977 )	11 months ago
Bagatur	95cf7de112	scheduled tests GHA (#8879 ) Adding scheduled daily GHA that runs marked integration tests. To start just marking some tests in test_openai	11 months ago
Harrison Chase	2448043b84	bump and fix (#8441 )	12 months ago
Harrison Chase	cddd8ae83d	update release yml (#8364 ) only do the step that tags and adds release notes if its langchain	12 months ago
William FH	01a9b06400	Add api cross ref linking (#8275 ) Example of how it would show up in our python docs: ![image](https://github.com/langchain-ai/langchain/assets/13333726/0f0a88cc-ba4a-4778-bc47-118c66807f15) Examples added to the reference docs: https://api.python.langchain.com/en/wfh-api_crosslink/vectorstores/langchain.vectorstores.chroma.Chroma.html#langchain.vectorstores.chroma.Chroma ![image](https://github.com/langchain-ai/langchain/assets/13333726/dcd150de-cb56-4d42-b49a-a76a002a5a52)	12 months ago
Harrison Chase	8dcabd9205	bump releases rc0 (#8097 )	12 months ago
Harrison Chase	0faba034b1	add experimental release action (#8096 )	12 months ago
Harrison Chase	da04760de1	Harrison/move experimental (#8084 )	12 months ago
Harrison Chase	f35db9f43e	(WIP) set up experimental (#7959 )	12 months ago
Yaroslav Halchenko	0d92a7f357	codespell: workflow, config + some (quite a few) typos fixed (#6785 ) Probably the most boring PR to review ;) Individual commits might be easier to digest --------- Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>	1 year ago
Davis Chase	87e502c6bc	Doc refactor (#6300 ) Co-authored-by: jacoblee93 <jacoblee93@gmail.com> Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>	1 year ago
Davis Chase	56cb77a828	Make test gha workflow manually runnable (#4998 ) if https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#workflow_dispatch is to be believed this should make it possible to manually kick of test workflow, but i don't know much about these things	1 year ago
Eugene Yurtsev	14bedf1cc5	Github Action: Fix poetry lock file checking (#4789 ) Fix how poetry lock file is checked to avoid skipping caches silently.	1 year ago
Eugene Yurtsev	49ce5ce1ca	Only run linkcheck against docs dir on PR (#4741 ) # Only run linkchecker on direct changes to docs This is a stop-gap that will speed up PRs. Some broken links can slip through if they're embedded in doc-strings inside the codebase. But we'll still be running the linkchecker on master.	1 year ago
Eugene Yurtsev	99cfe71cd0	Check poetry lock file (#4740 ) # Check poetry lock file on CI This PR checks that the lock file is up to date using poetry lock --check. As part of this PR, a new lock file was generated.	1 year ago
Eugene Yurtsev	08ed927c32	Turn on extended tests (#4588 ) # Turn on strict extended tests This PR turns on strict testing for extended tests.	1 year ago
Eugene Yurtsev	146616aa5d	Test workflow, fix minor typos (#4495 ) # Fix 2 minor typos in test workflow. This PR does not result in any functional changes.	1 year ago
Eugene Yurtsev	f373883c1a	Refactor test workflow (#4457 ) # Refactor the test workflow This PR refactors the tests to run using a single test workflow. This makes it easier to relaunch failing tests and see in the UI which test failed since the jobs are grouped together. ## Before submitting ## Who can review?	1 year ago
Eugene Yurtsev	80558b5b27	Add workflow for testing with all deps (#4410 ) # Add action to test with all dependencies installed PR adds a custom action for setting up poetry that allows specifying a cache key: https://github.com/actions/setup-python/issues/505#issuecomment-1273013236 This makes it possible to run 2 types of unit tests: (1) unit tests with only core dependencies (2) unit tests with extended dependencies (e.g., those that rely on an optional pdf parsing library) As part of this PR, we're moving some pdf parsing tests into the unit-tests section and making sure that these unit tests get executed when running with extended dependencies.	1 year ago
Ehsan M. Kermani	5d0674fb46	Use a consistent poetry version everywhere (#3250 ) Fixes the discrepancy of poetry version in Dockerfile and the GAs	1 year ago
Harrison Chase	012a6dfb16	Harrison/makefile (#1033 ) Co-authored-by: blob42 <contact@blob42.xyz> Co-authored-by: blob42 <spike@w530>	1 year ago
Steven Hoelscher	a5999351cf	chore: add release workflow (#360 ) Adds release workflow that (1) creates a GitHub release and (2) publishes built artifacts to PyPI Release Workflow 1. Checkout `master` locally and cut a new branch 1. Run `poetry version <rule>` to version bump (e.g., `poetry version patch`) 1. Commit changes and push to remote branch 1. Ensure all quality check workflows pass 1. Explicitly tag PR with `release` label 1. Merge to mainline At this point, a release workflow should be triggered because: * The PR is closed, targeting `master`, and merged * `pyproject.toml` has been detected as modified * The PR had a `release` label The workflow will then proceed to build the artifacts, create a GitHub release with release notes and uploaded artifacts, and publish to PyPI. Example Workflow run: https://github.com/shoelsch/langchain/actions/runs/3711037455/jobs/6291076898 Example Releases: https://github.com/shoelsch/langchain/releases -- Note, this workflow is looking for the `PYPI_API_TOKEN` secret, so that will need to be uploaded to the repository secrets. I tested uploading as far as hitting a permissions issue due to project ownership in Test PyPI.	1 year ago
Harrison Chase	9753bccc71	Feature: linkcheck-action (#534 ) (#542 ) - Add support for local build and linkchecking of docs - Add GitHub Action to automatically check links before prior to publication - Minor reformat of Contributing readme - Fix existing broken links Co-authored-by: Hunter Gerlach <hunter@huntergerlach.com> Co-authored-by: Hunter Gerlach <HunterGerlach@users.noreply.github.com> Co-authored-by: Hunter Gerlach <hunter@huntergerlach.com>	2 years ago
Hunter Gerlach	482611f426	unit test / code coverage improvements (#322 ) This PR has two contributions: 1. Add test for when stop token is found in middle of text 2. Add code coverage tooling and instructions - Add pytest-cov via poetry - Add necessary config files - Add new make instruction for `coverage` - Update README with coverage guidance - Update minor README formatting/spelling Co-authored-by: Hunter Gerlach <hunter@huntergerlach.com>	2 years ago
Christian Clauss	2fbb152386	Add Python 3.11 to the testing (#324 )	2 years ago
Christian Clauss	d946be2f3d	Add Python 3.11 to the testing (#323 )	2 years ago
Harrison Chase	3c1c7ba672	update branch name in gha (#274 )	2 years ago
Steven Hoelscher	98fb19b535	chore: use poetry as dependency manager (#242 ) * Adopts [Poetry](https://python-poetry.org/) as a dependency manager * Introduces dependency version requirements * Deprecates Python 3.7 support TODO - [x] Update developer guide - [x] Add back `playwright`, `manifest-ml`, and `jupyter` to dependency group Not Doing => Fast Follow - Investigate single source for version, perhaps relying on GitHub tags and [tackling this issue](https://github.com/hwchase17/langchain/issues/26)	2 years ago
Predrag Gruevski	1a95252f00	Use `pull_request` not `pull_request_target` in GitHub Actions. (#139 ) `pull_request` runs on the merge commit between the opened PR and the target branch where the PR is to be merged — `master` in this case. This is desirable because that way the new changes get linted and tested. The existing `pull_request_target` specifier causes lint and test to run _on the target branch itself_ (i.e. `master` in this case). That way the new code in the PR doesn't get linted and tested at all. This can also lead to security vulnerabilities, as described in the GitHub docs: ![image](https://user-images.githubusercontent.com/2348618/201735153-c5dd0c03-2490-45e9-b7f9-f0d47eb0109f.png) Screenshot from here: https://docs.github.com/en/actions/using-workflows/events-that-trigger-workflows#pull_request_target Link from the screenshot: https://securitylab.github.com/research/github-actions-preventing-pwn-requests/	2 years ago
Harrison Chase	6cff2837bb	Harrison/fix lint (#80 )	2 years ago
Harrison Chase	9679bdc34c	run workflows on forks (#78 ) per https://stackoverflow.com/questions/58221321/is-github-actions-available-on-forked-repositories	2 years ago
Harrison Chase	18aeb72012	initial commit	2 years ago

44 Commits (ade683c589f73ac5769cdf8d811db9c9f1d75ee4)