Commit Graph

52 Commits (bfd719f9d8454c69ce4fc8df2e8b4c96cb446ce3)

Author SHA1 Message Date
Harrison Chase eb903e211c
bump to 36 (#12487) 10 months ago
Bagatur c6a733802b
bump 324 and 35 (#12352) 10 months ago
Bagatur 286a29a49e
bump 322 and 34 (#12228) 10 months ago
Bagatur 963ff93476
bump 321 (#12161) 10 months ago
Bagatur 85302a9ec1
Add CI check that integration tests compile (#12090) 10 months ago
Bagatur 35c7c1f050
bump 317 (#11986) 10 months ago
Predrag Gruevski dcd0392423
Upgrade to newer black (23.10) and ruff (first 0.1.x!) versions. (#11944)
Minor lint dependency version upgrade to pick up latest functionality.

Ruff's new v0.1 version comes with lots of nice features, like
fix-safety guarantees and a preview mode for not-yet-stable features:
https://astral.sh/blog/ruff-v0.1.0
10 months ago
Bagatur ba0d729961
bump 316 (#11928) 10 months ago
Bagatur 25b1d65305
bump 315 (#11850) 11 months ago
Erick Friis 1861cc7100
General anthropic functions, steps towards experimental integration tests (#11727)
To match change in js here
https://github.com/langchain-ai/langchainjs/pull/2892

Some integration tests need a bit more work in experimental:
![Screenshot 2023-10-12 at 12 02 49
PM](https://github.com/langchain-ai/langchain/assets/9557659/262d7d22-c405-40e9-afef-669e8d585307)

Pretty sure the sqldatabase ones are an actual regression or change in
interface because it's returning a placeholder.

---------

Co-authored-by: Bagatur <baskaryan@gmail.com>
11 months ago
Bagatur 9c0584be74
bump 313 (#11718) 11 months ago
Bagatur 7232e082de
bump 312 (#11621) 11 months ago
Bagatur 53887242a1
bump 310 (#11486) 11 months ago
Bagatur 8fafa1af91 merge 11 months ago
Bagatur 8b6b8bf68c
bump 309 (#11443) 11 months ago
Predrag Gruevski c9986bc3a9
Tweak type hints to match dependency's behavior. (#11355)
Needs #11353 to merge first, and a new `langchain` to be published with
those changes.
11 months ago
Bagatur 16a80779b9
bump 307 (#11380) 11 months ago
Bagatur 8eec43ed91
bump 306 (#11289) 11 months ago
Bagatur 77c7c9ab97
bump 305 (#11224) 11 months ago
Bagatur 12fb393a43
bump 302 (#11070) 11 months ago
Bagatur aa6e6db8c7
bump 301 (#11018) 11 months ago
Bagatur 24cb5cd379
bump 298 (#10892) 11 months ago
Bagatur 46aa90062b
bump exp 19 (#10851) 11 months ago
Bagatur 0d1550da91
Bagatur/bump 295 (#10785) 11 months ago
Bagatur f7f3c02585
bump 287 (#10498) 12 months ago
olgavrou b78d672a43 merge from upstream/master 12 months ago
olgavrou 11f20cded1 move everything into experimental 12 months ago
Bagatur d2d11ccf63
bump 285 (#10373) 12 months ago
Bagatur 672907bbbb
bump 284 (#10330) 12 months ago
Tomaz Bratanic db73c9d5b5
Diffbot Graph Transformer / Neo4j Graph document ingestion (#9979)
Co-authored-by: Bagatur <baskaryan@gmail.com>
12 months ago
Bagatur 098b4aa465
bump 281 (#10189) 12 months ago
Bagatur 0e4c5dd176
bump 13 (#10130) 12 months ago
maks-operlejn-ds a8f804a618
Add data anonymizer (#9863)
### Description

The feature for anonymizing data has been implemented. In order to
protect private data, such as when querying external APIs (OpenAI), it
is worth pseudonymizing sensitive data to maintain full privacy.

Anonynization consists of two steps:

1. **Identification:** Identify all data fields that contain personally
identifiable information (PII).
2. **Replacement**: Replace all PIIs with pseudo values or codes that do
not reveal any personal information about the individual but can be used
for reference. We're not using regular encryption, because the language
model won't be able to understand the meaning or context of the
encrypted data.

We use *Microsoft Presidio* together with *Faker* framework for
anonymization purposes because of the wide range of functionalities they
provide. The full implementation is available in `PresidioAnonymizer`.

### Future works

- **deanonymization** - add the ability to reverse anonymization. For
example, the workflow could look like this: `anonymize -> LLMChain ->
deanonymize`. By doing this, we will retain anonymity in requests to,
for example, OpenAI, and then be able restore the original data.
- **instance anonymization** - at this point, each occurrence of PII is
treated as a separate entity and separately anonymized. Therefore, two
occurrences of the name John Doe in the text will be changed to two
different names. It is therefore worth introducing support for full
instance detection, so that repeated occurrences are treated as a single
object.

### Twitter handle
@deepsense_ai / @MaksOpp

---------

Co-authored-by: MaksOpp <maks.operlejn@gmail.com>
Co-authored-by: Bagatur <baskaryan@gmail.com>
1 year ago
Bagatur d6957921f0
bump 276 (#9931) 1 year ago
Bagatur 9731ce5a40
bump 273 (#9751) 1 year ago
Predrag Gruevski eee0d1d0dd
Update repository links in the package metadata. (#9454) 1 year ago
Bagatur a69d1b84f4
bump 267 (#9403) 1 year ago
Bagatur 5935767056
bump lc 246, lce 9 (#9207) 1 year ago
Harrison Chase 4d526c49ed
bump experimental to 008 (#8490) 1 year ago
Harrison Chase 2448043b84
bump and fix (#8441) 1 year ago
Bagatur 61dd92f821
bump 246 (#8410) 1 year ago
Harrison Chase ae78ef7fe6
bump experimental to 005 (#8339) 1 year ago
Bagatur 5c6dcb1960
bump 243 (#8289) 1 year ago
Bagatur 82b8d8596c
bump lc241 exp3 (#8193) 1 year ago
Bagatur 4928f7a9f5
undo bump (#8192) 1 year ago
Bagatur d5689d58ab
Bagatur/bump 241 (#8182) 1 year ago
Harrison Chase 77bf75c236
bump experimental to 002 (#8150) 1 year ago
Harrison Chase 9f3073d418
bump versions (#8129) 1 year ago
Harrison Chase aa0e69bc98
Harrison/official pre release (#8106) 1 year ago
Harrison Chase 8dcabd9205
bump releases rc0 (#8097) 1 year ago