langchain/docs
Emilien Chauvet c3d4126eb1
community[minor]: add user agent for web scraping loaders (#22480)
**Description:** This PR adds a `USER_AGENT` env variable that is to be
used for web scraping. It creates a util to get that user agent and uses
it in the classes used for scraping in [this piece of
doc](https://python.langchain.com/v0.1/docs/use_cases/web_scraping/).
Identifying your scraper is considered a good politeness practice, this
PR aims at easing it.
**Issue:** `None`
**Dependencies:** `None`
**Twitter handle:** `None`
2024-06-05 15:20:34 +00:00
..
api_reference docs: fix api ref link generation (#22438) 2024-06-04 12:09:22 -07:00
data 👥 Update LangChain people data (#22388) 2024-06-01 07:36:45 -07:00
docs community[minor]: add user agent for web scraping loaders (#22480) 2024-06-05 15:20:34 +00:00
scripts docs: fix api ref link generation (#22438) 2024-06-04 12:09:22 -07:00
src docs: add Microsoft Azure to ChatModelTabs (#22367) 2024-06-03 10:19:00 -04:00
static docs[patch]: Add robots.txt and root sitemap (#22492) 2024-06-04 11:26:40 -07:00
.gitignore infra: cleanup docs build (#21134) 2024-05-01 17:34:05 -07:00
.yarnrc.yml docs[minor]: Add thumbs up/down to all docs pages (#18526) 2024-03-04 15:14:28 -08:00
babel.config.js
docusaurus.config.js docs: link GH org (#22308) 2024-05-30 00:17:59 -07:00
Makefile docs: edit links, direct for notebooks (#22051) 2024-05-24 19:44:46 +00:00
package.json docs: v0.2 docs in master (#21438) 2024-05-08 12:29:59 -07:00
README.md
sidebars.js docs: make llm cache its own section (#22301) 2024-05-30 00:17:33 -07:00
vercel_build.sh infra: use nbconvert for docs build (#21135) 2024-05-07 12:30:17 -07:00
vercel_requirements.txt docs: remove postgres from docs build (#21847) 2024-05-17 15:36:35 -07:00
vercel.json docs[patch]: Add robots.txt and root sitemap (#22492) 2024-06-04 11:26:40 -07:00
yarn.lock docs: v0.2 docs in master (#21438) 2024-05-08 12:29:59 -07:00

LangChain Documentation

For more information on contributing to our documentation, see the Documentation Contributing Guide