You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
langchain/langchain
Zander Chase 785502edb3
Add 'get_token_ids' method (#4784)
Let user inspect the token ids in addition to getting th enumber of tokens

---------

Co-authored-by: Zach Schillaci <40636930+zachschillaci27@users.noreply.github.com>
1 year ago
..
agents Update planner_prompt.py (#4967) 1 year ago
callbacks Streaming only final output of agent (#2483) (#4630) 1 year ago
chains preserve language in conversation retrieval (#4969) 1 year ago
chat_models Add 'get_token_ids' method (#4784) 1 year ago
cli Add logs command (#5007) 1 year ago
client Separate Runner Functions from Client (#5079) 1 year ago
docstore changed ValueError to ImportError (#5006) 1 year ago
document_loaders feat: batch multiple files in a single Unstructured API request (#4525) 1 year ago
embeddings Revert "API update: Engines -> Models (#4915)" (#5008) 1 year ago
evaluation Replace remaining usage of basellm with baselangmodel (#3981) 1 year ago
experimental Harrison/spell executor (#4914) 1 year ago
graphs Minor: Remove duplicated word in error message (#2706) 2 years ago
indexes Replace remaining usage of basellm with baselangmodel (#3981) 1 year ago
llms Add 'get_token_ids' method (#4784) 1 year ago
memory dont error on sql import (#4647) 1 year ago
output_parsers Harrison/json new line (#4646) 1 year ago
prompts fix prompt saving (#4987) 1 year ago
retrievers Add self query translator for weaviate vectorstore (#4804) 1 year ago
tools Add Spark SQL support (#4602) (#4956) 1 year ago
utilities change to type checking (#5062) 1 year ago
vectorstores PGVector logger message level (#4920) 1 year ago
__init__.py console callback verbose (#4696) 1 year ago
base_language.py Add 'get_token_ids' method (#4784) 1 year ago
cache.py FIX: GPTCache cache_obj creation loop (#4827) 1 year ago
docker-compose.yaml Update docker-compose.yaml (#3582) 1 year ago
document_transformers.py Contextual compression retriever (#2915) 1 year ago
env.py Add Environment Info to Run (#4691) 1 year ago
example_generator.py Replace remaining usage of basellm with baselangmodel (#3981) 1 year ago
formatting.py Validate `input_variables` when using `jinja2` templates (#3140) 1 year ago
input.py Bold Crumbs (#4876) 1 year ago
math_utils.py fix #3884 (#3475) 1 year ago
model_laboratory.py Harrison/improve cache (#368) 2 years ago
py.typed Add py.typed marker to package (#121) 2 years ago
python.py Move PythonRepl -> langchain.utilities (#2917) 1 year ago
requests.py fixed aiohttp.client_exceptions.ClientConnectionError: Connection closed (#2718) 2 years ago
schema.py Chatconv agent: output parser exception (#4923) 1 year ago
serpapi.py move serpapi wrapper (#1199) 2 years ago
server.py Update Tracing Walkthrough (#4760) 1 year ago
sql_database.py Support Databricks in SQLDatabase (#4702) 1 year ago
text_splitter.py Fix TextSplitter.from_tiktoken(#4361) 1 year ago
utils.py Harrison/virtual time (#4658) 1 year ago