Update the section token count from 1,000 to 1,600

This resolves the mismatch between the values in markdown cell and code cell.
This commit is contained in:
Eugene Yan 2023-04-15 13:01:02 -07:00 committed by GitHub
parent 1b0ae90837
commit fea69be4cd

View File

@ -411,7 +411,7 @@
"- Shorter sections allow more sections to be retrieved, which may help with recall\n",
"- Overlapping sections may help prevent answers from being cut by section boundaries\n",
"\n",
"Here, we'll use a simple approach and limit sections to 1,000 tokens each, recursively halving any sections that are too long. To avoid cutting in the middle of useful sentences, we'll split along paragraph boundaries when possible."
"Here, we'll use a simple approach and limit sections to 1,600 tokens each, recursively halving any sections that are too long. To avoid cutting in the middle of useful sentences, we'll split along paragraph boundaries when possible."
]
},
{