Update the section token count from 1,000 to 1,600

This resolves the mismatch between the values in markdown cell and code cell.
pull/350/head
Eugene Yan 1 year ago committed by GitHub
parent 0d006b2cf2
commit 4f67e0cf43
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -411,7 +411,7 @@
"- Shorter sections allow more sections to be retrieved, which may help with recall\n",
"- Overlapping sections may help prevent answers from being cut by section boundaries\n",
"\n",
"Here, we'll use a simple approach and limit sections to 1,000 tokens each, recursively halving any sections that are too long. To avoid cutting in the middle of useful sentences, we'll split along paragraph boundaries when possible."
"Here, we'll use a simple approach and limit sections to 1,600 tokens each, recursively halving any sections that are too long. To avoid cutting in the middle of useful sentences, we'll split along paragraph boundaries when possible."
]
},
{

Loading…
Cancel
Save