Archives/reflexion-human-eval
2
0
Fork 0
mirror of https://github.com/GammaTauAI/reflexion-human-eval synced 2024-11-11 19:10:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

run testacc

Browse Source
This commit is contained in:
elleven11 2023-04-11 20:15:44 -04:00
parent b0a37fd732
commit e9407a6725
1 changed files with 10 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

10
run_testacc.sh Executable file
View File

@ -0,0 +1,10 @@
python main.py \
--run_name "testacc_humaneval_py3" \
--root_dir "root" \
--dataset_path ./benchmarks/humaneval-py.jsonl.gz \
--strategy "test-acc" \
--language "py" \
--model "gpt-4" \
--pass_at_k "1" \
--max_iters "1" \
--verbose