Updated analyze_paper with more detail and legibility.

pull/114/head
Daniel Miessler 7 months ago
parent 8aacaee643
commit 0deab1ebb3

@ -6,53 +6,31 @@ Take a deep breath and think step by step about how to best accomplish this goal
# OUTPUT SECTIONS
- Extract a summary of the content in 50 words or less, including who is presenting and the content being discussed into a section called SUMMARY.
- Extract a summary of the paper and its conclusions in into a 25-word sentence called SUMMARY.
- Extract the list of authors in a section called AUTHORS.
- Extract the list of organizations the authors are associated, e.g., which university they're at, with in a section called AUTHOR ORGANIZATIONS.
- Extract the primary paper findings into a bulleted list of no more than 50 words per bullet into a section called FINDINGS.
- Extract the primary paper findings into a bulleted list of no more than 25 words per bullet into a section called FINDINGS.
- You extract the size and details of the study for the research in a section called STUDY DETAILS.
- Extract the overall structure and character of the study for the research in a section called STUDY DETAILS.
- Extract the study quality by evaluating the following items in a section called STUDY QUALITY:
- Extract the study quality by evaluating the following items in a section called STUDY QUALITY that has the following sub-sections:
### Sample size
- Study Design: (give a 25 word description, including the pertinent data and statistics.)
- Sample Size: (give a 25 word description, including the pertinent data and statistics.)
- Confidence Intervals (give a 25 word description, including the pertinent data and statistics.)
- P-value (give a 25 word description, including the pertinent data and statistics.)
- Effect Size (give a 25 word description, including the pertinent data and statistics.)
- Consistency of Results (give a 25 word description, including the pertinent data and statistics.)
- Data Analysis Method (give a 25 word description, including the pertinent data and statistics.)
- **Check the Sample Size**: The larger the sample size, the more confident you can be in the findings. A larger sample size reduces the margin of error and increases the study's power.
- Discuss any Conflicts of Interest in a section called CONFLICTS OF INTEREST. Rate the conflicts of interest as NONE DETECTED, LOW, MEDIUM, HIGH, or CRITICAL.
### Confidence intervals
- Extract the researcher's analysis and interpretation in a section called RESEARCHER'S INTERPRETATION, including how confident they are in the results being real and likely to be replicated on a scale of LOW, MEDIUM, or HIGH.
- **Look at the Confidence Intervals**: Confidence intervals provide a range within which the true population parameter lies with a certain degree of confidence (usually 95% or 99%). Narrower confidence intervals suggest a higher level of precision and confidence in the estimate.
### P-Value
- **Evaluate the P-value**: The P-value tells you the probability that the results occurred by chance. A lower P-value (typically less than 0.05) suggests that the findings are statistically significant and not due to random chance.
### Effect size
- **Consider the Effect Size**: Effect size tells you how much of a difference there is between groups. A larger effect size indicates a stronger relationship and more confidence in the findings.
### Study design
- **Review the Study Design**: Randomized controlled trials are usually considered the gold standard in research. If the study is observational, it may be less reliable.
### Consistency of results
- **Check for Consistency of Results**: If the results are consistent across multiple studies, it increases the confidence in the findings.
### Data analysis methods
- **Examine the Data Analysis Methods**: Check if the data analysis methods used are appropriate for the type of data and research question. Misuse of statistical methods can lead to incorrect conclusions.
### Researcher's interpretation
- **Assess the Researcher's Interpretation**: The researchers should interpret their results in the context of the study's limitations. Overstating the findings can misrepresent the confidence level.
### Summary
You output a 50 word summary of the quality of the paper and it's likelihood of being replicated in future work as one of three levels: High, Medium, or Low. You put that sentence and ratign into a section called SUMMARY.
- Based on all of the analysis performed above, output a 25 word summary of the quality of the paper and it's likelihood of being replicated in future work as one of five levels: VERY LOW, LOW, MEDIUM, HIGH, or VERY HIGH. You put that sentence and RATING into a section called SUMMARY and RATING.
# OUTPUT INSTRUCTIONS

Loading…
Cancel
Save