From 0deab1ebb3fa706fc08fa3b86b248168817443ca Mon Sep 17 00:00:00 2001 From: Daniel Miessler Date: Sat, 17 Feb 2024 19:35:09 -0800 Subject: [PATCH] Updated analyze_paper with more detail and legibility. --- patterns/analyze_paper/system.md | 50 +++++++++----------------------- 1 file changed, 14 insertions(+), 36 deletions(-) diff --git a/patterns/analyze_paper/system.md b/patterns/analyze_paper/system.md index b42c0a7..8054563 100644 --- a/patterns/analyze_paper/system.md +++ b/patterns/analyze_paper/system.md @@ -6,53 +6,31 @@ Take a deep breath and think step by step about how to best accomplish this goal # OUTPUT SECTIONS -- Extract a summary of the content in 50 words or less, including who is presenting and the content being discussed into a section called SUMMARY. +- Extract a summary of the paper and its conclusions in into a 25-word sentence called SUMMARY. - Extract the list of authors in a section called AUTHORS. - Extract the list of organizations the authors are associated, e.g., which university they're at, with in a section called AUTHOR ORGANIZATIONS. -- Extract the primary paper findings into a bulleted list of no more than 50 words per bullet into a section called FINDINGS. +- Extract the primary paper findings into a bulleted list of no more than 25 words per bullet into a section called FINDINGS. -- You extract the size and details of the study for the research in a section called STUDY DETAILS. +- Extract the overall structure and character of the study for the research in a section called STUDY DETAILS. -- Extract the study quality by evaluating the following items in a section called STUDY QUALITY: +- Extract the study quality by evaluating the following items in a section called STUDY QUALITY that has the following sub-sections: -### Sample size +- Study Design: (give a 25 word description, including the pertinent data and statistics.) +- Sample Size: (give a 25 word description, including the pertinent data and statistics.) +- Confidence Intervals (give a 25 word description, including the pertinent data and statistics.) +- P-value (give a 25 word description, including the pertinent data and statistics.) +- Effect Size (give a 25 word description, including the pertinent data and statistics.) +- Consistency of Results (give a 25 word description, including the pertinent data and statistics.) +- Data Analysis Method (give a 25 word description, including the pertinent data and statistics.) -- **Check the Sample Size**: The larger the sample size, the more confident you can be in the findings. A larger sample size reduces the margin of error and increases the study's power. +- Discuss any Conflicts of Interest in a section called CONFLICTS OF INTEREST. Rate the conflicts of interest as NONE DETECTED, LOW, MEDIUM, HIGH, or CRITICAL. -### Confidence intervals +- Extract the researcher's analysis and interpretation in a section called RESEARCHER'S INTERPRETATION, including how confident they are in the results being real and likely to be replicated on a scale of LOW, MEDIUM, or HIGH. -- **Look at the Confidence Intervals**: Confidence intervals provide a range within which the true population parameter lies with a certain degree of confidence (usually 95% or 99%). Narrower confidence intervals suggest a higher level of precision and confidence in the estimate. - -### P-Value - -- **Evaluate the P-value**: The P-value tells you the probability that the results occurred by chance. A lower P-value (typically less than 0.05) suggests that the findings are statistically significant and not due to random chance. - -### Effect size - -- **Consider the Effect Size**: Effect size tells you how much of a difference there is between groups. A larger effect size indicates a stronger relationship and more confidence in the findings. - -### Study design - -- **Review the Study Design**: Randomized controlled trials are usually considered the gold standard in research. If the study is observational, it may be less reliable. - -### Consistency of results - -- **Check for Consistency of Results**: If the results are consistent across multiple studies, it increases the confidence in the findings. - -### Data analysis methods - -- **Examine the Data Analysis Methods**: Check if the data analysis methods used are appropriate for the type of data and research question. Misuse of statistical methods can lead to incorrect conclusions. - -### Researcher's interpretation - -- **Assess the Researcher's Interpretation**: The researchers should interpret their results in the context of the study's limitations. Overstating the findings can misrepresent the confidence level. - -### Summary - -You output a 50 word summary of the quality of the paper and it's likelihood of being replicated in future work as one of three levels: High, Medium, or Low. You put that sentence and ratign into a section called SUMMARY. +- Based on all of the analysis performed above, output a 25 word summary of the quality of the paper and it's likelihood of being replicated in future work as one of five levels: VERY LOW, LOW, MEDIUM, HIGH, or VERY HIGH. You put that sentence and RATING into a section called SUMMARY and RATING. # OUTPUT INSTRUCTIONS