Rules Table

Property Options Score for Match Score for No Match Question Column Header
Method Resourcing Complexity Time Commitment Total Match
Meta-analysis Normally requires 2+ people for interrater reliability Moderate complexity High (6+ months) 0
Systematic Review Requires multiple researchers High complexity High (12+ months) 0
Scoping Review Can be conducted by a single researcher Low complexity Moderate (3-6 months) 0
Rapid Review Can be conducted by a small team Moderate complexity Low (1-3 months) 0
Critical Review Typically requires expert knowledge but fewer researchers High complexity Moderate (3-6 months) 0
flowchart TD subgraph types direction LR %% Overarching categories ES["Approaches to Evidence Synthesis"] ES --> Q["More configurative, interpretative, or/and hypothesis developing"] ES --> Co["More confirmatory, consolidatory, or/and hypothesis testing"] %% Detailed types of reviews under Confirmatory Co --> A[fa:fa-ruler-combined Systematic Reviews]:::highlight-node Co --> B[fa:fa-calculator Meta-Analysis]:::highlight-node Co --> C[fa:fa-network-wired Scoping Review]:::highlight-node Co --> E[fa:fa-hourglass-start Rapid Review]:::highlight-node Co --> G[fa:fa-archive Umbrella Review]:::highlight-node Co --> H[fa:fa-theater-masks Bibliometric Analysis]:::highlight-node Co --> I[far:fa-compass State of the Art Review]:::highlight-node Co --> J[fa:fa-route Evidence Maps]:::highlight-node Co --> K[fa:fa-list Annotated Bibliographies]:::highlight-node Co --> L[fa:fa-scale-unbalanced Critically Appraised Topic]:::highlight-node %% Detailed types of reviews under Configurative Q --> F[fa:fa-gears Realist Evidence Synthesis]:::highlight-node Q --> M["far:fa-comments Qualitative Evidence Synthesis (QES)"]:::highlight-node Q --> D[fa:fa-quote-left Narrative Review]:::highlight-node Q --> N[far:fa-share-from-square Materials Review]:::highlight-node M --> BF[fa:fa-puzzle-piece Including framework-synthesis methods such as best-fit and Rapid Best Fit]:::highlight-node Q --> O[fa:fa-map]:::highlight-node %% Duration and resourcing required A --> A1["fa:fa-clock 18 months+ fa:fa-person fa:fa-repeat fa:fa-person 2+ personnel"]:::highlight-node B --> B1["fa:fa-clock 18 months+ fa:fa-person fa:fa-repeat fa:fa-person 2+ personnel"]:::highlight-node C --> C1["fa:fa-clock 2 months+" fa:fa-person 1+ personnel]:::highlight-node D --> D1["fa:fa-clock 3 months+ fa:fa-person 1+ personnel"]:::highlight-node E --> E1["fa:fa-clock 2 months+" fa:fa-person 1+ personnel]:::highlight-node F --> F1["fa:fa-clock 12 months+"]:::highlight-node G --> G1["fa:fa-clock 6 months+"]:::highlight-node H --> H1["fa:fa-clock 6 months+"]:::highlight-node I --> I1["fa:fa-clock 6 months+"]:::highlight-node J --> J1["fa:fa-clock 6 months+" fa:fa-person 1+ personnel]:::highlight-node K --> K1["fa:fa-clock 4 months+" fa:fa-person 1+ personnel]:::highlight-node L --> L1["fa:fa-clock 4 months+" fa:fa-person 1+ personnel]:::highlight-node M --> M1["fa:fa-clock 9 months+"]:::highlight-node N --> N1["fa:fa-clock 3 months+ fa:fa-person 1+ personnel"]:::highlight-node %% SALSA - Search, Appraisal, Synthesis, and Analysis %% Revised SALSA - Search, Appraisal, Synthesis, and Analysis A1 --> |"Components"| A2["Search: Exhaustive\\nAppraisal: Quality determines inclusion/exclusion\\nSynthesis: Narrative + Tabular\\nAnalysis: Known evidence; Recommendations for practice"]:::highlight-node B1 --> |"Components"| B2["Search: Exhaustive\\nAppraisal: Quality determines inclusion/exclusion\\nSynthesis: Graphical & Tabular\\nAnalysis: Numerical effect size"]:::highlight-node C1 --> |"Components"| C2["Search: Comprehensive within constraints\\nAppraisal: No formal quality assessment\\nSynthesis: Graphical & Tabular\\nAnalysis: Characterizes literature quantity & quality"]:::highlight-node D1 --> |"Components"| D2["Search: May be comprehensive\\nAppraisal: No formal quality assessment\\nSynthesis: Narrative\\nAnalysis: Conceptual innovation, theory derivation"]:::highlight-node E1 --> |"Components"| E2["Search: Time-constrained\\nAppraisal: Quality assessment\\nSynthesis: Narrative & Tabular\\nAnalysis: Literature quantity & direction of effect"]:::highlight-node F1 --> |"Components"| F2["Search: Theory identification\\nAppraisal: Contextual analysis\\nSynthesis: Qualitative & Narrative\\nAnalysis: Mechanism explanation"]:::highlight-node G1 --> |"Components"| G2["Search: Identifies component reviews\\nAppraisal: Reviews or studies\\nSynthesis: Graphical & Tabular\\nAnalysis: Recommendations for practice & research"]:::highlight-node H1 --> |"Components"| H2["Search: Citation mapping\\nAppraisal: Network analysis\\nSynthesis: Graphical\\nAnalysis: Research trends and connections"]:::highlight-node I1 --> |"Components"| I2["Search: Comprehensive of current literature\\nAppraisal: No formal quality assessment\\nSynthesis: Narrative + Tabular\\nAnalysis: State of knowledge & future priorities"]:::highlight-node J1 --> |"Components"| J2["Search: Broad scoping\\nAppraisal: Evidence mapping\\nSynthesis: Graphical & Tabular\\nAnalysis: Gaps identification"]:::highlight-node K1 --> |"Components"| K2["Search: Source selection\\nAppraisal: Annotations\\nSynthesis: Summarization\\nAnalysis: Key contributions identification"]:::highlight-node L1 --> |"Components"| L2["Search: Critical appraisal\\nAppraisal: Relevance assessment\\nSynthesis: Summary of findings\\nAnalysis: Relevance to context"]:::highlight-node %% Types of output and their purpose for stakeholders A2 --> A3[fa:fa-users-involved Systematic Reviews typically result in comprehensive guidelines, often in consultation with experts and stakeholders at the synthesis stage. Comprehensive approach, with low risk of bias.]:::highlight-node B2 --> B3[fa:fa-users-together Meta-Analysis outputs often involve aggregated data interpretations, with stakeholders providing feedback on applicability. Comprehensive approach, with low risk of bias.]:::highlight-node C2 --> C3[fa:fa-users-discuss Scoping Reviews map evidence with some stakeholder input at initial stages for relevance, not comprehensive, but transparent approach, with some risk of bias.]:::highlight-node D2 --> D3[fa:fa-users-share Narrative Reviews provide an overview of trends, generally with minimal stakeholder engagement. Non-comprehnsive approach, interpretative.]:::highlight-node E2 --> E3[fa:fa-users-quick Rapid Reviews focus on quickly informing policy or practice, involving stakeholders to prioritize evidence. Non-comprehensive, but transparent approach, bias limited.]:::highlight-node F2 --> F3[fa:fa-users-gear Realist Evidence Synthesis engages stakeholders to identify the problem space and theory of change and adapt the review focus iteratively.]:::highlight-node G2 --> G3[fa:fa-users-consolidate Umbrella Reviews synthesize findings from multiple reviews, often consulting stakeholders to interpret results.]:::highlight-node H2 --> H3[fa:fa-users-networks Bibliometric Analysis maps research networks and trends, usually with expert consultation.]:::highlight-node I2 --> I3[fa:fa-users-overview State of the Art Reviews summarize leading ideas with stakeholder engagement mainly in initial scoping.]:::highlight-node J2 --> J3[fa:fa-users-map Evidence Maps provide visual summaries of evidence, sometimes with stakeholder feedback on gaps.]:::highlight-node K2 --> K3[fa:fa-users-annotate Annotated Bibliographies collect key sources, occasionally with stakeholder suggestions for inclusion.]:::highlight-node L2 --> L3[fa:fa-users-appraise Critically Appraised Topics involve stakeholders in the appraisal process to ensure relevance and impact.]:::highlight-node M2 --> M3[fa:fa-users-qualitative Qualitative Evidence Synthesis gathers qualitative insights with stakeholder collaboration to validate findings.]:::highlight-node N2 --> N3[fa:fa-users-materials Materials Review organizes and classifies materials with input from stakeholders on categorization.]:::highlight-node %% Example questions each review type answers A3 --> |"Questions"| A4["fa:fa-question-circle What is the effect size of interventions?\\nHow effective is treatment X for condition Y?"]:::highlight-node B3 --> |"Questions"| B4["fa:fa-question-circle How effective is treatment X for condition Y?\\nWhat is the combined effect size?"]:::highlight-node C3 --> |"Questions"| C4["fa:fa-question-circle What is the extent of research on topic Z?\\nWhat types of interventions exist for condition A?"]:::highlight-node D3 --> |"Questions"| D4["fa:fa-question-circle What are the general trends in research on X?\\nHow have views on Y evolved over time?"]:::highlight-node E3 --> |"Questions"| E4["fa:fa-question-circle What is the current evidence on intervention X?\\nWhat are the immediate implications for policy Y?"]:::highlight-node F3 --> |"Questions"| F4["fa:fa-question-circle How do interventions work in different contexts?\\nWhat mechanisms explain the success of program X?"]:::highlight-node G3 --> |"Questions"| G4["fa:fa-question-circle What do existing reviews say about intervention X?\\nWhat are the overarching findings across reviews on topic Y?"]:::highlight-node H3 --> |"Questions"| H4["fa:fa-question-circle Who is working on what topics?\\nHow are different studies connected?"]:::highlight-node I3 --> |"Questions"| I4["fa:fa-question-circle What is the current state of research on X?\\nWhat are the leading thoughts and gaps?"]:::highlight-node J3 --> |"Questions"| J4["fa:fa-question-circle What is the distribution of evidence on topic Y?\\nWhere are the gaps in current research?"]:::highlight-node K3 --> |"Questions"| K4["fa:fa-question-circle What are the key sources on topic X?\\nWhat do they contribute to the understanding of Y?"]:::highlight-node L3 --> |"Questions"| L4["fa:fa-question-circle What are the critical findings on topic X?\\nHow relevant are these findings for context Y?"]:::highlight-node M3 --> |"Questions"| M4["fa:fa-question-circle What are the qualitative insights on X?\\nHow do themes emerge across different studies?"]:::highlight-node N3 --> |"Questions"| N4["fa:fa-question-circle What materials exist on topic X?\\nHow can these materials be classified and organized?"]:::highlight-node %% Styles and possible fontawesome icons to use classDef reviewStyle fill:#f9f,stroke:#333,stroke-width:2px; classDef characteristicsStyle fill:#ccf,stroke:#333,stroke-width:1px; class highlight-node fill:#ccf,stroke:#333,stroke-width:1px; class A,B,C,D,E,F,G,H,I,J,K,L,M,N,BF reviewStyle; class A1,B1,C1,D1,E1,F1,G1,H1,I1,J1,K1,L1,M1,N1 characteristicsStyle; class A2,B2,C2,D2,E2,F2,G2,H2,I2,J2,K2,L2,M2,N2 characteristicsStyle; class A3,B3,C3,D3,E3,F3,G3,H3,I3,J3,K3,L3,M3,N3 characteristicsStyle; end types ~~~ meta subgraph meta note["fa:fa-copyright Issues may arise with substantive parts"] grey["far:fa-newspaper consider if grey literature included"] other["fab:fa-creative-commons fab:fa-creative-commons-by"] end