| Property | Options | Score for Match | Score for No Match | Question | Column Header |
|---|
| Method | Resourcing | Complexity | Time Commitment | Total Match |
|---|---|---|---|---|
| Meta-analysis | Normally requires 2+ people for interrater reliability | Moderate complexity | High (6+ months) | 0 |
| Systematic Review | Requires multiple researchers | High complexity | High (12+ months) | 0 |
| Scoping Review | Can be conducted by a single researcher | Low complexity | Moderate (3-6 months) | 0 |
| Rapid Review | Can be conducted by a small team | Moderate complexity | Low (1-3 months) | 0 |
| Critical Review | Typically requires expert knowledge but fewer researchers | High complexity | Moderate (3-6 months) | 0 |
flowchart TD
subgraph types
direction LR
%% Overarching categories
ES["Approaches to Evidence Synthesis"]
ES --> Q["More configurative, interpretative, or/and hypothesis developing"]
ES --> Co["More confirmatory, consolidatory, or/and hypothesis testing"]
%% Detailed types of reviews under Confirmatory
Co --> A[fa:fa-ruler-combined Systematic Reviews]:::highlight-node
Co --> B[fa:fa-calculator Meta-Analysis]:::highlight-node
Co --> C[fa:fa-network-wired Scoping Review]:::highlight-node
Co --> E[fa:fa-hourglass-start Rapid Review]:::highlight-node
Co --> G[fa:fa-archive Umbrella Review]:::highlight-node
Co --> H[fa:fa-theater-masks Bibliometric Analysis]:::highlight-node
Co --> I[far:fa-compass State of the Art Review]:::highlight-node
Co --> J[fa:fa-route Evidence Maps]:::highlight-node
Co --> K[fa:fa-list Annotated Bibliographies]:::highlight-node
Co --> L[fa:fa-scale-unbalanced Critically Appraised Topic]:::highlight-node
%% Detailed types of reviews under Configurative
Q --> F[fa:fa-gears Realist Evidence Synthesis]:::highlight-node
Q --> M["far:fa-comments Qualitative Evidence Synthesis (QES)"]:::highlight-node
Q --> D[fa:fa-quote-left Narrative Review]:::highlight-node
Q --> N[far:fa-share-from-square Materials Review]:::highlight-node
M --> BF[fa:fa-puzzle-piece Including framework-synthesis methods such as best-fit and Rapid Best Fit]:::highlight-node
Q --> O[fa:fa-map]:::highlight-node
%% Duration and resourcing required
A --> A1["fa:fa-clock 18 months+ fa:fa-person fa:fa-repeat fa:fa-person 2+ personnel"]:::highlight-node
B --> B1["fa:fa-clock 18 months+ fa:fa-person fa:fa-repeat fa:fa-person 2+ personnel"]:::highlight-node
C --> C1["fa:fa-clock 2 months+" fa:fa-person 1+ personnel]:::highlight-node
D --> D1["fa:fa-clock 3 months+ fa:fa-person 1+ personnel"]:::highlight-node
E --> E1["fa:fa-clock 2 months+" fa:fa-person 1+ personnel]:::highlight-node
F --> F1["fa:fa-clock 12 months+"]:::highlight-node
G --> G1["fa:fa-clock 6 months+"]:::highlight-node
H --> H1["fa:fa-clock 6 months+"]:::highlight-node
I --> I1["fa:fa-clock 6 months+"]:::highlight-node
J --> J1["fa:fa-clock 6 months+" fa:fa-person 1+ personnel]:::highlight-node
K --> K1["fa:fa-clock 4 months+" fa:fa-person 1+ personnel]:::highlight-node
L --> L1["fa:fa-clock 4 months+" fa:fa-person 1+ personnel]:::highlight-node
M --> M1["fa:fa-clock 9 months+"]:::highlight-node
N --> N1["fa:fa-clock 3 months+ fa:fa-person 1+ personnel"]:::highlight-node
%% SALSA - Search, Appraisal, Synthesis, and Analysis
%% Revised SALSA - Search, Appraisal, Synthesis, and Analysis
A1 --> |"Components"| A2["Search: Exhaustive\\nAppraisal: Quality determines inclusion/exclusion\\nSynthesis: Narrative + Tabular\\nAnalysis: Known evidence; Recommendations for practice"]:::highlight-node
B1 --> |"Components"| B2["Search: Exhaustive\\nAppraisal: Quality determines inclusion/exclusion\\nSynthesis: Graphical & Tabular\\nAnalysis: Numerical effect size"]:::highlight-node
C1 --> |"Components"| C2["Search: Comprehensive within constraints\\nAppraisal: No formal quality assessment\\nSynthesis: Graphical & Tabular\\nAnalysis: Characterizes literature quantity & quality"]:::highlight-node
D1 --> |"Components"| D2["Search: May be comprehensive\\nAppraisal: No formal quality assessment\\nSynthesis: Narrative\\nAnalysis: Conceptual innovation, theory derivation"]:::highlight-node
E1 --> |"Components"| E2["Search: Time-constrained\\nAppraisal: Quality assessment\\nSynthesis: Narrative & Tabular\\nAnalysis: Literature quantity & direction of effect"]:::highlight-node
F1 --> |"Components"| F2["Search: Theory identification\\nAppraisal: Contextual analysis\\nSynthesis: Qualitative & Narrative\\nAnalysis: Mechanism explanation"]:::highlight-node
G1 --> |"Components"| G2["Search: Identifies component reviews\\nAppraisal: Reviews or studies\\nSynthesis: Graphical & Tabular\\nAnalysis: Recommendations for practice & research"]:::highlight-node
H1 --> |"Components"| H2["Search: Citation mapping\\nAppraisal: Network analysis\\nSynthesis: Graphical\\nAnalysis: Research trends and connections"]:::highlight-node
I1 --> |"Components"| I2["Search: Comprehensive of current literature\\nAppraisal: No formal quality assessment\\nSynthesis: Narrative + Tabular\\nAnalysis: State of knowledge & future priorities"]:::highlight-node
J1 --> |"Components"| J2["Search: Broad scoping\\nAppraisal: Evidence mapping\\nSynthesis: Graphical & Tabular\\nAnalysis: Gaps identification"]:::highlight-node
K1 --> |"Components"| K2["Search: Source selection\\nAppraisal: Annotations\\nSynthesis: Summarization\\nAnalysis: Key contributions identification"]:::highlight-node
L1 --> |"Components"| L2["Search: Critical appraisal\\nAppraisal: Relevance assessment\\nSynthesis: Summary of findings\\nAnalysis: Relevance to context"]:::highlight-node
%% Types of output and their purpose for stakeholders
A2 --> A3[fa:fa-users-involved Systematic Reviews typically result in comprehensive guidelines, often in consultation with experts and stakeholders at the synthesis stage. Comprehensive approach, with low risk of bias.]:::highlight-node
B2 --> B3[fa:fa-users-together Meta-Analysis outputs often involve aggregated data interpretations, with stakeholders providing feedback on applicability. Comprehensive approach, with low risk of bias.]:::highlight-node
C2 --> C3[fa:fa-users-discuss Scoping Reviews map evidence with some stakeholder input at initial stages for relevance, not comprehensive, but transparent approach, with some risk of bias.]:::highlight-node
D2 --> D3[fa:fa-users-share Narrative Reviews provide an overview of trends, generally with minimal stakeholder engagement. Non-comprehnsive approach, interpretative.]:::highlight-node
E2 --> E3[fa:fa-users-quick Rapid Reviews focus on quickly informing policy or practice, involving stakeholders to prioritize evidence. Non-comprehensive, but transparent approach, bias limited.]:::highlight-node
F2 --> F3[fa:fa-users-gear Realist Evidence Synthesis engages stakeholders to identify the problem space and theory of change and adapt the review focus iteratively.]:::highlight-node
G2 --> G3[fa:fa-users-consolidate Umbrella Reviews synthesize findings from multiple reviews, often consulting stakeholders to interpret results.]:::highlight-node
H2 --> H3[fa:fa-users-networks Bibliometric Analysis maps research networks and trends, usually with expert consultation.]:::highlight-node
I2 --> I3[fa:fa-users-overview State of the Art Reviews summarize leading ideas with stakeholder engagement mainly in initial scoping.]:::highlight-node
J2 --> J3[fa:fa-users-map Evidence Maps provide visual summaries of evidence, sometimes with stakeholder feedback on gaps.]:::highlight-node
K2 --> K3[fa:fa-users-annotate Annotated Bibliographies collect key sources, occasionally with stakeholder suggestions for inclusion.]:::highlight-node
L2 --> L3[fa:fa-users-appraise Critically Appraised Topics involve stakeholders in the appraisal process to ensure relevance and impact.]:::highlight-node
M2 --> M3[fa:fa-users-qualitative Qualitative Evidence Synthesis gathers qualitative insights with stakeholder collaboration to validate findings.]:::highlight-node
N2 --> N3[fa:fa-users-materials Materials Review organizes and classifies materials with input from stakeholders on categorization.]:::highlight-node
%% Example questions each review type answers
A3 --> |"Questions"| A4["fa:fa-question-circle What is the effect size of interventions?\\nHow effective is treatment X for condition Y?"]:::highlight-node
B3 --> |"Questions"| B4["fa:fa-question-circle How effective is treatment X for condition Y?\\nWhat is the combined effect size?"]:::highlight-node
C3 --> |"Questions"| C4["fa:fa-question-circle What is the extent of research on topic Z?\\nWhat types of interventions exist for condition A?"]:::highlight-node
D3 --> |"Questions"| D4["fa:fa-question-circle What are the general trends in research on X?\\nHow have views on Y evolved over time?"]:::highlight-node
E3 --> |"Questions"| E4["fa:fa-question-circle What is the current evidence on intervention X?\\nWhat are the immediate implications for policy Y?"]:::highlight-node
F3 --> |"Questions"| F4["fa:fa-question-circle How do interventions work in different contexts?\\nWhat mechanisms explain the success of program X?"]:::highlight-node
G3 --> |"Questions"| G4["fa:fa-question-circle What do existing reviews say about intervention X?\\nWhat are the overarching findings across reviews on topic Y?"]:::highlight-node
H3 --> |"Questions"| H4["fa:fa-question-circle Who is working on what topics?\\nHow are different studies connected?"]:::highlight-node
I3 --> |"Questions"| I4["fa:fa-question-circle What is the current state of research on X?\\nWhat are the leading thoughts and gaps?"]:::highlight-node
J3 --> |"Questions"| J4["fa:fa-question-circle What is the distribution of evidence on topic Y?\\nWhere are the gaps in current research?"]:::highlight-node
K3 --> |"Questions"| K4["fa:fa-question-circle What are the key sources on topic X?\\nWhat do they contribute to the understanding of Y?"]:::highlight-node
L3 --> |"Questions"| L4["fa:fa-question-circle What are the critical findings on topic X?\\nHow relevant are these findings for context Y?"]:::highlight-node
M3 --> |"Questions"| M4["fa:fa-question-circle What are the qualitative insights on X?\\nHow do themes emerge across different studies?"]:::highlight-node
N3 --> |"Questions"| N4["fa:fa-question-circle What materials exist on topic X?\\nHow can these materials be classified and organized?"]:::highlight-node
%% Styles and possible fontawesome icons to use
classDef reviewStyle fill:#f9f,stroke:#333,stroke-width:2px;
classDef characteristicsStyle fill:#ccf,stroke:#333,stroke-width:1px;
class highlight-node fill:#ccf,stroke:#333,stroke-width:1px;
class A,B,C,D,E,F,G,H,I,J,K,L,M,N,BF reviewStyle;
class A1,B1,C1,D1,E1,F1,G1,H1,I1,J1,K1,L1,M1,N1 characteristicsStyle;
class A2,B2,C2,D2,E2,F2,G2,H2,I2,J2,K2,L2,M2,N2 characteristicsStyle;
class A3,B3,C3,D3,E3,F3,G3,H3,I3,J3,K3,L3,M3,N3 characteristicsStyle;
end
types ~~~ meta
subgraph meta
note["fa:fa-copyright Issues may arise with substantive parts"]
grey["far:fa-newspaper consider if grey literature included"]
other["fab:fa-creative-commons fab:fa-creative-commons-by"]
end