Argument And Methodology Audit

Use this reference at depth levels 6-10 when reviewing academic, professional, research, policy, or evidence-heavy artifacts.

Toulmin Argument Checks

Check:

• Claim: the artifact states what it argues or recommends.
• Grounds: the artifact provides evidence for the claim.
• Warrant: the reasoning connecting evidence to claim is explicit.
• Backing: the warrant has support, not just assertion.
• Qualifier: the claim's scope and strength are bounded.
• Rebuttal: likely objections, exceptions, or limitations are addressed.

Common failures:

• Evidence is present but the warrant is missing.
• The conclusion is broader than the evidence.
• Counterarguments are ignored.
• A recommendation is made without decision criteria.

Methodology Fit

When empirical or statistical claims appear, check:

• The method matches the research question.
• The sample, setting, and scope are visible.
• Causal language is not used for correlational, survey, or descriptive evidence.
• Limitations are stated.
• Effect sizes, uncertainty, assumptions, and practical significance are included when relevant.

Evidence Synthesis

For literature reviews, compendia, and evidence syntheses, use PRISMA/Cochrane-inspired discipline without forcing clinical-review standards onto ordinary papers:

• Search and inclusion logic is transparent enough for the claim.
• Important omissions or competing evidence are acknowledged.
• Risk of bias or source limitations are visible.
• Selective reporting is not hidden.
• Conclusions match the strength of the evidence.