Human Review

Human Review is the quality control gate where expert reviewers verify AI screening decisions. EviSyn ensures that no paper is included or excluded without human approval.

​

The Review Dashboard

Navigate to Human Review from your project dashboard. The stats bar shows:

• Total papers to review
• Screened — how many have been through AI screening
• Included (green) — papers approved for inclusion
• Excluded (red) — papers confirmed for exclusion
• Doubt (orange) — papers needing closer attention
• Pending — papers awaiting human decision

​

Reviewing Papers

Each paper shows the AI’s recommendation alongside your review controls:

​

Making Decisions

For each paper, you can:

• Include — Confirm the paper should be in your review
• Exclude — Confirm the paper should be removed
• Doubt — Flag for further discussion

​

Filtering

Use the tabs to filter by category:

• All — See everything
• Included — Only AI-included papers
• Excluded — Only AI-excluded papers
• Doubt — Only uncertain papers (review these first)

​

Blinded Review Mode

For methodological rigor, EviSyn supports blinded reviewer groups:

• Multiple reviewer groups (R1, R2, R3, etc.) can be created
• Each group reviews papers independently — without seeing AI decisions or other groups’ choices
• The system tracks conflicts (disagreements between groups)
• A senior reviewer resolves conflicts

​

Inter-Rater Agreement

EviSyn automatically calculates Cohen’s kappa — the standard statistical measure of agreement between reviewers. This metric is:

• Required for publication in most systematic review journals
• Automatically computed when 2+ reviewer groups exist
• Available in the review dashboard

​

Finalizing the Review

Once all papers have human decisions and all conflicts are resolved, click Review Completed to finalize.

​

What’s Next?

After finalizing, proceed to Full Paper Download & Full-Text Screening.