EviSyn supports team-based reviews with role-based access control and blinded reviewer groups for methodological rigor.
Team Management
Your team name appears in the top navigation bar. Team features include:
Team Roles
| Role | Permissions |
|---|
| Admin | Full access: create/delete projects, manage team members, billing |
| Lead Reviewer | Create projects, manage screening, resolve conflicts, finalize reviews |
| Reviewer | Screen papers, review extractions, participate in quality assessment |
Adding Team Members
- Navigate to Team settings from the top navigation
- Invite members by email
- Assign a role (Admin, Lead Reviewer, or Reviewer)
Reviewer Groups (Blinded Review)
For reviews requiring independent, blinded assessment:
Setting Up Blinded Review
- Create 2+ Reviewer Groups (e.g., Group A, Group B)
- Assign reviewers to each group
- Enable blinded mode — group members cannot see:
- AI screening decisions
- Other groups’ decisions
- Overall screening statistics
Conflict Resolution Workflow
When blinded review is enabled:
- Each group reviews all papers independently
- EviSyn automatically identifies conflicts (papers where groups disagree)
- Conflicts are flagged in the Human Review dashboard
- A designated Lead Reviewer resolves each conflict with a final decision
- The resolution and reasoning are logged in the audit trail
Inter-Rater Agreement
EviSyn automatically calculates Cohen’s kappa when 2+ reviewer groups exist:
| Kappa Value | Interpretation |
|---|
| < 0.20 | Poor agreement |
| 0.21-0.40 | Fair |
| 0.41-0.60 | Moderate |
| 0.61-0.80 | Substantial |
| 0.81-1.00 | Almost perfect |
Project-Level Collaboration
Each project tracks:
- Which team member made each screening decision
- Who performed each data extraction
- Who confirmed quality assessments
- Complete activity log with user attribution
All collaborative actions are attributed to the specific user in the audit trail, ensuring accountability and traceability.
