Author Integrity, Flagging & Exclusion Framework

The UNIRANKS Open Index (OI) framework includes a dedicated integrity and anomaly detection layer designed to identify potentially unreliable, manipulated, abnormal, or suspicious author records within the global scholarly ecosystem.

The purpose of this framework is not to penalize productive researchers, but to improve data reliability, protect ranking accuracy, reduce metadata distortion, and support fair scholarly evaluation across the OI ecosystem.

Authors may be flagged, reviewed, monitored, or excluded when significant abnormal patterns, integrity concerns, or high-risk publishing behaviors are detected through automated and analytical validation mechanisms.

The framework combines productivity analysis, citation behavior, publication patterns, metadata stability, collaboration signals, and integrity indicators to support a more trustworthy and transparent research environment.

Modern scholarly databases contain millions of records aggregated from multiple indexing systems, repositories, publishers, conferences, and metadata providers.

While large-scale indexing improves accessibility and transparency, it also introduces challenges such as:

• Hyper-prolific publishing behavior
• Metadata duplication and author merging
• Artificial citation inflation
• Predatory publishing ecosystems
• Paper mill activity
• Automated or low-quality publishing patterns
• Abnormal collaboration structures
• Identity inconsistencies
• Mass-generated conference outputs
• Citation manipulation networks

The OI Integrity Framework helps reduce the impact of these anomalies on research evaluation, rankings, trust indicators, and ecosystem analytics.

Author Status Categories

Authors within the OI ecosystem may fall into one of the following categories:

Exclusion does not necessarily imply misconduct. In some cases, exclusion may result from metadata inconsistencies, author merging issues, or unresolved indexing anomalies.

1) Extreme Publication Productivity

Purpose

This indicator identifies unusually high publication volume that significantly exceeds expected scholarly production norms.

Why It Matters

Excessive publication volume may indicate:

• Metadata merging errors
• Artificial publishing behavior
• Hyper-authorship inflation
• Mass conference indexing
• Automated publication ecosystems
• Paper mill participation

Example Risk Thresholds

The framework evaluates both yearly productivity spikes and long-term publication patterns.

2) Citation-to-Work Imbalance

Purpose

This indicator evaluates whether publication quantity aligns with meaningful scholarly influence.

Why It Matters

Authors with extremely large publication portfolios but minimal citation activity may indicate:

• Low-impact mass publishing
• Artificial output generation
• Non-scholarly indexing inflation
• Weak research visibility
• Predatory publishing concentration

Example Signals

• Extremely low citations per work
• Large output with limited academic engagement
• Minimal scholarly influence despite high productivity

The framework analyzes citation quality alongside publication quantity.

3) Abnormal Productivity Spikes

Purpose

This indicator detects sudden and statistically abnormal increases in publication output.

Why It Matters

Large unexplained productivity jumps may indicate:

• Metadata corruption
• Artificial indexing activity
• Mass conference ingestion
• AI-assisted publication abuse
• Paper mill participation
• Author profile merging

Example Pattern

The system evaluates temporal consistency and productivity stability across multiple years.

4) h-index and Impact Mismatch

Purpose

This indicator evaluates whether scholarly impact reasonably aligns with publication volume.

Why It Matters

Authors with very large publication counts but extremely low impact indicators may represent:

• Low-quality publication ecosystems
• Non-influential publishing behavior
• Artificial output inflation
• Weak scholarly engagement

Example Signals

• Hundreds of publications with minimal citation depth
• Very low h-index relative to publication count
• Minimal long-term research influence

The framework evaluates balanced scholarly contribution rather than publication quantity alone.

5) Research Integrity & Reliability Indicators (RIRI)

Purpose

The RIRI framework evaluates broader research trust and reliability signals across author activity.

Why It Matters

Research quality cannot be measured through output volume alone.

The RIRI layer helps evaluate:

• Publishing reliability
• Citation integrity
• Metadata stability
• Research consistency
• Scholarly credibility
• Ecosystem trustworthiness

Areas Considered

• Productivity integrity
• Citation quality
• Collaboration behavior
• Publication consistency
• Journal trust signals
• Research stability
• Open science alignment

This framework supports a more balanced interpretation of research performance.

6) Self-Citation Analysis

Purpose

This indicator evaluates abnormal self-citation concentration.

Why It Matters

While self-citation is a normal scholarly practice, excessive self-citation may artificially inflate influence indicators.

Example Risk Signals

• Extremely high self-citation ratios
• Citation loops across repeated coauthor groups
• Citation concentration disconnected from broader scholarly adoption

The framework distinguishes healthy scholarly continuity from abnormal citation inflation patterns.

7) Journal & Source Quality Distribution

Purpose

This indicator evaluates the reliability and trust level of publication venues associated with an author.

Why It Matters

Publishing behavior concentrated in low-quality or suspicious venues may impact scholarly reliability assessments.

Example Risk Signals

• Large concentration in predatory journals
• Excessive low-quality conference outputs
• Minimal publication diversity
• Unverified or unstable publication sources

The framework analyzes publication ecosystem quality rather than relying solely on publication quantity.

8) Collaboration Network Integrity

Purpose

This indicator evaluates abnormal coauthor and collaboration structures.

Why It Matters

Artificial publishing networks often demonstrate repetitive and statistically abnormal collaboration behavior.

Example Signals

• Extremely repetitive coauthor groups
• Closed publication loops
• Unrealistic collaboration frequency
• Excessively dense publication clusters
• Repeated mass coauthorship structures

The framework helps identify possible paper mill or artificial collaboration ecosystems.

9) Retraction & Correction Signals

Purpose

This indicator evaluates the presence of retracted or corrected scholarly outputs.

Why It Matters

Retractions and corrections may indicate:

• Data integrity concerns
• Publishing reliability issues
• Ethical violations
• Scholarly quality problems

Areas Considered

• Retraction frequency
• Expressions of concern
• Major correction activity
• Integrity notices from trusted scholarly sources

The framework considers context and does not automatically penalize authors for isolated corrections.

10) Affiliation Stability Analysis

Purpose

This indicator evaluates consistency and reliability of institutional affiliations over time.

Why It Matters

Abnormal affiliation behavior may indicate:

• Metadata instability
• Author identity merging
• Artificial institutional association
• Fraudulent indexing patterns

Example Signals

• Frequent unexplained institution changes
• Simultaneous conflicting affiliations
• Cross-country inconsistencies within unrealistic timeframes

The framework helps improve author identity reliability.

11) Identity & ORCID Validation

Purpose

This indicator evaluates author identity consistency and verification strength.

Why It Matters

Reliable scholarly identity improves research transparency and metadata trust.

Positive Signals

• Verified ORCID association
• Stable publication history
• Consistent topic specialization
• Reliable institutional alignment
• Long-term authorship consistency

Risk Signals

• Fragmented author identities
• Merged profiles
• Inconsistent metadata patterns
• Unstable scholarly identity structures

The framework prioritizes identity reliability within the global research ecosystem.

12) Topic Dispersion & Discipline Consistency

Purpose

This indicator evaluates whether publication topics demonstrate realistic scholarly specialization patterns.

Why It Matters

Extreme topic dispersion across unrelated disciplines may indicate:

• Author profile merging
• Metadata corruption
• Artificial publication aggregation
• Non-specialized mass publishing behavior

Example Signals

Simultaneous publication activity across highly unrelated fields such as:

• Neurosurgery
• Civil Engineering
• Veterinary Medicine
• Quantum Physics
• Islamic Finance

The framework evaluates discipline consistency and realistic scholarly focus patterns.

Human Review & Transparency

The OI framework combines automated analytical systems with human validation processes where required.

Not all flagged records are excluded automatically.

Certain entities may undergo additional review to distinguish between:

• Legitimate high-performing researchers
• Large consortium participation
• Metadata anomalies
• Artificial publishing behavior
• Author identity conflicts

The framework is continuously refined to improve fairness, transparency, and analytical reliability.

Important Clarification

Being flagged or excluded within selected OI calculations does not automatically imply misconduct or unethical behavior.

In many cases, records may be temporarily excluded due to:

• Incomplete metadata
• Identity conflicts
• Indexing anomalies
• Unresolved publication inconsistencies
• Statistical abnormality thresholds

The objective of the framework is to support accurate, balanced, and trustworthy scholarly evaluation across the global research ecosystem.

Framework Evolution

The OI Integrity Framework will continue evolving through:

• Research integrity studies
• Metadata validation improvements
• Open scholarly ecosystem feedback
• Citation integrity analysis
• AI-assisted anomaly detection
• Publisher and indexing verification systems
• Cross-database validation models

The framework forms part of the broader UNIRANKS OI mission to improve transparency, trust, and research quality evaluation within modern scholarly ecosystems.

The UNIRANKS Open Index methodology is built around multiple interconnected indicators designed to evaluate research ecosystems from different perspectives, including scholarly impact, openness, collaboration, trust, growth, societal contribution, and ecosystem alignment.

Each indicator explores a unique dimension of research performance to provide a broader and more balanced understanding of global scholarly activity beyond traditional ranking models.

A) Core Output & Scale: 15%

Measuring the Foundation of Research Activity

Evaluate scholarly production volume, publication growth, productivity performance, and research scale across the global academic ecosystem.

Explore Core Output & Scale →

B) Impact & Excellence: 20%

Understanding Scholarly Influence and Research Recognition

Analyze citation impact, academic influence, research excellence, and the global visibility of scholarly contributions.

Explore Impact & Excellence →

C) Quality, Trust & Integrity: 15%

Evaluating Reliability and Research Credibility

Measure research trustworthiness through integrity indicators, publication quality signals, indexing standards, and scholarly reliability metrics.

Explore Quality, Trust & Integrity →

D) Open Science & Accessibility: 10%

Measuring Openness and Knowledge Accessibility

Assess open access availability, public research visibility, accessibility practices, and participation in open scholarly ecosystems.

Explore Open Science & Accessibility →

E) Collaboration & Global Reach: 15%

Mapping Research Connectivity Across Borders

Evaluate international collaboration, institutional partnerships, co-authorship networks, and global scholarly engagement.

Explore Collaboration & Global Reach →

F) Portfolio Strength & Momentum: 10%

Analyzing Research Diversity and Development Trends

Measure the breadth, sustainability, specialization, and evolving momentum of scholarly research portfolios over time.

Explore Portfolio Strength & Momentum →

G) Knowledge Transfer & Societal Influence: 10%

Measuring Research Contribution Beyond Academia

Evaluate how research supports innovation, policy development, industry engagement, education, healthcare, sustainability, and societal advancement.

Explore Knowledge Transfer & Societal Influence →

H) OI Alignment: 05%

Measuring Ecosystem Compatibility and Open Index Readiness

Assess how effectively entities align with the UNIRANKS Open Index framework, structured scholarly ecosystems, openness standards, and research connectivity models.

Explore OI Alignment →

Whether you need support, guidance, partnership information, technical assistance, or answers about our services and initiatives, our team is here to help. Reach out to us and we will respond as soon as possible.