arXiv ScienceSearch

arXiv · 2608.10739

Unveiling the Predators: Contemporary Approaches to Identifying Illegitimate Open Access Journals in the Academic Publishing Ecosystem

Abstract

Predatory journals pose a significant challenge to the integrity of the Open Access (OA) publishing model by exploiting its framework for financial gain while bypassing essential editorial and peer-review standards. This study critically evaluates existing methodologies for identifying such journals, ranging from manual blacklist checks to advanced automated approaches utilizing machine learning. The analysis highlights critical limitations, including the lack of a universally accepted definition of predatory journals, over-reliance on binary classification systems (e.g., blacklists and whitelists), and issues with scalability, reliability and interpretability. To address these shortcomings, this paper introduces a novel methodology based on multivariate graph analysis. By modeling the academic publishing ecosystem as a network of interconnected entities (such as authors, articles, journals, and publishers), this approach provides broader insights into the dynamics of scholarly communication and could help identify illegitimate publishing practices by utilizing graph algorithms like centrality measures, community detection, and anomaly detection. The proposed framework aims to enhance the accuracy, scalability, and transparency of detection of illegitimate journals and publishing practices while fostering a more comprehensive understanding of the academic publishing landscape.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Robert Šamárek, Radek Martinek. 2026-08-11. Unveiling the Predators: Contemporary Approaches to Identifying Illegitimate Open Access Journals in the Academic Publishing Ecosystem. https://arxiv.org/abs/2608.10739

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Same Problem, Different Field: Cross-Domain Solution Import via Domain-Stripped Computational Fingerprints

The same underlying computational problem is solved across unrelated fields under different names: recursive Bayesian state estimation appears as a "Kalman filter" in control, "Bayesian forecasting" in pharmacokinetics, and "data assimilation" in geoscience. Topical and citation-based scientific embeddings cannot see this shared problem. We distill each paper once into a domain- and method-name-stripped faceted computational fingerprint, a free-text mechanism skeleton plus controlled computational facets. We define a tunable, facet-selectable similarity over it. The goal is solution import: surface cross-field pairs solving the same problem, so a bespoke implementation can be swapped for another field's standard, specialized solver. On a benchmark of 18 method families across 109 papers, the skeleton lifts cross-domain retrieval average precision over the abstract from 0.222 to 0.513, and the whole fingerprint reaches 0.557. Strikingly, four trained scientific embedders all fall below plain abstract+TF-IDF: they encode topical and citation similarity, the wrong signal for this task. The gain is the representation: the abstract-to-skeleton swap lifts every embedder, and the pipeline is one cached LLM call per paper plus a cheap embedder. An interventional re-skin / math-edit test shows the fingerprint tracks the computation, not the field. On a 501-paper wild corpus, known twins dominate the top of the ranking (23 of the top 30); with planted pairs excluded from the results, three blind LLM judges rate 3 of the top 5 and 8 of the top 30 pairs genuine import candidates, and 0 of 30 random ones. The human verification is the four executed imports: in one, an open standard solver reproduces a bespoke clinical dosing engine's output. We release the benchmark, the code, and the distillation prompt.

cs.DL

Benchmarking locally hosted language models for journal editorial work on a compact desktop workstation

Journals are beginning to consider language models for manuscript handling, but submitted manuscripts are unpublished, and where policy forbids sending them to an external service the model must run on hardware the journal controls. The capability of locally hosted models on editorial work has not been measured. Here we constructed a benchmark of eight editorial tasks from a journal's Instructions for Authors, from manuscripts carrying defects we seeded and verified independently, and from published reviews of a preprint, and evaluated twenty open-weight models spanning a twenty-five-fold range of weight size on a compact desktop workstation of the kind a laboratory or small editorial office can adopt. The strongest model detected 36 of 40 seeded guideline violations and occupied 81 GB; a 17 GB model detected 33. Across the best configurations tested, we observed no consistent monotonic association between weight size and score: rank correlations were negligible on every task (Spearman |rho| <= 0.19), and within one model family the larger member scored below its smaller sibling. A deterministic checker of regular expressions and arithmetic, using no model, detected 31 of the same violations in a fraction of a second, and the union of its detections with those of the strongest model covered all 40. On the single peer-review case, the best model recovered 6 of 12 points from three published reviews. Prompt structure substantially altered scores within individual models. This level of performance is therefore within reach of a workstation of this class, once the deterministic checks are written.

cs.DL

Testing Our Foundations: Citation Trends, Errors, and Emerging Hallucinations in the Computing Education Literature

Accurate references are foundational to scholarly work, enabling verification, attribution, and systematic review. However, the rapid adoption of large language models has introduced a serious integrity concern: plausible-looking but fabricated citations. Although hallucinated references are widely discussed, their visibility within specific research communities remains unclear. We address this gap by examining reference integrity at key computing education venues using ACM Digital Library data. We analyze referencing trends across 24,751 computing education papers and compare them with the broader ACM corpus of more than 723,000 papers and 15 million references. We then examine reference lists from these venues, classify common bibliographic errors, and manually identify LLM-generated hallucinations containing verifiably false information, including impossible page ranges, invented titles, and misattributed authors. In 2025, hallucinated references appeared across five SIGCSE-sponsored or in-cooperation venues. At the Technical Symposium alone, verified hallucinated references increased from 3 in 2025 to 17 in 2026, appearing in 2.3\% of 2026 proceedings papers. Although still relatively rare for now, this growth poses an integrity risk our community should not ignore.

cs.DL