arXiv Science⌕ Search

arXiv · 2611.14713

Methodological Pitfalls in Predicting Ship Turnaround Time at Brazilian Ports: An Empirical Audit and a Reproducible Pipeline

Abstract

Two recent studies on ship turnaround time at Brazilian ports report models with R-squared scores above 0.80 on data from the national waterway transportation agency. We audit their published datasets and reveal these results are inflated by structural data leakage. Specifically, 97 percent of berthing events in their random row-level split appear in both training and testing partitions. We demonstrate that a model's R-squared drops from 0.82 to 0.20 when the data is properly split at the berthing level. We further document additional methodological flaws, including survivorship bias, undocumented target truncation, and the retention of variables that algebraically reconstruct the target. To address these issues, we propose a reproducible pipeline that aggregates cargo to the berthing level, utilizes conditional imputation, and represents high-cardinality cargo variables through weighted averages of multilingual sentence embeddings. Evaluating six time targets and thirty seeds, our pipeline reveals that cargo embeddings yield statistically significant improvements on four operational targets, while administrative waiting times remain unaffected. Prior works missed this per-target heterogeneity by conflating genuine signal with leaked identity.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Eduardo Caruso Barbosa Pacheco, Reynaldo Pereira Martins, Alexandre dos Santos Gualberto, Joao Vitor Souza Germano, Milton Miranda Neto, Francisco Louzada. 2026-11-10. Methodological Pitfalls in Predicting Ship Turnaround Time at Brazilian Ports: An Empirical Audit and a Reproducible Pipeline. https://arxiv.science/abs/2611.14713

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related papers

A Bayesian Framework for Latent Compliance Modeling in Cluster Randomized Trials with One-Sided Noncompliance

In pragmatic cluster randomized controlled trials (PCRCTs), healthcare providers are randomized, but intervention delivery and patient receipt may vary after assignment. In many PCRCTs, cluster-level implementation is measured using continuous implementation metrics, while individual compliance is recorded as a binary indicator. Standard complier average causal effect (CACE) estimands focus on individual-level compliance and do not account for heterogeneity in implementation across clusters. When intervention uptake is shaped by both cluster- and individual-level processes, it is of scientific interest to characterize how effects vary across these sources of compliance. We propose a Bayesian framework for PCRCTs with one-sided binary noncompliance at the individual level and one-sided partial compliance at the cluster level. The method uses a latent mixture model to summarize heterogeneity in cluster-level implementation based on baseline characteristics and treatment-arm implementation measures, and links these latent implementation strata to individual compliance and outcomes through a joint model. Because individual compliance and treatment-defined implementation measures are observed only under treatment assignment, the model imputes these quantities for control clusters and individuals assigned to control. The framework enables estimation of finite- and super-population intent-to-treat (ITT) and CACE estimands, both marginally and within latent implementation strata. We apply the method to the METRIcAL trial, a pragmatic cluster randomized study evaluating a personalized music intervention for nursing home residents with dementia. The analysis illustrates how accounting for implementation heterogeneity and individual compliance can provide insights beyond standard ITT analyses.

stat.AP↗

A Physically Informed Changepoint Score for Fault Prioritisation in District Heating

Poorly cooling district-heating installations raise return temperatures and pumped flow, increasing heat losses and pumping energy and hindering low-temperature operation. Faults often go unreported for weeks, so their onset is unknown and energy is wasted in the meantime. Utilities flag poorly cooling installations by a low supply-return temperature difference, but not when the problem began. Changepoint detectors such as the Bayesian Estimator of Abrupt Change, Seasonality, and Trend (BEAST) can date a change but report only its probability, so a large, fault-like change and a marginal one can look alike. We therefore develop a decision score that weighs each BEAST change in temperature difference and flow by its probability, size, deviation from recent operation and physical direction. Joint falls in temperature difference and rises in flow, the signature of insufficient cooling, rank first. Across 1,522 cases, 648 with a reported fault, 24 of the 25 highest-ranked cases were reported faults, and Average Precision was 0.772 against a prevalence of 0.426, likely conservative, as unreported cases may contain faults. Without using the report date, the strongest flow rise in reported-fault cases came a median of 11 days before the report (128 days in comparison cases). Combined with temperature-difference screening, the score raised Average Precision in season-matched cases from 0.486 to 0.646. After the detected change, flagged reported-fault installations returned water 16 K warmer and about half their circulated water delivered no heat. The score gives utilities a short list for inspection and a candidate onset date for each change.

stat.AP↗

Copula-Based Synthetic Data Generation: A Use-Inspired Perspective on Trade-offs

The generation of synthetic data offers a promising way to address challenges related to data scarcity and privacy concerns. While many approaches have been developed, tabular synthetic data generation methods often require complex models and extensive training data, while lacking interpretability. In this work, we investigate versatile probabilistic approaches using copulas, and leverage in particular the Gaussian Mixture Copula Model, to model the joint distribution of multivariate data, with a main focus on moderate-dimensional data sets. Taking a use-inspired perspective, we examine key trade-offs inherent to synthetic data evaluation, spanning fidelity, utility, and privacy, and demonstrate that copula-based methods achieve a sound balance across all three dimensions while remaining interpretable and providing an explicit probabilistic model. We illustrate and highlight the potential benefits of the method on a test case focusing on systematic missing values in a cardiovascular risk calculator and develop specific evaluation metrics for this application.

stat.AP↗