Estimator Precision and Selection for Up-the-Ramp Sampling with a High-Read-Noise InGaAs Camera

Abstract

The noise properties of an InGaAs camera vary with gain, requiring a trade-off between implementation complexity and precision. Using generalized least squares (GLS) with known covariance as the precision benchmark, we examine the applicability and precision penalties of ordinary least squares (OLS) and correlated double sampling (CDS) at different noise operating points. We define $η=fT/σ_\mathrm{R}^2$, where $f$ is the total pixel count rate, $T$ the fitting span, and $σ_\mathrm{R}$ the single-read noise. For constant flux, uniform sampling, and independent white read noise plus Poisson noise, established finite-sampling variance expressions give equal OLS and CDS variances at $η=10$ for $N\ge4$ reads; OLS is favored below this boundary and CDS above it. Analytical and Monte Carlo comparisons for three gain modes quantify the precision loss of the better simplified estimator relative to GLS. In high-gain on-sky data, choosing OLS at 20 s and CDS at 90 s increases the background residual standard deviation by 3.55% and 3.01%, respectively, relative to two-iteration feasible GLS (FGLS). Photometry of 21 common sources does not clearly resolve most estimator differences. The observed OLS-CDS crossover occurs earlier than the ideal prediction, indicating that temporal covariance beyond the ideal model also affects the selection boundary. Observational validation is limited to high gain; medium- and low-gain choices rely on theory and simulations using calibrated parameters. OLS or CDS can replace GLS with a small precision penalty at suitable operating points. The ideal criterion provides an initial selection rule, whose practical boundary requires validation against observed temporal covariance.