arXiv subjects

Ankit Patel

Publications and source records attributed to Ankit Patel.

At least 19 recordsLinked to original sources

arXiv2026

Failure Detection for Surgical Robot Imitation Policies via Flow-Matching World Modeling

Imitation learning has shown increasing promise for autonomous robotic surgery, yet safe deployment remains challenging due to the safety-critical nature of surgical tasks and the complexity and variability of surgical environments. Failure detection is therefore an essential safeguard, but its development remains difficult due to the challenges of scarce failure data, highly variable manipulation dynamics, and the need to balance missed detections against disruptive false alarms. To address these challenges, we introduce FoMo-FD (Flow-Matching World Model for Failure Detection), a failure detection method that learns nominal short-horizon visual dynamics with an action-conditioned flow-matching world model. FoMo-FD scores the inverse-transport nonconformity of observed endpoint latents, enabling window-level detection of visual-action inconsistencies without requiring failure demonstrations. Detection thresholds are obtained by conformal calibration on successful executions, yielding task-specific alarms without assuming future failure types. We evaluate FoMo-FD on four surgically relevant manipulation tasks with twenty failure modes across simulation and real-world experiments using the da Vinci Research Kit (dVRK). Results show that FoMo-FD outperforms observation-level anomaly baselines and a prediction-error variant of the same world model, with the wrist-camera view achieving the strongest performance, including a 96.6% failure detection rate (FDR) at a 1.3% false alarm rate (FAR).

cs.RO↗

arXiv2026

Production of high-quality plasma discharges via real-time control of plasma current ramp-up using neutral gas injection in Aditya-U tokamak

Robust control of plasma current ramp-up is an absolute necessity, as an efficient and uncontaminated plasma current ramp-up is essential for achieving prolonged, high-pressure tokamak plasma discharges. In conventional tokamaks with Ohmic breakdown, the plasma current ramp-up is achieved primarily with pre-fixed temporal profiles of the applied toroidal electric field and the equilibrium magnetic field (Bv). The pre-fixed temporal profiles of these fields are often insufficient to maintain a successful plasma current ramp-up, as several unquantified dynamical variables, such as the condition of the vessel wall and plasma-facing components, influence the plasma current rise. Fuel gas injection in an appropriate quantity at a suitable time during the current ramp-up is therefore used to control the plasma current rise rate, ensuring successful plasma current start-up in Aditya-U. The gas injection time and gas quantity are controlled based on real-time measurement of plasma current rise rate using a digital signal processor (DSP) controller. This special control scheme is capable of achieving the plasma current to rise nearly at the desired rate, resulting in a successful start-up and a stable plasma discharge.

physics.plasm-ph↗

arXiv2026

Feeding and Feedback in Dwarf Galaxies (FeeD) -- I. Evidence of nuclear ultra-fast and galaxy-scale outflows in the dwarf galaxy Arp 151

Feeding and feedback regulated by supermassive black holes (SMBHs) play a central role in galaxy growth and evolution, yet these processes remain poorly understood in low-mass galaxies. In particular, the presence, properties, and role of ultra-fast nuclear outflows (UFOs) in low-mass galaxy systems are largely unexplored. We analyze available NuSTAR X-ray observations of Arp 151 and find a possible evidence ($\sim 2\sigma$ confidence) for a fast outflow with a velocity of $\sim0.18c$ from the central BH. Furthermore, we have also detected an optical galaxy-scale outflow in MaNGA Integral Field Unit data. The estimated nuclear and galaxy-scale mass outflow rates are $\sim0.015$ $M_\odot$/yr from {\it NuSTAR} and $\sim0.43$ $M_\odot$/yr from MaNGA, respectively. Our estimates suggest that such outflows may significantly regulate the feedback process in the galaxy. Comparing the kinetics of the UFO and the galaxy-scale outflow indicates that they are in the momentum-conserving phase. This tentative detection implies that dwarf galaxies are also able to generate UFOs, which so far have been detected in massive galaxies. Thus, the AGN feedback may also be important for the evolution of the dwarf galaxies.

astro-ph.GA↗

arXiv2025

Pretraining Large Language Models with NVFP4

Large Language Models (LLMs) today are powerful problem solvers across many domains, and they continue to get stronger as they scale in model size, training set size, and training set quality, as shown by extensive research and experimentation across the industry. Training a frontier model today requires on the order of tens to hundreds of yottaflops, which is a massive investment of time, compute, and energy. Improving pretraining efficiency is therefore essential to enable the next generation of even more capable LLMs. While 8-bit floating point (FP8) training is now widely adopted, transitioning to even narrower precision, such as 4-bit floating point (FP4), could unlock additional improvements in computational speed and resource utilization. However, quantization at this level poses challenges to training stability, convergence, and implementation, notably for large-scale models trained on long token horizons. In this study, we introduce a novel approach for stable and accurate training of large language models (LLMs) using the NVFP4 format. Our method integrates Random Hadamard transforms (RHT) to bound block-level outliers, employs a two-dimensional quantization scheme for consistent representations across both the forward and backward passes, utilizes stochastic rounding for unbiased gradient estimation, and incorporates selective high-precision layers. We validate our approach by training a 12-billion-parameter model on 10 trillion tokens -- the longest publicly documented training run in 4-bit precision to date. Our results show that the model trained with our NVFP4-based pretraining technique achieves training loss and downstream task accuracies comparable to an FP8 baseline. These findings highlight that NVFP4, when combined with our training approach, represents a major step forward in narrow-precision LLM training algorithms.

cs.CL↗

arXiv2025

Origin of the double-peaked narrow emission-lines in the optical spectra of X-shaped Radio Galaxies

We investigate X-shaped radio galaxies (XRGs) with optical double-peaked narrow emission lines (DPNELs) as potential hosts of dual or binary supermassive black holes (SMBHs). Using available optical spectra from the SDSS and DESI surveys, we identify 55 DPNEL sources among a sample of 187 XRGs. We find that the occurrence of [O III] DPNELs in XRGs is $\sim$30 %, which is substantially higher than the $\sim$1 % observed in the general galaxy population. Using optical (involving {[O III]$\lambda$5007}, H$\alpha$, H$\beta$, {[N II]$\lambda$,6584}, and {[S II]$\lambda\lambda$6716,6731}) and mid-infrared diagnostic diagrams, we found that both components are predominantly AGN-powered, implying a $\sim$95 % probability of hosting dual AGN systems. In comparison, a stellar-mass-, color-, and redshift-matched control sample of non-XRG DPNEL galaxies shows a lower dual AGN fraction, which depends strongly on radio luminosity, rising from ~25 % in radio-undetected to ~54 % in radio-detected galaxies, and reaching ~95 % in radio-bright XRGs and FR-II radio galaxies. Interestingly, more than 30 % of DPNEL XRGs have companion galaxies, supporting a merger-driven origin for these systems. Finally, we analyze parsec-scale radio structure in 7 XRGs using VLBA observations at 1.4, 4.3, and 7.6 GHz, resolving the core in only one source. Nevertheless, flat radio spectral indices, AGN-like emission-line properties, and radio-optical VLBA-Gaia positional offsets found in 5 cases together support the interpretation that XRGs are strong dual/binary AGN candidates.

astro-ph.GA↗

arXiv2025

Favorable modifications of Scrape-Off Layer (SOL) heat flux width through pulsed fuelling in ADITYA-U Tokamak

Enhancement of the scrape-off layer (SOL) heat flux width has been observed in the ADITYA-U Tokamak following the injection of short fuel gas pulses. A notable reduction in parallel heat flux near the last closed flux surface (LCFS) is observed after each pulse. Comparative analysis indicates that pulsed fuelling is more effective in mitigating heat flux with improved core confinement than continuous gas feeding via real-time density control. Analytical and simulation works are also carried out for validation of experimental results. The analytical model shows that SOL width modification cannot be attributed solely to the decrease of temperature due to gas pulse injection; cross-field plasma diffusion also needs to increase. Simulations with the UEDGE code suggest that an increase in both the cross-field diffusion coefficient and inward pinch velocity is necessary to replicate the experimentally observed broadening of the heat flux SOL width. These findings provide insights into efficient SOL heat flux control strategies for future fusion devices.

physics.plasm-ph↗

arXiv2025

Identification and Characterization of a New Disruption Regime in ADITYA-U Tokamak

Disruptions continue to pose a significant challenge to the stable operation and future design of tokamak reactors. A comprehensive statistical investigation carried out on the ADITYA-U tokamak has led to the observation and characterization of a novel disruption regime. In contrast to the conventional Locked Mode Disruption (LMD), the newly identified disruption exhibits a distinctive two-phase evolution: an initial phase characterized by a steady rise in mode frequency with a nonlinearly saturated amplitude, followed by a sudden frequency collapse accompanied by a pronounced increase in amplitude. This behaviour signifies the onset of the precursor phase on a significantly shorter timescale. Clear empirical thresholds have been identified to distinguish this disruption type from conventional LMD events, including edge safety factor, current decay coefficient, current quench (CQ) time, and CQ rate. The newly identified disruption regime is predominantly governed by the (m/n = 2/1) drift-tearing mode (DTM), which, in contrast to typical disruptions in the ADITYA-U tokamak that involve both m/n = 2/1 and 3/1 modes, consistently manifests as the sole dominant instability. Initiated by core temperature hollowing, the growth of this mode is significantly enhanced by a synergistic interplay between a strongly localized pressure gradient and the pronounced steepening of the current density profile in the vicinity of the mode rational surface.

physics.plasm-ph↗

arXiv2025

The Spectral Bias of Shallow Neural Network Learning is Shaped by the Choice of Non-linearity

Despite classical statistical theory predicting severe overfitting, modern massively overparameterized neural networks still generalize well. This unexpected property is attributed to the network's so-called implicit bias, which describes its propensity to converge to solutions that generalize effectively, among the many possible that correctly label the training data. The aim of our research is to explore this bias from a new perspective, focusing on how non-linear activation functions contribute to shaping it. First, we introduce a reparameterization which removes a continuous weight rescaling symmetry. Second, in the kernel regime, we leverage this reparameterization to generalize recent findings that relate shallow Neural Networks to the Radon transform, deriving an explicit formula for the implicit bias induced by a broad class of activation functions. Specifically, by utilizing the connection between the Radon transform and the Fourier transform, we interpret the kernel regime's inductive bias as minimizing a spectral seminorm that penalizes high-frequency components, in a manner dependent on the activation function. Finally, in the adaptive regime, we demonstrate the existence of local dynamical attractors that facilitate the formation of clusters of hyperplanes where the input to a neuron's activation function is zero, yielding alignment between many neurons' response functions. We confirm these theoretical results with simulations. All together, our work provides a deeper understanding of the mechanisms underlying the generalization capabilities of overparameterized neural networks and its relation with the implicit bias, offering potential pathways for designing more efficient and robust models.

cs.LG↗

arXiv2025

A multi-purpose reciprocating probe drive system for studying the effect of gas-puffs on edge plasma dynamics in the ADITYA-U tokamak

This article reports the development of a versatile high-speed reciprocating drive system (HRDS) with interchangeable probe heads to characterize the edge plasma region of ADITYA-U tokamak. This reciprocating probe drive system consisting of Langmuir and magnetic probe heads, is designed, fabricated, installed, and operated for studying the extent of fuel/impurity gas propagation and its influence on plasma dynamics in the far-edge region inside the last closed magnetic flux surface (LCFS). The HRDS is driven by a highly accurate, easy-to-control, dynamic, brushless, permanently excited synchronous servo motor operated by a PXI-commanded controller. The system is remotely operated and allows for precise control of the speed, acceleration, and distance traveled of the probe head on a shot-to-shot basis, facilitating seamless control of operations according to experimental requirements. Using this system, consisting of a linear array of Langmuir probes, measurements of plasma density, temperature, potential, and their fluctuations revealed that the fuel gas-puff impact these mean and fluctuating parameters up to three to four cm inside the LCFS. Attaching an array of magnetic probes to this system led to measurements of magnetic fluctuations inside the LCFS. The HRDS system is fully operational and serves as an important diagnostic tool for ADITYA-U tokamak.

physics.plasm-ph↗

arXiv2024

MHD activity induced coherent mode excitation in the edge plasma region of ADITYA-U Tokamak

In this paper, we report the excitation of coherent density and potential fluctuations induced by magnetohydrodynamic (MHD) activity in the edge plasma region of ADITYA-U Tokamak. When the amplitude of the MHD mode, mainly the m/n = 2/1, increases beyond a threshold value of 0.3-0.4 %, coherent oscillations in the density and potential fluctuations are observed having the same frequency as that of the MHD mode. The mode numbers of these MHD induced density and potential fluctuations are obtained by Langmuir probes placed at different radial, poloidal, and toroidal locations in the edge plasma region. Detailed analyses of these Langmuir probe measurements reveal that the coherent mode in edge potential fluctuation has a mode structure of m/n = 2/1 whereas the edge density fluctuation has an m/n = 1/1 structure. It is further observed that beyond the threshold, the coupled power fraction scales almost linearly with the magnitude of magnetic fluctuations. Furthermore, the rise rates of the coupled power fraction for coherent modes in density and potential fluctuations are also found to be dependent on the growth rate of magnetic fluctuations. The disparate mode structures of the excited modes in density and plasma potential fluctuations suggest that the underlying mechanism for their existence is most likely due to the excitation of the global high-frequency branch of zonal flows occurring through the coupling of even harmonics of potential to the odd harmonics of pressure due to 1/R dependence of the toroidal magnetic field.

physics.plasm-ph↗

arXiv2023

Navigating protein landscapes with a machine-learned transferable coarse-grained model

The most popular and universally predictive protein simulation models employ all-atom molecular dynamics (MD), but they come at extreme computational cost. The development of a universal, computationally efficient coarse-grained (CG) model with similar prediction performance has been a long-standing challenge. By combining recent deep learning methods with a large and diverse training set of all-atom protein simulations, we here develop a bottom-up CG force field with chemical transferability, which can be used for extrapolative molecular dynamics on new sequences not used during model parametrization. We demonstrate that the model successfully predicts folded structures, intermediates, metastable folded and unfolded basins, and the fluctuations of intrinsically disordered proteins while it is several orders of magnitude faster than an all-atom model. This showcases the feasibility of a universal and computationally efficient machine-learned CG model for proteins.

q-bio.BM↗

arXiv2022

Interpreting convolutional neural networks' low dimensional approximation to quantum spin systems

Convolutional neural networks (CNNs) have been employed along with Variational Monte Carlo methods for finding the ground state of quantum many-body spin systems with great success. In order to do so, however, a CNN with only linearly many variational parameters has to circumvent the ``curse of dimensionality'' and successfully approximate a wavefunction on an exponentially large Hilbert space. In our work, we provide a theoretical and experimental analysis of how the CNN optimizes learning for spin systems, and investigate the CNN's low dimensional approximation. We first quantify the role played by physical symmetries of the underlying spin system during training. We incorporate our insights into a new training algorithm and demonstrate its improved efficiency, accuracy and robustness. We then further investigate the CNN's ability to approximate wavefunctions by looking at the entanglement spectrum captured by the size of the convolutional filter. Our insights reveal the CNN to be an ansatz fundamentally centered around the occurrence statistics of $K$-motifs of the input strings. We use this motivation to provide the shallow CNN ansatz with a unifying theoretical interpretation in terms of other well-known statistical and physical ansatzes such as the maximum entropy (MaxEnt) and entangled plaquette correlator product states (EP-CPS). Using regression analysis, we find further relationships between the CNN's approximations of the different motifs' expectation values. Our results allow us to gain a comprehensive, improved understanding of how CNNs successfully approximate quantum spin Hamiltonians and to use that understanding to improve CNN performance.

quant-ph↗

arXiv2022

Transforming Gait: Video-Based Spatiotemporal Gait Analysis

Human pose estimation from monocular video is a rapidly advancing field that offers great promise to human movement science and rehabilitation. This potential is tempered by the smaller body of work ensuring the outputs are clinically meaningful and properly calibrated. Gait analysis, typically performed in a dedicated lab, produces precise measurements including kinematics and step timing. Using over 7000 monocular video from an instrumented gait analysis lab, we trained a neural network to map 3D joint trajectories and the height of individuals onto interpretable biomechanical outputs including gait cycle timing and sagittal plane joint kinematics and spatiotemporal trajectories. This task specific layer produces accurate estimates of the timing of foot contact and foot off events. After parsing the kinematic outputs into individual gait cycles, it also enables accurate cycle-by-cycle estimates of cadence, step time, double and single support time, walking speed and step length.

cs.CV↗

arXiv2020

Shallow Univariate ReLu Networks as Splines: Initialization, Loss Surface, Hessian, & Gradient Flow Dynamics

Understanding the learning dynamics and inductive bias of neural networks (NNs) is hindered by the opacity of the relationship between NN parameters and the function represented. We propose reparametrizing ReLU NNs as continuous piecewise linear splines. Using this spline lens, we study learning dynamics in shallow univariate ReLU NNs, finding unexpected insights and explanations for several perplexing phenomena. We develop a surprisingly simple and transparent view of the structure of the loss surface, including its critical and fixed points, Hessian, and Hessian spectrum. We also show that standard weight initializations yield very flat functions, and that this flatness, together with overparametrization and the initial weight scale, is responsible for the strength and type of implicit regularization, consistent with recent work arXiv:1906.05827. Our implicit regularization results are complementary to recent work arXiv:1906.07842, done independently, which showed that initialization scale critically controls implicit regularization via a kernel-based argument. Our spline-based approach reproduces their key implicit regularization results but in a far more intuitive and transparent manner. Going forward, our spline-based approach is likely to extend naturally to the multivariate and deep settings, and will play a foundational role in efforts to understand neural networks. Videos of learning dynamics using a spline-based visualization are available at http://shorturl.at/tFWZ2.

cs.LG↗

arXiv2020

AI Tax: The Hidden Cost of AI Data Center Applications

Artificial intelligence and machine learning are experiencing widespread adoption in industry and academia. This has been driven by rapid advances in the applications and accuracy of AI through increasingly complex algorithms and models; this, in turn, has spurred research into specialized hardware AI accelerators. Given the rapid pace of advances, it is easy to forget that they are often developed and evaluated in a vacuum without considering the full application environment. This paper emphasizes the need for a holistic, end-to-end analysis of AI workloads and reveals the "AI tax." We deploy and characterize Face Recognition in an edge data center. The application is an AI-centric edge video analytics application built using popular open source infrastructure and ML tools. Despite using state-of-the-art AI and ML algorithms, the application relies heavily on pre-and post-processing code. As AI-centric applications benefit from the acceleration promised by accelerators, we find they impose stresses on the hardware and software infrastructure: storage and network bandwidth become major bottlenecks with increasing AI acceleration. By specializing for AI applications, we show that a purpose-built edge data center can be designed for the stresses of accelerated AI at 15% lower TCO than one derived from homogeneous servers and infrastructure.

cs.DC↗

arXiv2020

Local Convolutions Cause an Implicit Bias towards High Frequency Adversarial Examples

Adversarial Attacks are still a significant challenge for neural networks. Recent work has shown that adversarial perturbations typically contain high-frequency features, but the root cause of this phenomenon remains unknown. Inspired by theoretical work on linear full-width convolutional models, we hypothesize that the local (i.e. bounded-width) convolutional operations commonly used in current neural networks are implicitly biased to learn high frequency features, and that this is one of the root causes of high frequency adversarial examples. To test this hypothesis, we analyzed the impact of different choices of linear and nonlinear architectures on the implicit bias of the learned features and the adversarial perturbations, in both spatial and frequency domains. We find that the high-frequency adversarial perturbations are critically dependent on the convolution operation because the spatially-limited nature of local convolutions induces an implicit bias towards high frequency features. The explanation for the latter involves the Fourier Uncertainty Principle: a spatially-limited (local in the space domain) filter cannot also be frequency-limited (local in the frequency domain). Furthermore, using larger convolution kernel sizes or avoiding convolutions (e.g. by using Vision Transformers architecture) significantly reduces this high frequency bias, but not the overall susceptibility to attacks. Looking forward, our work strongly suggests that understanding and controlling the implicit bias of architectures will be essential for achieving adversarial robustness.

stat.ML↗

arXiv2019

Deep Learning-Enhanced Variational Monte Carlo Method for Quantum Many-Body Physics

Artificial neural networks have been successfully incorporated into variational Monte Carlo method (VMC) to study quantum many-body systems. However, there have been few systematic studies of exploring quantum many-body physics using deep neural networks (DNNs), despite of the tremendous success enjoyed by DNNs in many other areas in recent years. One main challenge of implementing DNN in VMC is the inefficiency of optimizing such networks with large number of parameters. We introduce an importance sampling gradient optimization (ISGO) algorithm, which significantly improves the computational speed of training DNN in VMC. We design an efficient convolutional DNN architecture to compute the ground state of a one-dimensional (1D) SU($N$) spin chain. Our numerical results of the ground-state energies with up to 16 layers of DNN show excellent agreement with the Bethe-Ansatz exact solution. Furthermore, we also calculate the loop correlation function using the wave function obtained. Our work demonstrates the feasibility and advantages of applying DNNs to numerical quantum many-body calculations.

cond-mat.str-el↗

arXiv2018

A Bayesian Perspective of Convolutional Neural Networks through a Deconvolutional Generative Model

Inspired by the success of Convolutional Neural Networks (CNNs) for supervised prediction in images, we design the Deconvolutional Generative Model (DGM), a new probabilistic generative model whose inference calculations correspond to those in a given CNN architecture. The DGM uses a CNN to design the prior distribution in the probabilistic model. Furthermore, the DGM generates images from coarse to finer scales. It introduces a small set of latent variables at each scale, and enforces dependencies among all the latent variables via a conjugate prior distribution. This conjugate prior yields a new regularizer based on paths rendered in the generative model for training CNNs-the Rendering Path Normalization (RPN). We demonstrate that this regularizer improves generalization, both in theory and in practice. In addition, likelihood estimation in the DGM yields training losses for CNNs, and inspired by this, we design a new loss termed as the Max-Min cross entropy which outperforms the traditional cross-entropy loss for object classification. The Max-Min cross entropy suggests a new deep network architecture, namely the Max-Min network, which can learn from less labeled data while maintaining good prediction performance. Our experiments demonstrate that the DGM with the RPN and the Max-Min architecture exceeds or matches the-state-of-art on benchmarks including SVHN, CIFAR10, and CIFAR100 for semi-supervised and supervised learning tasks.

cs.CV↗