arXiv subjects

Animesh Jain

Publications and source records attributed to Animesh Jain.

13 recordsLinked to original sources

arXiv2026

Fisher-Information-Based Sensor Placement for Structural Digital Twins: Analytic Results and Benchmarks

High-fidelity digital twins rely on the accurate assimilation of sensor data into physics-based computational models. In structural applications, such twins aim to identify spatially distributed quantities--such as elementwise weakening fields, material parameters, or effective thermal loads--by minimizing discrepancies between measured and simulated responses subject to the governing equations of structural mechanics. While adjoint-based methods enable efficient gradient computation for these inverse problems, the quality and stability of the resulting estimates depend critically on the choice of sensor locations, measurement types, and directions. This paper develops a rigorous and implementation-ready framework for Fisher-information-based sensor placement in adjoint-based finite-element digital twins. Sensor configurations are evaluated using a D-optimal design criterion derived from a linearization of the measurement map, yielding a statistically meaningful measure of information content. We present matrix-free operator formulas for applying the Jacobian and its adjoint, and hence for computing Fisher-information products $Fv = J^\top R^{-1} Jv$ using only forward and adjoint solves. Building on these operator evaluations, we derive explicit sensitivity expressions for D-optimal sensor design with respect to measurement parameters and discuss practical strategies for evaluating the associated log-determinant objectives. To complement the general framework, we provide analytically tractable sensor placement results for a canonical one-dimensional structural model, clarifying the distinction between detectability and localizability and proving that D-optimal placement of multiple displacement sensors yields approximately uniform spacing.

math.OC↗

arXiv2025

MIMIC: Multimodal Inversion for Model Interpretation and Conceptualization

Vision Language Models (VLMs) encode multimodal inputs over large, complex, and difficult-to-interpret architectures, which limit transparency and trust. We propose a Multimodal Inversion for Model Interpretation and Conceptualization (MIMIC) framework that inverts the internal encodings of VLMs. MIMIC uses a joint VLM-based inversion and a feature alignment objective to account for VLM's autoregressive processing. It additionally includes a triplet of regularizers for spatial alignment, natural image smoothness, and semantic realism. We evaluate MIMIC both quantitatively and qualitatively by inverting visual concepts across a range of free-form VLM outputs of varying length. Reported results include both standard visual quality metrics and semantic text-based metrics. To the best of our knowledge, this is the first model inversion approach addressing visual interpretations of VLM concepts.

cs.CV↗

arXiv2023

Automatic Attention Pruning: Improving and Automating Model Pruning using Attentions

Pruning is a promising approach to compress deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot efficiently run on commodity hardware; and they often require users to manually explore and tune the pruning process, which is time-consuming and often leads to sub-optimal results. To address these limitations, this paper presents Automatic Attention Pruning (AAP), an adaptive, attention-based, structured pruning approach to automatically generate small, accurate, and hardware-efficient models that meet user objectives. First, it proposes iterative structured pruning using activation-based attention maps to effectively identify and prune unimportant filters. Then, it proposes adaptive pruning policies for automatically meeting the pruning objectives of accuracy-critical, memory-constrained, and latency-sensitive tasks. A comprehensive evaluation shows that AAP substantially outperforms the state-of-the-art structured pruning works for a variety of model architectures. Our code is at: https://github.com/kaiqi123/Automatic-Attention-Pruning.git.

cs.LG↗

arXiv2023

Indirect noise from weakly reacting inhomogeneities

Indirect noise is a significant contributor to aircraft engine noise, which needs to be minimized in the design of aircraft engines. Indirect noise is caused by the acceleration of flow inhomogeneities through a nozzle. High-fidelity simulations showed that some flow inhomogeneities can be chemically reacting when they leave the combustor and enter the nozzle (Giusti et al., 2019). The state-of-art models, however, are limited to chemically non-reacting (frozen) flows. In this work, first, we propose a low-order model to predict indirect noise in nozzle flows with reacting inhomogeneities. Second, we identify the physical sources of sound, which generate indirect noise via two physical mechanisms: (i) chemical reaction generates compositional perturbations, thereby adding to compositional noise; and (ii) exothermic reaction generates entropy perturbations. Third, we numerically compute the nozzle transfer functions for different frequency ranges (Helmholtz numbers) and reaction rates (Damk\"{o}hler numbers) in subsonic flows with hydrogen and methane inhomogeneities. Fourth, we extend the model to supersonic flows. We find that hydrogen inhomogeneities have a larger impact to indirect noise than methane inhomogeneities. Both the Damk\"{o}hler number and the Helmholtz number markedly influence the phase and magnitude of the transmitted and reflected waves, which affect the sound generation and thermoacoustic stability. This work provides a physics-based low-order model, which can open new opportunities for predicting noise emissions and instabilities in aeronautical gas turbines with multi-physics flows.

physics.flu-dyn↗

arXiv2022

Compositional noise in nozzles with dissipation

We propose a physical model to predict indirect noise generated by the acceleration of compositional inhomogeneities in nozzles with viscous dissipation (non-isentropic nozzles). First, we derive the quasi-one-dimensional equations from the conservation laws of multicomponent flows. Second, we validate the proposed model with the experimental data available in the literature for binary mixtures of four gases. Third, we calculate the nozzle transfer functions for different Helmholtz numbers and friction factors, in both subsonic and supersonic flows with/without shock waves. We show that friction has a significant effect on the generation of indirect noise, for which the physical mechanism is identified and explained. Fourth, we find a semi-analytical solution with path integrals, which provide an asymptotic expansion with respect to the Helmholtz number. Fifth, we introduce the compositional noise scaling factor, which is applied to quickly estimate compositional noise from the knowledge of only one single-component gas transfer function. The approximation error is less than $1\%$. The proposed low-order model provides accurate estimates of the transfer functions and physical insight into indirect noise for multicomponent gases. This opens up new possibilities to accurately predict, and understand, sound generation in gas turbines.

physics.flu-dyn↗

arXiv2022

Iterative Activation-based Structured Pruning

Deploying complex deep learning models on edge devices is challenging because they have substantial compute and memory resource requirements, whereas edge devices' resource budget is limited. To solve this problem, extensive pruning techniques have been proposed for compressing networks. Recent advances based on the Lottery Ticket Hypothesis (LTH) show that iterative model pruning tends to produce smaller and more accurate models. However, LTH research focuses on unstructured pruning, which is hardware-inefficient and difficult to accelerate on hardware platforms. In this paper, we investigate iterative pruning in the context of structured pruning because structurally pruned models map well on commodity hardware. We find that directly applying a structured weight-based pruning technique iteratively, called iterative L1-norm based pruning (ILP), does not produce accurate pruned models. To solve this problem, we propose two activation-based pruning methods, Iterative Activation-based Pruning (IAP) and Adaptive Iterative Activation-based Pruning (AIAP). We observe that, with only 1% accuracy loss, IAP and AIAP achieve 7.75X and 15.88$X compression on LeNet-5, and 1.25X and 1.71X compression on ResNet-50, whereas ILP achieves 4.77X and 1.13X, respectively.

cs.LG↗

arXiv2022

Adaptive Activation-based Structured Pruning

Pruning is a promising approach to compress complex deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot efficiently run on commodity hardware and require users to manually explore and tune the pruning process, which is time-consuming and often leads to sub-optimal results. To address these limitations, this paper presents an adaptive, activation-based, structured pruning approach to automatically and efficiently generate small, accurate, and hardware-efficient models that meet user requirements. First, it proposes iterative structured pruning using activation-based attention feature maps to effectively identify and prune unimportant filters. Then, it proposes adaptive pruning policies for automatically meeting the pruning objectives of accuracy-critical, memory-constrained, and latency-sensitive tasks. A comprehensive evaluation shows that the proposed method can substantially outperform the state-of-the-art structured pruning works on CIFAR-10 and ImageNet datasets. For example, on ResNet-56 with CIFAR-10, without any accuracy drop, our method achieves the largest parameter reduction (79.11%), outperforming the related works by 22.81% to 66.07%, and the largest FLOPs reduction (70.13%), outperforming the related works by 14.13% to 26.53%.

cs.CV↗

arXiv2021

A physical model for indirect noise in non-isentropic nozzles: Transfer functions and stability

We propose a mathematical model from physical principles to predict the sound generated in nozzles with dissipation. The focus is on the sound generated from the acceleration of temperature inhomogeneities (also known as entropy waves), which is referred to as indirect noise. First, we model the dissipation caused by flow recirculation and wall friction with a friction factor, which enables us to derive quasi-one-dimensional equations from conservation laws. The model is valid for both compact nozzles and nozzles with a spatial extent. Second, the predictions from the proposed model are compared against the experimental data available in the literature. Third, we compute the nozzle transfer functions for a range of Helmholtz numbers and friction factors. It is found that the friction and the Helmholtz number have a significant effect on the gain/phase of the reflected and transmitted waves. The analysis is performed from subsonic to supersonic regimes (with and without shock waves). The acoustic transfer functions vary significantly because of non-isentropic effects and the Helmholtz number, in particular, in the subsonic-choked regime. Finally, we calculate the effect that the friction of a nozzle guide vane has on thermoacoustic stability. It is found that the friction and the Helmholtz number can change thermoacoustic stability from a linearly stable regime to a linearly unstable regime. The study opens up new possibilities for the accurate prediction of indirect noise in realistic nozzles with implications on both noise emissions and thermoacoustic stability. nozzles with implications on both noise emissions and thermoacoustic stability.

physics.flu-dyn↗

arXiv2021

Automated Backend-Aware Post-Training Quantization

Quantization is a key technique to reduce the resource requirement and improve the performance of neural network deployment. However, different hardware backends such as x86 CPU, NVIDIA GPU, ARM CPU, and accelerators may demand different implementations for quantized networks. This diversity calls for specialized post-training quantization pipelines to built for each hardware target, an engineering effort that is often too large for developers to keep up with. We tackle this problem with an automated post-training quantization framework called HAGO. HAGO provides a set of general quantization graph transformations based on a user-defined hardware specification and implements a search mechanism to find the optimal quantization strategy while satisfying hardware constraints for any model. We observe that HAGO achieves speedups of 2.09x, 1.97x, and 2.48x on Intel Xeon Cascade Lake CPUs, NVIDIA Tesla T4 GPUs, ARM Cortex-A CPUs on Raspberry Pi4 relative to full precision respectively, while maintaining the highest reported post-training quantization accuracy in each case.

cs.CV↗

arXiv2021

UNIT: Unifying Tensorized Instruction Compilation

Because of the increasing demand for computation in DNN, researchers develope both hardware and software mechanisms to reduce the compute and memory burden. A widely adopted approach is to use mixed precision data types. However, it is hard to leverage mixed precision without hardware support because of the overhead of data casting. Hardware vendors offer tensorized instructions for mixed-precision tensor operations, like Intel VNNI, Tensor Core, and ARM-DOT. These instructions involve a computing idiom that reduces multiple low precision elements into one high precision element. The lack of compilation techniques for this makes it hard to utilize these instructions: Using vendor-provided libraries for computationally-intensive kernels is inflexible and prevents further optimizations, and manually writing hardware intrinsics is error-prone and difficult for programmers. Some prior works address this problem by creating compilers for each instruction. This requires excessive effort when it comes to many tensorized instructions. In this work, we develop a compiler framework to unify the compilation for these instructions -- a unified semantics abstraction eases the integration of new instructions, and reuses the analysis and transformations. Tensorized instructions from different platforms can be compiled via UNIT with moderate effort for favorable performance. Given a tensorized instruction and a tensor operation, UNIT automatically detects the applicability, transforms the loop organization of the operation,and rewrites the loop body to leverage the tensorized instruction. According to our evaluation, UNIT can target various mainstream hardware platforms. The generated end-to-end inference model achieves 1.3x speedup over Intel oneDNN on an x86 CPU, 1.75x speedup over Nvidia cuDNN on an NvidiaGPU, and 1.13x speedup over a carefully tuned TVM solution for ARM DOT on an ARM CPU.

cs.PL↗

arXiv2020

Efficient Execution of Quantized Deep Learning Models: A Compiler Approach

A growing number of applications implement predictive functions using deep learning models, which require heavy use of compute and memory. One popular technique for increasing resource efficiency is 8-bit integer quantization, in which 32-bit floating point numbers (fp32) are represented using shorter 8-bit integer numbers. Although deep learning frameworks such as TensorFlow, TFLite, MXNet, and PyTorch enable developers to quantize models with only a small drop in accuracy, they are not well suited to execute quantized models on a variety of hardware platforms. For example, TFLite is optimized to run inference on ARM CPU edge devices but it does not have efficient support for Intel CPUs and Nvidia GPUs. In this paper, we address the challenges of executing quantized deep learning models on diverse hardware platforms by proposing an augmented compiler approach. A deep learning compiler such as Apache TVM can enable the efficient execution of model from various frameworks on various targets. Many deep learning compilers today, however, are designed primarily for fp32 computation and cannot optimize a pre-quantized INT8 model. To address this issue, we created a new dialect called Quantized Neural Network (QNN) that extends the compiler's internal representation with a quantization context. With this quantization context, the compiler can generate efficient code for pre-quantized models on various hardware platforms. As implemented in Apache TVM, we observe that the QNN-augmented deep learning compiler achieves speedups of 2.35x, 2.15x, 1.35x and 1.40x on Intel Xeon Cascade Lake CPUs, Nvidia Tesla T4 GPUs, ARM Raspberry Pi3 and Pi4 respectively against well optimized fp32 execution, and comparable performance to the state-of-the-art framework-specific solutions.

cs.DC↗

arXiv2020

Optimizing Memory-Access Patterns for Deep Learning Accelerators

Deep learning (DL) workloads are moving towards accelerators for faster processing and lower cost. Modern DL accelerators are good at handling the large-scale multiply-accumulate operations that dominate DL workloads; however, it is challenging to make full use of the compute power of an accelerator since the data must be properly staged in a software-managed scratchpad memory. Failing to do so can result in significant performance loss. This paper proposes a systematic approach which leverages the polyhedral model to analyze all operators of a DL model together to minimize the number of memory accesses. Experiments show that our approach can substantially reduce the impact of memory accesses required by common neural-network models on a homegrown AWS machine-learning inference chip named Inferentia, which is available through Amazon EC2 Inf1 instances.

cs.PF↗

arXiv2011

High-energy high-luminosity electron-ion collider eRHIC

In this paper, we describe a future electron-ion collider (EIC), based on the existing Relativistic Heavy Ion Collider (RHIC) hadron facility, with two intersecting superconducting rings, each 3.8 km in circumference. A new ERL accelerator, which provide 5-30 GeV electron beam, will ensure 10^33 to 10^34 cm^-2 s^-1 level luminosity.

physics.acc-ph↗