arXiv Science⌕ Search

arXiv subjects

Manpreet Singh

Publications and source records attributed to Manpreet Singh.

At least 37 records · Page 2Linked to original sources

Effects of Coronal Mass Ejection on PSR J1022+1001 and Possible Mode Change of PSR J2145-0750 in the InPTA DR2

The Indian Pulsar Timing Array (InPTA) has recently published its second data release (DR2), comprising the timing analysis of seven years of data on 27 millisecond pulsars (MSPs), observed simultaneously in the 300-500 MHz (band 3) and 1260-1460 MHz (band 5), using the upgraded Giant Metrewave Radio Telescope (uGMRT). The low-frequency data, particularly in band 3, is highly sensitive to propagation effects such as dispersion measure (DM) fluctuations, which can be imprints of some astrophysical phenomena (scientific outliers). Here, we analyze the two outliers of possible astrophysical origin coming from the band 3 DM time series of two pulsars: PSR J1022+1001, with an ecliptic latitude of -0.06 degree, and PSR J2145-0750, one of the brightest MSPs, with multi-component profile morphology. Our study reveals compelling evidence for a coronal mass ejection (CME) event traced in the data of PSR J1022+1001, and reports evidence for a potential mode-changing event in PSR J2145-0750. By contrasting these two cases, we show that DM fluctuations due to CME interacions and intrinsic mode-changing events produce distinct observational signatures, enabling a physically informed classification of scientific outliers in PTA datasets. Extending the analyses presented here to the full sample of InPTA-DR2 pulsars is expected to reveal additional CME events, and possible mode-changing events. Such detections will not only improve our understanding of solar and pulsar magnetospheric plasma interactions but will also enable more accurate modelling of DM variations, leading to improved pulsar timing solutions, which are crucial for high-precision Pulsar Timing Array (PTA) science.

astro-ph.HE↗

Interpreting the Effects of Quantization on LLMs

Quantization offers a practical solution to deploy LLMs in resource-constraint environments. However, its impact on internal representations remains understudied, raising questions about the reliability of quantized models. In this study, we employ a range of interpretability techniques to investigate how quantization affects model and neuron behavior. We analyze multiple LLMs under 4-bit and 8-bit quantization. Our findings reveal that the impact of quantization on model calibration is generally minor. Analysis of neuron activations indicates that the number of dead neurons, i.e., those with activation values close to 0 across the dataset, remains consistent regardless of quantization. In terms of neuron contribution to predictions, we observe that smaller full precision models exhibit fewer salient neurons, whereas larger models tend to have more, with the exception of Llama-2-7B. The effect of quantization on neuron redundancy varies across models. Overall, our findings suggest that effect of quantization may vary by model and tasks, however, we did not observe any drastic change which may discourage the use of quantization as a reliable model compression technique.

cs.LG↗

Neu-RadBERT for Enhanced Diagnosis of Brain Injuries and Conditions

Objective: We sought to develop a classification algorithm to extract diagnoses from free-text radiology reports of brain imaging performed in patients with acute respiratory failure (ARF) undergoing invasive mechanical ventilation. Methods: We developed and fine-tuned Neu-RadBERT, a BERT-based model, to classify unstructured radiology reports. We extracted all the brain imaging reports (computed tomography and magnetic resonance imaging) from MIMIC-IV database, performed in patients with ARF. Initial manual labelling was performed on a subset of reports for various brain abnormalities, followed by fine-tuning Neu-RadBERT using three strategies: 1) baseline RadBERT, 2) Neu-RadBERT with Masked Language Modeling (MLM) pretraining, and 3) Neu-RadBERT with MLM pretraining and oversampling to address data skewness. We compared the performance of this model to Llama-2-13B, an autoregressive LLM. Results: The Neu-RadBERT model, particularly with oversampling, demonstrated significant improvements in diagnostic accuracy compared to baseline RadBERT for brain abnormalities, achieving up to 98.0% accuracy for acute brain injuries. Llama-2-13B exhibited relatively lower performance, peaking at 67.5% binary classification accuracy. This result highlights potential limitations of current autoregressive LLMs for this specific classification task, though it remains possible that larger models or further fine-tuning could improve performance. Conclusion: Neu-RadBERT, enhanced through target domain pretraining and oversampling techniques, offered a robust tool for accurate and reliable diagnosis of neurological conditions from radiology reports. This study underscores the potential of transformer-based NLP models in automatically extracting diagnoses from free text reports with potential applications to both research and patient care.

q-bio.TO↗

The Indian Pulsar Timing Array Data Release 2: I. Dataset and Timing Analysis

The Indian Pulsar Timing Array (InPTA) employs unique features of the upgraded Giant Metrewave Radio Telescope (uGMRT) to monitor dozens of the International Pulsar Timing Array (IPTA) millisecond pulsars (MSPs), simultaneously in the 300-500 MHz and the 1260-1460 MHz bands. This dual-band approach ensures that any frequency-dependent delays are accurately characterized, significantly improving the timing precision for pulsar observations, which is crucial for pulsar timing arrays. We present details of InPTA's second data release that involves 7 yrs of data on 27 IPTA MSPs. This includes sub-banded Times of Arrival (ToAs), Dispersion Measures (DM), and initial timing ephemerides for our MSPs. A part of this dataset, originally released in InPTA's first data release, is being incorporated into IPTA's third data release which is expected to detect and characterize nanohertz gravitational waves in the coming years. The entire dataset is reprocessed in this second data release providing some of the highest precision DM estimates so far and interesting solar wind related DM variations in some pulsars. This is likely to characterize the noise introduced by the dynamic inter-stellar ionised medium much better than the previous release thereby increasing sensitivity to any future gravitational wave search.

astro-ph.IM↗

Quasitoric representation of generalized braids

In this paper, we define generalized braid theories in alignment with the language of Fenn and Bartholomew for knot theories, and compute a generating set for the pure generalized braid theories. Using this, we prove that every oriented normal generalized knot is the closure of a quasitoric normal generalized braid. Further, we prove that the set of quasitoric normal generalized braids forms a subgroup of normal generalized braid group.

math.GT↗

Fine-grained large-scale content recommendations for MSX sellers

One of the most critical tasks of Microsoft sellers is to meticulously track and nurture potential business opportunities through proactive engagement and tailored solutions. Recommender systems play a central role to help sellers achieve their goals. In this paper, we present a content recommendation model which surfaces various types of content (technical documentation, comparison with competitor products, customer success stories etc.) that sellers can share with their customers or use for their own self-learning. The model operates at the opportunity level which is the lowest possible granularity and the most relevant one for sellers. It is based on semantic matching between metadata from the contents and carefully selected attributes of the opportunities. Considering the volume of seller-managed opportunities in organizations such as Microsoft, we show how to perform efficient semantic matching over a very large number of opportunity-content combinations. The main challenge is to ensure that the top-5 relevant contents for each opportunity are recommended out of a total of $\approx 40,000$ published contents. We achieve this target through an extensive comparison of different model architectures and feature selection. Finally, we further examine the quality of the recommendations in a quantitative manner using a combination of human domain experts as well as by using the recently proposed "LLM as a judge" framework.

cs.IR↗

Twisted Yang-Baxter sets, cohomology theory, and application to knots

We introduce twisted set-theoretic Yang-Baxter solutions and develop an associated cohomology theory, which extends the standard cohomology theory of Yang-Baxter solutions. By employing cocycles of twisted biquandles along with Alexander numbering, we construct state-sum invariants for knots and knotted surfaces. As an application, we use our approach to distinguish the $2$-twist spun trefoil from its reverse orientation, in line with prior findings.

math.GT↗

Bridging colorings of virtual links from virtual biquandles to biquandles

A biquandle is a solution to the set-theoretical Yang-Baxter equation, which yields invariants for virtual knots such as the coloring number and the state-sum invariant. A virtual biquandle enriches the structure of a biquandle by incorporating an invertible unary map. This unary operator plays a crucial role in defining the action of virtual crossings on the labels of incoming arcs in a virtual link diagram. This leads to extensions of invariants from biquandles to virtual biquandles, thereby enhancing their strength. In this article, we establish a connection between the coloring invariant derived from biquandles and virtual biquandles. We prove that the number of colorings of a virtual link $L$ by virtual biquandles can be recovered from colorings by biquandles. We achieve this by proving the equivalence between two different representations of virtual braid groups. Furthermore, we introduce a new set of labeling rules using which one can construct a presentation of the associated fundamental virtual biquandle of $L$ using only the relations coming from the classical crossings. This is an improvement to the traditional method, where writing down a presentation of the associated fundamental virtual biquandle necessitates noting down the relations arising from the classical and virtual crossings.

math.GT↗

Motion Informed Needle Segmentation in Ultrasound Images

Segmenting a moving needle in ultrasound images is challenging due to the presence of artifacts, noise, and needle occlusion. This task becomes even more demanding in scenarios where data availability is limited. In this paper, we present a novel approach for needle segmentation for 2D ultrasound that combines classical Kalman Filter (KF) techniques with data-driven learning, incorporating both needle features and needle motion. Our method offers three key contributions. First, we propose a compatible framework that seamlessly integrates into commonly used encoder-decoder style architectures. Second, we demonstrate superior performance compared to recent state-of-the-art needle segmentation models using our novel convolutional neural network (CNN) based KF-inspired block, achieving a 15\% reduction in pixel-wise needle tip error and an 8\% reduction in length error. Third, to our knowledge we are the first to implement a learnable filter to incorporate non-linear needle motion for improving needle segmentation.

eess.IV↗

A case study of Generative AI in MSX Sales Copilot: Improving seller productivity with a real-time question-answering system for content recommendation

In this paper, we design a real-time question-answering system specifically targeted for helping sellers get relevant material/documentation they can share live with their customers or refer to during a call. Taking the Seismic content repository as a relatively large scale example of a diverse dataset of sales material, we demonstrate how LLM embeddings of sellers' queries can be matched with the relevant content. We achieve this by engineering prompts in an elaborate fashion that makes use of the rich set of meta-features available for documents and sellers. Using a bi-encoder with cross-encoder re-ranker architecture, we show how the solution returns the most relevant content recommendations in just a few seconds even for large datasets. Our recommender system is deployed as an AML endpoint for real-time inferencing and has been integrated into a Copilot interface that is now deployed in the production version of the Dynamics CRM, known as MSX, used daily by Microsoft sellers.

cs.IR↗

Endomorphism monoid and automorphism group of residually finite and profinite quandles

We explore residually finite and profinite quandles. We prove that the endomorphism monoid and the automorphism group of finitely generated residually finite quandles are residually finite. In fact, we establish the similar result for a broad class of residually finite quandles. We provide a topological characterization of profinite quandles. We establish necessary and sufficient conditions for profinite quandles ensuring that their endomorphism monoids and automorphism groups are profinite.

math.GR↗

PyRCA: A Library for Metric-based Root Cause Analysis

We introduce PyRCA, an open-source Python machine learning library of Root Cause Analysis (RCA) for Artificial Intelligence for IT Operations (AIOps). It provides a holistic framework to uncover the complicated metric causal dependencies and automatically locate root causes of incidents. It offers a unified interface for multiple commonly used RCA models, encompassing both graph construction and scoring tasks. This library aims to provide IT operations staff, data scientists, and researchers a one-step solution to rapid model development, model evaluation and deployment to online applications. In particular, our library includes various causal discovery methods to support causal graph construction, and multiple types of root cause scoring methods inspired by Bayesian analysis, graph analysis and causal analysis, etc. Our GUI dashboard offers practitioners an intuitive point-and-click interface, empowering them to easily inject expert knowledge through human interaction. With the ability to visualize causal graphs and the root cause of incidents, practitioners can quickly gain insights and improve their workflow efficiency. This technical report introduces PyRCA's architecture and major functionalities, while also presenting benchmark performance numbers in comparison to various baseline models. Additionally, we demonstrate PyRCA's capabilities through several example use cases.

cs.AI↗

AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges

Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes, particularly in cloud infrastructures, to provide actionable insights with the primary goal of maximizing availability. There are a wide variety of problems to address, and multiple use-cases, where AI capabilities can be leveraged to enhance operational efficiency. Here we provide a review of the AIOps vision, trends challenges and opportunities, specifically focusing on the underlying AI techniques. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions. We discuss the problem formulation for each task, and then present a taxonomy of techniques to solve these problems. We also identify relatively under explored topics, especially those that could significantly benefit from advances in AI literature. We also provide insights into the trends in this field, and what are the key investment opportunities.

cs.LG↗

Electrostatic Plasma wave excitations at the interplanetary shocks

Over the last few decades, different types of plasma waves (e.g., the ion acoustic waves (IAWs), electrostatic solitary waves (ESWs), upper/lower hybrid waves, the Langmuir waves etc.) have been observed in the upstream, downstream and ramp regions of the collisionless interplanetary (IP) shocks. These waves appear as short duration (only a few milliseconds at 1 au) electric field signatures in the in-situ measurements, with typical frequencies $\sim1-10$ kHz. A number of IAW features at the IP shocks seem to be unexplained by kinetic models and requires a new modeling effort. Thus, this paper is dedicated to bridge this gap. In this paper, we model the linear IAWs inside the shock ramp, by devising a novel linearization method of the two-fluid magnetohydrodynamic equations with spatially dependent shock parameters. It is found that, for parallel propagating waves, the linear dispersion relation leads to a finite growth rate dependent on the the shock density compression ratio, as Wind data suggest. Further analysis reveals that the wave frequency grows towards the downstream within the shock ramp, and the wave growth rate is independent of the electron-to-ion temperature ratio, as Magnetospheric Multiscale (MMS) in-situ measurements suggest, and uniform within the shock ramp. Thus, this study help understand the characteristics of the IAWs at the collisionless IP shocks.

physics.plasm-ph↗

Constructing an infinite family of quandles from a quandle

Quandles are self-distributive, right-invertible, idempotent algebras. A group with conjugation for binary operation is an example of a quandle. Given a quandle $(Q, \ast)$ and a positive integer $n$, define $a\ast_n b = (\cdots (a\ast \underbrace{b)\ast \cdots )\ast b}_{n}$, where $a, b \in Q$. Then, $(Q, \ast_n)$ is again a quandle. We set forth the following problem. ``Find $(Q, \ast)$ such that the sequence $\{(Q, \ast_n)\, :\, n\in \mathbb{Z}^+ \}$ is made up of pairwise non-isomorphic quandles.'' In this article we find such a quandle $(Q, \ast)$. We study the general linear group of $2$-by-$2$ matrices over $\mathbb{C}$ as a quandle under conjugation. Its (algebraically) connected components, that is, its conjugacy classes, are subquandles of it. We show the latter are connected as quandles and prove rigidity results about them such as the dihedral quandle of order $3$ is not a subquandle for most of them. Then we consider the quandle which is the projective linear group of $2$-by-$2$ matrices over $\mathbb{C}$ with conjugation, and prove it solves the problem above. In the course of this work we prove a sufficient and necessary condition for a quandle to be latin. This will reduce significantly the complexity of algorithms for ascertaining if a quandle is latin.

math.GR↗

Pairs, trimers and BCS-BEC crossover near a flat band: the sawtooth lattice

We investigate pairing and superconductivity in the attractive Fermi Hubbard model on the one-dimensional sawtooth lattice, which exhibits a flat band by fine-tuning the hopping rates. We first solve the two-body problem, both analytically and numerically, to extract the binding energy and the effective mass of the pairs. Based on the DMRG method, we address the ground-state properties of the many-body system, assuming equal spin populations. We compare our results with those available for a linear chain, where the model is integrable by Bethe ansatz, and show that the multiband nature of the system substantially modifies the physics of the BCS-BEC crossover. Near a flat band, the chemical potential remains always close to its zero-density limit predicted by the two-body physics. In contrast, the pairing gap exhibits a remarkably strong density dependence and, differently from the pair binding energy, it is no longer peaked at the flat-band point. We show that these results can be interpreted in terms of polarization screening effects, due to an anomalous attraction between pairs in the medium and single fermions. Importantly, we unveil that three-body bound states (trimers) exist in the sawtooth lattice, in sharp contrast with the linear chain geometry, and we compute their binding energy. The nature of these states is investigated via a strong coupling variational approach, revealing that they originate from tunneling-induced exchange processes.

cond-mat.quant-gas↗

Virtually Symmetric representations and marked Gauss diagrams

In this paper, we define the notion of a virtually symmetric representation of representations of virtual braid groups and prove that many known representations are equivalent to virtually symmetric. Using one such representation, we define the notion of virtual link groups which is an extension of virtual link groups defined by Kauffman. Moreover, we introduce the concept of marked Gauss diagrams as a generalisation of Gauss diagrams and their interpretation in terms of knot-like diagrams. We extend the definition of virtual link groups to marked Gauss diagrams and define their peripheral structure. We define $C_m$-groups and prove that every group presented by a $1$-irreducible $C_1$-presentation of deficiency $1$ or $2$ can be realized as the group of a marked Gauss diagram.

math.GT↗

Merlion: A Machine Learning Library for Time Series

We introduce Merlion, an open-source machine learning library for time series. It features a unified interface for many commonly used models and datasets for anomaly detection and forecasting on both univariate and multivariate time series, along with standard pre/post-processing layers. It has several modules to improve ease-of-use, including visualization, anomaly score calibration to improve interpetability, AutoML for hyperparameter tuning and model selection, and model ensembling. Merlion also provides a unique evaluation framework that simulates the live deployment and re-training of a model in production. This library aims to provide engineers and researchers a one-stop solution to rapidly develop models for their specific time series needs and benchmark them across multiple time series datasets. In this technical report, we highlight Merlion's architecture and major functionalities, and we report benchmark numbers across different baseline models and ensembles.

cs.LG↗