arXiv ScienceSearch

arXiv subjects

Chenyang Ren

Publications and source records attributed to Chenyang Ren.

10 recordsLinked to original sources

Dual IMU System for Accurate Gastrointestinal Motility Tracking

Gastrointestinal (GI) motility disorders impair the coordinated movement of food through the digestive tract. The Wireless Motility Capsule was developed to indirectly assess GI motility by recording pressure, pH, and temperature along the GI tract. Although an inertial measurement unit (IMU) enables precise and direct motion tracking, a single-IMU system is highly susceptible to artifacts caused by body movement and respiration. To address this limitation, we propose a dual-IMU system designed to distinguish intrinsic GI motility from extrinsic body motion. One IMU is integrated into an ingestible capsule to monitor internal movement, while a second IMU is worn externally to capture whole-body dynamics. Experimental validation was conducted using a turntable to simulate random body movements and a Stewart platform oscillating at 0.1 Hz to emulate GI motility. Three sensor fusion algorithms, including the Extended Kalman Filter, Madgwick Filter, and Mahony Filter, were benchmarked to calculate the real-time relative orientation between the two IMUs using quaternion analysis. The results show that the dual-IMU system effectively differentiates platform motion from turntable motion, demonstrating its potential to isolate GI-specific motility. Pearson correlation coefficients greater than 0.8 between the baseline and noise-cancelled motility signals indicate strong agreement and effective noise suppression.

eess.SP

Controllable Concept Bottleneck Models

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a human-understandable concept layer. However, most previous studies focused on static scenarios where the data and concepts are assumed to be fixed and clean. In real-world applications, deployed models require continuous maintenance: we often need to remove erroneous or sensitive data (unlearning), correct mislabeled concepts, or incorporate newly acquired samples (incremental learning) to adapt to evolving environments. Thus, deriving efficient editable CBMs without retraining from scratch remains a significant challenge, particularly in large-scale applications. To address these challenges, we propose Controllable Concept Bottleneck Models (CCBMs). Specifically, CCBMs support three granularities of model editing: concept-label-level, concept-level, and data-level, the latter of which encompasses both data removal and data addition. CCBMs enjoy mathematically rigorous closed-form approximations derived from influence functions that obviate the need for retraining. Experimental results demonstrate the efficiency and adaptability of our CCBMs, affirming their practical value in enabling dynamic and trustworthy CBMs.

cs.LG

Dynamics of evaporating, interconnected droplets

We report on the dynamics of a pair of sessile droplets that are connected by a microchannel, yet open to the atmosphere and hence free to evaporate. Our results reveal that fluid exchange between droplets occurs via a pumping flow driven by differences in hydrostatic and Laplace pressure between the two droplets. Evaporation causes the droplets to slowly lose volume and change shape, which subsequently affects the fluid transport between them. We observe that, for equal contact areas, a larger droplet typically feeds a smaller droplet during evaporation and the flow in the connecting channel is unidirectional. However, for unequal contact areas, the flow can reverse in the connecting channel following a sudden switch in dropletshape that occurs during evaporation. A stability,analysis reveals that the dynamics of the exchange flow are underpinned by a supercritical pitchfork bifurcation. Evaporative volume loss permits the droplet pair to step through a sequence of quasi-stationary states determined by the instantaneous volume of the system. Enforcing unequal contact area unfolds the bifurcation such that droplet-shape switching and the associated flow reversal can be understood in terms of a jump from the disconnected to the connected branch of the bifurcation. This establishes symmetry breaking as a mechanism to induce evaporation-driven flow reversal in connected droplets.

physics.flu-dyn

Attributing Data for Sharpness-Aware Minimization

Sharpness-aware Minimization (SAM) improves generalization in large-scale model training by linking loss landscape geometry to generalization. However, challenges such as mislabeled noisy data and privacy concerns have emerged as significant issues. Data attribution, which identifies the contributions of specific training samples, offers a promising solution. However, directly rendering existing data influence evaluation tools such as influence functions (IF) to SAM will be inapplicable or inaccurate as SAM utilizes an inner loop to find model perturbations that maximize loss, which the outer loop then minimizes, resulting in a doubled computational structure. Additionally, this bilevel structure complicates the modeling of data influence on the parameters. In this paper, based on the IF, we develop two innovative data valuation methods for SAM, each offering unique benefits in different scenarios: the Hessian-based IF and the Gradient Trajectory-based IF. The first one provides a comprehensive estimation of data influence using a closed-form measure that relies only on the trained model weights. In contrast, the other IF for SAM utilizes gradient trajectory information during training for more accurate and efficient data assessment. Extensive experiments demonstrate their effectiveness in data evaluation and parameter tuning, with applications in identifying mislabeled data, model editing, and enhancing interpretability.

cs.LG

Evaluating Data Influence in Meta Learning

As one of the most fundamental models, meta learning aims to effectively address few-shot learning challenges. However, it still faces significant issues related to the training data, such as training inefficiencies due to numerous low-contribution tasks in large datasets and substantial noise from incorrect labels. Thus, training data attribution methods are needed for meta learning. However, the dual-layer structure of mata learning complicates the modeling of training data contributions because of the interdependent influence between meta-parameters and task-specific parameters, making existing data influence evaluation tools inapplicable or inaccurate. To address these challenges, based on the influence function, we propose a general data attribution evaluation framework for meta-learning within the bilevel optimization framework. Our approach introduces task influence functions (task-IF) and instance influence functions (instance-IF) to accurately assess the impact of specific tasks and individual data points in closed forms. This framework comprehensively models data contributions across both the inner and outer training processes, capturing the direct effects of data points on meta-parameters as well as their indirect influence through task-specific parameters. We also provide several strategies to enhance computational efficiency and scalability. Experimental results demonstrate the framework's effectiveness in training data evaluation via several downstream tasks.

cs.LG

Dissecting Representation Misalignment in Contrastive Learning via Influence Function

Contrastive learning, commonly applied in large-scale multimodal models, often relies on data from diverse and often unreliable sources, which can include misaligned or mislabeled text-image pairs. This frequently leads to robustness issues and hallucinations, ultimately causing performance degradation. Data valuation is an efficient way to detect and trace these misalignments. Nevertheless, existing methods are computationally expensive for large-scale models. Although computationally efficient, classical influence functions are inadequate for contrastive learning models, as they were initially designed for pointwise loss. Furthermore, contrastive learning involves minimizing the distance between positive sample modalities while maximizing the distance between negative sample modalities. This necessitates evaluating the influence of samples from both perspectives. To tackle these challenges, we introduce the Extended Influence Function for Contrastive Loss (ECIF), an influence function crafted for contrastive loss. ECIF considers both positive and negative samples and provides a closed-form approximation of contrastive learning models, eliminating the need for retraining. Building upon ECIF, we develop a series of algorithms for data evaluation, misalignment detection, and misprediction trace-back tasks. Experimental results demonstrate our ECIF advances the transparency and interpretability of CLIP-style embedding models by offering a more accurate assessment of data impact and model alignment compared to traditional baseline methods.

cs.LG

Semi-supervised Concept Bottleneck Models

Concept Bottleneck Models (CBMs) have garnered increasing attention due to their ability to provide concept-based explanations for black-box deep learning models while achieving high final prediction accuracy using human-like concepts. However, the training of current CBMs is heavily dependent on the precision and richness of the annotated concepts in the dataset. These concept labels are typically provided by experts, which can be costly and require significant resources and effort. Additionally, concept saliency maps frequently misalign with input saliency maps, causing concept predictions to correspond to irrelevant input features - an issue related to annotation alignment. To address these limitations, we propose a new framework called SSCBM (Semi-supervised Concept Bottleneck Model). Our SSCBM is suitable for practical situations where annotated data is scarce. By leveraging joint training on both labeled and unlabeled data and aligning the unlabeled data at the concept level, we effectively solve these issues. We proposed a strategy to generate pseudo labels and an alignment loss. Experiments demonstrate that our SSCBM is both effective and efficient. With only 10% labeled data, our model's concept and task accuracy on average across four datasets is only 2.44% and 3.93% lower, respectively, compared to the best baseline in the fully supervised learning setting.

cs.CV

Editable Concept Bottleneck Models

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a humanunderstandable concept layer. However, most previous studies focused on cases where the data, including concepts, are clean. In many scenarios, we often need to remove/insert some training data or new concepts from trained CBMs for reasons such as privacy concerns, data mislabelling, spurious concepts, and concept annotation errors. Thus, deriving efficient editable CBMs without retraining from scratch remains a challenge, particularly in large-scale applications. To address these challenges, we propose Editable Concept Bottleneck Models (ECBMs). Specifically, ECBMs support three different levels of data removal: concept-label-level, concept-level, and data-level. ECBMs enjoy mathematically rigorous closed-form approximations derived from influence functions that obviate the need for retraining. Experimental results demonstrate the efficiency and adaptability of our ECBMs, affirming their practical value in CBMs.

cs.LG

Robust propagation of internal coastal Kelvin waves in complex domains

We experimentally investigate internal coastal Kelvin waves in a two-layer fluid system on a rotating table. Waves in our system propagate in the prograde direction and are exponentially localized near the boundary. Our experiments verify the theoretical dispersion relation of the wave and show that the wave amplitude decays exponentially along the propagation direction. We further demonstrate that the waves can robustly propagate along boundaries of complex geometries without being scattered and that adding obstacles to the wave propagation path does not cause additional attenuation.

physics.flu-dyn

Robust boundary flow in chiral active fluid

We perform experiments on an active chiral fluid system of self-spinning rotors in confining boundary. Along the boundary, actively rotating rotors collectively drives a unidirectional material flow. We systematically vary rotor density and boundary shape; boundary flow robustly emerges under all conditions. Flow strength initially increases then decreases with rotor density (quantified by area fraction $\phi$); peak strength appears around a density $\phi=0.65$. Boundary curvature plays an important role: flow near a concave boundary is stronger than that near a flat or convex boundary in the same confinements. Our experimental results in all cases can be reproduced by a continuum theory with single free fitting parameter, which describes the frictional property of the boundary. Our results support the idea that boundary flow in active chiral fluid is topologically protected; such robust flow can be used to develop materials with novel functions.

cond-mat.soft