arXiv subjects

Yi Wang

Publications and source records attributed to Yi Wang.

At least 577 records · Page 32Linked to original sources

arXiv2024

Multi-modality transrectal ultrasound video classification for identification of clinically significant prostate cancer

Prostate cancer is the most common noncutaneous cancer in the world. Recently, multi-modality transrectal ultrasound (TRUS) has increasingly become an effective tool for the guidance of prostate biopsies. With the aim of effectively identifying prostate cancer, we propose a framework for the classification of clinically significant prostate cancer (csPCa) from multi-modality TRUS videos. The framework utilizes two 3D ResNet-50 models to extract features from B-mode images and shear wave elastography images, respectively. An adaptive spatial fusion module is introduced to aggregate two modalities' features. An orthogonal regularized loss is further used to mitigate feature redundancy. The proposed framework is evaluated on an in-house dataset containing 512 TRUS videos, and achieves favorable performance in identifying csPCa with an area under curve (AUC) of 0.84. Furthermore, the visualized class activation mapping (CAM) images generated from the proposed framework may provide valuable guidance for the localization of csPCa, thus facilitating the TRUS-guided targeted biopsy. Our code is publicly available at https://github.com/2313595986/ProstateTRUS.

eess.IV↗

arXiv2024

A Model of Solar Magnetic Flux Rope Eruption Initiated Primarily by Magnetic Reconnection

There is a heated debate regarding the specific roles played by ideal magnetohydrodynamic (MHD) instability and magnetic reconnection in the causes of solar eruptions. In the context with a pre-existing magnetic flux rope (MFR) before an eruption, it is widely believed that an ideal MHD instability, in particular, the torus instability, is responsible for triggering and driving the eruption, while reconnection, as invoked in the wake of the erupting MFR, plays a secondary role. Here we present a new numerical MHD model in which the eruption of a pre-existing MFR is primarily triggered and driven by reconnection. In this model, a stable MFR embedded in a strapping field is set as the initial condition. A surface converging flow is then applied at the lower boundary, pushing magnetic flux towards to the main polarity inversion line. It drives a quasi-static evolution of the system, during which a current layer is built up below the MFR with decreasing thickness. Once reconnection starts in the current sheet, the eruption commences, which indicates that the reconnection plays a determining role in triggers the eruption. By further analyzing the works done by in the magnetic flux of the pre-existing MFR and the newly reconnected flux during the acceleration stage of the eruption, we find that the latter plays a major role in driving the eruption. Such a model may explain observed eruptions in which the pre-eruption MFR has not reached the conditions for ideal instability.

astro-ph.SR↗

arXiv2024

Pyramid Attention Network for Medical Image Registration

The advent of deep-learning-based registration networks has addressed the time-consuming challenge in traditional iterative methods.However, the potential of current registration networks for comprehensively capturing spatial relationships has not been fully explored, leading to inadequate performance in large-deformation image registration.The pure convolutional neural networks (CNNs) neglect feature enhancement, while current Transformer-based networks are susceptible to information redundancy.To alleviate these issues, we propose a pyramid attention network (PAN) for deformable medical image registration.Specifically, the proposed PAN incorporates a dual-stream pyramid encoder with channel-wise attention to boost the feature representation.Moreover, a multi-head local attention Transformer is introduced as decoder to analyze motion patterns and generate deformation fields.Extensive experiments on two public brain magnetic resonance imaging (MRI) datasets and one abdominal MRI dataset demonstrate that our method achieves favorable registration performance, while outperforming several CNN-based and Transformer-based registration networks.Our code is publicly available at https://github.com/JuliusWang-7/PAN.

cs.CV↗

arXiv2024

Super stealth dicing of transparent solids with nanometric precision

Laser cutting of semiconductor wafers and transparent dielectrics has become a dominant process in manufacturing industries, encompassing a wide range of applications from flat display panels to microelectronic chips. Limited by the diffraction barrier imposed on the beam width and its longitudinal extend of laser focus, a trade-off must be made between cutting accuracy and aspect ratio in conventional laser processing, with accuracy typically approaching a micron and the aspect ratio on the order of $10^2$. Herein, we propose a method to circumvent this limitation. It is based on the laser modification induced by a back-scattering interference crawling mechanism, which creates a positive feedback for homogenizing longitudinal energy deposition and lateral sub-wavelength light confinement during laser-matter interaction. Consequently, cutting width on the scale of tens of nanometers and aspect ratio $10^3 \sim 10^4$ were simultaneously achieved. We refer to this technique as ``super stealth dicing'', which is validated through numerical simulations, ensuring its broad applicability. It can be applied to various transparent functional solids, such as glass, laser crystal, ferroelectric, and semiconductor, and is elevating the precision of future advanced laser dicing, patterning, and drilling into the nanometric era.

physics.optics↗

arXiv2024

A cocyclic construction of $S^1$-equivariant homology and application to string topology

Given a space with a circle action, we study certain cocyclic chain complexes and prove a theorem relating cyclic homology to $S^1$-equivariant homology, in the spirit of celebrated work of Jones. As an application, we describe a chain level refinement of the gravity algebra structure on the (negative) $S^1$-equivariant homology of the free loop space of a closed oriented smooth manifold, based on work of Irie on chain level string topology and work of Ward on an $S^1$-equivariant version of operadic Deligne's conjecture.

math.AT↗

arXiv2024

Explaining Time Series via Contrastive and Locally Sparse Perturbations

Explaining multivariate time series is a compound challenge, as it requires identifying important locations in the time series and matching complex temporal patterns. Although previous saliency-based methods addressed the challenges, their perturbation may not alleviate the distribution shift issue, which is inevitable especially in heterogeneous samples. We present ContraLSP, a locally sparse model that introduces counterfactual samples to build uninformative perturbations but keeps distribution using contrastive learning. Furthermore, we incorporate sample-specific sparse gates to generate more binary-skewed and smooth masks, which easily integrate temporal trends and select the salient features parsimoniously. Empirical studies on both synthetic and real-world datasets show that ContraLSP outperforms state-of-the-art models, demonstrating a substantial improvement in explanation quality for time series data. The source code is available at \url{https://github.com/zichuan-liu/ContraLSP}.

cs.LG↗

arXiv2024

From GPT-4 to Gemini and Beyond: Assessing the Landscape of MLLMs on Generalizability, Trustworthiness and Causality through Four Modalities

Multi-modal Large Language Models (MLLMs) have shown impressive abilities in generating reasonable responses with respect to multi-modal contents. However, there is still a wide gap between the performance of recent MLLM-based applications and the expectation of the broad public, even though the most powerful OpenAI's GPT-4 and Google's Gemini have been deployed. This paper strives to enhance understanding of the gap through the lens of a qualitative study on the generalizability, trustworthiness, and causal reasoning capabilities of recent proprietary and open-source MLLMs across four modalities: ie, text, code, image, and video, ultimately aiming to improve the transparency of MLLMs. We believe these properties are several representative factors that define the reliability of MLLMs, in supporting various downstream applications. To be specific, we evaluate the closed-source GPT-4 and Gemini and 6 open-source LLMs and MLLMs. Overall we evaluate 230 manually designed cases, where the qualitative results are then summarized into 12 scores (ie, 4 modalities times 3 properties). In total, we uncover 14 empirical findings that are useful to understand the capabilities and limitations of both proprietary and open-source MLLMs, towards more reliable downstream multi-modal applications.

cs.CV↗

arXiv2024

Fully nonlinear Yamabe-type problems on non-compact manifolds

We obtain existence results for a class of fully nonlinear Yamabe-type problems on non-compact manifolds, addressing both the so-called positive and negative cases. We also give explicit examples of manifolds with warped product ends and asymptotically flat ends satisfying the hypotheses of our theorems.

math.AP↗

arXiv2024

A self-supervised learning framework for seismic low-frequency extrapolation

Full waveform inversion (FWI) is capable of generating high-resolution subsurface parameter models, but it is susceptible to cycle-skipping when the data lack low-frequency. Unfortunately, the low-frequency components (< 5.0 Hz) are often tainted by noise in real seismic exploration, which hinders the application of FWI. To address this issue, we develop a novel self-supervised low-frequency extrapolation method that does not require labeled data, enabling neural networks to be trained directly on real data. This paradigm effectively addresses the significant generalization gap often encountered by supervised learning techniques, which are typically trained on synthetic data. We validate the effectiveness of our method on both synthetic and field data. The results demonstrate that our method effectively extrapolates low-frequency components, aiding in circumventing the challenges of cycle-skipping in FWI. Meanwhile, by integrating a self-supervised denoiser, our method effectively performs simultaneously denoising and low-frequency extrapolation on noisy data. Furthermore, we showcase the potential application of our method in extending the ultra-low frequency components of the large-scale collected earthquake seismogram.

physics.geo-ph↗

arXiv2024

Modulating binary dynamics via the termination of black hole superradiance

A superradiant cloud of ultralight bosons near a rotating black hole provides a smoking gun for particle physics in the infrared. However, tidal perturbations from a nearby binary companion can destabilise the boson cloud and even terminate superradiance. In this work, we consider the backreaction of superradiance termination to the dynamics of general binary orbits parametrised by their semi-latus rectum, eccentricity and inclination angle. Our analysis focuses on Extreme Mass Ratio Inspiral (EMRI) systems and employs the period-average approximation to derive evolution equations of these binary parameters in the Newtonian limit. We find that the binary evolution history can be significantly modulated by the backreaction towards large circular equatorial orbits with reduced termination rate. This process can generically happen even away from the resonance bands. Our work therefore serves as a first step towards probing ultralight bosons through the statistics of EMRI binary parameters in the future.

gr-qc↗

arXiv2024

VideoChat: Chat-Centric Video Understanding

In this paper, we initiate an attempt of developing an end-to-end chat-centric video understanding system, coined as VideoChat. It integrates video foundation models and large language models via a learnable neural interface, excelling in spatiotemporal reasoning, event localization, and causal relationship inference. To instructively tune this system, we build a video-centric instruction dataset, composed of thousands of videos associated with detailed descriptions and conversations. This dataset emphasizes spatiotemporal reasoning and captures causal relationships, providing a valuable asset for training our chat-centric video understanding system. Preliminary qualitative experiments demonstrate the potential of our system across a broad spectrum of video applications, which could serve as a simple prototype system for future research on chat-centric video understanding. Access our code and data at https://github.com/OpenGVLab/Ask-Anything

cs.CV↗

arXiv2024

InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation

This paper introduces InternVid, a large-scale video-centric multimodal dataset that enables learning powerful and transferable video-text representations for multimodal understanding and generation. The InternVid dataset contains over 7 million videos lasting nearly 760K hours, yielding 234M video clips accompanied by detailed descriptions of total 4.1B words. Our core contribution is to develop a scalable approach to autonomously build a high-quality video-text dataset with large language models (LLM), thereby showcasing its efficacy in learning video-language representation at scale. Specifically, we utilize a multi-scale approach to generate video-related descriptions. Furthermore, we introduce ViCLIP, a video-text representation learning model based on ViT-L. Learned on InternVid via contrastive learning, this model demonstrates leading zero-shot action recognition and competitive video retrieval performance. Beyond basic video understanding tasks like recognition and retrieval, our dataset and model have broad applications. They are particularly beneficial for generating interleaved video-text data for learning a video-centric dialogue system, advancing video-to-text and text-to-video generation research. These proposed resources provide a tool for researchers and practitioners interested in multimodal video understanding and generation.

cs.CV↗

arXiv2023

Seamless and multi-resolution energy forecasting

Energy forecasting is pivotal in energy systems, by providing fundamentals for operation, with different horizons and resolutions. Though energy forecasting has been widely studied for capturing temporal information, very few works concentrate on the frequency information provided by forecasts. They are consequently often limited to single-resolution applications (e.g., hourly). Here, we propose a unified energy forecasting framework based on Laplace transform in the multi-resolution context. The forecasts can be seamlessly produced at different desired resolutions without re-training or post-processing. Case studies on both energy demand and supply data show that the forecasts from our proposed method can provide accurate information in both time and frequency domains. Across the resolutions, the forecasts also demonstrate high consistency. More importantly, we explore the operational effects of our produced forecasts in the day-ahead and intra-day energy scheduling. The relationship between (i) errors in both time and frequency domains and (ii) operational value of the forecasts is analysed. Significant operational benefits are obtained.

eess.SP↗

arXiv2023

Guidelines in Wastewater-based Epidemiology of SARS-CoV-2 with Diagnosis

With the global spread and increasing transmission rate of SARS-CoV-2, more and more laboratories and researchers are turning their attention to wastewater-based epidemiology (WBE), hoping it can become an effective tool for large-scale testing and provide more ac-curate predictions of the number of infected individuals. Based on the cases of sewage sampling and testing in some regions such as Hong Kong, Brazil, and the United States, the feasibility of detecting the novel coronavirus in sewage is extremely high. This study re-views domestic and international achievements in detecting SARS-CoV-2 through WBE and summarizes four aspects of COVID-19, including sampling methods, virus decay rate cal-culation, standardized population coverage of the watershed, algorithm prediction, and provides ideas for combining field modeling with epidemic prevention and control. Moreover, we highlighted some diagnostic techniques for detection of the virus from sew-age sample. Our review is a new approach in identification of the research gaps in waste water-based epidemiology and diagnosis and we also predict the future prospect of our analysis.

q-bio.QM↗

arXiv2023

Global dynamics of three-dimensional Lotka-Volterra competition models with seasonal succession: I. Classification of dynamics

The current series of two papers focus on a 3-dimensional Lotka-Volterra competition model of differential equations with seasonal succession, which exhibits that populations experience an external periodically forced environment. We are devoted to providing a delicate global dynamical description for the model. In the first part of the series, we first use a novel technique to construct an index formula for the associated Poincare map, by which we thoroughly classify the dynamics of the model into 33 classes via the equivalence relation relative to boundary dynamics. More precisely, we show that in classes 1--18, there is no positive fixed point and every orbit tends to certain boundary fixed point. While, for classes 19--33, there exists at least one (but not necessarily unique) positive fixed point, that is, a positive harmonic time-periodic solution of the model. Among them, the dynamics is trivial in classes 19--25 and 33, provided that the positive fixed point is unique. We emphasize that, unlike the corresponding $2$-dimensional system, a major significant difference and difficulty for the analysis of the global dynamics for 3-dimensional system is that it may not possess the uniqueness of the positive fixed point. In the forthcoming second part of the series, we shall address the issues of (non-)uniqueness of the positive fixed points for the associated Poincare map.

math.DS↗

arXiv2023

Enabling Mammography with Co-Robotic Ultrasound

Ultrasound (US) imaging is a vital adjunct to mammography in breast cancer screening and diagnosis, but its reliance on hand-held transducers often lacks repeatability and heavily depends on sonographers' skills. Integrating US systems from different vendors further complicates clinical standards and workflows. This research introduces a co-robotic US platform for repeatable, accurate, and vendor-independent breast US image acquisition. The platform can autonomously perform 3D volume scans or swiftly acquire real-time 2D images of suspicious lesions. Utilizing a Universal Robot UR5 with an RGB camera, a force sensor, and an L7-4 linear array transducer, the system achieves autonomous navigation, motion control, and image acquisition. The calibrations, including camera-mammogram, robot-camera, and robot-US, were rigorously conducted and validated. Governed by a PID force control, the robot-held transducer maintains a constant contact force with the compression plate during the scan for safety and patient comfort. The framework was validated on a lesion-mimicking phantom. Our results indicate that the developed co-robotic US platform promises to enhance the precision and repeatability of breast cancer screening and diagnosis. Additionally, the platform offers straightforward integration into most mammographic devices to ensure vendor-independence.

cs.RO↗

arXiv2023

Dataset Distillation via Adversarial Prediction Matching

Dataset distillation is the technique of synthesizing smaller condensed datasets from large original datasets while retaining necessary information to persist the effect. In this paper, we approach the dataset distillation problem from a novel perspective: we regard minimizing the prediction discrepancy on the real data distribution between models, which are respectively trained on the large original dataset and on the small distilled dataset, as a conduit for condensing information from the raw data into the distilled version. An adversarial framework is proposed to solve the problem efficiently. In contrast to existing distillation methods involving nested optimization or long-range gradient unrolling, our approach hinges on single-level optimization. This ensures the memory efficiency of our method and provides a flexible tradeoff between time and memory budgets, allowing us to distil ImageNet-1K using a minimum of only 6.5GB of GPU memory. Under the optimal tradeoff strategy, it requires only 2.5$\times$ less memory and 5$\times$ less runtime compared to the state-of-the-art. Empirically, our method can produce synthetic datasets just 10% the size of the original, yet achieve, on average, 94% of the test accuracy of models trained on the full original datasets including ImageNet-1K, significantly surpassing state-of-the-art. Additionally, extensive tests reveal that our distilled datasets excel in cross-architecture generalization capabilities.

cs.CV↗

arXiv2023

Multi-delay arterial spin-labeled perfusion estimation with biophysics simulation and deep learning

Purpose: To develop biophysics-based method for estimating perfusion Q from arterial spin labeling (ASL) images using deep learning. Methods: A 3D U-Net (QTMnet) was trained to estimate perfusion from 4D tracer propagation images. The network was trained and tested on simulated 4D tracer concentration data based on artificial vasculature structure generated by constrained constructive optimization (CCO) method. The trained network was further tested in a synthetic brain ASL image based on vasculature network extracted from magnetic resonance (MR) angiography. The estimations from both trained network and a conventional kinetic model were compared in ASL images acquired from eight healthy volunteers. Results: QTMnet accurately reconstructed perfusion Q from concentration data. Relative error of the synthetic brain ASL image was 7.04% for perfusion Q, lower than the error using single-delay ASL model: 25.15% for Q, and multi-delay ASL model: 12.62% for perfusion Q. Conclusion: QTMnet provides accurate estimation on perfusion parameters and is a promising approach as a clinical ASL MRI image processing pipeline.

q-bio.QM↗