arXiv subjects

Kexin Zhang

Publications and source records attributed to Kexin Zhang.

At least 91 records · Page 5Linked to original sources

arXiv2024

Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework

Semantic Communication (SC) is an emerging technology aiming to surpass the Shannon limit. Traditional SC strategies often minimize signal distortion between the original and reconstructed data, neglecting perceptual quality, especially in low Signal-to-Noise Ratio (SNR) environments. To address this issue, we introduce a novel Generative AI Semantic Communication (GSC) system for single-user scenarios. This system leverages deep generative models to establish a new paradigm in SC. Specifically, At the transmitter end, it employs a joint source-channel coding mechanism based on the Swin Transformer for efficient semantic feature extraction and compression. At the receiver end, an advanced Diffusion Model (DM) reconstructs high-quality images from degraded signals, enhancing perceptual details. Additionally, we present a Multi-User Generative Semantic Communication (MU-GSC) system utilizing an asynchronous processing model. This model effectively manages multiple user requests and optimally utilizes system resources for parallel processing. Simulation results on public datasets demonstrate that our generative AI semantic communication systems achieve superior transmission efficiency and enhanced communication content quality across various channel conditions. Compared to CNN-based DeepJSCC, our methods improve the Peak Signal-to-Noise Ratio (PSNR) by 17.75% in Additive White Gaussian Noise (AWGN) channels and by 20.86% in Rayleigh channels.

cs.LG↗

arXiv2024

Technique Report of CVPR 2024 PBDL Challenges

The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies. By leveraging the principles of physics to inform and enhance deep learning models, we can develop more robust and accurate vision systems. Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, and medium properties from images. In recent years, deep learning has shown promising improvements for various vision tasks, and when combined with physics-based vision, these approaches can enhance the robustness and accuracy of vision systems. This technical report summarizes the outcomes of the Physics-Based Vision Meets Deep Learning (PBDL) 2024 challenge, held in CVPR 2024 workshop. The challenge consisted of eight tracks, focusing on Low-Light Enhancement and Detection as well as High Dynamic Range (HDR) Imaging. This report details the objectives, methodologies, and results of each track, highlighting the top-performing solutions and their innovative approaches.

cs.CV↗

arXiv2024

Heterogeneous Causal Metapath Graph Neural Network for Gene-Microbe-Disease Association Prediction

The recent focus on microbes in human medicine highlights their potential role in the genetic framework of diseases. To decode the complex interactions among genes, microbes, and diseases, computational predictions of gene-microbe-disease (GMD) associations are crucial. Existing methods primarily address gene-disease and microbe-disease associations, but the more intricate triple-wise GMD associations remain less explored. In this paper, we propose a Heterogeneous Causal Metapath Graph Neural Network (HCMGNN) to predict GMD associations. HCMGNN constructs a heterogeneous graph linking genes, microbes, and diseases through their pairwise associations, and utilizes six predefined causal metapaths to extract directed causal subgraphs, which facilitate the multi-view analysis of causal relations among three entity types. Within each subgraph, we employ a causal semantic sharing message passing network for node representation learning, coupled with an attentive fusion method to integrate these representations for predicting GMD associations. Our extensive experiments show that HCMGNN effectively predicts GMD associations and addresses association sparsity issue by enhancing the graph's semantics and structure.

cs.LG↗

arXiv2024

PVUW 2024 Challenge on Complex Video Understanding: Methods and Results

Pixel-level Video Understanding in the Wild Challenge (PVUW) focus on complex video understanding. In this CVPR 2024 workshop, we add two new tracks, Complex Video Object Segmentation Track based on MOSE dataset and Motion Expression guided Video Segmentation track based on MeViS dataset. In the two new tracks, we provide additional videos and annotations that feature challenging elements, such as the disappearance and reappearance of objects, inconspicuous small objects, heavy occlusions, and crowded environments in MOSE. Moreover, we provide a new motion expression guided video segmentation dataset MeViS to study the natural language-guided video understanding in complex environments. These new videos, sentences, and annotations enable us to foster the development of a more comprehensive and robust pixel-level understanding of video scenes in complex environments and realistic scenarios. The MOSE challenge had 140 registered teams in total, 65 teams participated the validation phase and 12 teams made valid submissions in the final challenge phase. The MeViS challenge had 225 registered teams in total, 50 teams participated the validation phase and 5 teams made valid submissions in the final challenge phase.

cs.CV↗

arXiv2024

3rd Place Solution for MOSE Track in CVPR 2024 PVUW workshop: Complex Video Object Segmentation

Video Object Segmentation (VOS) is a vital task in computer vision, focusing on distinguishing foreground objects from the background across video frames. Our work draws inspiration from the Cutie model, and we investigate the effects of object memory, the total number of memory frames, and input resolution on segmentation performance. This report validates the effectiveness of our inference method on the coMplex video Object SEgmentation (MOSE) dataset, which features complex occlusions. Our experimental results demonstrate that our approach achieves a J\&F score of 0.8139 on the test set, securing the third position in the final ranking. These findings highlight the robustness and accuracy of our method in handling challenging VOS scenarios.

cs.CV↗

arXiv2024

Position: What Can Large Language Models Tell Us about Time Series Analysis

Time series analysis is essential for comprehending the complexities inherent in various realworld systems and applications. Although large language models (LLMs) have recently made significant strides, the development of artificial general intelligence (AGI) equipped with time series analysis capabilities remains in its nascent phase. Most existing time series models heavily rely on domain knowledge and extensive model tuning, predominantly focusing on prediction tasks. In this paper, we argue that current LLMs have the potential to revolutionize time series analysis, thereby promoting efficient decision-making and advancing towards a more universal form of time series analytical intelligence. Such advancement could unlock a wide range of possibilities, including time series modality switching and question answering. We encourage researchers and practitioners to recognize the potential of LLMs in advancing time series analysis and emphasize the need for trust in these related efforts. Furthermore, we detail the seamless integration of time series analysis with existing LLM technologies and outline promising avenues for future research.

cs.LG↗

arXiv2024

Simultaneous Measurement of Thermal Conductivity and Heat Capacity Across Diverse Materials Using the Square-Pulsed Source (SPS) Technique

State-of-the-art techniques like dual-frequency Time-Domain Thermoreflectance (TDTR) and Frequency-Domain Thermoreflectance (FDTR) offer superb capability for simultaneous measurements of thermal conductivity and heat capacity with a spatial resolution on the order of 10 μm. However, their applicability is limited to highly conductive materials with an in-plane thermal conductivity exceeding 10 W/(m*K). In this paper, we introduce the Square-Pulsed Source (SPS) technique, offering a novel approach to concurrently measure thermal conductivity and heat capacity with a 10 μm spatial resolution, while significantly extending the measurable thermal conductivity range to an unprecedented low of 0.1 W/(m*K), offering enhanced versatility. To demonstrate and validate its efficacy, we conducted measurements on various standard materials--PMMA, silica, sapphire, silicon, and diamond--spanning a wide thermal conductivity range from 0.1 to 2000 W/(m*K). The obtained results exhibit remarkable agreement with literature values, with a typical measurement uncertainty of less than 10% across the entire thermal conductivity range. By providing a unique capability to characterize both highly and lowly conductive materials with micron-scale spatial resolution, the SPS method opens new avenues for understanding and engineering thermal properties across diverse applications.

physics.app-ph↗

arXiv2024

Performance advantage of quantum hypothesis testing for partially coherent optical sources

Determining the presence of a potential optical source in the interest region is important for an imaging system and can be achieved by using hypothesis testing. The previous studies assume that the potential source is completely incoherent. In this paper, this problem is generalized to the scenario with partially coherent sources and any prior probabilities. We compare the error probability limit given by the quantum Helstrom bound with the error probability given by direct decision based on the prior probability. On this basis, the quantum-optimal detection advantage and detection-useless region are analyzed. For practical purposes, we propose a specific detection strategy using binary spatial-mode demultiplexing, which can be used in the scenarios without any prior information. This strategy shows superior detection performance and the results hold prospects for achieving super-resolved microscopic and astronomical imaging.

quant-ph↗

arXiv2024

Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects

Self-supervised learning (SSL) has recently achieved impressive performance on various time series tasks. The most prominent advantage of SSL is that it reduces the dependence on labeled data. Based on the pre-training and fine-tuning strategy, even a small amount of labeled data can achieve high performance. Compared with many published self-supervised surveys on computer vision and natural language processing, a comprehensive survey for time series SSL is still missing. To fill this gap, we review current state-of-the-art SSL methods for time series data in this article. To this end, we first comprehensively review existing surveys related to SSL and time series, and then provide a new taxonomy of existing time series SSL methods by summarizing them from three perspectives: generative-based, contrastive-based, and adversarial-based. These methods are further divided into ten subcategories with detailed reviews and discussions about their key intuitions, main frameworks, advantages and disadvantages. To facilitate the experiments and validation of time series SSL methods, we also summarize datasets commonly used in time series forecasting, classification, anomaly detection, and clustering tasks. Finally, we present the future directions of SSL for time series analysis.

cs.LG↗

arXiv2024

Exploring the Design Space of Optical See-through AR Head-Mounted Displays to Support First Responders in the Field

First responders (FRs) navigate hazardous, unfamiliar environments in the field (e.g., mass-casualty incidents), making life-changing decisions in a split second. AR head-mounted displays (HMDs) have shown promise in supporting them due to its capability of recognizing and augmenting the challenging environments in a hands-free manner. However, the design space have not been thoroughly explored by involving various FRs who serve different roles (e.g., firefighters, law enforcement) but collaborate closely in the field. We interviewed 26 first responders in the field who experienced a state-of-the-art optical-see-through AR HMD, as well as its interaction techniques and four types of AR cues (i.e., overview cues, directional cues, highlighting cues, and labeling cues), soliciting their first-hand experiences, design ideas, and concerns. Our study revealed both generic and role-specific preferences and needs for AR hardware, interactions, and feedback, as well as identifying desired AR designs tailored to urgent, risky scenarios (e.g., affordance augmentation to facilitate fast and safe action). While acknowledging the value of AR HMDs, concerns were also raised around trust, privacy, and proper integration with other equipment. Finally, we derived comprehensive and actionable design guidelines to inform future AR systems for in-field FRs.

cs.HC↗

arXiv2023

A Counterexample for the Principal Eigenvalue of An Elliptic Operator with Large Advection

There are numerous studies focusing on the convergence of the principal eigenvalue $λ(s)$ as $s\to+\infty$ corresponding to the elliptic eigenvalue problem \begin{align*} -Δφ(x)-2s\mathbf{v}\cdot\nablaφ(x)+c(x)φ(x)=λ(s)φ(x),\quad x\in Ω, \end{align*} where $Ω$ is a bounded domain and the advection term $\mathbf{v}$ under some certain restrictions. In this paper, we construct an infinitely oscillating gradient advection term $\mathbf{v}=\nabla m(x)\in C^1(Ω)$ such that the principal eigenvalue $λ(s)$ does not converge as $s\to+\infty$. As far as we know, this is the first result that guarantee the non-convergence of the principal eigenvalue.

math.AP↗

arXiv2023

Charge qubits based on ultra-thin topological insulator films

We study how to use the surface states in a Bi$_{2}$Se$_{3}$ topological insulator ultra-thin film that are affected by finite size effects for the purpose of quantum computing. We demonstrate that: (i) surface states under the finite size effect can effectively form a two-level system where their energy levels lie in between the bulk energy gap and a logic qubit can be constructed, (ii) the qubit can be initialized and manipulated using electric pulses of simple forms, (iii) two-qubit entanglement is achieved through a $\sqrt{\text{SWAP}}$ operation when the two qubits are in a parallel setup, and (iv) alternatively, a Floquet state can be exploited to construct a qubit and two Floquet qubits can be entangled through a Controlled-NOT operation. The Floquet qubit offers robustness to background noise since there is always an oscillating electric field applied, and the single qubit operations are controlled by amplitude modulation of the oscillating field, which is convenient experimentally.

cond-mat.mes-hall↗

arXiv2023

The Robust Semantic Segmentation UNCV2023 Challenge Results

This paper outlines the winning solutions employed in addressing the MUAD uncertainty quantification challenge held at ICCV 2023. The challenge was centered around semantic segmentation in urban environments, with a particular focus on natural adversarial scenarios. The report presents the results of 19 submitted entries, with numerous techniques drawing inspiration from cutting-edge uncertainty quantification methodologies presented at prominent conferences in the fields of computer vision and machine learning and journals over the past few years. Within this document, the challenge is introduced, shedding light on its purpose and objectives, which primarily revolved around enhancing the robustness of semantic segmentation in urban scenes under varying natural adversarial conditions. The report then delves into the top-performing solutions. Moreover, the document aims to provide a comprehensive overview of the diverse solutions deployed by all participants. By doing so, it seeks to offer readers a deeper insight into the array of strategies that can be leveraged to effectively handle the inherent uncertainties associated with autonomous driving and semantic segmentation, especially within urban environments.

cs.CV↗

arXiv2023

SoccerNet 2023 Challenges Results

The SoccerNet 2023 challenges were the third annual video understanding challenges organized by the SoccerNet team. For this third edition, the challenges were composed of seven vision-based tasks split into three main themes. The first theme, broadcast video understanding, is composed of three high-level tasks related to describing events occurring in the video broadcasts: (1) action spotting, focusing on retrieving all timestamps related to global actions in soccer, (2) ball action spotting, focusing on retrieving all timestamps related to the soccer ball change of state, and (3) dense video captioning, focusing on describing the broadcast with natural language and anchored timestamps. The second theme, field understanding, relates to the single task of (4) camera calibration, focusing on retrieving the intrinsic and extrinsic camera parameters from images. The third and last theme, player understanding, is composed of three low-level tasks related to extracting information about the players: (5) re-identification, focusing on retrieving the same players across multiple views, (6) multiple object tracking, focusing on tracking players and the ball through unedited video streams, and (7) jersey number recognition, focusing on recognizing the jersey number of players from tracklets. Compared to the previous editions of the SoccerNet challenges, tasks (2-3-7) are novel, including new annotations and data, task (4) was enhanced with more data and annotations, and task (6) now focuses on end-to-end approaches. More information on the tasks, challenges, and leaderboards are available on https://www.soccer-net.org. Baselines and development kits can be found on https://github.com/SoccerNet.

cs.CV↗

arXiv2023

Realization of all-optical underdamped stochastic Stirling engine

We experimentally demonstrate a nano-scale stochastic Stirling heat engine operating in the underdamped regime. The setup involves an optically levitated silica particle that is subjected to a power-varying optical trap and periodically coupled to a cold/hot reservoir via switching on/off active feedback cooling. We conduct a systematic investigation of the engine's performance and find that both the output work and efficiency approach their theoretical limits under quasi-static conditions. Furthermore, we examine the dependence of the output work fluctuation on the cycle time and temperature difference between the hot and cold reservoirs. We observe that the distribution has a Gaussian profile in the quasi-static regime, whereas it becomes asymmetric and non-Gaussian as the cycle duration time decreases. This non-Gaussianity is qualitatively attributed to the strong correlation of the particle's position within a cycle in the non-equilibrium regime. Our experiments provide valuable insights into stochastic thermodynamics in the underdamped regime and open up new possibilities for the design of future nano-machines.

physics.optics↗

arXiv2023

Pulse-controlled qubit in semiconductor double quantum dots

We present a numerically-optimized multipulse framework for the quantum control of a single-electron charge qubit. Our framework defines a set of pulse sequences, necessary for the manipulation of the ideal qubit basis, that avoids errors associated with excitations outside the computational subspace. A novel control scheme manipulates the qubit adiabatically, while also retaining high speed and ability to perform a general single-qubit rotation. This basis generates spatially localized logical qubit states, making readout straightforward. We consider experimentally realistic semiconductor qubits with finite pulse rise and fall times and determine the fastest pulse sequence yielding the highest fidelity. We show that our protocol leads to improved control of a qubit. We present simulations of a double quantum dot in a semiconductor device to visualize and verify our protocol. These results can be generalized to other physical systems since they depend only on pulse rise and fall times and the energy gap between the two lowest eigenstates.

quant-ph↗

arXiv2022

"It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality

In social Virtual Reality (VR), users are embodied in avatars and interact with other users in a face-to-face manner using avatars as the medium. With the advent of social VR, people with disabilities (PWD) have shown an increasing presence on this new social media. With their unique disability identity, it is not clear how PWD perceive their avatars and whether and how they prefer to disclose their disability when presenting themselves in social VR. We fill this gap by exploring PWD's avatar perception and disability disclosure preferences in social VR. Our study involved two steps. We first conducted a systematic review of fifteen popular social VR applications to evaluate their avatar diversity and accessibility support. We then conducted an in-depth interview study with 19 participants who had different disabilities to understand their avatar experiences. Our research revealed a number of disability disclosure preferences and strategies adopted by PWD (e.g., reflect selective disabilities, present a capable self). We also identified several challenges faced by PWD during their avatar customization process. We discuss the design implications to promote avatar accessibility and diversity for future social VR platforms.

cs.HC↗

arXiv2022

Enhancement of the superconducting critical temperature realized in the La-Ce-H system at moderate pressures

Covalent and ionic polyhydrides have become the two main camps in searching for the high-temperature superconductors under pressure. They have been considered as important platforms for exploring ternary or multiple hydrides in order to further increase the Tc or decrease the stabilization pressure. In this work, we successfully synthesized ternary hexagonal La-Ce polyhydrides stable in the pressure range of 95-130 GPa by laser-heating the La-Ce alloy (initial ratio La:Ce=2.5-3.5) in ammonia borane. Superconductivity at 176 K was strikingly preserved to about 100 GPa. The extrapolated upper critical field Hc2(0) reached 216 T at 100 GPa, the highest value among the synthesized polyhydrides. We also performed the contrast experiments and stabilized binary high-temperature superconducting LaHx with Tc-103 K at 78 GPa. In the pressure range of 95-130 GPa, the ternary hexagonal La-Ce-H system exhibits higher Tc than the binary La-H system, with the maximum difference of 100 K, and the compounds of both systems were synthesized at the same pressure and temperature conditions. These results clearly indicate that the discovered La-Ce-H system not only enriches the high-temperature superconducting hydrides but also realizes high-Tc at moderate pressures.

cond-mat.supr-con↗