arXiv subjects

Weibo Gao

Publications and source records attributed to Weibo Gao.

At least 73 records · Page 4Linked to original sources

arXiv2024

Towards Faithful Explanations: Boosting Rationalization with Shortcuts Discovery

The remarkable success in neural networks provokes the selective rationalization. It explains the prediction results by identifying a small subset of the inputs sufficient to support them. Since existing methods still suffer from adopting the shortcuts in data to compose rationales and limited large-scale annotated rationales by human, in this paper, we propose a Shortcuts-fused Selective Rationalization (SSR) method, which boosts the rationalization by discovering and exploiting potential shortcuts. Specifically, SSR first designs a shortcuts discovery approach to detect several potential shortcuts. Then, by introducing the identified shortcuts, we propose two strategies to mitigate the problem of utilizing shortcuts to compose rationales. Finally, we develop two data augmentations methods to close the gap in the number of annotated rationales. Extensive experimental results on real-world datasets clearly validate the effectiveness of our proposed method.

cs.LG↗

arXiv2024

A Survey of Models for Cognitive Diagnosis: New Developments and Future Directions

Cognitive diagnosis has been developed for decades as an effective measurement tool to evaluate human cognitive status such as ability level and knowledge mastery. It has been applied to a wide range of fields including education, sport, psychological diagnosis, etc. By providing better awareness of cognitive status, it can serve as the basis for personalized services such as well-designed medical treatment, teaching strategy and vocational training. This paper aims to provide a survey of current models for cognitive diagnosis, with more attention on new developments using machine learning-based methods. By comparing the model structures, parameter estimation algorithms, model evaluation methods and applications, we provide a relatively comprehensive review of the recent trends in cognitive diagnosis models. Further, we discuss future directions that are worthy of exploration. In addition, we release two Python libraries: EduData for easy access to some relevant public datasets we have collected, and EduCDM that implements popular CDMs to facilitate both applications and research purposes.

cs.AI↗

arXiv2024

Dielectric Fano Nanoantennas for Enabling Sub-Nanosecond Lifetimes in NV-based Single Photon Emitters

Solid-state quantum emitters are essential sources of single photons, and enhancing their emission rates is of paramount importance for applications in quantum communications, computing, and metrology. One approach is to couple quantum emitters with resonant photonic nanostructures, where the emission rate is enhanced due to the Purcell effect. Dielectric nanoantennas are promising as they provide strong emission enhancement compared to plasmonic ones, which suffer from high Ohmic loss. Here, we designed and fabricated a dielectric Fano resonator based on a pair of silicon (Si) ellipses and a disk, which supports the mode hybridization between quasi-bound-states-in-the-continuum (quasi-BIC) and Mie resonance. We demonstrated the performance of the developed resonant system by interfacing it with single photon emitters (SPEs) based on nitrogen-vacancy (NV-) centers in nanodiamonds (NDs). We observed that the interfaced emitters have a Purcell enhancement factor of ~10, with sub-ns emission lifetime and a polarization contrast of 9. Our results indicate a promising method for developing efficient and compact single-photon sources for integrated quantum photonics applications.

physics.optics↗

arXiv2024

Room-temperature tunable tunneling magnetoresistance in Fe3GaTe2/WSe2/Fe3GaTe2 van der Waals heterostructures

The exceptional properties of two-dimensional (2D) magnet materials present a novel approach to fabricate functional magnetic tunnel junctions (MTJ) by constructing full van der Waals (vdW) heterostructures with atomically sharp and clean interfaces. The exploration of vdW MTJ devices with high working temperature and adjustable functionalities holds great potential for advancing the application of 2D materials in magnetic sensing and data storage. Here, we report the observation of highly tunable room-temperature tunneling magnetoresistance through electronic means in a full vdW Fe3GaTe2/WSe2/Fe3GaTe2 MTJ. The spin valve effect of the MTJ can be detected even with the current below 1 nA, both at low and room temperatures, yielding a tunneling magnetoresistance (TMR) of 340% at 2 K and 50% at 300 K, respectively. Importantly, the magnitude and sign of TMR can be modulated by a DC bias current, even at room temperature, a capability that was previously unrealized in full vdW MTJs. This tunable TMR arises from the contribution of energy-dependent localized spin states in the metallic ferromagnet Fe3GaTe2 during tunnel transport when a finite electrical bias is applied. Our work offers a new perspective for designing and exploring room-temperature tunable spintronic devices based on vdW magnet heterostructures.

cond-mat.mes-hall↗

arXiv2024

Robust Nuclear Spin Polarization via Ground-State Level Anti-Crossing of Boron Vacancy Defects in Hexagonal Boron Nitride

Nuclear spin polarization plays a crucial role in quantum information processing and quantum sensing. In this work, we demonstrate a robust and efficient method for nuclear spin polarization with boron vacancy ($\mathrm{V_B^-}$) defects in hexagonal boron nitride (h-BN) using ground-state level anti-crossing (GSLAC). We show that GSLAC-assisted nuclear polarization can be achieved with significantly lower laser power than excited-state level anti-crossing, making the process experimentally more viable. Furthermore, we have demonstrated direct optical readout of nuclear spins for $\mathrm{V_B^-}$ in h-BN. Our findings suggest that GSLAC is a promising technique for the precise control and manipulation of nuclear spins in $\mathrm{V_B^-}$ defects in h-BN.

quant-ph↗

arXiv2024

Event Grounded Criminal Court View Generation with Cooperative (Large) Language Models

With the development of legal intelligence, Criminal Court View Generation has attracted much attention as a crucial task of legal intelligence, which aims to generate concise and coherent texts that summarize case facts and provide explanations for verdicts. Existing researches explore the key information in case facts to yield the court views. Most of them employ a coarse-grained approach that partitions the facts into broad segments (e.g., verdict-related sentences) to make predictions. However, this approach fails to capture the complex details present in the case facts, such as various criminal elements and legal events. To this end, in this paper, we propose an Event Grounded Generation (EGG) method for criminal court view generation with cooperative (Large) Language Models, which introduces the fine-grained event information into the generation. Specifically, we first design a LLMs-based extraction method that can extract events in case facts without massive annotated events. Then, we incorporate the extracted events into court view generation by merging case facts and events. Besides, considering the computational burden posed by the use of LLMs in the extraction phase of EGG, we propose a LLMs-free EGG method that can eliminate the requirement for event extraction using LLMs in the inference phase. Extensive experimental results on a real-world dataset clearly validate the effectiveness of our proposed method.

cs.CL↗

arXiv2024

FedJudge: Federated Legal Large Language Model

Large Language Models (LLMs) have gained prominence in the field of Legal Intelligence, offering potential applications in assisting legal professionals and laymen. However, the centralized training of these Legal LLMs raises data privacy concerns, as legal data is distributed among various institutions containing sensitive individual information. This paper addresses this challenge by exploring the integration of Legal LLMs with Federated Learning (FL) methodologies. By employing FL, Legal LLMs can be fine-tuned locally on devices or clients, and their parameters are aggregated and distributed on a central server, ensuring data privacy without directly sharing raw data. However, computation and communication overheads hinder the full fine-tuning of LLMs under the FL setting. Moreover, the distribution shift of legal data reduces the effectiveness of FL methods. To this end, in this paper, we propose the first Federated Legal Large Language Model (FedJudge) framework, which fine-tunes Legal LLMs efficiently and effectively. Specifically, FedJudge utilizes parameter-efficient fine-tuning methods to update only a few additional parameters during the FL training. Besides, we explore the continual learning methods to preserve the global model's important parameters when training local clients to mitigate the problem of data shifts. Extensive experimental results on three real-world datasets clearly validate the effectiveness of FedJudge. Code is released at https://github.com/yuelinan/FedJudge.

cs.CL↗

arXiv2024

Cooperative Classification and Rationalization for Graph Generalization

Graph Neural Networks (GNNs) have achieved impressive results in graph classification tasks, but they struggle to generalize effectively when faced with out-of-distribution (OOD) data. Several approaches have been proposed to address this problem. Among them, one solution is to diversify training distributions in vanilla classification by modifying the data environment, yet accessing the environment information is complex. Besides, another promising approach involves rationalization, extracting invariant rationales for predictions. However, extracting rationales is difficult due to limited learning signals, resulting in less accurate rationales and diminished predictions. To address these challenges, in this paper, we propose a Cooperative Classification and Rationalization (C2R) method, consisting of the classification and the rationalization module. Specifically, we first assume that multiple environments are available in the classification module. Then, we introduce diverse training distributions using an environment-conditional generative network, enabling robust graph representations. Meanwhile, the rationalization module employs a separator to identify relevant rationale subgraphs while the remaining non-rationale subgraphs are de-correlated with labels. Next, we align graph representations from the classification module with rationale subgraph representations using the knowledge distillation methods, enhancing the learning signal for rationales. Finally, we infer multiple environments by gathering non-rationale representations and incorporate them into the classification module for cooperative learning. Extensive experimental results on both benchmarks and synthetic datasets demonstrate the effectiveness of C2R. Code is available at https://github.com/yuelinan/Codes-of-C2R.

cs.LG↗

arXiv2024

EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction

A robot's ability to anticipate the 3D action target location of a hand's movement from egocentric videos can greatly improve safety and efficiency in human-robot interaction (HRI). While previous research predominantly focused on semantic action classification or 2D target region prediction, we argue that predicting the action target's 3D coordinate could pave the way for more versatile downstream robotics tasks, especially given the increasing prevalence of headset devices. This study expands EgoPAT3D, the sole dataset dedicated to egocentric 3D action target prediction. We augment both its size and diversity, enhancing its potential for generalization. Moreover, we substantially enhance the baseline algorithm by introducing a large pre-trained model and human prior knowledge. Remarkably, our novel algorithm can now achieve superior prediction outcomes using solely RGB images, eliminating the previous need for 3D point clouds and IMU input. Furthermore, we deploy our enhanced baseline algorithm on a real-world robotic platform to illustrate its practical utility in straightforward HRI tasks. The demonstrations showcase the real-world applicability of our advancements and may inspire more HRI use cases involving egocentric vision. All code and data are open-sourced and can be found on the project website.

cs.RO↗

arXiv2024

Zero-1-to-3: Domain-level Zero-shot Cognitive Diagnosis via One Batch of Early-bird Students towards Three Diagnostic Objectives

Cognitive diagnosis seeks to estimate the cognitive states of students by exploring their logged practice quiz data. It plays a pivotal role in personalized learning guidance within intelligent education systems. In this paper, we focus on an important, practical, yet often underexplored task: domain-level zero-shot cognitive diagnosis (DZCD), which arises due to the absence of student practice logs in newly launched domains. Recent cross-domain diagnostic models have been demonstrated to be a promising strategy for DZCD. These methods primarily focus on how to transfer student states across domains. However, they might inadvertently incorporate non-transferable information into student representations, thereby limiting the efficacy of knowledge transfer. To tackle this, we propose Zero-1-to-3, a domain-level zero-shot cognitive diagnosis framework via one batch of early-bird students towards three diagnostic objectives. Our approach initiates with pre-training a diagnosis model with dual regularizers, which decouples student states into domain-shared and domain-specific parts. The shared cognitive signals can be transferred to the target domain, enriching the cognitive priors for the new domain, which ensures the cognitive state propagation objective. Subsequently, we devise a strategy to generate simulated practice logs for cold-start students through analyzing the behavioral patterns from early-bird students, fulfilling the domain-adaption goal. Consequently, we refine the cognitive states of cold-start students as diagnostic outcomes via virtual data, aligning with the diagnosis-oriented goal. Finally, extensive experiments on six real-world datasets highlight the efficacy of our model for DZCD and its practical application in question recommendation. The code is publicly available at https://github.com/bigdata-ustc/Zero-1-to-3.

cs.AI↗

arXiv2024

Quantum Metric Nonlinear Spin-Orbit Torque Enhanced by Topological Bands

Effects manifesting quantum geometry have been a focus of physics research. Here, we reveal that quantum metric plays a crucial role in nonlinear electric spin response, leading to a quantum metric spin-orbit torque. We argue that enhanced quantum metric can occur at band (anti)crossings, so the nonlinear torque could be amplified in topological metals with nodal features close to Fermi level. By applying our theory to magnetic Kane-Mele model and monolayer CrSBr, which feature nodal lines and Weyl points, we demonstrate that the quantum metric torque dominates the response, and its magnitude is significantly enhanced by topological band structures, which even surpasses the previously reported linear torques and is sufficient to drive magnetic switching by itself.

cond-mat.mes-hall↗

arXiv2024

FedGT: Federated Node Classification with Scalable Graph Transformer

Graphs are widely used to model relational data. As graphs are getting larger and larger in real-world scenarios, there is a trend to store and compute subgraphs in multiple local systems. For example, recently proposed \emph{subgraph federated learning} methods train Graph Neural Networks (GNNs) distributively on local subgraphs and aggregate GNN parameters with a central server. However, existing methods have the following limitations: (1) The links between local subgraphs are missing in subgraph federated learning. This could severely damage the performance of GNNs that follow message-passing paradigms to update node/edge features. (2) Most existing methods overlook the subgraph heterogeneity issue, brought by subgraphs being from different parts of the whole graph. To address the aforementioned challenges, we propose a scalable \textbf{Fed}erated \textbf{G}raph \textbf{T}ransformer (\textbf{FedGT}) in the paper. Firstly, we design a hybrid attention scheme to reduce the complexity of the Graph Transformer to linear while ensuring a global receptive field with theoretical bounds. Specifically, each node attends to the sampled local neighbors and a set of curated global nodes to learn both local and global information and be robust to missing links. The global nodes are dynamically updated during training with an online clustering algorithm to capture the data distribution of the corresponding local subgraph. Secondly, FedGT computes clients' similarity based on the aligned global nodes with optimal transport. The similarity is then used to perform weighted averaging for personalized aggregation, which well addresses the data heterogeneity problem. Moreover, local differential privacy is applied to further protect the privacy of clients. Finally, extensive experimental results on 6 datasets and 2 subgraph settings demonstrate the superiority of FedGT.

cs.LG↗

arXiv2023

ASSIST: Interactive Scene Nodes for Scalable and Realistic Indoor Simulation

We present ASSIST, an object-wise neural radiance field as a panoptic representation for compositional and realistic simulation. Central to our approach is a novel scene node data structure that stores the information of each object in a unified fashion, allowing online interaction in both intra- and cross-scene settings. By incorporating a differentiable neural network along with the associated bounding box and semantic features, the proposed structure guarantees user-friendly interaction on independent objects to scale up novel view simulation. Objects in the scene can be queried, added, duplicated, deleted, transformed, or swapped simply through mouse/keyboard controls or language instructions. Experiments demonstrate the efficacy of the proposed method, where scaled realistic simulation can be achieved through interactive editing and compositional rendering, with color images, depth images, and panoptic segmentation masks generated in a 3D consistent manner.

cs.CV↗

arXiv2023

Quantum metric-induced nonlinear transport in a topological antiferromagnet

The Berry curvature and quantum metric are the imaginary part and real part, respectively, of the quantum geometric tensor which characterizes the topology of quantum states. The former is known to generate a zoo of important discoveries such as quantum Hall effect and anomalous Hall effect (AHE), while the consequences of the quantum metric have rarely been probed by transport. In this work, we observed quantum metric induced nonlinear transport, including both nonlinear AHE and diode-like nonreciprocal longitudinal response, in thin films of a topological antiferromagnet, MnBi$_2$Te$_4$. Our observation reveals that the transverse and longitudinal nonlinear conductivities reverse signs when reversing the antiferromagnetic order, diminish above the Néel temperature, and are insensitive to disorder scattering, thus verifying their origin in the band structure topology. They also flip signs between electron and hole-doped regions, in agreement with theoretical calculations. Our work provides a pathway to probe the quantum metric through nonlinear transport and to design magnetic nonlinear devices.

cond-mat.mes-hall↗

arXiv2023

Engineering Perovskite Emissions via Optical Quasi-Bound-States-in-the-Continuum

Metal halide perovskite quantum dots (PQDs) have emerged as promising materials due to their exceptional photoluminescence (PL) properties. A wide range of applications could benefit from adjustable luminescence properties, while preserving the physical and chemical properties of the PQDs. Therefore, post-synthesis engineering has gained attention recently, involving the use of ion-exchange or external stimuli, such as extreme pressure, magnetic and electric fields. Nevertheless, these methods typically suffer from spectrum broadening, intensity quenching or yield multiple bands. Alternatively, photonic antennas can modify the radiative decay channel of perovskites via the Purcell effect, with the largest wavelength shift being 8 nm to date, at an expense of 5-fold intensity loss. Here, we present an optical nanoantenna array with polarization-controlled quasi-bound-states-in-the-continuum (q-BIC) resonances, which can engineer and shift the photoluminescence wavelength over a ~39 nm range and confers a 21-fold emission enhancement of FAPbI3 perovskite QDs. The spectrum is engineered in a non-invasive manner via lithographically defined antennas and the pump laser polarization at ambient conditions. Our research provides a path towards advanced optoelectronic devices, such as spectrally tailored quantum emitters and lasers.

physics.optics↗

arXiv2023

Spectral fingerprint of quantum confinement in single CsPbBr$_3$ nanocrystals

Lead halide perovskite nanocrystals are promising materials for classical and quantum light emission. To understand these outstanding properties, a thorough analysis of the band-edge exciton emission is needed which is not reachable in ensemble and room temperature studies because of broadening effects. Here, we report on a cryogenic-temperature study of the photoluminescence of single CsPbBr$_3$ NCs in the intermediate quantum confinement regime. We reveal the size-dependence of the spectral features observed: the bright-triplet exciton energy splittings, the trion and biexciton binding energies as well as the optical phonon replica spectrum. In addition, we show that bright triplet energy splittings are consistent with a pure exchange model and that the variety of polarisation properties and spectra recorded can be rationalised simply by considering the orientation of the emitting dipoles and the populations of the emitting states.

cond-mat.mes-hall↗

arXiv2023

Moiré Synergy: An Emerging Game Changer by Moiré of Moiré

Moiré superlattices of tunable wavelengths and the further developed moiré of moiré systems, by artificially assembling two-dimensional (2D) van der Waals (vdW) materials as designed, have brought up a versatile toolbox to explore fascinating condensed mater physics and their stimulating physicochemical functionalities. In this Perspective, we briefly review the recent progress in the emerging field of moiré synergy, highlighting the synergetic effects arising in distinct dual moiré heterostructures of graphene and transition metal dichalcogenides (TMDCs). A spectrum of moiré of moiré configurations, the advanced characterization and the exploitation efforts on the moiré-moiré interactions will be discussed. Finally, we look out for urgent challenges to be conquered in the community and some potential research directions in the near future.

cond-mat.mtrl-sci↗

arXiv2023

Interlayer donor-acceptor pair excitons in MoSe2/WSe2 moiré heterobilayer

Localized interlayer excitons (LIXs) in two-dimensional moiré superlattices exhibit sharp and dense emission peaks, making them promising as highly tunable single-photon sources. However, the fundamental nature of these LIXs is still elusive. Here, we show the donor-acceptor pair (DAP) mechanism as one of the origins of these excitonic peaks. Numerical simulation results of the DAP model agree with the experimental photoluminescence spectra of LIX in the moiré MoSe2/WSe2 heterobilayer. In particular, we find that the emission energy-lifetime correlation and the nonmonotonic power dependence of the lifetime agree well with the DAP IX model. Our results provide insight into the physical mechanism of LIX formation in moiré heterostructures and pave new directions for engineering interlayer exciton properties in moiré superlattices.

cond-mat.mes-hall↗