arXiv subjects

You Song

Publications and source records attributed to You Song.

18 recordsLinked to original sources

arXiv2026

FACT: A Simple and Efficient Framework for Active Finetuning

The main goal of active finetuning is to improve a pretrained model's performance on a specific task or domain by finetuning it with carefully selected informative or challenging data. Previous research has predominantly focused on the active aspect (i.e., data selection) while uniformly employing full finetuning for model adaptation, which inevitably distorts pretrained features due to distribution shift. This issue becomes particularly pronounced when the model size is large relative to the finetuning data quantity, leading to heightened overfitting risks. To address this critical gap, we formally outline the FiAF task that emphasizes systematic exploration of finetuning methodologies in active learning. We propose FACT, a three-phase hierarchical finetuning framework featuring both efficiency and simplicity, specifically designed for active finetuning scenarios. Our comprehensive experiments span: (1) Three major dataset categories encompassing classic (CIFAR10, CIFAR100, ImageNet-1k), imbalanced (CIFAR10-LT, CIFAR100-LT), and fine-grained (StanfordCars, FGVCAircraft) image classification datasets, each evaluated under 3-5 distinct sampling ratios; (2) Diverse pretrained architectures including Convolutional Neural Network (ConvNeXt), Vision Transformer (ViT), and Vision LSTM (ViL) networks; (3) A systematic investigation of frozen feature augmentation (FroFA) strategies. (4) A comprehensive and rigorous analysis of efficiency and generalizability. The results demonstrate significant improvements with strong generalization and robustness. Notably, under low sampling ratios, our framework achieves remarkable performance gains of over 20% on the ViT model for CIFAR10, CIFAR100, and ImageNet-1k benchmarks. This systematic approach establishes new state-of-the-art performance while maintaining parameter efficiency, proving particularly effective when labeled data is scarce.

cs.CV↗

arXiv2026

FedSDR: Federated Self-Distillation with Rectification

Federated fine-tuning of Large Language Models faces severe statistical heterogeneity. However, existing model-level defenses often overlook the root cause: intrinsic data distribution mismatches. In this work, we first establish Federated Self-Distillation (FedSD) as a fundamental and potent strategy. By projecting client representations into a smoothed ``model-understanding space,'' FedSD alone serves as a universal booster, demonstrating superior performance over conventional algorithms. Despite its success, we identify a subtle trade-off termed the Rewrite Paradox -- unconstrained self-distillation can inadvertently increase hallucinations and redundancy. To refine this paradigm, we further propose FedSDR (Federated Self-Distillation with Rectification), the ultimate reinforced framework. It augments FedSD with a dual-stream mechanism: a local LoRA-S (Smoothing) branch to implicitly absorb heterogeneity via distilled data, and a parallel global LoRA-R (Rectification) branch anchored to raw data to enforce factual correctness. By selectively aggregating only LoRA-R, FedSDR yields a globally aligned and faithful model. Extensive experiments verify its superior performance.

cs.LG↗

arXiv2026

STDDN: A Physics-Guided Deep Learning Framework for Crowd Simulation

Accurate crowd simulation is crucial for public safety management, emergency evacuation planning, and intelligent transportation systems. However, existing methods, which typically model crowds as a collection of independent individual trajectories, are limited in their ability to capture macroscopic physical laws. This microscopic approach often leads to error accumulation and compromises simulation stability. Furthermore, deep learning-driven methods tend to suffer from low inference efficiency and high computational overhead, making them impractical for large-scale, efficient simulations. To address these challenges, we propose the Spatio-Temporal Decoupled Differential Equation Network (STDDN), a novel framework that guides microscopic trajectory prediction with macroscopic physics. We innovatively introduce the continuity equation from fluid dynamics as a strong physical constraint. A Neural Ordinary Differential Equation (Neural ODE) is employed to model the macroscopic density evolution driven by individual movements, thereby physically regularizing the microscopic trajectory prediction model. We design a density-velocity coupled dynamic graph learning module to formulate the derivative of the density field within the Neural ODE, effectively mitigating error accumulation. We also propose a differentiable density mapping module to eliminate discontinuous gradients caused by discretization and introduce a cross-grid detection module to accurately model the impact of individual cross-grid movements on local density changes. The proposed STDDN method has demonstrated significantly superior simulation performance compared to state-of-the-art methods on long-term tasks across four real-world datasets, as well as a major reduction in inference latency.

cs.LG↗

arXiv2024

RDPI: A Refine Diffusion Probability Generation Method for Spatiotemporal Data Imputation

Spatiotemporal data imputation plays a crucial role in various fields such as traffic flow monitoring, air quality assessment, and climate prediction. However, spatiotemporal data collected by sensors often suffer from temporal incompleteness, and the sparse and uneven distribution of sensors leads to missing data in the spatial dimension. Among existing methods, autoregressive approaches are prone to error accumulation, while simple conditional diffusion models fail to adequately capture the spatiotemporal relationships between observed and missing data. To address these issues, we propose a novel two-stage Refined Diffusion Probability Impuation (RDPI) framework based on an initial network and a conditional diffusion model. In the initial stage, deterministic imputation methods are used to generate preliminary estimates of the missing data. In the refinement stage, residuals are treated as the diffusion target, and observed values are innovatively incorporated into the forward process. This results in a conditional diffusion model better suited for spatiotemporal data imputation, bridging the gap between the preliminary estimates and the true values. Experiments on multiple datasets demonstrate that RDPI not only achieves state-of-the-art imputation accuracy but also significantly reduces sampling computational costs.

cs.LG↗

arXiv2023

One-shot neural band selection for spectral recovery

Band selection has a great impact on the spectral recovery quality. To solve this ill-posed inverse problem, most band selection methods adopt hand-crafted priors or exploit clustering or sparse regularization constraints to find most prominent bands. These methods are either very slow due to the computational cost of repeatedly training with respect to different selection frequencies or different band combinations. Many traditional methods rely on the scene prior and thus are not applicable to other scenarios. In this paper, we present a novel one-shot Neural Band Selection (NBS) framework for spectral recovery. Unlike conventional searching approaches with a discrete search space and a non-differentiable search strategy, our NBS is based on the continuous relaxation of the band selection process, thus allowing efficient band search using gradient descent. To enable the compatibility for se- lecting any number of bands in one-shot, we further exploit the band-wise correlation matrices to progressively suppress similar adjacent bands. Extensive evaluations on the NTIRE 2022 Spectral Reconstruction Challenge demonstrate that our NBS achieves consistent performance gains over competitive baselines when examined with four different spectral recov- ery methods. Our code will be publicly available.

cs.CV↗

arXiv2021

A comparative study on machine learning models combining with outlier detection and balanced sampling methods for credit scoring

Peer-to-peer (P2P) lending platforms have grown rapidly over the past decade as the network infrastructure has improved and the demand for personal lending has grown. Such platforms allow users to create peer-to-peer lending relationships without the help of traditional financial institutions. Assessing the borrowers' credit is crucial to reduce the default rate and benign development of P2P platforms. Building a personal credit scoring machine learning model can effectively predict whether users will repay loans on the P2P platform. And the handling of data outliers and sample imbalance problems can affect the final effect of machine learning models. There have been some studies on balanced sampling methods, but the effect of outlier detection methods and their combination with balanced sampling methods on the effectiveness of machine learning models has not been fully studied. In this paper, the influence of using different outlier detection methods and balanced sampling methods on commonly used machine learning models is investigated. Experiments on 44,487 Lending Club samples show that proper outlier detection can improve the effectiveness of the machine learning model, and the balanced sampling method only has a good effect on a few machine learning models, such as MLP.

cs.LG↗

arXiv2021

Managing dataset shift by adversarial validation for credit scoring

Dataset shift is common in credit scoring scenarios, and the inconsistency between the distribution of training data and the data that actually needs to be predicted is likely to cause poor model performance. However, most of the current studies do not take this into account, and they directly mix data from different time periods when training the models. This brings about two problems. Firstly, there is a risk of data leakage, i.e., using future data to predict the past. This can result in inflated results in offline validation, but unsatisfactory results in practical applications. Secondly, the macroeconomic environment and risk control strategies are likely to be different in different time periods, and the behavior patterns of borrowers may also change. The model trained with past data may not be applicable to the recent stage. Therefore, we propose a method based on adversarial validation to alleviate the dataset shift problem in credit scoring scenarios. In this method, partial training set samples with the closest distribution to the predicted data are selected for cross-validation by adversarial validation to ensure the generalization performance of the trained model on the predicted samples. In addition, through a simple splicing method, samples in the training data that are inconsistent with the test data distribution are also involved in the training process of cross-validation, which makes full use of all the data and further improves the model performance. To verify the effectiveness of the proposed method, comparative experiments with several other data split methods are conducted with the data provided by Lending Club. The experimental results demonstrate the importance of dataset shift in the field of credit scoring and the superiority of the proposed method.

cs.LG↗

arXiv2020

K-Core based Temporal Graph Convolutional Network for Dynamic Graphs

Graph representation learning is a fundamental task in various applications that strives to learn low-dimensional embeddings for nodes that can preserve graph topology information. However, many existing methods focus on static graphs while ignoring evolving graph patterns. Inspired by the success of graph convolutional networks(GCNs) in static graph embedding, we propose a novel k-core based temporal graph convolutional network, the CTGCN, to learn node representations for dynamic graphs. In contrast to previous dynamic graph embedding methods, CTGCN can preserve both local connective proximity and global structural similarity while simultaneously capturing graph dynamics. In the proposed framework, the traditional graph convolution is generalized into two phases, feature transformation and feature aggregation, which gives the CTGCN more flexibility and enables the CTGCN to learn connective and structural information under the same framework. Experimental results on 7 real-world graphs demonstrate that the CTGCN outperforms existing state-of-the-art graph embedding methods in several tasks, including link prediction and structural role classification. The source code of this work can be obtained from \url{https://github.com/jhljx/CTGCN}.

cs.LG↗

arXiv2020

Single-cell entropy to quantify the cellular transcription from single-cell RNA-seq data

We present the use of single-cell entropy (scEntropy) to measure the order of the cellular transcriptome profile from single-cell RNA-seq data, which leads to a method of unsupervised cell type classification through scEntropy followed by the Gaussian mixture model (scEGMM). scEntropy is straightforward in defining an intrinsic transcriptional state of a cell. scEGMM is a coherent method of cell type classification that includes no parameters and no clustering; however, it is comparable to existing machine learning-based methods in benchmarking studies and facilitates biological interpretation.

q-bio.QM↗

arXiv2019

An anomaly prediction framework for financial IT systems using hybrid machine learning methods

In financial field, a robust software system is of vital importance to ensure the smooth operation of financial transactions. However, many financial corporations still depend on operators to identify and eliminate the system failures when financial software systems break down. This traditional operation method is time consuming and extremely inefficient. To improve the efficiency and accuracy of system failure detection and thereby reduce the impact of system failures on financial services, we propose a novel machine learning-based framework to predict the occurrence of system exceptions and failures in a financial software system. In particular, we first extract rich information from system logs and eliminate noises in the data. Then the cleaned data is leveraged as the input of our proposed anomaly prediction framework which consists of three modules: key performance indicator(KPI) data prediction module, anomaly identification module and severity classification module. Notably, we design a hierarchical architecture of alarm classifiers and try to alleviate the influence of class-imbalance problem on the overall performance. Empirically, the experimental results demonstrate the superior performance of our proposed method on a real-world financial software system log data set.

cs.LG↗

arXiv2019

Unsupervised Cross-spectral Stereo Matching by Learning to Synthesize

Unsupervised cross-spectral stereo matching aims at recovering disparity given cross-spectral image pairs without any supervision in the form of ground truth disparity or depth. The estimated depth provides additional information complementary to individual semantic features, which can be helpful for other vision tasks such as tracking, recognition and detection. However, there are large appearance variations between images from different spectral bands, which is a challenge for cross-spectral stereo matching. Existing deep unsupervised stereo matching methods are sensitive to the appearance variations and do not perform well on cross-spectral data. We propose a novel unsupervised cross-spectral stereo matching framework based on image-to-image translation. First, a style adaptation network transforms images across different spectral bands by cycle consistency and adversarial learning, during which appearance variations are minimized. Then, a stereo matching network is trained with image pairs from the same spectra using view reconstruction loss. At last, the estimated disparity is utilized to supervise the spectral-translation network in an end-to-end way. Moreover, a novel style adaptation network F-cycleGAN is proposed to improve the robustness of spectral translation. Our method can tackle appearance variations and enhance the robustness of unsupervised cross-spectral stereo matching. Experimental results show that our method achieves good performance without using depth supervision or explicit semantic information.

cs.CV↗

arXiv2017

A Deep Learning Approach to the Citywide Traffic Accident Risk Prediction

With the rapid development of urbanization, the boom of vehicle numbers has resulted in serious traffic accidents, which led to casualties and huge economic losses. The ability to predict the risk of traffic accident is important in the prevention of the occurrence of accidents and to reduce the damages caused by accidents in a proactive way. However, traffic accident risk prediction with high spatiotemporal resolution is difficult, mainly due to the complex traffic environment, human behavior, and lack of real-time traffic-related data. In this study, we collected big traffic accident data. By analyzing the spatial and temporal patterns of traffic accident frequency, we presented the spatiotemporal correlation of traffic accidents. Based on the patterns we found in analysis, we proposed a high accurate deep learning model based on recurrent neural network toward the prediction of traffic accident risk. The predictive accident risk can be potential applied to the traffic accident warning system. The proposed method can be integrated into an intelligent traffic control system toward a more reasonable traffic prediction and command organization.

cs.CY↗

arXiv2016

Discovery of a new type of topological Weyl fermion semimetal state in Mo$_x$W$_{1-x}$Te$_2$

The recent discovery of a Weyl semimetal in TaAs offers the first Weyl fermion observed in nature and dramatically broadens the classification of topological phases. However, in TaAs it has proven challenging to study the rich transport phenomena arising from emergent Weyl fermions. The series Mo$_x$W$_{1-x}$Te$_2$ are inversion-breaking, layered, tunable semimetals already under study as a promising platform for new electronics and recently proposed to host Type II, or strongly Lorentz-violating, Weyl fermions. Here we report the discovery of a Weyl semimetal in Mo$_x$W$_{1-x}$Te$_2$ at $x = 25\%$. We use pump-probe angle-resolved photoemission spectroscopy (pump-probe ARPES) to directly observe a topological Fermi arc above the Fermi level, demonstrating a Weyl semimetal. The excellent agreement with calculation suggests that Mo$_x$W$_{1-x}$Te$_2$ is the first Type II Weyl semimetal. We also find that certain Weyl points are at the Fermi level, making Mo$_x$W$_{1-x}$Te$_2$ a promising platform for transport and optics experiments on Weyl semimetals.

cond-mat.mtrl-sci↗

arXiv2016

Measuring Chern numbers above the Fermi level in the Type II Weyl semimetal Mo$_x$W$_{1-x}$Te$_2$

It has recently been proposed that electronic band structures in crystals give rise to a previously overlooked type of Weyl fermion, which violates Lorentz invariance and, consequently, is forbidden in particle physics. It was further predicted that Mo$_x$W$_{1-x}$Te$_2$ may realize such a Type II Weyl fermion. One crucial challenge is that the Weyl points in Mo$_x$W$_{1-x}$Te$_2$ are predicted to lie above the Fermi level. Here, by studying a simple model for a Type II Weyl cone, we clarify the importance of accessing the unoccupied band structure to demonstrate that Mo$_x$W$_{1-x}$Te$_2$ is a Weyl semimetal. Then, we use pump-probe angle-resolved photoemission spectroscopy (pump-probe ARPES) to directly observe the unoccupied band structure of Mo$_x$W$_{1-x}$Te$_2$. For the first time, we directly access states $> 0.2$ eV above the Fermi level. By comparing our results with $\textit{ab initio}$ calculations, we conclude that we directly observe the surface state containing the topological Fermi arc. Our work opens the way to studying the unoccupied band structure as well as the time-domain relaxation dynamics of Mo$_x$W$_{1-x}$Te$_2$ and related transition metal dichalcogenides.

cond-mat.mes-hall↗

arXiv2016

Repairing atomic vacancies in single-layer MoSe2 field-effect transistor and its defect dynamics

Here we repair the single-layer MoSe2 field-effect transistors by the EDTA processing, after which the devices' room-temperature carrier mobility increases from 0.1 to over 70cm2/Vs. The atomic dynamics is constructed by the combined study of the first-principle calculation, aberration-corrected transmission electron microscopy and Raman spectroscopy. Single/double Se vacancies are revealed originally, which cause some mid-gap impurity states and localize the device carriers. They are found repaired with the result of improved electronic transport. Such a picture is confirmed by a 1.5cm-1 red shift in the Raman spectra.

cond-mat.mes-hall↗

arXiv2015

Unoccupied electronic structure and signatures of topological Fermi arcs in the Weyl semimetal candidate Mo$_x$W$_{1-x}$Te$_2$

Weyl semimetals have sparked intense research interest, but experimental work has been limited to the TaAs family of compounds. Recently, a number of theoretical works have predicted that compounds in the Mo$_x$W$_{1-x}$Te$_2$ series are Weyl semimetals. Such proposals are particularly exciting because Mo$_x$W$_{1-x}$Te$_2$ has a quasi two-dimensional crystal structure well-suited to many transport experiments, while WTe$_2$ and MoTe$_2$ have already been the subject of numerous proposals for device applications. However, with available ARPES techniques it is challenging to demonstrate a Weyl semimetal in Mo$_x$W$_{1-x}$Te$_2$. According to the predictions, the Weyl points are above the Fermi level, the system approaches two critical points as a function of doping, there are many irrelevant bulk bands, the Fermi arcs are nearly degenerate with bulk bands and the bulk band gap is small. Here, we study Mo$_x$W$_{1-x}$Te$_2$ for $x = 0.07$ and 0.45 using pump-probe ARPES. The system exhibits a dramatic response to the pump laser and we successfully access states $> 0.2$eV above the Fermi level. For the first time, we observe direct, experimental signatures of Fermi arcs in Mo$_x$W$_{1-x}$Te$_2$, which agree well with theoretical calculations of the surface states. However, we caution that the interpretation of these features depends sensitively on free parameters in the surface state calculation. We comment on the prospect of conclusively demonstrating a Weyl semimetal in Mo$_x$W$_{1-x}$Te$_2$.

cond-mat.mtrl-sci↗

arXiv2015

Mimicing the Kane-Mele type spin orbit interaction by spin-flexual phonon coupling in graphene devices

On the efforts of enhancing the spin orbit interaction (SOI) of graphene for seeking the dissipationless quantum spin Hall devices, unique Kane-Mele type SOI and high mobility samples are desired. However, common external decoration often introduces extrinsic Rashba-type SOI and simultaneous impurity scattering. Here we show, by the EDTA-Dy molecule decorating, the Kane-Mele type SOI is mimicked with even improved carrier mobility. It is evidenced by the suppressed weak localization at equal carrier densities and simultaneous Elliot-Yafet spin relaxation. The extracted spin scattering time is monotonically dependent on the carrier elastic scattering time, where the Elliot-Yafet plot gives the interaction strength of 3.3 meV. Improved quantum Hall plateaus can be even seen after the external operation. This is attributed to the spin-flexural phonon coupling induced by the enhanced graphene ripples, as revealed by the in-plane magnetotransport measurement.

cond-mat.mes-hall↗

arXiv2014

Enhanced quantum coherence in graphene caused by Pd cluster deposition

We report on the unexpected increase in the dephasing lengths of a graphene sheet caused by the deposition of Pd nanoclusters, as demonstrated by weak localization measurements. The dephasing lengths reached saturated values at low temperatures. Theoretical calculations indicate the p-type charge transfer from the Pd clusters, which contributes more carriers. The saturated values of dephasing lengths often depend on both the carrier concentration and mean free path. Although some impurities are increased as revealed by decreased mobilities, the intense charge transfer leads to the improved saturated values and subsequent improved dephasing lengths.

cond-mat.mes-hall↗