arXiv subjects

Yu Cheng

Publications and source records attributed to Yu Cheng.

At least 253 records · Page 14Linked to original sources

arXiv2025

Transferable and Forecastable User Targeting Foundation Model

User targeting, the process of selecting targeted users from a pool of candidates for non-expert marketers, has garnered substantial attention with the advancements in digital marketing. However, existing user targeting methods encounter two significant challenges: (i) Poor cross-domain and cross-scenario transferability and generalization, and (ii) Insufficient forecastability in real-world applications. These limitations hinder their applicability across diverse industrial scenarios. In this work, we propose FOUND, an industrial-grade, transferable, and forecastable user targeting foundation model. To enhance cross-domain transferability, our framework integrates heterogeneous multi-scenario user data, aligning them with one-sentence targeting demand inputs through contrastive pre-training. For improved forecastability, the text description of each user is derived based on anticipated future behaviors, while user representations are constructed from historical information. Experimental results demonstrate that our approach significantly outperforms existing baselines in cross-domain, real-world user targeting scenarios, showcasing the superior capabilities of FOUND. Moreover, our method has been successfully deployed on the Alipay platform and is widely utilized across various scenarios.

cs.LG↗

arXiv2025

The Core Mass Function Across Galactic Environments. IV. The Galactic Center

The origin of the stellar Initial Mass Function (IMF) and how it may vary with galactic environment is a matter of debate. Certain star formation theories involve a close connection between the IMF and the Core Mass Function (CMF) so it is important to measure this CMF in a range of Milky Way locations. Here we study the CMF of three Galactic Center clouds: G0.253+0.016 ("The Brick"), Sgr B2 (Deep South field) and Sgr C. We use ALMA 1 mm continuum images and identify cores as peaks in thermal dust emission via the dendrogram algorithm. We develop a completeness correction method via synthetic core insertion, utilizing a realistic mass-dependent size distribution. A power law $\text{d}N/\text{d}\log M \propto M^{-α}$ is fit to the CMFs $>2\:M_\odot$. The Brick has a Salpeter-like index $α=1.28\pm0.09$, while the other regions have shallower indices: Sgr C has $α=0.99\pm0.06$; Sgr B2-DS has $α=0.70\pm0.03$. When smoothed to a common resolution, the differences between the Brick and the others increase as we obtain $α=1.36\pm0.12$, $α=0.66\pm0.06$ and $α=0.62\pm0.04$, respectively, for masses $\gtrsim3\:M_\odot$. Furthermore, we analyze the spatial distribution and mass segregation of cores: Sgr C and Sgr B2-DS show signs of mass segregation, but the Brick does not. We compare our results to several other CMFs from different Galactic regions derived with the same methods. Finally, we discuss how our results may help define an evolutionary sequence of star cluster formation and be used to test star formation theories.

astro-ph.GA↗

arXiv2025

DGSense: A Domain Generalization Framework for Wireless Sensing

Wireless sensing is of great benefits to our daily lives. However, wireless signals are sensitive to the surroundings. Various factors, e.g. environments, locations, and individuals, may induce extra impact on wireless propagation. Such a change can be regarded as a domain, in which the data distribution shifts. A vast majority of the sensing schemes are learning-based. They are dependent on the training domains, resulting in performance degradation in unseen domains. Researchers have proposed various solutions to address this issue. But these solutions leverage either semi-supervised or unsupervised domain adaptation techniques. They still require some data in the target domains and do not perform well in unseen domains. In this paper, we propose a domain generalization framework DGSense, to eliminate the domain dependence problem in wireless sensing. The framework is a general solution working across diverse sensing tasks and wireless technologies. Once the sensing model is built, it can generalize to unseen domains without any data from the target domain. To achieve the goal, we first increase the diversity of the training set by a virtual data generator, and then extract the domain independent features via episodic training between the main feature extractor and the domain feature extractors. The feature extractors employ a pre-trained Residual Network (ResNet) with an attention mechanism for spatial features, and a 1D Convolutional Neural Network (1DCNN) for temporal features. To demonstrate the effectiveness and generality of DGSense, we evaluated on WiFi gesture recognition, Millimeter Wave (mmWave) activity recognition, and acoustic fall detection. All the systems exhibited high generalization capability to unseen domains, including new users, locations, and environments, free of new data and retraining.

cs.LG↗

arXiv2025

LASP-2: Rethinking Sequence Parallelism for Linear Attention and Its Hybrid

Linear sequence modeling approaches, such as linear attention, provide advantages like linear-time training and constant-memory inference over sequence lengths. However, existing sequence parallelism (SP) methods are either not optimized for the right-product-first feature of linear attention or use a ring-style communication strategy, which results in lower computation parallelism, limits their scalability for longer sequences in distributed systems. In this paper, we introduce LASP-2, a new SP method to enhance both communication and computation parallelism when training linear attention transformer models with very-long input sequences. Compared to previous work LASP, LASP-2 rethinks the minimal communication requirement for SP on linear attention layers, reorganizes the whole communication-computation workflow of LASP. In this way, only one single AllGather collective communication is needed on intermediate memory states, whose sizes are independent of the sequence length, leading to significant improvements of both communication and computation parallelism, as well as their overlap. Additionally, we extend LASP-2 to LASP-2H by applying similar communication redesign to standard attention modules, offering an efficient SP solution for hybrid models that blend linear and standard attention layers. Our evaluation on a Linear-Llama3 model, a variant of Llama3 with linear attention replacing standard attention, demonstrates the effectiveness of LASP-2 and LASP-2H. Specifically, LASP-2 achieves training speed improvements of 15.2% over LASP and 36.6% over Ring Attention, with a sequence length of 2048K across 64 GPUs. The Code is released as a part of: https://github.com/OpenSparseLLMs/Linear-MoE.

cs.LG↗

arXiv2025

A Deep Learning Framework Integrating CNN and BiLSTM for Financial Systemic Risk Analysis and Prediction

This study proposes a deep learning model based on the combination of convolutional neural network (CNN) and bidirectional long short-term memory network (BiLSTM) for discriminant analysis of financial systemic risk. The model first uses CNN to extract local patterns of multidimensional features of financial markets, and then models the bidirectional dependency of time series through BiLSTM, to comprehensively characterize the changing laws of systemic risk in spatial features and temporal dynamics. The experiment is based on real financial data sets. The results show that the model is significantly superior to traditional single models (such as BiLSTM, CNN, Transformer, and TCN) in terms of accuracy, recall, and F1 score. The F1-score reaches 0.88, showing extremely high discriminant ability. This shows that the joint strategy of combining CNN and BiLSTM can not only fully capture the complex patterns of market data but also effectively deal with the long-term dependency problem in time series data. In addition, this study also explores the robustness of the model in dealing with data noise and processing high-dimensional data, providing strong support for intelligent financial risk management. In the future, the research will further optimize the model structure, introduce methods such as reinforcement learning and multimodal data analysis, and improve the efficiency and generalization ability of the model to cope with a more complex financial environment.

cs.LG↗

arXiv2025

ALMA observations of massive clouds in the central molecular zone: slim filaments tracing parsec-scale shocks

The central molecular zone (CMZ) of our Galaxy exhibits widespread emission from SiO and various complex organic molecules (COMs), yet the exact origin of such emission is uncertain. Here we report the discovery of a unique class of long ($>$0.5 pc) and narrow ($<$0.03 pc) filaments in the emission of SiO 5$-$4 and eight additional molecular lines, including several COMs, in our ALMA 1.3 mm spectral line observations toward two massive molecular clouds in the CMZ, which we name as slim filaments. However, these filaments are not detected in the 1.3 mm continuum at the 5$σ$ level. Their line-of-sight velocities are coherent and inconsistent with being outflows. The column densities and relative abundances of the detected molecules are statistically similar to those in protostellar outflows but different from those in dense cores within the same clouds. Turbulent pressure in these filaments dominates over self gravity and leads to hydrostatic inequilibrium, indicating that they are a different class of objects than the dense gas filaments in dynamical equilibrium ubiquitously found in nearby molecular clouds. We argue that these newly detected slim filaments are associated with parsec-scale shocks, likely arising from dynamic interactions between shock waves and molecular clouds. The dissipation of the slim filaments may replenish SiO and COMs in the interstellar medium and lead to their widespread emission in the CMZ.

astro-ph.GA↗

arXiv2025

Féeton ($B-L$ Gauge Boson) Dark Matter Testable in Future Direct Detection Experiments

In this paper, we revisit the féeton (gauge boson of $U(1)_{B-L}$ symmetry) dark matter scenario, and first point out the $U(1)$ gauge symmetry can be a linear combination of the $B-L$ and the SM hypercharge gauge symmetries. With the redefinition of $B-L$ charge of fermions, the coupling between electron and féeton can be enhanced. After showing the parameter space required from the DM stability and cosmic production, we discuss the potential for verifying them in dark matter direct detection experiments. The results show that future experiments, such as SuperCDMS, have a sensitivity to reach the féeton DM region consistent with its cosmic production.

hep-ph↗

arXiv2025

Detecting a Fifth-Force Gauge Boson via Superconducting Josephson Junctions

A new fifth force between particles carrying $B-L$ charges is well-motivated by the intriguing $U(1)_{B-L}$ extension of the standard model. The gauge boson mediator, Féeton, also serves as a dark matter candidate. In this letter, we propose a novel experimental design to detect the quantum phase difference caused by this fifth force using a superconducting Josephson junction. We find that the experiment has the best sensitivity to the gauge coupling when the gauge boson is within the mass range of $0.01\,$eV to $10\,$eV, which is an interesting mass region for the Féeton dark matter. This opens up a new avenue for the measurement of new physics at small scale below millimeter.

hep-ph↗

arXiv2025

Dark Matter Annihilation via Breit-Wigner Enhancement with Heavier Mediator

We propose a new scenario that both the dark matter freeze-out in the early Universe and its possible annihilation for indirect detection around a supermassive black hole are enhanced by a Breit-Wigner resonance. With the mediator mass larger than the total initial dark matter mass, this annihilation is almost forbidden at late times. Thus, the stringent cosmic microwave background and indirect detection constraints do not apply. However, a supermassive black hole can accelerate the dark matter particles to reactivate this resonant annihilation whose subsequent decay to photons leaves a unique signal. The running Fermi-LAT and the future COSI satellites can test this scenario.

hep-ph↗

arXiv2025

Proposal for a Quantum Mechanical Test of Gravity at Millimeter Scale

The experimental verification of the Newton law of gravity at small scales has been a longstanding challenge. Recently, torsion balance experiments have successfully measured gravitational force at the millimeter scale. However, testing gravity force on quantum mechanical wave function at small scales remains difficult. In this paper, we propose a novel experiment that utilizes the Josephson effect to detect the different evolution of quantum phase induced from the potential difference caused by gravity. We demonstrate that this experiment can test gravity quantum mechanically at the millimeter scale, and also has a potential to investigate the parity invariance of gravity at small scales.

hep-ph↗

arXiv2025

Core mass function in view of fractal and turbulent filaments and fibers

We propose that the core mass function (CMF) can be driven by filament fragmentation. To model a star-forming system of filaments and fibers, we develop a fractal and turbulent tree with a fractal dimension of 2 and a Larson's law exponent ($β$) of 0.5. The fragmentation driven by convergent flows along the splines of the fractal tree yields a Kroupa-IMF-like CMF that can be divided into three power-law segments with exponents $α$ = $-0.5$, $-1.5$, and $-2$, respectively. The turnover masses of the derived CMF are approximately four times those of the Kroupa IMF, corresponding to a star formation efficiency of 0.25. Adopting $β=1/3$, which leads to fractional Brownian motion along the filament, may explain a steeper CMF at the high-mass end, with $α=-3.33$ close to that of the Salpeter IMF. We suggest that the fibers of the tree are basic building blocks of star formation, with similar properties across different clouds, establishing a common density threshold for star formation and leading to a universal CMF.

astro-ph.GA↗

arXiv2025

Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedback

Large language models (LLMs) demonstrate impressive performance but lack the flexibility to adapt to human preferences quickly without retraining. In this work, we introduce Test-time Preference Optimization (TPO), a framework that aligns LLM outputs with human preferences during inference, removing the need to update model parameters. Rather than relying on purely numerical rewards, TPO translates reward signals into textual critiques and uses them as textual rewards to iteratively refine its response. Evaluations on benchmarks covering instruction following, preference alignment, safety, and mathematics reveal that TPO progressively improves alignment with human preferences. Notably, after only a few TPO steps, the initially unaligned Llama-3.1-70B-SFT model can surpass the aligned counterpart, Llama-3.1-70B-Instruct. Furthermore, TPO scales efficiently with both the search width and depth during inference. Through case studies, we illustrate how TPO exploits the innate capacity of LLM to interpret and act upon reward signals. Our findings establish TPO as a practical, lightweight alternative for test-time preference optimization, achieving alignment on the fly. Our code is publicly available at https://github.com/yafuly/TPO.

cs.CL↗

arXiv2025

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

Scaling data and model size has been proven effective for boosting the performance of large language models. In addition to training-time scaling, recent studies have revealed that increasing test-time computational resources can further improve performance. In this work, we introduce Aggregation Fine-Tuning (AFT), a supervised finetuning paradigm where the model learns to synthesize multiple draft responses, referred to as proposals, into a single, refined answer, termed aggregation. At inference time, a propose-and-aggregate strategy further boosts performance by iteratively generating proposals and aggregating them. Empirical evaluations on benchmark datasets show that AFT-trained models substantially outperform standard SFT. Notably, an AFT model, fine-tuned from Llama3.1-8B-Base with only 64k data, achieves a 41.3% LC win rate on AlpacaEval 2, surpassing significantly larger LLMs such as Llama3.1-405B-Instruct and GPT4. By combining sequential refinement and parallel sampling, the propose-and-aggregate framework scales inference-time computation in a flexible manner. Overall, These findings position AFT as a promising approach to unlocking additional capabilities of LLMs without resorting to increasing data volume or model size.

cs.CL↗

arXiv2025

Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark

The ability to organically reason over and with both text and images is a pillar of human intelligence, yet the ability of Multimodal Large Language Models (MLLMs) to perform such multimodal reasoning remains under-explored. Existing benchmarks often emphasize text-dominant reasoning or rely on shallow visual cues, failing to adequately assess integrated visual and textual reasoning. We introduce EMMA (Enhanced MultiModal reAsoning), a benchmark targeting organic multimodal reasoning across mathematics, physics, chemistry, and coding. EMMA tasks demand advanced cross-modal reasoning that cannot be addressed by reasoning independently in each modality, offering an enhanced test suite for MLLMs' reasoning capabilities. Our evaluation of state-of-the-art MLLMs on EMMA reveals significant limitations in handling complex multimodal and multi-step reasoning tasks, even with advanced techniques like Chain-of-Thought prompting and test-time compute scaling underperforming. These findings underscore the need for improved multimodal architectures and training paradigms to close the gap between human and model reasoning in multimodality.

cs.CV↗

arXiv2024

On the Universal Truthfulness Hyperplane Inside LLMs

While large language models (LLMs) have demonstrated remarkable abilities across various fields, hallucination remains a significant challenge. Recent studies have explored hallucinations through the lens of internal representations, proposing mechanisms to decipher LLMs' adherence to facts. However, these approaches often fail to generalize to out-of-distribution data, leading to concerns about whether internal representation patterns reflect fundamental factual awareness, or only overfit spurious correlations on the specific datasets. In this work, we investigate whether a universal truthfulness hyperplane that distinguishes the model's factually correct and incorrect outputs exists within the model. To this end, we scale up the number of training datasets and conduct an extensive evaluation -- we train the truthfulness hyperplane on a diverse collection of over 40 datasets and examine its cross-task, cross-domain, and in-domain generalization. Our results indicate that increasing the diversity of the training datasets significantly enhances the performance in all scenarios, while the volume of data samples plays a less critical role. This finding supports the optimistic hypothesis that a universal truthfulness hyperplane may indeed exist within the model, offering promising directions for future research.

cs.CL↗

arXiv2024

Efficiently Solving Turn-Taking Stochastic Games with Extensive-Form Correlation

We study equilibrium computation with extensive-form correlation in two-player turn-taking stochastic games. Our main results are two-fold: (1) We give an algorithm for computing a Stackelberg extensive-form correlated equilibrium (SEFCE), which runs in time polynomial in the size of the game, as well as the number of bits required to encode each input number. (2) We give an efficient algorithm for approximately computing an optimal extensive-form correlated equilibrium (EFCE) up to machine precision, i.e., the algorithm achieves approximation error $\varepsilon$ in time polynomial in the size of the game, as well as $\log(1 / \varepsilon)$. Our algorithm for SEFCE is the first polynomial-time algorithm for equilibrium computation with commitment in such a general class of stochastic games. Existing algorithms for SEFCE typically make stronger assumptions such as no chance moves, and are designed for extensive-form games in the less succinct tree form. Our algorithm for approximately optimal EFCE is, to our knowledge, the first algorithm that achieves 3 desiderata simultaneously: approximate optimality, polylogarithmic dependency on the approximation error, and compatibility with stochastic games in the more succinct graph form. Existing algorithms achieve at most 2 of these desiderata, often also relying on additional technical assumptions.

cs.GT↗

arXiv2024

The JWST-NIRCam View of Sagittarius C. II. Evidence for Magnetically Dominated HII Regions in the CMZ

We present JWST-NIRCam narrow-band, 4.05 $μ$m Brackett-$α$ images of the Sgr C HII region, located in the Central Molecular Zone (CMZ) of the Galaxy. Unlike any HII region in the Solar vicinity, the Sgr C plasma is dominated by filamentary structure in both Brackett-$α$ and the radio continuum. Some bright filaments, which form a fractured arc with a radius of about 1.85 pc centered on the Sgr C star-forming molecular clump, likely trace ionization fronts. The brightest filaments form a `$π$-shaped' structure in the center of the HII region. Fainter filaments radiate away from the surface of the Sgr C molecular cloud. The filaments are emitting optically thin free-free emission, as revealed by spectral index measurements from 1.28 GHz (MeerKAT) to 97 GHz (ALMA). But, the negative in-band 1 to 2 GHz spectral index in the MeerKAT data alone reveals the presence of a non-thermal component across the entire Sgr C HII region. We argue that the plasma flow in Sgr C is controlled by magnetic fields, which confine the plasma to rope-like filaments or sheets. This results in the measured non-thermal component of low-frequency radio emission plasma, as well as a plasma $β$ (thermal pressure divided by magnetic pressure) below 1, even in the densest regions. We speculate that all mature HII regions in the CMZ, and galactic nuclei in general, evolve in a magnetically dominated, low plasma $β$ regime.

astro-ph.GA↗

arXiv2024

Magnetic Fields in Massive Star-forming Regions (MagMaR). V. The Magnetic Field at the Onset of High-mass Star Formation

A complete understanding of the initial conditions of high-mass star formation and what processes determine multiplicity require the study of the magnetic field (B-field) in young, massive cores. Using ALMA 250 GHz polarization (0.3" = 1000 au) and ALMA 220 GHz high-angular resolution observations (0.05" = 160 au), we have performed a full energy analysis including the B-field at core scales and have assessed what influences the multiplicity inside a massive core previously believed to be in the prestellar phase. With 31 Msun, the G11.92 MM2 core has a young CS outflow with a dynamical time scale of a few thousand years. At high-resolution, the MM2 core fragments into a binary system with a projected separation of 505 au and a binary mass ratio of 1.14. Using the DCF method with an ADF analysis, we estimate in this core a B-field strength of 6.2 mG and a mass-to-flux ratio of 18. The MM2 core is strongly subvirialized with a virial parameter of 0.064, including the B-field. The high mass-to-flux ratio and low virial parameter indicate that this massive core is very likely undergoing runaway collapse, which is in direct contradiction with the core-accretion model. The MM2 core is embedded in a filament that has a velocity gradient consistent with infall. In line with clump-fed scenarios, the core can grow in mass at a rate of 1.9--5.6 x 10^-4 Msun/yr. In spite of the B-field having only a minor contribution to the total energy budget at core scales, it likely plays a more important role at smaller scales by setting the binary properties. Considering energy ratios and a fragmentation criterion at the core scale, the binary could have been formed by core fragmentation. The binary properties (separation and mass ratio), however, are also consistent with radiation-magnetohydrodynamic simulations with super-Alfvenic, supersonic (or sonic) turbulence that form binaries by disk fragmentation.

astro-ph.GA↗