arXiv Science⌕ Search

arXiv subjects

Song Liu

Publications and source records attributed to Song Liu.

At least 91 records · Page 5Linked to original sources

Language of Network: A Generative Pre-trained Model for Encrypted Traffic Comprehension

The increasing demand for privacy protection and security considerations leads to a significant rise in the proportion of encrypted network traffic. Since traffic content becomes unrecognizable after encryption, accurate analysis is challenging, making it difficult to classify applications and detect attacks. Deep learning is currently the predominant approach for encrypted traffic classification through feature analysis. However, these methods face limitations due to their high dependence on labeled data and difficulties in detecting attack variants. First, their performance is highly sensitive to data quality, where the highcost manual labeling process and dataset imbalance significantly degrade results. Second, the rapid evolution of attack patterns makes it challenging for models to identify new types of attacks. To tackle these challenges, we present GBC, a generative model based on pre-training for encrypted traffic comprehension. Since traditional tokenization methods are primarily designed for natural language, we propose a protocol-aware tokenization approach for encrypted traffic that improves model comprehension of fields specific to network traffic. In addition, GBC employs pretraining to learn general representations from extensive unlabeled traffic data. Through prompt learning, it effectively adapts to various downstream tasks, enabling both high-quality traffic generation and effective detection. Evaluations across multiple datasets demonstrate that GBC achieves superior results in both traffic classification and generation tasks, resulting in a 5% improvement in F1 score compared to state-of-the-art methods for classification tasks.

cs.CR↗

Logical multi-qubit entanglement with dual-rail superconducting qubits

Recent advances in quantum error correction (QEC) across hardware platforms have demonstrated operation near and beyond the fault-tolerance threshold, yet achieving exponential suppression of logical errors through code scaling remains a critical challenge. Erasure qubits, which enable hardware-level detection of dominant error types, offer a promising path toward resource-efficient QEC by exploiting error bias. Single erasure qubits with dual-rail encoding in superconducting cavities and transmons have demonstrated high coherence and low single-qubit gate errors with mid-circuit erasure detection, but the generation of multi-qubit entanglement--a fundamental requirement for quantum computation and error correction--has remained an outstanding milestone. Here, we demonstrate a superconducting processor integrating four dual-rail erasure qubits that achieves the logical multi-qubit entanglement with error-biased protection. Each dual-rail qubit, encoded in pairs of tunable transmons, preserves millisecond-scale coherence times and single-qubit gate errors at the level of $10^{-5}$. By engineering tunable couplings between logical qubits, we generate high-fidelity entangled states resilient to physical qubit noise, including logical Bell states (98.8% fidelity) and a three-logical-qubit Greenberger-Horne-Zeilinger (GHZ) state (93.5% fidelity). A universal gate set is realized through a calibrated logical controlled-NOT (CNOT) gate with 96.2% process fidelity, enabled by coupler-activated $XX$ interactions in the protected logical subspace. This work advances dual-rail architectures beyond single-qubit demonstrations, providing a blueprint for concatenated quantum error correction with erasure qubits.

quant-ph↗

High-Dimensional Differential Parameter Inference in Exponential Family using Time Score Matching

This paper addresses differential inference in time-varying parametric probabilistic models, like graphical models with changing structures. Instead of estimating a high-dimensional model at each time point and estimating changes later, we directly learn the differential parameter, i.e., the time derivative of the parameter. The main idea is treating the time score function of an exponential family model as a linear model of the differential parameter for direct estimation. We use time score matching to estimate parameter derivatives. We prove the consistency of a regularized score matching objective and demonstrate the finite-sample normality of a debiased estimator in high-dimensional settings. Our methodology effectively infers differential structures in high-dimensional graphical models, verified on simulated and real-world datasets. The code reproducing our experiments can be found at: https://github.com/Leyangw/tsm.

stat.ML↗

Quantum squeezing amplification with a weak Kerr nonlinear oscillator

Quantum squeezed states, with reduced quantum noise, have been widely utilized in quantum sensing and quantum error correction applications. However, generating and manipulating these nonclassical states with a large squeezing degree typically requires strong nonlinearity, which inevitably induces additional decoherence that diminishes the overall performance. Here, we demonstrate the generation and amplification of squeezed states in a superconducting microwave cavity with weak Kerr nonlinearity. By subtly engineering an off-resonant microwave drive, we observe cyclic dynamics of the quantum squeezing evolution for various Fock states |N> with N up to 6 in displaced frame of the cavity. Furthermore, we deterministically realize quantum squeezing amplification by alternately displacing the Kerr oscillator using the Trotterization technique, achieving a maximum squeezing degree of 14.6 dB and squeezing rate of 0.28 MHz. Our hardware-efficient displacement-enhanced squeezing operations provide an alternative pathway for generating large squeezed states, promising potential applications in quantum-enhanced sensing and quantum information processing.

quant-ph↗

Every FLOP Counts: Scaling a 300B Mixture-of-Experts LING LLM without Premium GPUs

In this technical report, we tackle the challenges of training large-scale Mixture of Experts (MoE) models, focusing on overcoming cost inefficiency and resource limitations prevalent in such systems. To address these issues, we present two differently sized MoE large language models (LLMs), namely Ling-Lite and Ling-Plus (referred to as "Bailing" in Chinese, spelled Bǎilíng in Pinyin). Ling-Lite contains 16.8 billion parameters with 2.75 billion activated parameters, while Ling-Plus boasts 290 billion parameters with 28.8 billion activated parameters. Both models exhibit comparable performance to leading industry benchmarks. This report offers actionable insights to improve the efficiency and accessibility of AI development in resource-constrained settings, promoting more scalable and sustainable technologies. Specifically, to reduce training costs for large-scale MoE models, we propose innovative methods for (1) optimization of model architecture and training processes, (2) refinement of training anomaly handling, and (3) enhancement of model evaluation efficiency. Additionally, leveraging high-quality data generated from knowledge graphs, our models demonstrate superior capabilities in tool use compared to other models. Ultimately, our experimental findings demonstrate that a 300B MoE LLM can be effectively trained on lower-performance devices while achieving comparable performance to models of a similar scale, including dense and MoE models. Compared to high-performance devices, utilizing a lower-specification hardware system during the pre-training phase demonstrates significant cost savings, reducing computing costs by approximately 20%. The models can be accessed at https://huggingface.co/inclusionAI.

cs.LG↗

A thermal-noise-resilient microwave quantum network traversing 4 K

Quantum communication at microwave frequencies has been fundamentally constrained by the susceptibility of microwave photons to thermal noise, hindering their application in scalable quantum networks. Here we demonstrate a thermal-noise-resilient microwave quantum network that establishes coherent coupling between two superconducting qubits through a 4 K thermalized niobium-titanium transmission line. By overcoupling the communication channel to a cold load at 10 mK, we suppress the effective thermal occupancy of the channel to 0.06 photons through radiative cooling -- a two-order-of-magnitude reduction below ambient thermal noise. We then decouple the cold load and rapidly transfer microwave quantum states through the channel while it rethermalizes, achieving a 58.5% state transfer fidelity and a 52.3% Bell entanglement fidelity, both exceeding the classical communication threshold. Our architecture overcomes the temperature-compatibility barrier for microwave quantum systems, providing a scalable framework for distributed quantum computing and enabling hybrid quantum networks with higher-temperature semiconductor or photonic platforms.

quant-ph↗

Pressure Tuning of Layer-hybridized Excitons in Trilayer WSe2

We demonstrate dynamic pressure tuning (0-6.6 GPa) of layer-hybridized excitons in AB-stacked trilayer WSe$_2$ via diamond-anvil-cell-integrated reflectance spectroscopy. Pressure-controlled interlayer coupling manifests in enhanced energy-level anti-crossings and oscillator strength redistribution, with Stark shift analysis revealing a characteristic dipole moment reduction of 11%. Notably, the hybridization strength between the intra- and interlayer excitons triples from $\sim$10 meV to above $\sim$30 meV, exhibiting a near-linear scaling of 3.5$\pm$0.2 meV/GPa. Spectral density simulations resolve four distinct components, i.e., intralayer ground/excited and interlayer ground/excited excitons, with their relative weights transitioning from one component dominant to strongly hybridized at higher pressures. Our findings highlight the potential for controlling excitonic properties and engineering novel optoelectronic devices through interlayer compression.

cond-mat.mtrl-sci↗

Signatures of collective photon emission and ferroelectric ordering of excitons near their Mott insulating state in a WSe$_2$/WS$_2$ heterobilayer

Spontaneous symmetry breaking, arising from the competition of interactions and quantum fluctuations, is fundamental to understanding ordered electronic phases. Although electrically neutral, optical excitations like excitons can interact through their dipole moment, raising the possibility of optically active ordered phases. The effects of spontaneous ordering on optical properties remain largely unexplored. Recent observations of the excitonic Mott insulating state in semiconducting moiré crystals make them promising for addressing this question. Here, we present evidence for an in-plane ferroelectric phase of dipolar moiré excitons driven by strong exciton-exciton interactions. We discover a surprising speed-up of photon emission at late times and low densities in excitonic decay. This counterintuitive behavior is attributed to collective radiance, linked to the transition between disordered and symmetry-broken ferroelectric phases of moiré excitons. Our findings provide first evidence for strong dipolar inter-site interactions in moiré lattices, demonstrate collective photon emission as a probe for moiré quantum materials, and pave the way for exploring cooperative optical phenomena in strongly correlated systems.

cond-mat.mes-hall↗

Controlling spin currents with magnon interference in a canted antiferromagnet

Controlling spin current lies at the heart of spintronics and its applications. The sign of spin currents is monotonous in ferromagnets once the current direction is determined. Spin currents in antiferromagnets can possess opposite polarization, but requires enormous magnetic fields to lift the degeneracy. Controlling spin currents with different polarization is urgently demanded but remains hitherto elusive. Here, we demonstrate the control of spin currents at room temperature by magnon interference in a canted antiferromagnet, hematite recently also classified as an altermagnet. Magneto-optical characterization by Brillouin light scattering revealed that the spatial periodicity of the beating patterns was tunable via the microwave frequency. The inverse spin-Hall voltage changed sign as the frequency was scanned, i.e., a frequency-controlled switching of polarization in pure spin currents was obtained. Our work marks the use of antiferromagnetic magnon interference to control spin currents, which substantially extends the horizon for the emerging field of coherent antiferromagnetic spintronics.

cond-mat.mes-hall↗

Improving Quantum Optimization to Achieve Quadratic Time Complexity

Quantum Approximate Optimization Algorithm (QAOA) is a promising candidate for achieving quantum advantage in combinatorial optimization. However, its variational framework presents a long-standing challenge in selecting circuit parameters. In this work, we prove that the energy expectation produced by QAOA can be expressed as a trigonometric function of the final-level mixer parameter. Leveraging this insight, we introduce Penta-O, a level-wise parameter-setting strategy that eliminates the classical outer loop, maintains minimal sampling overhead, and ensures non-decreasing performance. This method is broadly applicable to the generic quadratic unconstrained binary optimization formulated as the Ising model. For a $p$-level QAOA, Penta-O achieves an unprecedented quadratic time complexity of $\mathcal{O}(p^2)$ and a sampling overhead proportional to $5p+1$. Through experiments and simulations, we demonstrate that QAOA enhanced by Penta-O achieves near-optimal performance with exceptional circuit depth efficiency. Our work provides a versatile tool for advancing variational quantum algorithms.

quant-ph↗

A Light-Weight Framework for Open-Set Object Detection with Decoupled Feature Alignment in Joint Space

Open-set object detection (OSOD) is highly desirable for robotic manipulation in unstructured environments. However, existing OSOD methods often fail to meet the requirements of robotic applications due to their high computational burden and complex deployment. To address this issue, this paper proposes a light-weight framework called Decoupled OSOD (DOSOD), which is a practical and highly efficient solution to support real-time OSOD tasks in robotic systems. Specifically, DOSOD builds upon the YOLO-World pipeline by integrating a vision-language model (VLM) with a detector. A Multilayer Perceptron (MLP) adaptor is developed to transform text embeddings extracted by the VLM into a joint space, within which the detector learns the region representations of class-agnostic proposals. Cross-modality features are directly aligned in the joint space, avoiding the complex feature interactions and thereby improving computational efficiency. DOSOD operates like a traditional closed-set detector during the testing phase, effectively bridging the gap between closed-set and open-set detection. Compared to the baseline YOLO-World, the proposed DOSOD significantly enhances real-time performance while maintaining comparable accuracy. The slight DOSOD-S model achieves a Fixed AP of $26.7\%$, compared to $26.2\%$ for YOLO-World-v1-S and $22.7\%$ for YOLO-World-v2-S, using similar backbones on the LVIS minival dataset. Meanwhile, the FPS of DOSOD-S is $57.1\%$ higher than YOLO-World-v1-S and $29.6\%$ higher than YOLO-World-v2-S. Meanwhile, we demonstrate that the DOSOD model facilitates the deployment of edge devices. The codes and models are publicly available at https://github.com/D-Robotics-AI-Lab/DOSOD.

cs.CV↗

Synthetic multi-dimensional Aharonov-Bohm cages in Fock state lattices

Fock-state lattices (FSLs), composed of photon number states with infinite Hilbert space, have emerged as a promising platform for simulating high-dimensional physics due to their potential to extend into arbitrarily high dimensions. Here, we demonstrate the construction of multi-dimensional FSLs using superconducting quantum circuits. By controlling artificial gauge fields within their internal structures, we investigate flux-induced extreme localization dynamics, such as Aharonov-Bohm caging, extending from 2D to 3D. We also explore the coherent interference of quantum superposition states, achieving extreme localization within specific subspaces assisted by quantum entanglement. Our findings pave the way for manipulating the behavior of a broad class of quantum states in higher-dimensional systems.

quant-ph↗

Real-Space Imaging of the Band Topology of Transition Metal Dichalcogenides

The topological properties of Bloch bands are intimately tied to the structure of their electronic wavefunctions within the unit cell of a crystal. Here, we show that scanning tunneling microscopy (STM) measurements on the prototypical transition metal dichalcogenide (TMD) semiconductor WSe$_2$ can be used to unambiguously fix the location of the Wannier center of the valence band. Using site-specific substitutional doping, we first determine the position of the atomic sites within STM images, establishing that the maximum electronic density of states at the $K$-point lies between the atoms. In contrast, the maximum density of states at the $Γ$ point is at the atomic sites. This signifies that WSe$_2$ is a topologically obstructed atomic insulator, which cannot be adiabatically transformed to the trivial atomic insulator limit.

cond-mat.mtrl-sci↗

Coupler-Assisted Leakage Reduction for Scalable Quantum Error Correction with Superconducting Qubits

Superconducting qubits are a promising platform for building fault-tolerant quantum computers, with recent achievement showing the suppression of logical error with increasing code size. However, leakage into non-computational states, a common issue in practical quantum systems including superconducting circuits, introduces correlated errors that undermine QEC scalability. Here, we propose and demonstrate a leakage reduction scheme utilizing tunable couplers, a widely adopted ingredient in large-scale superconducting quantum processors. Leveraging the strong frequency tunability of the couplers and stray interaction between the couplers and readout resonators, we eliminate state leakage on the couplers, thus suppressing space-correlated errors caused by population propagation among the couplers. Assisted by the couplers, we further reduce leakage to higher qubit levels with high efficiency (98.1%) and low error rate on the computational subspace (0.58%), suppressing time-correlated errors during QEC cycles. The performance of our scheme demonstrates its potential as an indispensable building block for scalable QEC with superconducting qubits.

quant-ph↗

Conditional Outcome Equivalence: A Quantile Alternative to CATE

Conditional quantile treatment effect (CQTE) can provide insight into the effect of a treatment beyond the conditional average treatment effect (CATE). This ability to provide information over multiple quantiles of the response makes CQTE especially valuable in cases where the effect of a treatment is not well-modelled by a location shift, even conditionally on the covariates. Nevertheless, the estimation of CQTE is challenging and often depends upon the smoothness of the individual quantiles as a function of the covariates rather than smoothness of the CQTE itself. This is in stark contrast to CATE where it is possible to obtain high-quality estimates which have less dependency upon the smoothness of the nuisance parameters when the CATE itself is smooth. Moreover, relative smoothness of the CQTE lacks the interpretability of smoothness of the CATE making it less clear whether it is a reasonable assumption to make. We combine the desirable properties of CATE and CQTE by considering a new estimand, the conditional quantile comparator (CQC). The CQC not only retains information about the whole treatment distribution, similar to CQTE, but also having more natural examples of smoothness and is able to leverage simplicity in an auxiliary estimand. We provide finite sample bounds on the error of our estimator, demonstrating its ability to exploit simplicity. We validate our theory in numerical simulations which show that our method produces more accurate estimates than baselines. Finally, we apply our methodology to a study on the effect of employment incentives on earnings across different age groups. We see that our method is able to reveal heterogeneity of the effect across different quantiles.

stat.ME↗

Floquet Engineering of Anisotropic Transverse Interactions in Superconducting Qubits

Superconducting transmon qubits have established as a leading candidate for quantum computation, as well as a flexible platform for exploring exotic quantum phases and dynamics. However, physical coupling naturally yields isotropic transverse interactions between qubits, restricting their access to diverse quantum phases that require spatially dependent interactions. Here, we demonstrate the simultaneous realization of both pairing (XX-YY) and hopping (XX+YY) interactions between transmon qubits by Floquet engineering. The coherent superposition of these interactions enables independent control over the XX and YY terms, yielding anisotropic transverse interactions. By aligning the transverse interactions along a 1D chain of six qubits, as calibrated via Aharonov-Bohm interference in synthetic space, we synthesize a transverse field Ising chain model and explore its dynamical phase transition under varying external field. The scalable synthesis of anisotropic transverse interactions paves the way for the implementation of more complex physical systems requiring spatially dependent interactions, enriching the toolbox for engineering quantum phases with superconducting qubits.

quant-ph↗

Digital simulation of zero-temperature spontaneous symmetry breaking in a superconducting lattice processor

Quantum simulators are ideal platforms to investigate quantum phenomena that are inaccessible through conventional means, such as the limited resources of classical computers to address large quantum systems or due to constraints imposed by fundamental laws of nature. Here, through a digitized adiabatic evolution, we report an experimental simulation of antiferromagnetic (AFM) and ferromagnetic (FM) phase formation induced by spontaneous symmetry breaking (SSB) in a three-generation Cayley tree-like superconducting lattice. We develop a digital quantum annealing algorithm to mimic the system dynamics, and observe the emergence of signatures of SSB-induced phase transition through a connected correlation function. We demonstrate that the signature of phase transition from classical AFM to quantum FM happens in systems undergoing zero-temperature adiabatic evolution with only nearest-neighbor interacting systems, the shortest range of interaction possible. By harnessing properties of the bipartite Renyi entropy as an entanglement witness, we observe the formation of entangled quantum FM and AFM phases. Our results open perspectives for new advances in condensed matter physics and digitized quantum annealing.

quant-ph↗

Experimental sample-efficient quantum state tomography via parallel measurements

Quantum state tomography (QST) via local measurements on reduced density matrices (LQST) is a promising approach but becomes impractical for large systems. To tackle this challenge, we developed an efficient quantum state tomography method inspired by quantum overlapping tomography [Phys. Rev. Lett. 124, 100401(2020)], which utilizes parallel measurements (PQST). In contrast to LQST, PQST significantly reduces the number of measurements and offers more robustness against shot noise. Experimentally, we demonstrate the feasibility of PQST in a tree-like superconducting qubit chip by designing high-efficiency circuits, preparing W states, ground states of Hamiltonians and random states, and then reconstructing these density matrices using full quantum state tomography (FQST), LQST, and PQST. Our results show that PQST reduces measurement cost, achieving fidelities of 98.68\% and 95.07\% after measuring 75 and 99 observables for 6-qubit and 9-qubit W states, respectively. Furthermore, the reconstruction of the largest density matrix of the 12-qubit W state is achieved with the similarity of 89.23\% after just measuring $243$ parallel observables, while $3^{12}=531441$ complete observables are needed for FQST. Consequently, PQST will be a useful tool for future tasks such as the reconstruction, characterization, benchmarking, and properties learning of states.

quant-ph↗