arXiv Science⌕ Search

arXiv subjects

Yuan Li

Publications and source records attributed to Yuan Li.

At least 235 records · Page 13Linked to original sources

New Partial Orders of Polar Codes for BMSC

In this paper, we define partial orders (POs) of polar codes based on the Bhattacharyya parameter and the bit-error probability, respectively. These POs are applicable to arbitrary binary memoryless symmetric channel (BMSC). Leveraging the extremal inequalities of polarization transformation, we derive new POs for BMSC based on the corresponding POs observed in the Binary Erasure Channel (BEC). %Additionally, we discover more special POs in the Binary Symmetric Channel (BSC). We provide examples that demonstrate the inability of existing POs to deduce these novel POs. Furthermore, we establish upper bounds for the expansion parameter $β$ if the polar codes constructed by $β$-expansion method obey these POs.

cs.IT↗

Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models

Sora is a text-to-video generative AI model, released by OpenAI in February 2024. The model is trained to generate videos of realistic or imaginative scenes from text instructions and show potential in simulating the physical world. Based on public technical reports and reverse engineering, this paper presents a comprehensive review of the model's background, related technologies, applications, remaining challenges, and future directions of text-to-video AI models. We first trace Sora's development and investigate the underlying technologies used to build this "world simulator". Then, we describe in detail the applications and potential impact of Sora in multiple industries ranging from film-making and education to marketing. We discuss the main challenges and limitations that need to be addressed to widely deploy Sora, such as ensuring safe and unbiased video generation. Lastly, we discuss the future development of Sora and video generation models in general, and how advancements in the field could enable new ways of human-AI interaction, boosting productivity and creativity of video generation.

cs.CV↗

Multi-interface engineering to realize all-solution processed highly efficient Kesterite solar cells

With the rapid development of Kesterite Cu2ZnSn(S, Se)4 solar cells in the past few years, how to achieve higher cost-performance ratio has become an important topic in the future development and industrialization of this technology. Herein, we demonstrate an all-solution route for the cell fabrication, in particular targeting at the solution processed window layer comprised of ZnO nanoparticles/Ag nanowires. A multi-interface engineering strategy assisted by organic polymers and molecules is explored to synergistically improve the film deposition, passivate the surface defects and facilitate the charge transfer. These efforts help us achieve high-performance and robust Kesterite solar cells at extremely low time and energy costs, with efficiency records of 14.37% and 13.12% being realized in rigid and flexible Kesterite solar cells, respectively. Our strategy here is also promising to be transplanted into other solar cells with similar geometric and energy band structures, helping reduce production costs and shorten the production cycle (i.e. increasing production capacity) of these photovoltaic industries.

cond-mat.mtrl-sci↗

Principles from Clinical Research for NLP Model Generalization

The NLP community typically relies on performance of a model on a held-out test set to assess generalization. Performance drops observed in datasets outside of official test sets are generally attributed to "out-of-distribution" effects. Here, we explore the foundations of generalizability and study the factors that affect it, articulating lessons from clinical studies. In clinical research, generalizability is an act of reasoning that depends on (a) internal validity of experiments to ensure controlled measurement of cause and effect, and (b) external validity or transportability of the results to the wider population. We demonstrate how learning spurious correlations, such as the distance between entities in relation extraction tasks, can affect a model's internal validity and in turn adversely impact generalization. We, therefore, present the need to ensure internal validity when building machine learning models in NLP. Our recommendations also apply to generative large language models, as they are known to be sensitive to even minor semantic preserving alterations. We also propose adapting the idea of matching in randomized controlled trials and observational studies to NLP evaluation to measure causation.

cs.CL↗

GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image

Recently, we have witnessed the explosive growth of various volumetric representations in modeling animatable head avatars. However, due to the diversity of frameworks, there is no practical method to support high-level applications like 3D head avatar editing across different representations. In this paper, we propose a generic avatar editing approach that can be universally applied to various 3DMM driving volumetric head avatars. To achieve this goal, we design a novel expression-aware modification generative model, which enables lift 2D editing from a single image to a consistent 3D modification field. To ensure the effectiveness of the generative modification process, we develop several techniques, including an expression-dependent modification distillation scheme to draw knowledge from the large-scale head avatar model and 2D facial texture editing tools, implicit latent space guidance to enhance model convergence, and a segmentation-based loss reweight strategy for fine-grained texture inversion. Extensive experiments demonstrate that our method delivers high-quality and consistent results across multiple expression and viewpoints. Project page: https://zju3dv.github.io/geneavatar/

cs.CV↗

High-Spectral Resolution Observations of the Optical Filamentary Nebula in NGC 1275

We present new high-spectral resolution observations (R = $λ/Δλ$ = 7000) of the filamentary nebula surrounding NGC 1275, the central galaxy of the Perseus cluster. These observations have been obtained with SITELLE, an imaging Fourier transform spectrometer installed on the Canada-France-Hawai Telescope (CFHT) with a field of view of $11\text{ arcmin }\times 11 \text{ arcmin}$ encapsulating the entire filamentary structure of ionised gas despite its large size of $80 \text{ kpc}\times50 \text{ kpc}$. Here, we present renewed flux, velocity and velocity dispersion maps that show in great detail the kinematics of the optical nebula at \sii$\lambda6716$, \sii$\lambda6731$, \nii$\lambda6584$, H$α$(6563Å), and \nii$\lambda6548$. These maps reveal the existence of a bright flattened disk-shaped structure in the core extending to r $\sim 10$ kpc and dominated by a chaotic velocity field. This structure is located in the wake of X-ray cavities and characterised by a high mean velocity dispersion of $134$ km/s. The disk-shaped structure is surrounded by an extended array of filaments spread out to $r\sim 50$ kpc that are 10 times fainter in flux, remarkably quiescent and has a uniform mean velocity dispersion of $44$ km/s. This stability is puzzling given that the cluster core exhibits several energetic phenomena. Based on these results, we argue that there are two mechanisms to form multiphase gas in clusters of galaxies: a first triggered in the wake of X-ray cavities leading to more turbulent multiphase gas and a second, distinct mechanism, that is gentle and leads to large-scale multiphase gas spread throughout the core.

astro-ph.GA↗

Electronic Phase Propagation Speed in BaFe$_2$As$_2$ Revealed by Dilatometry

Thermal expansion offers deep insights into phase transitions in condensed matter physics. Utilizing an advanced AC-temperature dilatometer with picometer resolution, this study clearly resolves the antiferromagnetic and structural transition in BaFe$_2$As$_2$. The implementation of temperature oscillation reveals a hysteresis near the transition temperature $T_\mathrm{N}$ with unprecedented resolution. Unexpectedly, we find that the hysteretic width exhibits a universal dependence on the parameters of temperature oscillation and the sample's longidutinal dimension, which in turn reveals a finite transition speed. Our quantitative analysis shows that this phase boundary propagates at a mere 188 $μ$m/s - a speed seven orders of magnitude slower than acoustic waves. It suggests a hidden thermodynamic constraint imposed by the electronic degrees of freedom. Our research not only sheds light on the dynamics of phase transitions between different correlated phases, but also establishes high precision dilatometry as a powerful tool for material studies. This measurement technique, when properly modified, can be extended to studies of other material properties such as piezoelectric, magneto-restriction, elastic modulus, etc.

cond-mat.supr-con↗

PiGW: A Plug-in Generative Watermarking Framework

Integrating watermarks into generative images is a critical strategy for protecting intellectual property and enhancing artificial intelligence security. This paper proposes Plug-in Generative Watermarking (PiGW) as a general framework for integrating watermarks into generative images. More specifically, PiGW embeds watermark information into the initial noise using a learnable watermark embedding network and an adaptive frequency spectrum mask. Furthermore, it optimizes training costs by gradually increasing timesteps. Extensive experiments demonstrate that PiGW enables embedding watermarks into the generated image with negligible quality loss while achieving true invisibility and high resistance to noise attacks. Moreover, PiGW can serve as a plugin for various commonly used generative structures and multimodal generative content types. Finally, we demonstrate how PiGW can also be utilized for detecting generated images, contributing to the promotion of secure AI development. The project code will be made available on GitHub.

cs.MM↗

FACT: Fast and Active Coordinate Initialization for Vision-based Drone Swarms

Swarm robots have sparked remarkable developments across a range of fields. While it is necessary for various applications in swarm robots, a fast and robust coordinate initialization in vision-based drone swarms remains elusive. To this end, our paper proposes a complete system to recover a swarm's initial relative pose on platforms with size, weight, and power (SWaP) constraints. To overcome limited coverage of field-of-view (FoV), the drones rotate in place to obtain observations. To tackle the anonymous measurements, we formulate a non-convex rotation estimation problem and transform it into a semi-definite programming (SDP) problem, which can steadily obtain global optimal values. Then we utilize the Hungarian algorithm to recover relative translation and correspondences between observations and drone identities. To safely acquire complete observations, we actively search for positions and generate feasible trajectories to avoid collisions. To validate the practicability of our system, we conduct experiments on a vision-based drone swarm with only stereo cameras and inertial measurement units (IMUs) as sensors. The results demonstrate that the system can robustly get accurate relative poses in real time with limited onboard computation resources. The source code is released.

cs.RO↗

Resolving the Mechanical and Radiative Feedback in J1044+0353 with KCWI Spectral Mapping

We present integral field spectroscopy toward and around J1044+0353, a rapidly growing, low-metallicity galaxy which produces extreme [O III] line emission. A new map of the O32 flux ratio reveals a density-bounded ionization cone emerging from the starburst. The interaction of the hydrogen ionizing radiation, produced by the very young starburst, with a cavity previously carved out by a galactic outflow, whose apex lies well outside the starburst region, determines the pathway for global Lyman continuum (LyC) escape. In the region within a few hundred parsecs of the young starburst, we demonstrate that superbubble breakthrough and blowout contribute distinct components to the [O III] line profile, broad and very-broad emission line wings, respectively. We draw attention to the large [O III] luminosity of the broad component and argue that this emission comes from photoionized, superbubble shells rather than a galactic wind as is often assumed. The spatially resolved H eII 4686 nebula appears to be photoionized by young star clusters. Stellar wind emission from these stars is likely the source of line wings detected on the He II line profile. This broader He II component indicates slow stellar winds, consistent with an increase in stellar rotation (and a decrease in effective escape speed) at the metallicity of J1044+0353. At least in J1044+0353, the recent star formation history plays a critical role in generating a global pathway for LyC escape, and the anisotropic escape would likely be missed by direct observations of the LyC.

astro-ph.GA↗

Arkenstone I: A Novel Method for Robustly Capturing High Specific Energy Outflows In Cosmological Simulations

Arkenstone is a new model for multiphase, stellar feedback driven galactic winds designed for inclusion in coarse resolution cosmological simulations. In this first paper of a series, we describe the features that allow Arkenstone to properly treat high specific energy wind components and demonstrate them using idealised non-cosmological simulations of a galaxy with a realistic CGM, using the Arepo code. Hot, fast gas phases with low mass loadings are predicted to dominate the energy content of multiphase outflows. In order to treat the huge dynamic range of spatial scales involved in cosmological galaxy formation at feasible computational expense, cosmological volume simulations typically employ a Lagrangian code or else use adaptive mesh refinement with a quasi-Lagrangian refinement strategy. However, it is difficult to inject a high specific energy wind in a Lagrangian scheme without incurring artificial burstiness. Additionally, the low densities inherent to this type of flow result in poor spatial resolution. Arkenstone addresses these issues with a novel scheme for coupling energy into the ISM/CGM transition region which also provides the necessary level of refinement at the base of the wind. In the absence of our improvements, we show that poor spatial resolution near the sonic point of a hot, fast outflow leads to an underestimation of gas acceleration as the wind propagates. We explore the different mechanisms by which low and high specific energy winds can regulate the SFR of galaxies. In future work, we will demonstrate other aspects of the Arkenstone model.

astro-ph.GA↗

Neuromorphic Event-Driven Semantic Communication in Microgrids

Synergies between advanced communications, computing and artificial intelligence are unraveling new directions of coordinated operation and resiliency in microgrids. On one hand, coordination among sources is facilitated by distributed, privacy-minded processing at multiple locations, whereas on the other hand, it also creates exogenous data arrival paths for adversaries that can lead to cyber-physical attacks amongst other reliability issues in the communication layer. This long-standing problem necessitates new intrinsic ways of exchanging information between converters through power lines to optimize the system's control performance. Going beyond the existing power and data co-transfer technologies that are limited by efficiency and scalability concerns, this paper proposes neuromorphic learning to implant communicative features using spiking neural networks (SNNs) at each node, which is trained collaboratively in an online manner simply using the power exchanges between the nodes. As opposed to the conventional neuromorphic sensors that operate with spiking signals, we employ an event-driven selective process to collect sparse data for training of SNNs. Finally, its multi-fold effectiveness and reliable performance is validated under simulation conditions with different microgrid topologies and components to establish a new direction in the sense-actuate-compute cycle for power electronic dominated grids and microgrids.

cs.ET↗

TaxDiff: Taxonomic-Guided Diffusion Model for Protein Sequence Generation

Designing protein sequences with specific biological functions and structural stability is crucial in biology and chemistry. Generative models already demonstrated their capabilities for reliable protein design. However, previous models are limited to the unconditional generation of protein sequences and lack the controllable generation ability that is vital to biological tasks. In this work, we propose TaxDiff, a taxonomic-guided diffusion model for controllable protein sequence generation that combines biological species information with the generative capabilities of diffusion models to generate structurally stable proteins within the sequence space. Specifically, taxonomic control information is inserted into each layer of the transformer block to achieve fine-grained control. The combination of global and local attention ensures the sequence consistency and structural foldability of taxonomic-specific proteins. Extensive experiments demonstrate that TaxDiff can consistently achieve better performance on multiple protein sequence generation benchmarks in both taxonomic-guided controllable generation and unconditional generation. Remarkably, the sequences generated by TaxDiff even surpass those produced by direct-structure-generation models in terms of confidence based on predicted structures and require only a quarter of the time of models based on the diffusion model. The code for generating proteins and training new versions of TaxDiff is available at:https://github.com/Linzy19/TaxDiff.

cs.LG↗

UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting

Multivariate time series forecasting plays a pivotal role in contemporary web technologies. In contrast to conventional methods that involve creating dedicated models for specific time series application domains, this research advocates for a unified model paradigm that transcends domain boundaries. However, learning an effective cross-domain model presents the following challenges. First, various domains exhibit disparities in data characteristics, e.g., the number of variables, posing hurdles for existing models that impose inflexible constraints on these factors. Second, the model may encounter difficulties in distinguishing data from various domains, leading to suboptimal performance in our assessments. Third, the diverse convergence rates of time series domains can also result in compromised empirical performance. To address these issues, we propose UniTime for effective cross-domain time series learning. Concretely, UniTime can flexibly adapt to data with varying characteristics. It also uses domain instructions and a Language-TS Transformer to offer identification information and align two modalities. In addition, UniTime employs masking to alleviate domain convergence speed imbalance issues. Our extensive experiments demonstrate the effectiveness of UniTime in advancing state-of-the-art forecasting performance and zero-shot transferability.

cs.LG↗

I Think, Therefore I am: Benchmarking Awareness of Large Language Models Using AwareBench

Do large language models (LLMs) exhibit any forms of awareness similar to humans? In this paper, we introduce AwareBench, a benchmark designed to evaluate awareness in LLMs. Drawing from theories in psychology and philosophy, we define awareness in LLMs as the ability to understand themselves as AI models and to exhibit social intelligence. Subsequently, we categorize awareness in LLMs into five dimensions, including capability, mission, emotion, culture, and perspective. Based on this taxonomy, we create a dataset called AwareEval, which contains binary, multiple-choice, and open-ended questions to assess LLMs' understandings of specific awareness dimensions. Our experiments, conducted on 13 LLMs, reveal that the majority of them struggle to fully recognize their capabilities and missions while demonstrating decent social intelligence. We conclude by connecting awareness of LLMs with AI alignment and safety, emphasizing its significance to the trustworthy and ethical development of LLMs. Our dataset and code are available at https://github.com/HowieHwong/Awareness-in-LLM.

cs.CL↗

Reversing Skin Cancer Adversarial Examples by Multiscale Diffusive and Denoising Aggregation Mechanism

Reliable skin cancer diagnosis models play an essential role in early screening and medical intervention. Prevailing computer-aided skin cancer classification systems employ deep learning approaches. However, recent studies reveal their extreme vulnerability to adversarial attacks -- often imperceptible perturbations to significantly reduce the performances of skin cancer diagnosis models. To mitigate these threats, this work presents a simple, effective, and resource-efficient defense framework by reverse engineering adversarial perturbations in skin cancer images. Specifically, a multiscale image pyramid is first established to better preserve discriminative structures in the medical imaging domain. To neutralize adversarial effects, skin images at different scales are then progressively diffused by injecting isotropic Gaussian noises to move the adversarial examples to the clean image manifold. Crucially, to further reverse adversarial noises and suppress redundant injected noises, a novel multiscale denoising mechanism is carefully designed that aggregates image information from neighboring scales. We evaluated the defensive effectiveness of our method on ISIC 2019, a largest skin cancer multiclass classification dataset. Experimental results demonstrate that the proposed method can successfully reverse adversarial perturbations from different attacks and significantly outperform some state-of-the-art methods in defending skin cancer diagnosis models.

cs.CV↗

On the Minimum Depth of Circuits with Linear Number of Wires Encoding Good Codes

Let $S_d(n)$ denote the minimum number of wires of a depth-$d$ (unbounded fan-in) circuit encoding an error-correcting code $C:\{0, 1\}^n \to \{0, 1\}^{32n}$ with distance at least $4n$. Gál, Hansen, Koucký, Pudlák, and Viola [IEEE Trans. Inform. Theory 59(10), 2013] proved that $S_d(n) = Θ_d(λ_d(n)\cdot n)$ for any fixed $d \ge 3$. By improving their construction and analysis, we prove $S_d(n)= O(λ_d(n)\cdot n)$. Letting $d = α(n)$, a version of the inverse Ackermann function, we obtain circuits of linear size. This depth $α(n)$ is the minimum possible to within an additive constant 2; we credit the nearly-matching depth lower bound to Gál et al., since it directly follows their method (although not explicitly claimed or fully verified in that work), and is obtained by making some constants explicit in a graph-theoretic lemma of Pudlák [Combinatorica, 14(2), 1994], extending it to super-constant depths. We also study a subclass of MDS codes $C: \mathbb{F}^n \to \mathbb{F}^m$ characterized by the Hamming-distance relation $\mathrm{dist}(C(x), C(y)) \ge m - \mathrm{dist}(x, y) + 1$ for any distinct $x, y \in \mathbb{F}^n$. (For linear codes this is equivalent to the generator matrix being totally invertible.) We call these superconcentrator-induced codes, and we show their tight connection with superconcentrators. Specifically, we observe that any linear or nonlinear circuit encoding a superconcentrator-induced code must be a superconcentrator graph, and any superconcentrator graph can be converted to a linear circuit, over a sufficiently large field (exponential in the size of the graph), encoding a superconcentrator-induced code.

cs.CC↗

A Deep Q-Network Based on Radial Basis Functions for Multi-Echelon Inventory Management

This paper addresses a multi-echelon inventory management problem with a complex network topology where deriving optimal ordering decisions is difficult. Deep reinforcement learning (DRL) has recently shown potential in solving such problems, while designing the neural networks in DRL remains a challenge. In order to address this, a DRL model is developed whose Q-network is based on radial basis functions. The approach can be more easily constructed compared to classic DRL models based on neural networks, thus alleviating the computational burden of hyperparameter tuning. Through a series of simulation experiments, the superior performance of this approach is demonstrated compared to the simple base-stock policy, producing a better policy in the multi-echelon system and competitive performance in the serial system where the base-stock policy is optimal. In addition, the approach outperforms current DRL approaches.

cs.LG↗