arXiv subjects

Zihan Zhang

Publications and source records attributed to Zihan Zhang.

At least 145 records · Page 8Linked to original sources

arXiv2024

DualSep: A Light-weight dual-encoder convolutional recurrent network for real-time in-car speech separation

Advancements in deep learning and voice-activated technologies have driven the development of human-vehicle interaction. Distributed microphone arrays are widely used in in-car scenarios because they can accurately capture the voices of passengers from different speech zones. However, the increase in the number of audio channels, coupled with the limited computational resources and low latency requirements of in-car systems, presents challenges for in-car multi-channel speech separation. To migrate the problems, we propose a lightweight framework that cascades digital signal processing (DSP) and neural networks (NN). We utilize fixed beamforming (BF) to reduce computational costs and independent vector analysis (IVA) to provide spatial prior. We employ dual encoders for dual-branch modeling, with spatial encoder capturing spatial cues and spectral encoder preserving spectral information, facilitating spatial-spectral fusion. Our proposed system supports both streaming and non-streaming modes. Experimental results demonstrate the superiority of the proposed system across various metrics. With only 0.83M parameters and 0.39 real-time factor (RTF) on an Intel Core i7 (2.6GHz) CPU, it effectively separates speech into distinct speech zones. Our demos are available at https://honee-w.github.io/DualSep/.

eess.AS↗

arXiv2024

The Critical Metallization of Hydrogen in Pressurized LaBeH8 Hydride

Behaviours of hydrogen, such as fluidity and metallicity, are crucial for our understanding of planetary interiors and the emerging field of high-temperature superconducting hydrides. These behaviours were discovered in complex phase diagrams of hydrogen and hydrides, however, the transition mechanism of behaviours driven by temperature, pressure and chemical compression remain unclear, particularly in the processes of metallization. Until now, a comprehensive theoretical framework to quantify atomization and metallization of hydrogen in phase diagram of hydrides has been lacking. In this study, we address this gap by combining molecular dynamics and electronic structure analysis to propose a theoretical framework, which clarify the content and properties of atomic hydrogen under various temperature and pressure conditions and chemical compression exerted by non-hydrogen elements in hydrides. Applying this framework to the superconducting hydride LaBeH8, we identify three general hydrogen orderings within its phase diagram: molecular, sublattice and warm hydrogens. During the phase transition from molecule to sublattice, hydrogen exhibits different properties from three general hydrogen orderings, such as fast superionicity, metallicity and unusual atomic content response to temperature. These abnormal behaviours were defined as the critical metallization of hydrogen, which not only suggests a potential synthesis route for the metastable phase but also provides valuable insights into the complex synthetic products of superconducting hydrides.

cond-mat.mtrl-sci↗

arXiv2024

Distil-DCCRN: A Small-footprint DCCRN Leveraging Feature-based Knowledge Distillation in Speech Enhancement

The deep complex convolution recurrent network (DCCRN) achieves excellent speech enhancement performance by utilizing the audio spectrum's complex features. However, it has a large number of model parameters. We propose a smaller model, Distil-DCCRN, which has only 30% of the parameters compared to the DCCRN. To ensure that the performance of Distil-DCCRN matches that of the DCCRN, we employ the knowledge distillation (KD) method to use a larger teacher model to help train a smaller student model. We design a knowledge distillation (KD) method, integrating attention transfer and Kullback-Leibler divergence (AT-KL) to train the student model Distil-DCCRN. Additionally, we use a model with better performance and a more complicated structure, Uformer, as the teacher model. Unlike previous KD approaches that mainly focus on model outputs, our method also leverages the intermediate features from the models' middle layers, facilitating rich knowledge transfer across different structured models despite variations in layer configurations and discrepancies in the channel and time dimensions of intermediate features. Employing our AT-KL approach, Distil-DCCRN outperforms DCCRN as well as several other competitive models in both PESQ and SI-SNR metrics on the DNS test set and achieves comparable results to DCCRN in DNSMOS.

cs.SD↗

arXiv2024

Electronic Correlations and Hund's Rule Coupling in Trilayer Nickelate La4Ni3O10

Trilayer Ruddlesden-Popper phase La4Ni3O10 has been observed with Tc of about 30 K at high pressure in recent experiment, which further expanded the family of nickelate superconductors. In this study, we explored the effects of electronic correlations in La4Ni3O10 using density function theory plus dynamical mean-field theory at ambient and high pressures. Our derived spectral functions and Fermi surface of ambient pressure phase are nicely consistent with the experimental results by angle-resolved photoemission spectroscopy, which emphasized the importance of electronic correlations in La4Ni3O10. We also found the electronic correlations in pressured La4Ni3O10 are both orbital-dependent and layer-dependent due to the presence of Hund's rule coupling. There is a competition between the Hund's rule coupling and the crystal-field splitting, and therefore the Ni-O layers with weaker crystal-field splitting energy would have stronger electronic correlations.

cond-mat.str-el↗

arXiv2024

E5-V: Universal Embeddings with Multimodal Large Language Models

Multimodal large language models (MLLMs) have shown promising advancements in general visual and language understanding. However, the representation of multimodal information using MLLMs remains largely unexplored. In this work, we introduce a new framework, E5-V, designed to adapt MLLMs for achieving universal multimodal embeddings. Our findings highlight the significant potential of MLLMs in representing multimodal inputs compared to previous approaches. By leveraging MLLMs with prompts, E5-V effectively bridges the modality gap between different types of inputs, demonstrating strong performance in multimodal embeddings even without fine-tuning. We propose a single modality training approach for E5-V, where the model is trained exclusively on text pairs. This method demonstrates significant improvements over traditional multimodal training on image-text pairs, while reducing training costs by approximately 95%. Additionally, this approach eliminates the need for costly multimodal training data collection. Extensive experiments across four types of tasks demonstrate the effectiveness of E5-V. As a universal multimodal model, E5-V not only achieves but often surpasses state-of-the-art performance in each task, despite being trained on a single modality.

cs.CL↗

arXiv2024

Random Reed-Solomon Codes Achieve the Half-Singleton Bound for Insertions and Deletions over Linear-Sized Alphabets

In this paper, we prove that with high probability, random Reed-Solomon codes approach the half-Singleton bound - the optimal rate versus error tradeoff for linear insdel codes - with linear-sized alphabets. More precisely, we prove that, for any $ε>0$ and positive integers $n$ and $k$, with high probability, random Reed--Solomon codes of length $n$ and dimension $k$ can correct $(1-\varepsilon)n-2k+1$ adversarial insdel errors over alphabets of size $n+2^{\mathsf{poly}(1/\varepsilon)}k$. This significantly improves upon the alphabet size demonstrated in the work of Con, Shpilka, and Tamo (IEEE TIT, 2023), who showed the existence of Reed--Solomon codes with exponential alphabet size $\widetilde O\left(\binom{n}{2k-1}^2\right)$ precisely achieving the half-Singleton bound. Our methods are inspired by recent works on list-decoding Reed-Solomon codes. Brakensiek-Gopi-Makam (STOC 2023) showed that random Reed-Solomon codes are list-decodable up to capacity with exponential-sized alphabets, and Guo-Zhang (FOCS 2023) and Alrabiah-Guruswami-Li (STOC 2024) improved the alphabet-size to linear. We achieve a similar alphabet-size reduction by similarly establishing strong bounds on the probability that certain random rectangular matrices are full rank. To accomplish this in our insdel context, our proof combines the random matrix techniques from list-decoding with structural properties of Longest Common Subsequences.

cs.IT↗

arXiv2024

Modulation of the Octahedral Structure and Potential Superconductivity of La$_3$Ni$_2$O$_7$ through Strain Engineering

The recent transport measurement of La$_3$Ni$_2$O$_7$ uncover a "right-triangle" shape of the superconducting dome in the pressure-temperature (P-T) phase diagram. Motivated by this, we perform theoretical first-principles studies of La$_3$Ni$_2$O$_7$ with the pressure ranging from 0 to 100 GPa. Notably, we reveal a pressure dependence of the Ni-$d_{z^2}$ electron density at the Fermi energy ($n_z^{EF}$) that highly coincides with such shape. On this basis, we further explore the electronic structure under uniaxial stress. By tracking the stress response of $n_z^{EF}$, we propose that superconductivity can be achieved by applying only about 2 GPa of compression along the c axis. The idea is further exemplified from the perspectives of lattice distortion, band structure, Fermi surface and superconducting phase coherence. We also discuss the possible charge modulation under the stress and provide an insight to the relation between n_z^EF and the superconducting Tc in La$_3$Ni$_2$O$_7$ system. Our study provides a helpful guide to the future experiment.

cond-mat.supr-con↗

arXiv2024

High-temperature Superconductivity in Perovskite Hydride below 10 GPa

Hydrogen and hydrides materials have long been considered promising materials for high-temperature superconductivity. But the extreme pressures required for the metallization of hydrogen-based superconductors limit their applications. Here, we have designed a series of high-temperature perovskite hydrides that can be stable within 10 GPa. Our research covered 182 ternary systems and ultimately determined that 9 compounds were stable within 20 GPa, of which 5 exhibited superconducting transition temperatures exceeding 120 K within 10 GPa. Excitingly, KGaH3 and CsInH3 are thermodynamically stable at 50 GPa. Among these perovskite hydrides, alkali metals are responsible for providing a fixed amount of charge and maintaining structural stability, while the cubic framework formed by IIIA group elements and hydrogen is crucial for high-temperature superconductivity. This work will inspire further experimental exploration and take an important step in the exploration of low-pressure stable high-temperature superconductors.

cond-mat.supr-con↗

arXiv2024

PiPar: Pipeline Parallelism for Collaborative Machine Learning

Collaborative machine learning (CML) techniques, such as federated learning, have been proposed to train deep learning models across multiple mobile devices and a server. CML techniques are privacy-preserving as a local model that is trained on each device instead of the raw data from the device is shared with the server. However, CML training is inefficient due to low resource utilization. We identify idling resources on the server and devices due to sequential computation and communication as the principal cause of low resource utilization. A novel framework PiPar that leverages pipeline parallelism for CML techniques is developed to substantially improve resource utilization. A new training pipeline is designed to parallelize the computations on different hardware resources and communication on different bandwidth resources, thereby accelerating the training process in CML. A low overhead automated parameter selection method is proposed to optimize the pipeline, maximizing the utilization of available resources. The experimental results confirm the validity of the underlying approach of PiPar and highlight that when compared to federated learning: (i) the idle time of the server can be reduced by up to 64.1x, and (ii) the overall training time can be accelerated by up to 34.6x under varying network conditions for a collection of six small and large popular deep neural networks and four datasets without sacrificing accuracy. It is also experimentally demonstrated that PiPar achieves performance benefits when incorporating differential privacy methods and operating in environments with heterogeneous devices and changing bandwidths.

cs.DC↗

arXiv2024

Structures and Superconductivity of Hydrogen and Hydrides under Extreme Pressure

Metallic hydrogen, existing in remarkably extreme environments, was predicted to exhibit long-sought room-temperature superconductivity. Although the superconductivity of metallic hydrogen has not been confirmed experimentally, superconductivity of hydrogen in hydrides was recently discovered with remarkably high critical temperature as theoretically predicted. In recent years, theoretical simulations have become a new paradigm for material science, especially exploration of material at extreme pressure. As the typical high-pressure material, metallic hydrogen has been providing a fertile playground for advanced simulations for long time. Simulations not only provide the substitute of experiments for hydrogen at high-pressure, but also encouraged the discovery of almost all the experimentally discovered superconducting hydrides with the record high superconducting transition temperature. This work reviews recent progress in hydrogen and hydrides under extreme pressure, focusing on phase diagram, structures and the long-sought goal of high-temperature superconductivity. In the end, we highlight structural features of hydrides for realization of hydrogen-driven superconducting hydrides near ambient pressure.

cond-mat.supr-con↗

arXiv2024

BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation

Audio packet loss is an inevitable problem in real-time speech communication. A band-split packet loss concealment network (BS-PLCNet) targeting full-band signals was recently proposed. Although it performs superiorly in the ICASSP 2024 PLC Challenge, BS-PLCNet is a large model with high computational complexity of 8.95G FLOPS. This paper presents its updated version, BS-PLCNet 2, to reduce computational complexity and improve performance further. Specifically, to compensate for the missing future information, in the wide-band module, we design a dual-path encoder structure (with non-causal and causal path) and leverage an intra-model knowledge distillation strategy to distill the future information from the non-causal teacher to the casual student. Moreover, we introduce a lightweight post-processing module after packet loss restoration to recover speech distortions and remove residual noise in the audio signal. With only 40% of original parameters in BS-PLCNet, BS-PLCNet 2 brings 0.18 PLCMOS improvement on the ICASSP 2024 PLC challenge blind set, achieving state-of-the-art performance on this dataset.

eess.AS↗

arXiv2024

RetrievalQA: Assessing Adaptive Retrieval-Augmented Generation for Short-form Open-Domain Question Answering

Adaptive retrieval-augmented generation (ARAG) aims to dynamically determine the necessity of retrieval for queries instead of retrieving indiscriminately to enhance the efficiency and relevance of the sourced information. However, previous works largely overlook the evaluation of ARAG approaches, leading to their effectiveness being understudied. This work presents a benchmark, RetrievalQA, comprising 1,271 short-form questions covering new world and long-tail knowledge. The knowledge necessary to answer the questions is absent from LLMs; therefore, external information must be retrieved to answer correctly. This makes RetrievalQA a suitable testbed to evaluate existing ARAG methods. We observe that calibration-based methods heavily rely on threshold tuning, while vanilla prompting is inadequate for guiding LLMs to make reliable retrieval decisions. Based on our findings, we propose Time-Aware Adaptive Retrieval (TA-ARE), a simple yet effective method that helps LLMs assess the necessity of retrieval without calibration or additional training. The dataset and code will be available at https://github.com/hyintell/RetrievalQA

cs.CL↗

arXiv2024

Achieving Tractable Minimax Optimal Regret in Average Reward MDPs

In recent years, significant attention has been directed towards learning average-reward Markov Decision Processes (MDPs). However, existing algorithms either suffer from sub-optimal regret guarantees or computational inefficiencies. In this paper, we present the first tractable algorithm with minimax optimal regret of $\widetilde{\mathrm{O}}(\sqrt{\mathrm{sp}(h^*) S A T})$, where $\mathrm{sp}(h^*)$ is the span of the optimal bias function $h^*$, $S \times A$ is the size of the state-action space and $T$ the number of learning steps. Remarkably, our algorithm does not require prior information on $\mathrm{sp}(h^*)$. Our algorithm relies on a novel subroutine, Projected Mitigated Extended Value Iteration (PMEVI), to compute bias-constrained optimal policies efficiently. This subroutine can be applied to various previous algorithms to improve regret bounds.

cs.LG↗

arXiv2024

ASI++: Towards Distributionally Balanced End-to-End Generative Retrieval

Generative retrieval, a promising new paradigm in information retrieval, employs a seq2seq model to encode document features into parameters and decode relevant document identifiers (IDs) based on search queries. Existing generative retrieval solutions typically rely on a preprocessing stage to pre-define document IDs, which can suffer from a semantic gap between these IDs and the retrieval task. However, end-to-end training for both ID assignments and retrieval tasks is challenging due to the long-tailed distribution characteristics of real-world data, resulting in inefficient and unbalanced ID space utilization. To address these issues, we propose ASI++, a novel fully end-to-end generative retrieval method that aims to simultaneously learn balanced ID assignments and improve retrieval performance. ASI++ builds on the fully end-to-end training framework of vanilla ASI and introduces several key innovations. First, a distributionally balanced criterion addresses the imbalance in ID assignments, promoting more efficient utilization of the ID space. Next, a representation bottleneck criterion enhances dense representations to alleviate bottlenecks in learning ID assignments. Finally, an information consistency criterion integrates these processes into a joint optimization framework grounded in information theory. We further explore various module structures for learning ID assignments, including neural quantization, differentiable product quantization, and residual quantization. Extensive experiments on both public and industrial datasets demonstrate the effectiveness of ASI++ in improving retrieval performance and achieving balanced ID assignments.

cs.IR↗

arXiv2024

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

Low-rank adaptation is a popular parameter-efficient fine-tuning method for large language models. In this paper, we analyze the impact of low-rank updating, as implemented in LoRA. Our findings suggest that the low-rank updating mechanism may limit the ability of LLMs to effectively learn and memorize new knowledge. Inspired by this observation, we propose a new method called MoRA, which employs a square matrix to achieve high-rank updating while maintaining the same number of trainable parameters. To achieve it, we introduce the corresponding non-parameter operators to reduce the input dimension and increase the output dimension for the square matrix. Furthermore, these operators ensure that the weight can be merged back into LLMs, which makes our method can be deployed like LoRA. We perform a comprehensive evaluation of our method across five tasks: instruction tuning, mathematical reasoning, continual pretraining, memory and pretraining. Our method outperforms LoRA on memory-intensive tasks and achieves comparable performance on other tasks.

cs.CL↗

arXiv2024

Using a Fast Adaptive Function Approximator to calculate Protein-Filament Binding Kinetics

The cytoskeleton, consisting of biopolymer filaments, molecular motors, and passive crosslinking proteins, provides the internal structure of cells that facilitate movement, growth, and cell division. Understanding the microscopic motor-filament kinetics and dynamics is essential for comprehending macroscopic behaviors of reconstituted cytoskeletal assemblies, such as self-organized flow and active stress. In this study, we employ an adaptive fast Chebyshev approximator based on tree search and parallel computing to accurately recover the equilibrium distribution of crosslinking proteins. Therefore, it satisfies detailed balance in binding through kinetic Monte Carlo sampling while maintaining cost-effectiveness. Additionally, we offer expandable features, including segregating the simulation process via pre-building and allowing the free-loading of different closed-form formulations of the motor's potential energy. Overall, this research contributes to computational advancement in function approximation and has the potential to better describe the evolution of cytoskeletal active matter.

cond-mat.soft↗

arXiv2024

Prediction of Room-Temperature Superconductivity in Quasi-atomic H2-Type Hydrides at High Pressure

Achieving superconductivity at room temperature (RT) is a holy grail in physics. Recent discoveries on high-Tc superconductivity in binary hydrides H3S and LaH10 at high pressure have directed the search for RT superconductors to compress hydrides with conventional electron-phonon mechanisms. Here, we predict an exceptional family of superhydrides under high pressures, MH12 (M = Mg, Sc, Zr, Hf, Lu), all exhibiting RT superconductivity with calculated Tcs ranging from 313 to 398 K. In contrast to H3S and LaH10, the hydrogen sublattice in MH12 is arranged as quasi-atomic H2 units. This unique configuration is closely associated with high Tc, attributed to the high electronic density of states derived from H2 antibonding states at the Fermi level and the strong electron-phonon coupling related to the bending vibration of H2 and H-M-H. Notably, MgH12 and ScH12 remain dynamically stable even at pressure below 100 GPa. Our findings offer crucial insights into achieving RT superconductivity and pave the way for innovative directions in experimental research.

cond-mat.supr-con↗

arXiv2024

Tunable exciton valley-pseudospin orders in moiré Bose-Hubbard model

Spin and charge are the two most important degrees of freedom of electrons. Their interplay lies at the heart of numerous strongly correlated phenomena including Hubbard model physics and high temperature superconductivity. Such interplay for bosons, on the other hand, is largely unexplored in condensed matter systems. Here we demonstrate a unique realization of the spin-1/2 Bose-Hubbard model through excitons in a semiconducting moiré superlattice. We find evidence of a transient in-plane ferromagnetic (FM-$xy$) order of exciton spin - here valley pseudospin - around exciton filling $ν_{ex}$ = 1, which transitions into a FM-$z$ order both with increasing exciton filling and a small magnetic field of 10 mT. The phase diagram is different from the fermion case and is qualitatively captured by a simple phenomenological model, highlighting the unique consequence of Bose-Einstein statistics. Our study paves the way for engineering exotic phases of matter from spinor bosons, as well as for unconventional devices in optics and quantum information science.

cond-mat.mes-hall↗