arXiv subjects

Zhe Wang

Publications and source records attributed to Zhe Wang.

At least 307 records · Page 17Linked to original sources

arXiv2024

Estimating a function of the scale parameter in a gamma distribution with bounded variance

Given a gamma population with known shape parameter $α$, we develop a general theory for estimating a function $g(\cdot)$ of the scale parameter $β$ with bounded variance. We begin by defining a sequential sampling procedure with $g(\cdot)$ satisfying some desired condition in proposing the stopping rule, and show the procedure enjoys appealing asymptotic properties. After these general conditions, we substitute $g(\cdot)$ with specific functions including the gamma mean, the gamma variance, the gamma rate parameter, and a gamma survival probability as four possible illustrations. For each illustration, Monte Carlo simulations are carried out to justify the remarkable performance of our proposed sequential procedure. This is further substantiated with a real data study on weights of newly born babies.

stat.ME↗

arXiv2024

DM3D: Distortion-Minimized Weight Pruning for Lossless 3D Object Detection

Applying deep neural networks to 3D point cloud processing has attracted increasing attention due to its advanced performance in many areas, such as AR/VR, autonomous driving, and robotics. However, as neural network models and 3D point clouds expand in size, it becomes a crucial challenge to reduce the computational and memory overhead to meet latency and energy constraints in real-world applications. Although existing approaches have proposed to reduce both computational cost and memory footprint, most of them only address the spatial redundancy in inputs, i.e. removing the redundancy of background points in 3D data. In this paper, we propose a novel post-training weight pruning scheme for 3D object detection that is (1) orthogonal to all existing point cloud sparsifying methods, which determines redundant parameters in the pretrained model that lead to minimal distortion in both locality and confidence (detection distortion); and (2) a universal plug-and-play pruning framework that works with arbitrary 3D detection model. This framework aims to minimize detection distortion of network output to maximally maintain detection precision, by identifying layer-wise sparsity based on second-order Taylor approximation of the distortion. Albeit utilizing second-order information, we introduced a lightweight scheme to efficiently acquire Hessian information, and subsequently perform dynamic programming to solve the layer-wise sparsity. Extensive experiments on KITTI, Nuscenes and ONCE datasets demonstrate that our approach is able to maintain and even boost the detection precision on pruned model under noticeable computation reduction (FLOPs). Noticeably, we achieve over 3.89x, 3.72x FLOPs reduction on CenterPoint and PVRCNN model, respectively, without mAP decrease, significantly improving the state-of-the-art.

cs.CV↗

arXiv2024

Decision Transformer for IRS-Assisted Systems with Diffusion-Driven Generative Channels

In this paper, we propose a novel diffusion-decision transformer (D2T) architecture to optimize the beamforming strategies for intelligent reflecting surface (IRS)-assisted multiple-input single-output (MISO) communication systems. The first challenge lies in the expensive computation cost to recover the real-time channel state information (CSI) from the received pilot signals, which usually requires prior knowledge of the channel distributions. To reduce the channel estimation complexity, we adopt a diffusion model to automatically learn the mapping between the received pilot signals and channel matrices in a model-free manner. The second challenge is that, the traditional optimization or reinforcement learning (RL) algorithms cannot guarantee the optimality of the beamforming policies once the channel distribution changes, and it is costly to resolve the optimized strategies. To enhance the generality of the decision models over varying channel distributions, we propose an offline pre-training and online fine-tuning decision transformer (DT) framework, wherein we first pre-train the DT offline with the data samples collected by the RL algorithms under diverse channel distributions, and then fine-tune the DT online with few-shot samples under a new channel distribution for a generalization purpose. Simulation results demonstrate that, compared with retraining RL algorithms, the proposed D2T algorithm boosts the convergence speed by 3 times with only a few samples from the new channel distribution while enhancing the average user data rate by 6%.

eess.SP↗

arXiv2024

Monitoring cis-to-trans isomerization of azobenzene using Brillouin microscopy

Brillouin spectroscopy is commonly used to study the acoustic properties of materials. Here we explored its feasibility in studying the photoinduced isomerization of azobenzene. The isomerization of azobenzene changes the solution elastic modulus, and Brillouin scattering is sensitive to these changes. In this study, we experimentally demonstrated the photoswitching of azobenzene in DMSO using our home-made VIPA-based high-resolution optical Brillouin spectrometer, and confirmed the results by ultraviolet-visible spectrophotometry. Remarkable Brillouin frequency shift variations were quantitatively recorded upon irradiation, and it was found that this method can indeed be used to monitor the isomerization process in situ. Importantly, our strategy also allows us to provide the relationship between the ratio of trans- and cis- azobenzene and the Brillouin frequency shift. This shows that Brillouin spectroscopy has broad prospects for the characterization of azobenzene isomerization and other photo responsive materials.

physics.optics↗

arXiv2024

A Tale of Two Paths: Toward a Hybrid Data Plane for Efficient Far-Memory Applications

With rapid advances in network hardware, far memory has gained a great deal of traction due to its ability to break the memory capacity wall. Existing far memory systems fall into one of two data paths: one that uses the kernel's paging system to transparently access far memory at the page granularity, and a second that bypasses the kernel, fetching data at the object granularity. While it is generally believed that object fetching outperforms paging due to its fine-grained access, it requires significantly more compute resources to run object-level LRU and eviction. We built Atlas, a hybrid data plane enabled by a runtime-kernel co-design that simultaneously enables accesses via these two data paths to provide high efficiency for real-world applications. Atlas uses always-on profiling to continuously measure page locality. For workloads already with good locality, paging is used to fetch data, whereas for those without, object fetching is employed. Object fetching moves objects that are accessed close in time to contiguous local space, dynamically improving locality and making the execution increasingly amenable to paging, which is much more resource-efficient. Our evaluation shows that Atlas improves the throughput (e.g., by 1.5x and 3.2x) and reduces the tail latency (e.g., by one and two orders of magnitude) when using remote memory, compared with AIFM and Fastswap, the state-of-the-art techniques respectively in the two categories.

cs.DC↗

arXiv2024

Towards Real-Time Neural Volumetric Rendering on Mobile Devices: A Measurement Study

Neural Radiance Fields (NeRF) is an emerging technique to synthesize 3D objects from 2D images with a wide range of potential applications. However, rendering existing NeRF models is extremely computation intensive, making it challenging to support real-time interaction on mobile devices. In this paper, we take the first initiative to examine the state-of-the-art real-time NeRF rendering technique from a system perspective. We first define the entire working pipeline of the NeRF serving system. We then identify possible control knobs that are critical to the system from the communication, computation, and visual performance perspective. Furthermore, an extensive measurement study is conducted to reveal the effects of these control knobs on system performance. Our measurement results reveal that different control knobs contribute differently towards improving the system performance, with the mesh granularity being the most effective knob and the quantization being the least effective knob. In addition, diverse hardware device settings and network conditions have to be considered to fully unleash the benefit of operating under the appropriate knobs

cs.DC↗

arXiv2024

Goal-oriented Semantic Communications for Avatar-centric Augmented Reality

Upon the advent of the emerging metaverse and its related applications in Augmented Reality (AR), the current bit-oriented network struggles to support real-time changes for the vast amount of associated information, hindering its development. Thus, a critical revolution in the Sixth Generation (6G) networks is envisioned through the joint exploitation of information context and its importance to the task, leading to a communication paradigm shift towards semantic and effectiveness levels. However, current research has not yet proposed any explicit and systematic communication framework for AR applications that incorporate these two levels. To fill this research gap, this paper presents a task-oriented and semantics-aware communication framework for augmented reality (TSAR) to enhance communication efficiency and effectiveness in 6G. Specifically, we first analyse the traditional wireless AR point cloud communication framework and then summarize our proposed semantic information along with the end-to-end wireless communication. We then detail the design blocks of the TSAR framework, covering both semantic and effectiveness levels. Finally, numerous experiments have been conducted to demonstrate that, compared to the traditional point cloud communication framework, our proposed TSAR significantly reduces wireless AR application transmission latency by 95.6%, while improving communication effectiveness in geometry and color aspects by up to 82.4% and 20.4%, respectively.

cs.IT↗

arXiv2024

Structural design of the acrylic vessel for the Jinping Neutrino Experiment

The Jinping neutrino experiment is designed to have multiple purposes in the China Jinping Underground Laboratory. Following the acrylic vessel design requirements proposal, a structural scheme has been developed and optimized. Subsequently, the stability of the acrylic shell structure was calculated using finite element analysis, as well as the load-bearing capacities under various working conditions. Further, the effects of temperature changes, rope failures, and Young's modulus of the ropes on the static behavior of the structure were analyzed. The results indicated that the stress level and structural displacement of the structure scheme satisfies the design requirements, as well as the stability of the vessel under compression. Moreover, the stress and displacement of the acrylic shell satisfies the given working conditions and temperatures. The structural scheme ensures basic safety if the rope fails.

physics.ins-det↗

arXiv2024

Magicoder: Empowering Code Generation with OSS-Instruct

We introduce Magicoder, a series of fully open-source (code, weights, and data) Large Language Models (LLMs) for code that significantly closes the gap with top code models while having no more than 7B parameters. Magicoder models are trained on 75K synthetic instruction data using OSS-Instruct, a novel approach to enlightening LLMs with open-source code snippets to generate diverse instruction data for code. Our main motivation is to mitigate the inherent bias of the synthetic data generated by LLMs through the wealth of open-source references for the production of more realistic and controllable data. The orthogonality of OSS-Instruct and other data generation methods like Evol-Instruct further enables us to build an enhanced MagicoderS. Both Magicoder and MagicoderS substantially outperform state-of-the-art code models with similar or even larger sizes on a wide range of coding benchmarks. Notably, MagicoderS-CL-7B based on CodeLlama even surpasses the prominent ChatGPT on HumanEval+ (66.5 vs. 65.9 in pass@1 ). Overall, OSS-Instruct opens a new direction for crafting diverse synthetic instruction data for code using abundant open-source references.

cs.CL↗

arXiv2024

Quantum criticality with emergent symmetry in the extended Shastry-Sutherland model

Motivated by the novel phenomena observed in the layered material $\rm SrCu_2(BO_3)_2$, the Shastry-Sutherland model (SSM) has been extensively studied as the minimal model for $\rm SrCu_2(BO_3)_2$. However, the nature of its quantum phase transition from the plaquette valence-bond solid (PVBS) to antiferromagnetic (AFM) phase is under fierce debate, posing a challenge to understand the underlying quantum criticality. Via the state-of-the-art tensor network simulations, we study the ground state of the SSM on large-scale size up to $20 \times 20$ sites. We identify the continuous transition nature accompanied by an emergent O(4) symmetry between the PVBS and AFM phase, which strongly suggests a deconfined quantum critical point (DQCP). Furthermore, we map out the phase diagram of an extended SSM that can be continuously tuned to the SSM, which demonstrates the same DQCP phenomena along a whole critical line. Our results indicate a compelling scenario for understanding the origin of the proposed proximate DQCP in recent experiments of $\rm SrCu_2(BO_3)_2$.

cond-mat.str-el↗

arXiv2024

Hybrid-Field Channel Estimation for XL-MIMO Systems with Stochastic Gradient Pursuit Algorithm

Extremely large-scale multiple-input multiple-output (XL-MIMO) is crucial for satisfying the high data rate requirements of the sixth-generation (6G) wireless networks. In this context, ensuring accurate acquisition of channel state information (CSI) with low complexity becomes imperative. Moreover, deploying an extremely large antenna array at the base station (BS) might result in some scatterers being located in near-field, while others are situated in far-field, leading to a hybrid-field communication scenario. To address these challenges, this paper introduces two stochastic gradient pursuit (SGP)-based schemes for the hybrid-field channel estimation in two scenarios. For the first scenario in which the prior knowledge of the specific proportion of the number of near-field and far-field channel paths is known, the scheme can effectively leverage the angular-domain sparsity of the far-field channels and the polar-domain sparsity of the near-field channels such that the channel estimation in these two fields can be performed separately. For the second scenario which the proportion is not available, we propose an off-grid SGP-based channel estimation scheme, which iterates through the values of the proportion parameter based on a criterion before performing the hybrid-field channel estimation. We demonstrate numerically that both of the proposed channel estimation schemes achieve superior performance in terms of both estimation accuracy and achievable rates while enjoying lower computational complexity compared with existing schemes. Additionally, we reveal that as the number of antennas at the UE increases, the normalized mean square error (NMSE) performances of the proposed schemes remain basically unchanged, while the NMSE performances of existing ones improve. Remarkably, even in this scenario, the proposed schemes continue to outperform the existing ones.

eess.SP↗

arXiv2024

Single electron charge spectra of 8-inch high-collection-efficiency MCP-PMTs

The atomic layer deposition(ALD) coating lengthens the lifetime of microchannel plates(MCP), which are used as the electron amplifier of the photomultiplier tubes(PMT). In the Jinping Neutrino Experiment, the newly developed 8-inch MCP-PMT achieves high collection efficiency by coating with high secondary emission materials. The resulting single electron response(SER) charge distribution deviates from the Gaussian distribution in large charge regions.To understand the nature of the jumbo-charged SER, we designed a voltage-division experiment to quantify the dependence of the MCP gain on the energy of incident electrons. Combining the relationship with the Furman probabilistic model, we reproduced the SER charge spectra by an additional amplification stage on the input electrode of the first MCP. Our results favor a Gamma-Tweedie mixture to describe the SER charge spectra of the MCP-PMTs.

physics.ins-det↗

arXiv2024

Why Superconducting Ta Qubits Have Fewer Tunneling Two-Level Systems at the Air-Oxide Interface Than Nb Qubits

Superconducting qubits are a key contender for quantum computing elements, but they often face challenges like noise and decoherence from two-level systems (TLS). Tantalum (Ta) qubits are notable for their long T$_1$ coherence times nearing milliseconds, mainly due to fewer TLS, though the cause was unclear. Our research explored this by analyzing the air-oxide interface with density functional theory, particularly comparing Nb oxide (Nb$_2$O$_5$) and Ta oxide (Ta$_2$O$_5$). We discovered that Ta$_2$O$_5$ forms a smoother surface with fewer dangling O atoms and TLS than Nb$_2$O$_5$. The greater atomic mass of Ta also lowers the TLS tunnel splittings below the qubit's operating frequency. Furthermore, using external electric fields or SO$_2$ passivation can significantly reduce TLS on Nb surfaces, potentially improving their coherence times.

cond-mat.mtrl-sci↗

arXiv2024

Resource Allocation for Near-Field Communications: Fundamentals, Tools, and Outlooks

Extremely large-scale multiple-input-multiple output (XL-MIMO) is a promising technology to achieve high spectral efficiency (SE) and energy efficiency (EE) in future wireless systems. The larger array aperture of XL-MIMO makes communication scenarios closer to the near-field region. Therefore, near-field resource allocation is essential in realizing the above key performance indicators (KPIs). Moreover, the overall performance of XL-MIMO systems heavily depends on the channel characteristics of the selected users, eliminating interference between users through beamforming, power control, etc. The above resource allocation issue constitutes a complex joint multi-objective optimization problem since many variables and parameters must be optimized, including the spatial degree of freedom, rate, power allocation, and transmission technique. In this article, we review the basic properties of near-field communications and focus on the corresponding "resource allocation" problems. First, we identify available resources in near-field communication systems and highlight their distinctions from far-field communications. Then, we summarize optimization tools, such as numerical techniques and machine learning methods, for addressing near-field resource allocation, emphasizing their strengths and limitations. Finally, several important research directions of near-field communications are pointed out for further investigation.

cs.IT↗

arXiv2024

From Algorithm to Hardware: A Survey on Efficient and Safe Deployment of Deep Neural Networks

Deep neural networks (DNNs) have been widely used in many artificial intelligence (AI) tasks. However, deploying them brings significant challenges due to the huge cost of memory, energy, and computation. To address these challenges, researchers have developed various model compression techniques such as model quantization and model pruning. Recently, there has been a surge in research of compression methods to achieve model efficiency while retaining the performance. Furthermore, more and more works focus on customizing the DNN hardware accelerators to better leverage the model compression techniques. In addition to efficiency, preserving security and privacy is critical for deploying DNNs. However, the vast and diverse body of related works can be overwhelming. This inspires us to conduct a comprehensive survey on recent research toward the goal of high-performance, cost-efficient, and safe deployment of DNNs. Our survey first covers the mainstream model compression techniques such as model quantization, model pruning, knowledge distillation, and optimizations of non-linear operations. We then introduce recent advances in designing hardware accelerators that can adapt to efficient model compression approaches. Additionally, we discuss how homomorphic encryption can be integrated to secure DNN deployment. Finally, we discuss several issues, such as hardware evaluation, generalization, and integration of various compression approaches. Overall, we aim to provide a big picture of efficient DNNs, from algorithm to hardware accelerators and security perspectives.

cs.LG↗

arXiv2024

RegionPLC: Regional Point-Language Contrastive Learning for Open-World 3D Scene Understanding

We propose a lightweight and scalable Regional Point-Language Contrastive learning framework, namely \textbf{RegionPLC}, for open-world 3D scene understanding, aiming to identify and recognize open-set objects and categories. Specifically, based on our empirical studies, we introduce a 3D-aware SFusion strategy that fuses 3D vision-language pairs derived from multiple 2D foundation models, yielding high-quality, dense region-level language descriptions without human 3D annotations. Subsequently, we devise a region-aware point-discriminative contrastive learning objective to enable robust and effective 3D learning from dense regional language supervision. We carry out extensive experiments on ScanNet, ScanNet200, and nuScenes datasets, and our model outperforms prior 3D open-world scene understanding approaches by an average of 17.2\% and 9.1\% for semantic and instance segmentation, respectively, while maintaining greater scalability and lower resource demands. Furthermore, our method has the flexibility to be effortlessly integrated with language models to enable open-ended grounded 3D reasoning without extra task-specific training. Code is available at https://github.com/CVMI-Lab/PLA.

cs.CV↗

arXiv2024

On the derivatives of the Liouville currents

The Liouville map, introduced by Bonahon, assigns to each point in the Teichmüller space a natural Radon measure on the space of geodesics of the base surface. The Liouville map is real analytic and it even extends to a holomorphic map of a neighborhood of the Teichmüller space in the Quasi-Fuchsian space of an arbitrary conformally hyperbolic Riemann surface. The earthquake paths and by their extension quake-bends, introduced by Thurston, are particularly nice real-analytic and holomorphic paths in the Teichmüller and the Quasi-Fuchsian space, respectively. We find a geometric expression for the derivative of the Liouville map along earthquake paths.

math.CV↗

arXiv2024

Attention Calibration for Disentangled Text-to-Image Personalization

Recent thrilling progress in large-scale text-to-image (T2I) models has unlocked unprecedented synthesis quality of AI-generated content (AIGC) including image generation, 3D and video composition. Further, personalized techniques enable appealing customized production of a novel concept given only several images as reference. However, an intriguing problem persists: Is it possible to capture multiple, novel concepts from one single reference image? In this paper, we identify that existing approaches fail to preserve visual consistency with the reference image and eliminate cross-influence from concepts. To alleviate this, we propose an attention calibration mechanism to improve the concept-level understanding of the T2I model. Specifically, we first introduce new learnable modifiers bound with classes to capture attributes of multiple concepts. Then, the classes are separated and strengthened following the activation of the cross-attention operation, ensuring comprehensive and self-contained concepts. Additionally, we suppress the attention activation of different classes to mitigate mutual influence among concepts. Together, our proposed method, dubbed DisenDiff, can learn disentangled multiple concepts from one single image and produce novel customized images with learned concepts. We demonstrate that our method outperforms the current state of the art in both qualitative and quantitative evaluations. More importantly, our proposed techniques are compatible with LoRA and inpainting pipelines, enabling more interactive experiences.

cs.CV↗