arXiv subjects

Feng Wang

Publications and source records attributed to Feng Wang.

At least 199 records · Page 11Linked to original sources

arXiv2024

An Integrated Data Processing Framework for Pretraining Foundation Models

The ability of the foundation models heavily relies on large-scale, diverse, and high-quality pretraining data. In order to improve data quality, researchers and practitioners often have to manually curate datasets from difference sources and develop dedicated data cleansing pipeline for each data repository. Lacking a unified data processing framework, this process is repetitive and cumbersome. To mitigate this issue, we propose a data processing framework that integrates a Processing Module which consists of a series of operators at different granularity levels, and an Analyzing Module which supports probing and evaluation of the refined data. The proposed framework is easy to use and highly flexible. In this demo paper, we first introduce how to use this framework with some example use cases and then demonstrate its effectiveness in improving the data quality with an automated evaluation with ChatGPT and an end-to-end evaluation in pretraining the GPT-2 model. The code and demonstration videos are accessible on GitHub.

cs.LG↗

arXiv2024

Towards Accurate and Efficient Sorting of Retired Lithium-ion Batteries: A Data Driven Based Electrode Aging Assessment Approach

Retired batteries (RBs) for second-life applications offer promising economic and environmental benefits. However, accurate and efficient sorting of RBs with discrepant characteristics persists as a pressing challenge. In this study, we introduce a data driven based electrode aging assessment approach to address this concern. To this end, a number of 15 feature points are extracted from battery open circuit voltage (OCV) curves to capture their characteristics at different levels of aging, and a convolutional neural network with an optimized structure and minimized input size is established to relocate the relative positions of these OCV feature points. Next, a rapid estimation algorithm is proposed to identify the three electrode aging parameters (EAPs) which best reconstruct the 15 OCV feature points over the entire usable capacity range. Utilizing the three EAPs as sorting indices, we employ an adaptive affinity propagation algorithm to cluster RBs without the need for pre-determining the clustering number. Unlike conventional sorting methods based solely on battery capacity, the proposed method provides profound insights into electrode aging behaviors, minimizes the need for constant-current charging data, and supports module/pack-level tests for the simultaneous processing of high volumes of RBs.

eess.SY↗

arXiv2024

Seismic Traveltime Tomography with Label-free Learning

Deep learning techniques have been used to build velocity models (VMs) for seismic traveltime tomography and have shown encouraging performance in recent years. However, they need to generate labeled samples (i.e., pairs of input and label) to train the deep neural network (NN) with end-to-end learning, and the real labels for field data inversion are usually missing or very expensive. Some traditional tomographic methods can be implemented quickly, but their effectiveness is often limited by prior assumptions. To avoid generating and/or collecting labeled samples, we propose a novel method by integrating deep learning and dictionary learning to enhance the VMs with low resolution by using the traditional tomography-least square method (LSQR). We first design a type of shallow and simple NN to reduce computational cost followed by proposing a two-step strategy to enhance the VMs with low resolution: (1) Warming up. An initial dictionary is trained from the estimation by LSQR through dictionary learning method; (2) Dictionary optimization. The initial dictionary obtained in the warming-up step will be optimized by the NN, and then it will be used to reconstruct high-resolution VMs with the reference slowness and the estimation by LSQR. Furthermore, we design a loss function to minimize traveltime misfit to ensure that NN training is label-free, and the optimized dictionary can be obtained after each epoch of NN training. We demonstrate the effectiveness of the proposed method through the numerical tests on both synthetic and field data.

physics.geo-ph↗

arXiv2024

Text-to-3D using Gaussian Splatting

Automatic text-to-3D generation that combines Score Distillation Sampling (SDS) with the optimization of volume rendering has achieved remarkable progress in synthesizing realistic 3D objects. Yet most existing text-to-3D methods by SDS and volume rendering suffer from inaccurate geometry, e.g., the Janus issue, since it is hard to explicitly integrate 3D priors into implicit 3D representations. Besides, it is usually time-consuming for them to generate elaborate 3D models with rich colors. In response, this paper proposes GSGEN, a novel method that adopts Gaussian Splatting, a recent state-of-the-art representation, to text-to-3D generation. GSGEN aims at generating high-quality 3D objects and addressing existing shortcomings by exploiting the explicit nature of Gaussian Splatting that enables the incorporation of 3D prior. Specifically, our method adopts a progressive optimization strategy, which includes a geometry optimization stage and an appearance refinement stage. In geometry optimization, a coarse representation is established under 3D point cloud diffusion prior along with the ordinary 2D SDS optimization, ensuring a sensible and 3D-consistent rough shape. Subsequently, the obtained Gaussians undergo an iterative appearance refinement to enrich texture details. In this stage, we increase the number of Gaussians by compactness-based densification to enhance continuity and improve fidelity. With these designs, our approach can generate 3D assets with delicate details and accurate geometry. Extensive evaluations demonstrate the effectiveness of our method, especially for capturing high-frequency components. Our code is available at https://github.com/gsgen3d/gsgen

cs.CV↗

arXiv2024

A new approach for deducing rms proton radii from charge-changing reactions of neutron-rich nuclei and the reaction-target dependence

We report the charge-changing cross sections ($σ_{\text{cc}}$) of 24 $p$-shell nuclides on both hydrogen and carbon at about 900$A$ MeV, of which $^{8,9}$Li, $^{10\textendash12}$Be, $^{10,14,15}$B, $^{14,15,17\textendash22}$N and $^{16}$O on hydrogen and $^{8,9}$Li on carbon are for the first time. Benefiting from the data set,we found a new and robust relationship between the scaling factor of the Glauber model calculations and the separation energies of the nuclei of interest on both targets.This allows us to deduce proton radii ($R_p$) for the first time from the cross sections on hydrogen. Nearly identical $R_p$ values are deduced from both target data for the neutron-rich carbon isotopes, however, the $R_p$ from the hydrogen target is systematically smaller in the neutron-rich nitrogen isotopes.This calls for further experimental and theoretical investigations.

nucl-ex↗

arXiv2024

Extended Spreading of Saline Droplets upon Impact on a Frosty Surface

Understanding the solidification dynamics of impacted water droplets is fundamental and crucial for applications, especially with the presence of frost and salt. Here, we experimentally investigate the spreading and freezing dynamics of saline droplets upon impact on a cold, frosty surface. Our findings demonstrate that the frost and salt can lead to an extended spreading of impacted droplets under specific conditions. In addition to the well-known 1/2 inertial spreading scaling law for droplets impact on a cold substrate, we observe a distinct transition to a 1/10 scaling law dominated by the capillary-viscous relation at low impacting velocities. We formulate the onset criterion for this extended spreading regime and derive a scaling dependence that captures the droplet's arrested diameter over various supercooling temperatures, by incorporating the effect of impact inertia, partial-wetting behavior and salinity. Based on the analysis, a unified model is proposed for predicting the droplet arrested diameter over a wide range of impact velocity and salinity.

physics.flu-dyn↗

arXiv2024

Electrically controlled nonvolatile switching of single-atom magnetism in a Dy@C84 single-molecule transistor

Single-atom magnetism switching is a key technique towards the ultimate data storage density of computer hard disks and has been conceptually realized by leveraging the spin bistability of a magnetic atom under a scanning tunnelling microscope. However, it has rarely been applied to solid-state transistors, an advancement that would be highly desirable for enabling various applications. Here, we demonstrate realization of the electrically controlled Zeeman effect in Dy@C84 single-molecule transistors, thus revealing a transition in the magnetic moment from 3.8 μB to 5.1 μB for the ground-state GN at an electric field strength of 3-10 MV/cm. The consequent magnetoresistance significantly increases from 600% to 1100% at the resonant tunneling point. Density functional theory calculations further corroborate our realization of nonvolatile switching of single-atom magnetism, and the switching stability emanates from an energy barrier of 92 meV for atomic relaxation. These results highlight the potential of using endohedral metallofullerenes for high-temperature, high-stability, high-speed, and compact single-atom magnetic data storage.

cond-mat.mtrl-sci↗

arXiv2024

V3D: Video Diffusion Models are Effective 3D Generators

Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency. Our code is available at https://github.com/heheyas/V3D

cs.CV↗

arXiv2024

Johnson-noise-limited cancellation-free microwave impedance microscopy with monolithic silicon cantilever probes

Microwave impedance microscopy (MIM) is an emerging scanning probe technique for nanoscale complex permittivity mapping and has made significant impacts in diverse fields from semiconductors to quantum materials. To date, the most significant hurdles that limit its widespread use are the requirements of specialized microwave probes and high-precision cancellation circuits. Here we show that forgoing both elements not only is feasible but actually enhances MIM performance. Using monolithic silicon cantilever probes and a cancellation-free architecture, we demonstrate thermal Johnson-noise-limited, drift-free MIM operation with 15 nm spatial resolution, minimal topography crosstalk, and an unprecedented sensitivity of 0.26 zF/$\sqrt{\text{Hz}}$. We accomplish this by taking advantage of the high mechanical resonant frequency and spatial resolution of silicon probes, the inherent common-mode phase noise rejection of self-referenced homodyne detection, and the exceptional stability of the streamlined architecture. Our approach makes MIM drastically more accessible and paves the way for more advanced operation modes and integration with complementary techniques.

cond-mat.mes-hall↗

arXiv2024

VisRec: A Semi-Supervised Approach to Radio Interferometric Data Reconstruction

Radio telescopes produce visibility data about celestial objects, but these data are sparse and noisy. As a result, images created on raw visibility data are of low quality. Recent studies have used deep learning models to reconstruct visibility data to get cleaner images. However, these methods rely on a substantial amount of labeled training data, which requires significant labeling effort from radio astronomers. Addressing this challenge, we propose VisRec, a model-agnostic semi-supervised learning approach to the reconstruction of visibility data. Specifically, VisRec consists of both a supervised learning module and an unsupervised learning module. In the supervised learning module, we introduce a set of data augmentation functions to produce diverse training examples. In comparison, the unsupervised learning module in VisRec augments unlabeled data and uses reconstructions from non-augmented visibility data as pseudo-labels for training. This hybrid approach allows VisRec to effectively leverage both labeled and unlabeled data. This way, VisRec performs well even when labeled data is scarce. Our evaluation results show that VisRec outperforms all baseline methods in reconstruction quality, robustness against common observation perturbation, and generalizability to different telescope configurations.

eess.IV↗

arXiv2024

Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings

We introduce a novel suite of state-of-the-art bilingual text embedding models that are designed to support English and another target language. These models are capable of processing lengthy text inputs with up to 8192 tokens, making them highly versatile for a range of natural language processing tasks such as text retrieval, clustering, and semantic textual similarity (STS) calculations. By focusing on bilingual models and introducing a unique multi-task learning objective, we have significantly improved the model performance on STS tasks, which outperforms the capabilities of existing multilingual models in both target language understanding and cross-lingual evaluation tasks. Moreover, our bilingual models are more efficient, requiring fewer parameters and less memory due to their smaller vocabulary needs. Furthermore, we have expanded the Massive Text Embedding Benchmark (MTEB) to include benchmarks for German and Spanish embedding models. This integration aims to stimulate further research and advancement in text embedding technologies for these languages.

cs.CL↗

arXiv2024

Quantum Melting of a Disordered Wigner Solid

The behavior of two-dimensional electron gas (2DEG) in extreme coupling limits are reasonably well-understood, but our understanding of intermediate region remains limited. Strongly interacting electrons crystalize into a solid phase known as the Wigner crystal at very low densities, and these evolve to a Fermi liquid at high densities. At intermediate densities, however, where the Wigner crystal melts into a strongly correlated electron fluid that is poorly understood partly due to a lack of microscopic probes for delicate quantum phases. Here we report the first imaging of a disordered Wigner solid and its quantum densification and quantum melting behavior in a bilayer MoSe2 using a non-invasive scanning tunneling microscopy (STM) technique. We observe a Wigner solid with nanocrystalline domains pinned by local disorder at low hole densities. With slightly increasing electrostatic gate voltages, the holes are added quantum mechanically during the densification of the disordered Wigner solid. As the hole density is increased above a threshold (p ~ 5.7 * 10e12 (cm-2)), the Wigner solid is observed to melt locally and create a mixed phase where solid and liquid regions coexist. With increasing density, the liquid regions gradually expand and form an apparent percolation network. Local solid domains appear to be pinned and stabilized by local disorder over a range of densities. Our observations are consistent with a microemulsion picture of Wigner solid quantum melting where solid and liquid domains emerge spontaneously and solid domains are pinned by local disorder.

cond-mat.str-el↗

arXiv2024

MM-TTS: Multi-modal Prompt based Style Transfer for Expressive Text-to-Speech Synthesis

The style transfer task in Text-to-Speech refers to the process of transferring style information into text content to generate corresponding speech with a specific style. However, most existing style transfer approaches are either based on fixed emotional labels or reference speech clips, which cannot achieve flexible style transfer. Recently, some methods have adopted text descriptions to guide style transfer. In this paper, we propose a more flexible multi-modal and style controllable TTS framework named MM-TTS. It can utilize any modality as the prompt in unified multi-modal prompt space, including reference speech, emotional facial images, and text descriptions, to control the style of the generated speech in a system. The challenges of modeling such a multi-modal style controllable TTS mainly lie in two aspects:1)aligning the multi-modal information into a unified style space to enable the input of arbitrary modality as the style prompt in a single system, and 2)efficiently transferring the unified style representation into the given text content, thereby empowering the ability to generate prompt style-related voice. To address these problems, we propose an aligned multi-modal prompt encoder that embeds different modalities into a unified style space, supporting style transfer for different modalities. Additionally, we present a new adaptive style transfer method named Style Adaptive Convolutions to achieve a better style representation. Furthermore, we design a Rectified Flow based Refiner to solve the problem of over-smoothing Mel-spectrogram and generate audio of higher fidelity. Since there is no public dataset for multi-modal TTS, we construct a dataset named MEAD-TTS, which is related to the field of expressive talking head. Our experiments on the MEAD-TTS dataset and out-of-domain datasets demonstrate that MM-TTS can achieve satisfactory results based on multi-modal prompts.

eess.AS↗

arXiv2024

Semantic-Guided Generative Image Augmentation Method with Diffusion Models for Image Classification

Existing image augmentation methods consist of two categories: perturbation-based methods and generative methods. Perturbation-based methods apply pre-defined perturbations to augment an original image, but only locally vary the image, thus lacking image diversity. In contrast, generative methods bring more image diversity in the augmented images but may not preserve semantic consistency, thus incorrectly changing the essential semantics of the original image. To balance image diversity and semantic consistency in augmented images, we propose SGID, a Semantic-guided Generative Image augmentation method with Diffusion models for image classification. Specifically, SGID employs diffusion models to generate augmented images with good image diversity. More importantly, SGID takes image labels and captions as guidance to maintain semantic consistency between the augmented and original images. Experimental results show that SGID outperforms the best augmentation baseline by 1.72% on ResNet-50 (from scratch), 0.33% on ViT (ImageNet-21k), and 0.14% on CLIP-ViT (LAION-2B). Moreover, SGID can be combined with other image augmentation baselines and further improves the overall performance. We demonstrate the semantic consistency and image diversity of SGID through quantitative human and automated evaluations, as well as qualitative case studies.

cs.CV↗

arXiv2024

LightHouse: A Survey of AGI Hallucination

With the development of artificial intelligence, large-scale models have become increasingly intelligent. However, numerous studies indicate that hallucinations within these large models are a bottleneck hindering the development of AI research. In the pursuit of achieving strong artificial intelligence, a significant volume of research effort is being invested in the AGI (Artificial General Intelligence) hallucination research. Previous explorations have been conducted in researching hallucinations within LLMs (Large Language Models). As for multimodal AGI, research on hallucinations is still in an early stage. To further the progress of research in the domain of hallucinatory phenomena, we present a bird's eye view of hallucinations in AGI, summarizing the current work on AGI hallucinations and proposing some directions for future research.

cs.CL↗

arXiv2024

City Scene Super-Resolution via Geometric Error Minimization

Super-resolution techniques are crucial in improving image granularity, particularly in complex urban scenes, where preserving geometric structures is vital for data-informed cultural heritage applications. In this paper, we propose a city scene super-resolution method via geometric error minimization. The geometric-consistent mechanism leverages the Hough Transform to extract regular geometric features in city scenes, enabling the computation of geometric errors between low-resolution and high-resolution images. By minimizing mixed mean square error and geometric align error during the super-resolution process, the proposed method efficiently restores details and geometric regularities. Extensive validations on the SET14, BSD300, Cityscapes and GSV-Cities datasets demonstrate that the proposed method outperforms existing state-of-the-art methods, especially in urban scenes.

cs.CV↗

arXiv2024

Energy-Efficient Data Offloading for Earth Observation Satellite Networks

In Earth Observation Satellite Networks (EOSNs) with a large number of battery-carrying satellites, proper power allocation and task scheduling are crucial to improving the data offloading efficiency. As such, we jointly optimize power allocation and task scheduling to achieve energy-efficient data offloading in EOSNs, aiming to balance the objectives of reducing the total energy consumption and increasing the sum weights of tasks. First, we derive the optimal power allocation solution to the joint optimization problem when the task scheduling policy is given. Second, leveraging the conflict graph model, we transform the original joint optimization problem into a maximum weight independent set problem when the power allocation strategy is given. Finally, we utilize the genetic framework to combine the above special solutions as a two-layer solution for the joint optimization problem. Simulation results demonstrate that our proposed solution can properly balance the sum weights of tasks and the total energy consumption, achieving superior system performance over the current best alternatives.

math.OC↗

arXiv2024

Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applications

We introduce Deformable Convolution v4 (DCNv4), a highly efficient and effective operator designed for a broad spectrum of vision applications. DCNv4 addresses the limitations of its predecessor, DCNv3, with two key enhancements: 1. removing softmax normalization in spatial aggregation to enhance its dynamic property and expressive power and 2. optimizing memory access to minimize redundant operations for speedup. These improvements result in a significantly faster convergence compared to DCNv3 and a substantial increase in processing speed, with DCNv4 achieving more than three times the forward speed. DCNv4 demonstrates exceptional performance across various tasks, including image classification, instance and semantic segmentation, and notably, image generation. When integrated into generative models like U-Net in the latent diffusion model, DCNv4 outperforms its baseline, underscoring its possibility to enhance generative models. In practical applications, replacing DCNv3 with DCNv4 in the InternImage model to create FlashInternImage results in up to 80% speed increase and further performance improvement without further modifications. The advancements in speed and efficiency of DCNv4, combined with its robust performance across diverse vision tasks, show its potential as a foundational building block for future vision models.

cs.CV↗