arXiv Science⌕ Search

arXiv subjects

Zhen Liu

Publications and source records attributed to Zhen Liu.

At least 181 records · Page 10Linked to original sources
arXiv2023

Low-Light Image Enhancement with Illumination-Aware Gamma Correction and Complete Image Modelling Network

This paper presents a novel network structure with illumination-aware gamma correction and complete image modelling to solve the low-light image enhancement problem. Low-light environments usually lead to less informative large-scale dark areas, directly learning deep representations from low-light images is insensitive to recovering normal illumination. We propose to integrate the effectiveness of gamma correction with the strong modelling capacities of deep networks, which enables the correction factor gamma to be learned in a coarse to elaborate manner via adaptively perceiving the deviated illumination. Because exponential operation introduces high computational complexity, we propose to use Taylor Series to approximate gamma correction, accelerating the training and inference speed. Dark areas usually occupy large scales in low-light images, common local modelling structures, e.g., CNN, SwinIR, are thus insufficient to recover accurate illumination across whole low-light images. We propose a novel Transformer block to completely simulate the dependencies of all pixels across images via a local-to-global hierarchical attention mechanism, so that dark areas could be inferred by borrowing the information from far informative regions in a highly effective manner. Extensive experiments on several benchmark datasets demonstrate that our approach outperforms state-of-the-art methods.

cs.CV↗
arXiv2023

Minimum Latency Deep Online Video Stabilization

We present a novel camera path optimization framework for the task of online video stabilization. Typically, a stabilization pipeline consists of three steps: motion estimating, path smoothing, and novel view rendering. Most previous methods concentrate on motion estimation, proposing various global or local motion models. In contrast, path optimization receives relatively less attention, especially in the important online setting, where no future frames are available. In this work, we adopt recent off-the-shelf high-quality deep motion models for motion estimation to recover the camera trajectory and focus on the latter two steps. Our network takes a short 2D camera path in a sliding window as input and outputs the stabilizing warp field of the last frame in the window, which warps the coming frame to its stabilized position. A hybrid loss is well-defined to constrain the spatial and temporal consistency. In addition, we build a motion dataset that contains stable and unstable motion pairs for the training. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art online methods both qualitatively and quantitatively and achieves comparable performance to offline methods. Our code and dataset are available at https://github.com/liuzhen03/NNDVS

cs.CV↗
arXiv2023

Self-supervised Learning and Graph Classification under Heterophily

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form of low-pass filter, fail to effectively capture heterophily. In this paper, we first present an experimental investigation exploring the performance of low-pass and high-pass filters in heterophily graph classification, where the results clearly show that high-frequency signal is important for learning heterophily graph representation. On the other hand, it is still unclear how to effectively capture the structural pattern of graphs and how to measure the capability of the self-supervised pre-training strategy in capturing graph structure. To address the problem, we first design a quantitative metric to Measure Graph Structure (MGS), which analyzes correlation between structural similarity and embedding similarity of graph pairs. Then, to enhance the graph structural information captured by self-supervised learning, we propose a novel self-supervised strategy for Pre-training GNNs based on the Metric (PGM). Extensive experiments validate our pre-training strategy achieves state-of-the-art performance for molecular property prediction and protein function prediction. In addition, we find choosing the suitable filter sometimes may be better than designing good pre-training strategies for heterophily graph classification.

cs.LG↗
arXiv2023

Heavy Neutral Leptons from Stopped Muons and Pions

Stopped muons, which are generic in pion-at-rest experiments, can shed light on heavy neutral leptons (HNLs) in unexplored parameter spaces. If the HNL is lighter than the muon, the HNL can be produced from decays of muons and pions.The HNL will travel from the production location and decay into visible Standard Model (SM) modes, leaving signals inside downstream detectors. We find that in the case that the HNL dominantly mixes with muon neutrinos, the LSND constraint on the mixing angle squared is stronger than all the previous constraints by more than an order of magnitude. In this study, we recast the LSND measurement of the $ν-e$ scattering. Future experiments such as PIP2-BD could further improve the sensitivity, provided they can distinguish the HNL events from backgrounds induced by the SM neutrinos.

hep-ph↗
arXiv2023

A Guide to Diagnosing Colored Resonances at Hadron Colliders

We present a comprehensive study on how to distinguish the properties of heavy dijet resonances at hadron colliders. A variety of spins, chiral couplings, charges, and QCD color representations are considered. Distinguishing the different color representations is particularly difficult at hadron colliders. To determine the QCD color structure, we consider a third jet radiated in a resonant dijet event. We show that the relative rates of three-jet versus two-jet processes are sensitive to the color representation of the resonance. We also show analytically that the antennae radiation pattern of soft radiation depends on the color structure of dijet events and develops an observable that is sensitive to the antennae patterns. Finally, we exploit a Convolutional Neural Network with Machine Learning techniques to differentiate the radiation patterns from different colored resonances and find encouraging results to discriminate them. We demonstrate our results numerically at a 14 TeV LHC, and the methodology presented here should be applicable to other future hadron colliders.

hep-ph↗
arXiv2023

SENSEI: Search for Millicharged Particles produced in the NuMI Beam

Millicharged particles appear in several extensions of the Standard Model, but have not yet been detected. These hypothetical particles could be produced by an intense proton beam striking a fixed target. We use data collected in 2020 by the SENSEI experiment in the MINOS cavern at the Fermi National Accelerator Laboratory to search for ultra-relativistic millicharged particles produced in collisions of protons in the NuMI beam with a fixed graphite target. The absence of any ionization events with 3 to 6 electrons in the SENSEI data allow us to place world-leading constraints on millicharged particles for masses between 30 MeV to 380 MeV. This work also demonstrates the potential of utilizing low-threshold detectors to investigate new particles in beam-dump experiments, and motivates a future experiment designed specifically for this purpose.

hep-ex↗
arXiv2023

Enhanced piezoelectric response at nanoscale vortex structures in ferroelectrics

The piezoelectric response is a measure of the sensitivity of a material's polarization to stress or its strain to an applied field. Using in-operando x-ray Bragg coherent diffraction imaging, we observe that topological vortices are the source of a five-fold enhancement of the piezoelectric response near the vortex core. The vortices form where several low symmetry ferroelectric phases and phase boundaries coalesce. Unlike bulk ferroelectric solid solutions in which a large piezoelectric response is associated with coexisting phases in the proximity of the triple point, the largest responses for pure BaTiO3 at the nanoscale are in spatial regions of extremely small spontaneous polarization at vortex cores. The response decays inversely with polarization away from the vortex, analogous to the behavior in bulk ceramics as the cation compositions are varied away from the triple point. We use first-principles-based molecular dynamics to augment our observations, and our results suggest that nanoscale piezoelectric materials with large piezoelectric response can be designed within a parameter space governed by vortex cores. Our findings have implications for the development of next-generation nanoscale piezoelectric materials.

cond-mat.mtrl-sci↗
arXiv2023

MeshDiffusion: Score-based Generative 3D Mesh Modeling

We consider the task of generating realistic 3D shapes, which is useful for a variety of applications such as automatic scene generation and physical simulation. Compared to other 3D representations like voxels and point clouds, meshes are more desirable in practice, because (1) they enable easy and arbitrary manipulation of shapes for relighting and simulation, and (2) they can fully leverage the power of modern graphics pipelines which are mostly optimized for meshes. Previous scalable methods for generating meshes typically rely on sub-optimal post-processing, and they tend to produce overly-smooth or noisy surfaces without fine-grained geometric details. To overcome these shortcomings, we take advantage of the graph structure of meshes and use a simple yet very effective generative modeling method to generate 3D meshes. Specifically, we represent meshes with deformable tetrahedral grids, and then train a diffusion model on this direct parametrization. We demonstrate the effectiveness of our model on multiple generative tasks.

cs.GR↗
arXiv2023

Boosting Convolutional Neural Networks with Middle Spectrum Grouped Convolution

This paper proposes a novel module called middle spectrum grouped convolution (MSGC) for efficient deep convolutional neural networks (DCNNs) with the mechanism of grouped convolution. It explores the broad "middle spectrum" area between channel pruning and conventional grouped convolution. Compared with channel pruning, MSGC can retain most of the information from the input feature maps due to the group mechanism; compared with grouped convolution, MSGC benefits from the learnability, the core of channel pruning, for constructing its group topology, leading to better channel division. The middle spectrum area is unfolded along four dimensions: group-wise, layer-wise, sample-wise, and attention-wise, making it possible to reveal more powerful and interpretable structures. As a result, the proposed module acts as a booster that can reduce the computational cost of the host backbones for general image recognition with even improved predictive accuracy. For example, in the experiments on ImageNet dataset for image classification, MSGC can reduce the multiply-accumulates (MACs) of ResNet-18 and ResNet-50 by half but still increase the Top-1 accuracy by more than 1%. With 35% reduction of MACs, MSGC can also increase the Top-1 accuracy of the MobileNetV2 backbone. Results on MS COCO dataset for object detection show similar observations. Our code and trained models are available at https://github.com/hellozhuo/msgc.

cs.CV↗
arXiv2023

Iterative Teaching by Data Hallucination

We consider the problem of iterative machine teaching, where a teacher sequentially provides examples based on the status of a learner under a discrete input space (i.e., a pool of finite samples), which greatly limits the teacher's capability. To address this issue, we study iterative teaching under a continuous input space where the input example (i.e., image) can be either generated by solving an optimization problem or drawn directly from a continuous distribution. Specifically, we propose data hallucination teaching (DHT) where the teacher can generate input data intelligently based on labels, the learner's status and the target concept. We study a number of challenging teaching setups (e.g., linear/neural learners in omniscient and black-box settings). Extensive empirical results verify the effectiveness of DHT.

cs.LG↗
arXiv2023

Locate Then Generate: Bridging Vision and Language with Bounding Box for Scene-Text VQA

In this paper, we propose a novel multi-modal framework for Scene Text Visual Question Answering (STVQA), which requires models to read scene text in images for question answering. Apart from text or visual objects, which could exist independently, scene text naturally links text and visual modalities together by conveying linguistic semantics while being a visual object in an image simultaneously. Different to conventional STVQA models which take the linguistic semantics and visual semantics in scene text as two separate features, in this paper, we propose a paradigm of "Locate Then Generate" (LTG), which explicitly unifies this two semantics with the spatial bounding box as a bridge connecting them. Specifically, at first, LTG locates the region in an image that may contain the answer words with an answer location module (ALM) consisting of a region proposal network and a language refinement network, both of which can transform to each other with one-to-one mapping via the scene text bounding box. Next, given the answer words selected by ALM, LTG generates a readable answer sequence with an answer generation module (AGM) based on a pre-trained language model. As a benefit of the explicit alignment of the visual and linguistic semantics, even without any scene text based pre-training tasks, LTG can boost the absolute accuracy by +6.06% and +6.92% on the TextVQA dataset and the ST-VQA dataset respectively, compared with a non-pre-training baseline. We further demonstrate that LTG effectively unifies visual and text modalities through the spatial bounding box connection, which is underappreciated in previous methods.

cs.CV↗
arXiv2023

Disorder-invariant Implicit Neural Representation

Implicit neural representation (INR) characterizes the attributes of a signal as a function of corresponding coordinates which emerges as a sharp weapon for solving inverse problems. However, the expressive power of INR is limited by the spectral bias in the network training. In this paper, we find that such a frequency-related problem could be greatly solved by re-arranging the coordinates of the input signal, for which we propose the disorder-invariant implicit neural representation (DINER) by augmenting a hash-table to a traditional INR backbone. Given discrete signals sharing the same histogram of attributes and different arrangement orders, the hash-table could project the coordinates into the same distribution for which the mapped signal can be better modeled using the subsequent INR network, leading to significantly alleviated spectral bias. Furthermore, the expressive power of the DINER is determined by the width of the hash-table. Different width corresponds to different geometrical elements in the attribute space, \textit{e.g.}, 1D curve, 2D curved-plane and 3D curved-volume when the width is set as $1$, $2$ and $3$, respectively. More covered areas of the geometrical elements result in stronger expressive power. Experiments not only reveal the generalization of the DINER for different INR backbones (MLP vs. SIREN) and various tasks (image/video representation, phase retrieval, refractive index recovery, and neural radiance field optimization) but also show the superiority over the state-of-the-art algorithms both in quality and speed. \textit{Project page:} \url{https://ezio77.github.io/DINER-website/}

cs.CV↗
arXiv2023

Recent Progress and Next Steps for the MATHUSLA LLP Detector

We report on recent progress and next steps in the design of the proposed MATHUSLA Long Lived Particle (LLP) detector for the HL-LHC as part of the Snowmass 2021 process. Our understanding of backgrounds has greatly improved, aided by detailed simulation studies, and significant R&D has been performed on designing the scintillator detectors and understanding their performance. The collaboration is on track to complete a Technical Design Report, and there are many opportunities for interested new members to contribute towards the goal of designing and constructing MATHUSLA in time for HL-LHC collisions, which would increase the sensitivity to a large variety of highly motivated LLP signals by orders of magnitude.

hep-ex↗
arXiv2023

Heavy Neutral Leptons at Muon Colliders

The future high-energy muon colliders, featuring both high energy and low background, could play a critical role in our searches for new physics. The smallness of neutrino mass is a puzzle of particle physics. Broad classes of solutions to the neutrino puzzles can be best tested by seeking the partners of SM light neutrinos, dubbed as heavy neutral leptons (HNLs), at muon colliders. We can parametrize HNLs in terms of the mass $m_N$ and the mixing angle with $\ell$-flavor $U_\ell$. In this work, we focus on the regime $m_N > O(100)$ GeV and study the projected sensitivities on the $|U_\ell|^2 - m_N$ plane with the full-reconstructable HNL decay into a hadronic $W$ and a charged lepton. The projected reach in $|U_\ell|^2$ leads to the best sensitivities in the TeV realm.

hep-ph↗
arXiv2023

Generalized Besov-type and Triebel-Lizorkin-type spaces

Let $0 0$. We establish several properties, including some embedding properties, of these spaces. We also obtain the atomic decomposition of the spaces $B_{p,q}^{s,φ}(\mathbb{R}^d)$ and $F_{p,q}^{s,φ}(\mathbb{R}^d)$.

math.FA↗
arXiv2023

Continual Learning by Modeling Intra-Class Variation

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To address this issue, memory-based continual learning has been actively studied and stands out as one of the best-performing methods. We examine memory-based continual learning and identify that large variation in the representation space is crucial for avoiding catastrophic forgetting. Motivated by this, we propose to diversify representations by using two types of perturbations: model-agnostic variation (i.e., the variation is generated without the knowledge of the learned neural network) and model-based variation (i.e., the variation is conditioned on the learned neural network). We demonstrate that enlarging representational variation serves as a general principle to improve continual learning. Finally, we perform empirical studies which demonstrate that our method, as a simple plug-and-play component, can consistently improve a number of memory-based continual learning methods by a large margin.

cs.LG↗
arXiv2023

A Generic Knowledge Based Medical Diagnosis Expert System

In this paper, we design and implement a generic medical knowledge based system (MKBS) for identifying diseases from several symptoms. In this system, some important aspects like knowledge bases system, knowledge representation, inference engine have been addressed. The system asks users different questions and inference engines will use the certainty factor to prune out low possible solutions. The proposed disease diagnosis system also uses a graphical user interface (GUI) to facilitate users to interact with the expert system. Our expert system is generic and flexible, which can be integrated with any rule bases system in disease diagnosis.

cs.AI↗
arXiv2023

Iterative Teaching by Label Synthesis

In this paper, we consider the problem of iterative machine teaching, where a teacher provides examples sequentially based on the current iterative learner. In contrast to previous methods that have to scan over the entire pool and select teaching examples from it in each iteration, we propose a label synthesis teaching framework where the teacher randomly selects input teaching examples (e.g., images) and then synthesizes suitable outputs (e.g., labels) for them. We show that this framework can avoid costly example selection while still provably achieving exponential teachability. We propose multiple novel teaching algorithms in this framework. Finally, we empirically demonstrate the value of our framework.

cs.LG↗