arXiv subjects

Huan Wang

Publications and source records attributed to Huan Wang.

At least 217 records · Page 12Linked to original sources

arXiv2023

Improved Online Conformal Prediction via Strongly Adaptive Online Learning

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret minimization algorithms from the online learning literature to learn prediction sets with approximately valid coverage and small regret. However, standard regret minimization could be insufficient for handling changing environments, where performance guarantees may be desired not only over the full time horizon but also in all (sub-)intervals of time. We develop new online conformal prediction methods that minimize the strongly adaptive regret, which measures the worst-case regret over all intervals of a fixed length. We prove that our methods achieve near-optimal strongly adaptive regret for all interval lengths simultaneously, and approximately valid coverage. Experiments show that our methods consistently obtain better coverage and smaller prediction sets than existing methods on real-world tasks, such as time series forecasting and image classification under distribution shift.

cs.LG↗

arXiv2023

Lower Bounds for Learning in Revealing POMDPs

This paper studies the fundamental limits of reinforcement learning (RL) in the challenging \emph{partially observable} setting. While it is well-established that learning in Partially Observable Markov Decision Processes (POMDPs) requires exponentially many samples in the worst case, a surge of recent work shows that polynomial sample complexities are achievable under the \emph{revealing condition} -- A natural condition that requires the observables to reveal some information about the unobserved latent states. However, the fundamental limits for learning in revealing POMDPs are much less understood, with existing lower bounds being rather preliminary and having substantial gaps from the current best upper bounds. We establish strong PAC and regret lower bounds for learning in revealing POMDPs. Our lower bounds scale polynomially in all relevant problem parameters in a multiplicative fashion, and achieve significantly smaller gaps against the current best upper bounds, providing a solid starting point for future studies. In particular, for \emph{multi-step} revealing POMDPs, we show that (1) the latent state-space dependence is at least $Ω(S^{1.5})$ in the PAC sample complexity, which is notably harder than the $\widetildeΘ(S)$ scaling for fully-observable MDPs; (2) Any polynomial sublinear regret is at least $Ω(T^{2/3})$, suggesting its fundamental difference from the \emph{single-step} case where $\widetilde{O}(\sqrt{T})$ regret is achievable. Technically, our hard instance construction adapts techniques in \emph{distribution testing}, which is new to the RL literature and may be of independent interest.

cs.LG↗

arXiv2022

A Close Look at Spatial Modeling: From Attention to Convolution

Vision Transformers have shown great promise recently for many vision tasks due to the insightful architecture design and attention mechanism. By revisiting the self-attention responses in Transformers, we empirically observe two interesting issues. First, Vision Transformers present a queryirrelevant behavior at deep layers, where the attention maps exhibit nearly consistent contexts in global scope, regardless of the query patch position (also head-irrelevant). Second, the attention maps are intrinsically sparse, few tokens dominate the attention weights; introducing the knowledge from ConvNets would largely smooth the attention and enhance the performance. Motivated by above observations, we generalize self-attention formulation to abstract a queryirrelevant global context directly and further integrate the global context into convolutions. The resulting model, a Fully Convolutional Vision Transformer (i.e., FCViT), purely consists of convolutional layers and firmly inherits the merits of both attention mechanism and convolutions, including dynamic property, weight sharing, and short- and long-range feature modeling, etc. Experimental results demonstrate the effectiveness of FCViT. With less than 14M parameters, our FCViT-S12 outperforms related work ResT-Lite by 3.7% top1 accuracy on ImageNet-1K. When scaling FCViT to larger models, we still perform better than previous state-of-the-art ConvNeXt with even fewer parameters. FCViT-based models also demonstrate promising transferability to downstream tasks, like object detection, instance segmentation, and semantic segmentation. Codes and models are made available at: https://github.com/ma-xu/FCViT.

cs.CV↗

arXiv2022

Look More but Care Less in Video Recognition

Existing action recognition methods typically sample a few frames to represent each video to avoid the enormous computation, which often limits the recognition performance. To tackle this problem, we propose Ample and Focal Network (AFNet), which is composed of two branches to utilize more frames but with less computation. Specifically, the Ample Branch takes all input frames to obtain abundant information with condensed computation and provides the guidance for Focal Branch by the proposed Navigation Module; the Focal Branch squeezes the temporal size to only focus on the salient frames at each convolution block; in the end, the results of two branches are adaptively fused to prevent the loss of information. With this design, we can introduce more frames to the network but cost less computation. Besides, we demonstrate AFNet can utilize fewer frames while achieving higher accuracy as the dynamic selection in intermediate features enforces implicit temporal modeling. Further, we show that our method can be extended to reduce spatial redundancy with even less cost. Extensive experiments on five datasets demonstrate the effectiveness and efficiency of our method.

cs.CV↗

arXiv2022

Large-Gap Quantum Anomalous Hall Insulators in $A$Ti$X$ Class

We theoretically propose that the monolayer $A$Ti$X$ family (KTiSb, KTiBi, RbTiSb, SrTiSn) are potential candidates for large-gap quantum anomalous Hall insulators with high Chern number $\mathcal{C}=2$. Both of the topology and magnetism in these materials are from $3d$-orbitals of Ti. We construct the tight-binding model with symmetry analysis to reveal the origin of topology. Remarkably, quite different from the conventional $s$-$d$ band inversion, here the topological band inversion within $3d$ orbitals is due to the crystal field and electron hopping, while spin-orbit coupling only trivially gaps out the Dirac cone at Fermi level. The general physics from the $3d$ orbitals here applies to a large class of transition metal compounds with the space group $P4/nmm$ or $P$-$42m$ and their subgroups.

cond-mat.mes-hall↗

arXiv2022

Parameter-Efficient Masking Networks

A deeper network structure generally handles more complicated non-linearity and performs more competitively. Nowadays, advanced network designs often contain a large number of repetitive structures (e.g., Transformer). They empower the network capacity to a new level but also increase the model size inevitably, which is unfriendly to either model restoring or transferring. In this study, we are the first to investigate the representative potential of fixed random weights with limited unique values by learning diverse masks and introduce the Parameter-Efficient Masking Networks (PEMN). It also naturally leads to a new paradigm for model compression to diminish the model size. Concretely, motivated by the repetitive structures in modern neural networks, we utilize one random initialized layer, accompanied with different masks, to convey different feature mappings and represent repetitive network modules. Therefore, the model can be expressed as \textit{one-layer} with a bunch of masks, which significantly reduce the model storage cost. Furthermore, we enhance our strategy by learning masks for a model filled by padding a given random weights vector. In this way, our method can further lower the space complexity, especially for models without many repetitive architectures. We validate the potential of PEMN learning masks on random weights with limited unique values and test its effectiveness for a new compression paradigm based on different network architectures. Code is available at https://github.com/yueb17/PEMN

cs.LG↗

arXiv2022

Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization

In Domain Generalization (DG) settings, models trained independently on a given set of training domains have notoriously chaotic performance on distribution shifted test domains, and stochasticity in optimization (e.g. seed) plays a big role. This makes deep learning models unreliable in real world settings. We first show that this chaotic behavior exists even along the training optimization trajectory of a single model, and propose a simple model averaging protocol that both significantly boosts domain generalization and diminishes the impact of stochasticity by improving the rank correlation between the in-domain validation accuracy and out-domain test accuracy, which is crucial for reliable early stopping. Taking advantage of our observation, we show that instead of ensembling unaveraged models (that is typical in practice), ensembling moving average models (EoA) from independent runs further boosts performance. We theoretically explain the boost in performance of ensembling and model averaging by adapting the well known Bias-Variance trade-off to the domain generalization setting. On the DomainBed benchmark, when using a pre-trained ResNet-50, this ensemble of averages achieves an average of $68.0\%$, beating vanilla ERM (w/o averaging/ensembling) by $\sim 4\%$, and when using a pre-trained RegNetY-16GF, achieves an average of $76.6\%$, beating vanilla ERM by $6\%$. Our code is available at https://github.com/salesforce/ensemble-of-averages.

cs.LG↗

arXiv2022

Non-equilibrium dynamics of ultracold lattice bosons inside a cavity

We study the non-equilibrium quench dynamics crossing a continuous phase transition between the charge density wave (CDW) and supersolid (SS) phases of a bosonic lattice gas with cavity-mediated interactions. When changing the hopping amplitude in the Hamiltonian as a function of time, we investigate the scaling behavior of the correlation length and vortex density with respect to the quench time and find that there is a threshold of the quench rate separating two distinct scaling regimes. When slowly varying the system below that threshold, we find a power-law scaling as predicted by the Kibble-Zurek mechanism (KZM). While considering fast quench above that threshold, a deviation from the KZM prediction occurs, manifested by a saturation of the defect density. We further show that such distinct scaling behaviors during different dynamic procedures can be understood through comparing the relaxation time and the quench rate.

cond-mat.quant-gas↗

arXiv2022

Moiré Engineering and Topological Flat Bands in Twisted Orbital-Active Bilayers

Topological flat bands at the Fermi level offer a promising platform to study a variety of intriguing correlated phase of matter. Here we present band engineering in the twisted orbital-active bilayers with spin-orbit coupling. The symmetry constraints on the interlayer coupling that determines the effective potential for low-energy physics of moiré electrons are exhaustively derived for two-dimensional point groups. We find the line graph or biparticle sublattice of moiré pattern emerge with a minimal $C_3$ symmetry, which exhibit isolated electronic flat bands with nontrivial topology. The band flatness is insensitive to the twist angle since they come from the interference effect. Armed with this guiding principle, we predict that twisted bilayers of 2H-PbS$_2$ and CdS realize the salient physics to engineer two-dimensional topological quantum phases. At small twist angles, PbS$_2$ heterostructures give rise to an emergent moiré Kagomé lattice, while CdS heterostructures lead to an emergent moiré honeycomb lattice, and both of them host moiré quantum spin Hall insulators with almost flat topological bands. We further study superconductivity of these two systems with local attractive interactions. The superfluid weight and Berezinskii-Kosterlitz-Thouless temperature are determined by multiband processes and quantum geometry of the band in the flat-band limit when the pairing potential exceeds the band width. Our results demonstrate twisted bilayers with multi-orbitals as a promising tunable platform to realize correlated topological phases.

cond-mat.mes-hall↗

arXiv2022

Design of Core-Shell Structured Magnetic Microwires with Desirable Properties for Multifunctional Applications

Amorphous Co-rich microwires with excellent soft magnetic and mechanical properties produced by melt-extraction technique are emerging as a multifunctional material for a variety of applications ranging from ultrasensitive magnetic field sensors to structural health self-monitoring composites. There is a pressing need for enhancing these properties to make the microwires practical for integration into new technologies. Conventional heat treatments at temperature below crystallization may improve the magnetic softness of an as-quenched amorphous wire, but usually deteriorate the good mechanical characteristic of the wire due to crystallization. To overcome this, we propose a new approach that utilizes the advantages of a multi-step Joule current annealing method to design novel (nanocrystal, amorphous)/amorphous core/shell structures directly from as-quenched amorphous microwires. These results show that the density and size of nanocrystals in the core can be optimized by controlling the Joule current intensity, resulting in the large enhancement of soft magnetic and giant magneto-impedance properties, while the amorphous shell preserves the excellent mechanical strength of the microwire. This study also provides a new pathway for the design of novel core/shell structures directly from rapidly quenched amorphous magnetic materials that are currently exploited in high frequency transformers, sensing and cooling devices.

cond-mat.mtrl-sci↗

arXiv2022

Local Calibration: Metrics and Recalibration

Probabilistic classifiers output confidence scores along with their predictions, and these confidence scores should be calibrated, i.e., they should reflect the reliability of the prediction. Confidence scores that minimize standard metrics such as the expected calibration error (ECE) accurately measure the reliability on average across the entire population. However, it is in general impossible to measure the reliability of an individual prediction. In this work, we propose the local calibration error (LCE) to span the gap between average and individual reliability. For each individual prediction, the LCE measures the average reliability of a set of similar predictions, where similarity is quantified by a kernel function on a pretrained feature space and by a binning scheme over predicted model confidences. We show theoretically that the LCE can be estimated sample-efficiently from data, and empirically find that it reveals miscalibration modes that are more fine-grained than the ECE can detect. Our key result is a novel local recalibration method LoRe, to improve confidence scores for individual predictions and decrease the LCE. Experimentally, we show that our recalibration method produces more accurate confidence scores, which improves downstream fairness and decision making on classification tasks with both image and tabular data.

cs.LG↗

arXiv2022

Generating Negative Samples for Sequential Recommendation

To make Sequential Recommendation (SR) successful, recent works focus on designing effective sequential encoders, fusing side information, and mining extra positive self-supervision signals. The strategy of sampling negative items at each time step is less explored. Due to the dynamics of users' interests and model updates during training, considering randomly sampled items from a user's non-interacted item set as negatives can be uninformative. As a result, the model will inaccurately learn user preferences toward items. Identifying informative negatives is challenging because informative negative items are tied with both dynamically changed interests and model parameters (and sampling process should also be efficient). To this end, we propose to Generate Negative Samples (items) for SR (GenNi). A negative item is sampled at each time step based on the current SR model's learned user preferences toward items. An efficient implementation is proposed to further accelerate the generation process, making it scalable to large-scale recommendation tasks. Extensive experiments on four public datasets verify the importance of providing high-quality negative samples for SR and demonstrate the effectiveness and efficiency of GenNi.

cs.IR↗

arXiv2022

On Bergman kernel functions and weak Morse inequalities

We give simple and unified proofs of weak holomorhpic Morse inequalities on complete manifolds, $q$-convex manifolds, pseudoconvex domains, weakly $1$-complete manifolds and covering manifolds. This paper is essentially based on the asymptotic Bergman kernel functions and the Bochner-Kodaira-Nakano formulas.

math.CV↗

arXiv2022

R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires querying the NeRF network hundreds of times. To resolve it, existing efforts mainly attempt to reduce the number of required sampled points. However, the problem of iterative sampling still exists. On the other hand, Neural Light Field (NeLF) presents a more straightforward representation over NeRF in novel view synthesis -- the rendering of a pixel amounts to one single forward pass without ray-marching. In this work, we present a deep residual MLP network (88 layers) to effectively learn the light field. We show the key to successfully learning such a deep NeLF network is to have sufficient data, for which we transfer the knowledge from a pre-trained NeRF model via data distillation. Extensive experiments on both synthetic and real-world scenes show the merits of our method over other counterpart algorithms. On the synthetic scenes, we achieve 26-35x FLOPs reduction (per camera ray) and 28-31x runtime speedup, meanwhile delivering significantly better (1.4-2.8 dB average PSNR improvement) rendering quality than NeRF without any customized parallelism requirement.

cs.CV↗

arXiv2022

Policy Optimization for Markov Games: Unified Framework and Faster Convergence

This paper studies policy optimization algorithms for multi-agent reinforcement learning. We begin by proposing an algorithm framework for two-player zero-sum Markov Games in the full-information setting, where each iteration consists of a policy update step at each state using a certain matrix game algorithm, and a value update step with a certain learning rate. This framework unifies many existing and new policy optimization algorithms. We show that the state-wise average policy of this algorithm converges to an approximate Nash equilibrium (NE) of the game, as long as the matrix game algorithms achieve low weighted regret at each state, with respect to weights determined by the speed of the value updates. Next, we show that this framework instantiated with the Optimistic Follow-The-Regularized-Leader (OFTRL) algorithm at each state (and smooth value updates) can find an $\mathcal{\widetilde{O}}(T^{-5/6})$ approximate NE in $T$ iterations, and a similar algorithm with slightly modified value update rule achieves a faster $\mathcal{\widetilde{O}}(T^{-1})$ convergence rate. These improve over the current best $\mathcal{\widetilde{O}}(T^{-1/2})$ rate of symmetric policy optimization type algorithms. We also extend this algorithm to multi-player general-sum Markov Games and show an $\mathcal{\widetilde{O}}(T^{-3/4})$ convergence rate to Coarse Correlated Equilibria (CCE). Finally, we provide a numerical example to verify our theory and investigate the importance of smooth value updates, and find that using "eager" value updates instead (equivalent to the independent natural policy gradient algorithm) may significantly slow down the convergence, even on a simple game with $H=2$ layers.

cs.LG↗

arXiv2022

Privacy-Preserving Face Recognition with Learnable Privacy Budgets in Frequency Domain

Face recognition technology has been used in many fields due to its high recognition accuracy, including the face unlocking of mobile devices, community access control systems, and city surveillance. As the current high accuracy is guaranteed by very deep network structures, facial images often need to be transmitted to third-party servers with high computational power for inference. However, facial images visually reveal the user's identity information. In this process, both untrusted service providers and malicious users can significantly increase the risk of a personal privacy breach. Current privacy-preserving approaches to face recognition are often accompanied by many side effects, such as a significant increase in inference time or a noticeable decrease in recognition accuracy. This paper proposes a privacy-preserving face recognition method using differential privacy in the frequency domain. Due to the utilization of differential privacy, it offers a guarantee of privacy in theory. Meanwhile, the loss of accuracy is very slight. This method first converts the original image to the frequency domain and removes the direct component termed DC. Then a privacy budget allocation method can be learned based on the loss of the back-end face recognition network within the differential privacy framework. Finally, it adds the corresponding noise to the frequency domain features. Our method performs very well with several classical face recognition test sets according to the extensive experiments.

cs.CV↗

arXiv2022

Local cohomology for Gorenstein homologically smooth DG algebras

In this paper, we introduce the theory of local cohomology and local duality to Notherian connected cochain DG algebras. We show that the notion of local cohomology functor can be used to detect the Gorensteinness of a homologically smooth DG algebra. For any Gorenstein homologically smooth locally finite DG algebra $\mathcal{A}$, we define a group homomorphism $\mathrm{Hdet}: \mathrm{Aut}_{dg}(\mathcal{A})\to k^{\times},$ called the homological determinant. As applications, we present a sufficient condition for the invariant DG subalgebra $\mathcal{A}^G$ to be Gorensten, where $\mathcal{A}$ is a homologically smooth DG algebra such that $H(\mathcal{A})$ is a Noetherian AS-Gorenstein graded algebra and $G$ is a finite subgroup of $\mathrm{Aut}_{dg}(\mathcal{A})$. Especially, we can apply this result to DG down-up algebras and non-trivial DG free algebras generated in two degree-one elements.

math.RA↗

arXiv2022

STN: Scalable Tensorizing Networks via Structure-Aware Training and Adaptive Compression

Deep neural networks (DNNs) have delivered a remarkable performance in many tasks of computer vision. However, over-parameterized representations of popular architectures dramatically increase their computational complexity and storage costs, and hinder their availability in edge devices with constrained resources. Regardless of many tensor decomposition (TD) methods that have been well-studied for compressing DNNs to learn compact representations, they suffer from non-negligible performance degradation in practice. In this paper, we propose Scalable Tensorizing Networks (STN), which dynamically and adaptively adjust the model size and decomposition structure without retraining. First, we account for compression during training by adding a low-rank regularizer to guarantee networks' desired low-rank characteristics in full tensor format. Then, considering network layers exhibit various low-rank structures, STN is obtained by a data-driven adaptive TD approach, for which the topological structure of decomposition per layer is learned from the pre-trained model, and the ranks are selected appropriately under specified storage constraints. As a result, STN is compatible with arbitrary network architectures and achieves higher compression performance and flexibility over other tensorizing versions. Comprehensive experiments on several popular architectures and benchmarks substantiate the superiority of our model towards improving parameter efficiency.

cs.CV↗