arXiv subjects

Liwei Jiang

Publications and source records attributed to Liwei Jiang.

65 records · Page 4Linked to original sources

arXiv2022

Algorithmic Regularization in Model-free Overparametrized Asymmetric Matrix Factorization

We study the asymmetric matrix factorization problem under a natural nonconvex formulation with arbitrary overparametrization. The model-free setting is considered, with minimal assumption on the rank or singular values of the observed matrix, where the global optima provably overfit. We show that vanilla gradient descent with small random initialization sequentially recovers the principal components of the observed matrix. Consequently, when equipped with proper early stopping, gradient descent produces the best low-rank approximation of the observed matrix without explicit regularization. We provide a sharp characterization of the relationship between the approximation error, iteration complexity, initialization size and stepsize. Our complexity bound is almost dimension-free and depends logarithmically on the approximation error, with significantly more lenient requirements on the stepsize and initialization compared to prior work. Our theoretical results provide accurate prediction for the behavior gradient descent, showing good agreement with numerical experiments.

cs.LG↗

arXiv2022

Can Machines Learn Morality? The Delphi Experiment

As AI systems become increasingly powerful and pervasive, there are growing concerns about machines' morality or a lack thereof. Yet, teaching morality to machines is a formidable task, as morality remains among the most intensely debated questions in humanity, let alone for AI. Existing AI systems deployed to millions of users, however, are already making decisions loaded with moral implications, which poses a seemingly impossible challenge: teaching machines moral sense, while humanity continues to grapple with it. To explore this challenge, we introduce Delphi, an experimental framework based on deep neural networks trained directly to reason about descriptive ethical judgments, e.g., "helping a friend" is generally good, while "helping a friend spread fake news" is not. Empirical results shed novel insights on the promises and limits of machine ethics; Delphi demonstrates strong generalization capabilities in the face of novel ethical situations, while off-the-shelf neural network models exhibit markedly poor judgment including unjust biases, confirming the need for explicitly teaching machines moral sense. Yet, Delphi is not perfect, exhibiting susceptibility to pervasive biases and inconsistencies. Despite that, we demonstrate positive use cases of imperfect Delphi, including using it as a component model within other imperfect AI systems. Importantly, we interpret the operationalization of Delphi in light of prominent ethical theories, which leads us to important future research questions.

cs.CL↗

arXiv2022

Aligning to Social Norms and Values in Interactive Narratives

We focus on creating agents that act in alignment with socially beneficial norms and values in interactive narratives or text-based games -- environments wherein an agent perceives and interacts with a world through natural language. Such interactive agents are often trained via reinforcement learning to optimize task performance, even when such rewards may lead to agent behaviors that violate societal norms -- causing harm either to the agent itself or other entities in the environment. Social value alignment refers to creating agents whose behaviors conform to expected moral and social norms for a given context and group of people -- in our case, it means agents that behave in a manner that is less harmful and more beneficial for themselves and others. We build on the Jiminy Cricket benchmark (Hendrycks et al. 2021), a set of 25 annotated interactive narratives containing thousands of morally salient scenarios covering everything from theft and bodily harm to altruism. We introduce the GALAD (Game-value ALignment through Action Distillation) agent that uses the social commonsense knowledge present in specially trained language models to contextually restrict its action space to only those actions that are aligned with socially beneficial values. An experimental study shows that the GALAD agent makes decisions efficiently enough to improve state-of-the-art task performance by 4% while reducing the frequency of socially harmful behaviors by 25% compared to strong contemporary value alignment approaches.

cs.CL↗

arXiv2021

NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics

The dominant paradigm for neural text generation is left-to-right decoding from autoregressive language models. Constrained or controllable generation under complex lexical constraints, however, requires foresight to plan ahead feasible future paths. Drawing inspiration from the A* search algorithm, we propose NeuroLogic A*esque, a decoding algorithm that incorporates heuristic estimates of future cost. We develop efficient lookahead heuristics that are efficient for large-scale language models, making our method a drop-in replacement for common techniques such as beam search and top-k sampling. To enable constrained generation, we build on NeuroLogic decoding (Lu et al., 2021), combining its flexibility in incorporating logical constraints with A*esque estimates of future constraint satisfaction. Our approach outperforms competitive baselines on five generation tasks, and achieves new state-of-the-art performance on table-to-text generation, constrained machine translation, and keyword-constrained generation. The improvements are particularly notable on tasks that require complex constraint satisfaction or in few-shot or zero-shot settings. NeuroLogic A*esque illustrates the power of decoding for improving and enabling new capabilities of large-scale language models.

cs.CL↗

arXiv2021

Rank Overspecified Robust Matrix Recovery: Subgradient Method and Exact Recovery

We study the robust recovery of a low-rank matrix from sparsely and grossly corrupted Gaussian measurements, with no prior knowledge on the intrinsic rank. We consider the robust matrix factorization approach. We employ a robust $\ell_1$ loss function and deal with the challenge of the unknown rank by using an overspecified factored representation of the matrix variable. We then solve the associated nonconvex nonsmooth problem using a subgradient method with diminishing stepsizes. We show that under a regularity condition on the sensing matrices and corruption, which we call restricted direction preserving property (RDPP), even with rank overspecified, the subgradient method converges to the exact low-rank solution at a sublinear rate. Moreover, our result is more general in the sense that it automatically speeds up to a linear rate once the factor rank matches the unknown rank. On the other hand, we show that the RDPP condition holds under generic settings, such as Gaussian measurements under independent or adversarial sparse corruptions, where the result could be of independent interest. Both the exact recovery and the convergence rate of the proposed subgradient method are numerically verified in the overspecified regime. Moreover, our experiment further shows that our particular design of diminishing stepsize effectively prevents overfitting for robust recovery under overparameterized models, such as robust matrix sensing and learning robust deep image prior. This regularization effect is worth further investigation.

math.OC↗

arXiv2021

"I'm Not Mad": Commonsense Implications of Negation and Contradiction

Natural language inference requires reasoning about contradictions, negations, and their commonsense implications. Given a simple premise (e.g., "I'm mad at you"), humans can reason about the varying shades of contradictory statements ranging from straightforward negations ("I'm not mad at you") to commonsense contradictions ("I'm happy"). Moreover, these negated or contradictory statements shift the commonsense implications of the original premise in nontrivial ways. For example, while "I'm mad" implies "I'm unhappy about something," negating the premise (i.e., "I'm not mad") does not necessarily negate the corresponding commonsense implications. In this paper, we present the first comprehensive study focusing on commonsense implications of negated statements and contradictions. We introduce ANION1, a new commonsense knowledge graph with 624K if-then rules focusing on negated and contradictory events. We then present joint generative and discriminative inference models for this new resource, providing novel empirical insights on how logical negations and commonsense contradictions reshape the commonsense implications of their original premises.

cs.CL↗

arXiv2020

Improving Positive Unlabeled Learning: Practical AUL Estimation and New Training Method for Extremely Imbalanced Data Sets

Positive Unlabeled (PU) learning is widely used in many applications, where a binary classifier is trained on the datasets consisting of only positive and unlabeled samples. In this paper, we improve PU learning over state-of-the-art from two aspects. Firstly, existing model evaluation methods for PU learning requires ground truth of unlabeled samples, which is unlikely to be obtained in practice. In order to release this restriction, we propose an asymptotic unbiased practical AUL (area under the lift) estimation method, which makes use of raw PU data without prior knowledge of unlabeled samples. Secondly, we propose ProbTagging, a new training method for extremely imbalanced data sets, where the number of unlabeled samples is hundreds or thousands of times that of positive samples. ProbTagging introduces probability into the aggregation method. Specifically, each unlabeled sample is tagged positive or negative with the probability calculated based on the similarity to its positive neighbors. Based on this, multiple data sets are generated to train different models, which are then combined into an ensemble model. Compared to state-of-the-art work, the experimental results show that ProbTagging can increase the AUC by up to 10%, based on three industrial and two artificial PU data sets.

cs.LG↗

arXiv2019

On the translates of general dyadic systems on $\mathbb{R}$

Many techniques in harmonic analysis use the fact that a continuous object can be written as a sum (or an intersection) of dyadic counterparts, as long as those counterparts belong to an adjacent dyadic system. Here we generalize the notion of adjacent dyadic system and explore when it occurs, leading to some new and perhaps surprising classifications. In particular, we show that every dyadic grid is determined by two parameters, the \emph{shift} and the \emph{location}; moreover two dyadic grids form an adjacent dyadic system if and only if their shifts and locations satisfy readily verifiable conditions.

math.CA↗

arXiv2019

Closed-loop Control of Compensation Point in the K-Rb-$^{21}$Ne Comagnetometer

We investigate the real-time closed-loop control of compensation point in the K-Rb-$^{21}$Ne comagnetometer operated in the spin-exchange relaxation-free regime. By locking the electron resonance, the alkali metal electrons are free from the fluctuations of the longitudinal ambient magnetic field and nuclear magnetization, which could improve the systematic stability, enlarge the linear measuring range, and suppress the cross-talk error of the comagnetometer. This is the first demonstration of closed-loop control of magnetic field in the single nuclear species comagnetometer, which will be of great significance for rotation sensing as gyroscopes and other high precision metrology applications of the comagnetometer.

physics.atom-ph↗

arXiv2017

Polarization measurement of Cs using the pump laser beam

In the optical pumping systems based on the pump-probe arrangement, the spin polarization of the atoms is generally monitored utilizing the probe laser beam, in which way an extra perturbation must be introduced and thus affects the normal operation of the sensors. By investigating the absorption rate of the circularly polarized pump laser, here we demonstrate the feasibility of extracting the electron-spin polarization from the transmitted pump laser intensity. We experimentally validate the method in a spin-exchange relaxation free (SERF) magnetometer and the results are in excellent agreement with the theory. The scheme operates in a silent mode and features a real-time observation. We also study the corresponding magnetic field response of the SERF magnetometer and a term arising from the diffusion effects has been added to the original model to explain the discrepancy of the response.

physics.atom-ph↗

arXiv2010

Magnetic miniband and magnetotransport property of a graphene superlattice

The eigen energy and the conductivity of a graphene sheet subject to a one-dimensional cosinusoidal potential and in the presence of a magnetic field are calculated. Such a graphene superlattice presents three distinct magnetic miniband structures as the magnetic field increases. They are, respectively, the triply degenerate Landau level spectrum, the nondegenerate minibands with finite dispersion and the same Landau level spectrum with the pristine graphene. The ratio of the magnetic length to the period of the potential function is the characteristic quantity to determine the electronic structure of the superlattice. Corresponding to these distinct electronic structures, the diagonal conductivity presents very strong anisotropy in the weak and moderate magnetic field cases. But the predominant magnetotransport orientation changes from the transverse to the longitudinal direction of the superlattice. More interestingly, in the weak magnetic field case, the superlattice exhibits half-integer quantum Hall effect, but with large jump between the Hall plateaux. Thus it is different from the one of the pristine graphene.

cond-mat.mes-hall↗