arXiv subjects

Tianyi Zhang

Publications and source records attributed to Tianyi Zhang.

At least 361 records · Page 20Linked to original sources

arXiv2021

Interference and Coverage Analysis of mmWave Inter-Vehicle Broadcast with Directional Antennas

Thanks to the availability of large bandwidth and high-gain directional antennas at the millimeter-wave (mmWave) bands, mmWave communications have been considered as one of the primary solutions to meet the high data rates needs in vehicular networks. Unicast in mmWave vehicle-to-vehicle (V2V) communications has been well-studied, but much less attention has been paid to V2V broadcast which is required by many V2V applications such as active safety. To fill the gap, this paper systematically investigates mmWave V2V broadcast by considering the unique properties of mmWave signal propagation in V2V environments as well as the impacts of directional antennas and interference. Based on widely-accepted, high-fidelity system models, we mathematically analyze the receiver-side signal-to-interference-plus-noise-ratio (SINR) and broadcast coverage, and we study the impacts of blockage, inter-vehicle distance, vehicle density and beam pattern. Through comprehensive numerical analysis, we find out that, instead of a single unique optimal beamwidth, there exists an optimal range of beamwidth, in which the beamwidths have similar performance and can maximize the coverage. We also find out that the selection of carrier sensing range plays an important role as it highly influences the performance of the whole vehicular networks. Our analysis provides unique insight into mmWave V2V broadcast, and it sheds light on designing effective V2V broadcast protocols.

cs.NI↗

arXiv2021

Rethinking Importance Weighting for Transfer Learning

A key assumption in supervised learning is that training and test data follow the same probability distribution. However, this fundamental assumption is not always satisfied in practice, e.g., due to changing environments, sample selection bias, privacy concerns, or high labeling costs. Transfer learning (TL) relaxes this assumption and allows us to learn under distribution shift. Classical TL methods typically rely on importance-weighting -- a predictor is trained based on the training losses weighted according to the importance (i.e., the test-over-training density ratio). However, as real-world machine learning tasks are becoming increasingly complex, high-dimensional, and dynamical, novel approaches are explored to cope with such challenges recently. In this article, after introducing the foundation of TL based on importance-weighting, we review recent advances based on joint and dynamic importance-predictor estimation. Furthermore, we introduce a method of causal mechanism transfer that incorporates causal structure in TL. Finally, we discuss future perspectives of TL research.

cs.LG↗

arXiv2021

Gomory-Hu Trees in Quadratic Time

Gomory-Hu tree [Gomory and Hu, 1961] is a succinct representation of pairwise minimum cuts in an undirected graph. When the input graph has general edge weights, classic algorithms need at least cubic running time to compute a Gomory-Hu tree. Very recently, the authors of [AKL+, arXiv v1, 2021] have improved the running time to $\tilde{O}(n^{2.875})$ which breaks the cubic barrier for the first time. In this paper, we refine their approach and improve the running time to $\tilde{O}(n^2)$. This quadratic upper bound is also obtained independently in an updated version by the same group of authors [AKL+, arXiv v2, 2021].

cs.DS↗

arXiv2021

Trends on 3d Transition Metal Coordination on Monolayer MoS$_2$

Two-dimensional materials (2DM) have attracted much interest due to their distinct optical, electronic, and catalytic properties. These properties can be by tuned a range of methods including substitutional doping or, as recently demonstrated, by surface functionalization with single atoms, increasing even further 2DM portfolio. Here we theoretically and experimentally describe the coordination reaction between MoS$_2$ monolayers with 3d transition metals (TMs), exploring the nature and the trend of MoS$_2$-TMs interaction. Density Functional Theory calculations, X-Ray Photoelectron Spectroscopy (XPS), and Photoluminescence (PL) point to the formation of MoS$_2$-TM coordination complexes, where the adsorption energy trend for 3d TM resembles the crystal-field (CF) stabilization energy for weak-field complexes. Pearson's theory for hard-soft acid-base and Ligand-field theory were applied to discuss the periodic trends on 3d TM coordination on the MoS$_2$ surface. We found that softer acids with higher ligand field stabilization energy, such as Ni$^{2+}$, tend to form bonds with more covalent character with MoS$_2$, which can be considered a soft base. On the other hand, harder acids, such as Cr$^{3+}$, tend to form bonds with more ionic character. Additionally, we studied the trends in charge transfer and doping observed in the XPS and PL results, where metals such as Ni led to an n-type of doping, while Cu functionalization results in p-type doping. Therefore, the formation of coordination complexes on TMD's surface is demonstrated to be a promising and effective way to control and to understand the nature of the single-atom functionalization of TMD.

cond-mat.mtrl-sci↗

arXiv2021

All lines on a smooth cubic surface in terms of three skew lines

Jordan showed that the incidence variety of a smooth cubic surface containing 27 lines has solvable Galois group over the incidence variety of a smooth cubic surface containing 3 skew lines. As noted by Harris, it follows that for any smooth cubic surface, there exist formulas for all 27 lines in terms of any 3 skew lines. In response to a question of Farb, we compute these formulas explicitly. We also discuss how these formulas relate to Schläfli's count of lines on real smooth cubic surfaces.

math.AG↗

arXiv2021

PSRR-MaxpoolNMS: Pyramid Shifted MaxpoolNMS with Relationship Recovery

Non-maximum Suppression (NMS) is an essential postprocessing step in modern convolutional neural networks for object detection. Unlike convolutions which are inherently parallel, the de-facto standard for NMS, namely GreedyNMS, cannot be easily parallelized and thus could be the performance bottleneck in convolutional object detection pipelines. MaxpoolNMS is introduced as a parallelizable alternative to GreedyNMS, which in turn enables faster speed than GreedyNMS at comparable accuracy. However, MaxpoolNMS is only capable of replacing the GreedyNMS at the first stage of two-stage detectors like Faster-RCNN. There is a significant drop in accuracy when applying MaxpoolNMS at the final detection stage, due to the fact that MaxpoolNMS fails to approximate GreedyNMS precisely in terms of bounding box selection. In this paper, we propose a general, parallelizable and configurable approach PSRR-MaxpoolNMS, to completely replace GreedyNMS at all stages in all detectors. By introducing a simple Relationship Recovery module and a Pyramid Shifted MaxpoolNMS module, our PSRR-MaxpoolNMS is able to approximate GreedyNMS more precisely than MaxpoolNMS. Comprehensive experiments show that our approach outperforms MaxpoolNMS by a large margin, and it is proven faster than GreedyNMS with comparable accuracy. For the first time, PSRR-MaxpoolNMS provides a fully parallelizable solution for customized hardware design, which can be reused for accelerating NMS everywhere.

cs.CV↗

arXiv2021

Modeling the Field Value Variations and Field Interactions Simultaneously for Fraud Detection

With the explosive growth of e-commerce, online transaction fraud has become one of the biggest challenges for e-commerce platforms. The historical behaviors of users provide rich information for digging into the users' fraud risk. While considerable efforts have been made in this direction, a long-standing challenge is how to effectively exploit internal user information and provide explainable prediction results. In fact, the value variations of same field from different events and the interactions of different fields inside one event have proven to be strong indicators for fraudulent behaviors. In this paper, we propose the Dual Importance-aware Factorization Machines (DIFM), which exploits the internal field information among users' behavior sequence from dual perspectives, i.e., field value variations and field interactions simultaneously for fraud detection. The proposed model is deployed in the risk management system of one of the world's largest e-commerce platforms, which utilize it to provide real-time transaction fraud detection. Experimental results on real industrial data from different regions in the platform clearly demonstrate that our model achieves significant improvements compared with various state-of-the-art baseline models. Moreover, the DIFM could also give an insight into the explanation of the prediction results from dual perspectives.

cs.LG↗

arXiv2021

A One-step Approach to Covariate Shift Adaptation

A default assumption in many machine learning scenarios is that the training and test samples are drawn from the same probability distribution. However, such an assumption is often violated in the real world due to non-stationarity of the environment or bias in sample selection. In this work, we consider a prevalent setting called covariate shift, where the input distribution differs between the training and test stages while the conditional distribution of the output given the input remains unchanged. Most of the existing methods for covariate shift adaptation are two-step approaches, which first calculate the importance weights and then conduct importance-weighted empirical risk minimization. In this paper, we propose a novel one-step approach that jointly learns the predictive model and the associated weights in one optimization by minimizing an upper bound of the test risk. We theoretically analyze the proposed method and provide a generalization error bound. We also empirically demonstrate the effectiveness of the proposed method.

cs.LG↗

arXiv2021

On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies

We study how masking and predicting tokens in an unsupervised fashion can give rise to linguistic structures and downstream performance gains. Recent theories have suggested that pretrained language models acquire useful inductive biases through masks that implicitly act as cloze reductions for downstream tasks. While appealing, we show that the success of the random masking strategy used in practice cannot be explained by such cloze-like masks alone. We construct cloze-like masks using task-specific lexicons for three different classification datasets and show that the majority of pretrained performance gains come from generic masks that are not associated with the lexicon. To explain the empirical success of these generic masks, we demonstrate a correspondence between the Masked Language Model (MLM) objective and existing methods for learning statistical dependencies in graphical models. Using this, we derive a method for extracting these learned statistical dependencies in MLMs and show that these dependencies encode useful inductive biases in the form of syntactic structures. In an unsupervised parsing evaluation, simply forming a minimum spanning tree on the implied statistical dependence structure outperforms a classic method for unsupervised parsing (58.74 vs. 55.91 UUAS).

cs.CL↗

arXiv2021

Fully Dynamic Maximal Independent Set in Expected Poly-Log Update Time

In the fully dynamic maximal independent set (MIS) problem our goal is to maintain an MIS in a given graph $G$ while edges are inserted and deleted from the graph. The first non-trivial algorithm for this problem was presented by Assadi, Onak, Schieber, and Solomon [STOC 2018] who obtained a deterministic fully dynamic MIS with $O(m^{3/4})$ update time. Later, this was independently improved by Du and Zhang and by Gupta and Khan [arXiv 2018] to $\tilde{O}(m^{2/3})$ update time. Du and Zhang [arXiv 2018] also presented a randomized algorithm against an oblivious adversary with $\tilde{O}(\sqrt{m})$ update time. The current state of art is by Assadi, Onak, Schieber, and Solomon [SODA 2019] who obtained randomized algorithms against oblivious adversary with $\tilde{O}(\sqrt{n})$ and $\tilde{O}(m^{1/3})$ update times. In this paper, we propose a dynamic randomized algorithm against oblivious adversary with expected worst-case update time of $O(\log^4n)$. As a direct corollary, one can apply the black-box reduction from a recent work by Bernstein, Forster, and Henzinger [SODA 2019] to achieve $O(\log^6n)$ worst-case update time with high probability. This is the first dynamic MIS algorithm with very fast update time of poly-log.

cs.DS↗

arXiv2021

Design Paradigms Based on Spring Agonists for Underactuated Robot Hands: Concepts and Application

In this paper, we focus on a rarely used paradigm in the design of underactuated robot hands: the use of springs as agonists and tendons as antagonists. We formalize this approach in a design matrix also considering its interplay with the underactuation method used (one tendon for multiple joints vs. multiple tendons on one motor shaft). We then show how different cells in this design matrix can be combined in order to facilitate the implementation of desired postural synergies with a single motor. Furthermore, we show that when agonist and antagonist tendons are combined on the same motor shaft, the resulting spring force cancellation can be leveraged to produce multiple desirable behaviors, which we demonstrate in a physical prototype.

cs.RO↗

arXiv2021

RFI Mitigation for One-bit UWB Radar Systems

Radio frequency interference (RFI) mitigation is critical to the proper operation of ultra-wideband (UWB) radar systems since RFI can severely degrade the radar imaging capability and target detection performance. In this paper, we address the RFI mitigation problem for one-bit UWB radar systems. A one-bit UWB system obtains its signed measurements via a low-cost and high rate sampling scheme, referred to as the Continuous Time Binary Value (CTBV) technology. This sampling strategy compares the signal to a known threshold varying with slow-time and therefore can be used to achieve a rather high sampling rate and quantization resolution with rather simple and affordable hardware. This paper establishes a proper data model for the RFI sources and proposes a novel RFI mitigation method for the one-bit UWB radar system that uses the CTBV sampling technique. Specifically, we first model the RFI sources as a sum of sinusoids with frequencies fixed during the coherent processing interval (CPI) and we exploit the sparsity of the RFI spectrum. We extend a majorization-minimization based 1bRELAX algorithm, referred to as 1bMMRELAX, to estimate the RFI source parameters from the signed measurements obtained by using the CTBV sampling strategy. We also devise a new fast frequency initialization method based on the Alternating Direction Method of Multipliers (ADMM) methodology for the extended 1bMMRELAX algorithm to significantly improve its computational efficiency. Moreover, an ADMM-based sparse method is introduced to recover the desired radar echoes using the estimated RFI parameters. Both simulated and experimental results are presented to demonstrate that our proposed algorithm outperforms the existing digital integration method, especially for severe RFI cases.

eess.SP↗

arXiv2021

Sinusoidal Parameter Estimation from Signed Measurements via Majorization-Minimization Based RELAX

We consider the problem of sinusoidal parameter estimation using signed observations obtained via one-bit sampling with fixed as well as time-varying thresholds. In a previous paper, a relaxation-based algorithm, referred to as 1bRELAX, has been proposed to iteratively maximize the likelihood function. However, the exhaustive search procedure used in each iteration of 1bRELAX is time-consuming. In this paper, we present a majorization-minimization (MM) based 1bRELAX algorithm, referred to as 1bMMRELAX, to enhance the computational efficiency of 1bRELAX. Using the MM technique, 1bMMRELAX maximizes the likelihood function iteratively using simple FFT operations instead of the more computationally intensive search used by 1bRELAX. Both simulated and experimental results are presented to show that 1bMMRELAX can significantly reduce the computational cost of 1bRELAX while maintaining its excellent estimation accuracy.

eess.SP↗

arXiv2021

Joint RFI Mitigation and Radar Echo Recovery for One-Bit UWB Radar

Radio frequency interference (RFI) mitigation and radar echo recovery are critically important for the proper functioning of ultra-wideband (UWB) radar systems using one-bit sampling techniques. We recently introduced a technique for one-bit UWB radar, which first uses a majorization-minimization method for RFI parameter estimation followed by a sparse method for radar echo recovery. However, this technique suffers from high computational complexity due to the need to estimate the parameters of each RFI source separately and iteratively. In this paper, we present a computationally efficient joint RFI mitigation and radar echo recovery framework to greatly reduce the computational cost. Specifically, we exploit the sparsity of RFI in the fast-frequency domain and the sparsity of radar echoes in the fast-time domain to design a one-bit weighted SPICE (SParse Iterative Covariance-based Estimation) based framework for the joint RFI mitigation and radar echo recovery of one-bit UWB radar. Both simulated and experimental results are presented to show that the proposed one-bit weighted SPICE framework can not only reduce the computational cost but also outperform the existing approach for decoupled RFI mitigation and radar echo recovery of one-bit UWB radar.

eess.SP↗

arXiv2021

Revisiting Few-sample BERT Fine-tuning

This paper is a study of fine-tuning of BERT contextual representations, with focus on commonly observed instabilities in few-sample scenarios. We identify several factors that cause this instability: the common use of a non-standard optimization method with biased gradient estimation; the limited applicability of significant parts of the BERT network for down-stream tasks; and the prevalent practice of using a pre-determined, and small number of training iterations. We empirically test the impact of these factors, and identify alternative practices that resolve the commonly observed instability of the process. In light of these observations, we re-visit recently proposed methods to improve few-sample fine-tuning with BERT and re-evaluate their effectiveness. Generally, we observe the impact of these methods diminishes significantly with our modified process.

cs.CL↗

arXiv2021

Learning to Stop with Surprisingly Few Samples

We consider a discounted infinite horizon optimal stopping problem. If the underlying distribution is known a priori, the solution of this problem is obtained via dynamic programming (DP) and is given by a well known threshold rule. When information on this distribution is lacking, a natural (though naive) approach is "explore-then-exploit," whereby the unknown distribution or its parameters are estimated over an initial exploration phase, and this estimate is then used in the DP to determine actions over the residual exploitation phase. We show: (i) with proper tuning, this approach leads to performance comparable to the full information DP solution; and (ii) despite common wisdom on the sensitivity of such "plug in" approaches in DP due to propagation of estimation errors, a surprisingly "short" (logarithmic in the horizon) exploration horizon suffices to obtain said performance. In cases where the underlying distribution is heavy-tailed, these observations are even more pronounced: a ${\it single \, sample}$ exploration phase suffices.

cs.LG↗

arXiv2021

Second- and third-order optical susceptibilities in bidimensional semiconductors near excitons states

Semiconducting Transition Metal Dichalcogenides (TMDs) have significant nonlinear optical effects. In this work we have used second-harmonic generation (SHG) and the four-wave mixing (FWM) spectroscopy in resonance with the excitons in MoS2, MoSe2, and WS2 monolayers to characterize the nonlinear optical properties of these materials. We show that trions and excitons are responsible for enhancing the nonlinear optical response, and determine the exciton and trion energies by comparing with the photoluminescence spectra. Moreover, we extract the second and third order optical sheet susceptibility near exciton energies and compare with values found in the literature. We also demonstrate the ability to generate different nonlinear effects in a wide spectral range in the visible region for monolayer MoS2, opening the possibility of using two-dimensional materials for nonlinear optoelectronic and photonic applications.

cond-mat.mes-hall↗

arXiv2020

Identifying Mislabeled Data using the Area Under the Margin Ranking

Not all data in a typical training set help with generalization; some samples can be overly ambiguous or outrightly mislabeled. This paper introduces a new method to identify such samples and mitigate their impact when training neural networks. At the heart of our algorithm is the Area Under the Margin (AUM) statistic, which exploits differences in the training dynamics of clean and mislabeled samples. A simple procedure - adding an extra class populated with purposefully mislabeled threshold samples - learns a AUM upper bound that isolates mislabeled data. This approach consistently improves upon prior work on synthetic and real-world datasets. On the WebVision50 classification task our method removes 17% of training data, yielding a 1.6% (absolute) improvement in test error. On CIFAR100 removing 13% of the data leads to a 1.2% drop in error.

cs.LG↗