arXiv subjects

Wenjie Wang

Publications and source records attributed to Wenjie Wang.

270 records · Page 15Linked to original sources

arXiv2022

Counterfactual Reasoning for Out-of-distribution Multimodal Sentiment Analysis

Existing studies on multimodal sentiment analysis heavily rely on textual modality and unavoidably induce the spurious correlations between textual words and sentiment labels. This greatly hinders the model generalization ability. To address this problem, we define the task of out-of-distribution (OOD) multimodal sentiment analysis. This task aims to estimate and mitigate the bad effect of textual modality for strong OOD generalization. To this end, we embrace causal inference, which inspects the causal relationships via a causal graph. From the graph, we find that the spurious correlations are attributed to the direct effect of textual modality on the model prediction while the indirect one is more reliable by considering multimodal semantics. Inspired by this, we devise a model-agnostic counterfactual framework for multimodal sentiment analysis, which captures the direct effect of textual modality via an extra text model and estimates the indirect one by a multimodal model. During the inference, we first estimate the direct effect by the counterfactual inference, and then subtract it from the total effect of all modalities to obtain the indirect effect for reliable prediction. Extensive experiments show the superior effectiveness and generalization ability of our proposed framework.

cs.CL↗

arXiv2022

User-controllable Recommendation Against Filter Bubbles

Recommender systems usually face the issue of filter bubbles: overrecommending homogeneous items based on user features and historical interactions. Filter bubbles will grow along the feedback loop and inadvertently narrow user interests. Existing work usually mitigates filter bubbles by incorporating objectives apart from accuracy such as diversity and fairness. However, they typically sacrifice accuracy, hurting model fidelity and user experience. Worse still, users have to passively accept the recommendation strategy and influence the system in an inefficient manner with high latency, e.g., keeping providing feedback (e.g., like and dislike) until the system recognizes the user intention. This work proposes a new recommender prototype called UserControllable Recommender System (UCRS), which enables users to actively control the mitigation of filter bubbles. Functionally, 1) UCRS can alert users if they are deeply stuck in filter bubbles. 2) UCRS supports four kinds of control commands for users to mitigate the bubbles at different granularities. 3) UCRS can respond to the controls and adjust the recommendations on the fly. The key to adjusting lies in blocking the effect of out-of-date user representations on recommendations, which contains historical information inconsistent with the control commands. As such, we develop a causality-enhanced User-Controllable Inference (UCI) framework, which can quickly revise the recommendations based on user controls in the inference stage and utilize counterfactual inference to mitigate the effect of out-of-date user representations. Experiments on three datasets validate that the UCI framework can effectively recommend more desired items based on user controls, showing promising performance w.r.t. both accuracy and diversity.

cs.IR↗

arXiv2022

A flexible method for estimating luminosity functions via Kernel Density Estimation -- II. Generalization and Python implementation

We propose a generalization of our previous KDE (kernel density estimation) method for estimating luminosity functions (LFs). This new upgrade further extend the application scope of our KDE method, making it a very flexible approach which is suitable to deal with most of bivariate LF calculation problems. From the mathematical point of view, usually the LF calculation can be abstracted as a density estimation problem in the bounded domain of $\{Z_1 f_{\mathrm{lim}}(z) \}$. We use the transformation-reflection KDE method ($\hatϕ$) to solve the problem, and introduce an approximate method ($\hatϕ_{\mathrm{1}}$) based on one-dimensional KDE to deal with the small sample size case. In practical applications, the different versions of LF estimators can be flexibly chosen according to the Kolmogorov-Smirnov test criterion. Based on 200 simulated samples, we find that for both cases of dividing or not dividing redshift bins, especially for the latter, our method performs significantly better than the traditional binning method $\hatϕ_{\mathrm{bin}}$. Moreover, with the increase of sample size $n$, our LF estimator converges to the true LF remarkably faster than $\hatϕ_{\mathrm{bin}}$. To implement our method, we have developed a public, open-source Python Toolkit, called \texttt{kdeLF}. With the support of \texttt{kdeLF}, our KDE method is expected to be a competitive alternative to existing nonparametric estimators, due to its high accuracy and excellent stability. \texttt{kdeLF} is available at \url{http://github.com/yuanzunli/kdeLF} with extensive documentation available at \url{http://kdelf.readthedocs.org/en/latest~}.

astro-ph.IM↗

arXiv2021

Learning Robust Recommender from Noisy Implicit Feedback

The ubiquity of implicit feedback makes it indispensable for building recommender systems. However, it does not actually reflect the actual satisfaction of users. For example, in E-commerce, a large portion of clicks do not translate to purchases, and many purchases end up with negative reviews. As such, it is of importance to account for the inevitable noises in implicit feedback. However, little work on recommendation has taken the noisy nature of implicit feedback into consideration. In this work, we explore the central theme of denoising implicit feedback for recommender learning, including training and inference. By observing the process of normal recommender training, we find that noisy feedback typically has large loss values in the early stages. Inspired by this observation, we propose a new training strategy named Adaptive Denoising Training (ADT), which adaptively prunes the noisy interactions by two paradigms (i.e., Truncated Loss and Reweighted Loss). Furthermore, we consider extra feedback (e.g., rating) as auxiliary signal and propose three strategies to incorporate extra feedback into ADT: finetuning, warm-up training, and colliding inference. We instantiate the two paradigms on the widely used binary cross-entropy loss and test them on three representative recommender models. Extensive experiments on three benchmarks demonstrate that ADT significantly improves the quality of recommendation over normal training without using extra feedback. Besides, the proposed three strategies for using extra feedback largely enhance the denoising ability of ADT.

cs.IR↗

arXiv2021

FREE: Feature Refinement for Generalized Zero-Shot Learning

Generalized zero-shot learning (GZSL) has achieved significant progress, with many efforts dedicated to overcoming the problems of visual-semantic domain gap and seen-unseen bias. However, most existing methods directly use feature extraction models trained on ImageNet alone, ignoring the cross-dataset bias between ImageNet and GZSL benchmarks. Such a bias inevitably results in poor-quality visual features for GZSL tasks, which potentially limits the recognition performance on both seen and unseen classes. In this paper, we propose a simple yet effective GZSL method, termed feature refinement for generalized zero-shot learning (FREE), to tackle the above problem. FREE employs a feature refinement (FR) module that incorporates \textit{semantic$\rightarrow$visual} mapping into a unified generative model to refine the visual features of seen and unseen class samples. Furthermore, we propose a self-adaptive margin center loss (SAMC-loss) that cooperates with a semantic cycle-consistency loss to guide FR to learn class- and semantically-relevant representations, and concatenate the features in FR to extract the fully refined features. Extensive experiments on five benchmark datasets demonstrate the significant performance gain of FREE over its baseline and current state-of-the-art methods. Our codes are available at https://github.com/shiming-chen/FREE .

cs.CV↗

arXiv2021

Lasing in Self-Assembled Biophotonic Network

Mode competition is conventionally regarded as an unwanted phenomenon that induces instability of laser emission. Here, we experimentally demonstrate that the random dynamics behavior of mode competition provides hidden information of the intracavity topology. We introduced the concept of self-assembled biophotonics networks, where human insulin protein with network topology was sandwiched in a Fabry-Perot (FP) cavity. The optical coupling between insulin fibrils and enables strong mode competition. Thanks to the optical feedback provided by the FP cavity, the interaction between the light and insulin network was enhanced. Subtle changes in the network will cause significant changes in laser mode dynamics. By recording the transverse mode dynamics, we reconstruct a graph that reveals the optical correlation in the insulin network. Our results indicate that the graph represents an intrinsic feature and can sensitivity respond to the stimulus. The unclonable and sensitively responsive property of the biophotonic lasing network can potentially be employed in applications in sensing and information encryption.

physics.optics↗

arXiv2021

Clicks can be Cheating: Counterfactual Recommendation for Mitigating Clickbait Issue

Recommendation is a prevalent and critical service in information systems. To provide personalized suggestions to users, industry players embrace machine learning, more specifically, building predictive models based on the click behavior data. This is known as the Click-Through Rate (CTR) prediction, which has become the gold standard for building personalized recommendation service. However, we argue that there is a significant gap between clicks and user satisfaction -- it is common that a user is "cheated" to click an item by the attractive title/cover of the item. This will severely hurt user's trust on the system if the user finds the actual content of the clicked item disappointing. What's even worse, optimizing CTR models on such flawed data will result in the Matthew Effect, making the seemingly attractive but actually low-quality items be more frequently recommended. In this paper, we formulate the recommendation models as a causal graph that reflects the cause-effect factors in recommendation, and address the clickbait issue by performing counterfactual inference on the causal graph. We imagine a counterfactual world where each item has only exposure features (i.e., the features that the user can see before making a click decision). By estimating the click likelihood of a user in the counterfactual world, we are able to reduce the direct effect of exposure features and eliminate the clickbait issue. Experiments on real-world datasets demonstrate that our method significantly improves the post-click satisfaction of CTR models.

cs.IR↗

arXiv2021

Deconfounded Recommendation for Alleviating Bias Amplification

Recommender systems usually amplify the biases in the data. The model learned from historical interactions with imbalanced item distribution will amplify the imbalance by over-recommending items from the major groups. Addressing this issue is essential for a healthy ecosystem of recommendation in the long run. Existing works apply bias control to the ranking targets (e.g., calibration, fairness, and diversity), but ignore the true reason for bias amplification and trade-off the recommendation accuracy. In this work, we scrutinize the cause-effect factors for bias amplification, identifying the main reason lies in the confounder effect of imbalanced item distribution on user representation and prediction score. The existence of such confounder pushes us to go beyond merely modeling the conditional probability and embrace the causal modeling for recommendation. Towards this end, we propose a Deconfounded Recommender System (DecRS), which models the causal effect of user representation on the prediction score. The key to eliminating the impact of the confounder lies in backdoor adjustment, which is however difficult to do due to the infinite sample space of the confounder. For this challenge, we contribute an approximation operator for backdoor adjustment which can be easily plugged into most recommender models. Lastly, we devise an inference strategy to dynamically regulate backdoor adjustment according to user status. We instantiate DecRS on two representative models FM and NFM, and conduct extensive experiments over two benchmarks to validate the superiority of our proposed DecRS.

cs.IR↗

arXiv2021

Characterization and Modeling of Native MOSFETs Down to 4.2 K

The extremely low threshold voltage (Vth) of native MOSFETs (Vth~0V@300K) is conducive to the design of cryogenic circuits. Previous research on cryogenic MOSFETs mainly focused on the standard threshold voltage (SVT) and low threshold voltage (LVT) MOSFETs. In this paper, we characterize native MOSFETs within the temperature range from 300K to 4.2K. The cryogenic Vth increases up to ~0.25V (W/L=10um/10um) and the improved subthreshold swing (SS)~14.30mV/dec@4.2K. The off-state current (Ioff) and the gate-induced drain leakage (GIDL) effect are ameliorated greatly. The step-up effect caused by the substrate charge and the transconductance peak effect caused by the energy quantization in different sub-bands are also discussed. Based on the EKV model, we modified the mobility calculation equations and proposed a compact model of large size native MOSFETs suitable for the range of 300K to 4.2K. The mobility-related parameters are extracted via a machine learning approach and the temperature dependences of the scattering mechanisms are analyzed. This work is beneficial to both the research on cryogenic MOSFETs modeling and the design of cryogenic CMOS circuits for quantum chips.

physics.app-ph↗

arXiv2021

CDE-GAN: Cooperative Dual Evolution Based Generative Adversarial Network

Generative adversarial networks (GANs) have been a popular deep generative model for real-world applications. Despite many recent efforts on GANs that have been contributed, mode collapse and instability of GANs are still open problems caused by their adversarial optimization difficulties. In this paper, motivated by the cooperative co-evolutionary algorithm, we propose a Cooperative Dual Evolution based Generative Adversarial Network (CDE-GAN) to circumvent these drawbacks. In essence, CDE-GAN incorporates dual evolution with respect to the generator(s) and discriminators into a unified evolutionary adversarial framework to conduct effective adversarial multi-objective optimization. Thus it exploits the complementary properties and injects dual mutation diversity into training to steadily diversify the estimated density in capturing multi-modes and improve generative performance. Specifically, CDE-GAN decomposes the complex adversarial optimization problem into two subproblems (generation and discrimination), and each subproblem is solved with a separated subpopulation (E-Generator} and E-Discriminators), evolved by its own evolutionary algorithm. Additionally, we further propose a Soft Mechanism to balance the trade-off between E-Generators and E-Discriminators to conduct steady training for CDE-GAN. Extensive experiments on one synthetic dataset and three real-world benchmark image datasets demonstrate that the proposed CDE-GAN achieves a competitive and superior performance in generating good quality and diverse samples over baselines. The code and more generated results are available at our project homepage: https://shiming-chen.github.io/CDE-GAN-website/CDE-GAN.html.

cs.CV↗

arXiv2021

Denoising Implicit Feedback for Recommendation

The ubiquity of implicit feedback makes them the default choice to build online recommender systems. While the large volume of implicit feedback alleviates the data sparsity issue, the downside is that they are not as clean in reflecting the actual satisfaction of users. For example, in E-commerce, a large portion of clicks do not translate to purchases, and many purchases end up with negative reviews. As such, it is of critical importance to account for the inevitable noises in implicit feedback for recommender training. However, little work on recommendation has taken the noisy nature of implicit feedback into consideration. In this work, we explore the central theme of denoising implicit feedback for recommender training. We find serious negative impacts of noisy implicit feedback,i.e., fitting the noisy data prevents the recommender from learning the actual user preference. Our target is to identify and prune noisy interactions, so as to improve the quality of recommender training. By observing the process of normal recommender training, we find that noisy feedback typically has large loss values in the early stages. Inspired by this observation, we propose a new training strategy namedAdaptive Denoising Training(ADT), which adaptively prunes noisy interactions during training. Specifically, we devise two paradigms for adaptive loss formulation: Truncated Loss that discards the large-loss samples with a dynamic threshold in each iteration; and reweighted Loss that adaptively lowers the weight of large-loss samples. We instantiate the two paradigms on the widely used binary cross-entropy loss and test the proposed ADT strategies on three representative recommenders. Extensive experiments on three benchmarks demonstrate that ADT significantly improves the quality of recommendation over normal training.

cs.IR↗

arXiv2020

Market2Dish: Health-aware Food Recommendation

With the rising incidence of some diseases, such as obesity and diabetes, a healthy diet is arousing increasing attention. However, most existing food-related research efforts focus on recipe retrieval, user preference-based food recommendation, cooking assistance, or the nutrition and calorie estimation of dishes, ignoring the personalized health-aware food recommendation. Therefore, in this work, we present a personalized health-aware food recommendation scheme, namely Market2Dish, mapping the ingredients displayed in the market to the healthy dishes eaten at home. The proposed scheme comprises three components, namely recipe retrieval, user-health profiling, and health-aware food recommendation. In particular, recipe retrieval aims to acquire the ingredients available to the users, and then retrieve recipe candidates from a large-scale recipe dataset. User health profiling is to characterize the health conditions of users by capturing the textual health-related information crawled from social networks. Specifically, to solve the issue that the health-related information is extremely sparse, we incorporate a word-class interaction mechanism into the proposed deep model to learn the fine-grained correlations between the textual tweets and pre-defined health concepts. For the health-aware food recommendation, we present a novel category-aware hierarchical memory network-based recommender to learn the health-aware user-recipe interactions for better food recommendation. Moreover, extensive experiments demonstrate the effectiveness of the health-aware food recommendation scheme.

cs.IR↗

arXiv2016

Dual User Selection for Security Enhancement in Uplink Multiuser Systems

This letter proposes a novel dual user selection scheme for uplink transmission with multiple users, where a jamming user and a served user are jointly selected to improve the secrecy performance. Specifically, the jamming user transmits jamming signal with a certain rate, so that the base station (BS) can decode the jamming signal before detecting the secret information signal. By carefully selecting the jamming user and the served user, it makes the eavesdropper decode the jamming signal with a low probability meanwhile the BS can achieve a high receive signal-to-noise ratio (SNR). Therefore, the uplink transmission achieves the dual secrecy improvement by jamming and scheduling. It is shown that the proposed scheme can significantly improve the security of the uplink transmission.

cs.IT↗

arXiv2016

Secure Communication in Uplink Transmissions: User Selection and Multiuser Secrecy Gain

In this paper, we investigate secure communications in uplink transmissions, where there are a base station (BS) with M receive antennas, K mobile users each with a single antenna, and an eavesdropper with N receive antennas. The closed-form expressions of the achievable ergodic secrecy sumrates (ESSR) for a random k users selection scheme in the high and low SNR regimes are presented. It is shown that the scaling behavior of ESSR with respect to the number of served users k can be quite different under different system configurations, determined by the numbers of the BS antennas and that of the eavesdropper antennas. In order to achieve a multiuser gain, two low-complexity user selection schemes are proposed under different assumptions on the eavesdropper's channel state information (CSI). The closed-form expressions of the achievable ESSRs and the multiuser secrecy gains of the two schemes are also presented in both low and high SNR regimes. We observe that, as k increases, the multiuser secrecy gain increases, while the ESSR may decrease. Therefore, when N is much larger than M, serving one user with the strongest channel (TDMA-like) is a favourable secrecy scheme, where the ESSR scales with root square of 2 log K.

cs.IT↗

arXiv2015

A Robust Generalized Chinese Remainder Theorem for Two Integers

A generalized Chinese remainder theorem (CRT) for multiple integers from residue sets has been studied recently, where the correspondence between the remainders and the integers in each residue set modulo several moduli is not known. A robust CRT has also been proposed lately for robustly reconstruct a single integer from its erroneous remainders. In this paper, we consider the reconstruction problem of two integers from their residue sets, where the remainders are not only out of order but also may have errors. We prove that two integers can be robustly reconstructed if their remainder errors are less than $M/8$, where $M$ is the greatest common divisor (gcd) of all the moduli. We also propose an efficient reconstruction algorithm. Finally, we present some simulations to verify the efficiency of the proposed algorithm. The study is motivated and has applications in the determination of multiple frequencies from multiple undersampled waveforms.

cs.IT↗

arXiv2014

The Effect of Cesium Carbonate on PCBM Aggregation in Films

Surface-pressure isotherms, X-ray reflectivity and X-ray near-total reflection fluorescence were used to study the properties of 1-(3-methoxycarbonyl)propyl-1-phenyl[6,6]C$_{61}$ (PCBM) that was pre-mixed with cesium carbonate and spread as a film at the air-water interface. The pre-mixed PCBM with cesium carbonate demonstrated a strikingly strong effect on the organization of the film. Whereas films formed from pure PCBM solution were rough due to strong inter-molecular interactions, the films formed from the mixture were much smoother. This indicates that the cesium carbonate moderates the inter-molecular interactions among PCBM molecules, hinting that the cesium diffusion observed in inverted organic photovoltaics and the likely ensuing ionic Cs-PCBM interaction decreases aggregation tendency of PCBM. This implies that the use of cesium salts affects the morphology of the organic layer and consequently improves the efficiency of these devices.

cond-mat.mtrl-sci↗

arXiv2013

Multi-Stage Robust Chinese Remainder Theorem

It is well-known that the traditional Chinese remainder theorem (CRT) is not robust in the sense that a small error in a remainder may cause a large error in the reconstruction solution. A robust CRT was recently proposed for a special case when the greatest common divisor (gcd) of all the moduli is more than 1 and the remaining integers factorized by the gcd of all the moduli are co-prime. In this special case, a closed-form reconstruction from erroneous remainders was proposed and a necessary and sufficient condition on the remainder errors was obtained. It basically says that the reconstruction error is upper bounded by the remainder error level $τ$ if $τ$ is smaller than a quarter of the gcd of all the moduli. In this paper, we consider the robust reconstruction problem for a general set of moduli. We first present a necessary and sufficient condition for the remainder errors for a robust reconstruction from erroneous remainders with a general set of muduli and also a corresponding robust reconstruction method. This can be thought of as a single stage robust CRT. We then propose a two-stage robust CRT by grouping the moduli into several groups as follows. First, the single stage robust CRT is applied to each group. Then, with these robust reconstructions from all the groups, the single stage robust CRT is applied again across the groups. This is then easily generalized to multi-stage robust CRT. Interestingly, with this two-stage robust CRT, the robust reconstruction holds even when the remainder error level $τ$ is above the quarter of the gcd of all the moduli. In this paper, we also propose an algorithm on how to group a set of moduli for a better reconstruction robustness of the two-stage robust CRT in some special cases.

cs.IT↗

arXiv2013

Magnetoelastic coupling and charge correlation lengths in a twin domain of Ba(Fe$_{1-x}$Co$_{x}$)$_{2}$As$_{2}$ ($x=0.047$): A high-resolution X-ray diffraction study

The interplay between structure, magnetism and superconductivity in single crystal Ba(Fe$_{1-x}$Co$_{x}$)$_{2}$As$_{2}$ (x=0.047) has been studied using high-resolution X-ray diffraction by monitoring charge Bragg reflections in each twin domain separately. The emergence of the superconducting state is correlated with the suppression of the orthorhombic distortion around \emph{T}$_\texttt{C}$, exhibiting competition between orthorhombicity and superconductivity. Above \emph{T}$_\texttt{S}$, the in-plane charge correlation length increases with the decrease of temperature, possibly induced by nematic fluctuations in the paramagnetic tetragonal phase. Upon cooling, anomalies in the in-plane charge correlation lengths along $a$ ($ξ_{a}$) and $b$ axes ($ξ_{b}$) are observed at \emph{T}$_\texttt{S}$ and also at \emph{T}$_\texttt{N}$ indicative of strong magnetoelastic coupling. The in-plane charge correlation lengths are found to exhibit anisotropic behavior along and perpendicular to the in-plane component of stripe-type AFM wave vector (101)$_{\rm O}$ below around \emph{T}$_\texttt{N}$. The temperature dependence of the out-of-plane charge correlation length shows a single anomaly at \emph{T}$_\texttt{N}$, reflecting the connection between Fe-As distance and Fe local moment. The origin of the anisotropic in-plane charge correlation lengths $ξ_{a}$ and $ξ_{b}$ is discussed on the basis of the antiphase magnetic domains and their dynamic fluctuations.

cond-mat.str-el↗