arXiv Science⌕ Search

arXiv subjects

Yuchen Liu

Publications and source records attributed to Yuchen Liu.

At least 199 records · Page 11Linked to original sources
arXiv2023

Moduli of boundary polarized Calabi-Yau pairs

We develop the moduli theory of boundary polarized CY pairs, which are slc Calabi-Yau pairs $(X,D)$ such that $D$ is ample. The motivation for studying this moduli problem is to construct a moduli space at the Calabi-Yau wall interpolating between certain K-moduli and KSBA moduli spaces. We prove that the moduli stack of boundary polarized CY pairs is S-complete, $Θ$-reductive, and satisfies the existence part of the valuative criterion for properness, which are steps towards constructing a proper moduli space. A key obstacle in this theory is that the irreducible components of the moduli stack are not in general of finite type. Despite this issue, in the case of pairs $(X,D)$ where $X$ is a degeneration of $\mathbb{P}^2$, we construct a projective moduli space on which the Hodge line bundle is ample. As a consequence, we complete the proof of a conjecture of Prokhorov and Shokurov in relative dimension two.

math.AG↗
arXiv2023

NBMOD: Find It and Grasp It in Noisy Background

Grasping objects is a fundamental yet important capability of robots, and many tasks such as sorting and picking rely on this skill. The prerequisite for stable grasping is the ability to correctly identify suitable grasping positions. However, finding appropriate grasping points is challenging due to the diverse shapes, varying density distributions, and significant differences between the barycenter of various objects. In the past few years, researchers have proposed many methods to address the above-mentioned issues and achieved very good results on publicly available datasets such as the Cornell dataset and the Jacquard dataset. The problem is that the backgrounds of Cornell and Jacquard datasets are relatively simple - typically just a whiteboard, while in real-world operational environments, the background could be complex and noisy. Moreover, in real-world scenarios, robots usually only need to grasp fixed types of objects. To address the aforementioned issues, we proposed a large-scale grasp detection dataset called NBMOD: Noisy Background Multi-Object Dataset for grasp detection, which consists of 31,500 RGB-D images of 20 different types of fruits. Accurate prediction of angles has always been a challenging problem in the detection task of oriented bounding boxes. This paper presents a Rotation Anchor Mechanism (RAM) to address this issue. Considering the high real-time requirement of robotic systems, we propose a series of lightweight architectures called RA-GraspNet (GraspNet with Rotation Anchor): RARA (network with Rotation Anchor and Region Attention), RAST (network with Rotation Anchor and Semi Transformer), and RAGT (network with Rotation Anchor and Global Transformer) to tackle this problem. Among them, the RAGT-3/3 model achieves an accuracy of 99% on the NBMOD dataset. The NBMOD and our code are available at https://github.com/kmittle/Grasp-Detection-NBMOD.

cs.CV↗
arXiv2023

The existence of the Kähler-Ricci soliton degeneration

We prove an algebraic version of the Hamilton-Tian Conjecture for all log Fano pairs. More precisely, we show that any log Fano pair admits a canonical two-step degeneration to a reduced uniformly Ding stable triple, which admits a Kähler-Ricci soliton when the ground field $\mathbb{k}=\mathbb{C}$.

math.AG↗
arXiv2023

Few-shot Multi-domain Knowledge Rearming for Context-aware Defence against Advanced Persistent Threats

Advanced persistent threats (APTs) have novel features such as multi-stage penetration, highly-tailored intention, and evasive tactics. APTs defense requires fusing multi-dimensional Cyber threat intelligence data to identify attack intentions and conducts efficient knowledge discovery strategies by data-driven machine learning to recognize entity relationships. However, data-driven machine learning lacks generalization ability on fresh or unknown samples, reducing the accuracy and practicality of the defense model. Besides, the private deployment of these APT defense models on heterogeneous environments and various network devices requires significant investment in context awareness (such as known attack entities, continuous network states, and current security strategies). In this paper, we propose a few-shot multi-domain knowledge rearming (FMKR) scheme for context-aware defense against APTs. By completing multiple small tasks that are generated from different network domains with meta-learning, the FMKR firstly trains a model with good discrimination and generalization ability for fresh and unknown APT attacks. In each FMKR task, both threat intelligence and local entities are fused into the support/query sets in meta-learning to identify possible attack stages. Secondly, to rearm current security strategies, an finetuning-based deployment mechanism is proposed to transfer learned knowledge into the student model, while minimizing the defense cost. Compared to multiple model replacement strategies, the FMKR provides a faster response to attack behaviors while consuming less scheduling cost. Based on the feedback from multiple real users of the Industrial Internet of Things (IIoT) over 2 months, we demonstrate that the proposed scheme can improve the defense satisfaction rate.

cs.CR↗
arXiv2023

Byzantine-Robust Learning on Heterogeneous Data via Gradient Splitting

Federated learning has exhibited vulnerabilities to Byzantine attacks, where the Byzantine attackers can send arbitrary gradients to a central server to destroy the convergence and performance of the global model. A wealth of robust AGgregation Rules (AGRs) have been proposed to defend against Byzantine attacks. However, Byzantine clients can still circumvent robust AGRs when data is non-Identically and Independently Distributed (non-IID). In this paper, we first reveal the root causes of performance degradation of current robust AGRs in non-IID settings: the curse of dimensionality and gradient heterogeneity. In order to address this issue, we propose GAS, a \shorten approach that can successfully adapt existing robust AGRs to non-IID settings. We also provide a detailed convergence analysis when the existing robust AGRs are combined with GAS. Experiments on various real-world datasets verify the efficacy of our proposed GAS. The implementation code is provided in https://github.com/YuchenLiu-a/byzantine-gas.

cs.LG↗
arXiv2023

ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Models

Augmented Language Models (ALMs) blend the reasoning capabilities of Large Language Models (LLMs) with tools that allow for knowledge retrieval and action execution. Existing ALM systems trigger LLM thought processes while pulling observations from these tools in an interleaved fashion. Specifically, an LLM reasons to call an external tool, gets halted to fetch the tool's response, and then decides the next action based on all preceding response tokens. Such a paradigm, though straightforward and easy to implement, often leads to huge computation complexity from redundant prompts and repeated execution. This study addresses such challenges for the first time, proposing a modular paradigm ReWOO (Reasoning WithOut Observation) that detaches the reasoning process from external observations, thus significantly reducing token consumption. Comprehensive evaluations across six public NLP benchmarks and a curated dataset reveal consistent performance enhancements with our proposed methodology. Notably, ReWOO achieves 5x token efficiency and 4% accuracy improvement on HotpotQA, a multi-step reasoning benchmark. Furthermore, ReWOO demonstrates robustness under tool-failure scenarios. Beyond prompt efficiency, decoupling parametric modules from non-parametric tool calls enables instruction fine-tuning to offload LLMs into smaller language models, thus substantially reducing model parameters. Our illustrative work offloads reasoning ability from 175B GPT3.5 into 7B LLaMA, demonstrating the significant potential for truly efficient and scalable ALM systems.

cs.CL↗
arXiv2023

MMViT: Multiscale Multiview Vision Transformers

We present Multiscale Multiview Vision Transformers (MMViT), which introduces multiscale feature maps and multiview encodings to transformer models. Our model encodes different views of the input signal and builds several channel-resolution feature stages to process the multiple views of the input at different resolutions in parallel. At each scale stage, we use a cross-attention block to fuse information across different views. This enables the MMViT model to acquire complex high-dimensional representations of the input at different resolutions. The proposed model can serve as a backbone model in multiple domains. We demonstrate the effectiveness of MMViT on audio and image classification tasks, achieving state-of-the-art results.

cs.CV↗
arXiv2023

Ethylene Leak Detection Based on Infrared Imaging: A Benchmark

Ethylene leakage detection has become one of the most important research directions in the field of target detection due to the fact that ethylene leakage in the petrochemical industry is closely related to production safety and environmental pollution. Under infrared conditions, there are many factors that affect the texture characteristics of ethylene, such as ethylene concentration, background, and so on. We find that the detection criteria used in infrared imaging ethylene leakage detection research cannot fully reflect real-world production conditions, which is not conducive to evaluate the performance of current image-based target detection methods. Therefore, we create a new infrared image dataset of ethylene leakage with different concentrations and backgrounds, including 54275 images. We use the proposed dataset benchmark to evaluate seven advanced image-based target detection algorithms. Experimental results demonstrate the performance and limitations of existing algorithms, and the dataset benchmark has good versatility and effectiveness.

cs.CV↗
arXiv2023

On the boundedness of singularities via normalized volume

In this article we study conjectures regarding normalized volume and boundedness of singularities. We focus on singularities with a torus action of complexity 1, threefold singularities, and hypersurface singularities. Given a real value v>0, we prove that the class of K-semistable threefold singularities with normalized volume at least v forms a bounded family. Analogous statements are proved in the case of n-dimensional complexity-1 and n-dimensional hypersurface singularities for arbitary n. In the general case of klt singularities, i.e. without the assumption on K-semistability, we show that, up to special degenerations, the normalized volume bounds singularities with a complexity-1 torus action. We exhibit a 3-dimensional example which shows that this last statement is optimal.

math.AG↗
arXiv2023

Multi-modal Expression Recognition with Ensemble Method

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained models are applied to capture more effective emotional information. For these combinations of visual and audio modal features, we utilize two temporal encoders to explore the temporal contextual information in the data. In addition, we employ several ensemble strategies for different experimental settings to obtain the most accurate expression recognition results. Our system achieves the average F1 Score of 0.45774 on the validation set.

cs.CV↗
arXiv2023

CalFAT: Calibrated Federated Adversarial Training with Label Skewness

Recent studies have shown that, like traditional machine learning, federated learning (FL) is also vulnerable to adversarial attacks. To improve the adversarial robustness of FL, federated adversarial training (FAT) methods have been proposed to apply adversarial training locally before global aggregation. Although these methods demonstrate promising results on independent identically distributed (IID) data, they suffer from training instability on non-IID data with label skewness, resulting in degraded natural accuracy. This tends to hinder the application of FAT in real-world applications where the label distribution across the clients is often skewed. In this paper, we study the problem of FAT under label skewness, and reveal one root cause of the training instability and natural accuracy degradation issues: skewed labels lead to non-identical class probabilities and heterogeneous local models. We then propose a Calibrated FAT (CalFAT) approach to tackle the instability issue by calibrating the logits adaptively to balance the classes. We show both theoretically and empirically that the optimization of CalFAT leads to homogeneous local models across the clients and better convergence points.

cs.LG↗
arXiv2023

A Composite T60 Regression and Classification Approach for Speech Dereverberation

Dereverberation is often performed directly on the reverberant audio signal, without knowledge of the acoustic environment. Reverberation time, T60, however, is an essential acoustic factor that reflects how reverberation may impact a signal. In this work, we propose to perform dereverberation while leveraging key acoustic information from the environment. More specifically, we develop a joint learning approach that uses a composite T60 module and a separate dereverberation module to simultaneously perform reverberation time estimation and dereverberation. The reverberation time module provides key features to the dereverberation module during fine tuning. We evaluate our approach in simulated and real environments, and compare against several approaches. The results show that this composite framework improves performance in environments.

eess.AS↗
arXiv2023

Separating the memory of reionization from cosmology in the Ly$α$ forest power spectrum at the post-reionization era

It has been recently shown that the astrophysics of reionization can be extracted from the Ly$α$ forest power spectrum by marginalizing the memory of reionization over cosmological information. This impact of cosmic reionization on the Ly$α$ forest power spectrum can survive cosmological time scales because cosmic reionization, which is inhomogeneous, and subsequent shocks from denser regions can heat the gas in low-density regions to $\sim 3\times10^4$ K and compress it to mean-density. Current approach of marginalization over the memory of reionization, however, is not only model-dependent, based on the assumption of a specific reionization model, but also computationally expensive. Here we propose a simple analytical template for the impact of cosmic reionization, thereby treating it as a broadband systematic to be marginalized over for Bayesian inference of cosmological information from the Ly$α$ forest in a model-independent manner. This template performs remarkably well with an error of $\leq 6 \%$ at large scales $k \approx 0.19$ Mpc$^{-1}$ where the effect of the memory of reionization is important, and reproduces the broadband effect of the memory of reionization in the Ly$α$ forest correlation function, as well as the expected bias of cosmological parameters due to this systematic. The template can successfully recover the morphology of forecast errors in cosmological parameter space as expected when assuming a specific reionization model for marginalization purposes, with a slight overestimation of tens of per cent for the forecast errors on the cosmological parameters. We further propose a similar template for this systematic on the Ly$α$ forest 1D power spectrum.

astro-ph.CO↗
arXiv2023

Graph Neural Networks for Joint Communication and Sensing Optimization in Vehicular Networks

In this paper, the problem of joint communication and sensing is studied in the context of terahertz (THz) vehicular networks. In the studied model, a set of service provider vehicles (SPVs) provide either communication service or sensing service to target vehicles, where it is essential to determine 1) the service mode (i.e., providing either communication or sensing service) for each SPV and 2) the subset of target vehicles that each SPV will serve. The problem is formulated as an optimization problem aiming to maximize the sum of the data rates of the communication target vehicles, while satisfying the sensing service requirements of the sensing target vehicles, by determining the service mode and the target vehicle association for each SPV. To solve this problem, a graph neural network (GNN) based algorithm with a heterogeneous graph representation is proposed. The proposed algorithm enables the central controller to extract each vehicle's graph information related to its location, connection, and communication interference. Using this extracted graph information, a joint service mode selection and target vehicle association strategy is then determined to adapt to the dynamic vehicle topology with various vehicle types (e.g., target vehicles and service provider vehicles). Simulation results show that the proposed GNN-based scheme can achieve 93.66% of the sum rate achieved by the optimal solution, and yield up to 3.16% and 31.86% improvements in sum rate, respectively, over a homogeneous GNN-based algorithm and a conventional optimization algorithm without using GNNs.

cs.NI↗
arXiv2023

Open RAN Testbeds with Controlled Air Mobility

With its promise of increasing softwarization, improving disaggregability, and creating an open-source based ecosystem in the area of Radio Access Networks, the idea of Open RAN has generated rising interest in the community. Even as the community races to provide and verify complete Open RAN systems, the importance of verification of systems based on Open RAN under real-world conditions has become clear, and testbed facilities for general use have been envisioned, in addition to private testing facilities. Aerial robots, including autonomous ones, are among the increasingly important and interesting clients of RAN systems, but also present a challenge for testbeds. Based on our experience in architecting and operating an advanced wireless testbed with aerial robots as a primary citizen, we present considerations relevant to the design of Open RAN testbeds, with particular attention to making such a testbed capable of controlled experimentation with aerial clients. We also present representative results from the NSF AERPAW testbed on Open RAN slicing, programmable vehicles, and programmable radios.

cs.NI↗
arXiv2023

CodePAD: Sequence-based Code Generation with Pushdown Automaton

In the process of code generation, it is essential to guarantee the generated code satisfies grammar constraints of programming language (PL). However, neglecting grammar constraints is a fatal drawback of commonly used sequence-based code generation. In this paper, we devise a pushdown automaton (PDA)-based methodology to address this problem, exploiting the principle that PL is a subset of PDA recognizable language and code accepted by PDA is grammatical. Specifically, we construct a PDA module and design an algorithm to constrain the generation of sequence-based models to ensure grammatical correctness. Guided by this methodology, we further propose CodePAD, a sequence-based code generation framework equipped with a PDA module, to integrate the deduction of PDA into deep learning. Additionally, this framework can leverage states of PDA deduction (including state representation, state prediction task, and joint prediction with state) to assist models in learning PDA deduction. To comprehensively evaluate CodePAD, we construct a PDA for Python and conduct extensive experiments on four public benchmark datasets. CodePAD can leverage existing sequence-based models, and we show that it can achieve 100\% grammatical correctness percentage on these benchmark datasets. Thus, it relatively improve 17\% CodeBLEU on CONALA, 8\% EM on DJANGO, and 15\% CodeBLEU on JUICE-10K compared to base models. In addition, our method significantly enhances pre-trained models, e.g., CodeBLEU of CodeGen-350M improvement from 3.21 to 21.54 on MBPP in zero-shot setting.

cs.SE↗
arXiv2022

Improving Training and Inference of Face Recognition Models via Random Temperature Scaling

Data uncertainty is commonly observed in the images for face recognition (FR). However, deep learning algorithms often make predictions with high confidence even for uncertain or irrelevant inputs. Intuitively, FR algorithms can benefit from both the estimation of uncertainty and the detection of out-of-distribution (OOD) samples. Taking a probabilistic view of the current classification model, the temperature scalar is exactly the scale of uncertainty noise implicitly added in the softmax function. Meanwhile, the uncertainty of images in a dataset should follow a prior distribution. Based on the observation, a unified framework for uncertainty modeling and FR, Random Temperature Scaling (RTS), is proposed to learn a reliable FR algorithm. The benefits of RTS are two-fold. (1) In the training phase, it can adjust the learning strength of clean and noisy samples for stability and accuracy. (2) In the test phase, it can provide a score of confidence to detect uncertain, low-quality and even OOD samples, without training on extra labels. Extensive experiments on FR benchmarks demonstrate that the magnitude of variance in RTS, which serves as an OOD detection metric, is closely related to the uncertainty of the input image. RTS can achieve top performance on both the FR and OOD detection tasks. Moreover, the model trained with RTS can perform robustly on datasets with noise. The proposed module is light-weight and only adds negligible computation cost to the model.

cs.CV↗