arXiv subjects

Yi Lin

Publications and source records attributed to Yi Lin.

At least 109 records · Page 6Linked to original sources

arXiv2023

Disorder-invariant Implicit Neural Representation

Implicit neural representation (INR) characterizes the attributes of a signal as a function of corresponding coordinates which emerges as a sharp weapon for solving inverse problems. However, the expressive power of INR is limited by the spectral bias in the network training. In this paper, we find that such a frequency-related problem could be greatly solved by re-arranging the coordinates of the input signal, for which we propose the disorder-invariant implicit neural representation (DINER) by augmenting a hash-table to a traditional INR backbone. Given discrete signals sharing the same histogram of attributes and different arrangement orders, the hash-table could project the coordinates into the same distribution for which the mapped signal can be better modeled using the subsequent INR network, leading to significantly alleviated spectral bias. Furthermore, the expressive power of the DINER is determined by the width of the hash-table. Different width corresponds to different geometrical elements in the attribute space, \textit{e.g.}, 1D curve, 2D curved-plane and 3D curved-volume when the width is set as $1$, $2$ and $3$, respectively. More covered areas of the geometrical elements result in stronger expressive power. Experiments not only reveal the generalization of the DINER for different INR backbones (MLP vs. SIREN) and various tasks (image/video representation, phase retrieval, refractive index recovery, and neural radiance field optimization) but also show the superiority over the state-of-the-art algorithms both in quality and speed. \textit{Project page:} \url{https://ezio77.github.io/DINER-website/}

cs.CV↗

arXiv2023

Exploring Visual Prompts for Whole Slide Image Classification with Multiple Instance Learning

Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). However, existing approaches typically rely on pre-trained models from large natural image datasets, such as ImageNet, to generate instance features, which can be sub-optimal due to the significant differences between natural images and histopathology images that lead to a domain shift. In this paper, we present a novel, simple yet effective method for learning domain-specific knowledge transformation from pre-trained models to histopathology images. Our approach entails using a prompt component to assist the pre-trained model in discerning differences between the pre-trained dataset and the target histopathology dataset, resulting in improved performance of MIL models. We validate our method on two publicly available datasets, Camelyon16 and TCGA-NSCLC. Extensive experimental results demonstrate the significant performance improvement of our method for different MIL models and backbones. Upon publication of this paper, we will release the source code for our method.

cs.CV↗

arXiv2023

Learning a Room with the Occ-SDF Hybrid: Signed Distance Function Mingled with Occupancy Aids Scene Representation

Implicit neural rendering, which uses signed distance function (SDF) representation with geometric priors (such as depth or surface normal), has led to impressive progress in the surface reconstruction of large-scale scenes. However, applying this method to reconstruct a room-level scene from images may miss structures in low-intensity areas or small and thin objects. We conducted experiments on three datasets to identify limitations of the original color rendering loss and priors-embedded SDF scene representation. We found that the color rendering loss results in optimization bias against low-intensity areas, causing gradient vanishing and leaving these areas unoptimized. To address this issue, we propose a feature-based color rendering loss that utilizes non-zero feature values to bring back optimization signals. Additionally, the SDF representation can be influenced by objects along a ray path, disrupting the monotonic change of SDF values when a single object is present. To counteract this, we explore using the occupancy representation, which encodes each point separately and is unaffected by objects along a querying ray. Our experimental results demonstrate that the joint forces of the feature-based rendering loss and Occ-SDF hybrid representation scheme can provide high-quality reconstruction results, especially in challenging room-level scenarios. The code would be released.

cs.CV↗

arXiv2023

Parallel Computing Based Solution for Reliability-Constrained Distribution Network Planning

The main goal of distribution network (DN) expansion planning is essentially to achieve minimal investment constrained with specified reliability requirements. The reliability-constrained distribution network planning (RcDNP) problem can be cast an instance of mixed-integer linear programming (MILP) which involves ultra-heavy computation burden especially for large scale DNs. In this paper, we propose a parallel computing-based acceleration algorithm for solve RcDNP problem. The RcDNP is decomposed into a backbone grid and several lateral grid problems with coordination. Then a parallelizable augmented Lagrangian algorithm with acceleration strategy is developed to solve the coordination planning problems. In this method, the lateral grid problems are solved in parallel through coordinating with the backbone grid planning problem. To address the presence of nonconvexity, Gauss-Seidel iteration is adopted on the convex hull of the feasible region constructed by the decomposition method. Under mild conditions, the optimality and convergence of this algorithm is proven. The numerical tests show the proposed method can significantly reduce the computation time and make the RcDNP applicable for real-world problems.

eess.SY↗

arXiv2023

Efficient Implicit Neural Reconstruction Using LiDAR

Modeling scene geometry using implicit neural representation has revealed its advantages in accuracy, flexibility, and low memory usage. Previous approaches have demonstrated impressive results using color or depth images but still have difficulty handling poor light conditions and large-scale scenes. Methods taking global point cloud as input require accurate registration and ground truth coordinate labels, which limits their application scenarios. In this paper, we propose a new method that uses sparse LiDAR point clouds and rough odometry to reconstruct fine-grained implicit occupancy field efficiently within a few minutes. We introduce a new loss function that supervises directly in 3D space without 2D rendering, avoiding information loss. We also manage to refine poses of input frames in an end-to-end manner, creating consistent geometry without global point cloud registration. As far as we know, our method is the first to reconstruct implicit scene representation from LiDAR-only input. Experiments on synthetic and real-world datasets, including indoor and outdoor scenes, prove that our method is effective, efficient, and accurate, obtaining comparable results with existing methods using dense input.

cs.RO↗

arXiv2023

Resonance contributions from $χ_{c0}$ in the charmless three-body hadronic $B$ meson decays

Within the framework of perturbative QCD factorization, we investigate the nonfactorizable contributions to these factorization-forbidden Quasi-two-body decays $B_{(s)}\rightarrow hχ_{c0}\rightarrow hπ^+π^-(K^+K^-)$ with $ h=π, K$. We compare our predicted branching ratios for the $B_{(s)}\rightarrow Kχ_{c0}\rightarrow Kπ^+π^-(K^+K^-)$ decay with available experiment data as well as predictions by other theoretical studies. The branching ratios of these decays are consistent with data and other theoretical predictions. In the Cabibbo-suppressed decays $B_{(s)}\rightarrow hχ_{c0}\rightarrow hπ^+π^-(K^+K^-)$ with $h=\bar{K}^0,π$, however, the values of the branching ratios are the order of $10^{-7}$ and $10^{-8}$. The ratio $R_{χ_{c0}}$ between the decay $B^+\rightarrow π^+χ_{c0}\rightarrow π^+π^+π^-$ and $B^+\rightarrow K^+χ_{c0}\rightarrow K^+π^+π^-$ and the distribution of branching ratios for different decay modes in invariant mass are considered in this work.

hep-ph↗

arXiv2022

Explainable and Safe Reinforcement Learning for Autonomous Air Mobility

Increasing traffic demands, higher levels of automation, and communication enhancements provide novel design opportunities for future air traffic controllers (ATCs). This article presents a novel deep reinforcement learning (DRL) controller to aid conflict resolution for autonomous free flight. Although DRL has achieved important advancements in this field, the existing works pay little attention to the explainability and safety issues related to DRL controllers, particularly the safety under adversarial attacks. To address those two issues, we design a fully explainable DRL framework wherein we: 1) decompose the coupled Q value learning model into a safety-awareness and efficiency (reach the target) one; and 2) use information from surrounding intruders as inputs, eliminating the needs of central controllers. In our simulated experiments, we show that by decoupling the safety-awareness and efficiency, we can exceed performance on free flight control tasks while dramatically improving explainability on practical. In addition, the safety Q learning module provides rich information about the safety situation of environments. To study the safety under adversarial attacks, we additionally propose an adversarial attack strategy that can impose both safety-oriented and efficiency-oriented attacks. The adversarial aims to minimize safety/efficiency by only attacking the agent at a few time steps. In the experiments, our attack strategy increases as many collisions as the uniform attack (i.e., attacking at every time step) by only attacking the agent four times less often, which provide insights into the capabilities and restrictions of the DRL in future ATC designs. The source code is publicly available at https://github.com/WLeiiiii/Gym-ATC-Attack-Project.

cs.LG↗

arXiv2022

Riemannian foliations and geometric quantization

We introduce geometric quantization for constant rank presymplectic structures with Riemannian null foliation and compact leaf closure space. We prove a quantization-commutes-with-reduction theorem in this context. Examples related to symplectic toric quasi-folds, suspensions of isometric actions of discrete groups, and K-contact manifolds are discussed.

math.SG↗

arXiv2022

Log symplectic manifolds and $[Q,R]=0$

We show, under an orientation hypothesis, that a log symplectic manifold with simple normal crossing singularities has a stable almost complex structure, and hence is Spin$_c$. In the compact Hamiltonian case we prove that the index of the Spin$_c$ Dirac operator twisted by a prequantum line bundle satisfies a $[Q,R]=0$ theorem.

math.SG↗

arXiv2022

Bubble Planner: Planning High-speed Smooth Quadrotor Trajectories using Receding Corridors

Quadrotors are agile platforms. With human experts, they can perform extremely high-speed flights in cluttered environments. However, fully autonomous flight at high speed remains a significant challenge. In this work, we propose a motion planning algorithm based on the corridor-constrained minimum control effort trajectory optimization (MINCO) framework. Specifically, we use a series of overlapping spheres to represent the free space of the environment and propose two novel designs that enable the algorithm to plan high-speed quadrotor trajectories in real-time. One is a sampling-based corridor generation method that generates spheres with large overlapped areas (hence overall corridor size) between two neighboring spheres. The second is a Receding Horizon Corridors (RHC) strategy, where part of the previously generated corridor is reused in each replan. Together, these two designs enlarge the corridor spaces in accordance with the quadrotor's current state and hence allow the quadrotor to maneuver at high speeds. We benchmark our algorithm against other state-of-the-art planning methods to show its superiority in simulation. Comprehensive ablation studies are also conducted to show the necessity of the two designs. The proposed method is finally evaluated on an autonomous LiDAR-navigated quadrotor UAV in woods environments, achieving flight speeds over 13.7 m/s without any prior map of the environment or external localization facility.

cs.RO↗

arXiv2022

Revealing the order parameter dynamics of 1T-TiSe$_2$ following optical excitation

The formation of a charge density wave state is characterized by an order parameter. The way it is established provides unique information on both the role that correlation plays in driving the charge density wave formation and the mechanism behind its formation. Here we use time and angle resolved photoelectron spectroscopy to optically perturb the charge-density phase in 1T-TiSe$_2$ and follow the recovery of its order parameter as a function of energy, momentum and excitation density. Our results reveal that two distinct orders contribute to the gap formation, a CDW order and pseudogap-like order, manifested by an overall robustness to optical excitation. A detailed analysis of the magnitude of the the gap as a function of excitation density and delay time reveals the excitonic long-range nature of the CDW gap and the short-range Jahn-Teller character of the pseudogap order. In contrast to the gap, the intensity of the folded Se$_{4p}$* band can only give access to the excitonic order. These results provide new information into the the long standing debate on the origin of the gap in TiSe$_2$ and place it in the same context of other quantum materials where a pseudogap phase appears to be a precursor of long-range order.

cond-mat.str-el↗

arXiv2022

Seg4Reg+: Consistency Learning between Spine Segmentation and Cobb Angle Regression

Automated methods for Cobb angle estimation are of high demand for scoliosis assessment. Existing methods typically calculate the Cobb angle from landmark estimation, or simply combine the low-level task (e.g., landmark detection and spine segmentation) with the Cobb angle regression task, without fully exploring the benefits from each other. In this study, we propose a novel multi-task framework, named Seg4Reg+, which jointly optimizes the segmentation and regression networks. We thoroughly investigate both local and global consistency and knowledge transfer between each other. Specifically, we propose an attention regularization module leveraging class activation maps (CAMs) from image-segmentation pairs to discover additional supervision in the regression network, and the CAMs can serve as a region-of-interest enhancement gate to facilitate the segmentation task in turn. Meanwhile, we design a novel triangle consistency learning to train the two networks jointly for global optimization. The evaluations performed on the public AASCE Challenge dataset demonstrate the effectiveness of each module and superior performance of our model to the state-of-the-art methods.

cs.CV↗

arXiv2022

A Comparative Study of Speaker Role Identification in Air Traffic Communication Using Deep Learning Approaches

Automatic spoken instruction understanding (SIU) of the controller-pilot conversations in the air traffic control (ATC) requires not only recognizing the words and semantics of the speech but also determining the role of the speaker. However, few of the published works on the automatic understanding systems in air traffic communication focus on speaker role identification (SRI). In this paper, we formulate the SRI task of controller-pilot communication as a binary classification problem. Furthermore, the text-based, speech-based, and speech and text based multi-modal methods are proposed to achieve a comprehensive comparison of the SRI task. To ablate the impacts of the comparative approaches, various advanced neural network architectures are applied to optimize the implementation of text-based and speech-based methods. Most importantly, a multi-modal speaker role identification network (MMSRINet) is designed to achieve the SRI task by considering both the speech and textual modality features. To aggregate modality features, the modal fusion module is proposed to fuse and squeeze acoustic and textual representations by modal attention mechanism and self-attention pooling layer, respectively. Finally, the comparative approaches are validated on the ATCSpeech corpus collected from a real-world ATC environment. The experimental results demonstrate that all the comparative approaches are worked for the SRI task, and the proposed MMSRINet shows the competitive performance and robustness than the other methods on both seen and unseen data, achieving 98.56%, and 98.08% accuracy, respectively.

cs.SD↗

arXiv2022

Basic Kirwan injectivity and its applications

Consider the Hamiltonian action of a torus on a transversely symplectic foliation that is also Riemannian. When the transverse hard Lefschetz property is satisfied, we establish a foliated version of the Kirwan injectivity theorem, and use it to study Hamiltonian torus actions on transversely Kähler foliations. Among other things, we prove a foliated analogue of the Carrell--Liberman theorem. As an application, this confirms a conjecture raised by Battaglia--Zaffran on the basic Hodge numbers of symplectic toric quasifolds. Our methods also allow us to present a symplectic approach to the calculation of the Betti numbers of symplectic toric quasifolds as diffeological spaces.

math.SG↗

arXiv2022

Spatiotemporal Propagation Learning for Network-Wide Flight Delay Prediction

Demystifying the delay propagation mechanisms among multiple airports is fundamental to precise and interpretable delay prediction, which is crucial during decision-making for all aviation industry stakeholders. The principal challenge lies in effectively leveraging the spatiotemporal dependencies and exogenous factors related to the delay propagation. However, previous works only consider limited spatiotemporal patterns with few factors. To promote more comprehensive propagation modeling for delay prediction, we propose SpatioTemporal Propagation Network (STPN), a space-time separable graph convolutional network, which is novel in spatiotemporal dependency capturing. From the aspect of spatial relation modeling, we propose a multi-graph convolution model considering both geographic proximity and airline schedule. From the aspect of temporal dependency capturing, we propose a multi-head self-attentional mechanism that can be learned end-to-end and explicitly reason multiple kinds of temporal dependency of delay time series. We show that the joint spatial and temporal learning models yield a sum of the Kronecker product, which factors the spatiotemporal dependence into the sum of several spatial and temporal adjacency matrices. By this means, STPN allows cross-talk of spatial and temporal factors for modeling delay propagation. Furthermore, a squeeze and excitation module is added to each layer of STPN to boost meaningful spatiotemporal features. To this end, we apply STPN to multi-step ahead arrival and departure delay prediction in large-scale airport networks. To validate the effectiveness of our model, we experiment with two real-world delay datasets, including U.S and China flight delays; and we show that STPN outperforms state-of-the-art methods. In addition, counterfactuals produced by STPN show that it learns explainable delay propagation patterns.

cs.LG↗

arXiv2022

InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation

Nuclei Segmentation from histology images is a fundamental task in digital pathology analysis. However, deep-learning-based nuclei segmentation methods often suffer from limited annotations. This paper proposes a realistic data augmentation method for nuclei segmentation, named InsMix, that follows a Copy-Paste-Smooth principle and performs morphology-constrained generative instance augmentation. Specifically, we propose morphology constraints that enable the augmented images to acquire luxuriant information about nuclei while maintaining their morphology characteristics (e.g., geometry and location). To fully exploit the pixel redundancy of the background and improve the model's robustness, we further propose a background perturbation method, which randomly shuffles the background patches without disordering the original nuclei distribution. To achieve contextual consistency between original and template instances, a smooth-GAN is designed with a foreground similarity encoder (FSE) and a triplet loss. We validated the proposed method on two datasets, i.e., Kumar and CPS datasets. Experimental results demonstrate the effectiveness of each component and the superior performance achieved by our method to the state-of-the-art methods.

eess.IV↗

arXiv2022

Accurate Scoliosis Vertebral Landmark Localization on X-ray Images via Shape-constrained Multi-stage Cascaded CNNs

Vertebral landmark localization is a crucial step for variant spine-related clinical applications, which requires detecting the corner points of 17 vertebrae. However, the neighbor landmarks often disturb each other for the homogeneous appearance of vertebrae, which makes vertebral landmark localization extremely difficult. In this paper, we propose multi-stage cascaded convolutional neural networks (CNNs) to split the single task into two sequential steps, i.e., center point localization to roughly locate 17 center points of vertebrae, and corner point localization to find 4 corner points for each vertebra without distracted by others. Landmarks in each step are located gradually from a set of initialized points by regressing offsets via cascaded CNNs. Principal Component Analysis (PCA) is employed to preserve a shape constraint in offset regression to resist the mutual attraction of vertebrae. We evaluate our method on the AASCE dataset that consists of 609 tight spinal anterior-posterior X-ray images and each image contains 17 vertebrae composed of the thoracic and lumbar spine for spinal shape characterization. Experimental results demonstrate our superior performance of vertebral landmark localization over other state-of-the-arts with the relative error decreasing from 3.2e-3 to 7.2e-4.

cs.CV↗

arXiv2022

Exciton-Driven Renormalization of Quasiparticle Band Structure in Monolayer MoS2

Optical excitation serves as a powerful approach to control the electronic structure of layered Van der Waals materials via many-body screening effects, induced by photoexcited free carriers, or via light-driven coherence, such as optical Stark and Bloch-Siegert effects. Although theoretical work has also pointed to an exotic mechanism of renormalizing band structure via excitonic correlations in bound electron-hole pairs (excitons), experimental observation of such exciton-driven band renormalization and the full extent of their implications is still lacking, largely due to the limitations of optical probes and the impact of screening effects. Here, by using extreme-ultraviolet time-resolved angle-resolved photoemission spectroscopy together with excitonic many-body theoretical calculations, we directly unmask the band renormalization effects driven by excitonic correlations in a monolayer semiconductor. We revealed a surprising bandgap opening, increased by 40 meV, and a simultaneous enhancement of band effective mass. Our findings unmask the novel exciton-driven mechanism towards the band engineering in photoexcited semiconducting materials, opening a new playground to manipulate the transient energy states in layered quantum materials via optical controls of excitonic many-body correlations.

cond-mat.mtrl-sci↗