arXiv subjects

Gang Chen

Publications and source records attributed to Gang Chen.

At least 181 records · Page 10Linked to original sources

arXiv2025

Particle-based Instance-aware Semantic Occupancy Mapping in Dynamic Environments

Representing the 3D environment with instance-aware semantic and geometric information is crucial for interaction-aware robots in dynamic environments. Nevertheless, creating such a representation poses challenges due to sensor noise, instance segmentation and tracking errors, and the objects' dynamic motion. This paper introduces a novel particle-based instance-aware semantic occupancy map to tackle these challenges. Particles with an augmented instance state are used to estimate the Probability Hypothesis Density (PHD) of the objects and implicitly model the environment. Utilizing a State-augmented Sequential Monte Carlo PHD (S$^2$MC-PHD) filter, these particles are updated to jointly estimate occupancy status, semantic, and instance IDs, mitigating noise. Additionally, a memory module is adopted to enhance the map's responsiveness to previously observed objects. Experimental results on the Virtual KITTI 2 dataset demonstrate that the proposed approach surpasses state-of-the-art methods across multiple metrics under different noise conditions. Subsequent tests using real-world data further validate the effectiveness of the proposed approach.

cs.RO↗

arXiv2025

Mining Platoon Patterns from Traffic Videos

Discovering co-movement patterns from urban-scale video data sources has emerged as an attractive topic. This task aims to identify groups of objects that travel together along a common route, which offers effective support for government agencies in enhancing smart city management. However, the previous work has made a strong assumption on the accuracy of recovered trajectories from videos and their co-movement pattern definition requires the group of objects to appear across consecutive cameras along the common route. In practice, this often leads to missing patterns if a vehicle is not correctly identified from a certain camera due to object occlusion or vehicle mis-matching. To address this challenge, we propose a relaxed definition of co-movement patterns from video data, which removes the consecutiveness requirement in the common route and accommodates a certain number of missing captured cameras for objects within the group. Moreover, a novel enumeration framework called MaxGrowth is developed to efficiently retrieve the relaxed patterns. Unlike previous filter-and-refine frameworks comprising both candidate enumeration and subsequent candidate verification procedures, MaxGrowth incurs no verification cost for the candidate patterns. It treats the co-movement pattern as an equivalent sequence of clusters, enumerating candidates with increasing sequence length while avoiding the generation of any false positives. Additionally, we also propose two effective pruning rules to efficiently filter the non-maximal patterns. Extensive experiments are conducted to validate the efficiency of MaxGrowth and the quality of its generated co-movement patterns. Our MaxGrowth runs up to two orders of magnitude faster than the baseline algorithm. It also demonstrates high accuracy in real video dataset when the trajectory recovery algorithm is not perfect.

cs.CV↗

arXiv2024

Cost-Aware Dynamic Cloud Workflow Scheduling using Self-Attention and Evolutionary Reinforcement Learning

The Cost-aware Dynamic Multi-Workflow Scheduling (CDMWS) in the cloud is a kind of cloud workflow management problem, which aims to assign virtual machine (VM) instances to execute tasks in workflows so as to minimize the total costs, including both the penalties for violating Service Level Agreement (SLA) and the VM rental fees. Powered by deep neural networks, Reinforcement Learning (RL) methods can construct effective scheduling policies for solving CDMWS problems. Traditional policy networks in RL often use basic feedforward architectures to separately determine the suitability of assigning any VM instances, without considering all VMs simultaneously to learn their global information. This paper proposes a novel self-attention policy network for cloud workflow scheduling (SPN-CWS) that captures global information from all VMs. We also develop an Evolution Strategy-based RL (ERL) system to train SPN-CWS reliably and effectively. The trained SPN-CWS can effectively process all candidate VM instances simultaneously to identify the most suitable VM instance to execute every workflow task. Comprehensive experiments show that our method can noticeably outperform several state-of-the-art algorithms on multiple benchmark CDMWS problems.

cs.AI↗

arXiv2024

Dynamics of Spinning Binary at 2PM

We consider the covariant proposal for the gravitational Compton amplitude for a Kerr black hole. Employing the covariant three- and four-point Compton amplitudes, we assemble the classical one-loop integrand on the maximal cut at all orders in spin, utilizing the method of unitarity. Expanding in powers of spin, we evaluate the one-loop amplitude up to $\mathcal O(G^2 a^8)$. Supplemented with extra contact contributions derived from the far-zone data of the Teukolsky solutions, the one-loop amplitude is in agreement with results available in the literature. We showcase the classical eikonal in the aligned-spin case at $\mathcal O(G^2 a^7)$.

hep-th↗

arXiv2024

Learning Monocular Depth from Events via Egomotion Compensation

Event cameras are neuromorphically inspired sensors that sparsely and asynchronously report brightness changes. Their unique characteristics of high temporal resolution, high dynamic range, and low power consumption make them well-suited for addressing challenges in monocular depth estimation (e.g., high-speed or low-lighting conditions). However, current existing methods primarily treat event streams as black-box learning systems without incorporating prior physical principles, thus becoming over-parameterized and failing to fully exploit the rich temporal information inherent in event camera data. To address this limitation, we incorporate physical motion principles to propose an interpretable monocular depth estimation framework, where the likelihood of various depth hypotheses is explicitly determined by the effect of motion compensation. To achieve this, we propose a Focus Cost Discrimination (FCD) module that measures the clarity of edges as an essential indicator of focus level and integrates spatial surroundings to facilitate cost estimation. Furthermore, we analyze the noise patterns within our framework and improve it with the newly introduced Inter-Hypotheses Cost Aggregation (IHCA) module, where the cost volume is refined through cost trend prediction and multi-scale cost consistency constraints. Extensive experiments on real-world and synthetic datasets demonstrate that our proposed framework outperforms cutting-edge methods by up to 10\% in terms of the absolute relative error metric, revealing superior performance in predicting accuracy.

cs.CV↗

arXiv2024

Localization transitions of correlated particles in nonreciprocal quasicrystals

The interplay among interaction, non-Hermiticity, and disorder opens a new avenue for engineering novel phase transitions. We here study the spectral and localization features of two interacting bosons in one-dimensional nonreciprocal quasicrystals. Specifically, by considering a quasiperiodic Hubbard lattice with nonreciprocal hoppings, we show that the interaction can lead to a mobility edge, which arises from the fact that the bound states display a much lower threshold for spectral and extended-localized transitions than scattering states. The localization transition of bound or scattering states is accompanied by a complex-real spectrum transition. Moreover, while the two-particle localized states are robust to the boundary conditions, the two-particle extended states turn into skin modes under open boundary condition. We also show the correlated dynamics to characterize these localization transitions. Finally, we reveal that the bound states can form mobility edge on their own by introducing a dimerized nonreciprocal quasicrystal. Our paper may pave the way for the study of non-Hermitian few-body physics.

cond-mat.dis-nn↗

arXiv2024

A High-Throughput FPGA Accelerator for Lightweight CNNs With Balanced Dataflow

FPGA accelerators for lightweight neural convolutional networks (LWCNNs) have recently attracted significant attention. Most existing LWCNN accelerators focus on single-Computing-Engine (CE) architecture with local optimization. However, these designs typically suffer from high on-chip/off-chip memory overhead and low computational efficiency due to their layer-by-layer dataflow and unified resource mapping mechanisms. To tackle these issues, a novel multi-CE-based accelerator with balanced dataflow is proposed to efficiently accelerate LWCNN through memory-oriented and computing-oriented optimizations. Firstly, a streaming architecture with hybrid CEs is designed to minimize off-chip memory access while maintaining a low cost of on-chip buffer size. Secondly, a balanced dataflow strategy is introduced for streaming architectures to enhance computational efficiency by improving efficient resource mapping and mitigating data congestion. Furthermore, a resource-aware memory and parallelism allocation methodology is proposed, based on a performance model, to achieve better performance and scalability. The proposed accelerator is evaluated on Xilinx ZC706 platform using MobileNetV2 and ShuffleNetV2.Implementation results demonstrate that the proposed accelerator can save up to 68.3% of on-chip memory size with reduced off-chip memory access compared to the reference design. It achieves an impressive performance of up to 2092.4 FPS and a state-of-the-art MAC efficiency of up to 94.58%, while maintaining a high DSP utilization of 95%, thus significantly outperforming current LWCNN accelerators.

cs.AR↗

arXiv2024

High-speed and High-quality Vision Reconstruction of Spike Camera with Spike Stability Theorem

Neuromorphic vision sensors, such as the dynamic vision sensor (DVS) and spike camera, have gained increasing attention in recent years. The spike camera can detect fine textures by mimicking the fovea in the human visual system, and output a high-frequency spike stream. Real-time high-quality vision reconstruction from the spike stream can build a bridge to high-level vision task applications of the spike camera. To realize high-speed and high-quality vision reconstruction of the spike camera, we propose a new spike stability theorem that reveals the relationship between spike stream characteristics and stable light intensity. Based on the spike stability theorem, two parameter-free algorithms are designed for the real-time vision reconstruction of the spike camera. To demonstrate the performances of our algorithms, two datasets (a public dataset PKU-Spike-High-Speed and a newly constructed dataset SpikeCityPCL) are used to compare the reconstruction quality and speed of various reconstruction methods. Experimental results show that, compared with the current state-of-the-art (SOTA) reconstruction methods, our reconstruction methods obtain the best tradeoff between the reconstruction quality and speed. Additionally, we design the FPGA implementation method of our algorithms to realize the real-time (running at 20,000 FPS) visual reconstruction. Our work provides new theorem and algorithm foundations for the real-time edge-end vision processing of the spike camera.

cs.CV↗

arXiv2024

SeSeMI: Secure Serverless Model Inference on Sensitive Data

Model inference systems are essential for implementing end-to-end data analytics pipelines that deliver the benefits of machine learning models to users. Existing cloud-based model inference systems are costly, not easy to scale, and must be trusted in handling the models and user request data. Serverless computing presents a new opportunity, as it provides elasticity and fine-grained pricing. Our goal is to design a serverless model inference system that protects models and user request data from untrusted cloud providers. It offers high performance and low cost, while requiring no intrusive changes to the current serverless platforms. To realize our goal, we leverage trusted hardware. We identify and address three challenges in using trusted hardware for serverless model inference. These challenges arise from the high-level abstraction of serverless computing, the performance overhead of trusted hardware, and the characteristics of model inference workloads. We present SeSeMI, a secure, efficient, and cost-effective serverless model inference system. It adds three novel features non-intrusively to the existing serverless infrastructure and nothing else.The first feature is a key service that establishes secure channels between the user and the serverless instances, which also provides access control to models and users' data. The second is an enclave runtime that allows one enclave to process multiple concurrent requests. The final feature is a model packer that allows multiple models to be executed by one serverless instance. We build SeSeMI on top of Apache OpenWhisk, and conduct extensive experiments with three popular machine learning models. The results show that SeSeMI achieves low latency and low cost at scale for realistic workloads.

cs.CR↗

arXiv2024

Unsupervised Cross-Domain Regression for Fine-grained 3D Game Character Reconstruction

With the rise of the ``metaverse'' and the rapid development of games, it has become more and more critical to reconstruct characters in the virtual world faithfully. The immersive experience is one of the most central themes of the ``metaverse'', while the reducibility of the avatar is the crucial point. Meanwhile, the game is the carrier of the metaverse, in which players can freely edit the facial appearance of the game character. In this paper, we propose a simple but powerful cross-domain framework that can reconstruct fine-grained 3D game characters from single-view images in an end-to-end manner. Different from the previous methods, which do not resolve the cross-domain gap, we propose an effective regressor that can greatly reduce the discrepancy between the real-world domain and the game domain. To figure out the drawbacks of no ground truth, our unsupervised framework has accomplished the knowledge transfer of the target domain. Additionally, an innovative contrastive loss is proposed to solve the instance-wise disparity, which keeps the person-specific details of the reconstructed character. In contrast, an auxiliary 3D identity-aware extractor is activated to make the results of our model more impeccable. Then a large set of physically meaningful facial parameters is generated robustly and exquisitely. Experiments demonstrate that our method yields state-of-the-art performance in 3D game character reconstruction.

cs.CV↗

arXiv2024

Precision Enhancement in Spatial Measurement by Introducing Squeezed Light into Weak Value Amplification

The precision enhancement is demonstrated in an optical spatial measurement based on weak value amplification (WVA) system and split-like detection, by injecting a TEM$_{10}$ squeezed vacuum beam. It is the first time to experimentally realize high-precision optical spatial measurement beyond the shot noise limit by using squeezing-assisted WVA. Based on the WVA technique, which can amplify the signal by increasing the number of photons that injected into the interferometer, squeezed beam injection can reduce the noise level and can further improve the signal-to-noise ratio(SNR). As a result, a SNR improvement of 2dB, i.e., 1.3 time precision enhancement, can be achieved, by using a 2dB squeezed beam injection and 2.6\% postselection probability in WVA process. Our work provides an effective method to accomplish higher precision in quantum spatial measurement, which has potential applications in gravitational wave interferometer calibration, super-resolution quantum imaging, etc.

quant-ph↗

arXiv2024

A hybridizable discontinuous Galerkin method for the indefinite time-harmonic Maxwell equations

In this paper, we aim to develop a hybridizable discontinuous Galerkin (HDG) method for the indefinite time-harmonic Maxwell equations with the perfectly conducting boundary in the three-dimensional space. First, we derive the wavenumber explicit regularity result, which plays an important role in the error analysis for the HDG method. Second, we prove a discrete inf-sup condition which holds for all positive mesh size $h$, for all wavenumber $k$, and for general domain $Ω$. Then, we establish the optimal order error estimates of the underlying HDG method with constant independent of the wavenumber. The theoretical results are confirmed by numerical experiments.

math.NA↗

arXiv2024

Reexamination of evaporation from horizontal surfaces with implications for solar interfacial evaporation experiments

To explain reported solar interfacial-evaporation rates from porous materials beyond an apparent 100% efficiency using the thermal evaporation mechanism, many publications hypothesize that intermediate water inside porous materials have a reduced latent heat. Key supporting evidence is that water-only surfaces have lower dark evaporation rates than porous evaporators, with the ratio of the two rates taken as the latent heat reduction. Through simulations and experiments, we present benchmark evaporation rates of water and show that reported differences in natural evaporation are likely due to experimental error from recessed evaporating surfaces rather than from reduced latent heat. A few millimeters recession of the evaporating surface can drop evaporation rates over 50% due to a stagnant air layer, suggesting that the comparative experiments are prone to error and the latent heat reduction hypothesis cannot be substantiated. Our results indicate that new mechanistic directions need to be pursued to understand superthermal evaporation.

physics.app-ph↗

arXiv2024

Agent Centric Operating System -- a Comprehensive Review and Outlook for Operating System

The operating system (OS) is the backbone of modern computing, providing essential services and managing resources for computer hardware and software. This review paper offers an in-depth analysis of operating systems' evolution, current state, and prospects. We begin with an overview of the concept and significance of operating systems in the digital era. In the second section, we delve into the existing released operating systems, examining their architectures, functionalities, and the ecosystems they support. We then explore recent advances in OS evolution, highlighting innovations in real-time processing, distributed computing, and security. The third section focuses on the new era of operating systems, discussing emerging trends like the Internet of Things (IoT), cloud computing, and artificial intelligence (AI) integration. We also consider the challenges and opportunities presented by these developments. This review concludes with a synthesis of the current landscape and a forward-looking discussion on the future trajectories of operating systems, including open issues and areas ripe for further research and innovation. Finally, we put forward a new OS architecture.

cs.DC↗

arXiv2024

TableGPT2: A Large Multimodal Model with Tabular Data Integration

The emergence of models like GPTs, Claude, LLaMA, and Qwen has reshaped AI applications, presenting vast new opportunities across industries. Yet, the integration of tabular data remains notably underdeveloped, despite its foundational role in numerous real-world domains. This gap is critical for three main reasons. First, database or data warehouse data integration is essential for advanced applications; second, the vast and largely untapped resource of tabular data offers immense potential for analysis; and third, the business intelligence domain specifically demands adaptable, precise solutions that many current LLMs may struggle to provide. In response, we introduce TableGPT2, a model rigorously pre-trained and fine-tuned with over 593.8K tables and 2.36M high-quality query-table-output tuples, a scale of table-related data unprecedented in prior research. This extensive training enables TableGPT2 to excel in table-centric tasks while maintaining strong general language and coding abilities. One of TableGPT2's key innovations is its novel table encoder, specifically designed to capture schema-level and cell-level information. This encoder strengthens the model's ability to handle ambiguous queries, missing column names, and irregular tables commonly encountered in real-world applications. Similar to visual language models, this pioneering approach integrates with the decoder to form a robust large multimodal model. We believe the results are compelling: over 23 benchmarking metrics, TableGPT2 achieves an average performance improvement of 35.20% in the 7B model and 49.32% in the 72B model over prior benchmark-neutral LLMs, with robust general-purpose capabilities intact.

cs.LG↗

arXiv2024

One-loop Gravitational Bremsstrahlung and Waveforms from a Heavy-Mass Effective Field Theory

Using a heavy-mass effective field theory (HEFT), we study gravitational-wave emission in the scattering of two spinless black holes or neutron stars of arbitrary masses at next-to-leading order in the Post-Minkowskian expansion. We compute the contributions to the one-loop scattering amplitude with four scalars and one graviton which are relevant to the calculation of the waveforms, also presenting expressions of classical tree-level amplitudes with four scalars and up to two radiated gravitons. The latter are obtained using a novel on-shell recursion relation for classical amplitudes with four scalars and an arbitrary number of gravitons. Our one-loop five-point amplitude is expressed in terms of a single family of master integrals with the principal value prescription for linearised massive propagators, which we evaluate using differential equations. In our HEFT approach all hyper-classical iterations and quantum corrections to the amplitude are dropped at the diagrammatic level, thereby computing directly contributions to classical physics. Our result exhibits the expected factorisation of infrared divergences, the correct soft limits, and highly nontrivial cancellations of spurious poles. Finally, using our amplitude result we compute numerically the corresponding next-to-leading corrections to the spectral waveforms and the far-field time-domain waveforms using the Newman-Penrose scalar $Ψ_4$.

hep-th↗

arXiv2024

Revisiting CNNs for Trajectory Similarity Learning

Similarity search is a fundamental but expensive operator in querying trajectory data, due to its quadratic complexity of distance computation. To mitigate the computational burden for long trajectories, neural networks have been widely employed for similarity learning and each trajectory is encoded as a high-dimensional vector for similarity search with linear complexity. Given the sequential nature of trajectory data, previous efforts have been primarily devoted to the utilization of RNNs or Transformers. In this paper, we argue that the common practice of treating trajectory as sequential data results in excessive attention to capturing long-term global dependency between two sequences. Instead, our investigation reveals the pivotal role of local similarity, prompting a revisit of simple CNNs for trajectory similarity learning. We introduce ConvTraj, incorporating both 1D and 2D convolutions to capture sequential and geo-distribution features of trajectories, respectively. In addition, we conduct a series of theoretical analyses to justify the effectiveness of ConvTraj. Experimental results on four real-world large-scale datasets demonstrate that ConvTraj achieves state-of-the-art accuracy in trajectory similarity search. Owing to the simple network structure of ConvTraj, the training and inference speed on the Porto dataset with 1.6 million trajectories are increased by at least $240$x and $2.16$x, respectively. The source code and dataset can be found at \textit{\url{https://github.com/Proudc/ConvTraj}}.

cs.AI↗

arXiv2024

Powering In-Database Dynamic Model Slicing for Structured Data Analytics

Relational database management systems (RDBMS) are widely used for the storage of structured data. To derive insights beyond statistical aggregation, we typically have to extract specific subdatasets from the database using conventional database operations, and then apply deep neural networks (DNN) training and inference on these subdatasets in a separate analytics system. The process can be prohibitively expensive, especially when there are various subdatasets extracted for different analytical purposes. This calls for efficient in-database support of advanced analytical methods. In this paper, we introduce LEADS, a novel SQL-aware dynamic model slicing technique to customize models for specified SQL queries. LEADS improves the predictive modeling of structured data via the mixture of experts (MoE) and maintains efficiency by a SQL-aware gating network. At the core of LEADS is the construction of a general model with multiple expert sub-models trained over the database. The MoE scales up the modeling capacity, enhances effectiveness, and preserves efficiency by activating necessary experts via the SQL-aware gating network during inference. To support in-database analytics, we build an inference extension that integrates LEADS onto PostgreSQL. Our extensive experiments on real-world datasets demonstrate that LEADS consistently outperforms the baseline models, and the in-database inference extension delivers a considerable reduction in inference latency compared to traditional solutions.

cs.DB↗