arXiv subjects

Chanho Kim

Publications and source records attributed to Chanho Kim.

At least 19 recordsLinked to original sources

arXiv2026

3D Point World Models: Point Completion Enables More Accurate Dynamics Learning

Learning predictive models of the world enables robotic control through planning, potentially allowing robots to improvise solutions on new tasks. However, large video-based dynamics models lack explicit 3D spatial structure and suffer from geometrically inconsistent long-term rollouts with compounding errors. Emerging 3D dynamics models based on partial point clouds improve geometric consistency but remain sensitive to occlusions and accumulated prediction drift. To address these challenges, we present 3D Point World Models (3DPWM) - a task-agnostic world model that operates entirely in 3D space by first completing partial point clouds and then learning action-conditioned dynamics in this completed 3D scene. By operating on completed geometry, 3DPWM enables reliable long-horizon rollouts and more accurate cost evaluation for model-based planning while supporting adaptation to new tasks. Experiments across different robotic embodiments and tabletop manipulation benchmarks demonstrate that 3DPWM achieves significantly more reliable long-horizon rollouts (100-300+ steps), supports both open-loop and closed-loop planning, and enables successful sim-to-real transfer.

cs.RO↗

arXiv2026

Learning Adversarial Augmentation Policies for Robust Garlic Seedling Detection

Accurate seedling detection during early growth stages is essential for timely replanting and effective crop management in precision agriculture. However, existing studies are mostly evaluated under relatively stable imaging conditions, such as UAV imagery or greenhouse environments, leaving robust detection under severe and spatially heterogeneous illumination in ground-based outdoor monitoring insufficiently explored. In addition, many illumination-robust detection methods rely on additional enhancement or feature-extraction modules, which increase inference-time overhead and are not tailored to seedling detection and downstream missing seedling localization. To address these gaps, we construct a new garlic seedling dataset captured using a ground-based monitoring platform under real outdoor field conditions with highly variable illumination. We further propose an illumination-robust seedling detection framework based on adversarial augmentation policy learning. The proposed method jointly optimizes a stochastic augmentation policy agent and an object detector, enabling the detector to learn robust representations under challenging visual conditions. A structural penalty is introduced to prevent unrealistic distortions while encouraging challenging augmentations during training. Extensive experiments show that the proposed approach achieves an AP$_{50}$ of 91.6%, improving the baseline by 0.9 percentage points and outperforming the previous best-performing method by 0.2 percentage points. For downstream missing seedling localization, it achieves 75.0% precision and a 67.0% F1-score, improving the baseline by 4.8 and 2.0 percentage points, respectively. These results demonstrate the effectiveness of the proposed framework for practical ground-based agricultural monitoring under complex outdoor lighting conditions without additional inference-time computational overhead.

cs.CV↗

arXiv2026

Learning a Particle Dynamics Model with Real-world Videos

Data-driven learning approaches for physics simulation, sometimes referred to as world models, have emerged as promising alternatives to traditional physics simulators due to their differentiable nature. Prior work has demonstrated impressive results in predicting the motions of rigid and non-rigid objects in complex scenes involving multiple interacting bodies. However, these models are typically trained in simulated environments because obtaining perfect state information such as complete scene point clouds and point correspondences over time is challenging in real-world settings. This reliance on synthetic data can limit their applicability when the sim-to-real gap is large. In this work, we aim to overcome these limitations by introducing a novel framework for training neural object dynamics models directly from unlabeled real-world videos. Specifically, we propose to learn a particle-based dynamics model compatible with a Gaussian splatting framework, which operates on dense particles derived from Gaussians (i.e., particles with scales and rotations) and predicts their position and rotation changes over time. The model is trained via rendering supervision, enabling learning from real-world videos without requiring particle-level labeled states. Our model operates directly on dense Gaussians without relying on heuristic subsampling anchor points. To enable this study, we also present a real-world dataset consisting of about 500 videos capturing diverse object interactions.

cs.CV↗

arXiv2026

Sparsely-Supervised Data Assimilation via Physics-Informed Schr\"odinger Bridge

Data assimilation (DA) for systems governed by partial differential equations (PDE) aims to reconstruct full spatiotemporal fields from sparse high-fidelity (HF) observations while respecting physical constraints. While full-grid low-fidelity (LF) simulations provide informative priors in multi-fidelity settings, recovering an HF field consistent with both sparse observations and the governing PDE typically requires per-instance test-time optimization, which becomes a major bottleneck in time-critical applications. To alleviate this, amortized reconstruction using generative models has recently been proposed; however, such approaches rely on full-field HF supervision during training, which is often impractical in real-world settings. From a more realistic perspective, we propose the Physics-Informed Conditional Schr\"odinger Bridge (PICSB), which transports an informative LF prior toward an observation-conditioned HF posterior without any additional inference-time guidance. To enable learning without HF endpoints, PICSB employs an iterative surrogate-endpoint refresh scheme, and directly incorporates PDE residuals into the training objective while enforcing observations via hard conditioning throughout sampling. Experiments on fluid PDE benchmarks demonstrate that PICSB enables extremely fast spatiotemporal field reconstruction while maintaining competitive accuracy under sparse HF supervision.

cs.LG↗

arXiv2025

X-ray studies of PSR J1838$-$0655 and its wind nebula associated with HESS J1837$-$069 and 1LHAASO J1837$-$0654u

We analyzed X-ray data from Chandra, XMM-Newton, NICER, and NuSTAR to characterize the properties of the pulsar PSR J1838$-$0655 and its pulsar wind nebula (PWN) associated with HESS J1837$-$069. Based on 5.5 years of NICER monitoring, we detected a glitch around MJD 59300, characterized by a fractional frequency jump of approximately $2\times 10^{-6}$. We constructed semi-phase-coherent timing solutions for pre- and post-glitch epochs, allowing for phase alignment of multi-instrument data and a subsequent measurement of the pulsed spectrum of the pulsar. This analysis confirmed previously-reported spectral curvature and revealed a peak energy of $73^{+85}_{-26}$ keV in the pulsar's spectral energy distribution (SED), based on a logpar model fit of the pulsed spectrum. We discuss these findings within the framework of pulsar magnetospheric emission scenarios. The PWN's X-ray spectrum is well-described by a power law with a photon index of $2.1\pm0.3$, softer than previously-reported measurements. We also characterized the X-ray emission from another extended X-ray source AX J1837.3$-$0652 within the extent of HESS J1837$-$069. Based on the spatial and spectral properties of these X-ray sources, we propose a leptonic emission scenario for HESS J1837$-$069 and demonstrate its feasibility through SED modeling. Finally, we discuss the implications of our model results and alternative scenarios for the gamma-ray emission.

astro-ph.HE↗

arXiv2025

Multi-wavelength Study of HESS J0632+057: New Insights into Pulsar-Disk Interaction

We present an analysis of new multi-wavelength observations of the TeV gamma-ray binary HESS J0632+057, conducted using SALT, Swift, NuSTAR, and VERITAS in 2023--2024. By combining these new data with archival observations, we confirm previous suggestions of orbital variability in the source's X-ray spectrum, including increased X-ray absorption at the orbital phase interval of $\phi\approx0.3\textrm{--}0.4$. The source's X-ray flux within this phase interval seems to have exhibited a significant change on an orbital timescale. Additionally, occasional short-term variations in the X-ray band on a timescale of less than 3 days have been observed. The measured duration of the increased absorbing column density and the flux variability timescales can provide clues about the interaction between the putative pulsar and the Be companion's disk if, as previously suggested, the pulsar crosses the disk at this phase interval. Moreover, the new contemporaneous X-ray and TeV observations around the pulsar-crossing phases revealed independent variability in the X-ray and TeV fluxes, contrary to a previous observation of concurrent flux increases. While these observations alone cannot provide definitive conclusions, we discuss our results in the context of pulsar-disk interaction and intrabinary shock emission scenarios.

astro-ph.HE↗

arXiv2025

GS4: Generalizable Sparse Splatting Semantic SLAM

Traditional SLAM algorithms excel at camera tracking, but typically produce incomplete and low-resolution maps that are not tightly integrated with semantics prediction. Recent work integrates Gaussian Splatting (GS) into SLAM to enable dense, photorealistic 3D mapping, yet existing GS-based SLAM methods require per-scene optimization that is slow and consumes an excessive number of Gaussians. We present GS4, the first generalizable GS-based semantic SLAM system. Compared with prior approaches, GS4 runs 10x faster, uses 10x fewer Gaussians, and achieves state-of-the-art performance across color, depth, semantic mapping and camera tracking. From an RGB-D video stream, GS4 incrementally builds and updates a set of 3D Gaussians using a feed-forward network. First, the Gaussian Prediction Model estimates a sparse set of Gaussian parameters from input frame, which integrates both color and semantic prediction with the same backbone. Then, the Gaussian Refinement Network merges new Gaussians with the existing set while avoiding redundancy. Finally, when significant pose changes are detected, we perform only 1-5 iterations of joint Gaussian-pose optimization to correct drift, remove floaters, and further improve tracking accuracy. Experiments on the real-world ScanNet and ScanNet++ benchmarks demonstrate state-of-the-art semantic SLAM performance, with strong generalization capability shown through zero-shot transfer to the NYUv2 and TUM RGB-D datasets.

cs.CV↗

arXiv2024

Investigation of the non-thermal X-ray emission from the supernova remnant CTB 37B hosting the magnetar CXOU J171405.7$-$381031

We present a detailed X-ray investigation of a region (S1) exhibiting non-thermal X-ray emission within the supernova remnant (SNR) CTB 37B hosting the magnetar CXOU J171405.7$-$381031. Previous analyses modeled this emission with a power law (PL), inferring various values for the photon index ($\Gamma$) and absorbing column density ($N_{\rm H}$). Based on these, S1 was suggested to be the SNR shell, a background pulsar wind nebula (PWN), or an interaction region between the SNR and a molecular cloud. Our analysis of a larger dataset favors a steepening (broken or curved PL) spectrum over a straight PL, with the best-fit broken power-law (BPL) parameters of $\Gamma=1.23\pm0.23$ and $2.24\pm0.16$ below and above a break at $5.57\pm0.52$ keV, respectively. However, a simple PL or srcut model cannot be definitively ruled out. For the BPL model, the inferred $N_{\rm H}=(4.08\pm0.72)\times 10^{22}\rm \ cm^{-2}$ towards S1 is consistent with that of the SNR, suggesting a physical association. The BPL-inferred spectral break $\Delta \Gamma \approx 1$ and hard $\Gamma$ can be naturally explained by a non-thermal bremsstrahlung (NTB) model. We present an evolutionary NTB model that reproduces the observed spectrum, which indicates the presence of sub-relativistic electrons within S1. However, alternate explanations for S1, an unrelated PWN or the SNR shock with unusually efficient acceleration, cannot be ruled out. We discuss these explanations and their implications for gamma-ray emission from CTB 37B, and describe future observations that could settle the origin of S1.

astro-ph.HE↗

arXiv2024

Revisiting the Intrabinary Shock Model for Millisecond Pulsar Binaries: Radiative Losses and Long-Term Variability

Spectrally hard X-ray emission with double-peak light curves (LCs) and orbitally modulated gamma rays have been observed in some millisecond pulsar binaries, phenomena attributed to intrabinary shocks (IBSs). While the existing IBS model by Sim, An, and Wadiasingh (2024) successfully explains these high-energy features observed in three pulsar binaries, it neglects particle energy loss within the shock region. We refine this IBS model to incorporate radiative losses of X-ray emitting electrons and positrons, and verify that the losses have insignificant impact on the observed LCs and spectra of the three binaries. Applying our refined IBS model to the X-ray bright pulsar binary PSR J1723-2837, we predict that it can be detected by the Cherenkov Telescope Array. Additionally, we propose that the long-term X-ray variability observed in XSS J12270-4859 and PSR J1723-2837 is due to changes in the shape of their IBSs. Our modeling of the X-ray variability suggests that these IBS shape changes may alter the extinction of the companion's optical emission, potentially explaining the simultaneous optical and X-ray variability observed in XSS J12270-4859. We present the model results and discuss their implications.

astro-ph.HE↗

arXiv2024

Long-Term 3D Point Tracking By Cost Volume Fusion

Long-term point tracking is essential to understand non-rigid motion in the physical world better. Deep learning approaches have recently been incorporated into long-term point tracking, but most prior work predominantly functions in 2D. Although these methods benefit from the well-established backbones and matching frameworks, the motions they produce do not always make sense in the 3D physical world. In this paper, we propose the first deep learning framework for long-term point tracking in 3D that generalizes to new points and videos without requiring test-time fine-tuning. Our model contains a cost volume fusion module that effectively integrates multiple past appearances and motion information via a transformer architecture, significantly enhancing overall tracking performance. In terms of 3D tracking performance, our model significantly outperforms simple scene flow chaining and previous 2D point tracking methods, even if one uses ground truth depth and camera pose to backproject 2D point tracks in a synthetic scenario.

cs.CV↗

arXiv2024

Point Cloud Models Improve Visual Robustness in Robotic Learners

Visual control policies can encounter significant performance degradation when visual conditions like lighting or camera position differ from those seen during training -- often exhibiting sharp declines in capability even for minor differences. In this work, we examine robustness to a suite of these types of visual changes for RGB-D and point cloud based visual control policies. To perform these experiments on both model-free and model-based reinforcement learners, we introduce a novel Point Cloud World Model (PCWM) and point cloud based control policies. Our experiments show that policies that explicitly encode point clouds are significantly more robust than their RGB-D counterparts. Further, we find our proposed PCWM significantly outperforms prior works in terms of sample efficiency during training. Taken together, these results suggest reasoning about the 3D scene through point clouds can improve performance, reduce learning time, and increase robustness for robotic learners. Project Webpage: https://pvskand.github.io/projects/PCWM

cs.RO↗

arXiv2024

Object Dynamics Modeling with Hierarchical Point Cloud-based Representations

Modeling object dynamics with a neural network is an important problem with numerous applications. Most recent work has been based on graph neural networks. However, physics happens in 3D space, where geometric information potentially plays an important role in modeling physical phenomena. In this work, we propose a novel U-net architecture based on continuous point convolution which naturally embeds information from 3D coordinates and allows for multi-scale feature representations with established downsampling and upsampling procedures. Bottleneck layers in the downsampled point clouds lead to better long-range interaction modeling. Besides, the flexibility of point convolutions allows our approach to generalize to sparsely sampled points from mesh vertices and dynamically generate features on important interaction points on mesh faces. Experimental results demonstrate that our approach significantly improves the state-of-the-art, especially in scenarios that require accurate gravity or collision reasoning.

cs.CV↗

arXiv2023

X-ray characterization of the pulsar PSR J1849$-$0001 and its wind nebula G32.64+0.53 associated with TeV sources detected by H.E.S.S., HAWC, Tibet AS$\gamma$, and LHAASO

We report on the X-ray emission properties of the pulsar PSR J1849$-$0001 and its wind nebula (PWN), as measured by Chandra, XMM-Newton, NICER, Swift, and NuSTAR. In the X-ray data, we detected the 38-ms pulsations of the pulsar up to $\sim$60 keV with high significance. Additionally, we found that the pulsar's on-pulse spectral energy distribution displays significant curvature, peaking at $\approx$60 keV. Comparing the phase-averaged and on-pulse spectra of the pulsar, we found that the pulsar's off-pulse emission exhibits a spectral shape that is very similar to its on-pulse emission. This characterization of the off-pulse emission enabled us to measure the $>$10 keV spectrum of the faint and extended PWN using NuSTAR's off-pulse data. We measured both the X-ray spectrum and the radial profiles of the PWN's brightness and photon index, and we combined these X-ray measurements with published TeV results. We then employed a multizone emission scenario to model the broadband data. The results of the modeling suggest that the magnetic field within the PWN is relatively low ($\approx 7\mu \rm G$) and that electrons are accelerated to energies $\stackrel{>}{_{\sim}}$400 TeV within this PWN. The electrons responsible for the TeV emission outside the X-ray PWN may propagate to $\sim$30 pc from the pulsar in $\sim$10 kyr.

astro-ph.HE↗

arXiv2023

The High Energy X-ray Probe (HEX-P): Galactic PeVatrons, star clusters, superbubbles, microquasar jets, and gamma-ray binaries

HEX-P is a probe-class mission concept that will combine high spatial resolution X-ray imaging (<10" FWHM) and broad spectral coverage (0.2-80 keV) with an effective area far superior to current facilities (including XMM-Newton and NuSTAR) to enable revolutionary new insights into a variety of important astrophysical problems. With the recent discoveries of over 40 ultra-high-energy gamma-ray sources (detected above 100 TeV) and neutrino emission in the Galactic Plane, we have entered a new era of multi-messenger astrophysics facing the exciting reality of Galactic PeVatrons. In the next decade, as more Galactic PeVatrons and TeV gamma-ray sources are expected to be discovered, the identification of their acceleration and emission mechanisms will be the most pressing issue in both particle and high-energy astrophysics. In this paper, along with its companion papers (Reynolds et al. 2023, Mori et al. 2023), we will present that HEX-P is uniquely suited to address important problems in various cosmic-ray accelerators, including Galactic PeVatrons, through investigating synchrotron X-ray emission of TeV-PeV electrons produced by both leptonic and hadronic processes.

astro-ph.HE↗

arXiv2023

The High Energy X-ray Probe (HEX-P): Supernova remnants, pulsar wind nebulae, and nuclear astrophysics

HEX-P is a probe-class mission concept that will combine high spatial resolution X-ray imaging ($<10"$ full width at half maximum) and broad spectral coverage (0.2--80 keV) with an effective area far superior to current facilities (including XMM-Newton and NuSTAR) to enable revolutionary new insights into a variety of important astrophysical problems. HEX-P is ideally suited to address important problems in the physics and astrophysics of supernova remnants (SNRs) and pulsar-wind nebulae (PWNe). For shell SNRs, HEX-P can greatly improve our understanding via more accurate spectral characterization and localization of non-thermal X-ray emission from both non-thermal-dominated SNRs and those containing both thermal and non-thermal components, and can discover previously unknown non-thermal components in SNRs. Multi-epoch HEX-P observations of several young SNRs (e.g., Cas A and Tycho) are expected to detect year-scale variabilities of X-ray filaments and knots, thus enabling us to determine fundamental parameters related to diffusive shock acceleration, such as local magnetic field strengths and maximum electron energies. For PWNe, HEX-P will provide spatially-resolved, broadband X-ray spectral data separately from their pulsar emission, allowing us to study how particle acceleration, cooling, and propagation operate in different evolution stages of PWNe. HEX-P is also poised to make unique and significant contributions to nuclear astrophysics of Galactic radioactive sources by improving detections of, or limits on, $^{44}$Ti in the youngest SNRs and by potentially discovering rare nuclear lines as evidence of double neutron star mergers. Throughout the paper, we present simulations of each class of objects, demonstrating the power of both the imaging and spectral capabilities of HEX-P to advance our knowledge of SNRs, PWNe, and nuclear astrophysics.

astro-ph.HE↗

arXiv2023

Learning Vision-Based Bipedal Locomotion for Challenging Terrain

Reinforcement learning (RL) for bipedal locomotion has recently demonstrated robust gaits over moderate terrains using only proprioceptive sensing. However, such blind controllers will fail in environments where robots must anticipate and adapt to local terrain, which requires visual perception. In this paper, we propose a fully-learned system that allows bipedal robots to react to local terrain while maintaining commanded travel speed and direction. Our approach first trains a controller in simulation using a heightmap expressed in the robot's local frame. Next, data is collected in simulation to train a heightmap predictor, whose input is the history of depth images and robot states. We demonstrate that with appropriate domain randomization, this approach allows for successful sim-to-real transfer with no explicit pose estimation and no fine-tuning using real-world data. To the best of our knowledge, this is the first example of sim-to-real learning for vision-based bipedal locomotion over challenging terrains.

cs.RO↗

arXiv2023

Out of Sight, Still in Mind: Reasoning and Planning about Unobserved Objects with Video Tracking Enabled Memory Models

Robots need to have a memory of previously observed, but currently occluded objects to work reliably in realistic environments. We investigate the problem of encoding object-oriented memory into a multi-object manipulation reasoning and planning framework. We propose DOOM and LOOM, which leverage transformer relational dynamics to encode the history of trajectories given partial-view point clouds and an object discovery and tracking engine. Our approaches can perform multiple challenging tasks including reasoning with occluded objects, novel objects appearance, and object reappearance. Throughout our extensive simulation and real-world experiments, we find that our approaches perform well in terms of different numbers of objects and different numbers of distractor actions. Furthermore, we show our approaches outperform an implicit memory baseline.

cs.RO↗

arXiv2023

A broadband X-ray study of the Rabbit pulsar wind nebula powered by PSR J1418-6058

We report on broadband X-ray properties of the Rabbit pulsar wind nebula (PWN) associated with the pulsar PSR J1418-6058 using archival Chandra and XMM-Newton data, and a new NuSTAR observation. NuSTAR data above 10 keV allowed us to detect the 110-ms spin period of the pulsar, characterize its hard X-ray pulse profile, and resolve hard X-ray emission from the PWN after removing contamination from the pulsar and other overlapping point sources. The extended PWN was detected up to $\sim$20 keV and is well described by a power-law model with a photon index $\Gamma\approx$2. The PWN shape does not vary significantly with energy, and its X-ray spectrum shows no clear evidence of softening away from the pulsar. We modeled the spatial profile of X-ray spectra and broadband spectral energy distribution in the radio to TeV band to infer the physical properties of the PWN. We found that a model with low magnetic field strength ($B\sim 10$ $\mu$G) and efficient diffusion ($D\sim 10^{27}$ cm$^2$ s$^{-1}$) fits the PWN data well. The extended hard X-ray and TeV emission, associated respectively with synchrotron radiation and inverse Compton scattering by relativistic electrons, suggests that particles are accelerated to very high energies ($\gtrsim500$ TeV), indicating that the Rabbit PWN is a Galactic PeVatron candidate.

astro-ph.HE↗