arXiv subjects

Xiaofeng Guo

Publications and source records attributed to Xiaofeng Guo.

At least 37 records · Page 2Linked to original sources

arXiv2023

Aerial Interaction with Tactile Sensing

While autonomous Uncrewed Aerial Vehicles (UAVs) have grown rapidly, most applications only focus on passive visual tasks. Aerial interaction aims to execute tasks involving physical interactions, which offers a way to assist humans in high-risk, high-altitude operations, thereby reducing cost, time, and potential hazards. The coupled dynamics between the aerial vehicle and manipulator, however, pose challenges for precision control. Previous research has typically employed either position control, which often fails to meet mission accuracy, or force control using expensive, heavy, and cumbersome force/torque sensors that also lack local semantic information. Conversely, tactile sensors, being both cost-effective and lightweight, are capable of sensing contact information including force distribution, as well as recognizing local textures. Existing work on tactile sensing mainly focuses on tabletop manipulation tasks within a quasi-static process. In this paper, we pioneer the use of vision-based tactile sensors on a fully-actuated UAV to improve the accuracy of the more dynamic aerial manipulation tasks. We introduce a pipeline utilizing tactile feedback for real-time force tracking via a hybrid motion-force controller and a method for wall texture detection during aerial interactions. Our experiments demonstrate that our system can effectively replace or complement traditional force/torque sensors, improving flight performance by approximately 16% in position tracking error when using the fused force estimate compared to relying on a single sensor. Our tactile sensor achieves 93.4% accuracy in real-time texture recognition and 100% post-contact. To the best of our knowledge, this is the first work to incorporate a vision-based tactile sensor into aerial interaction tasks.

cs.RO↗

arXiv2023

Estimating Properties of Solid Particles Inside Container Using Touch Sensing

Solid particles, such as rice and coffee beans, are commonly stored in containers and are ubiquitous in our daily lives. Understanding those particles' properties could help us make later decisions or perform later manipulation tasks such as pouring. Humans typically interact with the containers to get an understanding of the particles inside them, but it is still a challenge for robots to achieve that. This work utilizes tactile sensing to estimate multiple properties of solid particles enclosed in the container, specifically, content mass, content volume, particle size, and particle shape. We design a sequence of robot actions to interact with the container. Based on physical understanding, we extract static force/torque value from the F/T sensor, vibration-related features and topple-related features from the newly designed high-speed GelSight tactile sensor to estimate those four particle properties. We test our method on $37$ very different daily particles, including powder, rice, beans, tablets, etc. Experiments show that our approach is able to estimate content mass with an error of $1.8$ g, content volume with an error of $6.1$ ml, particle size with an error of $1.1$ mm, and achieves an accuracy of $75.6$% for particle shape estimation. In addition, our method can generalize to unseen particles with unknown volumes. By estimating these particle properties, our method can help robots to better perceive the granular media and help with different manipulation tasks in daily life and industry.

cs.RO↗

arXiv2023

Machine learning assisted phase and size-controlled synthesis of iron oxides

The controllable synthesis of iron oxides particles is a critical issue for materials science, energy storage, biomedical applications, environmental science, and earth science. However, synthesis of iron oxides with desired phase and size are still a time-consuming and trial-and-error process. This study presents solutions for two fundamental challenges in materials synthesis: predicting the outcome of a synthesis from specified reaction parameters and correlating sets of parameters to obtain products with desired outcomes. Four machine learning algorithms, including random forest, logistic regression, support vector machine, and k-nearest neighbor, were trained to predict the phase and particle size of iron oxide based on experimental conditions. Among the models, random forest exhibited the best performance, achieving 96% and 81% accuracy when predicting the phase and size of iron oxides in the test dataset. Premutation feature importance analysis shows that most models (except logistic regression) rely on known features such as precursor concentration, pH, and temperature to predict the phases from synthesis conditions. The robustness of the random forest models was further verified by comparing prediction and experimental results based on 24 randomly generated methods in additive and non-additive systems not included in the datasets. The predictions of product phase and particle size from the models are in good agreement with the experimental results. Additionally, a searching and ranking algorithm was developed to recommend potential synthesis parameters for obtaining iron oxide products with desired phase and particle size from previous studies in the dataset.

cond-mat.mtrl-sci↗

arXiv2023

Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation

Manual analysis of XRD data is usually laborious and time consuming. The deep neural network (DNN) based models trained by synthetic XRD patterns are proved to be an automatic, accurate, and high throughput method to analysis common XRD data collected from solid sample in ambient environment. However, it remains unknown that whether synthetic XRD based models are capable to solve u-XRD mapping data for in-situ experiments involving liquid phase exhibiting lower quality with significant artifacts. In this study, we collected u-XRD mapping data from an LaCl3-calcite hydrothermal fluid system and trained two categories of models to solve the experimental XRD patterns. The models trained by synthetic XRD patterns show low accuracy (as low as 64%) when solving experimental u-XRD mapping data. The accuracy of the DNN models was significantly improved (90% or above) when training them with the dataset containing both synthetic and small number of labeled experimental u-XRD patterns. This study highlighted the importance of labeled experimental patterns on the training of DNN models to solve u-XRD mapping data from in-situ experiments involving liquid phase.

cond-mat.dis-nn↗

arXiv2023

Deep Reinforcement Learning for Robotic Pushing and Picking in Cluttered Environment

In this paper, a novel robotic grasping system is established to automatically pick up objects in cluttered scenes. A composite robotic hand composed of a suction cup and a gripper is designed for grasping the object stably. The suction cup is used for lifting the object from the clutter first and the gripper for grasping the object accordingly. We utilize the affordance map to provide pixel-wise lifting point candidates for the suction cup. To obtain a good affordance map, the active exploration mechanism is introduced to the system. An effective metric is designed to calculate the reward for the current affordance map, and a deep Q-Network (DQN) is employed to guide the robotic hand to actively explore the environment until the generated affordance map is suitable for grasping. Experimental results have demonstrated that the proposed robotic grasping system is able to greatly increase the success rate of the robotic grasping in cluttered scenes.

cs.RO↗

arXiv2023

MQA: Answering the Question via Robotic Manipulation

In this paper, we propose a novel task, Manipulation Question Answering (MQA), where the robot performs manipulation actions to change the environment in order to answer a given question. To solve this problem, a framework consisting of a QA module and a manipulation module is proposed. For the QA module, we adopt the method for the Visual Question Answering (VQA) task. For the manipulation module, a Deep Q Network (DQN) model is designed to generate manipulation actions for the robot to interact with the environment. We consider the situation where the robot continuously manipulating objects inside a bin until the answer to the question is found. Besides, a novel dataset that contains a variety of object models, scenarios and corresponding question-answer pairs is established in a simulation environment. Extensive experiments have been conducted to validate the effectiveness of the proposed framework.

cs.AI↗

arXiv2023

LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval

Video-text retrieval is a class of cross-modal representation learning problems, where the goal is to select the video which corresponds to the text query between a given text query and a pool of candidate videos. The contrastive paradigm of vision-language pretraining has shown promising success with large-scale datasets and unified transformer architecture, and demonstrated the power of a joint latent space. Despite this, the intrinsic divergence between the visual domain and textual domain is still far from being eliminated, and projecting different modalities into a joint latent space might result in the distorting of the information inside the single modality. To overcome the above issue, we present a novel mechanism for learning the translation relationship from a source modality space $\mathcal{S}$ to a target modality space $\mathcal{T}$ without the need for a joint latent space, which bridges the gap between visual and textual domains. Furthermore, to keep cycle consistency between translations, we adopt a cycle loss involving both forward translations from $\mathcal{S}$ to the predicted target space $\mathcal{T'}$, and backward translations from $\mathcal{T'}$ back to $\mathcal{S}$. Extensive experiments conducted on MSR-VTT, MSVD, and DiDeMo datasets demonstrate the superiority and effectiveness of our LaT approach compared with vanilla state-of-the-art methods.

cs.CV↗

arXiv2023

1st Place Solution for PSG competition with ECCV'22 SenseHuman Workshop

Panoptic Scene Graph (PSG) generation aims to generate scene graph representations based on panoptic segmentation instead of rigid bounding boxes. Existing PSG methods utilize one-stage paradigm which simultaneously generates scene graphs and predicts semantic segmentation masks or two-stage paradigm that first adopt an off-the-shelf panoptic segmentor, then pairwise relationship prediction between these predicted objects. One-stage approach despite having a simplified training paradigm, its segmentation results are usually under-satisfactory, while two-stage approach lacks global context and leads to low performance on relation prediction. To bridge this gap, in this paper, we propose GRNet, a Global Relation Network in two-stage paradigm, where the pre-extracted local object features and their corresponding masks are fed into a transformer with class embeddings. To handle relation ambiguity and predicate classification bias caused by long-tailed distribution, we formulate relation prediction in the second stage as a multi-class classification task with soft label. We conduct comprehensive experiments on OpenPSG dataset and achieve the state-of-art performance on the leadboard. We also show the effectiveness of our soft label strategy for long-tailed classes in ablation studies. Our code has been released in https://github.com/wangqixun/mfpsg.

cs.CV↗

arXiv2022

Understanding Dynamic Tactile Sensing for Liquid Property Estimation

Humans perceive the world by interacting with objects, which often happens in a dynamic way. For example, a human would shake a bottle to guess its content. However, it remains a challenge for robots to understand many dynamic signals during contact well. This paper investigates dynamic tactile sensing by tackling the task of estimating liquid properties. We propose a new way of thinking about dynamic tactile sensing: by building a light-weighted data-driven model based on the simplified physical principle. The liquid in a bottle will oscillate after a perturbation. We propose a simple physics-inspired model to explain this oscillation and use a high-resolution tactile sensor GelSight to sense it. Specifically, the viscosity and the height of the liquid determine the decay rate and frequency of the oscillation. We then train a Gaussian Process Regression model on a small amount of the real data to estimate the liquid properties. Experiments show that our model can classify three different liquids with 100% accuracy. The model can estimate volume with high precision and even estimate the concentration of sugar-water solution. It is data-efficient and can easily generalize to other liquids and bottles. Our work posed a physically-inspired understanding of the correlation between dynamic tactile signals and the dynamic performance of the liquid. Our approach creates a good balance between simplicity, accuracy, and generality. It will help robots to better perceive liquids in different environments such as kitchens, food factories, and pharmaceutical factories.

cs.RO↗

arXiv2020

Size Dependence of Lattice Parameter and Electronic Structure in CeO 2 Nanoparticles

Intrinsic properties of a compound (e.g., electronic structure, crystallographic structure, optical and magnetic properties) define notably its chemical and physical behavior. In the case of nanomaterials, these fundamental properties depend on the occurrence of quantum mechanical size effects and on the considerable increase of the surface to bulk ratio. Here, we explore the size dependence of both crystal and electronic properties of CeO2 nanoparticles (NPs) with different sizes by state-of-the art spectroscopic techniques. X-ray diffraction, X-ray photoelectron spectroscopy, and high-energy resolution fluorescence-detection hard X-ray absorption near-edge structure (HERFD-XANES) spectroscopy demonstrate that the as-synthesized NPs crystallize in the fluorite structure and they are predominantly composed of CeIV ions. The strong dependence of the lattice parameter with the NPs size was attributed to the presence of adsorbed species at the NPs surface thanks to Fourier transform infrared spectroscopy and thermogravimetric analysis measurements. In addition, the size dependence of the t2g states in the Ce LIII XANES spectra was experimentally observed by HERFD-XANES and confirmed by theoretical calculations.

physics.chem-ph↗

arXiv2020

Acoustic streaming generated by sharp edges: the coupled influences of liquid viscosity and acoustic frequency

Acoustic streaming can be generated around sharp structures, even when the acoustic wavelength is much larger than the vessel size. This sharp-edge streaming can be relatively intense, \textcolor{blue}{owing to the strongly focused inertial effect experienced by the acoustic flow near the tip.} We conducted experiments with Particle Image Velocimetry to quantify this streaming flow through the influence of liquid viscosity $ν$, from 1 mm$^2$/s to 30 mm$^2$/s, and acoustic frequency $f$ from 500 Hz to 3500 Hz. Both quantities supposedly influence the thickness of the viscous boundary layer $δ= \left(\fracν{πf}\right)^{1/2}$. For all situations, the streaming flow appears as a main central jet from the tip, generating two lateral vortices beside the tip and outside the boundary layer. As a characteristic streaming velocity, the maximal velocity is located at a distance of $δ$ from the tip, and it increases as the square of the acoustic velocity. We then provide empirical scaling laws to quantify the influence of $ν$ and $f$ on the streaming velocity. Globally, the streaming velocity is dramatically weakened by a higher viscosity, whereas the flow pattern and the disturbance distance remain similar regardless of viscosity. Besides viscosity, the frequency also strongly influences the maximal streaming velocity.

physics.flu-dyn↗

arXiv2020

Unveiling of the mechanisms of acoustic streaming induced by sharp edges

Acoustic waves can generate steady streaming within a fluid owing to the generation of viscous boundary layers near walls, of typical thickness $δ$. In microchannels, the acoustic wavelength $λ$ is adjusted to twice the channel width $w$ to ensure a resonance condition, which implies the use of MHz transducers. Recently though, intense acoustic streaming was generated by acoustic waves of a few kHz (hence with $λ\gg w$), owing to the presence of sharp-tipped structures of curvature radius at the tip $r_c$ smaller than $δ$. The present study quantitatively investigates this sharp-edge acoustic streaming via the direct resolution of the full Navier-Stokes equation, using Finite Element Method. The influence of $δ$, $r_c$ and viscosity $ν$ on the acoustic streaming performance are quantified. Our results suggest choices of operating conditions and geometrical parameters, via dimensionless quantities $r_c/δ$ and $δ/w$ and provide guidelines on how to obtain strong, optimal sharp-edge acoustic streaming.

physics.flu-dyn↗

arXiv2018

Defect-Fluorite Gd2Zr2O7 Ceramics under Helium Irradiation: Amorphization, Cell Volume Expansion, and Multi-stage Bubble Formation

Here, we report a study on the radiation resistance enhancement of Gd2Zr2O7 nanograin ceramics, in which amorphization, cell volume expansion and multi-stage helium (He) bubble formation are investigated and discussed. Gd2Zr2O7 ceramics with a series of grain sizes (55-221 nm) were synthesized and irradiated by 190 keV He ion beam up to a fluence of 5x10^17 ions/cm2. Both the degree of post irradiation cell volume expansion and the amorphization fraction appear to be size dependent. As the average grain size evolves from 55 to 221 nm, the degree of post irradiation cell volume expansion increases from 0.56 to 1.02 %, and the amorphization fraction increases from 6.8 to 11.1 %. Additionally, the threshold He concentrations (at. %) of bubbles at different formation stages and locations, including (1) bubbles at grain boundary, (2) bubble-chains and (3) ribbon-like bubbles within the grain, are all found to be much higher in the nanograin ceramic (55 nm) compared with that of the submicron sample (221 nm). We conclude that grain boundary plays a critical role in minimizing the structural defects, and inhibiting the multi-stage He bubble formation process.

cond-mat.mtrl-sci↗

arXiv2018

Urban water networks as an alternative source for district heating and emergency heat-wave cooling

Urban water networks can contribute to the energy transition of cities by serving as alternatives sources for heating and cooling. Indeed, the thermal energy potential of the urban water cycle is considerable. Paris is taken as an example to present an assessment of the field performance of a district-scale waste water heat recovery system and to explore potential techniques for emergency cold recovery from drinking or non-potable water networks in response to heat-waves. The case heat recovery system was found to provide significant greenhouse gas emission reductions (up to 75%) and limited primary energy savings (around 30%). These limited savings are found to be mainly due to the performance of the heat pump system. Three emergency cold recovery techniques are presented as a response to heat-waves: subway station cooling, ice production for individual cooling, and "heat-wave shelter" cooling in association with pavement-watering. The cold generation potential of each approach is assessed with a special consideration for mains water temperature sanitary limitations. Finally, technical obstacles and perspectives are discussed.

physics.app-ph↗

arXiv2016

Enhanced Structural Stability and Photo Responsiveness of CH3NH3SnI3 Perovskite via Pressure-Induced Amorphization and Recrystallization

An organic-inorganic halide perovskite of CH3NH3SnI3 with significantly improved structural stability is obtained via pressure-induced amorphization and recrystallization. In situ high-pressure resistance measurements reveal an increased electrical conductivity by 300% in the pressure-treated perovskite. Photocurrent measurements also reveal a substantial enhancement in visible-light responsiveness. The mechanism underlying the enhanced properties is demonstrated to be associated with the improved structural stability.

cond-mat.mtrl-sci↗

arXiv2007

Multiple scattering and energy loss in semi-inclusive deeply inelastic eA scattering

We calculate the multiple scattering effect on single hadron production in semi-inclusive lepton-nucleus deeply inelastic scattering. We show that the quantum interference of multiple scattering amplitudes leads to suppression in hadron productions. At the leading power in medium length, the suppression can be approximately expressed in terms of a shift in $z$ of the fragmentation function $D(z)$, and could be therefore interpreted as the collisional energy loss. We compare our calculation with existing experimental data. We also discuss the effect of quark mass on the suppression. Our approach can be extended to other observables in hadronic collisions.

hep-ph↗

arXiv2006

Coherent multiple scattering effect in DIS

We present a QCD calculation of the coherent multiple scattering effect on single hadron production in semi-inclusive lepton-nucleus deep inelastic scattering (DIS). We show that the destructive interference of coherent multiple scattering leads to suppression in hadron productions. The suppression is similar to the expectations of energy loss calculations. We compare our calculation with experimental data.

hep-ph↗

arXiv2001

Multiple Parton Scattering in Nuclei: Parton Energy Loss

Multiple parton scattering and induced parton energy loss is studied in deeply inelastic scattering (DIS) off nuclei. The effect of multiple scattering of a highly off-shell quark and the induced parton energy loss is expressed in terms of the modification to the quark fragmentation functions. We derive such modified quark fragmentation functions and their QCD evolution equations in DIS using generalized factorization of higher twist parton distributions. We consider double-hard, hard-soft parton scattering as well as their interferences in the same framework. The final result, which depends on both the diagonal and off-diagonal twist-four parton distributions in nuclei, demonstrates clearly the Landau-Pomeranchuk-Migdal interference features and predicts a unique nuclear modification of the quark fragmentation functions.

hep-ph↗