arXiv Science⌕ Search

arXiv subjects

Yiting Chen

Publications and source records attributed to Yiting Chen.

50 records · Page 3Linked to original sources
arXiv2022

Robot Cooking with Stir-fry: Bimanual Non-prehensile Manipulation of Semi-fluid Objects

This letter describes an approach to achieve well-known Chinese cooking art stir-fry on a bimanual robot system. Stir-fry requires a sequence of highly dynamic coordinated movements, which is usually difficult to learn for a chef, let alone transfer to robots. In this letter, we define a canonical stir-fry movement, and then propose a decoupled framework for learning this deformable object manipulation from human demonstration. First, the dual arms of the robot are decoupled into different roles (a leader and follower) and learned with classical and neural network-based methods separately, then the bimanual task is transformed into a coordination problem. To obtain general bimanual coordination, we secondly propose a Graph and Transformer based model -- Structured-Transformer, to capture the spatio-temporal relationship between dual-arm movements. Finally, by adding visual feedback of content deformation, our framework can adjust the movements automatically to achieve the desired stir-fry effect. We verify the framework by a simulator and deploy it on a real bimanual Panda robot system. The experimental results validate our framework can realize the bimanual robot stir-fry motion and have the potential to extend to other deformable objects with bimanual coordination.

cs.RO↗
arXiv2021

A Unified Game-Theoretic Interpretation of Adversarial Robustness

This paper provides a unified view to explain different adversarial attacks and defense methods, i.e. the view of multi-order interactions between input variables of DNNs. Based on the multi-order interaction, we discover that adversarial attacks mainly affect high-order interactions to fool the DNN. Furthermore, we find that the robustness of adversarially trained DNNs comes from category-specific low-order interactions. Our findings provide a potential method to unify adversarial perturbations and robustness, which can explain the existing defense methods in a principle way. Besides, our findings also make a revision of previous inaccurate understanding of the shape bias of adversarially learned features.

cs.LG↗
arXiv2021

A Unified Game-Theoretic Interpretation of Adversarial Robustness

This paper provides a unified view to explain different adversarial attacks and defense methods, \emph{i.e.} the view of multi-order interactions between input variables of DNNs. Based on the multi-order interaction, we discover that adversarial attacks mainly affect high-order interactions to fool the DNN. Furthermore, we find that the robustness of adversarially trained DNNs comes from category-specific low-order interactions. Our findings provide a potential method to unify adversarial perturbations and robustness, which can explain the existing defense methods in a principle way. Besides, our findings also make a revision of previous inaccurate understanding of the shape bias of adversarially learned features.

cs.LG↗
arXiv2021

Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorations

Medical ultrasound has become a routine examination approach nowadays and is widely adopted for different medical applications, so it is desired to have a robotic ultrasound system to perform the ultrasound scanning autonomously. However, the ultrasound scanning skill is considerably complex, which highly depends on the experience of the ultrasound physician. In this paper, we propose a learning-based approach to learn the robotic ultrasound scanning skills from human demonstrations. First, the robotic ultrasound scanning skill is encapsulated into a high-dimensional multi-modal model, which takes the ultrasound images, the pose/position of the probe and the contact force into account. Second, we leverage the power of imitation learning to train the multi-modal model with the training data collected from the demonstrations of experienced ultrasound physicians. Finally, a post-optimization procedure with guided explorations is proposed to further improve the performance of the learned model. Robotic experiments are conducted to validate the advantages of our proposed framework and the learned models.

cs.RO↗
arXiv2021

Learning Friction Model for Tethered Capsule Robot

With the potential applications of capsule robots in medical endoscopy, accurate dynamic control of the capsule robot is becoming more and more important. In the scale of a capsule robot, the friction between capsule and the environment plays an essential role in the dynamic model, which is usually difficult to model beforehand. In the paper, a tethered capsule robot system driven by a robot manipulator is built, where a strong magnetic Halbach array is mounted on the robot's end-effector to adjust the state of the capsule. To increase the control accuracy, the friction between capsule and the environment is learned with demonstrated trajectories. With the learned friction model, experimental results demonstrate an improvement of 5.6% in terms of tracking error.

cs.RO↗
arXiv2021

Data Generation for Learning to Grasp in a Bin-picking Scenario

The rise of deep learning has greatly transformed the pipeline of robotic grasping from model-based approach to data-driven stream. Along this line, a large scale of grasping data either collected from simulation or from real world examples become extremely important. In this paper, we present our recent work on data generation in simulation for a bin-picking scene. 77 objects from the YCB object data sets are used to generate the dataset with PyBullet, where different environment conditions are taken into account including lighting, camera pose, sensor noise and so on. In all, 100K data samples are collected in terms of ground truth segmentation, RGB, 6D pose and point cloud. All the data examples including the source code are made available online.

cs.RO↗
arXiv2021

Unknown Object Segmentation through Domain Adaptation

The ability to segment unknown objects in cluttered scenes has a profound impact on robot grasping. The rise of deep learning has greatly transformed the pipeline of robotic grasping from model-based approach to data-driven stream, which generally requires a large scale of grasping data either collected in simulation or from real-world examples. In this paper, we proposed a sim-to-real framework to transfer the object segmentation model learned in simulation to the real-world. First, data samples are collected in simulation, including RGB, 6D pose, and point cloud. Second, we also present a GAN-based unknown object segmentation method through domain adaptation, which consists of an image translation module and an image segmentation module. The image translation module is used to shorten the reality gap and the segmentation module is responsible for the segmentation mask generation. We used the above method to perform segmentation experiments on unknown objects in a bin-picking scenario. Finally, the experimental result shows that the segmentation model learned in simulation can be used for real-world data segmentation.

cs.RO↗
arXiv2020

Deep Quaternion Features for Privacy Protection

We propose a method to revise the neural network to construct the quaternion-valued neural network (QNN), in order to prevent intermediate-layer features from leaking input information. The QNN uses quaternion-valued features, where each element is a quaternion. The QNN hides input information into a random phase of quaternion-valued features. Even if attackers have obtained network parameters and intermediate-layer features, they cannot extract input information without knowing the target phase. In this way, the QNN can effectively protect the input privacy. Besides, the output accuracy of QNNs only degrades mildly compared to traditional neural networks, and the computational cost is much less than other privacy-preserving methods.

cs.LG↗
arXiv2020

Rotation-Equivariant Neural Networks for Privacy Protection

In order to prevent leaking input information from intermediate-layer features, this paper proposes a method to revise the traditional neural network into the rotation-equivariant neural network (RENN). Compared to the traditional neural network, the RENN uses d-ary vectors/tensors as features, in which each element is a d-ary number. These d-ary features can be rotated (analogous to the rotation of a d-dimensional vector) with a random angle as the encryption process. Input information is hidden in this target phase of d-ary features for attribute obfuscation. Even if attackers have obtained network parameters and intermediate-layer features, they cannot extract input information without knowing the target phase. Hence, the input privacy can be effectively protected by the RENN. Besides, the output accuracy of RENNs only degrades mildly compared to traditional neural networks, and the computational cost is significantly less than the homomorphic encryption.

cs.LG↗
arXiv2019

Multifunctional Metamirrors Involving Simultaneous Linear-polarization Conversion and Focusing

Reducing a set of diverse bulk-optic-based optical components to a single ultrathin and compact element that enables the same complex functionality has become an emerging research area, propelling further integration and miniaturization in photonics. In this work, we establish a versatile metasurface platform based on gap-surface plasmon meta-atoms enabling efficient linear-polarization conversion along with the complete phase control over reflected fields. Capitalizing on the meta-atom design, multifunctional metamirrors involving linear-polarization conversion and focusing are experimentally demonstrated to generate various kinds of focused beams with distinct phase distributions and wavefronts, reproducing thereby the combined functionalities of conventional half-wave plates, lenses, and even spatial light modulators. The proof-of-concept fabricated metamirrors exhibit excellent capability of linear-polarization conversion and focusing within the wavelength range from 800 to 950 nm under linearly-polarized excitation. The multifunctional metamirrors design developed in this study opens new avenues in the advanced research and applications targeting photonics integration of diversified functionalities.

physics.optics↗
arXiv2018

Laser writing of bright colours on near-percolation plasmonic reflector arrays

Colouration by surface nanostructuring has attracted a great deal of attention by the virtue of making use of environment-friendly recyclable materials and generating non-bleaching colours [1-8]. Recently, it was found possible to delegate the task of colour printing to laser post-processing that modifies carefully designed and fabricated nanostructures [9,10]. Here we take the next crucial step in the development of structural colour printing by dispensing with preformed nanostructures and using instead near-percolation metal films atop dielectric-metal sandwiches, i.e., near-percolation plasmonic reflector arrays. Scanning rapidly (~ 20 μm/s) across 4-nm-thin island-like gold films supported by 30-nm-thin silica layers atop 100-nm-thick gold layers with a strongly focused Ti-sapphire laser beam, while adjusting the average laser power from 1 to 10 mW, we produce bright colours varying from green to red by laser-heating-induced merging and reshaping of gold islands. Selection of strongly heated islands and their reshaping, both originating from the excitation of plasmonic resonances, are strongly influenced by the polarization direction of laser illumination, so that the colours produced are well pronounced only when viewed with the same polarization. Conversely, the laser colour writing with circular polarizations results in bright polarization-independent colour images. The fabrication procedure for near-percolation reflector arrays is exceedingly simple and scalable to mass production, while the laser-induced modification occurs inherently with the subwavelength resolution. This unique combination of remarkable features makes the approach developed for laser colour writing readily amenable for practical implementation and use in diverse applications ranging from nanoscale patterning for security marking to large-scale colour printing for decoration.

physics.app-ph↗
arXiv2017

On-chip spectropolarimetry by fingerprinting with random surface arrays of nanoparticles

Optical metasurfaces revolutionized the approach to moulding the propagation of light by enabling simultaneous control of the light phase, momentum, amplitude and polarization. Thus, instantaneous spectropolarimetry became possible by conducting parallel intensity measurements of differently diffracted optical beams. Various implementations of this very important functionality have one feature in common - the determination of wavelength utilizes dispersion of the diffraction angle, requiring tracking the diffracted beams in space. Realization of on-chip spectropolarimetry calls thereby for conceptually different approaches. In this work, we demonstrate that random nanoparticle arrays on metal surfaces, enabling strong multiple scattering of surface plasmon polaritons (SPPs), produce upon illumination complicated SPP scattered patterns, whose angular spectra are uniquely determined by the polarization and wavelength of light, representing thereby spectropolarimetric fingerprints. Using um-sized circular arrays of randomly distributed μm-sized gold nanoparticles (density ~ 75 μm$^-$$^2$}) fabricated on gold films, we measure angular distributions of scattered SPP waves using the leakage radiation microscopy and find that the angular SPP spectra obtained for normally incident light beams different in wavelength and/or polarization are distinctly different. Our approach allows one to realize on-chip spectropolarimetry by fingerprinting using surface nanostructures fabricated with simple one-step electron-beam lithography.

physics.optics↗
arXiv2017

Beam-Size Invariant Spectropolarimeters Using Gap-Plasmon Metasurfaces

Metasurfaces enable exceptional control over the light with surface-confined planar components, offering the fascinating possibility of very dense integration and miniaturization in photonics. Here, we design, fabricate and experimentally demonstrate chip-size plasmonic spectropolarimeters for simultaneous polarization state and wavelength determination. Spectropolarimeters, consisting of three gap-plasmon phase-gradient metasurfaces that occupy 120° circular sectors each, diffract normally incident light to six predesigned directions, whose azimuthal angles are proportional to the light wavelength, while contrasts in the corresponding diffraction intensities provide a direct measure of the incident polarization state through retrieval of the associated Stokes parameters. The proof-of-concept 96-μm-diameter spectropolarimeter operating in the wavelength range of 750-950nm exhibits the expected polarization selectivity and high angular dispersion. Moreover, we show that, due to the circular-sector design, polarization analysis can be conducted for optical beams of different diameters without prior calibration, demonstrating thereby the beam-size invariant functionality. The proposed spectropolarimeters are compact, cost-effective, robust, and promise high-performance real-time polarization and spectral measurements.

physics.optics↗