arXiv ScienceSearch

arXiv subjects

Simin Liu

Publications and source records attributed to Simin Liu.

16 recordsLinked to original sources

A criterion on weak type $(1,1)$ bound of rough singular integrals

In this paper we establish a criterion on weak type $(1,\,1)$ bound of the following rough singular integral $$T_{\Omega,K,a}f(x)={\rm p.v.}\int_{\mathbb{R}^n}\Omega(x-y)K(x,y)m_{x,y}a f(y)dy,$$ where $m_{x,y}a=\int_0^1a(sx+(1-s)y)ds$ with $a\in L^1(\mathbb{R}^n)$ and $\hat{a}\in L^1(\mathbb{R}^n)$, $\Omega$ is homogeneous of degree zero, integrable in $\mathbb{S}^{n-1}$ and satisfies the cancellation condition $\int_{\mathbb{S}^{n-1}}\Omega(\theta)d\sigma(\theta)=0$ and $K$ is a measurable function defined on $\mathbb{R}^n\times\mathbb{R}^n\setminus \{(x,x):x\in\mathbb{R}^n\}$ and satisfies a H\"{o}lder condition. By assuming that $\Omega\in L\log L(\mathbb{S}^{n-1})$ and the operator $T_{\Omega, K}f(x)={\rm p.v.}\int_{\mathbb{R}^n}\Omega(x-y)K(x,y)f(y)dy$ is bounded on $L^2(\mathbb{R}^n)$, we prove the weak type (1,1) bound of $T_{\Omega,K,a}$. As several applications, we obtain a large class of singular integral operators which possess weak type $(1,\,1)$ bound. The main results of this paper essentially extend and generalize some known ones.

math.CA

Low cost, easily manufactured, highly flexible strain and touch sensitive fiber for robotics applications

Existing stretch and touch sensors for robots are generally expensive with respect to at least one of material costs, required manufacturing equipment, or manufacturing time. We present and experimentally characterize a conductive fiber made using only inexpensive commercial off-the-shelf parts (conductive thread at $0.07/ft, silicone tubing at $0.94/ft) and tools (loop-style needle threader at $2), which can be manufactured quickly (20 cm length in 2 minutes.) We demonstrate its use as a resistive strain sensor with three applications: Triggering a grasp in a pneumatically actuated assistive finger, sensing the pose of a pneumatically actuated robotic strap, and estimating the pose of a flexible solid. We also demonstrate that it can be used as a capacitive sensor with two applications: First, as a touch sensor which triggers a commercial robot arm to move, and second, as a near-field sensor enabling the robot arm to follow a moving hand. The capacitive sensors are knitted, showcasing the high flexibility of the fiber. We discuss methods for improving manufacturing scalability and their cost trade-offs. Finally, we demonstrate a method for repairing a cut fiber.

cs.RO

The Scaling Laws of Skills in LLM Agent Systems

As agent systems scale, skills accumulate into large reusable libraries, yet their scaling laws remain poorly understood. Across 15 frontier LLMs, 1,141 real-world skills, and over 3M routing or execution decisions, we identify two coupled laws. Routing law: single-step routing accuracy decays logarithmically with library size ($R^2{>}0.97$ for all models), with errors progressing from local skill competition to cross-family drift and capture by overly general "black-hole skills". Execution law: before state realization, joint routing is approximately multiplicative, whereas correct execution can improve difficult downstream decisions by about $4{\times}$. A single parameter, the routing logarithmic decay slope $b$, couples the two laws: routing-side fits predict execution-side rescue across models, showing that the same library property controls both pre-execution collapse and downstream recoverability. The laws are actionable: law-guided optimization raises held-out routing accuracy from 71.3% to 91.7%, reduces hijack from 22.4% to 4.1%, and transfers directionally to downstream ClawBench and ClawMark execution settings, improving mean pass rate from 49.3% to 61.6% on ClawBench and from 28.4% to 34.5% on ClawMark. These results show that agent performance depends not only on model capability, but also on the structure, granularity, and exposure policy of the skill library.

cs.CL

Approximately Optimal Global Planning for Contact-Rich SE(2) Manipulation on a Graph of Reachable Sets

If we consider human manipulation, it is clear that contact-rich manipulation (CRM)-the ability to use any surface of the manipulator to make contact with objects-can be far more efficient and natural than relying solely on end-effectors (i.e., fingertips). However, state-of-the-art model-based planners for CRM are still focused on feasibility rather than optimality, limiting their ability to fully exploit CRM's advantages. We introduce a new paradigm that computes approximately optimal manipulator plans. This approach has two phases. Offline, we construct a graph of mutual reachable sets, where each set contains all object orientations reachable from a starting object orientation and grasp. Online, we plan over this graph, effectively computing and sequencing local plans for globally optimized motion. On a challenging, representative contact-rich task, our approach outperforms a leading planner, reducing task cost by 61%. It also achieves a 91% success rate across 250 queries and maintains sub-minute query times, ultimately demonstrating that globally optimized contact-rich manipulation is now practical for real-world tasks.

cs.RO

Neural Spatial-Temporal Tensor Representation for Infrared Small Target Detection

Optimization-based approaches dominate infrared small target detection as they leverage infrared imagery's intrinsic low-rankness and sparsity. While effective for single-frame images, they struggle with dynamic changes in multi-frame scenarios as traditional spatial-temporal representations often fail to adapt. To address these challenges, we introduce a Neural-represented Spatial-Temporal Tensor (NeurSTT) model. This framework employs nonlinear networks to enhance spatial-temporal feature correlations in background approximation, thereby supporting target detection in an unsupervised manner. Specifically, we employ neural layers to approximate sequential backgrounds within a low-rank informed deep scheme. A neural three-dimensional total variation is developed to refine background smoothness while reducing static target-like clusters in sequences. Traditional sparsity constraints are incorporated into the loss functions to preserve potential targets. By replacing complex solvers with a deep updating strategy, NeurSTT simplifies the optimization process in a domain-awareness way. Visual and numerical results across various datasets demonstrate that our method outperforms detection challenges. Notably, it has 16.6$\times$ fewer parameters and averaged 19.19\% higher in $IoU$ compared to the suboptimal method on $256 \times 256$ sequences.

cs.CV

Certifying Robustness of Learning-Based Keypoint Detection and Pose Estimation Methods

This work addresses the certification of the local robustness of vision-based two-stage 6D object pose estimation. The two-stage method for object pose estimation achieves superior accuracy by first employing deep neural network-driven keypoint regression and then applying a Perspective-n-Point (PnP) technique. Despite advancements, the certification of these methods' robustness remains scarce. This research aims to fill this gap with a focus on their local robustness on the system level--the capacity to maintain robust estimations amidst semantic input perturbations. The core idea is to transform the certification of local robustness into neural network verification for classification tasks. The challenge is to develop model, input, and output specifications that align with off-the-shelf verification tools. To facilitate verification, we modify the keypoint detection model by substituting nonlinear operations with those more amenable to the verification processes. Instead of injecting random noise into images, as is common, we employ a convex hull representation of images as input specifications to more accurately depict semantic perturbations. Furthermore, by conducting a sensitivity analysis, we propagate the robustness criteria from pose to keypoint accuracy, and then formulating an optimal error threshold allocation problem that allows for the setting of a maximally permissible keypoint deviation thresholds. Viewing each pixel as an individual class, these thresholds result in linear, classification-akin output specifications. Under certain conditions, we demonstrate that the main components of our certification framework are both sound and complete, and validate its effects through extensive evaluations on realistic perturbations. To our knowledge, this is the first study to certify the robustness of large-scale, keypoint-based pose estimation given images in real-world scenarios.

cs.CV

Research on Information Extraction of LCSTS Dataset Based on an Improved BERTSum-LSTM Model

With the continuous advancement of artificial intelligence, natural language processing technology has become widely utilized in various fields. At the same time, there are many challenges in creating Chinese news summaries. First of all, the semantics of Chinese news is complex, and the amount of information is enormous. Extracting critical information from Chinese news presents a significant challenge. Second, the news summary should be concise and clear, focusing on the main content and avoiding redundancy. In addition, the particularity of the Chinese language, such as polysemy, word segmentation, etc., makes it challenging to generate Chinese news summaries. Based on the above, this paper studies the information extraction method of the LCSTS dataset based on an improved BERTSum-LSTM model. We improve the BERTSum-LSTM model to make it perform better in generating Chinese news summaries. The experimental results show that the proposed method has a good effect on creating news summaries, which is of great importance to the construction of news summaries.

cs.CL

Synthesis and verification of robust-adaptive safe controllers

Safe control with guarantees generally requires the system model to be known. It is far more challenging to handle systems with uncertain parameters. In this paper, we propose a generic algorithm that can synthesize and verify safe controllers for systems with constant, unknown parameters. In particular, we use robust-adaptive control barrier functions (raCBFs) to achieve safety. We develop new theories and techniques using sum-of-squares that enable us to pose synthesis and verification as a series of convex optimization problems. In our experiments, we show that our algorithms are general and scalable, applying them to three different polynomial systems of up to moderate size (7D). Our raCBFs are currently the most effective way to guarantee safety for uncertain systems, achieving 100% safety and up to 55% performance improvement over a robust baseline.

eess.SY

Learning the Positions in CountSketch

We consider sketching algorithms which first compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low-rank approximation and regression. In the learning-based sketching paradigm proposed by~\cite{indyk2019learning}, the sketch matrix is found by choosing a random sparse matrix, e.g., CountSketch, and then the values of its non-zero entries are updated by running gradient descent on a training data set. Despite the growing body of work on this paradigm, a noticeable omission is that the locations of the non-zero entries of previous algorithms were fixed, and only their values were learned. In this work, we propose the first learning-based algorithms that also optimize the locations of the non-zero entries. Our first proposed algorithm is based on a greedy algorithm. However, one drawback of the greedy algorithm is its slower training time. We fix this issue and propose approaches for learning a sketching matrix for both low-rank approximation and Hessian approximation for second order optimization. The latter is helpful for a range of constrained optimization problems, such as LASSO and matrix estimation with a nuclear norm constraint. Both approaches achieve good accuracy with a fast running time. Moreover, our experiments suggest that our algorithm can still reduce the error significantly even if we only have a very limited number of training matrices.

cs.LG

Hybrid-space reconstruction with add-on distortion correction for simultaneous multi-slab diffusion MRI

Purpose: This study aims to propose a model-based reconstruction algorithm for simultaneous multi-slab diffusion MRI acquired with blipped-CAIPI gradients (blipped-SMSlab), which can also incorporate distortion correction. Methods: We formulate blipped-SMSlab in a 4D k-space with kz gradients for the intra-slab slice encoding and km (blipped-CAIPI) gradients for the inter-slab encoding. Because kz and km gradients share the same physical axis, the blipped-CAIPI gradients introduce phase interference in the z-km domain while motion induces phase variations in the kz-m domain. Thus, our previous k-space-based reconstruction would need multiple steps to transform data back and forth between k-space and image space for phase correction. Here we propose a model-based hybrid-space reconstruction algorithm to correct the phase errors simultaneously. Moreover, the proposed algorithm is combined with distortion correction, and jointly reconstructs data acquired with the blip-up/down acquisition to reduce the g-factor penalty. Results: The blipped-CAIPI-induced phase interference is corrected by the hybrid-space reconstruction. Blipped-CAIPI can reduce the g-factor penalty compared to the non-blipped acquisition in the basic reconstruction. Additionally, the joint reconstruction simultaneously corrects the image distortions and improves the 1/g-factors by around 50%. Furthermore, through the joint reconstruction, SMSlab acquisitions without the blipped-CAIPI gradients also show comparable correction performance with blipped-SMSlab. Conclusion: The proposed model-based hybrid-space reconstruction can reconstruct blipped-SMSlab diffusion MRI successfully. Its extension to a joint reconstruction of the blip-up/down acquisition can correct EPI distortions and further reduce the g-factor penalty compared with the separate reconstruction.

physics.med-ph

3D Diffusion MRI Using Simultaneous Multi-slab with Blipped-CAIPI (Blipped-SMSlab) in a 4D K-space Framework

Purpose: To develop an efficient simultaneous multi-slab imaging method with blipped-controlled aliasing in parallel imaging (blipped-SMSlab) in a 4D k-space framework, and demonstrate its efficacy in high-resolution diffusion MRI (dMRI). Theory and Methods: First, the SMSlab 4D k-space signal expression is formulated, and the phase interferences from intra-slab and inter-slab encodings on the same physical z axis are analyzed. Then, the blipped-SMSlab dMRI sequence is designed, with blipped-CAIPI gradients for inter-slab encoding, and a 2D multi-band accelerated navigator for inter-kz-shot phase correction. Third, strategies are developed to remove the phase interferences, by RF phase modulation and/or phase correction during reconstruction, thus decoupling intra-slab and inter-slab encodings that are otherwise entangled. In vivo experiments are performed to validate the blipped-SMSlab method, and preliminarily evaluate its performance in high-resolution dMRI compared with traditional 2D imaging. Results: In the 4D k-space framework, inter-slab and intra-slab phase interferences of blipped-SMSlab are successfully removed using the proposed strategies. Compared with non-CAIPI sampling, the blipped-SMSlab acquisition reduces the g-factor and g-factor-related SNR penalty by about 12%. In addition, in vivo experiments show the SNR advantage of blipped-SMSlab dMRI over traditional 2D dMRI for 1.3 and 1.0 mm isotropic resolution imaging with matched acquisition time. Conclusion: Removing inter-slab and intra-slab phase interferences enables SMSlab dMRI with blipped-CAIPI in a 4D k-space framework. The proposed blipped-SMSlab dMRI is demonstrated to be more SNR-efficient than 2D dMRI and thus capable of high-quality, high-resolution fiber orientation detection.

physics.med-ph

Safe Control Under Input Limits with Neural Control Barrier Functions

We propose new methods to synthesize control barrier function (CBF)-based safe controllers that avoid input saturation, which can cause safety violations. In particular, our method is created for high-dimensional, general nonlinear systems, for which such tools are scarce. We leverage techniques from machine learning, like neural networks and deep learning, to simplify this challenging problem in nonlinear control design. The method consists of a learner-critic architecture, in which the critic gives counterexamples of input saturation and the learner optimizes a neural CBF to eliminate those counterexamples. We provide empirical results on a 10D state, 4D input quadcopter-pendulum system. Our learned CBF avoids input saturation and maintains safety over nearly 100% of trials.

cs.RO

Safety Index Synthesis via Sum-of-Squares Programming

Control systems often need to satisfy strict safety requirements. Safety index provides a handy way to evaluate the safety level of the system and derive the resulting safe control policies. However, designing safety index functions under control limits is difficult and requires a great amount of expert knowledge. This paper proposes a framework for synthesizing the safety index for general control systems using sum-of-squares programming. Our approach is to show that ensuring the non-emptiness of safe control on the safe set boundary is equivalent to a local manifold positiveness problem. We then prove that this problem is equivalent to sum-of-squares programming via the Positivstellensatz of algebraic geometry. We validate the proposed method on robot arms with different degrees of freedom and ground vehicles. The results show that the synthesized safety index guarantees safety and our method is effective even in high-dimensional robot systems.

cs.RO

Overview of FPGA deep learning acceleration based on convolutional neural network

In recent years, deep learning has become more and more mature, and as a commonly used algorithm in deep learning, convolutional neural networks have been widely used in various visual tasks. In the past, research based on deep learning algorithms mainly relied on hardware such as GPUs and CPUs. However, with the increasing development of FPGAs, both field programmable logic gate arrays, it has become the main implementation hardware platform that combines various neural network deep learning algorithms This article is a review article, which mainly introduces the related theories and algorithms of convolution. It summarizes the application scenarios of several existing FPGA technologies based on convolutional neural networks, and mainly introduces the application of accelerators. At the same time, it summarizes some accelerators' under-utilization of logic resources or under-utilization of memory bandwidth, so that they can't get the best performance.

cs.AI

Learning the Positions in CountSketch

We consider sketching algorithms which first quickly compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low rank approximation. In the learning-based sketching paradigm proposed by Indyk et al. [2019], the sketch matrix is found by choosing a random sparse matrix, e.g., the CountSketch, and then updating the values of the non-zero entries by running gradient descent on a training data set. Despite the growing body of work on this paradigm, a noticeable omission is that the locations of the non-zero entries of previous algorithms were fixed, and only their values were learned. In this work we propose the first learning algorithm that also optimizes the locations of the non-zero entries. We show this algorithm gives better accuracy for low rank approximation than previous work, and apply it to other problems such as $k$-means clustering for the first time. We show that our algorithm is provably better in the spiked covariance model and for Zipfian matrices. We also show the importance of the sketch monotonicity property for combining learned sketches. Our empirical results show the importance of optimizing not only the values of the non-zero entries but also their positions.

cs.LG

Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learning

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause proficient but specialized policies to fail at test time. Given that it is impractical to train separate policies to accommodate all situations the agent may see in the real world, this work proposes to learn how to quickly and effectively adapt online to new tasks. To enable sample-efficient learning, we consider learning online adaptation in the context of model-based reinforcement learning. Our approach uses meta-learning to train a dynamics model prior such that, when combined with recent data, this prior can be rapidly adapted to the local context. Our experiments demonstrate online adaptation for continuous control tasks on both simulated and real-world agents. We first show simulated agents adapting their behavior online to novel terrains, crippled body parts, and highly-dynamic environments. We also illustrate the importance of incorporating online adaptation into autonomous agents that operate in the real world by applying our method to a real dynamic legged millirobot. We demonstrate the agent's learned ability to quickly adapt online to a missing leg, adjust to novel terrains and slopes, account for miscalibration or errors in pose estimation, and compensate for pulling payloads.

cs.LG