arXiv subjects

Qi Wang

Publications and source records attributed to Qi Wang.

At least 415 records · Page 23Linked to original sources

arXiv2024

ScreenAgent: A Vision Language Model-driven Computer Control Agent

Existing Large Language Models (LLM) can invoke a variety of tools and APIs to complete complex tasks. The computer, as the most powerful and universal tool, could potentially be controlled directly by a trained LLM agent. Powered by the computer, we can hopefully build a more generalized agent to assist humans in various daily digital works. In this paper, we construct an environment for a Vision Language Model (VLM) agent to interact with a real computer screen. Within this environment, the agent can observe screenshots and manipulate the Graphics User Interface (GUI) by outputting mouse and keyboard actions. We also design an automated control pipeline that includes planning, acting, and reflecting phases, guiding the agent to continuously interact with the environment and complete multi-step tasks. Additionally, we construct the ScreenAgent Dataset, which collects screenshots and action sequences when completing a variety of daily computer tasks. Finally, we trained a model, ScreenAgent, which achieved computer control capabilities comparable to GPT-4V and demonstrated more precise UI positioning capabilities. Our attempts could inspire further research on building a generalist LLM agent. The code is available at \url{https://github.com/niuzaisheng/ScreenAgent}.

cs.HC↗

arXiv2024

Optimize Individualized Energy Delivery for Septic Patients Using Predictive Deep Learning Models: A Real World Study

Background and Objectives: We aim to establish deep learning models to optimize the individualized energy delivery for septic patients. Methods and Study Design: We conducted a study of adult septic patients in Intensive Care Unit (ICU), collecting 47 indicators for 14 days. After data cleaning and preprocessing, we used stats to explore energy delivery in deceased and surviving patients. We filtered out nutrition-related features and divided the data into three metabolic phases: acute early, acute late, and rehabilitation. Models were built using data before September 2020 and validated on the rest. We then established optimal energy target models for each phase using deep learning. Results: A total of 277 patients and 3115 data were included in this study. The models indicated that the optimal energy targets in the three phases were 900kcal/d, 2300kcal/d, and 2000kcal/d, respectively. Excessive energy intake increased mortality rapidly in the early period of the acute phase. Insufficient energy in the late period of the acute phase significantly raised the mortality of septic patients. For the rehabilitation phase, too much or too little energy delivery both associated with high mortality. Conclusion: Our study established time-series prediction models for septic patients to optimize energy delivery in the ICU. This approach indicated the feasibility of developing nutritional tools for critically ill patients. We recommended permissive underfeeding only in the early acute phase. Later, increased energy intake may improve survival and settle energy debts caused by underfeeding.

q-bio.OT↗

arXiv2024

Nonlinear erasing of propagating spin-wave pulses in thin-film Ga:YIG

Nonlinear phenomena are key for magnon-based information processing, but the nonlinear interaction between two spin-wave signals requires their spatio-temporal overlap which can be challenging for directional processing devices. Our study focuses on a gallium-substituted yttrium iron garnet film, which exhibits an exchange-dominated dispersion relation and thus provides a particularly broad range of group velocities compared to pure YIG. Using time- and space-resolved Brillouin light scattering spectroscopy, we demonstrate the excitation of time-separated spin-wave pulses at different frequencies from the same source, where the delayed pulse catches up with the previously excited pulse and outruns it due to its higher group velocity. By varying the excitation power of the faster pulse, the outcome can be finely tuned from a linear superposition to a nonlinear interaction of both pulses, resulting in a full attenuation of the slower pulse. Therefore, our findings demonstrate the all-magnonic erasing process of a propagating magnonic signal, which enables the realization of complex temporal logic operations with potential application, e.g., in inhibitory neuromorphic functionalities.

cond-mat.mtrl-sci↗

arXiv2024

Model-Free $δ$-Policy Iteration Based on Damped Newton Method for Nonlinear Continuous-Time H$\infty$ Tracking Control

This paper presents a δ-PI algorithm which is based on damped Newton method for the H{\infty} tracking control problem of unknown continuous-time nonlinear system. A discounted performance function and an augmented system are used to get the tracking Hamilton-Jacobi-Isaac (HJI) equation. Tracking HJI equation is a nonlinear partial differential equation, traditional reinforcement learning methods for solving the tracking HJI equation are mostly based on the Newton method, which usually only satisfies local convergence and needs a good initial guess. Based upon the damped Newton iteration operator equation, a generalized tracking Bellman equation is derived firstly. The δ-PI algorithm can seek the optimal solution of the tracking HJI equation by iteratively solving the generalized tracking Bellman equation. On-policy learning and off-policy learning δ-PI reinforcement learning methods are provided, respectively. Off-policy version δ-PI algorithm is a model-free algorithm which can be performed without making use of a priori knowledge of the system dynamics. NN-based implementation scheme for the off-policy δ-PI algorithms is shown. The suitability of the model-free δ-PI algorithm is illustrated with a nonlinear system simulation.

cs.LG↗

arXiv2024

A Novel Policy Iteration Algorithm for Nonlinear Continuous-Time H$\infty$ Control Problem

H{\infty} control of nonlinear continuous-time system depends on the solution of the Hamilton-Jacobi-Isaacs (HJI) equation, which has been proved impossible to obtain a closed-form solution due to the nonlinearity of HJI equation. In order to solve HJI equation, many iterative algorithms were proposed, and most of the algorithms were essentially Newton method when the fixed-point equation was constructed in a Banach space. Newton method is a local optimization method, it has small convergence region and needs the initial guess to be sufficiently close to the solution. Whereas damped Newton method enhances the robustness with respect to initial condition and has larger convergence region. In this paper, a novel reinforcement learning method which is named α-policy iteration (α-PI) is introduced for solving HJI equation. First, by constructing a damped Newton iteration operator equation, a generalized Bellman equation (GBE) is obtained. The GBE is an extension of bellman equation. And then, by iterating on the GBE, an on-policy α-PI reinforcement learning method without using knowledge regarding to the system internal dynamics is proposed. Third, based on the on-policy α-PI reinforcement learning method, we develop an off-policy α-PI reinforcement learning method without requiring any knowledge of the system dynamics. Finally, the neural-network based adaptive critic implementation schemes of on-policy and off-policy α-PI algorithms are derived respectively, and the batch least-squares method is used for calculating the weight parameters of neural networks. The effectiveness of the off-policy α-PI algorithm is verified through computer simulation.

eess.SY↗

arXiv2024

A Bi-Pyramid Multimodal Fusion Method for the Diagnosis of Bipolar Disorders

Previous research on the diagnosis of Bipolar disorder has mainly focused on resting-state functional magnetic resonance imaging. However, their accuracy can not meet the requirements of clinical diagnosis. Efficient multimodal fusion strategies have great potential for applications in multimodal data and can further improve the performance of medical diagnosis models. In this work, we utilize both sMRI and fMRI data and propose a novel multimodal diagnosis model for bipolar disorder. The proposed Patch Pyramid Feature Extraction Module extracts sMRI features, and the spatio-temporal pyramid structure extracts the fMRI features. Finally, they are fused by a fusion module to output diagnosis results with a classifier. Extensive experiments show that our proposed method outperforms others in balanced accuracy from 0.657 to 0.732 on the OpenfMRI dataset, and achieves the state of the art.

cs.CV↗

arXiv2024

SamLP: A Customized Segment Anything Model for License Plate Detection

With the emergence of foundation model, this novel paradigm of deep learning has encouraged many powerful achievements in natural language processing and computer vision. There are many advantages of foundation model, such as excellent feature extraction power, mighty generalization ability, great few-shot and zero-shot learning capacity, etc. which are beneficial to vision tasks. As the unique identity of vehicle, different countries and regions have diverse license plate (LP) styles and appearances, and even different types of vehicles have different LPs. However, recent deep learning based license plate detectors are mainly trained on specific datasets, and these limited datasets constrain the effectiveness and robustness of LP detectors. To alleviate the negative impact of limited data, an attempt to exploit the advantages of foundation model is implement in this paper. We customize a vision foundation model, i.e. Segment Anything Model (SAM), for LP detection task and propose the first LP detector based on vision foundation model, named SamLP. Specifically, we design a Low-Rank Adaptation (LoRA) fine-tuning strategy to inject extra parameters into SAM and transfer SAM into LP detection task. And then, we further propose a promptable fine-tuning step to provide SamLP with prompatable segmentation capacity. The experiments show that our proposed SamLP achieves promising detection performance compared to other LP detectors. Meanwhile, the proposed SamLP has great few-shot and zero-shot learning ability, which shows the potential of transferring vision foundation model. The code is available at https://github.com/Dinghaoxuan/SamLP

cs.CV↗

arXiv2024

A multimodal gesture recognition dataset for desktop human-computer interaction

Gesture recognition is an indispensable component of natural and efficient human-computer interaction technology, particularly in desktop-level applications, where it can significantly enhance people's productivity. However, the current gesture recognition community lacks a suitable desktop-level (top-view perspective) dataset for lightweight gesture capture devices. In this study, we have established a dataset named GR4DHCI. What distinguishes this dataset is its inherent naturalness, intuitive characteristics, and diversity. Its primary purpose is to serve as a valuable resource for the development of desktop-level portable applications. GR4DHCI comprises over 7,000 gesture samples and a total of 382,447 frames for both Stereo IR and skeletal modalities. We also address the variances in hand positioning during desktop interactions by incorporating 27 different hand positions into the dataset. Building upon the GR4DHCI dataset, we conducted a series of experimental studies, the results of which demonstrate that the fine-grained classification blocks proposed in this paper can enhance the model's recognition accuracy. Our dataset and experimental findings presented in this paper are anticipated to propel advancements in desktop-level gesture recognition research.

cs.CV↗

arXiv2024

Two families of linear codes with desirable properties from some functions over finite fields

Linear codes are widely studied in coding theory as they have nice applications in distributed storage, combinatorics, lattices, cryptography and so on. Constructing linear codes with desirable properties is an interesting research topic. In this paper, based on the augmentation technique, we present two families of linear codes from some functions over finite fields. The first family of linear codes is constructed from monomial functions over finite fields. The locality of them is determined and the weight distributions of two subfamilies of the codes are also given. An infinite family of locally recoverable codes which are at least almost optimal and some optimal recoverable codes are obtained from the linear codes. In particular, the two subfamilies of the codes are proved to be both optimally or almost optimally extendable and self-orthogonal. The second family of linear codes is constructed from weakly regular bent functions over finite fields and their weight distribution is determined. This family of codes is proved to have locality 3 for some cases and is conjectured to have locality 2 for other cases. Particularly, two families of optimal locally recoverable codes are derived from the linear codes. Besides, this family of codes is also proved to be both optimally or almost optimally extendable and self-orthogonal.

cs.IT↗

arXiv2024

Lifetimes of metastable windy states in two-dimensional Rayleigh-Bénard convection with stress-free boundaries

Two-dimensional horizontally periodic Rayleigh-Bénard convection between stress-free boundaries displays two distinct types of states, depending on the initial conditions. Roll states are composed of pairs of counter-rotating convection rolls. Windy states are dominated by strong horizontal wind (also called zonal flow) that is vertically sheared, precludes convection rolls, and suppresses heat transport. Windy states occur only when the Rayleigh number $Ra$ is sufficiently above the onset of convection. At intermediate $Ra$ values, windy states can be induced by suitable initial conditions, but they undergo a transition to roll states after finite lifetimes. At larger $Ra$ values, where windy states have been observed for the full duration of simulations, it is unknown whether they represent chaotic attractors or only metastable states that would eventually undergo a transition to roll states. We study this question using direct numerical simulations of a fluid with a Prandtl number of 10 in a layer whose horizontal period is 8 times its height. At each of seven $Ra$ values between $9\times10^6$ and $2.25\times10^7$ we have carried out 200 or more simulations, all from initial conditions leading to windy convection with finite lifetimes. The lifetime statistics at each $Ra$ indicate a memoryless process with survival probability decreasing exponentially in time. The mean lifetimes grow with $Ra$ approximately as $Ra^4$. This analysis provides no $Ra$ value at which windy convection becomes stable; it might remain metastable at larger $Ra$ with extremely long lifetimes.

physics.flu-dyn↗

arXiv2024

The Mood of the Sunlight: Visualization of the Sunlight Data for Public Art

The application of data visualization in public art attracts increasing attention. In this paper, we present the design and implementation of a visualization method for sunlight data collected over a long period of time with an industrial camera. The proposed method makes use of the saturation and value information of collected sunlight image data in Hue Saturation Value color model to show the variation of the mood of the sunlight. Specifically, we create visual patterns with a rotating planet gear, which has an intuitively consistent geometric meaning with HSV color model and the planetary motion. Due to the variation of the sunlight data over time, the generated visual pattern presents a periodic variation that corresponds to the changing mood of the sunlight. Furthermore, we also use the sunlight data to generate music as another form of data representation. Two public artworks have been created with the above visualization and auralization methods and displayed on an exhibition held at China Resources Tower, Shenzhen, China. This work is a typical practice of creating public installations with data visualization technology, giving a glimpse into the many ways science and art intersect.

cs.HC↗

arXiv2023

Enhancement of superconducting transition temperature and exotic stoichiometries in Lu-S system under high pressure

Binary metal sulfides are potential material family for exploring high Tc superconductors under high pressure. In this work, we study the crystal structures, electronic structures and superconducting properties of the Lu-S system in the pressure range from 0 GPa to 200 GPa, combining crystal structure predictions with ab-initio calculations. We predict 14 new structures, encompassing 7 unidentified stoichiometries. Within the S-rich structures, the formation of S atom cages is beneficial for superconductivity, with the superconducting transition temperature 25.86 K and 25.30 K for LuS6-C2/m at 70 GPa and LuS6-R-3m at 90 GPa, respectively. With the Lu/(Lu+S) ratio increases, the Lu-d electrons participate more in the electronic properties at the Fermi energy, resulting in the coexistence of superconductivity and topological non-triviality of LuS2-Cmca, as well as the superconductivity of predicted Lu-rich compounds. Our calculation is helpful for understanding the exotic properties in transition metal sulfides system under high pressure, providing possibility in designing novel superconductors for future experimental and theoretical works.

cond-mat.supr-con↗

arXiv2023

Pressure-induced structure phase transitions and superconductivity in dual topological insulator BiTe

The (Bi2)m(Bi2Te3)n homologous series possess natural multilayer heterostructure with intriguing physical properties at ambient pressure. Herein, we report the pressure-dependent evolution of the structure and electrical transport of the dual topological insulator BiTe, a member of the (Bi2)m(Bi2Te3)n series. With applied pressure, BiTe exhibits several different crystal structures and distinct superconducting states, which is remarkably similar to other members of the (Bi2)m(Bi2Te3)n series. Our results provide a systematic phase diagram for the pressure-induced superconductivity in BiTe, contributing to the highly interesting physics in this (Bi2)m(Bi2Te3)n series.

cond-mat.supr-con↗

arXiv2023

Text-Image Conditioned Diffusion for Consistent Text-to-3D Generation

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the NeRF representations, which supervises the NeRF optimization with pre-trained text-conditioned 2D diffusion models such as Imagen. However, the supervision signal provided by such pre-trained diffusion models only depends on text prompts and does not constrain the multi-view consistency. To inject the cross-view consistency into diffusion priors, some recent works finetune the 2D diffusion model with multi-view data, but still lack fine-grained view coherence. To tackle this challenge, we incorporate multi-view image conditions into the supervision signal of NeRF optimization, which explicitly enforces fine-grained view consistency. With such stronger supervision, our proposed text-to-3D method effectively mitigates the generation of floaters (due to excessive densities) and completely empty spaces (due to insufficient densities). Our quantitative evaluations on the T$^3$Bench dataset demonstrate that our method achieves state-of-the-art performance over existing text-to-3D methods. We will make the code publicly available.

cs.CV↗

arXiv2023

Pressure-induced Superconductivity in Tellurium Single Crystal

Tellurium (Te) is one of the p-orbital chalcogens, which shows attractive physical properties at ambient pressure. Here, we systematically investigate both structural and electronic evolution of Te single crystal under high pressure up to 40 GPa. The pressure dependence of the experimental Raman spectrum reveals the occurrence of multiple phase transitions, which is consistent with highpressure synchrotron X-ray diffraction (XRD) measurements. The appearance of superconductivity in high-pressure phase of Te is accompanied by structural phase transitions. The high-pressure phases of Te reveal a nonmonotonic evolution of superconducting temperature Tc with notably different upper critical fields. The theoretical calculations demonstrate that the pressure dependence of the density of states(DOS) agrees well with the variation of Tc. Our results provide a systematic phase diagram for the pressure-induced superconductivity of Te.

cond-mat.supr-con↗

arXiv2023

Superconducting Ternary Hydridies in Ca-U-H under High Pressure

The research on hydrogen-rich ternary compounds attract tremendous attention for it paves new route to room-temperature superconductivity at lower pressures. Here, we study the crystal structures, electronic structures, and superconducting properties of the ternary Ca-U-H system, combining crystal structure predictions with ab-initio calculations under high pressure. We found four dynamically stable structures with hydrogen clathrate cages: CaUH12-Cmmm, CaUH12-Fd-3m, Ca2UH18-P-3m1, and CaU3H32-Pm-3m. Among them, the Ca2UH18-P-3m1 and CaU3H32-Pm-3m are likely to be synthesized below 1 megabar. The f electrons in U atoms make dominant contribution to the electronic density of states around the Fermi energy. The electron-phonon interaction calculations reveal that phonon softening in the mid-frequency region can enhance the electron-phonon coupling significantly. The Tc value of Ca2UH18-P-3m1 is estimated to be 57.5-65.8 K at 100 GPa. Our studies demonstrate that introducing actinides into alkaline-earth metal hydrides provides possibility in designing novel superconducting ternary hydrides.

cond-mat.supr-con↗

arXiv2023

Nanoscaled magnon transistor based on stimulated three-magnon splitting

Magnonics is a rapidly growing field, attracting much attention for its potential applications in data transport and processing. Many individual magnonic devices have been proposed and realized in laboratories. However, an integrated magnonic circuit with several separate magnonic elements has yet not been reported due to the lack of a magnonic amplifier to compensate for transport and processing losses. The magnon transistor reported in [Nat. Commun. 5, 4700, (2014)] could only achieve a gain of 1.8, which is insufficient in many practical cases. Here, we use the stimulated three-magnon splitting phenomenon to numerically propose a concept of magnon transistor in which the energy of the gate magnons at 14.6 GHz is directly pumped into the energy of the source magnons at 4.2 GHz, thus achieving the gain of 9. The structure is based on the 100 nm wide YIG nano-waveguides, a directional coupler is used to mix the source and gate magnons, and a dual-band magnonic crystal is used to filter out the gate and idler magnons at 10.4 GHz frequency. The magnon transistor preserves the phase of the signal and the design allows integration into a magnon circuit.

cond-mat.mes-hall↗

arXiv2023

Traffic Sign Interpretation in Real Road Scene

Most existing traffic sign-related works are dedicated to detecting and recognizing part of traffic signs individually, which fails to analyze the global semantic logic among signs and may convey inaccurate traffic instruction. Following the above issues, we propose a traffic sign interpretation (TSI) task, which aims to interpret global semantic interrelated traffic signs (e.g.,~driving instruction-related texts, symbols, and guide panels) into a natural language for providing accurate instruction support to autonomous or assistant driving. Meanwhile, we design a multi-task learning architecture for TSI, which is responsible for detecting and recognizing various traffic signs and interpreting them into a natural language like a human. Furthermore, the absence of a public TSI available dataset prompts us to build a traffic sign interpretation dataset, namely TSI-CN. The dataset consists of real road scene images, which are captured from the highway and the urban way in China from a driver's perspective. It contains rich location labels of texts, symbols, and guide panels, and the corresponding natural language description labels. Experiments on TSI-CN demonstrate that the TSI task is achievable and the TSI architecture can interpret traffic signs from scenes successfully even if there is a complex semantic logic among signs. The TSI-CN dataset and the source code of the TSI architecture will be publicly available after the revision process.

cs.CV↗