arXiv subjects

Jingyi Wang

Publications and source records attributed to Jingyi Wang.

At least 91 records · Page 5Linked to original sources

arXiv2024

$μ$Drive: User-Controlled Autonomous Driving

Autonomous Vehicles (AVs) rely on sophisticated Autonomous Driving Systems (ADSs) to provide passengers a satisfying and safe journey. The individual preferences of riders plays a crucial role in shaping the perception of safety and comfort while they are in the car. Existing ADSs, however, lack mechanisms to systematically capture and integrate rider preferences into their planning modules. To bridge this gap, we propose $μ$Drive, an event-based Domain-Specific Language (DSL) designed for specifying autonomous vehicle behaviour. $μ$Drive enables users to express their preferences through rules triggered by contextual events, such as encountering obstacles or navigating complex traffic situations. These rules dynamically adjust the parameter settings of the ADS planning module, facilitating seamless integration of rider preferences into the driving plan. In our evaluation, we demonstrate the feasibility and efficacy of $μ$Drive by integrating it with the Apollo ADS framework. Our findings show that users can effectively influence Apollo's planning through $μ$Drive, assisting ADS in achieving improved compliance with traffic regulations. The response time for $μ$Drive commands remains consistently at the second or millisecond level. This suggests that $μ$Drive may help pave the way to more personalizsed and user-centric AV experiences.

cs.SE↗

arXiv2024

Correlated mid-infrared and X-ray outbursts in black hole X-ray binaries: A new route to discovery in infrared surveys

The mid-infrared (MIR; $λ\simeq3 - 10μ$m) bands offer a unique window into understanding accretion and its interplay with jet formation in Galactic black hole X-ray binaries (BHXRBs). Although extremely difficult to observe from the ground, the NEOWISE time domain survey offers an excellent data set to study MIR variability when combined with contemporaneous X-ray data from the MAXI all-sky survey over a $\approx15$ yr baseline. Using a new forced photometry pipeline for NEOWISE data, we present the first systematic study of BHXRB MIR variability in outburst. Analyzing a sample of 16 sources detected in NEOWISE, we show variability trends in the X-ray hardness and MIR spectral index wherein i) the MIR bands are typically dominated by jet emission during the hard states, constraining the electron power spectrum index to $p \approx 1-4$ in the optically thin regime and indicating emitting regions of a few tens of gravitational radii when evolving towards a flat spectrum, ii) the MIR luminosity ($L_{IR}$) scales as $L_{IR}\propto L_X^{0.82\pm0.12}$ with the $2-10$ keV X-ray luminosity ($L_X$) in the hard state, consistent with its origin in a jet, and iii) the thermal disk emission dominates the soft state as the jet switches off and dramatically suppresses ($\gtrsim 10\times$) the MIR emission into a inverted spectrum ($α\approx -1$, where $F_ν\proptoν^{-α}$). We highlight a population of `mini' BHXRB outbursts detected in NEOWISE (including two previously unreported episodes in MAXI J1828-249) but missed in MAXI due to their faint fluxes or source confusion, exhibiting MIR spectral indices suggestive of thermal emission from a large outer disk. We highlight that upcoming IR surveys and the Rubin observatory will be powerful discovery engines for the distinctively large amplitude and long-lived outbursts of BHXRBs, as an independent discovery route to X-ray monitors.

astro-ph.HE↗

arXiv2024

Characteristic time of transient response of solid oxide cells (SOCs) to changes in voltage/current: from theory to applications

The intermittency of solar and wind power can be addressed by integrating them with Solid Oxide Cells (SOCs). This study delves into the transient characteristics of SOCs and their dependence on dynamic heat and mass transfer processes. Non-dimensional analysis was used to identify influential parameters, followed by a 3-D numerical simulation-based parametric analysis to examine the dynamic gaseous and thermal responses of SOCs with varying dimensions, material properties, and operating conditions. For the first time, we proposed characteristic times to describe the relationship between SOC transients and multiple parameters. These characteristic times represent the overall heat and mass transfer rats in SOCs. Their effectiveness was validated against literature and demonstrated potential in characterizing the transient characteristics of other electrochemical cells. Besides, two examples are provided to illustrate how the characteristic times facilitate SOC design and control at minimal computational cost.

physics.flu-dyn↗

arXiv2024

Long term variability of Cygnus X-1. VIII. A spectral-timing look at low energies with NICER

The Neutron Star Interior Composition Explorer (NICER) monitoring campaign of Cyg X-1 allows us to study its spectral-timing behavior at energies ${<}1$ keV across all states. The hard state power spectrum can be decomposed into two main broad Lorentzians with a transition at around 1 Hz. The lower-frequency Lorentzian is the dominant component at low energies. The higher-frequency Lorentzian begins to contribute significantly to the variability above 1.5 keV and dominates at high energies. We show that the low- and high-frequency Lorentzians likely represent individual physical processes. The lower-frequency Lorentzian can be associated with a (possibly Comptonized) disk component, while the higher-frequency Lorentzian is clearly associated with the Comptonizing plasma. At the transition of these components, we discover a low-energy timing phenomenon characterized by an abrupt lag change of hard (${\gtrsim}2$ keV) with respect to soft (${\lesssim}1.5$ keV) photons, accompanied by a drop in coherence, and a reduction in amplitude of the second broad Lorentzian. The frequency of the phenomenon increases with the frequencies of the Lorentzians as the source softens and cannot be seen when the power spectrum is single-humped. A comparison to transient low-mass X-ray binaries shows that this feature does not only appear in Cyg X-1, but that it is a general property of accreting black hole binaries. In Cyg X-1, we find that the variability at low and high energies is overall highly coherent in the hard and intermediate states. The high coherence shows that there is a process at work which links the variability, suggesting a physical connection between the accretion disk and Comptonizing plasma. This process fundamentally changes in the soft state, where strong red noise at high energies is incoherent to the variability at low energies.

astro-ph.HE↗

arXiv2024

Design optimization in unilateral contact using pressure constraints and Bayesian optimization

Design optimization problems, e.g., shape optimization, that involve deformable bodies in unilateral contact are challenging as they require robust contact solvers, complex optimization methods that are typically gradient-based, and sensitivity derivations. Notably, the problems are nonsmooth, adding significant difficulty to the optimization process. We study design optimization problems in frictionless unilateral contact subject to pressure constraints, using both gradient-based and gradient-free optimization methods, namely Bayesian optimization. The contact simulation problem is solved via the mortar contact and finite element methods. For the gradient-based method, we use the direct differentiation method to compute the sensitivities of the cost and constraint function with respect to the design variables. Then, we use Ipopt to solve the optimization problems. For the gradient-free approach, we use a constrained Bayesian optimization algorithm based on the standard Gaussian Process surrogate model. We present numerical examples that control the contact pressure, inspired by real-life engineering applications, to demonstrate the effectiveness, strengths and shortcomings of both methods. Our results suggest that both optimization methods perform reasonably well for these nonsmooth problems.

math.NA↗

arXiv2024

Tackling Noisy Labels with Network Parameter Additive Decomposition

Given data with noisy labels, over-parameterized deep networks suffer overfitting mislabeled data, resulting in poor generalization. The memorization effect of deep networks shows that although the networks have the ability to memorize all noisy data, they would first memorize clean training data, and then gradually memorize mislabeled training data. A simple and effective method that exploits the memorization effect to combat noisy labels is early stopping. However, early stopping cannot distinguish the memorization of clean data and mislabeled data, resulting in the network still inevitably overfitting mislabeled data in the early training stage.In this paper, to decouple the memorization of clean data and mislabeled data, and further reduce the side effect of mislabeled data, we perform additive decomposition on network parameters. Namely, all parameters are additively decomposed into two groups, i.e., parameters $\mathbf{w}$ are decomposed as $\mathbf{w}=\bmσ+\bmγ$. Afterward, the parameters $\bmσ$ are considered to memorize clean data, while the parameters $\bmγ$ are considered to memorize mislabeled data. Benefiting from the memorization effect, the updates of the parameters $\bmσ$ are encouraged to fully memorize clean data in early training, and then discouraged with the increase of training epochs to reduce interference of mislabeled data. The updates of the parameters $\bmγ$ are the opposite. In testing, only the parameters $\bmσ$ are employed to enhance generalization. Extensive experiments on both simulated and real-world benchmarks confirm the superior performance of our method.

cs.LG↗

arXiv2024

MyriadAL: Active Few Shot Learning for Histopathology

Active Learning (AL) and Few Shot Learning (FSL) are two label-efficient methods which have achieved excellent results recently. However, most prior arts in both learning paradigms fail to explore the wealth of the vast unlabelled data. In this study, we address this issue in the scenario where the annotation budget is very limited, yet a large amount of unlabelled data for the target task is available. We frame this work in the context of histopathology where labelling is prohibitively expensive. To this end, we introduce an active few shot learning framework, Myriad Active Learning (MAL), including a contrastive-learning encoder, pseudo-label generation, and novel query sample selection in the loop. Specifically, we propose to massage unlabelled data in a self-supervised manner, where the obtained data representations and clustering knowledge form the basis to activate the AL loop. With feedback from the oracle in each AL cycle, the pseudo-labels of the unlabelled data are refined by optimizing a shallow task-specific net on top of the encoder. These updated pseudo-labels serve to inform and improve the active learning query selection process. Furthermore, we introduce a novel recipe to combine existing uncertainty measures and utilize the entire uncertainty list to reduce sample redundancy in AL. Extensive experiments on two public histopathology datasets show that MAL has superior test accuracy, macro F1-score, and label efficiency compared to prior works, and can achieve a comparable test accuracy to a fully supervised algorithm while labelling only 5% of the dataset.

cs.CV↗

arXiv2024

A novel control strategy to neutralize heat source within solid oxide electrolysis cell (SOEC) under variable solar power conditions

The integration of a solid oxide electrolysis cell (SOEC) with a photovoltaic (PV) system presents a viable method for storing variable solar energy through the production of green hydrogen. To ensure the SOEC's safety and longevity amidst dramatic fluctuations in solar power, control strategies are needed to limit the temperature gradients and rates of temperature change within the SOEC. Recognizing that the reactant supply influences the current, a novel control strategy is developed to modulate heat generation in the SOEC by adjusting the fuel flow rate. The effectiveness of this strategy is assessed through numerical simulations conducted on a coupled PV-SOEC system using actual solar irradiance data, recorded at two-second intervals, to account for rapid changes in solar exposure. The results indicate that conventional control strategies, which increase airflow rates, are inadequate in effectively suppressing the rate of temperature variation in scenarios of drastic solar power changes. In contrast, our proposed strategy demonstrates successful management of the SOEC's heat generation, thereby reducing the temperature gradient and rate of variation within the SOEC to below 5 K/cm and 1 K/min, respectively.

physics.flu-dyn↗

arXiv2024

Chasing the break: Tracing the full evolution of a black hole X-ray binary jet with multi-wavelength spectral modeling

Black hole X-ray binaries (BH XRBs) are ideal targets to study the connection between accretion inflow and jet outflow. Here we present quasi-simultaneous, multi-wavelength observations of the Galactic black hole system MAXI J1820+070, throughout its 2018-2019 outburst. Our data set includes coverage from the radio through X-ray bands from 17 different instruments/telescopes, and encompasses 19 epochs over a 7 month time period, resulting in one of the most well-sampled multi-wavelength data sets of a BH XRB outburst to date. With our data, we compile and model the broad-band spectra of this source using a phenomenological model that includes emission from the jet, companion star, and accretion flow. This modeling allows us to track the evolution of the spectral break in the jet spectrum, a key observable that samples the jet launching region. We find that the spectral break location changes over at least $\approx3$ orders of magnitude in electromagnetic frequency over this period. Using these spectral break measurements, we link the full cycle of jet behavior, including the rising, quenching, and re-ignition, to the changing accretion flow properties as the source evolves through its different accretion states. Our analyses show a consistent jet behavior with other sources in similar phases of their outbursts, reinforcing that the jet quenching and recovery may be a global feature of BH XRB systems in outburst. Our results also provide valuable evidence supporting a close connection between the geometry of the inner accretion flow and the base of the jet.

astro-ph.HE↗

arXiv2024

The 2022 Outburst of IGR J17091-3624: Connecting the exotic GRS 1915+105 to standard black hole X-ray binaries

While the standard X-ray variability of black hole X-ray binaries (BHXBs) is stochastic and noisy, there are two known BHXBs that exhibit exotic `heartbeat'-like variability in their light curves: GRS 1915+105 and IGR J17091-3624. In 2022, IGR J17091-3624 went into outburst for the first time in the NICER/NuSTAR era. These exquisite data allow us to simultaneously track the exotic variability and the corresponding spectral features with unprecedented detail. We find that as in typical BHXBs, the outburst began in the hard state, then the intermediate state, but then transitioned to an exotic soft state where we identify two types of heartbeat-like variability (Class V and a new Class X). The flux-energy spectra show a broad iron emission line due to relativistic reflection when there is no exotic variability, and absorption features from highly ionized iron when the source exhibits exotic variability. Whether absorption lines from highly ionized iron are detected in IGR J17091-3624 is not determined by the spectral state alone, but rather is determined by the presence of exotic variability; in a soft spectral state, absorption lines are only detected along with exotic variability. Our finding indicates that IGR J17091-3624 can be seen as a bridge between the most peculiar BHXB GRS 1915+105 and `normal' BHXBs because it alternates between the conventional and exotic behavior of BHXBs. We discuss the physical nature of the absorbing material and exotic variability in light of this new legacy dataset.

astro-ph.HE↗

arXiv2024

Highly-coherent quasi-periodic oscillations in the 'heartbeat' black hole X-ray binary IGR J17091-3624

IGR J17091-3624 is a black hole X-ray binary (BHXB), often referred to as the 'twin' of GRS 1915+105 because it is the only other known BHXB that can show exotic 'heartbeat'-like variability that is highly structured and repeated. Here we report on observations of IGR J17091-3624 from its 2022 outburst, where we detect an unusually coherent quasi-periodic oscillation (QPO) when the broadband variability is low (total fractional rms $\lesssim$ 6%) and the spectrum is dominated by the accretion disk. Such spectral and variability behavior is characteristic of the soft state of typical BHXBs (i.e., those that do not show heartbeats), but we also find that this QPO is strongest when there is some exotic heartbeat-like variability (so-called Class V variability). This QPO is detected at frequencies between 5 and 8 Hz and has Q-factors (defined as the QPO frequency divided by the width) $\gtrsim$ 50, making it one of the most highly coherent low-frequency QPO ever seen in a BHXB. The extremely high Q factor makes this QPO distinct from typical low-frequency QPOs that are conventionally classified into Type-A/B/C QPOs. Instead, we find evidence that archival observations of GRS 1915+105 also showed a similarly high-coherence QPO in the same frequency range, suggesting that this unusually coherent and strong QPO may be unique to BHXBs that can exhibit 'heartbeat'-like variability.

astro-ph.HE↗

arXiv2023

Electro-optic frequency comb-enabled precise distance measurement with megahertz acquisition rate

Artificial intelligence empowered autonomous vehicles and robotics have to sense the fast-changing three-dimensional environment with high precision and speed. However, it is challenging for the state-of-the-art ambiguity-free light detection and ranging (LiDAR) techniques to achieve absolute distance measurement with simultaneous high precision and high acquisition rate. Here we demonstrate an electro-optic frequency comb-enabled precise absolute distance measurement method, repetition rate modulated frequency comb (RRMFC), with megahertz-level acquisition rate. To achieve RRMFC, we designed and fabricated an integrated lithium niobate phase modulator with a modulation length of 5 cm and a half-wave voltage of 1.52 V, leading to over 50 sidebands and a continuously tunable repetition rate. Leveraging these unique features, RRMFC can directly resolve distance in time domain, leading to an acquisition rate as high as 25 MHz and an Allan deviation down to 13.77 μm at an averaging time of 724 μs. Based on RRMFC, we achieved high-speed 3D imaging at millimeter-level precision with a single laser. RRMFC-based LiDAR allows the autonomous vehicles and robotics to sense the fine details of fast-changing environment with high precision.

physics.optics↗

arXiv2023

An Adaptive Sampling Augmented Lagrangian Method for Stochastic Optimization with Deterministic Constraints

The primary goal of this paper is to provide an efficient solution algorithm based on the augmented Lagrangian framework for optimization problems with a stochastic objective function and deterministic constraints. Our main contribution is combining the augmented Lagrangian framework with adaptive sampling, resulting in an efficient optimization methodology validated with practical examples. To achieve the presented efficiency, we consider inexact solutions for the augmented Lagrangian subproblems, and through an adaptive sampling mechanism, we control the variance in the gradient estimates. Furthermore, we analyze the theoretical performance of the proposed scheme by showing equivalence to a gradient descent algorithm on a Moreau envelope function, and we prove sublinear convergence for convex objectives and linear convergence for strongly convex objectives with affine equality constraints. The worst-case sample complexity of the resulting algorithm, for an arbitrary choice of penalty parameter in the augmented Lagrangian function, is $O(ε^{-3-δ})$, where $ε> 0$ is the expected error of the solution and $δ> 0$ is a user-defined parameter. If the penalty parameter is chosen to be $O(ε^{-1})$, we demonstrate that the result can be improved to $O(ε^{-2})$, which is competitive with the other methods employed in the literature. Moreover, if the objective function is strongly convex with affine equality constraints, we obtain $O(ε^{-1}\log(1/ε))$ complexity. Finally, we empirically verify the performance of our adaptive sampling augmented Lagrangian framework in machine learning optimization and engineering design problems, including topology optimization of a heat sink with environmental uncertainty.

math.OC↗

arXiv2023

YAYI 2: Multilingual Open-Source Large Language Models

As the latest advancements in natural language processing, large language models (LLMs) have achieved human-level language understanding and generation abilities in many real-world tasks, and even have been regarded as a potential path to the artificial general intelligence. To better facilitate research on LLMs, many open-source LLMs, such as Llama 2 and Falcon, have recently been proposed and gained comparable performances to proprietary models. However, these models are primarily designed for English scenarios and exhibit poor performances in Chinese contexts. In this technical report, we propose YAYI 2, including both base and chat models, with 30 billion parameters. YAYI 2 is pre-trained from scratch on a multilingual corpus which contains 2.65 trillion tokens filtered by our pre-training data processing pipeline. The base model is aligned with human values through supervised fine-tuning with millions of instructions and reinforcement learning from human feedback. Extensive experiments on multiple benchmarks, such as MMLU and CMMLU, consistently demonstrate that the proposed YAYI 2 outperforms other similar sized open-source models.

cs.CL↗

arXiv2023

Feedback RoI Features Improve Aerial Object Detection

Neuroscience studies have shown that the human visual system utilizes high-level feedback information to guide lower-level perception, enabling adaptation to signals of different characteristics. In light of this, we propose Feedback multi-Level feature Extractor (Flex) to incorporate a similar mechanism for object detection. Flex refines feature selection based on image-wise and instance-level feedback information in response to image quality variation and classification uncertainty. Experimental results show that Flex offers consistent improvement to a range of existing SOTA methods on the challenging aerial object detection datasets including DOTA-v1.0, DOTA-v1.5, and HRSC2016. Although the design originates in aerial image detection, further experiments on MS COCO also reveal our module's efficacy in general detection models. Quantitative and qualitative analyses indicate that the improvements are closely related to image qualities, which match our motivation.

cs.CV↗

arXiv2023

Prompting Frameworks for Large Language Models: A Survey

Since the launch of ChatGPT, a powerful AI Chatbot developed by OpenAI, large language models (LLMs) have made significant advancements in both academia and industry, bringing about a fundamental engineering paradigm shift in many areas. While LLMs are powerful, it is also crucial to best use their power where "prompt'' plays a core role. However, the booming LLMs themselves, including excellent APIs like ChatGPT, have several inherent limitations: 1) temporal lag of training data, and 2) the lack of physical capabilities to perform external actions. Recently, we have observed the trend of utilizing prompt-based tools to better utilize the power of LLMs for downstream tasks, but a lack of systematic literature and standardized terminology, partly due to the rapid evolution of this field. Therefore, in this work, we survey related prompting tools and promote the concept of the "Prompting Framework" (PF), i.e. the framework for managing, simplifying, and facilitating interaction with large language models. We define the lifecycle of the PF as a hierarchical structure, from bottom to top, namely: Data Level, Base Level, Execute Level, and Service Level. We also systematically depict the overall landscape of the emerging PF field and discuss potential future research and challenges. To continuously track the developments in this area, we maintain a repository at https://github.com/lxx0628/Prompting-Framework-Survey, which can be a useful resource sharing platform for both academic and industry in this field.

cs.SE↗

arXiv2023

MSE-Nets: Multi-annotated Semi-supervised Ensemble Networks for Improving Segmentation of Medical Image with Ambiguous Boundaries

Medical image segmentation annotations exhibit variations among experts due to the ambiguous boundaries of segmented objects and backgrounds in medical images. Although using multiple annotations for each image in the fully-supervised has been extensively studied for training deep models, obtaining a large amount of multi-annotated data is challenging due to the substantial time and manpower costs required for segmentation annotations, resulting in most images lacking any annotations. To address this, we propose Multi-annotated Semi-supervised Ensemble Networks (MSE-Nets) for learning segmentation from limited multi-annotated and abundant unannotated data. Specifically, we introduce the Network Pairwise Consistency Enhancement (NPCE) module and Multi-Network Pseudo Supervised (MNPS) module to enhance MSE-Nets for the segmentation task by considering two major factors: (1) to optimize the utilization of all accessible multi-annotated data, the NPCE separates (dis)agreement annotations of multi-annotated data at the pixel level and handles agreement and disagreement annotations in different ways, (2) to mitigate the introduction of imprecise pseudo-labels, the MNPS extends the training data by leveraging consistent pseudo-labels from unannotated data. Finally, we improve confidence calibration by averaging the predictions of base networks. Experiments on the ISIC dataset show that we reduced the demand for multi-annotated data by 97.75\% and narrowed the gap with the best fully-supervised baseline to just a Jaccard index of 4\%. Furthermore, compared to other semi-supervised methods that rely only on a single annotation or a combined fusion approach, the comprehensive experimental results on ISIC and RIGA datasets demonstrate the superior performance of our proposed method in medical image segmentation with ambiguous boundaries.

cs.CV↗

arXiv2023

Local convergence of a sequential quadratic programming method for a class of nonsmooth nonconvex objectives

A sequential quadratic programming (SQP) algorithm is designed for nonsmooth optimization problems with upper-C^2 objective functions. Upper-C^2 functions are locally equivalent to difference-of-convex (DC) functions with smooth convex parts. They arise naturally in many applications such as certain classes of solutions to parametric optimization problems, e.g., recourse of stochastic programming, and projection onto closed sets. The proposed algorithm conducts line search and adopts an exact penalty merit function. The potential inconsistency due to the linearization of constraints are addressed through relaxation, similar to that of Sl_1QP. We show that the algorithm is globally convergent under reasonable assumptions. Moreover, we study the local convergence behavior of the algorithm under additional assumptions of Kurdyka-Łojasiewicz (KL) properties, which have been applied to many nonsmooth optimization problems. Due to the nonconvex nature of the problems, a special potential function is used to analyze local convergence. We show that under acceptable assumptions, upper bounds on local convergence can be proven. Additionally, we show that for a large number of optimization problems with upper-C^2 objectives, their corresponding potential functions are indeed KL functions. Numerical experiment is performed with a power grid optimization problem that is consistent with the assumptions and analysis in this paper.

math.OC↗