arXiv subjects

Jie Li

Publications and source records attributed to Jie Li.

At least 307 records · Page 17Linked to original sources

arXiv2024

Testing Colour-magnitude Pattern as A Method in the Search for Changing-Look AGNs

We develop a simple method to search for changing-look (CL) active galactic nucleus (AGN) candidates, and conduct a test run. In this method, optical variations of AGNs are monitored and CL-AGNs may appear to have a pattern of being bluer when in brightening flare-like events. Applying this method, previously-classified type 2 AGNs that show the bluer-when-brighter (BWB) pattern are selected. Among more than ten thousands type 2 AGNs classified in the Sloan Digital Sky Survey (SDSS), we find 73 candidates with possibly the strongest BWB pattern. We note that 13 of them have previously been reported as CL-AGNs. We have observed nine candidates, and found that five among them showed the CL transition from type 2 to type 1. In addition, we also test extending the selection to previously-classified type 1 AGNs in the SDSS by finding sources with a possible redder-when-brighter pattern, but none of the three sources observed by us is found to show the transition from type 1 to type 2. We discuss the variation properties in both the success and failure cases, and plan to observe more candidates selected with the method. From the observational results, a detailed comparison between the CL-AGNs and none CL-AGNs will help quantitatively refine the selection criteria and in turn allow us to configure the general properties of CLAGNs.

astro-ph.GA↗

arXiv2024

Microwave-optics entanglement via coupled opto- and magnomechanical microspheres

Microwave-optics entanglement plays a crucial role in building hybrid quantum networks with quantum nodes working in the microwave and optical frequency bands. However, there are limited efficient ways to produce such entanglement due to the large frequency mismatch between the two regimes. Here, we present a new mechanism to prepare microwave-optics entanglement based on a hybrid system of two coupled opto- and magnomechanical microspheres, i.e., a YIG sphere and a silica sphere. The YIG sphere holds a magnon mode and a vibration mode induced by magnetostriction, while the silica sphere supports an optical whispering-gallery mode and a mechanical mode coupled via an optomechanical interaction. The two mechanical modes are close in frequency and directly coupled via physical contact of the two microspheres. We show that by simultaneously activating the magnomechanical (optomechanical) Stokes (anti-Stokes) scattering, stationary entanglement can be established between the magnon and optical modes via mechanics-mechanics coupling. This leads to stationary microwave-optics entanglement by further coupling the YIG sphere to a microwave cavity and utilizing the magnon-microwave state swapping. Our protocol is within reach of current technology and may become a promising new approach for preparing microwave-optics entanglement, which finds unique applications in hybrid quantum networks and quantum information processing with hybrid quantum systems.

quant-ph↗

arXiv2024

A Single-Frame and Multi-Frame Cascaded Image Super-Resolution Method

The objective of image super-resolution is to reconstruct a high-resolution (HR) image with the prior knowledge from one or several low-resolution (LR) images. However, in the real world, due to the limited complementary information, the performance of both single-frame and multi-frame super-resolution reconstruction degrades rapidly as the magnification increases. In this paper, we propose a novel two-step image super resolution method concatenating multi-frame super-resolution (MFSR) with single-frame super-resolution (SFSR), to progressively upsample images to the desired resolution. The proposed method consisting of an L0-norm constrained reconstruction scheme and an enhanced residual back-projection network, integrating the flexibility of the variational modelbased method and the feature learning capacity of the deep learning-based method. To verify the effectiveness of the proposed algorithm, extensive experiments with both simulated and real world sequences were implemented. The experimental results show that the proposed method yields superior performance in both objective and perceptual quality measurements. The average PSNRs of the cascade model in set5 and set14 are 33.413 dB and 29.658 dB respectively, which are 0.76 dB and 0.621 dB more than the baseline method. In addition, the experiment indicates that this cascade model can be robustly applied to different SFSR and MFSR methods.

eess.IV↗

arXiv2024

Contrasting Adversarial Perturbations: The Space of Harmless Perturbations

Existing works have extensively studied adversarial examples, which are minimal perturbations that can mislead the output of deep neural networks (DNNs) while remaining imperceptible to humans. However, in this work, we reveal the existence of a harmless perturbation space, in which perturbations drawn from this space, regardless of their magnitudes, leave the network output unchanged when applied to inputs. Essentially, the harmless perturbation space emerges from the usage of non-injective functions (linear or non-linear layers) within DNNs, enabling multiple distinct inputs to be mapped to the same output. For linear layers with input dimensions exceeding output dimensions, any linear combination of the orthogonal bases of the nullspace of the parameter consistently yields no change in their output. For non-linear layers, the harmless perturbation space may expand, depending on the properties of the layers and input samples. Inspired by this property of DNNs, we solve for a family of general perturbation spaces that are redundant for the DNN's decision, and can be used to hide sensitive data and serve as a means of model identification. Our work highlights the distinctive robustness of DNNs (i.e., consistency under large magnitude perturbations) in contrast to adversarial examples (vulnerability for small imperceptible noises).

cs.LG↗

arXiv2024

Gaze into the Pattern: Characterizing Spatial Patterns with Internal Temporal Correlations for Hardware Prefetching

Hardware prefetching is one of the most widely-used techniques for hiding long data access latency. To address the challenges faced by hardware prefetching, architects have proposed to detect and exploit the spatial locality at the granularity of spatial region. When a new region is activated, they try to find similar previously accessed regions for footprint prediction based on system-level environmental features such as the trigger instruction or data address. However, we find that such context-based prediction cannot capture the essential characteristics of access patterns, leading to limited flexibility, practicality and suboptimal prefetching performance. In this paper, inspired by the temporal property of memory accessing, we note that the temporal correlation exhibited within the spatial footprint is a key feature of spatial patterns. To this end, we propose Gaze, a simple and efficient hardware spatial prefetcher that skillfully utilizes footprint-internal temporal correlations to efficiently characterize spatial patterns. Meanwhile, we observe a unique unresolved challenge in utilizing spatial footprints generated by spatial streaming, which exhibit extremely high access density. Therefore, we further enhance Gaze with a dedicated two-stage approach that mitigates the over-prefetching problem commonly encountered in conventional schemes. Our comprehensive and diverse set of experiments show that Gaze can effectively enhance the performance across a wider range of scenarios. Specifically, Gaze improves performance by 5.7\% and 5.4\% at single-core, 11.4\% and 8.8\% at eight-core, compared to most recent low-cost solutions PMP and vBerti.

cs.AR↗

arXiv2024

Towards Cross-View-Consistent Self-Supervised Surround Depth Estimation

Depth estimation is a cornerstone for autonomous driving, yet acquiring per-pixel depth ground truth for supervised learning is challenging. Self-Supervised Surround Depth Estimation (SSSDE) from consecutive images offers an economical alternative. While previous SSSDE methods have proposed different mechanisms to fuse information across images, few of them explicitly consider the cross-view constraints, leading to inferior performance, particularly in overlapping regions. This paper proposes an efficient and consistent pose estimation design and two loss functions to enhance cross-view consistency for SSSDE. For pose estimation, we propose to use only front-view images to reduce training memory and sustain pose estimation consistency. The first loss function is the dense depth consistency loss, which penalizes the difference between predicted depths in overlapping regions. The second one is the multi-view reconstruction consistency loss, which aims to maintain consistency between reconstruction from spatial and spatial-temporal contexts. Additionally, we introduce a novel flipping augmentation to improve the performance further. Our techniques enable a simple neural model to achieve state-of-the-art performance on the DDAD and nuScenes datasets. Last but not least, our proposed techniques can be easily applied to other methods. The code is available at https://github.com/denyingmxd/CVCDepth.

cs.CV↗

arXiv2024

Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment

Large Language Models (LLMs) like OpenAI's GPT series, Anthropic's Claude, and Meta's LLaMa have shown remarkable capabilities in text generation. However, their susceptibility to toxic prompts presents significant security challenges. This paper investigates alignment techniques, including Supervised Fine-Tuning (SFT) and Reinforcement Learning from Human Feedback (RLHF), to mitigate these risks. We conduct an empirical study on refusal patterns across nine LLMs, revealing that models with uniform refusal patterns, such as Claude3, exhibit higher security. Based on these findings, we propose self-distilling and cross-model distilling methods to enhance LLM security. Our results show that these methods significantly improve refusal rates and reduce unsafe content, with cross-model distilling achieving refusal rates close to Claude3's 94.51%. These findings underscore the potential of distillation-based alignment in securing LLMs against toxic prompts.

cs.CR↗

arXiv2024

Generation of circular field harmonics in quasi-polygonal magnet apertures using superconducting canted-cosine-theta coils

Superconducting magnets with non-circular apertures are important for handling unconventional beam profiles and specialized accelerator applications. This paper presents an analytical framework for designing superconducting accelerator magnets with quasi-polygonal apertures, aimed at generating precise circular field harmonics. In Part 1, we explore the relationship between current distributions on quasi-polygonal formers and their corresponding magnetic field harmonics. By employing conformal mapping techniques, we establish a connection between the design of quasi-polygonal bore magnets and traditional circular bore configurations, facilitating the simplification of complex mathematical formulations. Part 2 applies the derived current distributions to the canted cosine theta (CCT) coil magnet concept, focusing on designing analytic winding schemes that generate single or mixed circular harmonics within quasi-polygonal apertures. This work not only advances the design of superconducting magnets but also broadens the scope of CCT technology to accommodate more complex geometries.

physics.acc-ph↗

arXiv2024

Towards Balanced RGB-TSDF Fusion for Consistent Semantic Scene Completion by 3D RGB Feature Completion and a Classwise Entropy Loss Function

Semantic Scene Completion (SSC) aims to jointly infer semantics and occupancies of 3D scenes. Truncated Signed Distance Function (TSDF), a 3D encoding of depth, has been a common input for SSC. Furthermore, RGB-TSDF fusion, seems promising since these two modalities provide color and geometry information, respectively. Nevertheless, RGB-TSDF fusion has been considered nontrivial and commonly-used naive addition will result in inconsistent results. We argue that the inconsistency comes from the sparsity of RGB features upon projecting into 3D space, while TSDF features are dense, leading to imbalanced feature maps when summed up. To address this RGB-TSDF distribution difference, we propose a two-stage network with a 3D RGB feature completion module that completes RGB features with meaningful values for occluded areas. Moreover, we propose an effective classwise entropy loss function to punish inconsistency. Extensive experiments on public datasets verify that our method achieves state-of-the-art performance among methods that do not adopt extra data.

cs.CV↗

arXiv2024

MemFusionMap: Working Memory Fusion for Online Vectorized HD Map Construction

High-definition (HD) maps provide environmental information for autonomous driving systems and are essential for safe planning. While existing methods with single-frame input achieve impressive performance for online vectorized HD map construction, they still struggle with complex scenarios and occlusions. We propose MemFusionMap, a novel temporal fusion model with enhanced temporal reasoning capabilities for online HD map construction. Specifically, we contribute a working memory fusion module that improves the model's memory capacity to reason across a history of frames. We also design a novel temporal overlap heatmap to explicitly inform the model about the temporal overlap information and vehicle trajectory in the Bird's Eye View space. By integrating these two designs, MemFusionMap significantly outperforms existing methods while also maintaining a versatile design for scalability. We conduct extensive evaluation on open-source benchmarks and demonstrate a maximum improvement of 5.4% in mAP over state-of-the-art methods. The project page for MemFusionMap is https://song-jingyu.github.io/MemFusionMap

cs.CV↗

arXiv2024

A Multi-scale Information Integration Framework for Infrared and Visible Image Fusion

Infrared and visible image fusion aims at generating a fused image containing the intensity and detail information of source images, and the key issue is effectively measuring and integrating the complementary information of multi-modality images from the same scene. Existing methods mostly adopt a simple weight in the loss function to decide the information retention of each modality rather than adaptively measuring complementary information for different image pairs. In this study, we propose a multi-scale dual attention (MDA) framework for infrared and visible image fusion, which is designed to measure and integrate complementary information in both structure and loss function at the image and patch level. In our method, the residual downsample block decomposes source images into three scales first. Then, dual attention fusion block integrates complementary information and generates a spatial and channel attention map at each scale for feature fusion. Finally, the output image is reconstructed by the residual reconstruction block. Loss function consists of image-level, feature-level and patch-level three parts, of which the calculation of the image-level and patch-level two parts are based on the weights generated by the complementary information measurement. Indeed, to constrain the pixel intensity distribution between the output and infrared image, a style loss is added. Our fusion results perform robust and informative across different scenarios. Qualitative and quantitative results on two datasets illustrate that our method is able to preserve both thermal radiation and detailed information from two modalities and achieve comparable results compared with the other state-of-the-art methods. Ablation experiments show the effectiveness of our information integration architecture and adaptively measure complementary information retention in the loss function.

cs.CV↗

arXiv2024

Evolution of Electronic Correlations in the Ruddlesden-Popper Nickelates

We report on optical studies of the Ruddlesden-Popper nickelates La$_{n+1}$Ni$_{n}$O$_{3n+1}$ with $n = 2$ (La$_{3}$Ni$_{2}$O$_{7}$), $n = 3$ (La$_{4}$Ni$_{3}$O$_{10}$) and $n = \infty$ (LaNiO$_{3}$). As the number of the NiO$_{6}$ octahedra layers $n$ grows, the ratio of the kinetic energy determined from the experimental optical conductivity and that from band theory $K_{\text{exp}}/K_{\text{band}}$ increases, suggesting a reduction of electronic correlations. While the strong electronic correlations in the bilayer La$_{3}$Ni$_{2}$O$_{7}$ place it on the verge of the Mott insulating phase, the trilayer La$_{4}$Ni$_{3}$O$_{10}$ and infinite-layer LaNiO$_{3}$ exhibit moderate electronic correlations, falling into the regime of correlated metals. The evolution of the electronic correlations in La$_{n+1}$Ni$_{n}$O$_{3n+1}$ is likely to be dominated by the Ni-$d_{z^2}$ orbital. Our results provide important information for understanding the superconductivity in Ruddlesden-Popper nickelates.

cond-mat.supr-con↗

arXiv2024

Neutrinos in the flavor-dependent $U(1)_F$ model

The neutrino oscillation experiments provide definitive evidence of new physics beyond the Standard Model (SM), and the neutrino mass-squared differences and flavor mixing have been precisely measured. This study examines the neutrino sector within the flavor-dependent $U(1)_F$ model, where the unique fermion sector can simultaneously address both the flavor mixing puzzle and the mass hierarchy puzzle. It is found that the lightest neutrino is naturally massless in this model, and the predicted neutrino mass-squared differences, flavor mixing angles, Dirac CP phase agree well with the experimental measurements. Additionally, the effects of the Dirac CP phase and Majorana CP phase on the theoretical predictions of the neutrino transition magnetic dipole moments are analyzed.

hep-ph↗

arXiv2024

Inference-to-complete: A High-performance and Programmable Data-plane Co-processor for Neural-network-driven Traffic Analysis

Neural-networks-driven intelligent data-plane (NN-driven IDP) is becoming an emerging topic for excellent accuracy and high performance. Meanwhile we argue that NN-driven IDP should satisfy three design goals: the flexibility to support various NNs models, the low-latency-high-throughput inference performance, and the data-plane-unawareness harming no performance and functionality. Unfortunately, existing work either over-modify NNs for IDP, or insert inline pipelined accelerators into the data-plane, failing to meet the flexibility and unawareness goals. In this paper, we propose Kaleidoscope, a flexible and high-performance co-processor located at the bypass of the data-plane. To address the challenge of meeting three design goals, three key techniques are presented. The programmable run-to-completion accelerators are developed for flexible inference. To further improve performance, we design a scalable inference engine which completes low-latency and low-cost inference for the mouse flows, and perform complex NNs with high-accuracy for the elephant flows. Finally, raw-bytes-based NNs are introduced, which help to achieve unawareness. We prototype Kaleidoscope on both FPGA and ASIC library. In evaluation on six NNs models, Kaleidoscope reaches 256-352 ns inference latency and 100 Gbps throughput with negligible influence on the data-plane. The on-board tested NNs perform state-of-the-art accuracy among other NN-driven IDP, exhibiting the the significant impact of flexibility on enhancing traffic analysis accuracy.

cs.NI↗

arXiv2024

Tetragonal BaCoO$_3$: A Co$^{4+}$ Ferromagnetic Mott Insulator with Inverted Spin Crossover

The interplay between crystal electric field splitting of d states and Hund's rule exchange energy in cobalt-based perovskites offers a promising avenue for inducing spin-state transitions. This study reports a new body-centered tetragonal (BCT) phase of BaCoO$_3$ (BCT-BaCoO$_3$), synthesized under high pressure (15 GPa) and high temperature (1200 °C) conditions. BCT-BaCoO$_3$ adopts a double perovskite structure of EuTiO$_3$-type (space group I4/mcm, #140), confirmed by high-resolution scanning transmission electron microscopy. X-ray photoelectron spectroscopy reveals a rare Co$^{4+}$ valence state. Magnetization and X-ray absorption measurements reveal a low-spin to high-spin transition that takes place between 200 and 300 K. While spin crossovers are relatively common among common oxides, the one observed in BCT-BaCoO$_3$ is remarkable in that it proceeds in the opposite direction from conventional spin transitions. BCT-BaCoO$_3$ exhibits a low-spin (S = 1/2) state at high temperatures and transitions to a high-spin (S = 5/2) state at low temperatures. Within the high-spin state, hard ferromagnetic order onsets at T$_C$ = 107 K. Electrical resistivity indicates weak magnetoresistance and insulating behavior. Overall, BCT-BaCoO$_3$ presents an exceptional model for the exploration of spin-state transitions and the study of Co spin states in cobalt-based perovskites.

cond-mat.mtrl-sci↗

arXiv2024

Entangling two exciton modes using exciton optomechanics

Exciton optomechanics, bridging cavity exciton polaritons and optomechanics, opens new opportunities for the study of light-matter strong interactions and nonlinearities, due to the rich nonlinear couplings among excitons, phonons, and photons. Here, we propose to entangle two exciton modes in an exciton-optomechanics system, which consists of a semiconductor microcavity integrated with two quantum wells. The quantum wells support two exciton modes, which simultaneously couple to an optical cavity mode via a linear dipole interaction and to a mechanical vibration mode via a nonlinear deformation potential interaction. We show that by strongly driving the microcavity with a red-detuned laser field and when the two exciton modes are respectively resonant with the Stokes and anti-Stokes sidebands scattered by the mechanical motion, stationary entanglement between the two exciton modes can be established under realistic parameters. The protocol is within reach of current technology and may become a promising approach for preparing excitonic entanglement.

quant-ph↗

arXiv2024

Model reduction, machine learning based global optimisation for large-scale steady state nonlinear systems

Many engineering processes can be accurately modelled using partial differential equations (PDEs), but high dimensionality and non-convexity of the resulting systems pose limitations on their efficient optimisation. In this work, a model reduction, machine-learning methodology combining principal component analysis (PCA) and artificial neural networks (ANNs) is employed to construct a reduced surrogate model, which can then be utilised by advanced deterministic global optimisation algorithms to compute global optimal solutions with theoretical guarantees. However, such optimisation would still be time-consuming due to the high non-convexity of the activation functions inside the reduced ANN structures. To develop a computationally-efficient optimisation framework, we propose two alternative strategies: The first one is a piecewise-affine reformulation of the nonlinear ANN activation functions, while the second one is based on deep rectifier neural networks with ReLU activation function. The performance of the proposed framework is demonstrated through two illustrative case studies.

math.OC↗

arXiv2024

Magnon squeezing via reservoir-engineered optomagnomechanics

We show how to prepare magnonic squeezed states in an optomagnomechanical system, in which magnetostriction induced mechanical displacement couples to an optical cavity via radiation pressure. We discuss two scenarios depending on whether the magnomechanical coupling is linear or dispersive. We show that in both cases the strong mechanical squeezing obtained via two-tone driving of the optical cavity can be efficiently transferred to the magnon mode. In the linear coupling case, stationary magnon squeezing is achieved; while in the dispersive coupling case, a transient magnonic squeezed state is prepared in a two-step protocol. The proposed magnonic squeezed states find promising applications in quantum information processing and quantum sensing using magnons.

quant-ph↗