arXiv subjects

Jun Lin

Publications and source records attributed to Jun Lin.

At least 55 records · Page 3Linked to original sources

arXiv2024

Theoretical Studies on the Evolution of Solar Filaments in Response to New Emerging Flux

New emerging flux (NEF) has long been considered a mechanism for solar eruptions, but detailed process remains an open question. In this work, we explore how NEF drives a coronal magnetic configuration to erupt. This configuration is created by two magnetic sources of strengths $M$ and $S$ embedded in the photosphere, one electric-current-carrying flux rope (FR) floating in the corona, and an electric current induced on the photospheric surface by the FR. The source $M$ is fixed accounting for the initial background field, and $S$ changes playing the role of NEF. We introduce the channel function $C$ to forecast the overall evolutionary behavior of the configuration. Location, polarity, and strength of NEF governs the evolutionary behavior of FR before eruption. In the case of $|S/M|<1$ with reconnection occur between new and old fields, the configuration in equilibrium evolves to the critical state, invoking the catastrophe. In this case, if polarities of the new and old fields are opposite, reconnection occurs as NEF is close to FR; and if polarities are the same, reconnection happens as NEF appears far from FR. With different combinations of the relative polarity and the location, the evolutionary behavior of the system gets complex, and the catastrophe may not occur. If $|S/M|>1$ and the two fields have opposite polarity, the catastrophe always takes place; but if the polarities are the same, catastrophe occurs only as NEF is located far from FR; otherwise, the evolution ends up either with failed eruption or without catastrophe at all.

astro-ph.SR↗

arXiv2024

LangGFM: A Large Language Model Alone Can be a Powerful Graph Foundation Model

Graph foundation models (GFMs) have recently gained significant attention. However, the unique data processing and evaluation setups employed by different studies hinder a deeper understanding of their progress. Additionally, current research tends to focus on specific subsets of graph learning tasks, such as structural tasks, node-level tasks, or classification tasks. As a result, they often incorporate specialized modules tailored to particular task types, losing their applicability to other graph learning tasks and contradicting the original intent of foundation models to be universal. Therefore, to enhance consistency, coverage, and diversity across domains, tasks, and research interests within the graph learning community in the evaluation of GFMs, we propose GFMBench-a systematic and comprehensive benchmark comprising 26 datasets. Moreover, we introduce LangGFM, a novel GFM that relies entirely on large language models. By revisiting and exploring the effective graph textualization principles, as well as repurposing successful techniques from graph augmentation and graph self-supervised learning within the language space, LangGFM achieves performance on par with or exceeding the state of the art across GFMBench, which can offer us new perspectives, experiences, and baselines to drive forward the evolution of GFMs.

cs.LG↗

arXiv2024

Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration

Large Language Models (LLMs) could struggle to fully understand legal theories and perform complex legal reasoning tasks. In this study, we introduce a challenging task (confusing charge prediction) to better evaluate LLMs' understanding of legal theories and reasoning capabilities. We also propose a novel framework: Multi-Agent framework for improving complex Legal Reasoning capability (MALR). MALR employs non-parametric learning, encouraging LLMs to automatically decompose complex legal tasks and mimic human learning process to extract insights from legal rules, helping LLMs better understand legal theories and enhance their legal reasoning abilities. Extensive experiments on multiple real-world datasets demonstrate that the proposed framework effectively addresses complex reasoning issues in practical scenarios, paving the way for more reliable applications in the legal domain.

cs.AI↗

arXiv2024

SPEED: A Scalable RISC-V Vector Processor Enabling Efficient Multi-Precision DNN Inference

Deploying deep neural networks (DNNs) on those resource-constrained edge platforms is hindered by their substantial computation and storage demands. Quantized multi-precision DNNs, denoted as MP-DNNs, offer a promising solution for these limitations but pose challenges for existing RISC-V processors due to complex instructions, suboptimal parallel processing, and inefficient dataflow mapping. To tackle the challenges mentioned above, SPEED, a scalable RISC-V vector (RVV) processor, is proposed to enable efficient MP-DNN inference, incorporating innovations in customized instructions, hardware architecture, and dataflow mapping. Firstly, some dedicated customized RISC-V instructions are introduced based on RVV extensions to reduce the instruction complexity, allowing SPEED to support processing precision ranging from 4-bit to 16-bit with minimized hardware overhead. Secondly, a parameterized multi-precision tensor unit is developed and integrated within the scalable module to enhance parallel processing capability by providing reconfigurable parallelism that matches the computation patterns of diverse MP-DNNs. Finally, a flexible mixed dataflow method is adopted to improve computational and energy efficiency according to the computing patterns of different DNN operators. The synthesis of SPEED is conducted on TSMC 28nm technology. Experimental results show that SPEED achieves a peak throughput of 737.9 GOPS and an energy efficiency of 1383.4 GOPS/W for 4-bit operators. Furthermore, SPEED exhibits superior area efficiency compared to prior RVV processors, with enhancements of 5.9$\sim$26.9$\times$ and 8.2$\sim$18.5$\times$ for 8-bit operator and best integer performance, respectively, which highlights SPEED's significant potential for efficient MP-DNN inference.

cs.AR↗

arXiv2024

Unraveling the Trigger Mechanism of Explosive Reconnection in Partially Ionized Solar Plasma

Plasmoid instability is usually accounted for the onset of fast reconnection events observed in astrophysical plasmas. However, the measured reconnection rate from observations can be one order of magnitude higher than that derived from MHD simulations. In this study, we present the results of magnetic reconnection in the partially ionized low solar atmosphere based on 2.5D magnetohydrodynamics (MHD) simulations. The whole reconnection process covers two different fast reconnection phases. In the first phase, the slow Sweet-Parker reconnection transits to the plasmoid-mediated reconnection, and the reconnection rate reaches about 0.02. In the second phase, a faster explosive reconnection appears, with the reconnection rate reaching above 0.06. At the same time, a sharp decrease in plasma temperature and density at the principle X-point is observed which is associated with the strong radiative cooling, the ejection of hot plasma from the local reconnection region or the motion of principle X-point from hot and denser region to cool and less dense one along the narrow current sheet. This causes gas pressure depletion and the increasing of magnetic diffusion at the main X-point, resulting in the local Petschek-like reconnection and a violent and rapid increase in the reconnection rate. This study for the first time reveals a common phenomenon that the plasmoid dominated reconnection transits to an explosive faster reconnection with the rate approaching the order of 0.1 in partially ionized plasma in the MHD scale.

astro-ph.SR↗

arXiv2024

Evidence for Plasmoid-mediated Magnetic Reconnection during a Small-scale Flare in the Partially Ionized Low Solar Atmosphere

Magnetic reconnection plays a crucial role in the energy release process for different kinds of solar eruptions and activities. The rapid solar eruption requires a fast reconnection model. Plasmoid instability in the reconnecting current sheets is one of the most acceptable fast reconnection mechanisms for explaining the explosive events in the magnetohydrodynamics (MHD) scale, which is also a potential bridge between the macroscopic MHD reconnection process and microscale dissipations. Plenty of high resolution observations indicate that the plasmoid-like structures exist in the high temperature solar corona, but such evidences are very rare in the lower solar atmosphere with partially ionized plasmas. Utilizing joint observations from the Goode Solar Telescope (GST) and the Solar Dynamics Observatory (SDO), we discovered a small-scale eruptive phenomenon in NOAA AR 13085, characterized by clear reconnection cusp structures, supported by Nonlinear Force-Free Field (NLFFF) extrapolation results. The plasmoid-like structures with a size about 150 km were observed to be ejected downward from the current sheet at a maximum velocity of 24 km$\cdot$s$^{-1}$ in the H$α$ line wing images, followed by enhanced emissions at around the post flare loop region in multiple wave lengths. Our 2.5D high-resolution MHD simulations further reproduced such a phenomenon and revealed reconnection fine structures. These results provide comprehensive evidences for the plasmoid mediated reconnection in partially ionized plasmas, and suggest an unified reconnection model for solar flares with different length scales from the lower chromosphere to corona.

astro-ph.SR↗

arXiv2024

I3: Intent-Introspective Retrieval Conditioned on Instructions

Recent studies indicate that dense retrieval models struggle to perform well on a wide variety of retrieval tasks that lack dedicated training data, as different retrieval tasks often entail distinct search intents. To address this challenge, in this work we leverage instructions to flexibly describe retrieval intents and introduce I3, a unified retrieval system that performs Intent-Introspective retrieval across various tasks, conditioned on Instructions without any task-specific training. I3 innovatively incorporates a pluggable introspector in a parameter-isolated manner to comprehend specific retrieval intents by jointly reasoning over the input query and instruction, and seamlessly integrates the introspected intent into the original retrieval model for intent-aware retrieval. Furthermore, we propose progressively-pruned intent learning. It utilizes extensive LLM-generated data to train I3 phase-by-phase, embodying two key designs: progressive structure pruning and drawback extrapolation-based data refinement. Extensive experiments show that in the BEIR benchmark, I3 significantly outperforms baseline methods designed with task-specific retrievers, achieving state-of-the-art zero-shot performance without any task-specific tuning.

cs.CL↗

arXiv2024

Music Style Transfer With Diffusion Model

Previous studies on music style transfer have mainly focused on one-to-one style conversion, which is relatively limited. When considering the conversion between multiple styles, previous methods required designing multiple modes to disentangle the complex style of the music, resulting in large computational costs and slow audio generation. The existing music style transfer methods generate spectrograms with artifacts, leading to significant noise in the generated audio. To address these issues, this study proposes a music style transfer framework based on diffusion models (DM) and uses spectrogram-based methods to achieve multi-to-multi music style transfer. The GuideDiff method is used to restore spectrograms to high-fidelity audio, accelerating audio generation speed and reducing noise in the generated audio. Experimental results show that our model has good performance in multi-mode music style transfer compared to the baseline and can generate high-quality audio in real-time on consumer-grade GPUs.

cs.SD↗

arXiv2024

Seismic Interpolation Transformer for Consecutively Missing Data: A Case Study in DAS-VSP Data

Distributed optical fiber acoustic sensing (DAS) is a rapidly-developed seismic acquisition technology with advantages of low cost, high resolution, high sensitivity, and small interval, etc. Nonetheless, consecutively missing cases often appear in real seismic data acquired by DAS system due to some factors, including optical fiber damage and inferior coupling between cable and well. Recently, some deep-learning seismic interpolation methods based on convolutional neural network (CNN) have shown impressive performance in regular and random missing cases but still remain the consecutively missing case as a challenging task. The main reason is that the weight sharing makes it difficult for CNN to capture enough comprehensive features. In this paper, we propose a transformer-based interpolation method, called seismic interpolation transformer (SIT), to deal with the consecutively missing case. This proposed SIT is an encoder-decoder structure connected by some U-shaped swin-transformer blocks. In encoder and decoder part, the multi-head self-attention (MSA) mechanism is used to capture global features which is essential for the reconstruction of consecutively missing traces. The U-shaped swin-transformer blocks are utilized to perform feature extraction operations on feature maps with different resolutions. Moreover, we combine the loss based on structural similarity index (SSIM) and L1 norm to propose a novel loss function for SIT. In experiments, this proposed SIT outperforms U-Net and swin-transformer. Moreover, ablation studies also demonstrate the advantages of new network architecture and loss function.

physics.geo-ph↗

arXiv2024

An FPGA-Based Accelerator Enabling Efficient Support for CNNs with Arbitrary Kernel Sizes

Convolutional neural networks (CNNs) with large kernels, drawing inspiration from the key operations of vision transformers (ViTs), have demonstrated impressive performance in various vision-based applications. To address the issue of computational efficiency degradation in existing designs for supporting large-kernel convolutions, an FPGA-based inference accelerator is proposed for the efficient deployment of CNNs with arbitrary kernel sizes. Firstly, a Z-flow method is presented to optimize the computing data flow by maximizing data reuse opportunity. Besides, the proposed design, incorporating the kernel-segmentation (Kseg) scheme, enables extended support for large-kernel convolutions, significantly reducing the storage requirements for overlapped data. Moreover, based on the analysis of typical block structures in emerging CNNs, vertical-fused (VF) and horizontal-fused (HF) methods are developed to optimize CNN deployments from both computation and transmission perspectives. The proposed hardware accelerator, evaluated on Intel Arria 10 FPGA, achieves up to 3.91 times better DSP efficiency than prior art on the same network. Particularly, it demonstrates efficient support for large-kernel CNNs, achieving throughputs of 169.68 GOPS and 244.55 GOPS for RepLKNet-31 and PyConvResNet-50, respectively, both of which are implemented on hardware for the first time.

cs.AR↗

arXiv2024

A magnetic reconnection model for the hot explosion with both ultraviolet and Hα wing emissions

Ellerman bombs (EBs) with significant H$α$ wing emissions and ultraviolet bursts (UV bursts) with strong Si IV emissions are two kinds of small transient brightening events that occur in the low solar atmosphere.We numerically investigated the magnetic reconnection process between the emerging arch magnetic field and the lower atmospheric background magnetic field. We aim to find out if the hot UV emissions and much colder H$α$ wing emissions can both appear in the same reconnection process and how they are located in the reconnection region. The open-source code NIRVANA was applied to perform the 2.5D magnetohydrodynamic (MHD) simulation. We developed the related sub-codes to include the more realistic radiative cooling process for the photosphere and chromosphere and the time-dependent ionization degree of hydrogen. The initial background magnetic field is 600 G, and the emerged magnetic field in the solar atmosphere is of the same magnitude, meaning that it results in a low- $β$ magnetic reconnection environment. We also used the radiative transfer code RH1.5D to synthesize the Si IV and H$α$ spectral line profiles based on the MHD simulation results. Magnetic reconnection between emerged and background magnetic fields creates a thin, curved current sheet, which then leads to the formation of plasmoid instability and the nonuniform density distributions. The mix of hot tenuous and much cooler dense plasmas in the turbulent reconnection region can appear at about the same height, or even in the same plasmoid. The turbulent current sheet is always in a dense plasma environment with an optical depth larger than 6.5$\times$10$^{-5}$ due to the emerged magnetic field pushing high-density plasmas upward.

astro-ph.SR↗

arXiv2024

A Scalable RISC-V Vector Processor Enabling Efficient Multi-Precision DNN Inference

RISC-V processors encounter substantial challenges in deploying multi-precision deep neural networks (DNNs) due to their restricted precision support, constrained throughput, and suboptimal dataflow design. To tackle these challenges, a scalable RISC-V vector (RVV) processor, namely SPEED, is proposed to enable efficient multi-precision DNN inference by innovations from customized instructions, hardware architecture, and dataflow mapping. Firstly, dedicated customized RISC-V instructions are proposed based on RVV extensions, providing SPEED with fine-grained control over processing precision ranging from 4 to 16 bits. Secondly, a parameterized multi-precision systolic array unit is incorporated within the scalable module to enhance parallel processing capability and data reuse opportunities. Finally, a mixed multi-precision dataflow strategy, compatible with different convolution kernels and data precision, is proposed to effectively improve data utilization and computational efficiency. We perform synthesis of SPEED in TSMC 28nm technology. The experimental results demonstrate that SPEED achieves a peak throughput of 287.41 GOPS and an energy efficiency of 1335.79 GOPS/W at 4-bit precision condition, respectively. Moreover, when compared to the pioneer open-source vector processor Ara, SPEED provides an area efficiency improvement of 2.04$\times$ and 1.63$\times$ under 16-bit and 8-bit precision conditions, respectively, which shows SPEED's significant potential for efficient multi-precision DNN inference.

cs.AR↗

arXiv2024

North-South asymmetries in the Galactic thin disk associated with the vertical phase spiral as seen using LAMOST-Gaia stars

We select 1,052,469 (754,635) thin disk stars from {\it Gaia} eDR3 and LAMOST DR7 in the range of Galactocentric radius $R$ (guiding center radius $R_\mathrm{g}$) from 8 to 11\,kpc to investigate the asymmetries between the North and South of the disk midplane. More specifically we analyze the vertical velocity dispersion profiles ($σ_{v_{z}}(z$)) in different bins of $R$ ($R_\mathrm{g}$) and $[\mathrm{Fe/H}]$. We find troughs in the profiles of $σ_{v_{z}}(z)$ located in both the North ($z \sim 0.7$\,kpc) and South ($z \sim -0.5$\,kpc) of the disk at all radial and chemical bins studied. The difference between the Northern and Southern vertical velocity dispersion profiles ($Δσ_{v_{z}}(|z|)$) shows a shift between curves of different $R$ and $R_\mathrm{g}$. A similar shift exists in these NS asymmetry profiles further divided into different $[\mathrm{Fe/H}]$ ranges. The sample binned with $R_\mathrm{g}$ more clearly displays the features in the velocity dispersion profiles. The shift in the peaks of the $Δσ_{v_{z}}$ profiles and the variation in the phase spiral shape binned by metallicity indicate the variation of the vertical potential profiles and the radial metallicity gradient. The wave-like signal in NS asymmetry of $σ_{v_{z}}(z)$ largely originates from phase spiral; while the NS asymmetry profiles of [Fe/H] only display a weak wave-like feature near solar radius. We perform a test particle simulation to qualitatively reproduce the observed results. A quantitative explanation of the NS asymmetry in the metallicity profile needs careful consideration of the spiral shape and the perturbation model, and we leave this for future work.

astro-ph.GA↗

arXiv2023

Excitation of quasi-periodic fast-propagating waves in the early stage of the solar eruption

We propose a mechanism for the excitation of large-scale quasi-periodic fast-propagating magnetoacoustic (QFP) waves observed on both sides of the coronal mass ejection (CME). Through a series of numerical experiments, we successfully simulated the quasi-static evolution of the equilibrium locations of the magnetic flux rope in response to the change of the background magnetic field, as well as the consequent loss of the equilibrium that eventually gives rise to the eruption. During the eruption, we identified QFP waves propagating radially outwards the flux rope, and tracing their origin reveals that they result from the disturbance within the flux rope. Acting as an imperfect waveguide, the flux rope allows the internal disturbance to escape to the outside successively via its surface, invoking the observed QFP waves. Furthermore, we synthesized the images of QFP waves on the basis of the data given by our simulations, and found the consistence with observations. This indicates that the leakage of the disturbance outside the flux rope could be a reasonable mechanism of QFP waves.

astro-ph.SR↗

arXiv2023

Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document

Visual Relation Extraction (VRE) is a powerful means of discovering relationships between entities within visually-rich documents. Existing methods often focus on manipulating entity features to find pairwise relations, yet neglect the more fundamental structural information that links disparate entity pairs together. The absence of global structure information may make the model struggle to learn long-range relations and easily predict conflicted results. To alleviate such limitations, we propose a GlObal Structure knowledge-guided relation Extraction (GOSE) framework. GOSE initiates by generating preliminary relation predictions on entity pairs extracted from a scanned image of the document. Subsequently, global structural knowledge is captured from the preceding iterative predictions, which are then incorporated into the representations of the entities. This "generate-capture-incorporate" cycle is repeated multiple times, allowing entity representations and global structure knowledge to be mutually reinforced. Extensive experiments validate that GOSE not only outperforms existing methods in the standard fine-tuning setting but also reveals superior cross-lingual learning capabilities; indeed, even yields stronger data-efficient performance in the low-resource setting. The code for GOSE will be available at https://github.com/chenxn2020/GOSE.

cs.CL↗

arXiv2023

Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization

Prompt tuning is a parameter-efficient method, which learns soft prompts and conditions frozen language models to perform specific downstream tasks. Though effective, prompt tuning under few-shot settings on the one hand heavily relies on a good initialization of soft prompts. On the other hand, it can easily overfit to few-shot training samples, thereby undermining generalizability. Existing works leverage pre-training or supervised meta-learning to initialize soft prompts but they fail to data-efficiently generalize to unseen downstream tasks. To address the above problems, this paper proposes a novel Self-sUpervised meta-Prompt learning framework with MEta-gradient Regularization for few-shot generalization (SUPMER). SUPMER leverages self-supervised meta-learning with a diverse set of well-designed meta-training tasks to learn a universal prompt initialization for efficient adaptation using only unlabeled data. Additionally, it jointly meta-learns a gradient regularization function to transform raw gradients into a domain-generalizable direction, thus alleviating the problem of overfitting. Extensive experiments show that SUPMER achieves better performance for different few-shot downstream tasks, and also exhibits a stronger domain generalization ability. The code for SUPMER will be available at https://github.com/beepkh/SUPMER.

cs.CL↗

arXiv2023

A Precision-Scalable RISC-V DNN Processor with On-Device Learning Capability at the Extreme Edge

Extreme edge platforms, such as in-vehicle smart devices, require efficient deployment of quantized deep neural networks (DNNs) to enable intelligent applications with limited amounts of energy, memory, and computing resources. However, many edge devices struggle to boost inference throughput of various quantized DNNs due to the varying quantization levels, and these devices lack floating-point (FP) support for on-device learning, which prevents them from improving model accuracy while ensuring data privacy. To tackle the challenges above, we propose a precision-scalable RISC-V DNN processor with on-device learning capability. It facilitates diverse precision levels of fixed-point DNN inference, spanning from 2-bit to 16-bit, and enhances on-device learning through improved support with FP16 operations. Moreover, we employ multiple methods such as FP16 multiplier reuse and multi-precision integer multiplier reuse, along with balanced mapping of FPGA resources, to significantly improve hardware resource utilization. Experimental results on the Xilinx ZCU102 FPGA show that our processor significantly improves inference throughput by 1.6$\sim$14.6$\times$ and energy efficiency by 1.1$\sim$14.6$\times$ across various DNNs, compared to the prior art, XpulpNN. Additionally, our processor achieves a 16.5$\times$ higher FP throughput for on-device learning.

cs.AR↗

arXiv2023

Can the Parker Solar Probe Detect a CME-flare Current Sheet?

A current sheet (CS) is the central structure in the disrupting magnetic configuration during solar eruptions. More than 90\% of the free magnetic energy (the difference between the energy in the non-potential magnetic field and that in the potential one) stored in the coronal magnetic field beforehand is converted into heating and kinetic energy of the plasma, as well as accelerating charged particles, by magnetic reconnection occurring in the CS. However, the detailed physical properties and fine structures of the CS are still unknown since there is no relevant information obtained via in situ detections. The Parker Solar Probe (PSP) may provide us such information should it traverse a CS in the eruption. The perihelion of PSP's final orbit is located at about 10 solar radii from the center of the Sun, so it can observe the CS at a very close distance, or even traverses the CS, which provides us a unique opportunity to look into fine properties and structures of the CS, helping reveal the detailed physics of large-scale reconnection that was impossible before. We evaluate the probability that PSP can traverse a CS, and examine the orbit of a PSP-like spacecraft that has the highest probability to traverse a CS.

astro-ph.SR↗