arXiv Science⌕ Search

arXiv subjects

Jun Li

Publications and source records attributed to Jun Li.

At least 415 records · Page 23Linked to original sources

Ploutos: Towards interpretable stock movement prediction with financial large language model

Recent advancements in large language models (LLMs) have opened new pathways for many domains. However, the full potential of LLMs in financial investments remains largely untapped. There are two main challenges for typical deep learning-based methods for quantitative finance. First, they struggle to fuse textual and numerical information flexibly for stock movement prediction. Second, traditional methods lack clarity and interpretability, which impedes their application in scenarios where the justification for predictions is essential. To solve the above challenges, we propose Ploutos, a novel financial LLM framework that consists of PloutosGen and PloutosGPT. The PloutosGen contains multiple primary experts that can analyze different modal data, such as text and numbers, and provide quantitative strategies from different perspectives. Then PloutosGPT combines their insights and predictions and generates interpretable rationales. To generate accurate and faithful rationales, the training strategy of PloutosGPT leverage rearview-mirror prompting mechanism to guide GPT-4 to generate rationales, and a dynamic token weighting mechanism to finetune LLM by increasing key tokens weight. Extensive experiments show our framework outperforms the state-of-the-art methods on both prediction accuracy and interpretability.

q-fin.ST↗

Spatial Variations of Dust Opacity and Grain Growth in Dark Clouds: L1689, L1709 and L1712

The far-infrared (FIR) opacity of dust in dark clouds within the Ophiuchus molecular cloud is investigated through multi-wavelength infrared observations from UKIDSS, Spitzer and Herschel. Employing the infrared color excess technique with both near-infrared (NIR) and mid-infrared (MIR) photometric data, a high-resolution extinction map in the $K$ band ($A_K$) is constructed for three dark clouds: L1689, L1709, and L1712. The derived extinction map has a resolution of $1'$ and reaches a depth of $A_K\sim3$ mag. The FIR optical depths $τ_{250}$ at a reference wavelength of $250\,\rm μm$ are obtained by fitting the Herschel PACS and SPIRE continuum data at 100, 160, 250, 350 and 500 $\rm μm$ using a modified blackbody model. The average dust opacity per unit gas mass at $250\rm μm$, $rκ_{250}$ is determined through a pixel-by-pixel correlation of $τ_{250}$ with $A_K$, yielding a value of approximately $0.09\,\rm cm^2\,g^{-1}$, which is about 2-3 times higher than the typical value in the diffuse interstellar medium (ISM). Additionally, an independent analysis across 16 sub-regions within the Ophiuchus cloud indicates spatial variations in dust opacity, with values ranging from 0.07-0.12$\,\rm cm^2\,g^{-1}$. Although the observed trend of increasing dust opacity with higher extinction implies grain growth, our findings indicate that rapid grain growth clearly not yet occurred in the dark clouds studied in this work.

astro-ph.GA↗

Distributed Generalized Nash Equilibria Seeking Algorithms Involving Synchronous and Asynchronous Schemes

This paper considers a class of noncooperative games in which the feasible decision sets of all players are coupled together by a coupled inequality constraint. Adopting the variational inequality formulation of the game, we first introduce a new local edge-based equilibrium condition and develop a distributed primal-dual proximal algorithm with full information. Considering challenges when communication delays occur, we devise an asynchronous distributed algorithm to seek a generalized Nash equilibrium. This asynchronous scheme arbitrarily activates one player to start new computations independently at different iteration instants, which means that the picked player can use the involved out-dated information from itself and its neighbors to perform new updates. A distinctive attribute is that the proposed algorithms enable the derivation of new distributed forward-backward-like extensions. In theoretical aspect, we provide explicit conditions on algorithm parameters, for instance, the step-sizes to establish a sublinear convergence rate for the proposed synchronous algorithm. Moreover, the asynchronous algorithm guarantees almost sure convergence in expectation under the same step-size conditions and some standard assumptions. An interesting observation is that our analysis approach improves the convergence rate of prior synchronous distributed forward-backward-based algorithms. Finally, the viability and performance of the proposed algorithms are demonstrated by numerical studies on the networked Cournot competition.

cs.GT↗

Private Knowledge Sharing in Distributed Learning: A Survey

The rise of Artificial Intelligence (AI) has revolutionized numerous industries and transformed the way society operates. Its widespread use has led to the distribution of AI and its underlying data across many intelligent systems. In this light, it is crucial to utilize information in learning processes that are either distributed or owned by different entities. As a result, modern data-driven services have been developed to integrate distributed knowledge entities into their outcomes. In line with this goal, the latest AI models are frequently trained in a decentralized manner. Distributed learning involves multiple entities working together to make collective predictions and decisions. However, this collaboration can also bring about security vulnerabilities and challenges. This paper provides an in-depth survey on private knowledge sharing in distributed learning, examining various knowledge components utilized in leading distributed learning architectures. Our analysis sheds light on the most critical vulnerabilities that may arise when using these components in a distributed setting. We further identify and examine defensive strategies for preserving the privacy of these knowledge components and preventing malicious parties from manipulating or accessing the knowledge information. Finally, we highlight several key limitations of knowledge sharing in distributed learning and explore potential avenues for future research.

cs.CR↗

PVLR: Prompt-driven Visual-Linguistic Representation Learning for Multi-Label Image Recognition

Multi-label image recognition is a fundamental task in computer vision. Recently, vision-language models have made notable advancements in this area. However, previous methods often failed to effectively leverage the rich knowledge within language models and instead incorporated label semantics into visual features in a unidirectional manner. In this paper, we propose a Prompt-driven Visual-Linguistic Representation Learning (PVLR) framework to better leverage the capabilities of the linguistic modality. In PVLR, we first introduce a dual-prompting strategy comprising Knowledge-Aware Prompting (KAP) and Context-Aware Prompting (CAP). KAP utilizes fixed prompts to capture the intrinsic semantic knowledge and relationships across all labels, while CAP employs learnable prompts to capture context-aware label semantics and relationships. Later, we propose an Interaction and Fusion Module (IFM) to interact and fuse the representations obtained from KAP and CAP. In contrast to the unidirectional fusion in previous works, we introduce a Dual-Modal Attention (DMA) that enables bidirectional interaction between textual and visual features, yielding context-aware label representations and semantic-related visual representations, which are subsequently used to calculate similarities and generate final predictions for all labels. Extensive experiments on three popular datasets including MS-COCO, Pascal VOC 2007, and NUS-WIDE demonstrate the superiority of PVLR.

cs.CV↗

Formation Mechanism of Laser-Driven Magnetized "Pillars of Creation"

Pillars of Creation, one of the most recognized objects in the sky, are believed to be associated with the formation of young stars. However, so far, the formation and maintenance mechanism for the pillars are still not fully understood due to the complexity of the nonlinear radiation magneto-hydrodynamics (RMHD). Here, assuming laboratory laser-driven conditions, we studied the self-consistent dynamics of pillar structures in magnetic fields by means of two-dimensional (2D) and three-dimensional (3D) RMHD simulations, and these results also support our proposed experimental scheme. We find only when the magnetic pressure and ablation pressure are comparable, the magnetic field can significantly alter the plasma hydrodynamics. For medium magnetized cases ($β_{initial} \approx 3.5$), {the initial magnetic fields undergo compression and amplification. This amplification results in the magnetic pressure inside the pillar becoming large enough to support the sides of the pillar against radial collapse due to pressure from the surrounding hot plasma. This effect is particularly pronounced for the parallel component ($B_y$), which is consistent with observational results.} In contrast, a strong perpendicular ($B_x, B_z$) magnetic field ($β_{initial} < 1$) almost remains its initial distribution and significantly suppresses the expansion of blow-off gas plasma, leading to the inability to form pillar-like structures. The 3D simulations suggest that the bending at the head of `Column \uppercase\expandafter{\romannumeral1}' in pillars of creation may be due to the non-parallel magnetic fields. After similarity scaling transformation, our results can be applied to explain the formation and maintenance mechanism of the pillars, and can also provide useful information for future experimental designs.

physics.plasm-ph↗

Nonreciprocal charge transport in the titanium sesquioxide heterointerface superconductor

Nonreciprocal charge transport in heterostructural superconductors exhibits appealing quantum physical phenomena and holds the promising potential for superconducting circuits applications. Realizing a nonreciprocity is, however, fundamentally and technologically challenging, as it requires a material structure without a centre of inversion, which is scarce among superconducting materials. Here, we report an evidence of helical superconductivity, in which the Rashba spin-orbit coupling induces momentum-dependent superconducting gap in the inversion symmetry breaking heterointerface superconductor consisting of Mott insulating Ti$_2$O$_3$ and polar semiconducting GaN. Remarkably, the nonlinear responses emerge in the superconducting transition regime, when the magnetic field is precisely aligned in-plane orientations perpendicular to the applied current. In particular, the observed nonreciprocal supercurrent is extremely sensitive to the direction of the magnetic field for 0.5 degree, suggestive of a crossover from a symmetry breaking state to a symmetric one. Our finding not only unveils the underlying rich physical properties in heterointerface superconductors, but also provides an exciting opportunity for the development of novel mesoscopic superconducting devices.

cond-mat.supr-con↗

Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning

Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that devices actively participate in local training. However, there are few studies on incentive mechanism design for HFL. In this paper, we design two-level incentive mechanisms for the HFL with a two-tiered computing structure to encourage the participation of entities in each tier in the HFL training. In the lower-level game, we propose a coalition formation game to joint optimize the edge association and bandwidth allocation problem, and obtain efficient coalition partitions by the proposed preference rule, which can be proven to be stable by exact potential game. In the upper-level game, we design the Stackelberg game algorithm, which not only determines the optimal number of edge aggregations for edge servers to maximize their utility, but also optimize the unit reward provided for the edge aggregation performance to ensure the interests of cloud servers. Furthermore, numerical results indicate that the proposed algorithms can achieve better performance than the benchmark schemes.

cs.GT↗

Constraints on Axion-like Particles from the Observation of GRB 221009A by LHAASO

The LHAASO collaboration recently reported the measurement of the gamma-ray spectra of GRB 221009A, which is the brightest burst ever, covering an energy range from 0.3 $\mathrm{TeV}$ to about 10 $\mathrm{TeV}$. Based on the observation, we investigate the ALP-photon oscillation effect in the host galaxy of GRB 221009A and the Milky Way. The ${\rm CL_s}$ method is applied to set constraints on the ALP parameters in this study. Given the uncertain magnetic field configuration in the host galaxy, we use three different models: a homogeneous magnetic field model, a magnetic field model identical to that of the Milky Way, and a model constructed from the HST observations of the host galaxy. We find that the constraints derived using these three host galaxy magnetic field models are comparable. Our results are complementary in the small ALP mass regions compared with other experiments.

astro-ph.HE↗

Non-aligned supervision for Real Image Dehazing

Removing haze from real-world images is challenging due to unpredictable weather conditions, resulting in the misalignment of hazy and clear image pairs. In this paper, we propose an innovative dehazing framework that operates under non-aligned supervision. This framework is grounded in the atmospheric scattering model, and consists of three interconnected networks: dehazing, airlight, and transmission networks. In particular, we explore a non-alignment scenario that a clear reference image, unaligned with the input hazy image, is utilized to supervise the dehazing network. To implement this, we present a multi-scale reference loss that compares the feature representations between the referred image and the dehazed output. Our scenario makes it easier to collect hazy/clear image pairs in real-world environments, even under conditions of misalignment and shift views. To showcase the effectiveness of our scenario, we have collected a new hazy dataset including 415 image pairs captured by mobile Phone in both rural and urban areas, called "Phone-Hazy". Furthermore, we introduce a self-attention network based on mean and variance for modeling real infinite airlight, using the dark channel prior as positional guidance. Additionally, a channel attention network is employed to estimate the three-channel transmission. Experimental results demonstrate the superior performance of our framework over existing state-of-the-art techniques in the real-world image dehazing task. Phone-Hazy and code will be available at https://fanjunkai1.github.io/projectpage/NSDNet/index.html.

cs.CV↗

Constraints on Axion-like Particles from the Observation of Galactic Sources by LHAASO

High-energy photons may oscillate with axion-like particles (ALPs) when they propagate through the Milky Way's magnetic field, resulting in an alteration in the observed photon energy spectrum. The ultra-high energy gamma-ray spectra, measured by the Large High Altitude Air Shower Observatory (LHAASO) up to $\mathcal{O}(1)~\mathrm{PeV}$, provide a promising opportunity to investigate the ALP-photon oscillation effect. In this study, we utilize the gamma-ray spectra of four Galactic sources measured by LHAASO, including the Crab Nebula, LHAASO J2226+6057, LHAASO J1908+0621, and LHAASO J1825-1326, to explore this effect. We employ the $\rm CL_s$ method to set constraints on the ALP parameters. Combing the observations of the four sources, our analysis reveals that the ALP-photon coupling $g_{aγ}$ is constrained to be smaller than $1.4\times10^{-10}$ ${\rm GeV}^{-1}$ for the ALP mass of $\sim 4\times10^{-7} ~\mathrm{eV}$ at the 95\% C.L. By combing the observations of the Crab Nebula from LHAASO and other experiments, we find that the ALP-photon coupling could be set to be about $7.2\times10^{-11}$ ${\rm GeV}^{-1}$ for the ALP mass $\sim 4 \times10^{-7}~\mathrm{eV}$ , which is in close proximity to the CAST constraint.

astro-ph.HE↗

Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute

Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and the scarcity of realistic 3D human avatar datasets. To address these issues, we propose Text2Avatar, which can generate realistic-style 3D avatars based on the coupled text prompts. Text2Avatar leverages a discrete codebook as an intermediate feature to establish a connection between text and avatars, enabling the disentanglement of features. Furthermore, to alleviate the scarcity of realistic style 3D human avatar data, we utilize a pre-trained unconditional 3D human avatar generation model to obtain a large amount of 3D avatar pseudo data, which allows Text2Avatar to achieve realistic style generation. Experimental results demonstrate that our method can generate realistic 3D avatars from coupled textual data, which is challenging for other existing methods in this field.

cs.CV↗

Exploring Multi-Modal Control in Music-Driven Dance Generation

Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these issues, we propose a unified framework capable of generating high-quality dance movements and supporting multi-modal control, including genre control, semantic control, and spatial control. First, we decouple the dance generation network from the dance control network, thereby avoiding the degradation in dance quality when adding additional control information. Second, we design specific control strategies for different control information and integrate them into a unified framework. Experimental results show that the proposed dance generation framework outperforms state-of-the-art methods in terms of motion quality and controllability.

cs.SD↗

Gradient Sparsification for Efficient Wireless Federated Learning with Differential Privacy

Federated learning (FL) enables distributed clients to collaboratively train a machine learning model without sharing raw data with each other. However, it suffers the leakage of private information from uploading models. In addition, as the model size grows, the training latency increases due to limited transmission bandwidth and the model performance degrades while using differential privacy (DP) protection. In this paper, we propose a gradient sparsification empowered FL framework over wireless channels, in order to improve training efficiency without sacrificing convergence performance. Specifically, we first design a random sparsification algorithm to retain a fraction of the gradient elements in each client's local training, thereby mitigating the performance degradation induced by DP and and reducing the number of transmission parameters over wireless channels. Then, we analyze the convergence bound of the proposed algorithm, by modeling a non-convex FL problem. Next, we formulate a time-sequential stochastic optimization problem for minimizing the developed convergence bound, under the constraints of transmit power, the average transmitting delay, as well as the client's DP requirement. Utilizing the Lyapunov drift-plus-penalty framework, we develop an analytical solution to the optimization problem. Extensive experiments have been implemented on three real life datasets to demonstrate the effectiveness of our proposed algorithm. We show that our proposed algorithms can fully exploit the interworking between communication and computation to outperform the baselines, i.e., random scheduling, round robin and delay-minimization algorithms.

cs.DC↗

Satellite Impact on Astronomical Observations Based on Elliptical Orbit Model

Space-based and ground-based telescopes have extensively documented the impact of satellites on astronomical observations. With the proliferation of satellite mega-constellation programs, their influence on astronomical observations has become undeniable. It is crucial to quantify the impact of satellites on telescopes. To address this need, we have enhanced the circular orbit model for satellites and introduced a methodology based on two-line element (TLE) orbit data. This involves constructing a satellite probability distribution model to evaluate the impact of satellites on telescopes. Using our method, we assessed the satellite impact on global observatories. The results indicate that the regions most severely affected by satellite interference currently are those near the equator, with latitudes around 50 and 80 degrees experiencing the most significant impact from low Earth orbit satellites. Furthermore, we validated the reliability of our method using imaging data obtained from the focal surface acquisition camera of the LAMOST telescope.

astro-ph.IM↗

Towards Balanced Alignment: Modal-Enhanced Semantic Modeling for Video Moment Retrieval

Video Moment Retrieval (VMR) aims to retrieve temporal segments in untrimmed videos corresponding to a given language query by constructing cross-modal alignment strategies. However, these existing strategies are often sub-optimal since they ignore the modality imbalance problem, \textit{i.e.}, the semantic richness inherent in videos far exceeds that of a given limited-length sentence. Therefore, in pursuit of better alignment, a natural idea is enhancing the video modality to filter out query-irrelevant semantics, and enhancing the text modality to capture more segment-relevant knowledge. In this paper, we introduce Modal-Enhanced Semantic Modeling (MESM), a novel framework for more balanced alignment through enhancing features at two levels. First, we enhance the video modality at the frame-word level through word reconstruction. This strategy emphasizes the portions associated with query words in frame-level features while suppressing irrelevant parts. Therefore, the enhanced video contains less redundant semantics and is more balanced with the textual modality. Second, we enhance the textual modality at the segment-sentence level by learning complementary knowledge from context sentences and ground-truth segments. With the knowledge added to the query, the textual modality thus maintains more meaningful semantics and is more balanced with the video modality. By implementing two levels of MESM, the semantic information from both modalities is more balanced to align, thereby bridging the modality gap. Experiments on three widely used benchmarks, including the out-of-distribution settings, show that the proposed framework achieves a new start-of-the-art performance with notable generalization ability (e.g., 4.42% and 7.69% average gains of R1@0.7 on Charades-STA and Charades-CG). The code will be available at https://github.com/lntzm/MESM.

cs.CV↗

Collisionless cooling of perpendicular electron temperature in the thermal quench of a magnetized plasma

Thermal quench of a nearly collisionless plasma against a cooling boundary or region is an undesirable off-normal event in magnetic fusion experiments, but an ubiquitous process of cosmological importance in astrophysical plasmas. There is a well-known mismatch that what experimentally diagnosed is the drop in perpendicular electron temperature $T_{e\perp},$ but the parallel transport theory of ambipolar-constrained tail electron loss produces parallel electron temperature $T_{e\parallel}$ cooling. Here two collisionless mechanisms, dilutional cooling by infalling cold electrons and wave-particle interaction by two families of whistler instabilities, are shown to enable fast $T_{e\perp}$ cooling that closely tracks the mostly collisionless crash of $T_{e\parallel}.$

physics.plasm-ph↗

Compound Text-Guided Prompt Tuning via Image-Adaptive Cues

Vision-Language Models (VLMs) such as CLIP have demonstrated remarkable generalization capabilities to downstream tasks. However, existing prompt tuning based frameworks need to parallelize learnable textual inputs for all categories, suffering from massive GPU memory consumption when there is a large number of categories in the target dataset. Moreover, previous works require to include category names within prompts, exhibiting subpar performance when dealing with ambiguous category names. To address these shortcomings, we propose Compound Text-Guided Prompt Tuning (TGP-T) that significantly reduces resource demand while achieving superior performance. We introduce text supervision to the optimization of prompts, which enables two benefits: 1) releasing the model reliance on the pre-defined category names during inference, thereby enabling more flexible prompt generation; 2) reducing the number of inputs to the text encoder, which decreases GPU memory consumption significantly. Specifically, we found that compound text supervisions, i.e., category-wise and content-wise, is highly effective, since they provide inter-class separability and capture intra-class variations, respectively. Moreover, we condition the prompt generation on visual features through a module called Bonder, which facilitates the alignment between prompts and visual features. Extensive experiments on few-shot recognition and domain generalization demonstrate that TGP-T achieves superior performance with consistently lower training costs. It reduces GPU memory usage by 93% and attains a 2.5% performance gain on 16-shot ImageNet. The code is available at https://github.com/EricTan7/TGP-T.

cs.CV↗