arXiv subjects

Jianyu Zhang

Publications and source records attributed to Jianyu Zhang.

At least 37 records · Page 2Linked to original sources

arXiv2025

AgriGPT: a Large Language Model Ecosystem for Agriculture

Despite the rapid progress of Large Language Models (LLMs), their application in agriculture remains limited due to the lack of domain-specific models, curated datasets, and robust evaluation frameworks. To address these challenges, we propose AgriGPT, a domain-specialized LLM ecosystem for agricultural usage. At its core, we design a multi-agent scalable data engine that systematically compiles credible data sources into Agri-342K, a high-quality, standardized question-answer (QA) dataset. Trained on this dataset, AgriGPT supports a broad range of agricultural stakeholders, from practitioners to policy-makers. To enhance factual grounding, we employ Tri-RAG, a three-channel Retrieval-Augmented Generation framework combining dense retrieval, sparse retrieval, and multi-hop knowledge graph reasoning, thereby improving the LLM's reasoning reliability. For comprehensive evaluation, we introduce AgriBench-13K, a benchmark suite comprising 13 tasks with varying types and complexities. Experiments demonstrate that AgriGPT significantly outperforms general-purpose LLMs on both domain adaptation and reasoning. Beyond the model itself, AgriGPT represents a modular and extensible LLM ecosystem for agriculture, comprising structured data construction, retrieval-enhanced generation, and domain-specific evaluation. This work provides a generalizable framework for developing scientific and industry-specialized LLMs. All models, datasets, and code will be released to empower agricultural communities, especially in underserved regions, and to promote open, impactful research.

cs.AI↗

arXiv2025

AI for the Open-World: the Learning Principles

During the past decades, numerous successes of AI has been made on "specific capabilities", named closed-world, such as artificial environments or specific real-world tasks. This well-defined narrow capability brings two nice benefits, a clear criterion of success and the opportunity to collect a lot of examples. The criteria not only reveal whether a machine has achieved a goal, but reveal how the machine falls short of the goal. As a result, human designers can fix the problems one after the other until the machine is deemed good enough for the task. Furthermore, the large set of collected examples reduces the difficulty of this problem-fixing process (by the central limit theorem). Do the success in closed-world translate into broad open-world, where a machine is required to perform any task that a human could possibly undertake with fewer examples and less priori knowledge from human designers? No. Because competence in a specific task provides little insight in handling other tasks, the valuable criteria for specific tasks become helpless when handling broader unseen tasks. Furthermore, due to the shortage of examples in unseen tasks, central limit theorem does not stand on our side. At the end, human designers lose the oscilloscope to "hack" an AI system for the open-world. Achieving AI for the open-world requires unique learning principles and innovated techniques, which are different from the ones in building AI for the closed-world. This thesis explores necessary learning principles required to construct AI for the open-world, including rich features (analogy a large tool box), disentangled representation (an organized tool box), and inference-time learning (a tool-savvy hand). Driven by the learning principles, this thesis further proposes techniques to use the learning principles, conducts enormous large-scale experiments to verify the learning principles.

cs.LG↗

arXiv2025

Scale-Invariance Drives Convergence in AI and Brain Representations

Despite variations in architecture and pretraining strategies, recent studies indicate that large-scale AI models often converge toward similar internal representations that also align with neural activity. We propose that scale-invariance, a fundamental structural principle in natural systems, is a key driver of this convergence. In this work, we propose a multi-scale analytical framework to quantify two core aspects of scale-invariance in AI representations: dimensional stability and structural similarity across scales. We further investigate whether these properties can predict alignment performance with functional Magnetic Resonance Imaging (fMRI) responses in the visual cortex. Our analysis reveals that embeddings with more consistent dimension and higher structural similarity across scales align better with fMRI data. Furthermore, we find that the manifold structure of fMRI data is more concentrated, with most features dissipating at smaller scales. Embeddings with similar scale patterns align more closely with fMRI data. We also show that larger pretraining datasets and the inclusion of language modalities enhance the scale-invariance properties of embeddings, further improving neural alignment. Our findings indicate that scale-invariance is a fundamental structural principle that bridges artificial and biological representations, providing a new framework for evaluating the structural quality of human-like AI systems.

q-bio.NC↗

arXiv2025

Enhanced semi-supervised stamping process monitoring with physically-informed feature extraction

In tackling frequent batch anomalies in high-speed stamping processes, this study introduces a novel semi-supervised in-process anomaly monitoring framework, utilizing accelerometer signals and physics information, to capture the process anomaly effectively. The proposed framework facilitates the construction of a monitoring model with imbalanced sample distribution, which enables in-process condition monitoring in real-time to prevent batch anomalies, which helps to reduce batch defects risk and enhance production yield. Firstly, to effectively capture key features from raw data containing redundant information, a hybrid feature extraction algorithm is proposed to utilize data-driven methods and physical mechanisms simultaneously. Secondly, to address the challenge brought by imbalanced sample distribution, a semi-supervised anomaly detection model is established, which merely employs normal samples to build a golden baseline model, and a novel deviation score is proposed to quantify the anomaly level of each online stamping stroke. The effectiveness of the proposed feature extraction method is validated with various classification algorithms. A real-world in-process dataset from stamping manufacturing workshop is employed to illustrate the superiority of proposed semi-supervised framework with enhance performance for process anomaly monitoring.

cs.LG↗

arXiv2025

Fine-tuning with Very Large Dropout

It is impossible today to pretend that the practice of machine learning is always compatible with the idea that training and testing data follow the same distribution. Several authors have recently used ensemble techniques to show how scenarios involving multiple data distributions are best served by representations that are both richer than those obtained by regularizing for the best in-distribution performance, and richer than those obtained under the influence of the implicit sparsity bias of common stochastic gradient procedures. This contribution investigates the use of very high dropout rates instead of ensembles to obtain such rich representations. Although training a deep network from scratch using such dropout rates is virtually impossible, fine-tuning a large pre-trained model under such conditions is not only possible but also achieves out-of-distribution performances that exceed those of both ensembles and weight averaging methods such as model soups. This result has practical significance because the importance of the fine-tuning scenario has considerably grown in recent years. This result also provides interesting insights on the nature of rich representations and on the intrinsically linear nature of fine-tuning a large network using a comparatively small dataset.

cs.LG↗

arXiv2025

Memory Mosaics

Memory Mosaics are networks of associative memories working in concert to achieve a prediction task of interest. Like transformers, memory mosaics possess compositional capabilities and in-context learning capabilities. Unlike transformers, memory mosaics achieve these capabilities in comparatively transparent way ("predictive disentanglement"). We illustrate these capabilities on a toy example and also show that memory mosaics perform as well or better than transformers on medium-scale language modeling tasks.

cs.LG↗

arXiv2025

CP violation studies at Super Tau-Charm Facility

Charge-parity ($C\!P$) violation in the tau-charm energy region is a promising area for sensitive tests of Standard Model (SM) predictions and searches for new, beyond the SM physics. A future Tau-Charm Facility that operates at center-of-mass energies between 2.0 and 7.0 GeV, with a peak luminosity of $0.5\times10^{35}$~cm$^{-2}$s$^{-1}$, would provide huge numbers of hadrons and tau ($τ$) leptons that are produced in low-background environments and with well understood kinematic properties. In this report, prospects for unique studies of $C\!P$ violation in the decay of charmed hadrons, and in the production and decay of hyperons and $τ$ leptons at a next-generation tau-charm facility are discussed. In addition, opportunities for improved tests of $CPT$ invariance test in $K^{0}-\bar{K}^{0}$ mixing are presented.

hep-ex↗

arXiv2025

Psychometric-Based Evaluation for Theorem Proving with Large Language Models

Large language models (LLMs) for formal theorem proving have become a prominent research focus. At present, the proving ability of these LLMs is mainly evaluated through proof pass rates on datasets such as miniF2F. However, this evaluation method overlooks the varying importance of theorems. As a result, it fails to highlight the real performance disparities between LLMs and leads to high evaluation costs. This study proposes a psychometric-based evaluation method for theorem proving with LLMs, comprising two main components: Dataset Annotation and Adaptive Evaluation. First, we propose a metric calculation method to annotate the dataset with difficulty and discrimination metrics. Specifically, we annotate each theorem in the miniF2F dataset and grade them into varying difficulty levels according to the performance of LLMs, resulting in an enhanced dataset: miniF2F-Graded. Experimental results show that the difficulty grading in miniF2F-Graded better reflects the theorem difficulty perceived by LLMs. Secondly, we design an adaptive evaluation method to dynamically select the most suitable theorems for testing based on the annotated metrics and the real-time performance of LLMs. We apply this method to evaluate 10 LLMs. The results show that our method finely highlights the performance disparities between LLMs. It also reduces evaluation costs by using only 23% of the theorems in the dataset.

cs.AI↗

arXiv2024

MagicPIG: LSH Sampling for Efficient LLM Generation

Large language models (LLMs) with long context windows have gained significant attention. However, the KV cache, stored to avoid re-computation, becomes a bottleneck. Various dynamic sparse or TopK-based attention approximation methods have been proposed to leverage the common insight that attention is sparse. In this paper, we first show that TopK attention itself suffers from quality degradation in certain downstream tasks because attention is not always as sparse as expected. Rather than selecting the keys and values with the highest attention scores, sampling with theoretical guarantees can provide a better estimation for attention output. To make the sampling-based approximation practical in LLM generation, we propose MagicPIG, a heterogeneous system based on Locality Sensitive Hashing (LSH). MagicPIG significantly reduces the workload of attention computation while preserving high accuracy for diverse tasks. MagicPIG stores the LSH hash tables and runs the attention computation on the CPU, which allows it to serve longer contexts and larger batch sizes with high approximation accuracy. MagicPIG can improve decoding throughput by up to $5\times$ across various GPU hardware and achieve 54ms decoding latency on a single RTX 4090 for Llama-3.1-8B-Instruct model with a context of 96k tokens. The code is available at https://github.com/Infini-AI-Lab/MagicPIG.

cs.CL↗

arXiv2024

Incorporating Feature Pyramid Tokenization and Open Vocabulary Semantic Segmentation

The visual understanding are often approached from 3 granular levels: image, patch and pixel. Visual Tokenization, trained by self-supervised reconstructive learning, compresses visual data by codebook in patch-level with marginal information loss, but the visual tokens does not have semantic meaning. Open Vocabulary semantic segmentation benefits from the evolving Vision-Language models (VLMs) with strong image zero-shot capability, but transferring image-level to pixel-level understanding remains an imminent challenge. In this paper, we treat segmentation as tokenizing pixels and study a united perceptual and semantic token compression for all granular understanding and consequently facilitate open vocabulary semantic segmentation. Referring to the cognitive process of pretrained VLM where the low-level features are progressively composed to high-level semantics, we propose Feature Pyramid Tokenization (PAT) to cluster and represent multi-resolution feature by learnable codebooks and then decode them by joint learning pixel reconstruction and semantic segmentation. We design loosely coupled pixel and semantic learning branches. The pixel branch simulates bottom-up composition and top-down visualization of codebook tokens, while the semantic branch collectively fuse hierarchical codebooks as auxiliary segmentation guidance. Our experiments show that PAT enhances the semantic intuition of VLM feature pyramid, improves performance over the baseline segmentation model and achieves competitive performance on open vocabulary semantic segmentation benchmark. Our model is parameter-efficient for VLM integration and flexible for the independent tokenization. We hope to give inspiration not only on improving segmentation but also on semantic visual token utilization.

cs.CV↗

arXiv2024

A Framework For Image Synthesis Using Supervised Contrastive Learning

Text-to-image (T2I) generation aims at producing realistic images corresponding to text descriptions. Generative Adversarial Network (GAN) has proven to be successful in this task. Typical T2I GANs are 2 phase methods that first pretrain an inter-modal representation from aligned image-text pairs and then use GAN to train image generator on that basis. However, such representation ignores the inner-modal semantic correspondence, e.g. the images with same label. The semantic label in priory describes the inherent distribution pattern with underlying cross-image relationships, which is supplement to the text description for understanding the full characteristics of image. In this paper, we propose a framework leveraging both inter- and inner-modal correspondence by label guided supervised contrastive learning. We extend the T2I GANs to two parameter-sharing contrast branches in both pretraining and generation phases. This integration effectively clusters the semantically similar image-text pair representations, thereby fostering the generation of higher-quality images. We demonstrate our framework on four novel T2I GANs by both single-object dataset CUB and multi-object dataset COCO, achieving significant improvements in the Inception Score (IS) and Frechet Inception Distance (FID) metrics of imagegeneration evaluation. Notably, on more complex multi-object COCO, our framework improves FID by 30.1%, 27.3%, 16.2% and 17.1% for AttnGAN, DM-GAN, SSA-GAN and GALIP, respectively. We also validate our superiority by comparing with other label guided T2I GANs. The results affirm the effectiveness and competitiveness of our approach in advancing the state-of-the-art GAN for T2I generation

cs.CV↗

arXiv2024

Integrated Modeling, Verification, and Code Generation for Unmanned Aerial Systems

Unmanned Aerial Systems (UAS) are currently widely used in safety-critical fields such as industrial production, military operations, and disaster relief. Due to the diversity and complexity of application scenarios, UAS have become increasingly intricate. The challenge of designing and implementing highly reliable UAS while effectively controlling development costs and enhancing efficiency is a pressing issue faced by both academia and industry. Addressing this challenge, this paper aims to investigate an integrated approach to modeling, verification, and code generation for UAS. The paper begins by utilizing Architecture Analysis and Design Language (AADL) to model the UAS, proposing a set of generic UAS models. Based on these models, formal specifications are written to describe the system's safety properties and functions. Finally, the paper introduces a method for generating flight controller code for UAS based on the verified models. Experiments conducted with the proposed method demonstrate its effectiveness in identifying potential vulnerabilities in the UAS during the early design phase and in generating viable flight controller code from the verified models. This approach can enhance the efficiency of designing and verifying high-reliability UAS.

cs.SE↗

arXiv2024

Hyperon-Nucleus/Nucleon Scattering at BESIII

Utilizing the large quantity of hyperons and antihyperons produced by the decay of 10 billion $J/ψ$ and 2.7 billion $ψ(3686)$ collected at BESIII, the cross sections of several specific elastic or inelastic (anti-)hyperon-nucleus/nucleon rections have been measured via the scattering between the (anti-)hyperons and the nucleus in the dense objects of BESIII detector. The novel method developed in these works extends the research field and opens a new era for the experiments at $e^+ e^-$ colliders. The results of such measurements will definitely benefit a lot the precise probe of the (anti-)hyperon-nucleus/nucleon interactions and provide constraints for the studies of the potential of strong interaction, the origin of color confinement, the unified model for baryon-baryon interactions, and the internal structure of neutron stars. The desirable prospects of corresponding studies in the future Super Tau-Charm Factory (STCF) are also discussed in this report.

nucl-ex↗

arXiv2024

Prospects to study hyperon-nucleon interactions at BESIII

The prospects to study hyperon-nuclei/nucleon interactions at BESIII and similar $e^+ e^-$ colliders are proposed in this work. Utilizing the large quantity of hyperons produced by the decay of 10 billion $J/ψ$ and 2.7 billion $ψ(3686)$ collected at BESIII, the cross sections of several specific elastic or inelastic hyperon-nuclei reactions can be measured via the scattering between the hyperons and the nucleus in the dense objects of BESIII detector. Subsequently, the cross sections of corresponding hyperon-nucleon interactions are able to be extracted with further phenomenological calculation. Furthermore, the interactions between antihyperon and nuclei/nucleon, including scattering and annihilation, can also be studied via the method proposed in this paper. The results will definitely benefit a lot the precise probe of the hyperon-nuclei/nucleon interactions and provide constraints for the studies of the potential of strong interaction, the origin of color confinement, the unified model for baryon-baryon interactions, and the internal structure of neutron stars. In addition, the desirable prospects of corresponding studies in the future Super Tau-Charm Factory (STCF) are discussed and estimated in this work.

hep-ex↗

arXiv2024

An Agile Formal Specification Language Design Based on K Framework

Formal Methods (FMs) are currently essential for verifying the safety and reliability of software systems. However, the specification writing in formal methods tends to be complex and challenging to learn, requiring familiarity with various intricate formal specification languages and verification technologies. In response to the increasing complexity of software frameworks, existing specification writing methods fall short in meeting agility requirements. To address this, this paper introduces an Agile Formal Specification Language (ASL). The ASL is defined based on the K Framework and YAML Ain't Markup Language (YAML). The design of ASL incorporates agile design principles, making the writing of formal specifications simpler, more efficient, and scalable. Additionally, a specification translation algorithm is developed, capable of converting ASL into K formal specification language that can be executed for verification. Experimental evaluations demonstrate that the proposed method significantly reduces the code size needed for specification writing, enhancing agility in formal specification writing.

cs.SE↗

arXiv2024

Data-driven Topology Optimization of Channel Flow Problems

Typical topology optimization methods require complex iterative calculations, which cannot meet the requirements of fast computing applications. The neural network is studied to reduce the time of computing the optimization result, however, the data-driven method for fluid topology optimization is less of discussion. This paper intends to introduce a neural network architecture that avoids time-consuming iterative processes and has a strong generalization ability for topology optimization for Stokes flow. Different neural network methods including Convolution Neural Networks (CNN), conditional Generative Adversarial Networks (cGAN), and Denoising Diffusion Implicit Models (DDIM) which have been already successfully used in solid structure optimization problems are mutated and examined for fluid topology optimization cases. The presented neural network method is tested on the channel flow topology optimization problems for Stokes flow. The results have shown that our presented method has high pixel accuracy and gains a 663 times decrease on average in execution time compared with the conventional method.

physics.comp-ph↗

arXiv2023

Probing hyperon electric dipole moments with a full angular analysis

The electric dipole moment (EDM) of elementary particles, arising from flavor-diagonal $CP$ violation, serves as a powerful probe for new physics beyond the Standard Model and holds the potential to provide novel insights in unraveling the puzzle of the matter-dominated Universe. Hyperon EDM is a largely unexplored territory. In this paper, we present a comprehensive angular analysis that focuses on entangled hyperon-antihyperon pairs in $J/ψ$ decays for the indirect extraction of hyperon EDM. The statistical sensitivities are investigated for BESIII and the proposed Super Tau-Charm Facility (STCF). Leveraging the statistics from the BESIII experiment, the estimated sensitivity for $Λ$ EDM can reach an impressive level of $10^{-19}$ $e$ cm, achieving a 3-orders-of-magnitude improvement over the only existing measurement in a fixed-target experiment at Fermilab with similar statistics. The estimated sensitivities for the $Σ^+$, $Ξ^-$, and $Ξ^0$ hyperons at the same level of $10^{-19}$ $e$ cm will mark the first-ever achievement and the latter two will be the first exploration of hyperons with two strange valence quarks. The EDM measurements for hyperons conducted at the BESIII experiment will be a significant milestone and serve as a litmus test for new physics such as supersymmetry and the left-right symmetrical model. Furthermore, at the STCF experiment, the sensitivity of hyperon EDM measurements can be further enhanced by 2 orders of magnitude. Additionally, this angular analysis enables the determination of $CP$ violation in hyperon decays, the effective weak mixing angle, and beam polarization.

hep-ex↗

arXiv2023

Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization

Foundation models are redefining how AI systems are built. Practitioners now follow a standard procedure to build their machine learning solutions: from a pre-trained foundation model, they fine-tune the weights on the target task of interest. So, the Internet is swarmed by a handful of foundation models fine-tuned on many diverse tasks: these individual fine-tunings exist in isolation without benefiting from each other. In our opinion, this is a missed opportunity, as these specialized models contain rich and diverse features. In this paper, we thus propose model ratatouille, a new strategy to recycle the multiple fine-tunings of the same foundation model on diverse auxiliary tasks. Specifically, we repurpose these auxiliary weights as initializations for multiple parallel fine-tunings on the target task; then, we average all fine-tuned weights to obtain the final model. This recycling strategy aims at maximizing the diversity in weights by leveraging the diversity in auxiliary tasks. Empirically, it improves the state of the art on the reference DomainBed benchmark for out-of-distribution generalization. Looking forward, this work contributes to the emerging paradigm of updatable machine learning where, akin to open-source software development, the community collaborates to reliably update machine learning models. Our code is released: https://github.com/facebookresearch/ModelRatatouille.

cs.LG↗