arXiv subjects

Tong Bao

Publications and source records attributed to Tong Bao.

At least 19 recordsLinked to original sources

arXiv2026

SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation

Automatic scientific survey generation has become an important task in scientific document processing. The common approach of retrieving literature from a single source (e.g., arXiv) and generating surveys through a one-pass large language model (LLM) call often leads to limited reference coverage and, more importantly, fails to replicate the expert-driven revision process that is crucial for writing high-quality surveys. In this paper, we introduce SurveyAgent-HKA, a multi-agent framework that improves end-to-end scientific survey generation by incorporating knowledge derived from published surveys and peer-review comments. The framework decomposes survey generation into well-defined sub-tasks handled by LLM-powered agent. It first retrieves relevant papers from multiple sources and identifies key topics through clustering to construct an initial outline, which is then refined using outlines from related human-written surveys. Based on the refined outline, topic-focused papers are retrieved and re-ranked to select for drafting a well-grounded survey. Then, we identify common issues raised by experts in peer-review comments from published surveys to guide the revisions and finalize the survey. Experiments on two domains show that our approach outperforms mainstream baselines in citation quality, structural consistency, and content quality. Furthermore, our framework is efficient in both time and cost, making it a practical solution for broader AI-assisted scientific writing applications.

cs.CL↗

arXiv2026

Measuring the Novelty of Biomedical Papers Using the Latent Distances between Knowledge Units

Measuring the novelty of scientific papers is a central concern in research evaluation and scientometrics. From a recombination perspective, prior studies have largely focused on the co-occurrence of knowledge units to assess the novelty of scientific papers. However, these studies often overlook other relationships between knowledge units. This narrow view may result in inaccurate or incomplete evaluations of novelty for scientific papers. To fill this gap, this study introduces a comprehensive novelty measurement that incorporates three types of relationships between knowledge units: network, semantic, and hierarchical. These relationships are used to quantify the latent distances among knowledge units. Using a dataset of 142,036 articles published in PLoS ONE and a validation dataset from the H1 Connect platform, our results demonstrate that (1) each relationship type captures distinct latent distances between MeSH terms; (2) compared to the widely used indicators proposed by Uzzi et al. (2013), our measures show stronger alignment with peer judgements; and (3) combining all three distance metrics yields more effective identification of novel papers than using any single perspective alone.

cs.DL↗

arXiv2026

More Computational Resources Do Not Ensure Higher Scholarly Impact: Evidence from Leading NLP Conference Papers

Computational resources are increasingly central to NLP research, but how closely reported GPU capability aligns with scholarly impact remains unclear. We analyze 13,921 ACL, EMNLP, and NAACL main-conference papers published between 2020 and 2025, using GPU resources as our operational measure of computational resources. From full texts, we extract GPU models and counts, standardize each paper's largest reported configuration into a comparable hardware-capability measure, and link these data to citation, award, topic, and institutional metadata. GPU reporting became more common but remained incomplete, while reported capability increased mainly through newer hardware generations and medium-scale multi-GPU configurations. Resource concentration substantially exceeded impact concentration: the annual top 20% of GPU-quantifiable papers accounted for 83.9%-89.9% of reported GPU capability, but only 27%-32% of citations and 20%-33% of paper awards. In adjusted models, a tenfold increase in aggregate reported GPU capability was associated with a 3.52-percentage-point increase in within-NLP topic-year citation percentile, but increased model R^2 by only 0.0042. GPU count showed more consistent positive associations with citation and award outcomes than newer hardware generation. Overall, reported GPU resources are associated with scholarly impact but provide little standalone explanation of research influence.

cs.CL↗

arXiv2026

Enhancing Scientific Named Entity Recognition via Large Language Models: A Type-driven Multi-task Learning Approach

Scientific named entity recognition (SciNER) plays a crucial role in information extraction and knowledge discovery from scientific texts. Recently, large language models (LLMs) have demonstrated the capacity to achieve competitive SciNER performance with minimal human effort. Existing research highlights the importance of incorporating candidate entity type information for accurate entity recognition and classification by LLMs. However, when too many candidate entity types are provided in the prompt, LLMs struggle to accurately recognize and label entities in scientific texts, where entity types are more complex than in general domains. To address this challenge, we propose TdSciNER, a type-driven approach that effectively leverages entity type information to enhance SciNER performance. In TdSciNER, we first design an entity type filter model to identify the most likely entity types present in a given sentence. Subsequently, we introduce an auxiliary multi-class entity typing task within a multi-task learning framework alongside SciNER to obtain richer contextual representations. Then, we develop a novel demonstration selection strategy based on sentence similarity and entity type diversity to activate the in-context learning capabilities of LLMs, thereby improving entity recognition accuracy across diverse scientific domains. Experiments on three datasets demonstrate that our method achieves performance comparable to fully supervised models. Further analysis validates that each entity type-driven component in TdSciNER contributes to the improvement of SciNER performance. This work provides valuable insights for future advancements in SciNER and broader information extraction tasks in scientific text mining.

cs.CL↗

arXiv2026

X-ray luminous late-type giants: an overlooked population contributing to the Galactic ridge iron line emission

The origin of the highly ionized iron emission (Fe XXV at $6.7\,\mathrm{keV}$) characterizing the Galactic ridge X-ray emission (GRXE) remains a fundamental puzzle in high-energy astrophysics. Although the GRXE continuum is largely resolved into discrete populations of cataclysmic variables and coronally active stars, these sources exhibit Fe XXV equivalent widths significantly lower than that of the total GRXE, leaving the intense iron line emission unexplained. In this work, we cross-correlated the XMM-Newton survey of the inner Galactic disk with Gaia DR3 astrometry to identify and characterize hard X-ray sources ($>2\,\mathrm{keV}$) with reliable stellar counterparts. We selected 107 X-ray sources located within the red giant branch of the color-magnitude diagram, many of which are verified long-period variables. These sources exhibit high X-ray luminosities ($L_{\mathrm{X}} \approx 10^{31}$--$10^{33}\,\mathrm{erg~s^{-1}}$), significantly exceeding the typical coronal saturation levels of single giants. Their X-ray spectra are notably harder than those of quiescent stellar coronae, with plasma temperatures reaching up to $kT \approx 6\,\mathrm{keV}$ and a prominent emission feature at $\sim 6.7\,\mathrm{keV}$. The combination of high $L_{\mathrm{X}}$, hard spectra, and intense Fe XXV emission identifies this population as accretion-powered binaries associated with late-type giants. Our analysis demonstrates that this population contributes $\sim 20\%$ of the total GRXE continuum and $\sim 40\%$ of its iron line emission, providing a key component to resolving the Galactic X-ray background puzzle.

astro-ph.HE↗

arXiv2026

Multimodal Protein Language Models for Enzyme Kinetic Parameters: From Substrate Recognition to Conformational Adaptation

Predicting enzyme kinetic parameters quantifies how efficiently an enzyme catalyzes a specific substrate under defined biochemical conditions. Canonical parameters such as the turnover number ($k_\text{cat}$), Michaelis constant ($K_\text{m}$), and inhibition constant ($K_\text{i}$) depend jointly on the enzyme sequence, the substrate chemistry, and the conformational adaptation of the active site during binding. Many learning pipelines simplify this process to a static compatibility problem between the enzyme and substrate, fusing their representations through shallow operations and regressing a single value. Such formulations overlook the staged nature of catalysis, which involves both substrate recognition and conformational adaptation. In this regard, we reformulate kinetic prediction as a staged multimodal conditional modeling problem and introduce the Enzyme-Reaction Bridging Adapter (ERBA), which injects cross-modal information via fine-tuning into Protein Language Models (PLMs) while preserving their biochemical priors. ERBA performs conditioning in two stages: Molecular Recognition Cross-Attention (MRCA) first injects substrate information into the enzyme representation to capture specificity; Geometry-aware Mixture-of-Experts (G-MoE) then integrates active-site structure and routes samples to pocket-specialized experts to reflect induced fit. To maintain semantic fidelity, Enzyme-Substrate Distribution Alignment (ESDA) enforces distributional consistency within the PLM manifold in a reproducing kernel Hilbert space. Experiments across three kinetic endpoints and multiple PLM backbones, ERBA delivers consistent gains and stronger out-of-distribution performance compared with sequence-only and shallow-fusion baselines, offering a biologically grounded route to scalable kinetic prediction and a foundation for adding cofactors, mutations, and time-resolved structural cues.

cs.CV↗

arXiv2026

Impact of large language models on peer review opinions from a fine-grained perspective: Evidence from top conference proceedings in AI

With the rapid advancement of Large Language Models (LLMs), the academic community has faced unprecedented disruptions, particularly in the realm of academic communication. The primary function of peer review is improving the quality of academic manuscripts, such as clarity, originality and other evaluation aspects. Although prior studies suggest that LLMs are beginning to influence peer review, it remains unclear whether they are altering its core evaluative functions. Moreover, the extent to which LLMs affect the linguistic form, evaluative focus, and recommendation-related signals of peer-review reports has yet to be systematically examined. In this study, we examine the changes in peer review reports for academic articles following the emergence of LLMs, emphasizing variations at fine-grained level. Specifically, we investigate linguistic features such as the length and complexity of words and sentences in review comments, while also automatically annotating the evaluation aspects of individual review sentences. We also use a maximum likelihood estimation method, previously established, to identify review reports that potentially have modified or generated by LLMs. Finally, we assess the impact of evaluation aspects mentioned in LLM-assisted review reports on the informativeness of recommendation for paper decision-making. The results indicate that following the emergence of LLMs, peer review texts have become longer and more fluent, with increased emphasis on summaries and surface-level clarity, as well as more standardized linguistic patterns, particularly reviewers with lower confidence score. At the same time, attention to deeper evaluative dimensions, such as originality, replicability, and nuanced critical reasoning, has declined.

cs.CL↗

arXiv2026

Beyond Single-Dimension Novelty: How Combinations of Theory, Method, and Results-based Novelty Shape Scientific Impact

Scientific novelty drives advances at the research frontier, yet it is also associated with heightened uncertainty and potential resistance from incumbent paradigms, leading to complex patterns of scientific impact. Prior studies have primarily ex-amined the relationship between a single dimension of novelty -- such as theoreti-cal, methodological, or results-based novelty -- and scientific impact. However, because scientific novelty is inherently multidimensional, focusing on isolated dimensions may obscure how different types of novelty jointly shape impact. Consequently, we know little about how combinations of novelty types influence scientific impact. To this end, we draw on a dataset of 15,322 articles published in Nature Communications. Using the DeepSeek-V3 model, we classify articles into three novelty dimensions based on the content of their Introduction sections: theoretical novelty, methodological novelty, and results-based novelty. These dimensions may coexist within the same article, forming distinct novelty configura-tions. Scientific impact is measured using five-year citation counts and indicators of whether an article belongs to the top 1% or top 10% highly cited papers. Descriptive results indicate that results-based novelty alone and the simultaneous presence of all three novelty types are the dominant configurations in the sample. Regression results further show that articles with results-based novelty only re-ceive significantly more citations and are more likely to rank among the top 1% and top 10% highly cited papers than articles exhibiting all three novelty types. These findings advance our understanding of how multidimensional novelty configurations shape knowledge diffusion.

cs.DL↗

arXiv2026

STONKS first results: Long-term transients in the XMM-Newton Galactic plane survey

The study of astronomical transients at high energies provides insights into some of the most extreme physical events in the universe; however, carrying out their detection and fast follow-up studies are limited by instrumental constraints. Search for Transient Object in New observations using Known Sources (STONKS) is a near-real-time transient detection system for XMM-Newton offering the capability to detect transients in XMM-Newton observations at fainter fluxes than can be achieved with wide survey instruments. We present the transients detected with the STONKS pipeline found in an XMM-Newton multi-year heritage survey of the Galactic plane to identify and classify highly variable X-ray sources that have recently been reported in this region. We examined the alerts created by the STONKS pipeline from over 200 XMM observations of the Galactic plane, screening for instrumental effects. The 78 alerts associated with 70 real astrophysical sources were then subjected to further temporal and spectral analysis. From the 70 sources we identified, we were able to classify 32 with a high degree of confidence, including 7 X-ray binaries, 1 $γ$-Cas analogue, and 1 magnetar candidate. Of the 70 sources, 23 were detected for the first time in X-rays. This systematic analysis of publicly available data has shown the value and potential of STONKS in the application to XMM-Newton observations. It will enable the community to detect transient and highly variable sources at fainter fluxes than with any other X-ray transient detection systems.

astro-ph.HE↗

arXiv2026

The Advanced X-ray Imaging Satellite (AXIS) Community Science Book

The AXIS Community Science Book represents the collective effort of 592 scientists worldwide to define the transformative science enabled by the Advanced X-ray Imaging Satellite (AXIS), a next-generation X-ray mission selected by NASA's Astrophysics Probe Program for Phase A study. AXIS will advance the legacy of high-angular-resolution X-ray astronomy with ~1.5'' imaging over a wide 24' field of view and an order of magnitude greater collecting area than Chandra in the 0.3-12 keV band. Combining sharp imaging, high throughput, and rapid response capabilities, AXIS will open new windows on virtually every aspect of modern astrophysics, exploring the birth and growth of supermassive black holes, the feedback processes that shape galaxies, the life cycles of stars and exoplanet environments, and the nature of compact stellar remnants, supernova remnants, and explosive transients. This book compiles 138 community-contributed science cases developed by five Science Working Groups focused on AGN and supermassive black holes, galaxy evolution and feedback, compact objects and supernova remnants, stellar physics and exoplanets, and time-domain and multi-messenger astrophysics. Together, these studies establish the scientific foundation for next-generation X-ray exploration in the 2030s and highlight strong synergies with facilities of the 2030s, such as JWST, Roman, Rubin/LSST, SKA, ALMA, ngVLA, and next-generation gravitational-wave and neutrino networks.

astro-ph.HE↗

arXiv2025

The very faint X-ray transient Swift J174610-290018 at the Galactic center

Very Faint X-ray Transients (VFXTs) are a class of X-ray binary systems that exhibit occasional outbursts with peak X-ray luminosities (L_X< 1e36 erg s^-1) much lower than typical X-ray transients. On 22nd February 2024, during its daily Galactic center monitoring, Swift-XRT detected a VFXT, 7 arcmin from Sgr A* dubbing it Swift J174610--290018. We aim to characterize the outburst that occurred in 2024, and a second, distinct outburst in 2025, to understand the nature and accretion flow properties of this new VFXT. Swift-XRT light curves are used to constrain the duration of the two events. We carried out X-ray spectral analysis exploiting XMM and NuSTAR data. We used Chandra and XMM observations of the last 25 years to constrain the quiescent luminosity of the source. During the 2024 outburst, which lasted about 50 days, the source reached a luminosity in the 2-10 keV band of L_X = 1.2e35 erg s^-1 (assuming it is located at the Galactic center). The 2025 outburst is shorter (about 5 days), and reached L_X = 9e34 erg s^-1. The spectral features of the source include an excess at 6.5-7 keV, which can be associated either with a single reflection line or with the ionized Fe XXV and XXVI lines. The same source was identified in both the XMM and Chandra catalogs of point sources (known as 4XMM J174610.7--290020). During previous detections, the source displayed luminosity levels ranging from L_X= 2e32 to L_X = 3e34 erg s^-1 between 2000 and 2010. Moreover, it exhibited a potential type I X-ray burst in 2004. The analysis of the outbursts and the potential type I burst strongly suggests the neutron star low mass X-ray binary (NS-LMXB) nature of the VFXT. The source can be described by an accretion disk corona (as has been recently proposed by the XRISM/Xtend analysis). This scenario explains the overall low luminosity of this transient and the peculiar iron lines in the spectrum.

astro-ph.HE↗

arXiv2025

Probing Periodic and Aperiodic Variability of X-ray Sources in M31, M81 and Centaurus A with Chandra

Based on archival Chandra observations, we present a systematic timing survey of several hundred X-ray sources in M31, M81, and Centaurus A, mostly low-mass X-ray binaries (LXMBs), focusing on searching and characterizing aperiodic and periodic variability within single observation. We identify flares in 24 sources in M31, 5 in M81, and 26 in Cen~A; several display recurrent events. Flare durations span from tens of seconds to a few $10^{4}$ s, with peak luminosities of $10^{37}$-$10^{40}\ \mathrm{erg\ s^{-1}}$ and low flare duty cycles of $4.9\times10^{-6}$-$3.5\times10^{-2}$. Dipping events are found in 8 sources in M31, 1 in M81, and 5 in Cen A, including two repeaters. On multi-epoch baselines, the standard deviation of the source luminosity correlates linearly with the mean luminosity, with a coefficient of 0.49 (M31), 0.30 (M81), and 0.67 (Cen A), indicating galaxy-to-galaxy diversity. No statistically significant periodic signals are detected in M81 or Cen A, which, along with several periodic signals previously found among the M31 sources, can be understood considering a joint effect of our detection sensitivity and intrinsic distributions of the orbital period and X-ray luminosity of LMXBs. The ensemble of short-duty-cycle flares, a mix of recurrent and isolated dips, and galaxy-dependent rms--flux factor, supports a picture in which stochastic accretion-rate fluctuations modulate luminosity on $\sim$10-$10^{4}$ s. Conducted at known distances and across distinct host environments, this extragalactic survey provides uniform flare/dip samples and rms-flux scalings for bulge-dominated fields, offering empirical constraints for accretion physics and illustrating the promise of timing analyses in external galaxies using the Chandra archive.

astro-ph.HE↗

arXiv2025

The first extragalactic ultra-compact X-ray binary : a candidate black hole-white dwarf system

M31 UCXB-1 is one of the brightest X-ray point sources in the bulge of M31, with a peak X-ray luminosity $ L_{\mathrm{0.5-10 \: keV}} = 2.9^{+0.2}_{-0.2} \times 10^{38} \: \mathrm{erg} \: \mathrm{s}^{-1} $. Both XMM-Newton and Chandra observations have detected an eclipsing signal with a period of about 465 seconds from this source, and we note that the periodic signal is detected exclusively during the source's high-luminosity states. This signal probably originates from its orbital motion, therefore it is an ultra-compact X-ray binary (UCXB) candidate with the highest X-ray luminosity. Our theoretical analyses show that M31 UCXB-1 is in good agreement with the luminosity-orbital period relation ($ L_{\mathrm{2-10 \: keV}}-P_{\mathrm{orb}} $) of the black hole/neutron star--white dwarf (BH/NS--WD) UCXB system. Moreover, our spectral analyses indicate that the primary in M31 UCXB-1 is more likely to be a BH rather than an NS. The results show that M31 UCXB-1 is a BH--WD system, with the shortest orbital period, the possibly strongest gravitational wave emission, and the most massive white dwarf among the known UCXBs.

astro-ph.HE↗

arXiv2025

Unveiling the soft X-ray source population towards the inner Galactic disk with XMM-Newton

Across the Galactic disk lies a diverse population of X-ray sources, with the fainter end remaining poorly understood due to past survey sensitivity limits. We aim to classify and characterize faint X-ray sources detected in the eROSITA All-Sky Survey (eRASS1) towards the inner Galactic disk ($350^\circ < l < 360^\circ$, $-1^\circ < b < 1^\circ$) using deeper XMM-Newton observations (typical exposure of $\sim 20\,\text{ks}$). We analyzed 189 eRASS1 sources, combining X-ray spectral fitting ($0.2$--$10\,\text{keV}$) with Gaia astrometric and photometric data for robust classification. Our results show that the eRASS1 catalog towards the Galactic disk is overwhelmingly dominated by coronal sources ($\sim 74\%$), primarily active stars and binaries, with $\sim 8\%$ being wind-powered massive stars and $\sim 18\%$ being accreting compact objects. We propose an empirical hardness-ratio cut ($\text{HR} > -0.2$) to efficiently isolate these non-coronal sources. By stacking the classified population and comparing with the Galactic Ridge X-ray Emission (GRXE), we estimate that $\sim 6\%$ of the GRXE flux in the $0.5$--$2.0\,\text{keV}$ band is resolved into point sources above the eRASS1 flux limit ($\sim 5\times 10^{-14}\,\text{erg}\,\text{cm}^{-2}\,\text{s}^{-1}$). This resolved soft-band emission is dominated by active stars, while hard-band flux originates primarily from X-ray binaries. We conclude that the eRASS1 catalog retains a non-negligible population of compact objects that can be effectively distinguished using X-ray color selection.

astro-ph.HE↗

arXiv2025

SurveyGen: Quality-Aware Scientific Survey Generation with Large Language Models

Automatic survey generation has emerged as a key task in scientific document processing. While large language models (LLMs) have shown promise in generating survey texts, the lack of standardized evaluation datasets critically hampers rigorous assessment of their performance against human-written surveys. In this work, we present SurveyGen, a large-scale dataset comprising over 4,200 human-written surveys across diverse scientific domains, along with 242,143 cited references and extensive quality-related metadata for both the surveys and the cited papers. Leveraging this resource, we build QUAL-SG, a novel quality-aware framework for survey generation that enhances the standard Retrieval-Augmented Generation (RAG) pipeline by incorporating quality-aware indicators into literature retrieval to assess and select higher-quality source papers. Using this dataset and framework, we systematically evaluate state-of-the-art LLMs under varying levels of human involvement - from fully automatic generation to human-guided writing. Experimental results and human evaluations show that while semi-automatic pipelines can achieve partially competitive outcomes, fully automatic survey generation still suffers from low citation quality and limited critical analysis.

cs.CL↗

arXiv2025

A sample of ionised Fe line-emitting X-ray sources in the inner Galactic disc

Previous studies suggest that the Galactic diffuse X-ray emission is composed of unresolved point sources, primarily mCVs. However, nearby mCVs have a much lower 6.7 keV line equivalent width ($\rm EW_{6.7}$) compared to the diffuse X-ray emission. Therefore, the primary contributors to the unresolved X-ray emission remain unclear. We detected a total of 859 sources in the 6.5-7 keV band using XMM-Newton observations of the inner Galactic disc, of which 72 sources show significant iron line emission at 6.7 keV. The distribution of spectral index $Γ$ for these 72 sources is bimodal, with peaks at $Γ=0.5\pm0.4$ and $1.8\pm0.3$, suggesting two populations of sources. The soft X-ray sources have significantly larger $\rm EW_{6.7}$ than the hard X-ray sources. Furthermore, 18 of the 32 hard sources are associated with previously known CVs. We identify CV candidates in our sample as those with spectral index $Γ<1.25$. The line ratio, 2-10 keV luminosity, and previous detection of spin period suggest that most of these hard sources are mCVs. The distribution of the $\rm EW_{6.7}$ line for the combined sample of previously identified and candidate CVs has a mean value of <$\rm EW_{6.7}$>$=415\pm39$ eV. Furthermore, we computed the stacked spectra of all sources detected in the 6.5-7 keV band for different flux groups, and we find evidence in the stacked spectra of hard sources that the $\rm EW_{6.7}$ increases with decreasing flux. The soft X-ray sources have <$\rm EW_{6.7}$>$=1.1\pm0.1$ keV. We identified 13 of the 30 soft sources associated with active stars, young stellar objects, and active binaries of RS CVn type. The <$\rm EW_{6.7}$> of our CV candidate sample is more than twice as large as the typical $\rm EW_{6.7}$ found in mCVs within 500 pc, and the <$\rm EW_{6.7}$> of our CV candidate sample is close to the $\rm EW_{6.7}$ value of Galactic diffuse X-ray emission.

astro-ph.HE↗

arXiv2025

SC4ANM: Identifying Optimal Section Combinations for Automated Novelty Prediction in Academic Papers

Novelty is a core component of academic papers, and there are multiple perspectives on the assessment of novelty. Existing methods often focus on word or entity combinations, which provide limited insights. The content related to a paper's novelty is typically distributed across different core sections, e.g., Introduction, Methodology and Results. Therefore, exploring the optimal combination of sections for evaluating the novelty of a paper is important for advancing automated novelty assessment. In this paper, we utilize different combinations of sections from academic papers as inputs to drive language models to predict novelty scores. We then analyze the results to determine the optimal section combinations for novelty score prediction. We first employ natural language processing techniques to identify the sectional structure of academic papers, categorizing them into introduction, methods, results, and discussion (IMRaD). Subsequently, we used different combinations of these sections (e.g., introduction and methods) as inputs for pretrained language models (PLMs) and large language models (LLMs), employing novelty scores provided by human expert reviewers as ground truth labels to obtain prediction results. The results indicate that using introduction, results and discussion is most appropriate for assessing the novelty of a paper, while the use of the entire text does not yield significant results. Furthermore, based on the results of the PLMs and LLMs, the introduction and results appear to be the most important section for the task of novelty score prediction. The code and dataset for this paper can be accessed at https://github.com/njust-winchy/SC4ANM.

cs.CL↗

arXiv2025

Enhancing Abstractive Summarization of Scientific Papers Using Structure Information

Abstractive summarization of scientific papers has always been a research focus, yet existing methods face two main challenges. First, most summarization models rely on Encoder-Decoder architectures that treat papers as sequences of words, thus fail to fully capture the structured information inherent in scientific papers. Second, existing research often use keyword mapping or feature engineering to identify the structural information, but these methods struggle with the structural flexibility of scientific papers and lack robustness across different disciplines. To address these challenges, we propose a two-stage abstractive summarization framework that leverages automatic recognition of structural functions within scientific papers. In the first stage, we standardize chapter titles from numerous scientific papers and construct a large-scale dataset for structural function recognition. A classifier is then trained to automatically identify the key structural components (e.g., Background, Methods, Results, Discussion), which provides a foundation for generating more balanced summaries. In the second stage, we employ Longformer to capture rich contextual relationships across sections and generating context-aware summaries. Experiments conducted on two domain-specific scientific paper summarization datasets demonstrate that our method outperforms advanced baselines, and generates more comprehensive summaries. The code and dataset can be accessed at https://github.com/tongbao96/code-for-SFR-AS.

cs.CL↗