arXiv subjects

Humza Nusrat

Publications and source records attributed to Humza Nusrat.

7 recordsLinked to original sources

arXiv2026

Weight-space programming for auditing clinical decision networks

Machine learning models in radiotherapy are commissioned by testing them on cases with known answers, which may not reveal a shortcut that the test cases share with the training data. Frontier language models have recently been reported to read and write the raw weights of small neural networks, an ability called weight-space programming. The purpose of this study was to determine whether such a model, given only a clinical protocol and a network's weights, can audit and repair the network. Networks with 433 to 4,801 parameters were trained to screen head-and-neck planning requests against four rules. Flaws were planted through the training data: confounds that hid each rule, a 3 Gy shift in the cord threshold, and a hidden trigger. Claude Opus 5.5 audited each network blind, without tools, data or code execution, and every claim and repair was tested on about 420,000 requests. The language model named the broken rule in 16 of 18 flawed networks (95% CI 67% to 97%), including all 15 with a confound or a threshold shift. It repaired each of the 16 by changing a median of 3 parameters. Fine-tuning on protocol-labeled requests also repaired every network, but changed nearly every parameter. Each confound and shift it found was visible in single units, and a simple statistic chosen for each flaw type found the same flaws. It cleared 2 of 5 healthy networks without being forced and found 1 of 3 triggers. Testing against the protocol detected every flaw, and black-box testing found the confounds and the shift faster. The results indicate that, in small networks, weight-space programming can locate and repair flaws that silence an input or shift a threshold, but cannot yet certify that a network is correct.

physics.med-ph↗

arXiv2026

OpenGray: a benchmark for evaluating the decisions of radiotherapy planning agents

Background and purpose: Radiotherapy planning agents based on large language models (LLMs) decide when to submit a plan or request review but are evaluated mainly by dose. This study developed OpenGray, a benchmark of planning tasks with known correct decisions. Materials and methods: OpenGray adds tasks with known answers to the OpenKBP-Opt head-and-neck dataset, including two contradictions with dose goals proven incompatible and a feasible control with a stored plan meeting every hard goal. Four systems, from a rule-based planning script to a full LLM agent, were evaluated on 30 patients, the LLM-based ones with a commercial (Terra) and a local (Ministral 3 8B) LLM. Decisions, achieved dose, problem recognition, and technical failures were recorded and also read from logs of 39 stereotactic radiosurgery runs of SAGE, a clinical LLM agent. Results: With Terra, the script preceded by an LLM review and the full agent had decision accuracies of 95.4% and 92.1%, respectively, yet escalated only 50% (95% confidence interval, 25-75%) and 25% (10-40%) of overlap contradictions, which required arithmetic on the anatomy. All four systems submitted every feasible control, but 24% of these plans missed a hard goal that the stored plan had met. In four SAGE runs, one goal failed at every attempt; the agent identified it in every reply but had no action for stopping. Conclusions: Favorable aggregate scores concealed specific decision failures. Planning agents should be evaluated on their decisions as well as their dose and given an explicit action for stopping and requesting review.

cs.AI↗

arXiv2025

Automated stereotactic radiosurgery planning using a human-in-the-loop reasoning large language model agent

Stereotactic radiosurgery (SRS) demands precise dose shaping around critical structures, yet black-box AI systems have limited clinical adoption due to opacity concerns. We tested whether chain-of-thought reasoning improves agentic planning in a retrospective cohort of 41 patients with brain metastases treated with 18 Gy single-fraction SRS. We developed SAGE (Secure Agent for Generative Dose Expertise), an LLM-based planning agent for automated SRS treatment planning. Two variants generated plans for each case: one using a non-reasoning model, one using a reasoning model. The reasoning variant showed comparable plan dosimetry relative to human planners on primary endpoints (PTV coverage, maximum dose, conformity index, gradient index; all p > 0.21) while reducing cochlear dose below human baselines (p = 0.022). When prompted to improve conformity, the reasoning model demonstrated systematic planning behaviors including prospective constraint verification (457 instances) and trade-off deliberation (609 instances), while the standard model exhibited none of these deliberative processes (0 and 7 instances, respectively). Content analysis revealed that constraint verification and causal explanation concentrated in the reasoning agent. The optimization traces serve as auditable logs, offering a path toward transparent automated planning.

cs.AI↗

arXiv2025

When AI Does Science: Evaluating the Autonomous AI Scientist KOSMOS in Radiation Biology

Agentic AI "scientists" now use language models to search the literature, run analyses, and generate hypotheses. We evaluate KOSMOS, an autonomous AI scientist, on three problems in radiation biology using simple random-gene null benchmarks. Hypothesis 1: baseline DNA damage response (DDR) capacity across cell lines predicts the p53 transcriptional response after irradiation (GSE30240). Hypothesis 2: baseline expression of OGT and CDO1 predicts the strength of repressed and induced radiation-response modules in breast cancer cells (GSE59732). Hypothesis 3: a 12-gene expression signature predicts biochemical recurrence-free survival after prostate radiotherapy plus androgen deprivation therapy (GSE116918). The DDR-p53 hypothesis was not supported: DDR score and p53 response were weakly negatively correlated (Spearman rho = -0.40, p = 0.76), indistinguishable from random five-gene scores. OGT showed only a weak association (r = 0.23, p = 0.34), whereas CDO1 was a clear outlier (r = 0.70, empirical p = 0.0039). The 12-gene signature achieved a concordance index of 0.61 (p = 0.017) but a non-unique effect size. Overall, KOSMOS produced one well-supported discovery, one plausible but uncertain result, and one false hypothesis, illustrating that AI scientists can generate useful ideas but require rigorous auditing against appropriate null models.

cs.AI↗

arXiv2025

Development and pilot evaluation of a virtual reality simulator for HDR prostate brachytherapy

Purpose: To develop a virtual reality simulator for high dose rate prostate brachytherapy and to test whether participation is associated with immediate gains in self-reported confidence across predefined procedural domains in two cohorts. Methods: Two modules were developed and implemented using Unreal Engine: patient preparation and template guided needle insertion. Oncology staff and trainees completed pre and post surveys that assessed confidence for recalling steps, explaining steps, identifying equipment, and explaining equipment function. Studies were conducted at the Hands On Brachytherapy Workshop (HOWBT) in London, Ontario, and at Sunnybrook Odette Cancer Centre in Toronto, Ontario. Paired Wilcoxon signed rank tests with two-sided p values compared before and after scores within each module. Results: Patient preparation (N=11) confidence increased for recalling steps (W=65, p=0.002), explaining steps (W=51, p = 0.023), identifying equipment (W=65, p=0.002), and explaining equipment function (W=60, p=0.0078). Needle insertion (N=27) confidence increased for recalling steps (W=292, p<0.001), explaining steps (W=347, p<0.001), identifying equipment (W=355, p<0.001), and explaining equipment function (W=354, p<0.001). Conclusion: The simulator was feasible to deploy and was associated with higher self-reported confidence across key domains immediately after training. Findings may inform future curriculum design and implementation work.

physics.med-ph↗

arXiv2025

Characterization and ex vivo application of flexible 2D scintillating coatings in ultra-high dose rate electron beams for FLASH radiotherapy

The increasing interest in FLASH-RT has lead to the conversion of linear accelerators to enable ultra-high dose rate (UHDR) beams for preclinical research. Dosimetry hereof remains challenging with several crucial aspects missing. This work shows the challenges for real-time 2D UHDR dosimetry, and aims to present a solution in the context of preclinical irradiations in non-homogeneous UHDR electron beams. An experimental camera-scintillation sheet combination, was used to investigate the spatial dose distribution of a converted UHDR Varian Trilogy. The dosimetric system was characterized by variation of the number of pulses and source to surface distance (SSD) and its application was investigated by variation of bolus thickness and ambient light intensity. The challenges of prelcinical real time 2D dosimetry with scintillating coatings were assessed by ex vivo irradiations of a rat brain, mouse hindlimb and whole body mouse. Radiochromic EBT XD film was used as passive reference dosimeter. The coating showed a linear response with the number of pulses in the absence and presence of transparent bolus, up to 3 cm thick, and with the inverse squared SSD. The presence of ambient light reduces the signal-background ratio. The sheet showed to have sufficient flexibility to be molded on the subjects' surface, following its curvatures. Linearity with number of pulses was preserved in a preclinical setting. For small field sizes the light output became too low, resulting in noisy dose maps. The system showed robust within 5% for camera set up differences. Calibration of the system was complicated due to set up variations and the inhomogeneity of the beam. We showed the need for 2D real-time dosimetry to determine beam characteristics in non-homogeneous UHDR beams using a preclinical setting. We presented one solution to meet this need with scintillating based dosimetry.

physics.med-ph↗

arXiv2025

Autonomous Radiotherapy Treatment Planning Using DOLA: A Privacy-Preserving, LLM-Based Optimization Agent

Radiotherapy treatment planning is a complex and time-intensive process, often impacted by inter-planner variability and subjective decision-making. To address these challenges, we introduce Dose Optimization Language Agent (DOLA), an autonomous large language model (LLM)-based agent designed for optimizing radiotherapy treatment plans while rigorously protecting patient privacy. DOLA integrates the LLaMa3.1 LLM directly with a commercial treatment planning system, utilizing chain-of-thought prompting, retrieval-augmented generation (RAG), and reinforcement learning (RL). Operating entirely within secure local infrastructure, this agent eliminates external data sharing. We evaluated DOLA using a retrospective cohort of 18 prostate cancer patients prescribed 60 Gy in 20 fractions, comparing model sizes (8 billion vs. 70 billion parameters) and optimization strategies (No-RAG, RAG, and RAG+RL) over 10 planning iterations. The 70B model demonstrated significantly improved performance, achieving approximately 16.4% higher final scores than the 8B model. The RAG approach outperformed the No-RAG baseline by 19.8%, and incorporating RL accelerated convergence, highlighting the synergy of retrieval-based memory and reinforcement learning. Optimal temperature hyperparameter analysis identified 0.4 as providing the best balance between exploration and exploitation. This proof of concept study represents the first successful deployment of locally hosted LLM agents for autonomous optimization of treatment plans within a commercial radiotherapy planning system. By extending human-machine interaction through interpretable natural language reasoning, DOLA offers a scalable and privacy-conscious framework, with significant potential for clinical implementation and workflow improvement.

physics.med-ph↗