arXiv Science⌕ Search

arXiv subjects

Kenji Hirata

Publications and source records attributed to Kenji Hirata.

10 recordsLinked to original sources

Fine-Grained Japanese Clinical Named Entity Recognition: A Controlled Comparison of BERT and Open-Weight Large Language Models

Background: Generative large language models (LLMs) offer an alternative to encoder-based clinical named entity recognition (NER), but their performance on fine-grained Japanese extraction tasks and sensitivity to generation settings remain uncertain. Methods: We compared two fine-tuned BERT-CRF baselines with nine open-weight LLMs on iCorpus, which defines 113 entity categories. The evaluation used 433 sentences from 36 test documents; 1,672 sentences were used for training. LLMs were evaluated using zero-shot prompting with and without JSON Schema constraints and three-seed QLoRA fine-tuning. Fine-tuned models were assessed under different output-token limits, including 900 and larger model-specific limits of 2,600 or 4,096 tokens. Performance was measured using sentence-level label-surface matching with relaxed and exact-surface F1. Results: The highest zero-shot relaxed F1 was 0.337, compared with 0.836-0.841 for the BERT baselines. At the larger output limits, all eight fine-tuned LLMs with at least 13B total parameters exceeded both BERT baselines (relaxed F1, 0.882-0.914; exact-surface F1, 0.840-0.880). Across three-seed means, increasing the output limit improved relaxed F1 by 0.052-0.085, alongside higher recall and fewer length-limited outputs. JSON Schema constraints changed relaxed F1 by -0.014 to +0.008 among seven models outside the two reasoning-oriented configurations, while medical-general model pairs showed no consistent advantage for medical specialization. Conclusions: On this historical Japanese case-report benchmark, task-specific fine-tuning combined with adequate generation capacity was associated with stronger LLM extraction performance. Output-token limits materially affected comparisons with BERT, whereas enforcing output structure alone did not overcome low zero-shot accuracy.

cs.AI↗

The LLENS Platform for On-Premises Large Language Model Agents in a Japanese University Hospital: Development and Evaluation Study

Large language model agents that use tools could take on part of the electronic health record and desk work that occupies physicians' time, but in many hospitals the medical information systems run inside closed networks, so the model and the agent harness must also be inside the network. We designed, implemented, and deployed LLENS, a clinical support AI agent platform that runs inside the closed network of Hokkaido University Hospital on a single host with 8 NVIDIA H200 GPUs, the open-weight model Kimi K2.6 (~1 trillion parameters), and a web application rebuilt from Open WebUI. The harness has 10 components, including page image reading, full-text attachment input, a path-addressed document tree without a vector index, a network-isolated sandbox, artifact return, self-checking of generated output, subagents, and saved procedures. Kimi K2.6 was chosen from 3 open-weight candidates and scored 480/500 on the 2026 Japanese Medical Licensing Examination; it generated 119 tokens/s for a single user and served 16 concurrent requests at 908 tokens/s in total. On 180 questions over hospital documents (3 seeds each), mean accuracy was 10.7% with no documents, 81.3% with fixed retrieval (top 10 chunks of one lexical search), and 97.2% with interactive access, in which the model reads with document tools and the sandbox (15.9 percentage points above fixed retrieval, 95% CI 10.9-21.3); the difference lay in filtering/counting questions (16.7% vs 87.8%). In an automated test of 13 work scenarios (4 runs each), the expected components were triggered in all runs for 12, and 5 scenarios were run with synthetic data on the deployment host. The platform has run on the hospital network since September 14, 2026.

cs.CL↗

Personalized Longitudinal Medical Report Generation via Temporally-Aware Federated Adaptation

Longitudinal medical report generation is clinically important yet remains challenging due to strict privacy constraints and the evolving nature of disease progression. Although federated learning (FL) enables collaborative training without data sharing, existing FL methods largely overlook longitudinal dynamics by assuming stationary client distributions, making them unable to model temporal shifts across visits or patient-specific heterogeneity-ultimately leading to unstable optimization and suboptimal report generation. We introduce Federated Temporal Adaptation (FTA), a federated setting that explicitly accounts for the temporal evolution of client data. Building upon this setting, we propose FedTAR, a framework that integrates demographic-driven personalization with time-aware global aggregation. FedTAR generates lightweight LoRA adapters from demographic embeddings and performs temporal residual aggregation, where updates from different visits are weighted by a meta-learned temporal policy optimized via first-order MAML. Experiments on J-MID (1M exams) and MIMIC-CXR demonstrate consistent improvements in linguistic accuracy, temporal coherence, and cross-site generalization, establishing FedTAR as a robust and privacy-preserving paradigm for federated longitudinal modeling.

cs.CV↗

Privacy-Aware Continual Self-Supervised Learning on Multi-Window Chest Computed Tomography for Domain-Shift Robustness

We propose a novel continual self-supervised learning (CSSL) framework for simultaneously learning diverse features from multi-window-obtained chest computed tomography (CT) images and ensuring data privacy. Achieving a robust and highly generalizable model in medical image diagnosis is challenging, mainly because of issues, such as the scarcity of large-scale, accurately annotated datasets and domain shifts inherent to dynamic healthcare environments. Specifically, in chest CT, these domain shifts often arise from differences in window settings, which are optimized for distinct clinical purposes. Previous CSSL frameworks often mitigated domain shift by reusing past data, a typically impractical approach owing to privacy constraints. Our approach addresses these challenges by effectively capturing the relationship between previously learned knowledge and new information across different training stages through continual pretraining on unlabeled images. Specifically, by incorporating a latent replay-based mechanism into CSSL, our method mitigates catastrophic forgetting due to domain shifts during continual pretraining while ensuring data privacy. Additionally, we introduce a feature distillation technique that integrates Wasserstein distance-based knowledge distillation (WKD) and batch-knowledge ensemble (BKE), enhancing the ability of the model to learn meaningful, domain-shift-robust representations. Finally, we validate our approach using chest CT images obtained across two different window settings, demonstrating superior performance compared with other approaches.

cs.CV↗

Continual Self-supervised Learning Considering Medical Domain Knowledge in Chest CT Images

We propose a novel continual self-supervised learning method (CSSL) considering medical domain knowledge in chest CT images. Our approach addresses the challenge of sequential learning by effectively capturing the relationship between previously learned knowledge and new information at different stages. By incorporating an enhanced DER into CSSL and maintaining both diversity and representativeness within the rehearsal buffer of DER, the risk of data interference during pretraining is reduced, enabling the model to learn more richer and robust feature representations. In addition, we incorporate a mixup strategy and feature distillation to further enhance the model's ability to learn meaningful representations. We validate our method using chest CT images obtained under two different imaging conditions, demonstrating superior performance compared to state-of-the-art methods.

cs.CV↗

KPCA for Thrust Vectoring Systems Exhibiting Singular Points

This paper considers a class of thrust vectoring systems, which are nonlinear, overactuated, and time-invariant. We assume that the system is composed of two subsystems and there exist singular points around which the linearized system is uncontrollable. Furthermore, we assume that the system is stabilizable through a two-level control allocation. In this particular setting, we cannot do much with the linearized system, and a direct nonlinear control approach must be used to analyze the system stability. Under adequate assumptions and a suitable nonlinear continuous control-allocation law, we can prove uniform asymptotic convergence of the points of equilibrium using Lyapunov input-to-state stability and the small gain theorem. This control allocation, however, requires the design of an allocated mapping and introduces two exogenous inputs. In particular, the closed-loop system is cascaded, and the output of one subsystem is the disturbance of the other, and vice versa. In general, it is difficult to find a closed-form solution for the allocated mapping; it needs to satisfy restrictive conditions, among which Lipschitz continuity to ensure that the disturbances eventually vanish. Additionally, this mapping is in general nontrivial and non-unique. In this paper, we propose a new kernel-based predictive control allocation to substitute the need for designing an analytic mapping, and assess if it can produce a meaningful mapping ``on-the-fly" by solving online an optimization problem. The simulations include three examples, which are the manipulation of an object through an unmanned aerial vehicle in two and three dimensions, and the control of a surface vessel actuated by two azimuthal thrusters.

eess.SY↗

Net-Zero Energy House-oriented Linear Programming for the Sizing Problem of Photovoltaic Panels and Batteries

The global drive towards carbon neutrality has led to a significant increase in the number of power plants based on renewable energy sources (RES). Concurrently, numerous households are adopting RES to generate their own energy, aiming to decrease both electricity costs and carbon footprints. To support these users, many papers have been devoted to developing optimal investment strategies for residential energy systems. However, there is still a significant gap as these studies often neglect important aspects like carbon neutrality. For this reason, in this paper, we explore the concept of net-zero energy houses (ZEHs) -- houses designed to have an annual net energy consumption around zero -- by presenting a constrained optimization problem to find the optimal number of photovoltaic panels and the optimal size of the battery system for home integration. Solving this constrained optimization problem is difficult due to its nonconvex constraints. Nevertheless, by applying a series of transformations, we reveal that it is possible to find an equivalent linear programming (LP) problem which is computationally tractable. The attainment of ZEH can be tackled by introducing a single constraint in the optimization problem. Additionally, we propose a sharing economy approach to the investment problem, offering a strategy that could potentially reduce investment costs and facilitate the attainment of ZEH more efficiently. Finally, we apply the proposed frameworks to a neighborhood in Japan as a case study, demonstrating the potential for long-term ZEH attainment. The results show that, under the right incentive, users can achieve ZEH, reduce their electricity costs and have a minimal impact on the main grid.

math.OC↗

Stochastic Optimal Investment Strategy for Net-Zero Energy Houses

In this research, we investigate Net-Zero Energy Houses (ZEH), which harness regionally produced electricity from photovoltaic(PV) panels and fuel cells, integrating them into a local power system in pursuit of achieving carbon neutrality. This paper examines the impact of electricity sharing among users who are working towards attaining ZEH status through the integration of PV panels and battery storage devices. We propose two potential scenarios: the first assumes that all users individually invest in storage devices, hence minimizing their costs on a local level without energy sharing; the second envisions cost minimization through the collective use of a shared storage device, managed by a central manager. These two scenarios are formulated as a stochastic convex optimization and a cooperative game, respectively. To tackle the stochastic challenges posed by multiple random variables, we apply the Monte Carlo sample average approximation (SAA) to the problems. To demonstrate the practical applicability of these models, we implement the proposed scenarios in the Jono neighborhood in Kitakyushu, Japan.

econ.GN↗

Passivity-based Analysis and Design for Population Dynamics with Conformity Biases

This paper addresses mechanisms for boundedly rational decision makers in discrete choice problem. First, we introduce two mathematical models of population dynamics with conformity biases. We next analyze the models in terms of delta-passivity, and show that the conformity biases work to break passivity of decision makers. Based on the passivity perspective, we propose mechanisms so as to induce decision makers to a desired population state. Furthermore, we analyze a convergence property of designed mechanisms, and present parameter conditions to guarantee stable inducements.

eess.SY↗

Contract Theory Approach to Incentivizing Market and Control Design

We discuss an incentivizing market and model-based approach to design the energy management and control systems which realize high-quality ancillary services in dynamic power grids. Under the electricity liberalization, such incentivizing market should secure a high speed market-clearing by using the market players' private information well. Inspired by contract theory in microeconomics field, we propose a novel design method of such incentivizing market based on the integration of the economic models and the dynamic grid model. The conventional contract problems are analyzed for static systems or dynamical systems with control inputs directly operated by the principal. The analysis is, however, in discord with the incentivizing market. The main challenge of our approach is to reformulate the contract problems adapted to the market from the system and control perspective. We first establish the fundamental formulas for optimal design and clarify the basic properties of the designed market. We also discuss possibilities, limitation and some challenges in the direction of our approach and general market-based approaches.

eess.SY↗