arXiv ScienceSearch

arXiv subjects

Simone Caputo

Publications and source records attributed to Simone Caputo.

3 recordsLinked to original sources

Comparing LLM-Based Conversational and Graphical Interfaces for Industrial Decision Tasks: An Exploratory Mixed-Methods Study

The use of Generative AI Conversational User Interfaces (CUI) as a new way to access and analyze data is growing in all sectors, and the industrial one is no exception. There, large amounts of data produced by IoT devices are flowing through user interfaces and may require them a new adaptation to the new analyses needs of decision-makers. LLM-based CUIs are promising a new way to directly interact with those data through the directness of natural language and without the learning costs that every GUI design has. Moreover, the capabilities of LLMs and their agency open up the possibility to automate some tasks and help with the reasoning during decision-making activities. But are this promises well founded? We try to scope this general question with a mixed-approach study comparing a state-of-the-art dashboard with a conversational agent. A total of 20 participants used both interfaces to complete four simulated industrial decision tasks of varying complexity. We combined measures of mental workload, completion time, and decision accuracy with a post-study questionnaire and semi-structured interviews analyzed through thematic analysis. The findings suggest that the conversational agent can reduce interactional effort by supporting more direct access to information, while the dashboard remains valuable for overview and verification. However, these benefits may vary across tasks and require validation through larger-scale studies.

cs.CY

Neither Replacement nor Panacea: Comparing LLM-Based Conversational and Graphical Decision Support in Industrial Tasks

Managers in manufacturing settings rely on digital interfaces to interpret operational data for decision-making, but growing data volume and complexity can make relevant insights difficult to identify efficiently. While dashboards remain dominant in industrial contexts, Large Language Model (LLM)-based conversational agents (CAs), accessed through conversational user interfaces (CUIs), may provide more direct access to such data. However, their effectiveness may depend on the information-processing demands of the task. This study compares an LLM-based CA delivered through a CUI with a dashboard in a manufacturing decision-support scenario. In a mixed factorial experiment with a 2x3 design, 134 industrial decision-makers were assigned to one interface condition and completed three tasks of increasing complexity. We examined perceived Mental Workload (MWL), decision accuracy, completion time, and intended reliance, and tested self-reported data literacy as a moderator. Results showed that the CUI reduced perceived MWL overall and supported faster completion in less demanding tasks, but both advantages diminished as task complexity increased. Neither interface produced a consistent overall advantage in decision accuracy, and the CUI was not preferred as a sole basis for subsequent decisions. Furthermore, data literacy did not reliably moderate interface effects. These findings indicate that conversational interaction offers conditional rather than universal benefits for industrial decision support. LLM-based CAs may reduce information-access effort, whereas complex decisions continue to benefit from persistent, inspectable visual representations.

cs.CY

Comparison of three reconstruction algorithms for low-dose phase-contrast computed tomography of the breast with synchrotron radiation

Three different computed tomography (CT) reconstruction algorithms: Filtered Back Projection (FBP), Unified Tomographic Reconstruction (UTR) and customized Simultaneous Algebraic Reconstruction Technique (cSART), have been systematically compared and evaluated using experimental data from CT scans of ten fresh mastectomy samples collected at the Imaging and Medical beamline of the Australian Synchrotron. All the scans were collected at the mean glandular dose of 2 mGy, using monochromatic X-rays with 32 keV energy, flat-panel detectors with 0.1 mm pixels and 6 meter distance between the rotation stage and the detector. Paganin's phase retrieval method was used in conjunction with all three CT reconstruction algorithms. The reconstructed images were compared in terms of the objective image quality characteristics, including spatial resolution, contrast, signal-to-noise, and contrast-to-noise ratios. The images were also evaluated by seven experienced medical imaging specialists, rating perceptible contrast, sharpness of tissue interfaces, image noise, calcification visibility and overall image quality. Of the three compared algorithms, cSART was clearly superior to UTR and FBP in terms of most measured objective image quality characteristics. At the same time, the results of the subjective quality evaluation consistently favoured the images reconstructed by FBP, followed by UTR, with cSART receiving lower scores on average. We argue that this apparent disagreement between the objective and subjective assessments of image quality can be explained by the importance assigned to image contrast in the subjective assessment, while the signal-to-noise ratio seemed to receive relatively low weighting. This study was conducted in preparation for phase-contrast breast CT imaging of live patients at Australian Synchrotron (Melbourne, Australia).

physics.med-ph