arXiv Science⌕ Search

arXiv subjects

Tamara Babaian

Publications and source records attributed to Tamara Babaian.

4 recordsLinked to original sources

Algorithmic Bias from the Perspectives of Healthcare Professionals

This paper focuses on algorithmic bias of machine learning and artificial intelligence applications in healthcare information systems. Based on the quantitative data and qualitative comments from a survey and interviews with healthcare professionals, who have different job roles (e.g., clinical vs. administrative), this study provides findings about the relationships between algorithmic bias, perceived fairness, and the intended acceptance and adoption of ML algorithms and algorithm generated outcomes. The results suggest that the opinions of healthcare professionals toward the causes of algorithmic bias, the criteria of algorithm assessment, the perceived fairness, and bias mitigation approaches may vary depending on their job roles, perspectives, tasks, and the algorithm characteristics. More research is needed to investigate algorithmic bias to ensure fairness and equality in healthcare.

cs.AI↗

The Collaborative Critique: An Inspection Method for Expert Evaluation of User Interfaces

The development of the collaborative critique (CC) usability inspection method was driven by the need for systems, ranging from the simple to the complex, to lessen the workload on their users by being better collaborative partners. In the collaborative view of system-user interaction, the role of the system is expanded to that of a partner that must help its users achieve their goals. This perspective shifts the dynamic from focusing on the user's ability to make effective and efficient use of the system to the system's usefulness within a given task, user, and interaction context, thereby reducing the user's cognitive and physical efforts. The CC method consists of a walkthrough evaluation in which the questions answered at each step of the interaction assess the collaborative strength of the system. This method is further distinguished by the inclusion of questions that access the behavior of the system in error situations, which are known to be particularly burdensome to users of complex systems. In this paper, we provide a detailed description of the CC method and its application and demonstrate its usefulness in evaluating an interface. The results of a laboratory evaluation show that the method performed well in identifying the problems experienced by users across all severity levels and predicted almost all of the problems associated with error situations.

cs.HC↗

Entity Recognition from Colloquial Text

Extraction of concepts and entities of interest from non-formal texts such as social media posts and informal communication is an important capability for decision support systems in many domains, including healthcare, customer relationship management, and others. Despite the recent advances in training large language models for a variety of natural language processing tasks, the developed models and techniques have mainly focused on formal texts and do not perform as well on colloquial data, which is characterized by a number of distinct challenges. In our research, we focus on the healthcare domain and investigate the problem of symptom recognition from colloquial texts by designing and evaluating several training strategies for BERT-based model fine-tuning. These strategies are distinguished by the choice of the base model, the training corpora, and application of term perturbations in the training data. The best-performing models trained using these strategies outperform the state-of-the-art specialized symptom recognizer by a large margin. Through a series of experiments, we have found specific patterns of model behavior associated with the training strategies we designed. We present design principles for training strategies for effective entity recognition in colloquial texts based on our findings.

cs.CL↗

Efficient Open World Reasoning for Planning

We consider the problem of reasoning and planning with incomplete knowledge and deterministic actions. We introduce a knowledge representation scheme called PSIPLAN that can effectively represent incompleteness of an agent's knowledge while allowing for sound, complete and tractable entailment in domains where the set of all objects is either unknown or infinite. We present a procedure for state update resulting from taking an action in PSIPLAN that is correct, complete and has only polynomial complexity. State update is performed without considering the set of all possible worlds corresponding to the knowledge state. As a result, planning with PSIPLAN is done without direct manipulation of possible worlds. PSIPLAN representation underlies the PSIPOP planning algorithm that handles quantified goals with or without exceptions that no other domain independent planner has been shown to achieve. PSIPLAN has been implemented in Common Lisp and used in an application on planning in a collaborative interface.

cs.AI↗