arXiv Science⌕ Search

arXiv subjects

Menglin Liu

Publications and source records attributed to Menglin Liu.

8 recordsLinked to original sources

Measuring Public Participation in Local Government: An Audio-Based Instrument for Classifying Speakers in City Council Meetings

How much does the public actually speak in local government? Despite sustained interest in democratic participation, we lack large-scale measures of public voice at the local level, because the underlying record -- audio of open meetings -- has been prohibitively costly to convert into data. We contribute a measurement instrument: an audio-analysis pipeline that classifies each speaker in a city council meeting as an elected official or a member of the public directly from audio, and aggregates these labels into validated measures of participation such as floor-time share. The pipeline first segments each recording by speaker, then classifies each speaker with a multimodal large language model (MLLM), using the meeting's own temporal structure (neighboring speakers, iterative refinement, and a majority vote across three classifiers) as supporting components. We collect 1,618 recordings from seven U.S. cities (2017-2023); after diarization and quality control, the analytic corpus is 1,565 meetings from five cities. The task is non-trivial: audio quality is uneven, members of the public speak informally and are often introduced only briefly, and speech frequently overlaps. Even so, segmentation reaches 89% accuracy (mean pairwise kappa=0.84), and the classifier reaches 87.7% accuracy (kappa=0.736, public-participant F1=0.832) on ground truth from five cities (N=1,761 speakers) -- agreement comparable to that among the human annotators themselves. At scale, members of the public receive a median of just 10% of floor time, the top speaker is an official in over 94% of meetings, and public participation declined over COVID-19 without recovering by 2023. The instrument measures participation directly from audio, without transcription or linkage to external voter or property records, establishing audio-as-data as a practical approach for the study of local politics.

cs.CY↗

JailbreakOPT: Iterative Jailbreak Prompt Optimization with Macro-Action

Jailbreak attacks expose persistent safety weaknesses in large language models (LLMs), but existing stateless single-turn methods face a trade-off: hand-crafted prompts are expressive but static, while iterative prompt optimization can adapt but often relies on low-level mutations that require many target-model responses. We propose JailbreakOPT, a method that maintains a library of reusable prompt transformations (actions) and composes them into macro-actions for within-episode search, generating standalone attack prompts. To reuse experience across episodes, JailbreakOPT learns an action-selection policy using contextual Thompson sampling and outcomes from prior search paths. Experiments across multiple LLMs and benchmarks show that JailbreakOPT improves attack success rate (ASR) over single-action and iterative baselines. More broadly, exploration and exploitation over human-designed attack strategies can help probe residual vulnerabilities and identify failure patterns that may inform defenses aimed at broader classes of attacks.

cs.CR↗

CHAOSMINING: Benchmarking Post-Hoc Attribution with Sparse Informative Features in High Dimensions

Post-hoc attribution is widely used to identify important model inputs, but evaluating whether these attributions identify truly informative features is difficult because real datasets rarely provide reliable ground truth. We introduce a multimodal benchmark containing symbolic tabular, vision, and audio tasks with known informative feature sets. In the main benchmark conditions, informative variables, spatial regions, or channels occupy fixed input coordinates while the remaining inputs provide irrelevant or distracting information. We use the benchmark to study how attribution quality depends on predictive performance, irrelevant-feature burden and structure, model configuration, and attribution mechanism, while separately measuring identification, stability, and computational cost. In most symbolic-data sweeps, informative-set identification co-varies with predictive performance, while the relative ordering of attribution methods remains largely stable. Across modalities, no method dominates all architectures and conditions, and greater attribution complexity does not consistently improve identification. Simple gradient attribution is often competitive at lower computational cost, while the vision and audio results show that architecture and the form of irrelevant content materially affect attribution quality.

cs.LG↗

What a Model Refuses, a State Fears: How Authoritarian Information Control Reproduces in Language-Model Guardrails

As large language models increasingly mediate access to political information, their refusal behavior creates a new site of information control. We ask whether political distinctions identified in theories of authoritarian information control remain visible in model guardrails, and how their enforcement changes when implemented through general-purpose AI. Across ten models, we combine cross-model comparisons with within-model experiments that manipulate political referent, collective-action potential, and political valence. Aggregate differences in political refusal across developer origins are sensitive to model composition, but the within-model experiments reveal a more specific structure. Chinese-developed models are substantially more likely to refuse otherwise identical political requests when they concern China rather than foreign or fictional settings, and refusal responds more strongly to collective-action potential than to political valence, including for peaceful pro-government mobilization. Yet these political distinctions are enforced imperfectly: refusal extends to some low-coordination political criticism even though models can distinguish criticism from coordination; the form of non-compliance varies across languages; and high native refusal does not imply adversarial robustness. These findings show that general-purpose AI can preserve recognizable political boundaries while transforming the breadth, form, and robustness with which those boundaries are enforced. More broadly, they demonstrate why refusal rates alone provide an incomplete measure of political control in language models.

cs.CY↗

Are LLMs Positionally Consistent Ordinal Classifiers? A Systematic Evaluation

Large language models are increasingly used for ordinal classification, yet semantically equivalent changes to prompt organization can alter their predictions. We conduct systematic experiments to characterize positional bias from label order, demonstration order, and demonstration placement. First, we apply the three probes to ten frontier LLMs on a common ordinal-classification task; every model is sensitive to all three positional sources, showing that the problem is pervasive. Second, we vary eight prompt-, task-, and model-level factors across five datasets; accuracy and stability are often misaligned, and only lower scale cardinality consistently improves both. Third, we compare pointwise, pairwise, and listwise inference, alternative aggregation and debiasing methods, and joint configurations; the tested corrections do not provide a reliable remedy, while a comparison-based listwise formulation offers the best balance but transfers unevenly across models and bias sources. These findings show that positional robustness depends on the full system configuration rather than the model alone. Ordinal-classification systems should therefore be selected jointly for predictive performance and stability.

cs.CL↗

Enhancing LLM-Based Text Classification in Political Science: Automatic Prompt Optimization and Dynamic Exemplar Selection for Few-Shot Learning

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that enhances LLM performance through automatic prompt optimization, dynamic exemplar selection, and a consensus mechanism. Our approach automates prompt refinement using task-specific exemplars, eliminating speculative trial-and-error adjustments and producing structured prompts aligned with human-defined criteria. In the second stage, we dynamically select the most relevant exemplars, ensuring contextually appropriate guidance for each query. Finally, our consensus mechanism mimics the role of multiple human coders for a single task, combining outputs from LLMs to achieve high reliability and consistency at a reduced cost. Evaluated across tasks including sentiment analysis, stance detection, and campaign ad tone classification, our method enhances classification accuracy without requiring task-specific model retraining or extensive manual adjustments to prompts. This framework not only boosts accuracy, interpretability and transparency but also provides a cost-effective, scalable solution tailored to political science applications. An open-source Python package (PoliPrompt) is available on GitHub.

cs.CL↗

Decoupled Doubly Contrastive Learning for Cross Domain Facial Action Unit Detection

Despite the impressive performance of current vision-based facial action unit (AU) detection approaches, they are heavily susceptible to the variations across different domains and the cross-domain AU detection methods are under-explored. In response to this challenge, we propose a decoupled doubly contrastive adaptation (D$^2$CA) approach to learn a purified AU representation that is semantically aligned for the source and target domains. Specifically, we decompose latent representations into AU-relevant and AU-irrelevant components, with the objective of exclusively facilitating adaptation within the AU-relevant subspace. To achieve the feature decoupling, D$^2$CA is trained to disentangle AU and domain factors by assessing the quality of synthesized faces in cross-domain scenarios when either AU or domain attributes are modified. To further strengthen feature decoupling, particularly in scenarios with limited AU data diversity, D$^2$CA employs a doubly contrastive learning mechanism comprising image and feature-level contrastive learning to ensure the quality of synthesized faces and mitigate feature ambiguities. This new framework leads to an automatically learned, dedicated separation of AU-relevant and domain-relevant factors, and it enables intuitive, scale-specific control of the cross-domain facial image synthesis. Extensive experiments demonstrate the efficacy of D$^2$CA in successfully decoupling AU and domain factors, yielding visually pleasing cross-domain synthesized facial images. Meanwhile, D$^2$CA consistently outperforms state-of-the-art cross-domain AU detection approaches, achieving an average F1 score improvement of 6\%-14\% across various cross-domain scenarios.

cs.CV↗

Molecular Multipoles and (Hyper)Polarizabilities from Buckingham Expansion. Revisited

Buckingham expansion is important for understanding molecular multipoles and (hyper)polarizabilities. In this study, we give a complete derivation of Buckingham expansion in the traced form using successive Taylor series. Based on such derivation, a general Buckingham expansion in the traced form is proposed, and from which numerical calculations with finite field method of high accuracy can be achieved. The transformations from the traced multipoles and multipole-multipole polarizabilities to the corresponding traceless counterparts are realized with an auxiliary traced electric field gradient. The applications of the finite field method in this study show good agreements with previous theoretical calculations and experimental measurements.

physics.chem-ph↗