arXiv Science⌕ Search

arXiv subjects

Jia Geng

Publications and source records attributed to Jia Geng.

2 recordsLinked to original sources

User Embeddings are Superpositions of Interpretable Behavioral Modes

User embeddings are central components of modern recommendation, personalization, and behavioral modeling systems. Though these embeddings can compactly encode rich behavioral information, they are inherently dense and opaque, limiting interpretability. To address this gap, we argue that user embeddings can be understood as sparse superpositions of interpretable behavioral modes. This structure is directly predicted by generative models of user behavior for linear embeddings and extends approximately to deep-learning representations by the superposition hypothesis. Superimposed modes can naturally be recovered by sparse dictionary learning methods, such as sparse autoencoders (SAEs), and recovered modes can be automatically named and queried in natural language. We validate mode recovery against known ground truth on synthetic data, where SAEs recover modes better than classical sparse baselines. We then apply our methods to classical and transformer-based user embeddings from two real-world datasets. We also show how the corresponding natural-language labels enable zero-shot audience retrieval and characterization over embeddings never trained on text. The framework is post-hoc and model-agnostic, requiring no modification to the upstream embedding system.

cs.LG↗

Hydrophobically gated memristive nanopores for neuromorphic applications

Brain-inspired computing has the potential to revolutionise the current von Neumann architecture, advancing machine learning applications. Signal transmission in the brain relies on voltage-gated ion channels, which exhibit the electrical behaviour of memristors, resistors with memory. State-of-the-art technologies currently employ semiconductor-based neuromorphic approaches, which have already demonstrated their efficacy in machine learning systems. However, these approaches still cannot match performance achieved by biological neurons in terms of energy efficiency and size. In this study, we utilise molecular dynamics simulations, continuum models, and electrophysiological experiments to propose and realise a bioinspired hydrophobically gated memristive nanopore. Our findings indicate that hydrophobic gating enables memory through an electrowetting mechanism, and we establish simple design rules accordingly. Through the engineering of a biological nanopore, we successfully replicate the characteristic hysteresis cycles of a memristor \tr{and construct a synaptic device capable of learning and forgetting}. This advancement offers a promising pathway for the realization of nanoscale, cost- and energy-effective, and adaptable bioinspired memristors.

cond-mat.mes-hall↗