arXiv Science⌕ Search

arXiv subjects

Bowen Chen

Publications and source records attributed to Bowen Chen.

88 records · Page 5Linked to original sources

AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose

Creating expressive, diverse and high-quality 3D avatars from highly customized text descriptions and pose guidance is a challenging task, due to the intricacy of modeling and texturing in 3D that ensure details and various styles (realistic, fictional, etc). We present AvatarVerse, a stable pipeline for generating expressive high-quality 3D avatars from nothing but text descriptions and pose guidance. In specific, we introduce a 2D diffusion model conditioned on DensePose signal to establish 3D pose control of avatars through 2D images, which enhances view consistency from partially observed scenarios. It addresses the infamous Janus Problem and significantly stablizes the generation process. Moreover, we propose a progressive high-resolution 3D synthesis strategy, which obtains substantial improvement over the quality of the created 3D avatars. To this end, the proposed AvatarVerse pipeline achieves zero-shot 3D modeling of 3D avatars that are not only more expressive, but also in higher quality and fidelity than previous works. Rigorous qualitative evaluations and user studies showcase AvatarVerse's superiority in synthesizing high-fidelity 3D avatars, leading to a new standard in high-quality and stable 3D avatar creation. Our project page is: https://avatarverse3d.github.io

cs.CV↗

Weakly Supervised AI for Efficient Analysis of 3D Pathology Samples

Human tissue and its constituent cells form a microenvironment that is fundamentally three-dimensional (3D). However, the standard-of-care in pathologic diagnosis involves selecting a few two-dimensional (2D) sections for microscopic evaluation, risking sampling bias and misdiagnosis. Diverse methods for capturing 3D tissue morphologies have been developed, but they have yet had little translation to clinical practice; manual and computational evaluations of such large 3D data have so far been impractical and/or unable to provide patient-level clinical insights. Here we present Modality-Agnostic Multiple instance learning for volumetric Block Analysis (MAMBA), a deep-learning-based platform for processing 3D tissue images from diverse imaging modalities and predicting patient outcomes. Archived prostate cancer specimens were imaged with open-top light-sheet microscopy or microcomputed tomography and the resulting 3D datasets were used to train risk-stratification networks based on 5-year biochemical recurrence outcomes via MAMBA. With the 3D block-based approach, MAMBA achieves an area under the receiver operating characteristic curve (AUC) of 0.86 and 0.74, superior to 2D traditional single-slice-based prognostication (AUC of 0.79 and 0.57), suggesting superior prognostication with 3D morphological features. Further analyses reveal that the incorporation of greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, suggesting the value of capturing larger extents of heterogeneous 3D morphology. With the rapid growth and adoption of 3D spatial biology and pathology techniques by researchers and clinicians, MAMBA provides a general and efficient framework for 3D weakly supervised learning for clinical decision support and can help to reveal novel 3D morphological biomarkers for prognosis and therapeutic response.

eess.IV↗

Towards a Visual-Language Foundation Model for Computational Pathology

The accelerated adoption of digital pathology and advances in deep learning have enabled the development of powerful models for various pathology tasks across a diverse array of diseases and patient cohorts. However, model training is often difficult due to label scarcity in the medical domain and the model's usage is limited by the specific task and disease for which it is trained. Additionally, most models in histopathology leverage only image data, a stark contrast to how humans teach each other and reason about histopathologic entities. We introduce CONtrastive learning from Captions for Histopathology (CONCH), a visual-language foundation model developed using diverse sources of histopathology images, biomedical text, and notably over 1.17 million image-caption pairs via task-agnostic pretraining. Evaluated on a suite of 13 diverse benchmarks, CONCH can be transferred to a wide range of downstream tasks involving either or both histopathology images and text, achieving state-of-the-art performance on histology image classification, segmentation, captioning, text-to-image and image-to-text retrieval. CONCH represents a substantial leap over concurrent visual-language pretrained systems for histopathology, with the potential to directly facilitate a wide array of machine learning-based workflows requiring minimal or no further supervised fine-tuning.

cs.CV↗

Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Images

Contrastive visual language pretraining has emerged as a powerful method for either training new language-aware image encoders or augmenting existing pretrained models with zero-shot visual recognition capabilities. However, existing works typically train on large datasets of image-text pairs and have been designed to perform downstream tasks involving only small to medium sized-images, neither of which are applicable to the emerging field of computational pathology where there are limited publicly available paired image-text datasets and each image can span up to 100,000 x 100,000 pixels. In this paper we present MI-Zero, a simple and intuitive framework for unleashing the zero-shot transfer capabilities of contrastively aligned image and text models on gigapixel histopathology whole slide images, enabling multiple downstream diagnostic tasks to be carried out by pretrained encoders without requiring any additional labels. MI-Zero reformulates zero-shot transfer under the framework of multiple instance learning to overcome the computational challenge of inference on extremely large images. We used over 550k pathology reports and other available in-domain text corpora to pre-train our text encoder. By effectively leveraging strong pre-trained encoders, our best model pretrained on over 33k histopathology image-caption pairs achieves an average median zero-shot accuracy of 70.2% across three different real-world cancer subtyping tasks. Our code is available at: https://github.com/mahmoodlab/MI-Zero.

cs.CV↗

Full Resolution Repetition Counting

Given an untrimmed video, repetitive actions counting aims to estimate the number of repetitions of class-agnostic actions. To handle the various length of videos and repetitive actions, also optimization challenges in end-to-end video model training, down-sampling is commonly utilized in recent state-of-the-art methods, leading to ignorance of several repetitive samples. In this paper, we attempt to understand repetitive actions from a full temporal resolution view, by combining offline feature extraction and temporal convolution networks. The former step enables us to train repetition counting network without down-sampling while preserving all repetition regardless of the video length and action frequency, and the later network models all frames in a flexible and dynamically expanding temporal receptive field to retrieve all repetitions with a global aspect. We experimentally demonstrate that our method achieves better or comparable performance in three public datasets, i.e., TransRAC, UCFRep and QUVA. We expect this work will encourage our community to think about the importance of full temporal resolution.

cs.CV↗

Topological Hall Effect Driven by Short-Range Magnetic Orders in EuZn$_2$As$_2$

Short-range (SR) magnetic orders such as magnetic glass orders or fluctuations in a quantum system usually host exotic states or critical behaviors. As the long-range (LR) magnetic orders, SR magnetic orders can also break time-reversal symmetry and drive the non-zero Berry curvature leading to novel transport properties. In this work, we report that in EuZn$_2$As$_2$ compound, besides the LR A-type antiferromagnetic (AF) order, the SR magnetic order is observed in a wide temperature region. The magnetization measurements and electron spin resonance (ESR) measurements reveal the ferromagnetic (FM) correlations for this SR magnetic order which results in an obvious anomalous Hall effect above the AF transition. Moreover the ESR results reveal that this FM SR order coexists with LR AF order exhibiting anisotropic magnetic correlations below the AF transition. The interactions of LR and SR magnetism evolving with temperature and field can host non-zero spin charility and berry curvature leading the additional topological Hall contribution even in a centrosymmetric simple AF system. Our results indicate that EuZn$_2$As$_2$ is a fertile platform to investigate exotic magnetic and electronic states.

cond-mat.str-el↗

Boundary and bulk notions of transport in the AdS$_3$/CFT$_2$ correspondence

We construct operators in holographic two-dimensional conformal field theory, which act locally in the code subspace as arbitrary bulk spacelike vector fields. Key to the construction is an interplay between parallel transport in the bulk spacetime and in kinematic space. We outline challenges, which arise when the same construction is extended to timelike vector fields. We also sketch several applications, including boundary formulations of the bulk Riemann tensor, dreibein, and spin connection, as well as an application to holographic complexity.

hep-th↗

Modular parallel transport of multiple intervals in 1+1-dimensional free fermion theory

Modular parallel transport is a generalization of Berry phases, applied to modular (entanglement) Hamiltonians. Here we initiate the study of modular parallel transport for disjoint field theory regions. We study modular parallel transport in the kinematic space of multi-interval regions in the vacuum of 1+1-dimensional free fermion theory--one of the few theories for which modular Hamiltonians on disjoint regions are known. We compute explicitly the generators of modular parallel transport, and explain why their relatively simple form follows from a half-sided modular inclusion. We also compute explicitly the curvature two-form of modular parallel transport. We contrast all calculations with the expected behavior of modular parallel transport in holographic theories, emphasizing the role of non-local terms that couple distinct intervals.

hep-th↗

Text Difficulty Study: Do machines behave the same as humans regarding text difficulty?

Given a task, human learns from easy to hard, whereas the model learns randomly. Undeniably, difficulty insensitive learning leads to great success in NLP, but little attention has been paid to the effect of text difficulty in NLP. In this research, we propose the Human Learning Matching Index (HLM Index) to investigate the effect of text difficulty. Experiment results show: (1) LSTM has more human-like learning behavior than BERT. (2) UID-SuperLinear gives the best evaluation of text difficulty among four text difficulty criteria. (3) Among nine tasks, some tasks' performance is related to text difficulty, whereas some are not. (4) Model trained on easy data performs best in easy and medium data, whereas trains on a hard level only perform well on hard data. (5) Training the model from easy to hard leads to fast convergence.

cs.CL↗

Quantum Information in Holographic Duality

We give a pedagogical review of how concepts from quantum information theory build up the gravitational side of the AdS/CFT correspondence. The review is self-contained in that it only presupposes knowledge of quantum mechanics and general relativity; other tools--including holographic duality itself--are introduced in the text. We have aimed to give researchers interested in entering this field a working knowledge sufficient for initiating original projects. The review begins with the laws of black hole thermodynamics, which form the basis of this subject, then introduces the Ryu-Takayanagi proposal, the JLMS relation, and subregion duality. We discuss tensor networks as a visualization tool and analyze various network architectures in detail. Next, several modern concepts and techniques are discussed: Renyi entropies and the replica trick, differential entropy and kinematic space, modular Berry phases, modular minimal entropy, entanglement wedge cross sections, bit threads, and others. We discuss the extent to which bulk geometries are fixed by boundary entanglement entropies, and analyze the relations such as the monogamy of mutual information, which boundary entanglement entropies must obey if a state has a semiclassical bulk dual. We close with a discussion of black holes, including holographic complexity, firewalls and the black hole information paradox, islands, and replica wormholes.

hep-th↗

Phased Flight Trajectory Prediction with Deep Learning

The unprecedented increase of commercial airlines and private jets over the next ten years presents a challenge for air traffic control. Precise flight trajectory prediction is of great significance in air transportation management, which contributes to the decision-making for safe and orderly flights. Existing research and application mainly focus on the sequence generation based on historical trajectories, while the aircraft-aircraft interactions in crowded airspace especially the airspaces near busy airports have been largely ignored. On the other hand, there are distinct characteristics of aerodynamics for different flight phases, and the trajectory may be affected by various uncertainties such as weather and advisories from air traffic controllers. However, there is no literature fully considers all these issues. Therefore, we proposed a phased flight trajectory prediction framework. Multi-source and multi-modal datasets have been analyzed and mined using variants of recurrent neural network (RNN) mixture. To be specific, we first introduce spatio temporal graphs into the low-altitude airway prediction problem, and the motion constraints of an aircraft are embedded to the inference process for reliable forecasting results. In the en-route phase, the dual attention mechanism is employed to adaptively extract much more important features from overall datasets to learn the hidden patterns in dynamical environments. The experimental results demonstrate our proposed framework can outperform state-of-the-art methods for flight trajectory prediction for large passenger/transport airplanes.

cs.LG↗

Fusion-DHL: WiFi, IMU, and Floorplan Fusion for Dense History of Locations in Indoor Environments

The paper proposes a multi-modal sensor fusion algorithm that fuses WiFi, IMU, and floorplan information to infer an accurate and dense location history in indoor environments. The algorithm uses 1) an inertial navigation algorithm to estimate a relative motion trajectory from IMU sensor data; 2) a WiFi-based localization API in industry to obtain positional constraints and geo-localize the trajectory; and 3) a convolutional neural network to refine the location history to be consistent with the floorplan. We have developed a data acquisition app to build a new dataset with WiFi, IMU, and floorplan data with ground-truth positions at 4 university buildings and 3 shopping malls. Our qualitative and quantitative evaluations demonstrate that the proposed system is able to produce twice as accurate and a few orders of magnitude denser location history than the current standard, while requiring minimal additional energy consumption. We will publicly share our code, data and models.

cs.RO↗

A Combinatorial Approach to Root Multiplicities of a Special Type Rank 3 Kac-Moody Algebras

In this paper, we calculate the dimension of root spaces $\mathfrak{g}_λ$ of a special type rank $3$ Kac-Moody algebras $\mathfrak{g}$. We first introduce a special type of elements in $\mathfrak{g}$, which we call elements in standard form. Then, we prove that any root space is spanned by these elements. By calculating the number of linearly independent elements in standard form, we obtain a formula for the dimension of root spaces $\mathfrak{g}_λ$, which depends on the root $λ$.

math.RT↗

ScribbleBox: Interactive Annotation Framework for Video Object Segmentation

Manually labeling video datasets for segmentation tasks is extremely time consuming. In this paper, we introduce ScribbleBox, a novel interactive framework for annotating object instances with masks in videos. In particular, we split annotation into two steps: annotating objects with tracked boxes, and labeling masks inside these tracks. We introduce automation and interaction in both steps. Box tracks are annotated efficiently by approximating the trajectory using a parametric curve with a small number of control points which the annotator can interactively correct. Our approach tolerates a modest amount of noise in the box placements, thus typically only a few clicks are needed to annotate tracked boxes to a sufficient accuracy. Segmentation masks are corrected via scribbles which are efficiently propagated through time. We show significant performance gains in annotation efficiency over past work. We show that our ScribbleBox approach reaches 88.92% J&F on DAVIS2017 with 9.14 clicks per box track, and 4 frames of scribble annotation.

cs.CV↗

Cutoff Dependence and Complexity of the CFT$_2$ Ground State

We present the vacuum of a two-dimensional conformal field theory (CFT$_2$) as a network of Wilson lines in $SL(2,\mathbb{R}) \times SL(2,\mathbb{R})$ Chern-Simons theory, which is conventionally used to study gravity in three-dimensional anti-de Sitter space (AdS$_3$). The position and shape of the network encode the cutoff scale at which the ground state density operator is defined. A general argument suggests identifying the `density of complexity' of this network with the extrinsic curvature of the cutoff surface in AdS$_3$, which by the Gauss-Bonnet theorem agrees with the holographic Complexity = Volume proposal.

hep-th↗