arXiv subjects

Junyan He

Publications and source records attributed to Junyan He.

18 recordsLinked to original sources

arXiv2026

UniSpace: Unified Visual Representation and Scalable Multimodal Modeling

Semantic vision encoders have become a central visual interface for multimodal understanding and semantic conditioning in image generation. However, their final tokens discard fine-grained visual details, leading to poor pixel reconstruction and limiting their use in reconstruction-sensitive tasks such as image generation and editing. In this work, we ask whether understanding, generation, and editing can be modeled in a single visual representation space built from a pretrained semantic ViT. We show that the frozen Transformer blocks of a semantic ViT are not intrinsically unable to preserve visual details. Instead, the original patch parameterization drives the representation toward semantic abstraction, making fine-grained information difficult to recover from the final tokens. Based on this observation, we introduce \emph{Patch Reparameterization}, which preserves the original semantic pathway while adding a reconstruction-aware patch embedding that provides fine-grained visual information to the same frozen ViT blocks. The resulting unified representation preserves multimodal understanding while enabling high-fidelity image reconstruction and a favorable reconstruction--generation trade-off. We further scale this representation into \emph{UniSpace}, an 8B Mixture-of-Transformer-Experts model that performs understanding, generation, and editing in the same visual space without a separate VAE pathway. System-level evaluations demonstrate practical text-to-image generation and instruction-based image editing, showing that a reparameterized pretrained ViT can serve as a unified visual interface for scalable multimodal modeling.

cs.CV↗

arXiv2026

ViGoR-Bench: How Far Are Visual Generative Models From Zero-Shot Visual Reasoners?

Beneath the stunning visual fidelity of modern AIGC models lies a "logical desert", where systems fail tasks that require physical, causal, or complex spatial reasoning. Current evaluations largely rely on superficial metrics or fragmented benchmarks, creating a ``performance mirage'' that overlooks the generative process. To address this, we introduce ViGoR Vision-G}nerative Reasoning-centric Benchmark), a unified framework designed to dismantle this mirage. ViGoR distinguishes itself through four key innovations: 1) holistic cross-modal coverage bridging Image-to-Image and Video tasks; 2) a dual-track mechanism evaluating both intermediate processes and final results; 3) an evidence-grounded automated judge ensuring high human alignment; and 4) granular diagnostic analysis that decomposes performance into fine-grained cognitive dimensions. Experiments on over 20 leading models reveal that even state-of-the-art systems harbor significant reasoning deficits, establishing ViGoR as a critical ``stress test'' for the next generation of intelligent vision models. The demo have been available at https://vincenthancoder.github.io/ViGoR-Bench/

cs.CV↗

arXiv2026

First-principles study of hydrogen diffusion in polycrystalline Nickel

Hydrogen embrittlement in metals is strongly governed by hydrogen diffusion and trapping, yet predicting these effects in polycrystalline systems remains challenging. This work introduces a multiscale modeling framework that links atomistic energetics to continuum-scale transport. Migration barriers for bulk and grain-boundary environments, obtained from first-principles calculations, are used in kinetic Monte Carlo simulations to compute anisotropic effective diffusivities. These diffusivities are then incorporated into finite element models of polycrystalline microstructures, explicitly accounting for grain-boundary character and connectivity. The approach captures both fast-path and trapping effects without relying on empirical parameters and reproduces experimental trends for nickel, including the dependence of effective diffusivity on grain size and boundary type. This methodology provides a physically grounded route for predicting hydrogen transport in engineering alloys and can be extended to other materials and defect types.

cond-mat.mtrl-sci↗

arXiv2025

Active RIS Enabled NLoS LEO Satellite Communications: A Three-timescale Optimization Framework

In this letter, we study an active reconfigurable intelligent surfaces (RIS) assisted Low Earth orbit (LEO) satellite communications under non-line-of-sight (NLoS) scenarios, where the active RIS is deployed to create visual line-of-sight links for reliable communication. To address the challenges of high energy consumption caused by frequent beamforming updates in active RIS, we propose a three-timescale optimization framework that jointly designs the transmit beamforming, RIS beamforming, and RIS direction vectors based on their characteristics. The goal is to maximize the system achievable rate while reducing energy consumption by controlling the RIS beamforming switching frequency. Then, a two-layer solution framework is developed, incorporating fractional programming (FP), alternating optimization (AO), successive approximation (SCA), and penalty-based methods, to obtain the optimized solution. Simulation results demonstrate that the proposed scheme can effectively improve system performance and reduce the energy consumption of the active RIS.

eess.SP↗

arXiv2024

Nonlinear Inverse Design of Mechanical Multi-Material Metamaterials Enabled by Video Denoising Diffusion and Structure Identifier

Metamaterials, synthetic materials with customized properties, have emerged as a promising field due to advancements in additive manufacturing. These materials derive unique mechanical properties from their internal lattice structures, which are often composed of multiple materials that repeat geometric patterns. While traditional inverse design approaches have shown potential, they struggle to map nonlinear material behavior to multiple possible structural configurations. This paper presents a novel framework leveraging video diffusion models, a type of generative artificial Intelligence (AI), for inverse multi-material design based on nonlinear stress-strain responses. Our approach consists of two key components: (1) a fields generator using a video diffusion model to create solution fields based on target nonlinear stress-strain responses, and (2) a structure identifier employing two UNet models to determine the corresponding multi-material 2D design. By incorporating multiple materials, plasticity, and large deformation, our innovative design method allows for enhanced control over the highly nonlinear mechanical behavior of metamaterials commonly seen in real-world applications. It offers a promising solution for generating next-generation metamaterials with finely tuned mechanical characteristics.

cs.AI↗

arXiv2024

Advanced Deep Operator Networks to Predict Multiphysics Solution Fields in Materials Processing and Additive Manufacturing

Unlike classical artificial neural networks, which require retraining for each new set of parametric inputs, the Deep Operator Network (DeepONet), a lately introduced deep learning framework, approximates linear and nonlinear solution operators by taking parametric functions (infinite-dimensional objects) as inputs and mapping them to complete solution fields. In this paper, two newly devised DeepONet formulations with sequential learning and Residual U-Net (ResUNet) architectures are trained for the first time to simultaneously predict complete thermal and mechanical solution fields under variable loading, loading histories, process parameters, and even variable geometries. Two real-world applications are demonstrated: 1- coupled thermo-mechanical analysis of steel continuous casting with multiple visco-plastic constitutive laws and 2- sequentially coupled direct energy deposition for additive manufacturing. Despite highly challenging spatially variable target stress distributions, DeepONets can infer reasonably accurate full-field temperature and stress solutions several orders of magnitude faster than traditional and highly optimized finite-element analysis (FEA), even when FEA simulations are run on the latest high-performance computing platforms. The proposed DeepONet model's ability to provide field predictions almost instantly for unseen input parameters opens the door for future preliminary evaluation and design optimization of these vital industrial processes.

cs.CE↗

arXiv2024

Geom-DeepONet: A Point-cloud-based Deep Operator Network for Field Predictions on 3D Parameterized Geometries

Modern digital engineering design process commonly involves expensive repeated simulations on varying three-dimensional (3D) geometries. The efficient prediction capability of neural networks (NNs) makes them a suitable surrogate to provide design insights. Nevertheless, few available NNs can handle solution prediction on varying 3D shapes. We present a novel deep operator network (DeepONet) variant called Geom-DeepONet, which encodes parameterized 3D geometries and predicts full-field solutions on an arbitrary number of nodes. To the best of the authors' knowledge, this is the first attempt in the literature and is our primary novelty. In addition to expressing shapes using mesh coordinates, the signed distance function for each node is evaluated and used to augment the inputs to the trunk network of the Geom-DeepONet, thereby capturing both explicit and implicit representations of the 3D shapes. The powerful geometric encoding capability of a sinusoidal representation network (SIREN) is also exploited by replacing the classical feedforward neural networks in the trunk with SIREN. Additional data fusion between the branch and trunk networks is introduced by an element-wise product. A numerical benchmark was conducted to compare Geom-DeepONet to PointNet and vanilla DeepONet, where results show that our architecture trains fast with a small memory footprint and yields the most accurate results among the three with less than 2 MPa stress error. Results show a much lower generalization error of our architecture on unseen dissimilar designs than vanilla DeepONet. Once trained, the model can predict vector solutions, and speed can be over $10^5$ times faster than implicit finite element simulations for large meshes.

cs.CE↗

arXiv2024

Material-Response-Informed DeepONet and its Application to Polycrystal Stress-strain Prediction in Crystal Plasticity

Crystal plasticity (CP) simulations are a tool for understanding how microstructure morphology and texture affect mechanical properties and are an essential component of elucidating the structure-property relations. However, it can be computationally expensive. Hence, data-driven machine learning models have been applied to predict the mean-field response of a polycrystal representative volume element to reduce computation time. In this work, we proposed a novel Deep Operator Network (DeepONet) architecture for predicting microstructure stress-strain response. It employs a convolutional neural network in the trunk to encode the microstructure. To account for different material properties, boundary conditions, and loading, we proposed using single crystal stress-strain curves as inputs to the branch network, furnishing a material-response-informed DeepONet. Using four numerical examples, we demonstrate that the current DeepONet can be trained on a single material and loading and then generalized to new conditions via transfer learning. Results show that using single crystal responses as input outperforms a similar model using material properties as inputs and overcomes limitations with changing boundary conditions and temporal resolution. In all cases, the new model achieved a $R^2$ value of above 0.99, and over 95\% of predicted stresses have a relative error of $\le$ 5\%, indicating superior accuracy. With as few as 20 new data points and under 1min training time, the trained DeepONet can be fine-tuned to generate accurate predictions on different materials and loading. Once trained, the prediction speed is almost $1\times10^{4}$ times faster the CP simulations. The efficiency and high generalizability of our DeepONet render it a powerful data-driven surrogate model for CP simulations in multi-scale analyses.

cs.CE↗

arXiv2023

Predictions of Transient Vector Solution Fields with Sequential Deep Operator Network

The Deep Operator Network (DeepONet) structure has shown great potential in approximating complex solution operators with low generalization errors. Recently, a sequential DeepONet (S-DeepONet) was proposed to use sequential learning models in the branch of DeepONet to predict final solutions given time-dependent inputs. In the current work, the S-DeepONet architecture is extended by modifying the information combination mechanism between the branch and trunk networks to simultaneously predict vector solutions with multiple components at multiple time steps of the evolution history, which is the first in the literature using DeepONets. Two example problems, one on transient fluid flow and the other on path-dependent plastic loading, were shown to demonstrate the capabilities of the model to handle different physics problems. The use of a trained S-DeepONet model in inverse parameter identification via the genetic algorithm is shown to demonstrate the application of the model. In almost all cases, the trained model achieved an $R^2$ value of above 0.99 and a relative $L_2$ error of less than 10\% with only 3200 training data points, indicating superior accuracy. The vector S-DeepONet model, having only 0.4\% more parameters than a scalar model, can predict two output components simultaneously at an accuracy similar to the two independently trained scalar models with a 20.8\% faster training time. The S-DeepONet inference is at least three orders of magnitude faster than direct numerical simulations, and inverse parameter identifications using the trained model is highly efficient and accurate.

cs.CE↗

arXiv2023

Designing impact-resistant bio-inspired low-porosity structures using neural networks

Biological structural designs in nature, like hoof walls, horns, and antlers, can be used as inspiration for generating structures with excellent mechanical properties. A common theme in these designs is the small percent porosity in the structure ranging from 1 - 5\%. In this work, the sheep horn was used as an inspiration due to its higher toughness when loaded in the radial direction compared to the longitudinal direction. Under dynamic transverse compression, we investigated the structure-property relations in low porosity structures characterized by their two-dimensional (2D) cross-sections. A diverse design space was created by combining polygonal tubules with different numbers of sides placed on a grid with varying numbers of rows and columns. The volume fraction and the orientation angle of the tubules were also varied. The finite element (FE) method was used with a rate-dependent elastoplastic material model to generate the stress-strain curves under plane strain conditions. A gated recurrent unit (GRU) model was trained to predict the structures' stress-strain response and energy absorption under different strain rates and applied strains. The parameter-based model uses eight discrete parameters to characterize the design space and as inputs to the model. The trained GRU model can efficiently predict the response of a new design in as little as 0.16 ms and allows rapid performance evaluation of 128000 designs in the design space. The GRU predictions identified high-performance structures, and four design trends that affect the specific energy absorption were extracted and discussed.

cs.CE↗

arXiv2023

Sequential Deep Operator Networks (S-DeepONet) for Predicting Full-field Solutions Under Time-dependent Loads

Deep Operator Network (DeepONet), a recently introduced deep learning operator network, approximates linear and nonlinear solution operators by taking parametric functions (infinite-dimensional objects) as inputs and mapping them to solution functions in contrast to classical neural networks that need re-training for every new set of parametric inputs. In this work, we have extended the classical formulation of DeepONets by introducing sequential learning models like the gated recurrent unit (GRU) and long short-term memory (LSTM) in the branch network to allow for accurate predictions of the solution contour plots under parametric and time-dependent loading histories. Two example problems, one on transient heat transfer and the other on path-dependent plastic loading, were shown to demonstrate the capabilities of the new architectures compared to the benchmark DeepONet model with a feed-forward neural network (FNN) in the branch. Despite being more computationally expensive, the GRU- and LSTM-DeepONets lowered the prediction error by half (0.06\% vs. 0.12\%) compared to FNN-DeepONet in the heat transfer problem, and by 2.5 times (0.85\% vs. 3\%) in the plasticity problem. In all cases, the proposed DeepONets achieved a prediction $R^2$ value of above 0.995, indicating superior accuracy. Results show that once trained, the proposed DeepONets can accurately predict the final full-field solution over the entire domain and are at least two orders of magnitude faster than direct finite element simulations, rendering it an accurate and robust surrogate model for rapid preliminary evaluations.

cs.CE↗

arXiv2023

Novel DeepONet architecture to predict stresses in elastoplastic structures with variable complex geometries and loads

A novel deep operator network (DeepONet) with a residual U-Net (ResUNet) as the trunk network is devised to predict full-field highly nonlinear elastic-plastic stress response for complex geometries obtained from topology optimization under variable loads. The proposed DeepONet uses a ResUNet in the trunk to encode complex input geometries, and a fully-connected branch network encodes the parametric loads. Additional information fusion is introduced via an element-wise multiplication of the encoded latent space to improve prediction accuracy further. The performance of the proposed DeepONet was compared to two baseline models, a standalone ResUNet and a DeepONet with fully connected networks as the branch and trunk. The results show that ResUNet and the proposed DeepONet share comparable accuracy; both can predict the stress field and accurately identify stress concentration points. However, the novel DeepONet is more memory efficient and allows greater flexibility with framework architecture modifications. The DeepONet with fully connected networks suffers from high prediction error due to its inability to effectively encode the complex, varying geometry. Once trained, all three networks can predict the full stress distribution orders of magnitude faster than finite element simulations. The proposed network can quickly guide preliminary optimization, designs, sensitivity analysis, uncertainty quantification, and many other nonlinear analyses that require extensive forward evaluations with variable geometries, loads, and other parameters. This work marks the first time a ResUNet is used as the trunk network in the DeepONet architecture and the first time that DeepONet solves problems with complex, varying input geometries under parametric loads and elasto-plastic material behavior.

cs.CE↗

arXiv2022

A deep learning energy-based method for classical elastoplasticity

The deep energy method (DEM) has been used to solve the elastic deformation of structures with linear elasticity, hyperelasticity, and strain-gradient elasticity material models based on the principle of minimum potential energy. In this work, we extend DEM to elastoplasticity problems involving path dependence and irreversibility. A loss function inspired by the discrete variational formulation of plasticity is proposed. The radial return algorithm is coupled with DEM to update the plastic internal state variables without violating the Kuhn-Tucker consistency conditions. Finite element shape functions and their gradients are used to approximate the spatial gradients of the DEM-predicted displacements, and Gauss quadrature is used to integrate the loss function. Four numerical examples are presented to demonstrate the use of the framework, such as generating stress-strain curves in cyclic loading, material heterogeneity, performance comparison with other physics-informed methods, and simulation/inference on unstructured meshes. In all cases, the DEM solution shows decent accuracy compared to the reference solution obtained from the finite element method. The current DEM model marks the first time that energy-based physics-informed neural networks are extended to plasticity, and offers promising potential to effectively solve elastoplasticity problems from scratch using deep neural networks.

cs.CE↗

arXiv2022

On the use of graph neural networks and shape-function-based gradient computation in the deep energy method

A graph neural network (GCN) is employed in the deep energy method (DEM) model to solve the momentum balance equation in 3D for the deformation of linear elastic and hyperelastic materials due to its ability to handle irregular domains over the traditional DEM method based on a multilayer perceptron (MLP) network. Its accuracy and solution time are compared to the DEM model based on a MLP network. We demonstrate that the GCN-based model delivers similar accuracy while having a shorter run time through numerical examples. Two different spatial gradient computation techniques, one based on automatic differentiation (AD) and the other based on shape function (SF) gradients, are also accessed. We provide a simple example to demonstrate the strain localization instability associated with the AD-based gradient computation and show that the instability exists in more general cases by four numerical examples. The SF-based gradient computation is shown to be more robust and delivers an accurate solution even at severe deformations. Therefore, the combination of the GCN-based DEM model and SF-based gradient computation is potentially a promising candidate for solving problems involving severe material and geometric nonlinearities.

cs.CE↗

arXiv2022

Deep energy method in topology optimization applications

This paper explores the possibilities of applying physics-informed neural networks (PINNs) in topology optimization (TO) by introducing a fully self-supervised TO framework that is based on PINNs. This framework solves the forward elasticity problem by the deep energy method (DEM). Instead of training a separate neural network to update the density distribution, we leverage the fact that the compliance minimization problem is self-adjoint to express the element sensitivity directly in terms of the displacement field from the DEM model, and thus no additional neural network is needed for the inverse problem. The method of moving asymptotes is used as the optimizer for updating density distribution. The implementation of Neumann, Dirichlet, and periodic boundary conditions are described in the context of the DEM model. Three numerical examples are presented to demonstrate framework capabilities: (1) Compliance minimization in 2D under different geometries and loading, (2) Compliance minimization in 3D, and (3) Maximization of homogenized shear modulus to design 2D meta material unit cells. The results show that the optimized designs from the DEM-based framework are very comparable to those generated by the finite element method, and shed light on a new way of integrating PINN-based simulation methods into classical computational mechanics problems.

cs.CE↗

arXiv2022

LatticeOPT: A heuristic topology optimization framework for thin-walled, 2D extruded lattices

This paper introduces a heuristic topology optimization framework for thin-walled, 2D extruded lattice structures subject to complex high-speed loading. The proposed framework optimizes the wall thickness distribution in the lattice cross section through different thickness update schemes, inspired by the idea of equalization of absorbed energy density across all lattice walls. The proposed framework is ubiquitous and can be used in explicit dynamic simulations, which is the primary numerical method used in crashworthiness studies. No information on the material tangent stiffness matrix is required, and complex material behaviors and complex loading conditions can be handled. Three numerical examples are presented to demonstrate framework capabilities: (1) Optimization of a long, slender column under axial compression to maximize specific energy absorption, (2) Optimization of a lattice-filled sandwich panel under off-center blast loading to minimize material damage, (3) Generation of a periodic lattice core design under blast loading. The results show that the framework can effectively increase specific energy absorption or minimize material damage with as few as 25 finite element simulations and optimization iterations.

math.OC↗

arXiv2022

Exploring the structure-property relations of thin-walled, 2D extruded lattices using neural networks

This paper investigates the structure-property relations of thin-walled lattices under dynamic longitudinal compression, characterized by their cross-sections and heights. These relations elucidate the interactions of different geometric features of a design on mechanical response, including energy absorption. We proposed a combinatorial, key-based design system to generate different lattice designs and used the finite element method to simulate their response with the Johnson-Cook material model. Using an autoencoder, we encoded the cross-sectional images of the lattices into latent design feature vectors, which were supplied to the neural network model to generate predictions. The trained models can accurately predict lattice energy absorption curves in the key-based design system and can be extended to new designs outside of the system via transfer learning.

cs.LG↗

arXiv2021

Polycrystal plasticity with grain boundary evolution: A numerically efficient dislocation-based diffuse-interface model

Grain structure plays a key role in the mechanical properties of alloy materials. Engineering the grain structure requires a comprehensive understanding of the evolution of grain boundaries (GBs) when a material is subjected to various manufacturing processes. To this end, we present a computationally efficient framework to describe the co-evolution of bulk plasticity and GBs. We represent GBs as diffused geometrically necessary dislocations, whose evolution describes GB plasticity. Under this representation, the evolution of GBs and bulk plasticity is described in unison using the evolution equation for the plastic deformation gradient, an equation central to classical crystal plasticity theories. To reduce the number of degrees of freedom, we present a procedure which combines the governing equations for each slip rates into a set of governing equations for the plastic deformation gradient. Finally, we outline a method to introduce a synthetic potential to drive migration of a flat GB. Three numerical examples are presented to demonstrate the model. First, a scaling test is used to demonstrate the computational efficiency of our framework. Second, we study the evolution of a tricrystal, formed by embedding a circular grain into a bicrystal, and demonstrate qualitative agreement between the predictions of our model and those of molecular dynamics simulations by Trautt and Mishin (2014). Finally, we demonstrate the effect of applied loading in texture evolution by simulating the evolution of a synthetic polycrystal under applied displacements.

cond-mat.mtrl-sci↗