arXiv subjects

Ning Lin

Publications and source records attributed to Ning Lin.

45 records · Page 3Linked to original sources

arXiv2023

Random resistive memory-based deep extreme point learning machine for unified visual processing

Visual sensors, including 3D LiDAR, neuromorphic DVS sensors, and conventional frame cameras, are increasingly integrated into edge-side intelligent machines. Realizing intensive multi-sensory data analysis directly on edge intelligent machines is crucial for numerous emerging edge applications, such as augmented and virtual reality and unmanned aerial vehicles, which necessitates unified data representation, unprecedented hardware energy efficiency and rapid model training. However, multi-sensory data are intrinsically heterogeneous, causing significant complexity in the system development for edge-side intelligent machines. In addition, the performance of conventional digital hardware is limited by the physically separated processing and memory units, known as the von Neumann bottleneck, and the physical limit of transistor scaling, which contributes to the slowdown of Moore's law. These limitations are further intensified by the tedious training of models with ever-increasing sizes. We propose a novel hardware-software co-design, random resistive memory-based deep extreme point learning machine (DEPLM), that offers efficient unified point set analysis. We show the system's versatility across various data modalities and two different learning tasks. Compared to a conventional digital hardware-based system, our co-design system achieves huge energy efficiency improvements and training cost reduction when compared to conventional systems. Our random resistive memory-based deep extreme point learning machine may pave the way for energy-efficient and training-friendly edge AI across various data modalities and tasks.

cs.LG↗

arXiv2023

Pruning random resistive memory for optimizing analogue AI

The rapid advancement of artificial intelligence (AI) has been marked by the large language models exhibiting human-like intelligence. However, these models also present unprecedented challenges to energy consumption and environmental sustainability. One promising solution is to revisit analogue computing, a technique that predates digital computing and exploits emerging analogue electronic devices, such as resistive memory, which features in-memory computing, high scalability, and nonvolatility. However, analogue computing still faces the same challenges as before: programming nonidealities and expensive programming due to the underlying devices physics. Here, we report a universal solution, software-hardware co-design using structural plasticity-inspired edge pruning to optimize the topology of a randomly weighted analogue resistive memory neural network. Software-wise, the topology of a randomly weighted neural network is optimized by pruning connections rather than precisely tuning resistive memory weights. Hardware-wise, we reveal the physical origin of the programming stochasticity using transmission electron microscopy, which is leveraged for large-scale and low-cost implementation of an overparameterized random neural network containing high-performance sub-networks. We implemented the co-design on a 40nm 256K resistive memory macro, observing 17.3% and 19.9% accuracy improvements in image and audio classification on FashionMNIST and Spoken digits datasets, as well as 9.8% (2%) improvement in PR (ROC) in image segmentation on DRIVE datasets, respectively. This is accompanied by 82.1%, 51.2%, and 99.8% improvement in energy efficiency thanks to analogue in-memory computing. By embracing the intrinsic stochasticity and in-memory computing, this work may solve the biggest obstacle of analogue computing systems and thus unleash their immense potential for next-generation AI hardware.

cs.ET↗

arXiv2023

Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximization

Zero-shot skeleton-based action recognition aims to recognize actions of unseen categories after training on data of seen categories. The key is to build the connection between visual and semantic space from seen to unseen classes. Previous studies have primarily focused on encoding sequences into a singular feature vector, with subsequent mapping the features to an identical anchor point within the embedded space. Their performance is hindered by 1) the ignorance of the global visual/semantic distribution alignment, which results in a limitation to capture the true interdependence between the two spaces. 2) the negligence of temporal information since the frame-wise features with rich action clues are directly pooled into a single feature vector. We propose a new zero-shot skeleton-based action recognition method via mutual information (MI) estimation and maximization. Specifically, 1) we maximize the MI between visual and semantic space for distribution alignment; 2) we leverage the temporal information for estimating the MI by encouraging MI to increase as more frames are observed. Extensive experiments on three large-scale skeleton action datasets confirm the effectiveness of our method. Code: https://github.com/YujieOuO/SMIE.

cs.CV↗

arXiv2020

Hurricane-blackout-heatwave Compound Hazard Risk and Resilience in a Changing Climate

Hurricanes have caused power outages and blackouts, affecting millions of customers and inducing severe social and economic impacts. The impacts of hurricane-caused blackouts may worsen due to increased heat extremes and possibly increased hurricanes under climate change. We apply hurricane and heatwave projections with power outage and recovery process analysis to investigate how the emerging hurricane-blackout-heatwave compound hazard may vary in a changing climate, for Harris County in Texas (including major part of Houston City) as an example. We find that, under the high-emissions scenario RCP8.5, the expected percent of customers experiencing at least one longer-than-5-day hurricane-induced power outage in a 20-year period would increase significantly from 14% at the end of the 20th century to 44% at the end of the 21st century in Harris County. The expected percent of customers who may experience at least one longer-than-5-day heatwave without power (to provide air conditioning) would increase alarmingly, from 0.8% to 15.5%. These increases of risk may be largely avoided if the climate is well controlled under the stringent mitigation scenario RCP2.6. We also reveal that a moderate enhancement of critical sectors of the distribution network can significantly improve the resilience of the entire power grid and mitigate the risk of the future compound hazard. Together these findings suggest that, in addition to climate mitigation, climate adaptation actions are urgently needed to improve the resilience of coastal power systems.

stat.AP↗

arXiv2018

Tetris: Re-architecting Convolutional Neural Network Computation for Machine Learning Accelerators

Inference efficiency is the predominant consideration in designing deep learning accelerators. Previous work mainly focuses on skipping zero values to deal with remarkable ineffectual computation, while zero bits in non-zero values, as another major source of ineffectual computation, is often ignored. The reason lies on the difficulty of extracting essential bits during operating multiply-and-accumulate (MAC) in the processing element. Based on the fact that zero bits occupy as high as 68.9% fraction in the overall weights of modern deep convolutional neural network models, this paper firstly proposes a weight kneading technique that could eliminate ineffectual computation caused by either zero value weights or zero bits in non-zero weights, simultaneously. Besides, a split-and-accumulate (SAC) computing pattern in replacement of conventional MAC, as well as the corresponding hardware accelerator design called Tetris are proposed to support weight kneading at the hardware level. Experimental results prove that Tetris could speed up inference up to 1.50x, and improve power efficiency up to 5.33x compared with the state-of-the-art baselines.

cs.LG↗

arXiv2018

Tropical Cyclone Intensity Evolution Modeled as a Dependent Hidden Markov Process

A hidden Markov model is developed to simulate tropical cyclone intensity evolution dependent on the surrounding large-scale environment. The model considers three unobserved (hidden) discrete states of intensification and associates each state with a probability distribution of intensity change. The storm's transit from one state to another is described as a Markov chain. Both the intensity change and state transit components of the model are dependent on environmental variables including potential intensity, vertical wind shear, relative humidity, and ocean feedback. This Markov environment-dependent hurricane intensity model (MeHiM) is used to simulate the evolution of storm intensity along the storm track over the ocean, and a simple decay model is added to estimate the intensity change when the storm moves over land. Data for the North Atlantic (NA) basin from 1979-2014 (555 storms) are used for model development and evaluation. Probability distributions of 6-h and 24-h intensity change, lifetime maximum intensity, and landfall intensity based on model simulations and observations compare well. Although the MeHiM is still limited in fully describing rapid intensification, it shows a significant improvement over previous statistical models (e.g., linear, nonlinear, and finite mixture models).

stat.AP↗

arXiv2018

A reconstruction of Florida Traffic Flow During Hurricane Irma (2017)

Recent Hurricane Irma (2017) created the most extensive scale of evacuation in Florida's history, involving about 6.5 million people on mandatory evacuation order and 4 million evacuation vehicles. To understand the hurricane evacuation process, the spatial and temporal evolution of the traffic flow is a critical piece of information, but it is usually not fully observed. Based on the game theory, this paper employs the available traffic observation on main highways (20 cameras; including parts of Route 1, 27 and I-75, 95, 4,10) during Irma to reconstruct the traffic flow in Florida during Irma. The model is validated with self-reported twitters. The traffic reconstruction estimates the traffic demand (about 4 million cars in total) and the temporal and spatial distribution of congestion during the evacuation. The results compare well with available information from news reports and Twitter records. The reconstructed data can be used to analyze hurricane evacuation decisions and travel behavior.

physics.soc-ph↗

arXiv2018

Rapid Assessment of Damaged Homes in the Florida Keys after Hurricane Irma

On September 10, 2017, Hurricane Irma made landfall in the Florida Keys and caused significant damage. Informed by hydrodynamic storm surge and wave modeling and post-storm satellite imagery, a rapid damage survey was soon conducted for 1600+ residential buildings in Big Pine Key and Marathon. Damage categorizations and statistical analysis reveal distinct factors governing damage at these two locations. The distance from the coast is significant for the damage in Big Pine Key, as severely damaged buildings were located near narrow waterways connected to the ocean. Building type and size are critical in Marathon, highlighted by the near-complete destruction of trailer communities there. These observations raise issues of affordability and equity that need consideration in damage recovery and rebuilding for resilience.

stat.AP↗

arXiv2012

Second-order continuous-time non-stationary Gaussian autoregression

The objective of the paper is to identify and investigate all possible types of asymptotic behavior for the maximum likelihood estimators of the unknown parameters in the second-order linear stochastic ordinary differential equation driven by Gaussian white noise. The emphasis is on the non-ergodic case, when the roots of the corresponding characteristic equation are not both in the left half-plane.

math.ST↗