arXiv subjects

Deepank Verma

Publications and source records attributed to Deepank Verma.

3 recordsLinked to original sources

arXiv2023

Generative agents in the streets: Exploring the use of Large Language Models (LLMs) in collecting urban perceptions

Evaluating the surroundings to gain understanding, frame perspectives, and anticipate behavioral reactions is an inherent human trait. However, these continuous encounters are diverse and complex, posing challenges to their study and experimentation. Researchers have been able to isolate environmental features and study their effect on human perception and behavior. However, the research attempts to replicate and study human behaviors with proxies, such as by integrating virtual mediums and interviews, have been inconsistent. Large language models (LLMs) have recently been unveiled as capable of contextual understanding and semantic reasoning. These models have been trained on large amounts of text and have evolved to mimic believable human behavior. This study explores the current advancements in Generative agents powered by LLMs with the help of perceptual experiments. The experiment employs Generative agents to interact with the urban environments using street view images to plan their journey toward specific goals. The agents are given virtual personalities, which make them distinguishable. They are also provided a memory database to store their thoughts and essential visual information and retrieve it when needed to plan their movement. Since LLMs do not possess embodiment, nor have access to the visual realm, and lack a sense of motion or direction, we designed movement and visual modules that help agents gain an overall understanding of surroundings. The agents are further employed to rate the surroundings they encounter based on their perceived sense of safety and liveliness. As these agents store details in their memory, we query the findings to get details regarding their thought processes. Overall, this study experiments with current AI developments and their potential in simulated human behavior in urban environments.

cs.CY↗

arXiv2022

FoldingNet Autoencoder model to create a geospatial grouping of CityGML building dataset

Explainable numerical representations or latent information of otherwise complex datasets are more convenient to analyze and study. These representations assist in identifying clusters and outliers, assess similar data points, and explore and interpolate data. Dataset of three-dimensional (3D) building models possesses inherent complexity in various footprint shapes, distinct roof types, walls, height, and volume. Traditionally, grouping similar buildings or 3D shapes requires matching their known properties and shape metrics with each other. However, this requires obtaining a plethora of such properties to calculate similarity. This study, in contrast, utilizes an autoencoder to compute the shape information in a fixed-size vector form that can be compared and grouped with the help of distance metrics. The study uses 'FoldingNet,' a 3D autoencoder, to generate the latent representation of each building from the obtained LoD 2 CityGML dataset. The efficacy of the embeddings obtained from the autoencoder is further analyzed by dataset reconstruction, latent spread visualization, and hierarchical clustering methods. While the clusters give an overall perspective of the type of build forms, they do not include geospatial information in the clustering. A geospatial model is therefore created to iteratively find the geographical groupings of buildings using cosine similarity approaches in embedding vectors. The German federal states of Brandenburg and Berlin are taken as an example to test the methodology. The output provides a detailed overview of the build forms in the form of semantic topological clusters and geographical groupings. This approach is beneficial and scalable for complex analytics, e.g., in large urban simulations, urban morphological studies, energy analysis, or evaluations of building stock.

cs.CY↗

arXiv2019

LULC classification methodology based on simple Convolutional Neural Network to map complex urban forms at finer scale: Evidence from Mumbai

The satellite imagery classification task is fundamental to spatial knowledge discovery. Several image classification methods are used to create standardized Land use and Land cover (LULC) maps, which facilitate research on spatial and ecological processes and human activities. Local Climate Zones (LCZ) classification maps are an example of standardized maps which have been widely used to demarcate the homogeneity in built and natural character in the cities. The LCZ classification scheme is primarily focused on urban climate-related research, in which 17 climate zones are mapped in a city area with the 100-150m spatial resolution. Each zone exhibits physical properties related to urban form and functions essential for thermal behavior studies. Extending this widely adopted approach to create LULC maps at finer resolution using the LCZ mapping scheme would benefit the allied domains of urban planning, transportation, and water resources management. This study proposes a novel solution to generate classification maps with a 10-band Sentinel-2B dataset and Convolutional Neural Networks (CNN) at the 10m spatial resolution. The classification benefits from CNNs property to preserve local structures in the image datasets. The proposed CNN model outperforms traditional machine learning models such as Artificial Neural Network, Random Forests, and Support Vector Machines. The overall accuracy and kappa statistic of the CNN model trained on 14 urban and natural classes are 82 percent and 0.81, respectively. The study also discusses the utility of the model for specialized remote sensing tasks such as change detection, identification of slum settlements, and mapping pervious/impervious layers in urban settlements with higher accuracy.

cs.CY↗