arXiv subjects

Pilwon Kim

Publications and source records attributed to Pilwon Kim.

9 recordsLinked to original sources

arXiv2024

Unsupervised Reservoir Computing for Multivariate Denoising of Severely Contaminated Signals

The interdependence and high dimensionality of multivariate signals present significant challenges for denoising, as conventional univariate methods often struggle to capture the complex interactions between variables. A successful approach must consider not only the multivariate dependencies of the desired signal but also the multivariate dependencies of the interfering noise. In our previous research, we introduced a method using machine learning to extract the maximum portion of ``predictable information" from univariate signal. We extend this approach to multivariate signals, with the key idea being to properly incorporate the interdependencies of the noise back into the interdependent reconstruction of the signal. The method works successfully for various multivariate signals, including chaotic signals and highly oscillating sinusoidal signals which are corrupted by spatially correlated intensive noise. It consistently outperforms other existing multivariate denoising methods across a wide range of scenarios.

cs.LG↗

arXiv2024

Signal-noise separation using unsupervised reservoir computing

Removing noise from a signal without knowing the characteristics of the noise is a challenging task. This paper introduces a signal-noise separation method based on time series prediction. We use Reservoir Computing (RC) to extract the maximum portion of "predictable information" from a given signal. Reproducing the deterministic component of the signal using RC, we estimate the noise distribution from the difference between the original signal and reconstructed one. The method is based on a machine learning approach and requires no prior knowledge of either the deterministic signal or the noise distribution. It provides a way to identify additivity/multiplicativity of noise and to estimate the signal-to-noise ratio (SNR) indirectly. The method works successfully for combinations of various signal and noise, including chaotic signal and highly oscillating sinusoidal signal which are corrupted by non-Gaussian additive/ multiplicative noise. The separation performances are robust and notably outstanding for signals with strong noise, even for those with negative SNR.

cs.LG↗

arXiv2021

STDP-based Associative Memory Formation and Retrieval

Spike-timing-dependent plasticity(STDP) is a biological process in which the precise order and timing of neuronal spikes affect the degree of synaptic modification. While there have been numerous research focusing on the role of STDP in neural coding, the functional implications of STDP at the macroscopic level in the brain have not been fully explored yet. In this work, we propose a neurodynamical model based on STDP that renders storage and retrieval of a group of associative memories. We showed that the function of STDP at the macroscopic level is to form a "memory plane" in the neural state space which dynamically encodes high dimensional data. We derived the analytic relation between the input, the memory plane, and the induced macroscopic neural oscillations around the memory plane. Such plane produces a limit cycle in reaction to a similar memory cue, which can be used for retrieval of the original input.

q-bio.NC↗

arXiv2021

A STDP-based Encoding Algorithm for Associative and Composite Data

Spike-timing-dependent plasticity(STDP) is a biological process of synaptic modification caused by the difference of firing order and timing between neurons. One of the neurodynamical roles of STDP is to form a macroscopic geometrical structure in the neuronal state space in response to a periodic input. This work proposes a practical memory model based on STDP that can store and retrieve high-dimensional associative data. The model combines STDP dynamics with an encoding scheme for distributed representations and can handle multiple composite data in a continuous manner. In the auto-associative memory task where a group of images is continuously streamed to the model, the images are successfully retrieved from an oscillating neural state whenever a proper cue is given. In the second task that deals with semantic memories embedded from sentences, the results show that words can recall multiple sentences simultaneously or one exclusively, depending on their grammatical relations.

q-bio.NC↗

arXiv2019

Reservoir Computing based on Quenched Chaos

Reservoir computing(RC) is a brain-inspired computing framework that employs a transient dynamical system whose reaction to an input signal is transformed to a target output. One of the central problems in RC is to find a reliable reservoir with a large criticality, since computing performance of a reservoir is maximized near the phase transition. In this work, we propose a continuous reservoir that utilizes transient dynamics of coupled chaotic oscillators in a critical regime where sudden amplitude death occurs. This "explosive death" not only brings the system a large criticality which provides a variety of orbits for computing, but also stabilizes them which otherwise diverge soon in chaotic units. The proposed framework shows better results in tasks for signal reconstructions than RC based on explosive synchronization of regular phase oscillators. We also show that the information capacity of the reservoirs can be used as a predictive measure for computational capability of a reservoir at a critical point.

nlin.CD↗

arXiv2019

Dynamics of Crime In and Out of Prisons

The accumulated criminal records shows that serious and minor crimes differ in many measures and are related in a complex way. While some of those who have committed minor crime spontaneously evolve into serious criminals, the transition from minor crime to major crime involves many social factors and have not been fully understood yet. In this work, we present a mathematical model to describe how minor criminals turns in to major criminals inside and outside of prisons. The model is design to implement two social effects which respectively have been conceptualized in popular terms "broken windows effect" and "prison as a crime school." Analysis of the system shows how the crime-related parameters such as the arrest rate, the period of imprisonment and the in-prison contact rate affect the criminal distribution at equilibrium. Without proper control of contact between prisoners, the longer imprisonment rather increases occurrence of serious crimes in society. An optimal allocation of the police resources to suppress crimes is also discussed.

physics.soc-ph↗

arXiv2019

Effects of adaptive acceleration response of birds on collective behaviors

Collective dynamics of many interacting particles have been widely studied because of a wealth of their behavioral patterns quite different from the individual traits. A selective way of birds that reacts to their neighbors is one of the main factors characterizing the collective behaviors. Individual birds can react differently depending on their local environment during the collective decision-making process, and these variable reactions can be a source of complex spatiotemporal flocking dynamics. Here, we extend the deterministic Cucker-Smale model by including the individual's reaction to neighbors' acceleration where the reaction time depends on the local state of polarity. Simulation results show that the adaptive reaction of individuals induces the collective response of the flock. Birds are not frozen in a complete synchronization but remain sensitive to perturbations coming from environments. We confirm that the adaptivity of the reaction also generates natural fluctuations of orientation and speed, both of which are indeed scale-free as experimentally reported. This work may provide essential insight in designing resilient systems of many active agents working in complex, unpredictable environments.

nlin.AO↗

arXiv2018

Critical Neuromorphic Computing based on Explosive Synchronization

Synchronous oscillations in neuronal ensembles have been proposed to provide a neural basis for the information processes in the brain. In this work, we present a neuromorphic computing algorithm based on oscillator synchronization in a critical regime. The algorithm uses the high dimensional transient dynamics perturbed by an input and translates it into proper output stream. One of the benefits of adopting coupled phase oscillators as neuromorphic elements is that the synchrony among oscillators can be finely tuned at a critical state. Especially near a critical state, the marginally synchronized oscillators operate with high efficiency and maintain better computing performances. We also show that explosive synchronization which is induced from specific neuronal connectivity produces more improved and stable outputs. This work provides a systematic way to encode computing in a large size coupled oscillators, which may be useful in designing neuromorphic devices.

cs.NE↗

arXiv2010

Stochastic Processes Driven by Deterministic Scale Interactions

We study various solution behaviors of scale equations which are recently proposed in \cite{Kim}. On the contrary to conventional mathematical tools, scale equations are capable to accommodate various behaviors at different scale levels into one integrated solution. Some solutions of scale equations often retain strong stochastic properties such as fractional Brownian Motion, although constructing those solutions is a deterministic process. We show that imposing a regularity condition on scale equations determines the behaviors of solutions at both small and large scale levels simultaneously, and moreover, the corresponding solutions occur as solutions of differential equations too. This suggests that scale equations provide a potential framework unifying differential equations through fractal, to stochastic processes.

math.DS↗