arXiv subjects

James Smith

Publications and source records attributed to James Smith.

At least 19 recordsLinked to original sources

arXiv2025

Dynamic Epsilon Scheduling: A Multi-Factor Adaptive Perturbation Budget for Adversarial Training

Adversarial training is among the most effective strategies for defending deep neural networks against adversarial examples. A key limitation of existing adversarial training approaches lies in their reliance on a fixed perturbation budget, which fails to account for instance-specific robustness characteristics. While prior works such as IAAT and MMA introduce instance-level adaptations, they often rely on heuristic or static approximations of data robustness. In this paper, we propose Dynamic Epsilon Scheduling (DES), a novel framework that adaptively adjusts the adversarial perturbation budget per instance and per training iteration. DES integrates three key factors: (1) the distance to the decision boundary approximated via gradient-based proxies, (2) prediction confidence derived from softmax entropy, and (3) model uncertainty estimated via Monte Carlo dropout. By combining these cues into a unified scheduling strategy, DES tailors the perturbation budget dynamically to guide more effective adversarial learning. Experimental results on CIFAR-10 and CIFAR-100 show that our method consistently improves both adversarial robustness and standard accuracy compared to fixed-epsilon baselines and prior adaptive methods. Moreover, we provide theoretical insights into the stability and convergence of our scheduling policy. This work opens a new avenue for instance-aware, data-driven adversarial training methods.

cs.CV↗

arXiv2024

Closed ideals of operators on the Baernstein and Schreier spaces

We study the lattice of closed ideals of bounded operators on two families of Banach spaces: the Baernstein spaces $B_p$ for $1<p<\infty$ and the Schreier spaces $S_p$ for $1\le p<\infty$. Our main conclusion is that there are $2^{\mathfrak{c}}$ many closed ideals that lie between the ideals of compact and strictly singular operators on each of these spaces, and also $2^{\mathfrak{c}}$ many closed ideals that contain projections of infinite rank. Counterparts of results of Gasparis and Leung using a numerical index to distinguish the isomorphism types of subspaces spanned by subsequences of the unit vector basis for the higher-order Schreier spaces play a key role in the proofs, as does the Johnson-Schechtman technique for constructing $2^{\mathfrak{c}}$ many closed ideals of operators on a Banach space.

math.FA↗

arXiv2024

Turtles, Hats and Spectres: Aperiodic structures on a Rhombic tiling

These notes derive aperiodic monotiles (arXiv:2303.10798) from a set of rhombuses with matching rules. This dual construction is used to simplify the proof of aperiodicity by considering the tiling as a colouring game on a Rhombille tiling. A simple recursive substitution system is then introduced to show the existence of a non-periodic tiling without the need for computer-aided verification. A new cut-and-project style construction linking the Turtle tiling with 1-dimensional Fibonacci words provides a second proof of non-periodicity, and an alternative demonstration that the Turtle can tile the plane. Deforming the Turtle into the Hat tile then provides a third proof for non-periodicity by considering the effect on the lattice underlying the Rhombille tiling. Finally, attention turns to the Spectre tile. In collaboration with Erhard K\"unzel and Yoshiaki Araki, we present two new substitution rules for generating Spectre tilings. This pair of conjugate rules show that the aperiodic monotile tilings can be considered as a 2-dimensional analog to Sturmian words.

math.MG↗

arXiv2023

Robust Topological Orderings for Directed Graphs

We modify the Pearce-Kelly algorithm that maintains a topological ordering for a directed acyclic graph in order to allow cycles to be tolerated. Cycles make topological orderings moot, of course, however tolerating them is useful in practice. A user may mistakenly introduce a cyclic dependency in their project,, for example, and then subsequently fix their mistake. In these cases it is better to maintain the relevant data structures so that if and when the directed graph becomes acyclic again, a topological ordering can be instantly recovered. It turns out that adding this functionality costs us little, only small modifications and some attention to detail are needed.

cs.DS↗

arXiv2022

System Design for an Integrated Lifelong Reinforcement Learning Agent for Real-Time Strategy Games

As Artificial and Robotic Systems are increasingly deployed and relied upon for real-world applications, it is important that they exhibit the ability to continually learn and adapt in dynamically-changing environments, becoming Lifelong Learning Machines. Continual/lifelong learning (LL) involves minimizing catastrophic forgetting of old tasks while maximizing a model's capability to learn new tasks. This paper addresses the challenging lifelong reinforcement learning (L2RL) setting. Pushing the state-of-the-art forward in L2RL and making L2RL useful for practical applications requires more than developing individual L2RL algorithms; it requires making progress at the systems-level, especially research into the non-trivial problem of how to integrate multiple L2RL algorithms into a common framework. In this paper, we introduce the Lifelong Reinforcement Learning Components Framework (L2RLCF), which standardizes L2RL systems and assimilates different continual learning components (each addressing different aspects of the lifelong learning problem) into a unified system. As an instantiation of L2RLCF, we develop a standard API allowing easy integration of novel lifelong learning components. We describe a case study that demonstrates how multiple independently-developed LL components can be integrated into a single realized system. We also introduce an evaluation environment in order to measure the effect of combining various system components. Our evaluation environment employs different LL scenarios (sequences of tasks) consisting of Starcraft-2 minigames and allows for the fair, comprehensive, and quantitative comparison of different combinations of components within a challenging common evaluation environment.

cs.LG↗

arXiv2022

Secret Sharing for Generic Theoretic Cryptography

Sharing a secret efficiently amongst a group of participants is not easy since there is always an adversary / eavesdropper trying to retrieve the secret. In secret sharing schemes, every participant is given a unique share. When the desired group of participants come together and provide their shares, the secret is obtained. For other combinations of shares, a garbage value is returned. A threshold secret sharing scheme was proposed by Shamir and Blakley independently. In this (n,t) threshold secret sharing scheme, the secret can be obtained when at least t out of n participants contribute their shares. This paper proposes a novel algorithm to reveal the secret only to the subsets of participants belonging to the access structure. This scheme implements totally generalized ideal secret sharing. Unlike threshold secret sharing schemes, this scheme reveals the secret only to the authorized sets of participants, not any arbitrary set of users with cardinality more than or equal to t. Since any access structure can be realized with this scheme, this scheme can be exploited to implement various access priorities and access control mechanisms. A major advantage of this scheme over the existing ones is that the shares being distributed to the participants is totally independent of the secret being shared. Hence, no restrictions are imposed on the scheme and it finds a wider use in real world applications.

cs.CR↗

arXiv2022

Lifelong Wandering: A realistic few-shot online continual learning setting

Online few-shot learning describes a setting where models are trained and evaluated on a stream of data while learning emerging classes. While prior work in this setting has achieved very promising performance on instance classification when learning from data-streams composed of a single indoor environment, we propose to extend this setting to consider object classification on a series of several indoor environments, which is likely to occur in applications such as robotics. Importantly, our setting, which we refer to as online few-shot continual learning, injects the well-studied issue of catastrophic forgetting into the few-shot online learning paradigm. In this work, we benchmark several existing methods and adapted baselines within our setting, and show there exists a trade-off between catastrophic forgetting and online performance. Our findings motivate the need for future work in this setting, which can achieve better online performance without catastrophic forgetting.

cs.CV↗

arXiv2022

A Closer Look at Knowledge Distillation with Features, Logits, and Gradients

Knowledge distillation (KD) is a substantial strategy for transferring learned knowledge from one neural network model to another. A vast number of methods have been developed for this strategy. While most method designs a more efficient way to facilitate knowledge transfer, less attention has been put on comparing the effect of knowledge sources such as features, logits, and gradients. This work provides a new perspective to motivate a set of knowledge distillation strategies by approximating the classical KL-divergence criteria with different knowledge sources, making a systematic comparison possible in model compression and incremental learning. Our analysis indicates that logits are generally a more efficient knowledge source and suggests that having sufficient feature dimensions is crucial for the model design, providing a practical guideline for effective KD-based transfer learning.

cs.LG↗

arXiv2021

Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which is problematic when memory constraints or data legality concerns exist. In this work, we consider the high-impact problem of Data-Free Class-Incremental Learning (DFCIL), where an incremental learning agent must learn new concepts over time without storing generators or training data from past tasks. One approach for DFCIL is to replay synthetic images produced by inverting a frozen copy of the learner's classification model, but we show this approach fails for common class-incremental benchmarks when using standard distillation strategies. We diagnose the cause of this failure and propose a novel incremental distillation strategy for DFCIL, contributing a modified cross-entropy training and importance-weighted feature distillation, and show that our method results in up to a 25.1% increase in final task accuracy (absolute difference) compared to SOTA DFCIL methods for common class-incremental benchmarks. Our method even outperforms several standard replay based methods which store a coreset of images.

cs.CV↗

arXiv2021

On the Adversarial Robustness of Quantized Neural Networks

Reducing the size of neural network models is a critical step in moving AI from a cloud-centric to an edge-centric (i.e. on-device) compute paradigm. This shift from cloud to edge is motivated by a number of factors including reduced latency, improved security, and higher flexibility of AI algorithms across several application domains (e.g. transportation, healthcare, defense, etc.). However, it is currently unclear how model compression techniques may affect the robustness of AI algorithms against adversarial attacks. This paper explores the effect of quantization, one of the most common compression techniques, on the adversarial robustness of neural networks. Specifically, we investigate and model the accuracy of quantized neural networks on adversarially-perturbed images. Results indicate that for simple gradient-based attacks, quantization can either improve or degrade adversarial robustness depending on the attack strength.

cs.LG↗

arXiv2021

Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer

Rehearsal is a critical component for class-incremental continual learning, yet it requires a substantial memory budget. Our work investigates whether we can significantly reduce this memory budget by leveraging unlabeled data from an agent's environment in a realistic and challenging continual learning paradigm. Specifically, we explore and formalize a novel semi-supervised continual learning (SSCL) setting, where labeled data is scarce yet non-i.i.d. unlabeled data from the agent's environment is plentiful. Importantly, data distributions in the SSCL setting are realistic and therefore reflect object class correlations between, and among, the labeled and unlabeled data distributions. We show that a strategy built on pseudo-labeling, consistency regularization, Out-of-Distribution (OoD) detection, and knowledge distillation reduces forgetting in this setting. Our approach, DistillMatch, increases performance over the state-of-the-art by no less than 8.7% average task accuracy and up to 54.5% average task accuracy in SSCL CIFAR-100 experiments. Moreover, we demonstrate that DistillMatch can save up to 0.23 stored images per processed unlabeled image compared to the next best method which only saves 0.08. Our results suggest that focusing on realistic correlated distributions is a significantly new perspective, which accentuates the importance of leveraging the world's structure as a continual learning strategy.

cs.CV↗

arXiv2019

Pulsed laser deposition of single phase n- and p-type Cu2O thin films with low resistivity

Low resistivity (~3-24 mOhm.cm) with tunable n- and p-type phase pure Cu2O thin films have been grown by pulsed laser deposition at 25-200 0C by varying the background oxygen partial pressure (O2pp). Capacitance data obtained by electrochemical impedance spectroscopy was used to determine the conductivity (n- or p-type), carrier density, and flat band potentials for samples grown on indium tin oxide (ITO) at 25 0C. The Hall mobility of the n- and p-type Cu2O was estimated to be ~ 0.85 cm2.V-1s-1 and ~ 4.78 cm2.V-1s-1 respectively for samples grown on quartz substrate at 25 0C. An elevated substrate temperature ~ 200 0C with O2pp = 2 - 3 mTorr yielded p-type Cu2O films with six orders of magnitude higher resistivities in the range ~ 9 - 49 kOhm.cm and mobilities in the range ~ 13.5 - 22.2 cm2.V-1s-1. UV-Vis-NIR diffuse reflectance spectroscopy showed optical bandgaps of Cu2O films in the range of 1.76 to 2.15 eV depending on O2pp. Thin films grown at oxygen-rich conditions O2pp > 7 mTorr yielded mixed-phase copper oxide irrespective of the substrate temperatures and upon air annealing at 550 0C for 1 hour completely converted to CuO phase with n-type semiconducting properties (~12 Ohm.cm, ~1.50 cm2.V-1s-1). The as-grown p- and n-type Cu2O showed rectification and a photovoltaic (PV) response in solid junctions with n-ZnO and p-Si electrodes respectively. Our findings may create new opportunities for devising Cu2O based junctions requiring low process temperatures.

cond-mat.mtrl-sci↗

arXiv2019

Eliminating Left Recursion without the Epsilon

The standard algorithm to eliminate indirect left recursion takes a preventative approach, rewriting a grammar's rules so that indirect left recursion is no longer possible, rather than eliminating it only as and when it occurs. This approach results in many of the rules being lost, so that the parse trees that result are often devoid of the detail that the BNF was supposed to capture in the first place. Furthermore, the standard algorithm results in exponential blow-up as the BNF is rewritten, making it wholly unworkable in practice. To avoid these pitfalls, we revise the standard algorithm to eliminate direct left recursion and then take a graph-theoretic approach to eliminating indirect left recursion. We also extend the algorithm to rewrite the resultant parse trees in order to recover the parse trees that would have resulted if left recursion had not had to be eliminated in the first place. Therefore, aside from a couple of caveats, our algorithm works not just in theory but also in practice.

cs.DS↗

arXiv2019

Unsupervised Progressive Learning and the STAM Architecture

We first pose the Unsupervised Progressive Learning (UPL) problem: an online representation learning problem in which the learner observes a non-stationary and unlabeled data stream, learning a growing number of features that persist over time even though the data is not stored or replayed. To solve the UPL problem we propose the Self-Taught Associative Memory (STAM) architecture. Layered hierarchies of STAM modules learn based on a combination of online clustering, novelty detection, forgetting outliers, and storing only prototypical features rather than specific examples. We evaluate STAM representations using clustering and classification tasks. While there are no existing learning scenarios that are directly comparable to UPL, we compare the STAM architecture with two recent continual learning models, Memory Aware Synapses (MAS) and Gradient Episodic Memories (GEM), after adapting them in the UPL setting.

cs.LG↗

arXiv2017

Finer-grained Locking in Concurrent Dynamic Planar Convex Hulls

The convex hull of a planar point set is the smallest convex polygon containing each point in the set. The dynamic convex hull problem concerns efficiently maintaining the convex hull of a set of points subject to additions and removals. One algorithm for this problem uses two external balanced binary search trees (BSTs) (M. H. Overmars, J. van Leeuwen 1981). We present the first concurrent solution for this problem, which uses a single BST that stores references to intermediate convex hull solutions at each node. We implement and evaluate two lock-based approaches: a) fine-grained locking, where each node of the tree is protected by a lock, and b) "finer-grained locking", where each node contains a separate lock for each of the left and right chains. In our throughput experiments, we observe that finer-grained locking yields an 8-60% improvement over fine-grained locking, and a 38-61x improvement over coarsegrained locking and software transactional memory (STM). When applied to find the convex hull of static point sets, our approach outperforms a parallel divide-and-conquer implementation by 2-4x using an equivalent number of threads.

cs.DC↗

arXiv2014

Gender Prediction in Social Media

In this paper, we explore the task of gender classification using limited network data with an application to Fotolog. We take a heuristic approach to automating gender inference based on username, followers and network structure. We test our approach on a subset of 100,000 nodes and analyze our results to find that there is a lot of value in these limited information and that there is great promise in further pursuing this approach to classification.

cs.SI↗

arXiv2013

Proving Properties of Rich Internet Applications

We introduce application layer specifications, which allow us to reason about the state and transactions of rich Internet applications. We define variants of the state/event based logic UCTL* along with two example applications to demonstrate this approach, and then look at a distributed, rich Internet application, proving properties about the information it stores and disseminates. Our approach enables us to justify proofs about abstract properties that are preserved in the face of concurrent, networked inputs by proofs about concrete properties in an Internet setting. We conclude that our approach makes it possible to reason about the programs and protocols that comprise the Internet's application layer with reliability and generality.

cs.NI↗

arXiv2013

State/event based versus purely Action or State based Logics

Although less studied than purely action or state based logics, state/event based logics are becoming increasingly important. Some systems are best studied using structures with information on both states and transitions, and it is these structures over which state/event based logics are defined. The logic UCTL and its variants are perhaps the most widely studied and implemented of these logics to date. As yet, however, no-one seems to have defined UCTL*, a trivial step but a worthwhile one. Here we do just that, but prove in the cases of both UCTL and UCTL* that these logics are no more expressive than their more commonplace fragments. Also, acknowledging the importance of modal transition systems, we define a state/event based logic over a modified modal transition system as a precursor to further work.

cs.LO↗