arXiv Science⌕ Search

arXiv subjects

Attila Nagy

Publications and source records attributed to Attila Nagy.

At least 19 recordsLinked to original sources
arXiv2026

Balancing Trial and Reorder: A Hybrid Sequential Transformer-GBDT Ranker for On-Demand Delivery

On a delivery platform, personalized store ranking greatly influences what users find and order. Unlike digital-only domains, candidate stores are local and bound by real-time availability and delivery operations. One central modeling tension is between surfacing new stores for trial and preserving ranking quality for sessions with reorder intent. We present Universal Venue Ranker (UVR), a production system deployed at Wolt that pairs a bidirectional transformer encoder for sequential user modeling with a GBDT ranker integrating contextual, user, and store features. Trained across all stores and domains of a country while enforcing local delivery constraints at inference, UVR replaces four previously separate ranking models (three for restaurants, one for retail) with a single unified system. Label smoothing and trial-biased sample weighting steer the model toward new stores, lifting offline trial MRR by +12% to +30% over production while regressing reorder MRR in five of six countries. These regressions leave Global CVR, our core online metric, which blends trial and reorder sessions, statistically unchanged. We validate UVR in three consecutive A/B tests, the first two across Wolt's largest operating markets and the third spanning all operating countries and both domains. UVR V1 delivers +5.5% Merchant Trial Rate and +0.16% Global CVR over the previous production ranker; V2 adds a further +0.45% Merchant Trial Rate on top; and V3, our cross-domain unification of the restaurant and retail rankers, adds a further +1.31% Retail Merchant Trial Rate, together accounting for substantial incremental gross order value and a materially simplified serving stack.

cs.IR↗
arXiv2026

Revising RVL-CDIP: Quantifying Errors and Test-Train Overlap

RVL-CDIP is a popular dataset for benchmarking document classifiers. However, the dataset contains ample amounts of label errors as well as non-trivial amounts of test-train overlap, both of which may impact model performance metrics. In this paper, we address these two problems by (1) finding and fixing label errors, and (2) detecting and addressing test-train overlap. We produce several variations of RVL-CDIP with label error and test-train overlap fixes, and benchmark document classification performance on these new RVL-CDIP variations. Our rigorous analysis of RVL-CDIP finds that the corpus contains 12\% label error and approximately 35% test-train duplication. Remediation sees improvements in classification accuracy when errors are removed, but sees decreases in accuracy when duplicates are removed. We additionally evaluate models on RVL-CDIP-N, an out-of-distribution benchmark, finding that training on error-corrected data substantially improves OOD generalization, with supervised models gaining an average of 8.1 percentage points in accuracy and improvements as large as 14 percentage points.

cs.CL↗
arXiv2024

From News to Summaries: Building a Hungarian Corpus for Extractive and Abstractive Summarization

Training summarization models requires substantial amounts of training data. However for less resourceful languages like Hungarian, openly available models and datasets are notably scarce. To address this gap our paper introduces HunSum-2 an open-source Hungarian corpus suitable for training abstractive and extractive summarization models. The dataset is assembled from segments of the Common Crawl corpus undergoing thorough cleaning, preprocessing and deduplication. In addition to abstractive summarization we generate sentence-level labels for extractive summarization using sentence similarity. We train baseline models for both extractive and abstractive summarization using the collected dataset. To demonstrate the effectiveness of the trained models, we perform both quantitative and qualitative evaluation. Our dataset, models and code are publicly available, encouraging replication, further research, and real-world applications across various domains.

cs.CL↗
arXiv2023

TreeSwap: Data Augmentation for Machine Translation via Dependency Subtree Swapping

Data augmentation methods for neural machine translation are particularly useful when limited amount of training data is available, which is often the case when dealing with low-resource languages. We introduce a novel augmentation method, which generates new sentences by swapping objects and subjects across bisentences. This is performed simultaneously based on the dependency parse trees of the source and target sentences. We name this method TreeSwap. Our results show that TreeSwap achieves consistent improvements over baseline models in 4 language pairs in both directions on resource-constrained datasets. We also explore domain-specific corpora, but find that our method does not make significant improvements on law, medical and IT data. We report the scores of similar augmentation methods and find that TreeSwap performs comparably. We also analyze the generated sentences qualitatively and find that the augmentation produces a correct translation in most cases. Our code is available on Github.

cs.CL↗
arXiv2023

On a probabilistic problem on finite semigroups

In this paper we deal with the following problem: how does the structure of a finite semigroup $S$ depend on the probability that two elements selected at random from $S$, with replacement, define the same inner right translation of $S$. We solve a subcase of this problem. As the main result of the paper, we show how to construct not necessarily finite medial semigroups in which the index of the kernel of the right regular representation equals two.

math.GR↗
arXiv2023

Data Augmentation for Machine Translation via Dependency Subtree Swapping

We present a generic framework for data augmentation via dependency subtree swapping that is applicable to machine translation. We extract corresponding subtrees from the dependency parse trees of the source and target sentences and swap these across bisentences to create augmented samples. We perform thorough filtering based on graphbased similarities of the dependency trees and additional heuristics to ensure that extracted subtrees correspond to the same meaning. We conduct resource-constrained experiments on 4 language pairs in both directions using the IWSLT text translation datasets and the Hunglish2 corpus. The results demonstrate consistent improvements in BLEU score over our baseline models in 3 out of 4 language pairs. Our code is available on GitHub.

cs.CL↗
arXiv2023

HunSum-1: an Abstractive Summarization Dataset for Hungarian

We introduce HunSum-1: a dataset for Hungarian abstractive summarization, consisting of 1.14M news articles. The dataset is built by collecting, cleaning and deduplicating data from 9 major Hungarian news sites through CommonCrawl. Using this dataset, we build abstractive summarizer models based on huBERT and mT5. We demonstrate the value of the created dataset by performing a quantitative and qualitative analysis on the models' results. The HunSum-1 dataset, all models used in our experiments and our code are available open source.

cs.CL↗
arXiv2022

Syntax-based data augmentation for Hungarian-English machine translation

We train Transformer-based neural machine translation models for Hungarian-English and English-Hungarian using the Hunglish2 corpus. Our best models achieve a BLEU score of 40.0 on HungarianEnglish and 33.4 on English-Hungarian. Furthermore, we present results on an ongoing work about syntax-based augmentation for neural machine translation. Both our code and models are publicly available.

cs.CL↗
arXiv2022

A subdirect decomposition of a semigroup of all fuzzy sets in a semigroup

In this paper we give a subdirect decomposition of semigroups $({\mathfrak F}(S); \circ )$, where $S$ is a semigroup, ${\mathfrak F}(S)$ is the set of all fuzzy sets in $S$, and the operation $\circ$ on ${\mathfrak F}(S)$ is defined by the following way: for $f, g\in {\mathfrak F}(S)$ and $s\in S$, $(f\circ g)(s)=\vee _{{x, y\in S}\atop{s=xy}}(f(x)\wedge g(y))$ if $s\in S^2$, and $(f\circ g)(s)=0$ otherwise.

math.GR↗
arXiv2021

Developing neural machine translation models for Hungarian-English

I train models for the task of neural machine translation for English-Hungarian and Hungarian-English, using the Hunglish2 corpus. The main contribution of this work is evaluating different data augmentation methods during the training of NMT models. I propose 5 different augmentation methods that are structure-aware, meaning that instead of randomly selecting words for blanking or replacement, the dependency tree of sentences is used as a basis for augmentation. I start my thesis with a detailed literature review on neural networks, sequential modeling, neural machine translation, dependency parsing and data augmentation. After a detailed exploratory data analysis and preprocessing of the Hunglish2 corpus, I perform experiments with the proposed data augmentation techniques. The best model for Hungarian-English achieves a BLEU score of 33.9, while the best model for English-Hungarian achieves a BLEU score of 28.6.

cs.CL↗
arXiv2021

Improving the sample-efficiency of neural architecture search with reinforcement learning

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture discovered by renowned deep learning scientists as a basis (e.g. Inception) and try to apply it to a specific problem. This might be sufficient, but as of now, achieving very high accuracy on a complex or yet unsolved task requires the knowledge of highly-trained deep learning experts. In this work, we would like to contribute to the area of Automated Machine Learning (AutoML), specifically Neural Architecture Search (NAS), which intends to make deep learning methods available for a wider range of society by designing neural topologies automatically. Although several different approaches exist (e.g. gradient-based or evolutionary algorithms), our focus is on one of the most promising research directions, reinforcement learning. In this scenario, a recurrent neural network (controller) is trained to create problem-specific neural network architectures (child). The validation accuracies of the child networks serve as a reward signal for training the controller with reinforcement learning. The basis of our proposed work is Efficient Neural Architecture Search (ENAS), where parameter sharing is applied among the child networks. ENAS, like many other RL-based algorithms, emphasize the learning of child networks as increasing their convergence result in a denser reward signal for the controller, therefore significantly reducing training times. The controller was originally trained with REINFORCE. In our research, we propose to modify this to a more modern and complex algorithm, PPO, which has demonstrated to be faster and more stable in other environments. Then, we briefly discuss and evaluate our results.

cs.LG↗
arXiv2021

On special Rees matrix semigroups over semigroups

In this paper we focus on Rees $I\times Λ$ matrix semigroups without zero over a semigroup $S$ with $Λ\times I$ sandwich matrix $P$, where $I$ is a singleton, $Λ$ is the factor semigroup of $S$ modulo the kernel $θ_S$ of the right regular representation of $S$, and $P$ is a choice function on the collection of all $θ_S$-classes of $S$. We describe the kernel of the right regular representation of this type of Rees matrix semigroups, and prove embedding theorems on them. Motivated by one of embedding theorems, we show how right commutative right cancellative semigroups can be constructed. We define the concept of a right regular sequence of semigroups, and show that every congruence on an arbitrary semigroup defines such a sequence.

math.GR↗
arXiv2021

Remarks on Graphons

L. Lovász and B. Szegedy proved in 2006 that the limits of convergent graph sequences can be described by measurable symmetric functions $W: [0, 1]\times [0, 1]\to [0, 1]$ called graphons. In our present paper we investigate the structure of the set of all graphons within the semigroup $(\mathfrak{F}([0, 1]^2); \circ)$ of all fuzzy subsets of the unit square $[0,1]^2=[0, 1]\times [0, 1]$, where the operation $\circ$ is defined by: for every $f, g\in \mathfrak{F}([0,1]^2)$ and every $s\in [0,1]^2$, $(f\circ g)(s)=\vee_{x\in [0,1]^2}(f(x)\wedge g(s))$.

math.CO↗
arXiv2021

Automatic punctuation restoration with BERT models

We present an approach for automatic punctuation restoration with BERT models for English and Hungarian. For English, we conduct our experiments on Ted Talks, a commonly used benchmark for punctuation restoration, while for Hungarian we evaluate our models on the Szeged Treebank dataset. Our best models achieve a macro-averaged $F_1$-score of 79.8 in English and 82.2 in Hungarian. Our code is publicly available.

cs.CL↗
arXiv2020

Deposition distribution of the new coronavirus (SARS-CoV-2) in the human airways upon exposure to cough-generated aerosol

The new coronavirus disease 2019 (COVID-19) has been emerged as a rapidly spreading pandemic. The disease is thought to spread mainly from person-to-person through respiratory droplets produced when an infected person coughs, sneezes, or talks. The pathogen of COVID-19 is the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). It infects the cells binding to the angiotensin-converting enzyme 2 receptor (ACE2) which is expressed by cells throughout the airways as targets for cellular entry. Although the majority of persons infected with SARS-CoV-2 experience symptoms of mild upper respiratory tract infection, in some people infections of the peripheral airways result in severe, potentially fatal pneumonia. However, the induction of COVID-19 pneumonia requires that SARS-CoV-2 reaches the peripheral airways. While huge efforts have been made to understand the spread of the disease as well as the pathogenesis following cellular entry, much less attention is paid how SARS-CoV-2 from the environment reach the receptors of the target cells. The aim of the present study is to characterize the deposition distribution of SARS-CoV-2 in the airways upon exposure to cough-generated aerosol. For this purpose, the Stochastic Lung Deposition Model has been applied. Aerosol size distribution and breathing parameters were taken from the literature supposing normal breathing through the nose. We found that the probability of direct infection of the peripheral airways due to inhalation of aerosol generated by a bystander cough is very low. As the number of pathogens deposited in the extrathoracic airways is ~10 times higher than in the peripheral airways, we concluded that in most cases COVID-19 pneumonia must be preceded by SARS-CoV-2 infection of the upper airways. Our results suggest that without the enhancement of viral load in the upper airways, COVID-19 would be much less dangerous...

physics.bio-ph↗
arXiv2018

On Congruence Permutable $G$-sets

An algebraic structure is said to be congruence permutable if its arbitrary congruences $α$ and $β$ satisfy the equation $α\circ β=β\circ α$, where $\circ$ denotes the usual composition of binary relations. For an arbitrary $G$-set $X$ with $G\cap X=\emptyset$, we define a semigroup $(G,X,0)$ with a zero $0$ ($0\notin G\cup X$), and give necessary and sufficient conditions for the congruence permutability of the $G$-set $X$ by the help of the semigroup $(G,X,0)$.

math.GR↗