arXiv subjects

Eunju Shin

Publications and source records attributed to Eunju Shin.

4 recordsLinked to original sources

arXiv2026

Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing

In this paper, we present a Mixture-of-Experts (MoE) quantization method based on activation entropy. Although quantization reduces memory and computational costs, it can substantially degrade performance. In particular, performance decline is pronounced in quantized MoE models, where individual experts have a small number of parameters that are sensitive to low-bit representation. Considering that MoE operates as an ensemble model with collaborative contributions from routed experts, a significant performance decline of a particular expert due to quantization can harm model performance. Therefore, we propose Colla-Q, a bit-allocation framework to maintain balanced performance across experts through an activation-entropy-based bit-width allocation algorithm. This approach encourages each expert to operate collaboratively in the quantized model, thereby 1) improving the overall MoE performance and 2) reducing the dependence on the calibration dataset. Since uniformly adjusting each expert's performance facilitates robustness and stability of the MoE model, the proposed MoE quantization method can generalize more consistently across different calibration datasets. Our code is available at: https://github.com/mmai-laboratory/Colla_Q

cs.LG↗

arXiv2026

Character varieties on a four-holed sphere

For each $\mathbf{k}\in\mathbb{C}^4$, let $V_\mathbf{k}$ be the character variety on a four-holed sphere and $Γ_\mathbf{k}$ the group generated by the Vieta involution maps. First, under a certain condition, we find a fundamental domain for $Γ_\mathbf{k}$-action on $V_\mathbf{k}$, expressed via inequalities. Second, we show that it is decidable whether or not two integral solutions for $V_\mathbf{k}$ are in the same $Γ_\mathbf{k}$-orbit and in the same mapping class group orbit. To achieve our goals, we introduce graphs corresponding to the $Γ_\mathbf{k}$-orbits and the mapping class group orbits, and classify their restricted global shapes by analyzing the limited local edge configurations at each vertex, using a descent argument.

math.NT↗

arXiv2026

Density of subsets of squarefree elements in certain Dedekind domains

We consider polynomial rings over finite fields and rings of integers of imaginary quadratic fields $\mathbb{Q}(\sqrt{-D})$. In this paper, we formulate the density of squarefree elements divisible by all elements of $T$ but by none of $P$, where $T$ and $P$ are subsets of squarefree elements and $T$ is finite. We also define Mersenne irreducibles in order to estimate the density of squarefree elements divisible by none of $P$.

math.NT↗

arXiv2023

Fundamental domain for the Markoff-Hurwitz equation

For integers $a\neq0$, $k$, and $n\geq3$, we consider the Markoff-Hurwitz equation given by $x_1^1+\cdots+x_n^2-ax_1\cdots x_n=k$. By defining graphs associated with a height function and by using their properties, we find an exact fundamental domain for a symmetric group generated by involution maps sending $(x_1,\dots,x_n)$ to $(x_1,\dots,ax_1\cdots x_{i-1}x_{i+1}\cdots x_n-x_i,\dots,x_n)$, permutations, and double sign changes on the set of integral solutions for the Markoff-Hurwitz equation.

math.CO↗