arXiv Science⌕ Search

arXiv subjects

Linfang Hou

Publications and source records attributed to Linfang Hou.

3 recordsLinked to original sources

Affine Vertex Operator Algebras and Correlation Functions on Elliptic Curves

Let $V^{\Bbbk}(\mathfrak{g})$ be the universal affine vertex algebra attached to a finite-dimensional complex simple Lie algebra at arbitrary level, and let $M=\bigoplus_{N=0}^{\infty}M_N$ be a $V^{\Bbbk}(\mathfrak{g})$ -module. We give an explicit formula for every genus-one trace of affine currents as a finite sum over cycle partitions. We then show the convergence of all fixed zero-mode trace series, hence absolute locally uniform convergence of the current traces and their meromorphic continuation on the elliptic configuration space. The same conclusion is obtained for arbitrary affine-state insertions. Finally, we compute the cases of at most four currents and the nodal limit $q\to 0$, in which the type-1 and type-2 elliptic cycle coefficients degenerate to rational genus-zero cycle coefficients and the module trace reduces to the ground-state space.

math.RT↗

Data-Efficient Reinforcement Learning for Malaria Control

Sequential decision-making under cost-sensitive tasks is prohibitively daunting, especially for the problem that has a significant impact on people's daily lives, such as malaria control, treatment recommendation. The main challenge faced by policymakers is to learn a policy from scratch by interacting with a complex environment in a few trials. This work introduces a practical, data-efficient policy learning method, named Variance-Bonus Monte Carlo Tree Search~(VB-MCTS), which can copy with very little data and facilitate learning from scratch in only a few trials. Specifically, the solution is a model-based reinforcement learning method. To avoid model bias, we apply Gaussian Process~(GP) regression to estimate the transitions explicitly. With the GP world model, we propose a variance-bonus reward to measure the uncertainty about the world. Adding the reward to the planning with MCTS can result in more efficient and effective exploration. Furthermore, the derived polynomial sample complexity indicates that VB-MCTS is sample efficient. Finally, outstanding performance on a competitive world-level RL competition and extensive experimental results verify its advantage over the state-of-the-art on the challenging malaria control task.

cs.LG↗

Robust Reinforcement Learning with Wasserstein Constraint

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating environmental parameters in a heuristic way, which lack quantified robustness to the system dynamics (i.e. transition probability). To overcome this issue, we leverage Wasserstein distance to measure the disturbance to the reference transition kernel. With Wasserstein distance, we are able to connect transition kernel disturbance to the state disturbance, i.e. reduce an infinite-dimensional optimization problem to a finite-dimensional risk-aware problem. Through the derived risk-aware optimal Bellman equation, we show the existence of optimal robust policies, provide a sensitivity analysis for the perturbations, and then design a novel robust learning algorithm--Wasserstein Robust Advantage Actor-Critic algorithm (WRAAC). The effectiveness of the proposed algorithm is verified in the Cart-Pole environment.

cs.LG↗