A cascade of orbital-field-driven phases with a Lifshitz-type transition to unidirectional spiral order

Abstract

Frustration in magnetic systems gives rise to unconventional orders and exotic spin liquids. Here, we explore a new type of frustration arising from an intrinsic bond-dependent orbital-field that couples orbital degrees of freedom to spin correlations. Introducing this orbital-field interaction into the antiferromagnetic Heisenberg model on the honeycomb lattice, we show that local spin-orbital constraints generate a subextensive degeneracy, lifted by order-by-disorder to select distinct collinear magnets in a cascade of phases as the orbital field increases from a para-orbital liquid. At larger fields, the selected phase gives way to an incommensurate unidirectional spiral that spontaneously breaks chiral symmetry. This transition is driven by the coupling of a Goldstone mode to gapped dynamical spin-orbital fluctuations. The spin stiffness becomes negative along a particular direction, while the spiral wavevector grows as the square root of the distance from the transition, signaling a Lifshitz-type transition. We present a microscopic route to realizing this orbital field and discuss candidate materials.