Twin Domains in Van der Waals Quaternary Oxides

Abstract

Optical anisotropy is the basis for many intriguing phenomena in van der Waals materials, including hyperbolic polaritons and extreme birefringence. Stacking and twisting van der Waals materials along the out-of-plane direction emerged as a powerful route to tailor this anisotropy, but designing lateral interfaces remains a challenge. Here, twin domains are reported in the van der Waals quaternary oxides MgTeMoO$_6$, MnTeMoO$_6$, ZnTeMoO$_6$, and CoTeMoO$_6$ - materials that possess strong in-plane optical anisotropy and second-order nonlinearity. The domains naturally form in their orthorhombic crystal structure and extend over hundreds of micrometers. It is proposed that this stability is achieved by the domain wall acting as a diagonal mirror plane in the crystal structure, parallel to the (1-10) or (110) crystal planes, resulting in nearly opposite birefringence between domains. This hypothesis is experimentally confirmed by determining the angle between the crystal axes of neighboring domains using polarization-resolved optical microscopy, infrared-visible sum-frequency generation microscopy, and transmission electron microscopy. The latter further allowed an estimate of the domain wall thickness. Overall, the observation of twin domains with orthogonal optical anisotropy opens new routes to use van der Waals quaternary oxides for birefringent waveguiding, polariton steering, and frequency conversion applications.