Abstract: This article introduces semantically meaningful causal language modeling (SMCLM), a self-supervised method of training autoregressive models to generate semantically equivalent text. Our ...