Nature Machine Intelligence reported on the development of NucleicBERT, a self-supervised language model with masking that trains on individual RNA sequences and forms contextual representations without evolutionary information.

The authors link the development to the challenge of the non-coding part of the genome: many of its elements act through RNA, yet the structural and functional roles of such sequences remain insufficiently understood.

The practical significance of the approach cannot yet be assessed based on the available description. It does not provide test results, specific biological tasks, comparisons with other models, or data on the application of NucleicBERT.