The last year or two, unsurprisingly, has made me rethink how I work with text in research. With LightOn and Answer.AI releasing an exciting encoding model—ModernBERT—a few days ago, I thought would write a post where I try it out. I do so by revisiting a previous post of mine, walking through how my thoughts about supervised text classification have changed.