Before Transformer was a thing there were several embedding techniques used BOW, Word2Vec, Lemmatization, TF-IDF. but the TF-IDF is still reliable, low-cost baseline especially in systems where interpretability, efficiency, or keyword precision matter.