AI Research
Word2Vec Cracked: It Just Runs PCA on Word Co-Occurrences
For years, word2vec seemed like an inscrutable oracle for word meanings. A fresh theory reveals it's merely PCA in disguise—shaking foundations for modern LLMs.