Notes
- How robust are LLM embeddings to adversarial perturbations?
- The token embeddings in LLM mostly have positive cosine similarity with each other
- Researchers should be tool builders
- Visualize embeddings of individual tokens
- The Gemma model family seems to partially be trained like autoencoder
- AI and the Limit of Human Intelligence
- Towards Production and Delivery of Machine Learning Solutions