Transformers

Transformers and LLMs Explained

Posted by Fede Nolasco | Aug 12, 2025

Discover the mechanics of transformers and LLMs in this engaging video by 3Blue1Brown, breaking down complex concepts into visual explanations.

Transformers and Attention Mechanisms

Posted by Fede Nolasco | Jun 25, 2025

Grant Sanderson explains the mechanics of Transformers and attention mechanisms in deep learning, breaking down complex concepts into visually understandable segments.

AI Breakthroughs: Lex Fridman and Aravind Srinivas Discuss

Posted by Fede Nolasco | Oct 7, 2024

Lex Fridman and Aravind Srinivas discuss recent AI breakthroughs, focusing on attention mechanisms, Transformers, and retrieval-augmented generation (RAG).

MIT 6.S191: Recurrent Neural Networks, Transformers

Posted by Fede Nolasco | Aug 27, 2024

Explore Recurrent Neural Networks and Transformers in MIT’s 6.S191 course. Learn about sequence modeling, attention mechanisms, and practical applications.

Mamba Neural Network Architecture

Posted by Fede Nolasco | Jul 2, 2024

Discover the Mamba neural network architecture, which surpasses Transformers in language modeling efficiency and performance.

New Discovery: LLMs Have a Performance Phase

Posted by Fede Nolasco | Jun 27, 2024

Discover the phenomenon of ‘grokking’ in LLMs, where extended training leads to superior generalization and complex reasoning capabilities. Learn about the implications for AI training.