Leçon 3.1 - Self-Attention
Contenu LMS :
- Q, K, V
- Matrice d’attention
- Pondération contextuelle
- Multi-head attention
Explication technique simplifiée :
Attention = softmax(QKᵀ / √dₖ)V
Rating
0
0
There are no comments for now.
Join this Course
to be the first to leave a comment.
Share This Content
Share Link
Share on Social Media
Share by Email
Please login to share this Document by email.
Embed in another Website
Start at Page