Self and cross attention
Well I figured out it’s high time I actually understand what’s going on inside the black box.
Could not find a resource that explains cross attention and how does it differ from simple self attention, so here is my attempt.
Well I figured out it’s high time I actually understand what’s going on inside the black box.
Could not find a resource that explains cross attention and how does it differ from simple self attention, so here is my attempt.
Last updated: September 25, 2025