English Pronunciation

Google has nice animations for this!

• Query = [kwee ree]
• Paradigm = [pa ruh daim] or American [peh ruh daim]

Linear algebra

I’ll be following this: 9.1. Attention Mechanism — Dive into Deep Learning 0.7 documentation

• Inner product is the generalization of the dot product. Result is a scalar. ¹

Python assert statement

UsingAssertionsEffectively - Python Wiki assert condition, message -> if condition is false, it returns an AssertionError.