Build your intuition. Click the correct answer from the options.
Why divide by sqrt(d_k)?
Click the option that best answers the question.
- noise suppression
- numerical stability in softmax
- to save memory
- to enforce sparsity
Back to course sections
Mark As Completed Discussion