visualizing query + key vectors in BERT
TSNE view allAttention - Sentence View
click a point to explore its attention!
show tokens with attention ≥ 0.2
q
k
Attention - Sentence View
click a point to explore its attention!
show tokens with attention ≥ 0.2