- only important during training - you don't want network to know future words when outputting this word, only words before should be known - basically [[Multi Head Attention]], but you block out any future words