Attention Mechanisms in Deep Neural Networks
Recently the Deep Learning community has shown great interest in attention mechanisms to train neural networks - the network pays attention to only certain parts of the input or to certain parts of the network structure …