Attention Mechanisms in Deep Neural Networks

Projects

Recently the Deep Learning community has shown great interest in attention mechanisms to train neural networks – the network pays attention to only certain parts of the input or to certain parts of the network structure …

Tags: deep learning, reinforcement learning, transfer learning, natural language processing

Distributed learning machines for solving forward and inverse problems in partial differential equations

Publications

Tags: Neural networks, Transfer learning

Attend, Adapt and Transfer: Attentive Deep Architecture for Adaptive Transfer from multiple sources

Publications

Transferring knowledge from prior source tasks in solving a new target task can be useful in several learning applications. The application of transfer poses two serious challenges which have not been adequately …

Tags: Transfer Learning, Deep neural network architecture, Attention