Our ICML 2018 paper on training ultra-deep (10k layers) CNNs is now up, from work we've done at Google Brain:
arxiv.org/abs/1806.05393. We examine the relationship of trainability to signal propagation and Jacobian conditioning in networks with convolutional layers, ... (1/3)