SoonChangNeural Network Pruning: A Gentle IntroductionThis post will be continuously updated from time to time.Nov 26, 20211Nov 26, 20211
SoonChangNetwork Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep ArchitecturesIn this writing, I am going to share about the paper Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep…Nov 20, 20212Nov 20, 20212
SoonChangWhen BERT Plays the Lottery, All Tickets Are WinningIn this writing, I write about the paper When BERT Plays the Lottery, All Tickets Are Winning authored by Sai Prasanna, Anna Rogers and…Nov 20, 2021Nov 20, 2021
SoonChangSlimmable Neural NetworksIn this writing, I would like to share about Slimmable neural networks by Jiahui Yu and colleagues which was accepted in ICLR 2019. The…Oct 30, 20211Oct 30, 20211
SoonChangThe Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural NetworksIn this piece of writing, I would like to share what I learned from this paper authored by Jonathan Frankle and Michael Carbin. Before we…Oct 25, 2021Oct 25, 2021
SoonChangDistilling the Knowledge in a Neural NetworkIn this post, we will go through “Distilling the Knowledge in a Neural Network” by Hinton et al. In this paper, the authors aimed to find a…Oct 24, 2021Oct 24, 2021
SoonChangVinVL: Revisting Visual Representations in Vision-Language ModelsIn this post, we are going to explore the recently published VinVL paper. In this paper, the authors introduced a new object detection…Oct 3, 2021Oct 3, 2021