SoonChangNeural Network Pruning: A Gentle IntroductionThis post will be continuously updated from time to time.3 min read·Nov 26, 2021----
SoonChangNetwork Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep ArchitecturesIn this writing, I am going to share about the paper Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep…4 min read·Nov 20, 2021--2--2
SoonChangWhen BERT Plays the Lottery, All Tickets Are WinningIn this writing, I write about the paper When BERT Plays the Lottery, All Tickets Are Winning authored by Sai Prasanna, Anna Rogers and…5 min read·Nov 20, 2021----
SoonChangSlimmable Neural NetworksIn this writing, I would like to share about Slimmable neural networks by Jiahui Yu and colleagues which was accepted in ICLR 2019. The…5 min read·Oct 30, 2021--1--1
SoonChangThe Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural NetworksIn this piece of writing, I would like to share what I learned from this paper authored by Jonathan Frankle and Michael Carbin. Before we…4 min read·Oct 25, 2021----
SoonChangDistilling the Knowledge in a Neural NetworkIn this post, we will go through “Distilling the Knowledge in a Neural Network” by Hinton et al. In this paper, the authors aimed to find a…5 min read·Oct 24, 2021----
SoonChangVinVL: Revisting Visual Representations in Vision-Language ModelsIn this post, we are going to explore the recently published VinVL paper. In this paper, the authors introduced a new object detection…7 min read·Oct 3, 2021----
