STP‐CNN: Selection of transfer parameters in convolutional neural networks

Abstract

Nowadays, transfer learning has shown promising results in many applications. However, most deep transfer learning methods such as parameter sharing and fine‐tuning are still suffering from the lack of parameters transmission strategy. In this paper, we propose a new optimization model for parameter‐based transfer learning in convolutional neural networks named STP‐CNN. Indeed, we propose a Lasso transfer model supported by a regularization term that controls transferability. Moreover, we opt for the proximal gradient descent method to solve the proposed model. The suggested technique allows, under certain conditions, to control exactly which parameters, in each convolutional layer of the source network, which will be used directly or adjusted in the target network. Several experiments prove the performance of our model in locating the transferable parameters as well as improving the data classification.