Combining generative and discriminative representation learning for lung CT analysis with convolutional restricted Boltzmann machines
Research output: Contribution to journal › Journal article › Research › peer-review
Standard
Combining generative and discriminative representation learning for lung CT analysis with convolutional restricted Boltzmann machines. / van Tulder, Gijs; de Bruijne, Marleen.
In: IEEE Transactions on Medical Imaging, Vol. 35, No. 5, 2016, p. 1262-1272.Research output: Contribution to journal › Journal article › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - Combining generative and discriminative representation learning for lung CT analysis with convolutional restricted Boltzmann machines
AU - van Tulder, Gijs
AU - de Bruijne, Marleen
PY - 2016
Y1 - 2016
N2 - The choice of features greatly influences the performance of a tissue classification system. Despite this, many systems are built with standard, predefined filter banks that are not optimized for that particular application. Representation learning methods such as restricted Boltzmann machines may outperform these standard filter banks because they learn a feature description directly from the training data. Like many other representation learning methods, restricted Boltzmann machines are unsupervised and are trained with a generative learning objective; this allows them to learn representations from unlabeled data, but does not necessarily produce features that are optimal for classification. In this paper we propose the convolutional classification restricted Boltzmann machine, which combines a generative and a discriminative learning objective. This allows it to learn filters that are good both for describing the training data and for classification. We present experiments with feature learning for lung texture classification and airway detection in CT images. In both applications, a combination of learning objectives outperformed purely discriminative or generative learning, increasing, for instance, the lung tissue classification accuracy by 1 to 8 percentage points. This shows that discriminative learning can help an otherwise unsupervised feature learner to learn filters that are optimized for classification.
AB - The choice of features greatly influences the performance of a tissue classification system. Despite this, many systems are built with standard, predefined filter banks that are not optimized for that particular application. Representation learning methods such as restricted Boltzmann machines may outperform these standard filter banks because they learn a feature description directly from the training data. Like many other representation learning methods, restricted Boltzmann machines are unsupervised and are trained with a generative learning objective; this allows them to learn representations from unlabeled data, but does not necessarily produce features that are optimal for classification. In this paper we propose the convolutional classification restricted Boltzmann machine, which combines a generative and a discriminative learning objective. This allows it to learn filters that are good both for describing the training data and for classification. We present experiments with feature learning for lung texture classification and airway detection in CT images. In both applications, a combination of learning objectives outperformed purely discriminative or generative learning, increasing, for instance, the lung tissue classification accuracy by 1 to 8 percentage points. This shows that discriminative learning can help an otherwise unsupervised feature learner to learn filters that are optimized for classification.
U2 - 10.1109/TMI.2016.2526687
DO - 10.1109/TMI.2016.2526687
M3 - Journal article
C2 - 26886968
VL - 35
SP - 1262
EP - 1272
JO - I E E E Transactions on Medical Imaging
JF - I E E E Transactions on Medical Imaging
SN - 0278-0062
IS - 5
ER -
ID: 162034567