Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Support Vector Machine Histogram: New Analysis and Architecture Design Method of Deep Convolutional Neural Network

Support Vector Machine Histogram: New Analysis and Architecture Design Method of Deep... Deep convolutional neural network (DCNN) is a kind of hierarchical neural network models and attracts attention in recent years since it has shown high classification performance. DCNN can acquire the feature representation which is a parameter indicating the feature of the input by learning. However, its internal analysis and the design of the network architecture have many unclear points and it cannot be said that it has been sufficiently elucidated. We propose the novel DCNN analysis method “Support vector machine (SVM) histogram” as a prescription to deal with these problems. This is a method that examines the spatial distribution of DCNN extracted feature representation by using the decision boundary of linear SVM. We show that we can interpret DCNN hierarchical processing using this method. In addition, by using the result of SVM histogram, DCNN architecture design becomes possible. In this study, we designed the architecture of the application to large scale natural image dataset. In the result, we succeeded in showing higher accuracy than the original DCNN. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Neural Processing Letters Springer Journals

Support Vector Machine Histogram: New Analysis and Architecture Design Method of Deep Convolutional Neural Network

Suzuki, Satoshi; Shouno, Hayaru
Neural Processing Letters , Volume 47 (3) – Jul 3, 2017
Download PDF
16 pages

Loading next page...
 
/lp/springer_journal/support-vector-machine-histogram-new-analysis-and-architecture-design-Fv42uks4oy
Publisher
Springer Journals
Copyright
Copyright © 2017 by Springer Science+Business Media, LLC
Subject
Computer Science; Artificial Intelligence (incl. Robotics); Complex Systems; Computational Intelligence
ISSN
1370-4621
eISSN
1573-773X
DOI
10.1007/s11063-017-9652-0
Publisher site
See Article on Publisher Site

Abstract

Deep convolutional neural network (DCNN) is a kind of hierarchical neural network models and attracts attention in recent years since it has shown high classification performance. DCNN can acquire the feature representation which is a parameter indicating the feature of the input by learning. However, its internal analysis and the design of the network architecture have many unclear points and it cannot be said that it has been sufficiently elucidated. We propose the novel DCNN analysis method “Support vector machine (SVM) histogram” as a prescription to deal with these problems. This is a method that examines the spatial distribution of DCNN extracted feature representation by using the decision boundary of linear SVM. We show that we can interpret DCNN hierarchical processing using this method. In addition, by using the result of SVM histogram, DCNN architecture design becomes possible. In this study, we designed the architecture of the application to large scale natural image dataset. In the result, we succeeded in showing higher accuracy than the original DCNN.

Journal

Neural Processing Letters – Springer Journals

Published: Jul 3, 2017

References

  • Pattern recognition and machine learning
    Bishop, CM
  • Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position
    Fukushima, K
  • Artificial vision by multi-layered neural networks: neocognitron and its advances
    Fukushima, K
  • Backpropagation applied to handwritten zip code recognition
    LeCun, Y; Boser, B; Denker, JS; Henderson, D; Howard, RE; Hubbard, W; Jackel, L