csulb-ml.github.io

csulb-ml.github.io

Visualizing and Understanding Convolutional Networks By Patrapee Pongtana Credit: Matthew D. Zeiler, Rob Fergus Dept. of Computer Science, Courant Institute, New York University

Background of Convolutional Neural Networks Previously, Alex Krizhevsky has achieved error rate as low as 16.4% on Top-5 Test

Architecture consists of 5 convolutional layers and 3 fully connected layers Krizhevsky utilized A large dataset that consists of millions of labeled examples

A powerful GPU to train a large model A dropout method to regularize the better model Motivation

To observe each layers highest activation on feature maps To map these highest

activation location back to input pixel space To learn what machine learns

Multi Layered Deconvolutional Network Performed under unsupervised learning Max-pooling MUST be able to reversed back The convolutional during reconstruct will perform conv transpose

Reconstruction Switches

Feature Map Top-9 Patches

Top-9 Highest of Activation from validation set Top-9 Highest of Activation from validation set

Top-9 Highest of Activation from validation set Top-9 Highest of Activation from validation set

Layer 4 Matt Zeibers Architecture

Result Conclusion The visualization of how machine learn helps us improve the performance by exploring the key location of each pixel

E.g. We can know which hidden layer will be able to distinguish between human face and a dog face The intuition of this research is to explain how and what hidden layers (conv layers) learn features with given filters

Recently Viewed Presentations

  • Lord of the Flies - Moore Public Schools

    Lord of the Flies - Moore Public Schools

    Lord of the Flies. Vocabulary by Chapter. Chapter One (Page numbers are in parentheses) Foliage (9) ... Chapter Nine(Page numbers are in Parentheses) Interspersed (146) Corpulent (146) ... Lord of the Flies
  • FHA 203(k) and 203(k) Limited INSTRUCTIONS AND PROCEDURES

    FHA 203(k) and 203(k) Limited INSTRUCTIONS AND PROCEDURES

    HomeStar Quick Notes for Full and Limited 203(k)s. 203k loans are not to be submitted thru Fastrak. They must be fully processed loans. All 203k purchases and refinances must be submitted to underwriting only after they have an appraisal; a...
  • Managing Difficult Conversations February 8, 2017 Francine Montemurro,

    Managing Difficult Conversations February 8, 2017 Francine Montemurro,

    Brainstorm in groups of 4. Catherine Rich. Joanne Murabito. Renda Wiener. ShoumitaDasgupta. Jenny Siegel. Lucia Plant. Tracy Battaglia. Lynn Deng. Joanna D'Afflitti
  • Heritage Tourism and the Historic Preservation Movement

    Heritage Tourism and the Historic Preservation Movement

    Heritage Tourism and the Historic Preservation Movement. The new world order, the present must profit from the past. Taxation is a burden to residents who, however, wish the services that the local jurisdictions provide. ... Lack of return to historic...
  • Chapter 1

    Chapter 1

    Chapter 1 INTRODUCTION TO INSTRUMENTATION * Standard Deviation and Probable of Error Variance: the mean-squared value of the deviations Standard deviation or root ...
  • Title of presentation to a maximum of three lines of text

    Title of presentation to a maximum of three lines of text

    At the heart of a conflict sensitive approach is meaningful stakeholder engagement, and alongside this, "conflict analysis" - essentially, understanding the context, issues and stakeholders that shape an existing or potential conflict, and the role of the company in the...
  • Current and Future Unit Mobilizations

    Current and Future Unit Mobilizations

    Southwestern Veterans' Center - Pittsburgh PA . Based on the Department of Health (DOH) inspection on July 14, 2016 SWVC obtained three deficiencies on the most recent abbreviated survey / inspection. ... CURRENT AND FUTURE UNIT MOBILIZATIONS
  • :Outline .The integumentary system .The musculoskeletal system .The

    :Outline .The integumentary system .The musculoskeletal system .The

    ( Skeletal muscles develop from the myoblasts derived from The muscles of the neck and trunk are derived from the myotomes, whereas the limb musculature develops from myogenic cel