diff --git a/notebooks/09a_Object_recognition_with_CIFAR-10_and_CIFAR-100.ipynb b/notebooks/09a_Object_recognition_with_CIFAR-10_and_CIFAR-100.ipynb new file mode 100644 index 0000000..4cefe09 --- /dev/null +++ b/notebooks/09a_Object_recognition_with_CIFAR-10_and_CIFAR-100.ipynb @@ -0,0 +1,351 @@ +{ + "cells": [ + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": true + }, + "outputs": [], + "source": [ + "import tensorflow as tf\n", + "import numpy as np\n", + "from mlp.data_providers import CIFAR10DataProvider, CIFAR100DataProvider\n", + "import matplotlib.pyplot as plt\n", + "%matplotlib inline" + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "## CIFAR-10 and CIFAR-100 datasets\n", + "\n", + "[CIFAR-10 and CIFAR-100](https://www.cs.toronto.edu/~kriz/cifar.html) are a pair of image classification datasets collected by collected by Alex Krizhevsky, Vinod Nair, and Geoffrey Hinton. They are labelled subsets of the much larger [80 million tiny images](dataset). They are a common benchmark task for image classification - a list of current accuracy benchmarks for both data sets are maintained by Rodrigo Benenson [here](http://rodrigob.github.io/are_we_there_yet/build/).\n", + "\n", + "As the name suggests, CIFAR-10 has images in 10 classes:\n", + "\n", + "> airplane, automobile, bird, cat, deer, dog, frog, horse, ship, and truck\n", + "\n", + "with 6000 images per class for an overall dataset size of 60000. Each image has three (RGB) color channels and pixel dimension 32×32, corresponding to a total dimension per input image of 3×32×32=3072.\n", + "\n", + "CIFAR-100 has images of identical dimensions to CIFAR-10 but rather than 10 classes they are instead split across 100 fine-grained classes (and 20 coarser 'superclasses' comprising multiple finer classes):\n", + "\n", + "\n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + " \n", + "
SuperclassClasses
aquatic mammalsbeaver, dolphin, otter, seal, whale
fishaquarium fish, flatfish, ray, shark, trout
flowersorchids, poppies, roses, sunflowers, tulips
food containersbottles, bowls, cans, cups, plates
fruit and vegetablesapples, mushrooms, oranges, pears, sweet peppers
household electrical devicesclock, computer keyboard, lamp, telephone, television
household furniturebed, chair, couch, table, wardrobe
insectsbee, beetle, butterfly, caterpillar, cockroach
large carnivoresbear, leopard, lion, tiger, wolf
large man-made outdoor thingsbridge, castle, house, road, skyscraper
large natural outdoor scenescloud, forest, mountain, plain, sea
large omnivores and herbivorescamel, cattle, chimpanzee, elephant, kangaroo
medium-sized mammalsfox, porcupine, possum, raccoon, skunk
non-insect invertebratescrab, lobster, snail, spider, worm
peoplebaby, boy, girl, man, woman
reptilescrocodile, dinosaur, lizard, snake, turtle
small mammalshamster, mouse, rabbit, shrew, squirrel
treesmaple, oak, palm, pine, willow
vehicles 1bicycle, bus, motorcycle, pickup truck, train
vehicles 2lawn-mower, rocket, streetcar, tank, tractor
\n", + "\n", + "Each class has 600 examples in it, giving an overall dataset size of 60000 i.e. the same as CIFAR-10.\n", + "\n", + "Both CIFAR-10 and CIFAR-100 have standard splits into 50000 training examples and 10000 test examples. To avoid accidental (or purposeful...) fitting to the test set, we have used a different assignation of examples to test and training sets and only provided the inputs (and not target labels) for the 10000 examples chosen for the test set. The remaining 50000 examples have been split in to a 40000 example training dataset and a 10000 example validation dataset, each with target labels provided. If you wish to use a more complex cross-fold validation scheme you may want to combine these two portions of the dataset and define your own functions for separating out a validation set.\n", + "\n", + "Data provider classes for both CIFAR-10 and CIFAR-100 are available in the `mlp.data_providers` module. Both have similar behaviour to the `MNISTDataProvider` used extensively last semester. A `which_set` argument can be used to specify whether to return a data provided for the training dataset (`which_set='train'`) or validation dataset (`which_set='valid'`). \n", + "\n", + "The CIFAR-100 data provider also takes an optional `use_coarse_targets` argument in its constructor. By default this is set to `False` and the targets returned by the data provider correspond to 1-of-K encoded binary vectors for the 100 fine-grained object classes. If `use_coarse_targets=True` then instead the data provider will return 1-of-K encoded binary vector targets for the 20 coarse-grained superclasses associated with each input instead.\n", + "\n", + "Below example code is given for creating instances of the CIFAR-10 and CIFAR-100 data provider objects and using them to train simple two-layer feedforward network models with rectified linear activations in TensorFlow. You may wish to use this code as a starting point for your own experiments." + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "## Example two-layer classifier model on CIFAR-10" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": true + }, + "outputs": [], + "source": [ + "train_data = CIFAR10DataProvider('train', batch_size=50)\n", + "valid_data = CIFAR10DataProvider('valid', batch_size=50)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": true + }, + "outputs": [], + "source": [ + "def fully_connected_layer(inputs, input_dim, output_dim, nonlinearity=tf.nn.relu):\n", + " weights = tf.Variable(\n", + " tf.truncated_normal(\n", + " [input_dim, output_dim], stddev=2. / (input_dim + output_dim)**0.5), \n", + " 'weights')\n", + " biases = tf.Variable(tf.zeros([output_dim]), 'biases')\n", + " outputs = tf.matmul(inputs, weights) + biases\n", + " return outputs" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": false + }, + "outputs": [], + "source": [ + "inputs = tf.placeholder(tf.float32, [None, train_data.inputs.shape[1]], 'inputs')\n", + "targets = tf.placeholder(tf.float32, [None, train_data.num_classes], 'targets')\n", + "num_hidden = 200\n", + "\n", + "with tf.name_scope('fc-layer-1'):\n", + " hidden_1 = fully_connected_layer(inputs, train_data.inputs.shape[1], num_hidden)\n", + "with tf.name_scope('output-layer'):\n", + " outputs = fully_connected_layer(hidden_1, num_hidden, train_data.num_classes, tf.identity)\n", + "\n", + "with tf.name_scope('error'):\n", + " error = tf.reduce_mean(\n", + " tf.nn.softmax_cross_entropy_with_logits(outputs, targets))\n", + "with tf.name_scope('accuracy'):\n", + " accuracy = tf.reduce_mean(tf.cast(\n", + " tf.equal(tf.argmax(outputs, 1), tf.argmax(targets, 1)), \n", + " tf.float32))\n", + "\n", + "with tf.name_scope('train'):\n", + " train_step = tf.train.AdamOptimizer().minimize(error)\n", + " \n", + "init = tf.global_variables_initializer()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": false + }, + "outputs": [], + "source": [ + "with tf.Session() as sess:\n", + " sess.run(init)\n", + " for e in range(25):\n", + " running_error = 0.\n", + " running_accuracy = 0.\n", + " for input_batch, target_batch in train_data:\n", + " _, batch_error, batch_acc = sess.run(\n", + " [train_step, error, accuracy], \n", + " feed_dict={inputs: input_batch, targets: target_batch})\n", + " running_error += batch_error\n", + " running_accuracy += batch_acc\n", + " running_error /= train_data.num_batches\n", + " running_accuracy /= train_data.num_batches\n", + " print('End of epoch {0:02d}: err(train)={1:.2f} acc(train)={2:.2f}'\n", + " .format(e + 1, running_error, running_accuracy))\n", + " if (e + 1) % 5 == 0:\n", + " valid_error = 0.\n", + " valid_accuracy = 0.\n", + " for input_batch, target_batch in valid_data:\n", + " batch_error, batch_acc = sess.run(\n", + " [error, accuracy], \n", + " feed_dict={inputs: input_batch, targets: target_batch})\n", + " valid_error += batch_error\n", + " valid_accuracy += batch_acc\n", + " valid_error /= valid_data.num_batches\n", + " valid_accuracy /= valid_data.num_batches\n", + " print(' err(valid)={0:.2f} acc(valid)={1:.2f}'\n", + " .format(valid_error, valid_accuracy))" + ] + }, + { + "cell_type": "markdown", + "metadata": {}, + "source": [ + "## Example two-layer classifier model on CIFAR-100" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": true + }, + "outputs": [], + "source": [ + "train_data = CIFAR100DataProvider('train', batch_size=50)\n", + "valid_data = CIFAR100DataProvider('valid', batch_size=50)" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": true + }, + "outputs": [], + "source": [ + "tf.reset_default_graph()\n", + "\n", + "inputs = tf.placeholder(tf.float32, [None, train_data.inputs.shape[1]], 'inputs')\n", + "targets = tf.placeholder(tf.float32, [None, train_data.num_classes], 'targets')\n", + "num_hidden = 200\n", + "\n", + "with tf.name_scope('fc-layer-1'):\n", + " hidden_1 = fully_connected_layer(inputs, train_data.inputs.shape[1], num_hidden)\n", + "with tf.name_scope('output-layer'):\n", + " outputs = fully_connected_layer(hidden_1, num_hidden, train_data.num_classes, tf.identity)\n", + "\n", + "with tf.name_scope('error'):\n", + " error = tf.reduce_mean(\n", + " tf.nn.softmax_cross_entropy_with_logits(outputs, targets))\n", + "with tf.name_scope('accuracy'):\n", + " accuracy = tf.reduce_mean(tf.cast(\n", + " tf.equal(tf.argmax(outputs, 1), tf.argmax(targets, 1)), \n", + " tf.float32))\n", + "\n", + "with tf.name_scope('train'):\n", + " train_step = tf.train.AdamOptimizer().minimize(error)\n", + " \n", + "init = tf.global_variables_initializer()" + ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": { + "collapsed": false + }, + "outputs": [], + "source": [ + "with tf.Session() as sess:\n", + " sess.run(init)\n", + " for e in range(25):\n", + " running_error = 0.\n", + " running_accuracy = 0.\n", + " for input_batch, target_batch in train_data:\n", + " _, batch_error, batch_acc = sess.run(\n", + " [train_step, error, accuracy], \n", + " feed_dict={inputs: input_batch, targets: target_batch})\n", + " running_error += batch_error\n", + " running_accuracy += batch_acc\n", + " running_error /= train_data.num_batches\n", + " running_accuracy /= train_data.num_batches\n", + " print('End of epoch {0:02d}: err(train)={1:.2f} acc(train)={2:.2f}'\n", + " .format(e + 1, running_error, running_accuracy))\n", + " if (e + 1) % 5 == 0:\n", + " valid_error = 0.\n", + " valid_accuracy = 0.\n", + " for input_batch, target_batch in valid_data:\n", + " batch_error, batch_acc = sess.run(\n", + " [error, accuracy], \n", + " feed_dict={inputs: input_batch, targets: target_batch})\n", + " valid_error += batch_error\n", + " valid_accuracy += batch_acc\n", + " valid_error /= valid_data.num_batches\n", + " valid_accuracy /= valid_data.num_batches\n", + " print(' err(valid)={0:.2f} acc(valid)={1:.2f}'\n", + " .format(valid_error, valid_accuracy))" + ] + } + ], + "metadata": { + "anaconda-cloud": {}, + "kernelspec": { + "display_name": "Python [conda env:mlp]", + "language": "python", + "name": "conda-env-mlp-py" + }, + "language_info": { + "codemirror_mode": { + "name": "ipython", + "version": 2 + }, + "file_extension": ".py", + "mimetype": "text/x-python", + "name": "python", + "nbconvert_exporter": "python", + "pygments_lexer": "ipython2", + "version": "2.7.12" + } + }, + "nbformat": 4, + "nbformat_minor": 1 +}