canvas-recognition/number_recoginition_capstone.ipynb

3644 lines
435 KiB
Text
Raw Normal View History

2021-03-30 00:07:48 -07:00
{
"cells": [
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "rffwkDWTz_Fo"
},
"source": [
"# Capstone Project\n",
"## Image classifier for the SVHN dataset\n",
"### Instructions\n",
"\n",
"In this notebook, you will create a neural network that classifies real-world images digits. You will use concepts from throughout this course in building, training, testing, validating and saving your Tensorflow classifier model.\n",
"\n",
"This project is peer-assessed. Within this notebook you will find instructions in each section for how to complete the project. Pay close attention to the instructions as the peer review will be carried out according to a grading rubric that checks key parts of the project instructions. Feel free to add extra cells into the notebook as required.\n",
"\n",
"### How to submit\n",
"\n",
"When you have completed the Capstone project notebook, you will submit a pdf of the notebook for peer review. First ensure that the notebook has been fully executed from beginning to end, and all of the cell outputs are visible. This is important, as the grading rubric depends on the reviewer being able to view the outputs of your notebook. Save the notebook as a pdf (you could download the notebook with File -> Download .ipynb, open the notebook locally, and then File -> Download as -> PDF via LaTeX), and then submit this pdf for review.\n",
"\n",
"### Let's get started!\n",
"\n",
"We'll start by running some imports, and loading the dataset. For this project you are free to make further imports throughout the notebook as you wish. "
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 2,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {},
"colab_type": "code",
"id": "O3vI8jSIz_Fs"
},
2021-04-01 03:16:00 -07:00
"outputs": [],
2021-03-30 00:07:48 -07:00
"source": [
"import tensorflow as tf\n",
"from scipy.io import loadmat\n",
"import numpy as np\n",
"import matplotlib.pyplot as plt\n",
"%matplotlib inline\n",
"from tensorflow.keras.layers import Dense,Flatten,Conv2D,MaxPooling2D,BatchNormalization,Dropout\n",
"from tensorflow.keras.models import Sequential\n",
"from tensorflow.keras.callbacks import EarlyStopping, ModelCheckpoint,ReduceLROnPlateau\n",
"import pandas as pd"
]
},
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "8OrHY7TRz_Fx"
},
"source": [
"For the capstone project, you will use the [SVHN dataset](http://ufldl.stanford.edu/housenumbers/). This is an image dataset of over 600,000 digit images in all, and is a harder dataset than MNIST as the numbers appear in the context of natural scene images. SVHN is obtained from house numbers in Google Street View images.\n",
"\n",
"* Y. Netzer, T. Wang, A. Coates, A. Bissacco, B. Wu and A. Y. Ng. \"Reading Digits in Natural Images with Unsupervised Feature Learning\". NIPS Workshop on Deep Learning and Unsupervised Feature Learning, 2011.\n",
"\n",
"The train and test datasets required for this project can be downloaded from [here](http://ufldl.stanford.edu/housenumbers/train.tar.gz) and [here](http://ufldl.stanford.edu/housenumbers/test.tar.gz). Once unzipped, you will have two files: `train_32x32.mat` and `test_32x32.mat`. You should store these files in Drive for use in this Colab notebook.\n",
"\n",
"Your goal is to develop an end-to-end workflow for building, training, validating, evaluating and saving a neural network that classifies a real-world image into one of ten classes."
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 3,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {},
"colab_type": "code",
"id": "YWdiz3n_z_Fy"
},
"outputs": [],
"source": [
"# Load the dataset from your Drive folder\n",
"\n",
2021-04-01 03:16:00 -07:00
"train = loadmat('C:/Users/bncha/Downloads/train_32x32.mat')\n",
"test = loadmat('C:/Users/bncha/Downloads/test_32x32.mat')"
2021-03-30 00:07:48 -07:00
]
},
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "Sot1IcuZz_F2"
},
"source": [
"Both `train` and `test` are dictionaries with keys `X` and `y` for the input images and labels respectively."
]
},
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "_Q1n_Ai2z_F3"
},
"source": [
"## 1. Inspect and preprocess the dataset\n",
"* Extract the training and testing images and labels separately from the train and test dictionaries loaded for you.\n",
"* Select a random sample of images and corresponding labels from the dataset (at least 10), and display them in a figure.\n",
"* Convert the training and test images to grayscale by taking the average across all colour channels for each pixel. _Hint: retain the channel dimension, which will now have size 1._\n",
"* Select a random sample of the grayscale images and corresponding labels from the dataset (at least 10), and display them in a figure."
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 6,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 68
},
"colab_type": "code",
"id": "-WIH5hyXz_F4",
"outputId": "e51e8a80-911b-41a7-df93-e1cfc2fb2733"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"scaled image sizes : \n",
"train images:(73257, 32, 32, 3)\n",
"test images:(26032, 32, 32, 3)\n"
]
}
],
"source": [
"train_images = train['X']\n",
"test_images = test['X']\n",
"train_labels = train['y']\n",
"test_labels = test['y']\n",
"\n",
"train_images = train_images/255\n",
"test_images = test_images/255\n",
"train_labels = train_labels[:,0]\n",
"test_labels = test_labels[:,0]\n",
"scaled_train_images = train_images.transpose((3,0,1,2))\n",
"scaled_test_images = test_images.transpose((3,0,1,2))\n",
"\n",
"\n",
"print('scaled image sizes : ')\n",
"print('train images:' + str(scaled_train_images.shape))\n",
"print('test images:' + str(scaled_test_images.shape))"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 7,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {},
"colab_type": "code",
"id": "6SR4gYffz_F_"
},
"outputs": [],
"source": [
"def plot_random_images(images,labels,rows,columns):\n",
"\n",
" num_train_images = images.shape[0]\n",
"\n",
" random_inx = np.random.choice(num_train_images, rows*columns)\n",
" random_train_images = images[random_inx,...]\n",
" random_train_labels = labels[random_inx, ...]\n",
"\n",
"\n",
"\n",
"\n",
"\n",
" fig, axes = plt.subplots(rows, columns,figsize = (16,16))\n",
" fig.subplots_adjust(hspace=-0.7, wspace= 0.2)\n",
"\n",
" for i,ax in enumerate(axes.flat):\n",
"\n",
" ax.imshow(np.squeeze(random_train_images[i]))\n",
" ax.text(6., -1.0, f'Digit {random_train_labels[i]}',fontsize = 20)\n",
" ax.get_xaxis().set_visible(False)\n",
" ax.get_yaxis().set_visible(False)\n",
" \n",
" \n",
" plt.show()\n",
"\n",
"\n"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 8,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 406
},
"colab_type": "code",
"id": "ghAbFwh57GBq",
"outputId": "1ec22b47-ffd2-4e9e-f57d-755b7d024f58"
},
"outputs": [
{
"data": {
2021-04-01 03:16:00 -07:00
"image/png": "iVBORw0KGgoAAAANSUhEUgAAA44AAAGFCAYAAACyr61+AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAACmgklEQVR4nO39ebSsWXrWB777m2I6051vDlVZo0oDSCoJCYTKUoExSAwtGi3aEvNqr0ZrdTe2MO12G2RUgOQlW1rN7AZLzDRNuxtJIBYLZAsKGbsZBJrlKtWQmZWVw807nTkivmn3H3FSuvt9nhM3TmbWjXNOPb+17joZO/f3xf72fvcUEc+zQ4zRhBBCCCGEEEKI08jWXQAhhBBCCCGEEOcbbRyFEEIIIYQQQixFG0chhBBCCCGEEEvRxlEIIYQQQgghxFK0cRRCCCGEEEIIsRRtHIUQQgghhBBCLOXzauMYQvhoCOEtnz8SQvhICCGGED781kslxNuHYlxcZhTf4rKjGBeXHcX4xebCbRxPguTRf/MQwt0Qwr8LIfxACOEbQwj5Gsv20bdw/fUQwveGED4WQpiGEHZDCD8ZQviv38ZiinPOZY3xEMKXhRD+3yGE10IIdQjhpRDC94cQnnmbiynOMZcxvkMIXxRC+BMhhL8fQvjMI89WfA6KKc45ly3Gw4JvCCH8+RDCT4UQHoYQZiGEj4cQ/kwI4dbnqLjinHLZYvyR6x737/d+Dop8oQgxvuVN/xPlkU8p/sTJ39zMdszsS8zsa82sMrOfMLPfHWP8RXftO81sHGP82Fssw3Uzu25mn4kxHruy/fMY44ffxD0/aGb/xMyumdmPmtlPm9nQzN5jZr8yxvjut1JmcXG4jDEeQvjNZvZDZlaa2Y+Y2S+a2QfM7Lea2V0z+9oY4yffSpnFxeCSxve3m9mfNrPOzD5hZu+yxfhdxhjbt1JWcfG4bDEeQhia2dTMajP7cVusT3Iz+/Vm9qVmdsfM/r0Y4yfeSpnFxeGyxfjJdR855X9tmNkfMbPWzN4RY3ztTRX4knBhN44xxkD+3y0z+/Nm9jvN7CUz+1UxxtefcNneTLBeMbOftUVwfkOM8V+6/1/GGJu3raDiXHPZYvxk0fG8md02s2+OMf7gI//vd5rZf3/We4qLy2WL75PrPmCLRdPPxBinIYQXzOw508bx85LLFuMhhNLM/q9m9t/GGB8+kp6Z2X9rZt9mZv8wxvjb3ubiinPKZYvxx9zv28zsL5nZD8UYf8fbcc+LzIX7qeoyYox3zOxbzOyjZvYOM/ujj/7/cMrvqkMIg7D4rfSnT75ufz6E8F0n6fCVd3C/qw4h/IFH7vv17mvtj6xQ9D9sZs+Y2R/zm8aT59KmUZjZhY3xX2uLTeNPPLppPHme/4+Z/duTe/7KlSpBXFouaHxbjPHjMcZ/FWOcnv2pxecTFzHGY4xNjPG7H900nqT3ZvYnT15+eKUKEJeeixjjj+EPnvz9y2/hHpeGS6e/iDH2IYTvssUg9q0hhD8cl3ytGkIIZvb3zOy32OInRn/BFj+n+wO2+Mp9FX7KFl/Xf6eZvWhmf/2R//fRFa7/Xbb4idPfCiF8sZn9+2Y2NrNPmdk/jjEerlgO8XnABYzx2yd/P33K//+0mX2lLeL+Z1csj7ikXMD4FuJMXLIYr0/+6pt18UtclhgPIXyFmX2Fmb1gZv/Dm7nHZePSbRxP+Be2GMRu2kJr8vySvL/HFoH6P5nZb4gx1mZmIYQ/bmbw7R8jxvhTZvZTIYTvNLMXYowfWbWgYfEz1ffaQvP1ETP7djN79Kv/+yGE3xdj/Eer3lN8XnBhYtzM7p38PU2n+56Tv194hnuKy81Fim8h3gyXJcb/o5O///htup+4PFyGGP+2k7/ff/IN++c9l+qnqm8QY5yb2f2Tlzcek/33n/z9jjcC9eQeu2b2p97+0gE3T/6+18z+kJn957b4huYpM/vPzGzbzP5eCOGLnkBZxAXhgsX4/2xmD83sq0II3/To/wgh/A5bfNtoZnblCZRFXAAuWHwLcWYuQ4yHEL7KFt/uHJjZd6yrHOJ8ctFjPISwYWbfaovN719dRxnOI5dy43jCG9/aPc7954Nm1pvZ/0L+3794W0vEyR/5+2djjN8bY7wTY3wtxvh9ZvbnbOHO9+1PoCziYnEhYjzGeGSLD0V6M/vBEMIPhxD+mxDCD5vZ/9fMfuYka/e5Lou4UFyI+BbiLXBhYzyE8AW2cMguzez3xBg/tY5yiHPPhY1xW2waN83sH3y+O6k+yqXcOIaFi+PVk5d3H5N928wenOJ8d+dtLRjnUbH5D5H//0baVz+BsogLwgWLcYsx/j/N7NfZ4udMX2dm/4mZvd8WG8q/dJLtibmuifPNRYtvIc7KRY7xEML7zeyf2aL83xJj/AdPugzi/HORY/yEN0xx/rs1vf+55LJqHD9ki2e7E2N84TF5983sagihIAH7OT/UNsb4aghh38y2zGyXZHljYzn6XJdFXCguTIy/QYzxx21xBlhCCOFvnPznv3lSZRHnngsX30KckQsZ4yeymR+zxZnTvzPG+Pef5PuLC8WFjHEzsxDCl5vZr7KFLvNHn/T7n2cu3TeOYXGu0B87efl3VrjkJ21RD7+W/L8PnfHte/vln56ehX968vdXkP/3RtoLb+K+4hJyQWOcEkK4Zmb/W1toZH7k7bqvuLhcpvgWgnFRY/zkyKSP2uJbpG/WplGcxkWN8Ud4wxTnB5a5wX4+cqk2jiGEm2b2d21h//sZM/uvVrjsb578/a4QQvXIvbbN7L88YxHu2+LMmrPyF0/+fkcIYeeRMuw8Uoa/+ybuKy4ZFzXGQwibJG3DzP62LTQEfzLGuH/W+4rLxUWNbyFW5aLG+Mk3MP/MFuP1N8UY/+FZ7yE+P7ioMf7Ie05scUyeTHEIF/anqo8c5pmZ2Y4tznn5kJlVZvavzex3xxjv0YtT/qYtDir9BjP7uRDCP7CF2PubzewnzOwDtvj0YhV+zMy+JYTwI7Y41Lw1sx8/+YneqcQY/8cQwp+3hd7r506uNzP7rWb2rJn9sP1ypxKfJ1ymGDez3x9C+CO2+LT6VVs4rP02W/wE5fvN7P++4vuLS8Jliu8QwnUz+75Hkq6f/P0rjxxI/T0xxo+tWA5xCbgsMX5ybNiP2eKbxh8zs68JIXwNyfpnTlwwxecJlyXGHd9iC/nYD8oUhxBjvFD/bOHM9Oi/uS3Oifu3tliAfoOZZadc+9HFI0P60Mz+pC1+yzy3xc9Cv9vMnjl5jx92+T9ykv5hl37TFl/J37GFQ2Q0s4+c4dl+ny3Oqzk0s6ktvrr/Q2aWr7ve9e/J/buMMW5mv8bM/pEtNo21LT4R/Me2+OR67XWuf0/u3yWN73eR5/L/Pvy4++jf5fh32WJ8xfiOZvaudde9/j2Zf5ctxt31/+rkmt+07no+j//CSSUJQgjhP7CFKPZ7Yoz/xbrLI8TbjWJcXGYU3+KyoxgXlx3F+PniUmkc3ywhhKdJ2jUz+56Tl+yYDCEuDIpxcZlRfIvLjmJcXHYU4xeDM33jmGVZzAsviww079lynC2nzxXIdYHdit4+WN3UFmNvWcjMQrAYe+v7xU+p8zy3sixXKtdqpeVlY8/goS21avu5N129TVYsB83nc+KV7Lmn0+m9GOONs5fsrbG1vRNv3rr92HxQ5rdQmavV5Vv4VcDJpXdefcXm87kNRyPL89zatrHjoyPr+962trbtOjw3ec+3XoxfhtQZG4u6roO0tsW0rkulD31EKQSLtSxD47U8R+l3luG1vrhvjBlpufBIqtdf+cxa4tvMrCyLOBxWSVrbYrl9HfekbQIZyFYNkbcy/iDR+q5f/ITmpEzR4i8XJphlWQbjLis/nUtWLK2PXz40szp7cx3rrfxaiM6PK81Vq71n23Zri/HhYBw3xjtJ2mRjDPkmm2laNSCWD6yeyNhySoW+ffTRXnzxRZtOpzaZTCzPc2uaxg4ODqzrOrt69ao988yz1veu35IxifXlLMPvEHKWlqfjJR0XSfFZqLL+h9fhhWxsZ2/K5g42Hvuxbj6
2021-03-30 00:07:48 -07:00
"text/plain": [
"<Figure size 1152x1152 with 10 Axes>"
]
},
"metadata": {
2021-04-01 03:16:00 -07:00
"needs_background": "light"
2021-03-30 00:07:48 -07:00
},
"output_type": "display_data"
}
],
"source": [
"plot_random_images(scaled_train_images,train_labels,2,5)"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 11,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {},
"colab_type": "code",
"id": "UXYwWhHpz_GD"
},
"outputs": [],
"source": [
"grayscale_train_images = np.mean(scaled_train_images, axis= 3)\n",
"grayscale_train_images = grayscale_train_images[...,np.newaxis]\n",
"\n",
"grayscale_test_images = np.mean(scaled_test_images, axis= 3)\n",
"grayscale_test_images = grayscale_test_images[...,np.newaxis]\n"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 7,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 406
},
"colab_type": "code",
"id": "CGHZvq4zz_GK",
"outputId": "2d7f65e0-f983-4b95-f2dd-1cb6594237be"
},
"outputs": [
{
2021-04-01 03:16:00 -07:00
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAA44AAAGFCAYAAACyr61+AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAACkOElEQVR4nO39eZhsSXrWCX52zvE9PLYbcffcMyszqyprU6mKkqpUpY0ubYAkBAJpBs3QzcAz042AgQEaUAmJhu7RIGho6B6JQaNGgAa0S0hCW1WpVCqpVtWSlXvezLvfWG5EeLiHux8/x+aPuCXS7H2vx7lL3ogb+f6e5z75+Jd2zrFj9tlnZuH+vea89yaEEEIIIYQQQlyPZL8rIIQQQgghhBDiYKONoxBCCCGEEEKIqWjjKIQQQgghhBBiKto4CiGEEEIIIYSYijaOQgghhBBCCCGmoo2jEEIIIYQQQoipvKY2js65Dzrnbvn8EefcB5xz3jn3vluvlRC3D/m4OMzIv8VhRz4uDjvy8bubu27jeM1JXvlv5Jxbcc59yjn3o865b3DOpftYtw/exHWPO+e+3zn3c865l1/xbtmrUE1xwJGPi8PMIfXvP+Gc+0nn3FPOuavOuR3n3LPOuX/nnHv7q1BVcYA5pD6uGC7+EPn4axfn/S1v+u8or/grxfdf+29qZvNm9gYz+0ozq5vZJ8zsu7z3z0TX3mtmbe/9U7dYhyUzWzKzl733g6huH/Lev+8G7/e9ZvbDZlaY2bNmdr+ZNc2s5r2f3Epdxd2HfFwcZg6pf/9rM3uvmX3czC6Y2djMHjazb7Ld9/kL3vsfvZU6i7uHQ+rj32uK4eIa8vHXLnftxtF778j/O2Zm/8zMvsPMzprZ2733V+5w3W7GWR+13QH3We/9jnPujJndZ3LW1yTycXGYOaT+3fTeD4n9CdvdTA7N7Kj3fnxbKioONIfUxxXDxR8iH3/tctf9VHUa3vvLZvadZvZBM7vHzP72K/+/u87vqp1zDbf7W+kXrn3d/qJz7gev2eErbxf9rto59z2vuO97o6/vP1Ch3k9773/Pe79z428tXkvIx8Vh5i72b9g0XrN/zsy+aGZzZra8133E4ecu9nHFcFEJ+fjh5tD9btd7XzrnftDM3mdmf8Y591f8lK9VnXPOzH7Kdn9S9KyZ/XMzq5nZ99juV+5V+Iztfl3/fWb2kpn92Cv+3wdvpP5C7IV8XBxmDpN/O+deZ2aPmtmqmV282fuIw8Vh8nEhGPLxw8uh2zhe4yNmNjGzo7b7G+UXp5T9btt11N82s6/70k+JnHN/z8w+VuVh3vvPmNlnnHPfZ2ZnvPcfuNmKC1ER+bg4zNyV/u2c+zoze7ft5vc8YGbfcu1//dfe+/Jm7ikOLXeljwtxA8jHDyGH6qeqX8J7PzKztWsf9/p50J+79t+/88r8E+/9hpn9wO2vnRC3jnxcHGbuYv/+Otv9a/ffst2favXM7Fu99z93h+shDjh3sY8LUQn5+OHkUG4cr/GlhN291H/eamalmX2U/L+P3NYaCXF7kY+Lw8xd59/e+795TSxixszeZma/aWa/7Jz77+9kPcRdw13n40LcIPLxQ8ah3Dg655pmtnjt48oexefMbP06ikmXb2vFhLhNyMfFYeZu92/vfd97/2nv/XeZ2a+a2Q845758P+oiDiZ3u48LsRfy8cPJodw42m6OSWZml733Z/You2Vmi44f8HnsdldMiNuEfFwcZg6Tf/+K7f7V/b37XRFxoDhMPi4EQz5+CDl0G0fnXGJmX/pZ0L+tcMmnbbcdvoL8v3ff4ONL2z0EVYhXDfm4OMwcQv8+de2/OgdMmNmh9HEhAuTjh5dDtXF0zh01s39vu/K/L5vZ/1Dhsh+/9t8fdM7VX3GvOTP7uzdYhTXbPbNGiFcF+bg4zNyN/n3tjDG22LFrP0/9i7a7kPmVG6yLOITcjT4uxI0gHz/c3LXHcbziMM/EzOZt95yXL8mg/76ZfZf3frXCrX7cdtXv3m9mn3fO/bztnh3z7Wb2Cds9g6uqjPpvmNl3Oud+wcw+abt/Yf6w9/7De7zLkpn90CtMS9f++69ecZjpP/LeP1WxHuIQIB8Xh5lD5N8tM/sd59xTZvYpMztnZm0ze9zMvuZamb8u337tcYh8XDFcUOTjr0G893fVP9tVZnrlv5HtHq78STP7Edt1uuQ6135w95XB3jSzv2+7Z8yMzOyMmf0D2/2JkTezn43Kf+Ca/X2R/ajtfiV/2cyKa2U+UOGd7ifvFf9731730b/D8U8+rn+H+d9h82/bXdz8XTP7ddvdNA7NbMfMnrPdxdA797vN9e/O/jtsPn7tOsVw/XulP8jHX6P/3LXGEgTn3Neb2X+23b8w/K39ro8Qtxv5uDjMyL/FYUc+Lg478vGDxaHKcbxZnHMnie2Imf2jax9/5s7WSIjbi3xcHGbk3+KwIx8Xhx35+N3BDX3jWE+avpV0QyO53vvoZ8jkES4he9bEoS3FNExfC6/1Dq/zRE/Js/s7s1FvzcoitySrm3OpeV9YMR6a+dKyZsfqMwt7nlz6pXtVsXlW7mZhbcsqG9mqVoG+N3sn9icId+NlzMxG58+teu+X967d7SWd6fjsyEJoJHV2SdyY2EqtLAdbluDP81k/pC4sl5BeSFy1e32J1bM7lg9La7RTSzJnRV7acHtiZWHWWajZ3Il2dC98JhlmxjyEFUui1ISEtBm7bkKcpiCd4isMqqqRrqz497QyemZv3MAyJdZr/OKFffFvM7O00/HZ4mJoZKF4PP2zGR/PRRtbudsegm0h6wefm66a4CjrmcQ5O/PSxHaG3jptZ1nmLM/NtnqlFYXZkcXE7j19e9P5eajf2wdL4oXMVsVXSzL3FqQOacUxSm3RoE9IKXbdpz473jcfn19M/fGov+OxykhJTMpISlXCA+GesP6asFhGrvXe2cWzuY2G3potZ+k1Hx9sF1YWZrMLqS2fqkNsnJCFEI2pxMbqUdJJPKSTjsBWJ+M7pW0bPpXNQwxPvJBdydpj7LOoDGsLvP+lJzf2zcfnFjN/7FQtsDm68Auh8zopx8ZLlZ5g7VS1Hmb2hz7euubjk9xbf7u85uOJHTtVg2fE66XrEfezGV9bxXVj6w3Gza6p2dqFvRMbL6zP+TvtXaYkb/Dk53Lq4zc0m7aSrr1r9o8HNj/GBbIfh6sMX5KXa+Iiy7Vb+NDFeTBNlsPNa9HEYJB3ia2NDlBmztbPfMZWnv6o7WxctmI8MJdm1lm6x4687h125NF3mnMOF0nES0qyWS1rWLCsYbkK8djY+HAF2tIRae8oblcca7ReJfGaooXvOWnGZYizkns9/7f+2kvVand7yY4s2PG//ZcDm2thA2eNsDGzGpZ54/GLYFuoD8DWiDvGzGazcKHdJqv2Npmc2QLxS3z6ly/b7/zkObv0XN8GG7lljcTueeOcvePbTto7/+RJ65fh2KsRx2I2toFl5TpJWN+mw7jBrlsrZsC2WWCcyCNHYkGQLY4Yg7K+dyEz2ynCgfyhcw9Dmf4A49yLf+bv7It/m5lli4t26q9+b2ArG+g3nZfDYDZzFvs572Abr70N+/Br3vYk2L5t6RPB59fXqmgnmDVJ3G0nqf3Mzw/sX/943556ZmJXN0prNpy97c11+z9854x9z5/twAboVqk5DPbMFjPy6Pe9Esd3lfDcJ/PqJplcugkba3g/Mi1Z04VjpkGOWGO2+skX9s3Hj5/O7Ed+/nRgG3r2diHdBP/AsZxgnO2wP0BXgPXXOok1Q7LAzX1mH/ylnv38T2zYS8+OrbdZWK2e2MNPtO1r/+SCff2fXjTnnPWiOH45n8NnTjpg24ona+ObrK0cy8W8a/55sN1TWwPbLGnvuA/YnMb+6JiT2J6T+l8pumB7aRyui1n7jMhC5X98y0/vm48fO1Wz//nnHghsTTLOY+pWbQ4flDhvsT9KxeTEd9l1bP43M/vQL23ZL/7Ehp255uP1RmKPvqlp/9V3zNk3/Ok5c87BM7rJzp71MjM7P1kAW52uc8I1WZ+0BWPa+uuVxO0xJDF7NsWxMZ/
"image/svg+xml": [
"<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"no\"?>\r\n",
"<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\r\n",
" \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\r\n",
"<!-- Created with matplotlib (https://matplotlib.org/) -->\r\n",
"<svg height=\"390.146928pt\" version=\"1.1\" viewBox=\"0 0 910.7 390.146928\" width=\"910.7pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\r\n",
" <metadata>\r\n",
" <rdf:RDF xmlns:cc=\"http://creativecommons.org/ns#\" xmlns:dc=\"http://purl.org/dc/elements/1.1/\" xmlns:rdf=\"http://www.w3.org/1999/02/22-rdf-syntax-ns#\">\r\n",
" <cc:Work>\r\n",
" <dc:type rdf:resource=\"http://purl.org/dc/dcmitype/StillImage\"/>\r\n",
" <dc:date>2021-03-31T21:00:35.034111</dc:date>\r\n",
" <dc:format>image/svg+xml</dc:format>\r\n",
" <dc:creator>\r\n",
" <cc:Agent>\r\n",
" <dc:title>Matplotlib v3.3.4, https://matplotlib.org/</dc:title>\r\n",
" </cc:Agent>\r\n",
" </dc:creator>\r\n",
" </cc:Work>\r\n",
" </rdf:RDF>\r\n",
" </metadata>\r\n",
" <defs>\r\n",
" <style type=\"text/css\">*{stroke-linecap:butt;stroke-linejoin:round;}</style>\r\n",
" </defs>\r\n",
" <g id=\"figure_1\">\r\n",
" <g id=\"patch_1\">\r\n",
" <path d=\"M 0 390.146928 \r\n",
"L 910.7 390.146928 \r\n",
"L 910.7 0 \r\n",
"L 0 0 \r\n",
"z\r\n",
"\" style=\"fill:none;\"/>\r\n",
" </g>\r\n",
" <g id=\"axes_1\">\r\n",
" <g id=\"patch_2\">\r\n",
" <path d=\"M 10.7 178.733082 \r\n",
"L 164.631034 178.733082 \r\n",
"L 164.631034 24.802047 \r\n",
"L 10.7 24.802047 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#p48f6c38c3c)\">\r\n",
" <image height=\"154\" id=\"image5ed51843f1\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"10.7\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAMJ0lEQVR4nO2dSW8kxxGFs6uqFzaX2aUZWYsFWxcbMHTxzYAPBnz1b/B/NaCLAcOAD4Yw1q6RNINZOM0hu1mbDz5Vvm+sNMkJCsb7bp3IqsyuDhYjIl9Gzv549Ocx5fS9NI1Z22w2kz6z/bW2LRZ6r5uH0tbd3p98bg8a6dMe1nrdSucxNNA2lyZlKOiTUhp1ainpU0yzrG3UaUmf192r5P54HYBj0pA038JnlFNd7DJj/jdsaCYEG5oJwYZmQmhmtdpa7vgXMxR6mcBYged5wevG0j+fkunCtMhJpj/ZIQuYZiMMCM51scOd3a40sCgOBjT2wudRMqbfaCYEG5oJwYZmQrChmRAox50SZP0vTAW2TPfPu11iDuislwBTLQ0sxhqCkrxpoMiizHOelcRn5PhTsEFj0rUUaGVNGFgU/LzGvBFsaCYEG5oJgX20iwLJ32IyX2J2ieRvMRdMPpI/NlByM3sc6M70oIIBf6wCvyrvh/4YPMeqg4kAA1hH7pORj4Zjlg1pzOWwoZkQbGgmBBuaCaEZW/UMxw7a8n6QzJudtzrC3p62gWPbvNxOb79TT7Rf6L36ud5rhGTvoIpyoYLpkwffqhIdE7v9MrvuAL73tiwYmG+03/qHqfdft2WJ2Pq8rN8IyfZhPp1H1emF9c7BgLkmbGgmBBuaCcGGZkLglQGScg/TtjFBKpzk2KUS7f6CKwGFt0dFR9ZG2X3KtpPjv7ul829vTZ9ZdaDRxu5Yo5RZSyoPHbQ7nv1Yl1RDgFO0xzWl1C91HnmAU50XrmyUDWnM5bChmRBsaCYEG5oJ4WplQpchk96MJDkq3GNJTjG2ZWNWkB7HrZjw1Np7uppy/91nk8+3VmfS54u929K2faUBQtsutS0PBk51XpTyp5WT4v2reR94FlR4x280E4INzYRgQzMh2NBMCNcTDIAzSpKUi4J7MQuCBqoUSdeR5Ojo3om0/eHBp5PPh/VW+qT0kbR809yQtpMTTef3q+lSRkO3LwyWqB/JifIAigKjBM/HbzQTgg3NhGBDMyHY0EwIP52VgdzkQV5Ezjpt5iX42v/+OSV2nAfYp/DWoQYDv1l/Nfm8mqlm59O9t6Xtu5dHMBFtyiVMtOehPtc2grL5PTj150dZMACSI8uEzLVhQzMh2NBMCA0WyrsOCgrvUQE5Kigyg4J3VIzkKsvIzCt1TO7UU79tDs5LBRPrBv1NSN5dUuSF5Cfk1+YS7ZTUH/tPW34v2NcJe1V/IlZm/t+xoZkQbGgmBBuaCeE1VbnfsP2hlDiTJVNsUHq2JQ0J+0arVDBm4b7RAS7us2wvJWw7yAj3PQQDVJW7YF8qJaopObu7AY7/DdqrOo04xrlGILNO5+83mgnBhmZCsKGZEGxoJoRy9UZ+9iQVb7lEECG+dOERPVx+HNrwiJu8lnnZ2Z90/xY88e04lTbsp5306SmIgGCAyIfsV9qHzjNtDyAYuAuO/019aAdvT1c7SLXSwAPyG82EYEMzIdjQTAg2NBMCBwMjlTm8OlENFRkZm8zmC51wcvJr1D2TNFxmUTQmVTncdj8eV61mWgimgyACj9NESXn2GVYBsCANlK8nx//ee8+l7fcPHk4+//bgM+mTy6NS8hvNBGFDMyHY0EwINjQTAnuwNehNqCR8CZThp72YIhOi6iRwGe0ZgGz7WBVUPqTq9bRHEfZPtr0+szYrh9jCxtEBBh1ozwDFZ9ntsKw7fKd+Bc9sTwOV9480GPh4f7pX9deL76XPivZGwNSMuXJsaCYEG5oJoZlB9eur3O+YOv1/PevU4chVBqQ6QFl1oeKC7ifKjwsmSlNKaV7r96wzx2oNzt1by420NY3eqwO/M3eF8HtT1ey1ftE7dzTJ+rvbD6XtF/PHk89b8Du/7bR2iN9oJgQbmgnBhmZCsKGZEJo0h/Miz9VpHXOZNsm2QfUxtpTd1OSgTgJuX1ooj/LN4MDnydjSsznbQ3WmDxcq0z6spkfyvAMBw6/Wj6Ttk/WH0vY8HUhbnQ1JsnY42ScNhzqPj+99K21/OviHtM2z3+Wvu/vS55OTX0qb32gmBBuaCcGGZkKwoZkQGpRtl0CZe1J9EJDNz1UYVJSFZNtY5ZCmQUftZP1QMFIYgBwt9Hycd+pp1v9GpRsv15UGEQ0EDYnUJ/lqil7F9PpFN51GDSUFz592GqR8eapnkPqNZkKwoZkQbGgmBBuaCaG50uqOJPduQKdCZdzb6bV4pCQECLzftEwGLkf0wFR7OrpmX1c2Dht16nfZAM8HDRh+6PRszlc7Xa2hvaTN6fQzydqrDio5nujT/f6VSnsedXvSdq+ernbsQzBzd/FK5yEtxrwBbGgmBBuaCcGGZkK4nvM6BygZ3mdlxWEvAxZ5KUyHk6M/ZJoXkhd1UEUxrXQid5equT/M9ghsYa6ncAjTSPsD4LvXbXbDgr2fKaVUwblSGwhAHvdaDSbf90DnW+1DYOQ3mgnBhmZCsKGZEC7uo0Fy8FLk/kXh0TilkoUBpAi5T0b7NanSdbVQv+TD5RNp+3mznnw+GdV3WcFez0WjCeEt+ZgF6hMqxEdHEZFfuBk0YZvv4+wLfyi/0UwINjQTgg3NhGBDMyFwMAAJVZF8V3ApKEFmVISlaGpllCZsS/aJclJXB1iu1IG/3WjCts6exwbULaeDJkqpEB8WcJEAB+TeJEWnfa8w5ot+LW2nwzTBvICE7bsLLeDnN5oJwYZmQrChmRBsaCYEDgaqAvsj2TYVeSHZNq0q5ENSEEEOPWq+y9rya0urO+4tz7UfXPy4n0qaH7Yql/7qTPdAnm41QKh1yFTvsr2wEMNBrIGVxttOI4Qvtnel7X5zPPl8s1bZ9gcLXSXxG82EYEMzIdjQTAg2NBPC1Uq5C6VDWNq9JAAhh75UTlQAZ9/1Oy2gPHsPf7NPs2IqX7TqXD96pfs6253+LEuQX1fdxdZYSq+iI4W24zQ6etHvS58nnUrA/UYzIdjQTAg2NBOCDc2EUC4Tukog6z/MpzY/wkH0eCvybKmt5CsVrijUMGgPUclppjsiJ/l4p5sSxnOQWxUcl0r7UnHPAEmf5rpPYV3BckTG162ubPx98560+Y1mQrChmRBsaCYEG5oJ4c0XeSE5EZEFCLR6cJm2q/yTokNgcy19Sin9q703+fzPkwfS59mxZtarE/1ZskKLKaWUmrOpU08rG/0SVhR22vbqTPVEJ1CAJl8toNWDXa/z9xvNhGBDMyHY0EwITRroOBiwv2yP4ghKjRH8sVkCLTSQF+LDv4HCIiZUmKXkYHvaw0ljfvndHWn7y/5H0vb+3rPJ5882el17ps9neayTXWxAEp819flhmimlTrdmpmGp96LjeHbwcD/fTf3Op+d6RM/LVn8Av9FMCDY0E4INzYRgQzMhcMKWztPMz4Yk2TYlZ+kIoIIjemZLqk6iTQTKu8nPH/LP8L21nktKTzW5+bf9n0nb5/tTZcOT5yBxPtafYL6RplTr6T7yPSkwon2dFPRU8N2PW634eJ4Ncnyujn8HBWP8RjMh2NBMCDY0E4INzYRQXORFnH8o6FIKFXmRszjhbE4+j1LvX2uV9cTRQK4YgatIEbFQx/nsG3X0z2bTrHl9pjdbHcM5nKDUIMm6FKkpDILoiJ4O9pJ+vbkpbYcLfLjTIWEifqOZEGxoJgQbmgnBhmZCKN7XqSsDV2yj3XRMCQ7Sa87rhH41ZfNB7zPLVihGrDIJ18ECyPIFOMA4j6wPbJ2s8nM4U2FQAn0wWDol+bvKlZ6sVAJ0tp72O1ppcLCe65fyG82EYEMzIdjQTAg2NBPCm9/XCeBezPlUFjQ2sDpRWISFqCBoGDJpDDnvDchzcJsFJMzz+9EZTLgPArT/tDRQUviFVkkWG6oeqW3bPZUAveyzg2EhKOxWlgmZa8KGZkKwoZkQ2EcDqXURJZW1U+LjdwoK8VHbABsS8agd6Je7PVTlGgv9keQb+snxPpfwMVEsk41Jc6jOybcrSy4PjTqVXaZAeblWE9qsVALuN5oJwYZmQrChmRBsaCa
" </g>\r\n",
" <g id=\"patch_3\">\r\n",
" <path d=\"M 10.7 178.733082 \r\n",
"L 10.7 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_4\">\r\n",
" <path d=\"M 164.631034 178.733082 \r\n",
"L 164.631034 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_5\">\r\n",
" <path d=\"M 10.7 178.733082 \r\n",
"L 164.631034 178.733082 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_6\">\r\n",
" <path d=\"M 10.7 24.802047 \r\n",
"L 164.631034 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_1\">\r\n",
" <!-- Digit 1 -->\r\n",
" <g transform=\"translate(41.967241 22.396875)scale(0.2 -0.2)\">\r\n",
" <defs>\r\n",
" <path d=\"M 19.671875 64.796875 \r\n",
"L 19.671875 8.109375 \r\n",
"L 31.59375 8.109375 \r\n",
"Q 46.6875 8.109375 53.6875 14.9375 \r\n",
"Q 60.6875 21.78125 60.6875 36.53125 \r\n",
"Q 60.6875 51.171875 53.6875 57.984375 \r\n",
"Q 46.6875 64.796875 31.59375 64.796875 \r\n",
"z\r\n",
"M 9.8125 72.90625 \r\n",
"L 30.078125 72.90625 \r\n",
"Q 51.265625 72.90625 61.171875 64.09375 \r\n",
"Q 71.09375 55.28125 71.09375 36.53125 \r\n",
"Q 71.09375 17.671875 61.125 8.828125 \r\n",
"Q 51.171875 0 30.078125 0 \r\n",
"L 9.8125 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-68\"/>\r\n",
" <path d=\"M 9.421875 54.6875 \r\n",
"L 18.40625 54.6875 \r\n",
"L 18.40625 0 \r\n",
"L 9.421875 0 \r\n",
"z\r\n",
"M 9.421875 75.984375 \r\n",
"L 18.40625 75.984375 \r\n",
"L 18.40625 64.59375 \r\n",
"L 9.421875 64.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-105\"/>\r\n",
" <path d=\"M 45.40625 27.984375 \r\n",
"Q 45.40625 37.75 41.375 43.109375 \r\n",
"Q 37.359375 48.484375 30.078125 48.484375 \r\n",
"Q 22.859375 48.484375 18.828125 43.109375 \r\n",
"Q 14.796875 37.75 14.796875 27.984375 \r\n",
"Q 14.796875 18.265625 18.828125 12.890625 \r\n",
"Q 22.859375 7.515625 30.078125 7.515625 \r\n",
"Q 37.359375 7.515625 41.375 12.890625 \r\n",
"Q 45.40625 18.265625 45.40625 27.984375 \r\n",
"z\r\n",
"M 54.390625 6.78125 \r\n",
"Q 54.390625 -7.171875 48.1875 -13.984375 \r\n",
"Q 42 -20.796875 29.203125 -20.796875 \r\n",
"Q 24.46875 -20.796875 20.265625 -20.09375 \r\n",
"Q 16.0625 -19.390625 12.109375 -17.921875 \r\n",
"L 12.109375 -9.1875 \r\n",
"Q 16.0625 -11.328125 19.921875 -12.34375 \r\n",
"Q 23.78125 -13.375 27.78125 -13.375 \r\n",
"Q 36.625 -13.375 41.015625 -8.765625 \r\n",
"Q 45.40625 -4.15625 45.40625 5.171875 \r\n",
"L 45.40625 9.625 \r\n",
"Q 42.625 4.78125 38.28125 2.390625 \r\n",
"Q 33.9375 0 27.875 0 \r\n",
"Q 17.828125 0 11.671875 7.65625 \r\n",
"Q 5.515625 15.328125 5.515625 27.984375 \r\n",
"Q 5.515625 40.671875 11.671875 48.328125 \r\n",
"Q 17.828125 56 27.875 56 \r\n",
"Q 33.9375 56 38.28125 53.609375 \r\n",
"Q 42.625 51.21875 45.40625 46.390625 \r\n",
"L 45.40625 54.6875 \r\n",
"L 54.390625 54.6875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-103\"/>\r\n",
" <path d=\"M 18.3125 70.21875 \r\n",
"L 18.3125 54.6875 \r\n",
"L 36.8125 54.6875 \r\n",
"L 36.8125 47.703125 \r\n",
"L 18.3125 47.703125 \r\n",
"L 18.3125 18.015625 \r\n",
"Q 18.3125 11.328125 20.140625 9.421875 \r\n",
"Q 21.96875 7.515625 27.59375 7.515625 \r\n",
"L 36.8125 7.515625 \r\n",
"L 36.8125 0 \r\n",
"L 27.59375 0 \r\n",
"Q 17.1875 0 13.234375 3.875 \r\n",
"Q 9.28125 7.765625 9.28125 18.015625 \r\n",
"L 9.28125 47.703125 \r\n",
"L 2.6875 47.703125 \r\n",
"L 2.6875 54.6875 \r\n",
"L 9.28125 54.6875 \r\n",
"L 9.28125 70.21875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-116\"/>\r\n",
" <path id=\"DejaVuSans-32\"/>\r\n",
" <path d=\"M 12.40625 8.296875 \r\n",
"L 28.515625 8.296875 \r\n",
"L 28.515625 63.921875 \r\n",
"L 10.984375 60.40625 \r\n",
"L 10.984375 69.390625 \r\n",
"L 28.421875 72.90625 \r\n",
"L 38.28125 72.90625 \r\n",
"L 38.28125 8.296875 \r\n",
"L 54.390625 8.296875 \r\n",
"L 54.390625 0 \r\n",
"L 12.40625 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-49\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-49\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_2\">\r\n",
" <g id=\"patch_7\">\r\n",
" <path d=\"M 195.417241 178.733082 \r\n",
"L 349.348276 178.733082 \r\n",
"L 349.348276 24.802047 \r\n",
"L 195.417241 24.802047 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#p938aaf3316)\">\r\n",
" <image height=\"154\" id=\"image5bd05d35a8\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"195.417241\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAOdklEQVR4nO2dyXIcWRWGb441aSiVppIt04Z2u2emVQcBbNiy5RmI4FF4Ap6ALcGugwAamg1smqAHuttD2+1BlqzBkkqlGjOTBat7/x+cIbuPNv+3yxNZWTezjlLn3Pufc6Pf3flu5QKSqAxNQOLgY5TY4bXY9eteD65fY6zOOdeMZmDrxlPv+Khowjm3pptge//wXbD9/c63wZY8aXjHZY73WK1NwfbLH/wNbD9f/BhsWXDvRRXBOSdlA2ztGJ/FlaQAW+LweiEz8rsNSrTFz72SEC8BOZowQY4mTJCjCRPSi35wWiVgyyMSUJJgvajQv2eBz7Mkgl2fkbt654UMqxxse/NlsN05XgNb9gCD7sX7/nGZY3A9OsUE5IPtm2C70dgD2/XsAGwhBQnoS5I0sJSqJIH+YeF/9kaG48/cBGx6owkT5GjCBDmaMEGOJkxI66wC1IUlCHWThjD4L8nfQMFCVpJYDB1+Z1JhYNsMxjEoW3DOvdE62PafLoFt9QEOrffFyDuet8i4xpiAfPl1H2x/WnwLbD9d+tI77qcncA57/p0EVwYykjQclfi8v5qvesd59PyExDm90YQRcjRhghxNmJCOS4wRmjEqCr5pwpiMTTS6CueXE6LKYEoQpvI4LzPv+LhowzmPzrt4/aMMbAs7c7Bl9596x+nyApxT5jghfPoIf5N/rH0LbFcax95xNzmHc9oxTp72SIzWiPA79wuM7z4dXfu/x845t5YOwKY3mjBBjiZMkKMJE+RowoTa6o0sUEQUL+CjbBIRkgEyEdshge2LMA0mdlkyMJxhkJyMMVHJjzCBKvb8ZCAenME5WQ+/s72HycYRmSS+t+6rSN5s7sA53RgThOUYn38jQlcYVjiOh+Oed3z7FCe0X13CSVy90YQJcjRhghxNmCBHEyakMxKYO7JaMA6O2cw9C9br12sGyUb0/JpC55wbk4CVXp3Ilx/P/MB2UuK14oiMn4hIogKNUStQg1zFGtHhNkqhp4t4fRfjODqp/7yvps/gnF4S/nLO7czxWQwqVNT84fSHYPvLwxve8ehrHOydaBtseqMJE+RowgQ5mjBBjiZMoCsDNEEIYCsDRYXyk06MwWidlYEZkQSNyWpBFqE8h8GuFwb/Wc260agkdZE53lPa9SVAk00MnId9vKfRNo5jfeMUbNebh/45yQjOyUhOtU+SnvszrFW9N1wF23C34x2vfkZWSc7U5EVcEnI0YYIcTZggRxMmXLjJS11okxHi3yxBCKGdImvWpSYRynjWUz/APiV1nbVJ8D6rRV8CNFrHIPx8CwPnrVf3wfbjza/A9lbzsXfcIIH/i1TtnkzweWQn/u+09i+UPsUnKE3SG02YIEcTJsjRhAlyNGFC/ZqBYNacdWRksBl5RhjUl2QV4GUDTVHqLTK4un1x5st+MH22jQlPfB2D6V9c+whs77Xugi1cCciJtCrs0OhcfenWaI7JS3rmXy9+gJ0ow1oJ5/RGE0bI0YQJcjRhQu0YLVR0MPUG+9/PJmfrbNtTZwLXOV7/yWAqj24Q45zGKKuuS5HhOMq2/3hHG/h83tl6AraftG+B7ZUUlTFljS10EiJFb5NnsURUNu0MJ7nDkDvKMI6LUnQrvdGECXI0YYIcTZggRxMmpHXrIkNYEJ7E9WYyw+Yqzjl3we06a8MmjhvBJHRdJQjLPwrScbsI5BTzBbz+95Yfgy3cR9Q5587J8wmHwSZsM/Jgmby7n6BUfKOFnRvvtv3rzbdR7p1mSgbEJSFHEybI0YQJcjRhwjcu5eb7ddab9Q+hio6aAXzdvT5Dshg/V5GGK2WKEfas5Y+3auHs/isN7I44IHWXjLCNO3trdGIc15RsVzRl8voS3aPM/c+eXUO5d6ulZEBcEnI0YYIcTZggRxMmvNRkgO23VJfzsuEds4YrdRu61GUW/J2xfbFox8cL/nlGKWt+gs/stGqAjbHm/GRgJcbAfFThKsOgxOe4X2ADmtMpyqbimZ9cjHskCerg+PVGEybI0YQJcjRhghxNmJBetD5zkXQXZNTV9IcbmLJVgLq1nkz6NCPJxXHpB7uHBW7cOiObo5IJczdvkiYvwXAr1imS/K2PycoAW9loBrKgJMJrzUr8fcdkZYYlQiVpmV8lfkIzXSY1IbgAojeasEGOJkyQowkT0ib7h0poBpODrIaTxTiMfnoMtnDj+f057k/J9tNkG9azGO3Dk5tg+/xZ3zsejHGicTzFa5UNon5Yen6NZZxhnDUs8TsfzlAe/VpjF2xrid8h+6zE2szbpH9GTuLy7zdwr89fXfsAbL9tvOcdf/Th63BO8wCfhd5owgQ5mjBBjiZMkKMJE9JQNeEcTp4yWLdtRk4UF3XqJ9k5LHEZkonGW6M+2k42wLZz6G+hU5yRhiUz/FtsHqAtHWGCMA/ED1GC5zQjvCemUmHbJj0t/FrM/QLHdUQStPUE6zXZG4c1flnLh94xmdN1CXEfvdGECXI0YYIcTZggRxMmUCk3Uw/UWUHoJkOwsWsxRUeozGABcRZhQLw/XwHbp6dXwHb/4TrYmg/8RKKFDbJdivGwy09JUH+Es/5nV/zxZmRlgN3nzRw7XS+Sxi9hfeaAJEZsNYXRjQ/BxsbWb/idzNtvHMM5Q9cFm95owgQ5mjBBjiZMkKMJE1IqtSazveEKAvsck3ezJILJePLqYk1YJiTZ2D3DGsXkEM9rP/GD6c4ujiEdoi2Z4KpFPMHA+XzDn5WPSI1ohwT5NzLMQFjN5mkgC2KrNazWlgX505oy+YWEZEcB7FJ6owkT5GjCBDmaMEGOJkx4qU1eWB0BC1DZeWF9acFaxBOYfKZi2hVCGpQbNA8wME+fYlt0R9qsl4vYEKUIJuqbeT1JUDvCxIU1azkqw2eG7w0m9VmNsc6C7SvFrhfKmhaaqAkatEiyBBYhvgHkaMIEOZowIWX/h9l2OWEsxBrlsXiJTc7Wkoq/wATi1iLGVQc9rBOddP0gak622clmpPkf6WrtSIxWBnvhtDK81mqCkpF7c3y2j0md66D0J3FZPMyuzzgmkv7bE5TE35v4KpitDj7r3ZVlsOmNJkyQowkT5GjCBDmaMCFlzdZKMlkaBv+s7pI1ZqkT+P/3O5/v86wRX48Eu28uYUOUp1tY33h46Ae2nV2cv262MEiOJjjxWjaJZD0QXDQSDPJZMnZYolJjh0jWQ5k8S9DYhO3jAoP1f55fB9sfd9/AcRz5v/HsHOXjyZG26BGXhBxNmCBHEybI0YQJF1ZvsJn7c1JXyFYLmOQ7VG+MK5xpn5JrsY6Pb7cege2gh8nAn3td/zt7GNAvkBn/JMZ7Z6sKRXC5jCQD9PmQAH49xRn446IDtpDTEsd/a7wFtvd33gLbky+wMU57x7/3aIkocabq+CguCTmaMEGOJkyQowkTaPt3tm1PuEUPk/+wGsK9Ga4WsPOWGn4AzOTeDLZ1TT89Adur7X2w/fvqpnd8/skmnMO266yYlDsj2+Ms+h9+cxlXLK6Q7os5eT6sJXzYOp5JghZjlnjhTe3sdcG2+jHeZz7wn/fxDSKlJymm3mjCBDmaMEGOJkyQowkTUrYXUUKSgUEww8yaqzD9/rxEXz4rSA1kjXbyYULiHE9cWIKzSMb2ytIz7/izHJMBFuRHpO5y3iarBct+4Hy9iV0VF2OWeIGJJl+hxIvViDKezkgTnD30g+5dfGZV7H/n+TomA5MefqfeaMIEOZowQY4mTJCjCRNSFvizoDvU6zOZEEsQUhLsMlhSUocZqW8oSQLCViNC5qRT+ngdxxWTaH3cI0lDy2/MwiRBExr443nsd2IJTsjuHOsDvjpbA1t+TKQ9I5JcBMkAGaobr6vJi7gk5GjCBDmaMCHtpbjiz2K0LJhkbcQYj7EYjcUWjEFQBMnqRlkNJIvt2B6YbBy93JeBT3p4zrCPQQgL94ZXMMZZ6PrXZ3Eii8dYXSeTsa8Gvx2TgLMtetgketHEYHG2hNL8cAKbxbXpBlOMCGGAHE2YIEcTJsjRhAlpGIQ7x5UCrGazDgtkJ/c
" </g>\r\n",
" <g id=\"patch_8\">\r\n",
" <path d=\"M 195.417241 178.733082 \r\n",
"L 195.417241 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_9\">\r\n",
" <path d=\"M 349.348276 178.733082 \r\n",
"L 349.348276 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_10\">\r\n",
" <path d=\"M 195.417241 178.733082 \r\n",
"L 349.348276 178.733082 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_11\">\r\n",
" <path d=\"M 195.417241 24.802047 \r\n",
"L 349.348276 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_2\">\r\n",
" <!-- Digit 1 -->\r\n",
" <g transform=\"translate(226.684483 22.396875)scale(0.2 -0.2)\">\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-49\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_3\">\r\n",
" <g id=\"patch_12\">\r\n",
" <path d=\"M 380.134483 178.733082 \r\n",
"L 534.065517 178.733082 \r\n",
"L 534.065517 24.802047 \r\n",
"L 380.134483 24.802047 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#pc3b91751e9)\">\r\n",
" <image height=\"154\" id=\"image4a039413aa\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"380.134483\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAPeElEQVR4nO2dyY9cVxXGb72hqrqqq+d2t+dOZ3DsDJaDxRA5BFCIRAQiYsOCBexY8CewZI3EDpQNO3YoiUQipKBIhAgnDk4gTkIcT/GQdrvndnVXV9Wr94pFVvd+H/KTICeb77d7R/fdN9Tp1+ee+91zK7/+6JmhC/hW42JocnNx5h23ogTaRC4CW+EKsDG6w9w7zoZwWy6uVMCWk3aMnNiycqeWYiqOSf/+s7M3UavgOwvPc865DnnORvA+6hW8h3YxwPMibMdoF/jW1vLUO14vGtAmH+IzoUWILwA5mjBBjiZMkKMJE5JOXivVMAzEc4fBaU5C7oIEsbUKDiTiIFS+lWObl++eAtvf1xbBdrePz1RPMChuVXvecSPpY5ukB7a52l20pWh7rH7TO14kbcKA3jnn6lEVbOkQ7z8M1rukzRTpq0fa3czxm/PO3gNge23jhHf80eoctMkyNlAUwgA5mjBBjiZMkKMJE5LCYTDKCDPwnSHLtSMsm5+SHHkWDC7Od49Cm1duPQK27fdmwDZ6A+9j2MFBSScc4NTxvEEd7z8bxXadoxhgP/Tgknf8k4NvQZunRj4FWyvCd8tmSqrB/bOvBpuZSclsxEaOGf4/Lj8Btstn/d9l33nsv3mzAzZ90YQJcjRhghxNmJCkFYwH+sT/ukGIkJLQjqkTmLqiVrm3bKI7TMEWkfMq5KLVNrYbWccYqpL77YYxPtSQPCdr17+GiogbS0e849+cbkKbtcV3wHamieqZ+RgTx61ArZFS9QYmobcLfD9bRIWRRPhyB03/3O4k+krSwWBXXzRhghxNmCBHEybI0YQJdDBQBh74E1vJ/kKPv7+6Am2e3n8ZbH85hX8ry/Pj2H8HFQWhAIW9iriHgX+8h7aJy/hGpj72bVvZNLT5ff51sI0/jAnPhdErYAul82Vl7d0hDhpmY1SW/GjuXbAdeXLTO/7wxDy02djFgYW+aMIEOZowQY4mTJCjCRNIhOxcteRazDKQJLqLiWIkVJEsphvQZn7ibbB9s/Ux2LYewgx8TlL8cTDTwNrczibR1sfBxsvvoNJh5m0/6J68hKONlRb29d4hVK4818SBUPgad4YZNGmQ2YIDMf6+h4hk/UT6Kdi+07jqHXf3sbW2aNMXTZggRxMmyNGECXI0YUISEZ0Nk+NAG2YrpwqnhPLiWSJRSWO8r/vSTbA5x2zkms4PlNl6095widhQcnTwDF7zt4NnvOOZf+Bbq23gS3t/4wDYVmfx3tKKH/z3yczAKJFts9+XDdDqpJBPLbhG2SI++qIJE+RowgQ5mjBBjiZMSDIiGYlJAZdweSNbr1kWViAmDEbZ2kOmiceVBeUJZTYxuWaNTJ6wQcOPx/4FtvOn/Az/uzvHsK91vK9bd3A24q0jWMzm+dFL3jELy9lswXqOv12VaKSmyICsEflvPCW/QEQGFvqiCRPkaMIEOZowQY4mTEgKUqo7I7awmiMLwll2OSze4hyvAlkE7TYKVpyElDJnFRPJoIGVpu86f3Ftj1yT/SWygcpcjFUmn595zzs+d2AB2tRXcbFtvIx9XeygNr/b/MS/L2jBZwsOJ6z8Oz4TKx2/nOHgIiSUX/HehfgCkKMJE+RowgSasGVFXkJYnMJiL1rkJbr3uTNky5sO2TKmTQqWZCyWK7EtzS7pixWzYbZaBSOk2cRfK1khsUu6g7ZBAy+wQ6qnh2+RRU+tkonvjBRWZEn5VpDEDYsBOse3HdIXTZggRxMmyNGECXI0YUKyRkpMdwoMPOOg4iBfm8mCabKekiZ2/SBzIydFU8ggokH042yfyTukv5AWCfLL7kvKmIj2vOORJlZfHNRHwFaQ1bYjMYb6rWCAw/b5jMj7Z1v5sHMZ9aA/9lsy9EUTJsjRhAlyNGGCHE2YQIu8MMKgnu/XWa7iIKMbzAywv4A2C3bJJdkcQIutZQyeKaVl70nGnIimGw73xWwXvjKj18XZgxHyC2Qt7H9/dRsbhueRWZgweHeOP1OHnMvUIOGMEJshYn6gL5owQY4mTJCjCRPkaMKEpBZhlphJpsMMMMsIs4CSlX9PSWCeBaYJMgvA5N05uY8p8ufTIDKecDDAMuZM5sSy7dvFHthe2nrKN9zAWQDyqt1wGmcQjtVvgy2UVpEtSV0LTXzNLBkgsN8uDPRr/2WX0BB90YQJcjRhghxNmCBHEybQvaCYLQyAy0plyhaSD3X4bD1oi0iCyv6lsGInebBGgAW/TRI4M17YehRsL58/5R1PXcPzBrhtkhufwL2g2F5NIWwtA/udwjW6n5/LdsBlgzbflhFfYWtH9EUTJsjRhAlyNGECXdfJCP/vsv/NjLKeHN4FW685F7PK1Hj/SwPcbuYS2WpnNR+75311C0z0hqoM55x74ZVnwTZ3wX+GCnmmnSN4zcem1sDWrGCMGSZeZ0iBQEZZ2TZbCxuey2TzazkrzieEAXI0YYIcTZggRxMmJD2yiJAFu1lQtK5GVBOsKAgbaoRb4zjnXD3cO7NkqrddoNLhZo5rVd/YeRhsb67c7x3fuD0FbarXcY1rA4UUbvH8DtiyCf/cO6dR7j12EgP/7818ALbxCAcDtYqvBmHVsDeJqoQNtFiyl1VnDwcgtwb4rXq1/TjY9EUTJsjRhAlyNGGCHE2YkGz0UT6Qk6rcWN2ZyKrZ2kBaEZDti+lrmtkggmW02ZBhK8dnCgN/55xbecPfF/OB13ehTXwBA/Oi3QZbsh+rZm+euM/v66u4p+cvj70Ktifrd8BWIzMgcF8keGeBP4Ot/2S/UxYoP5bJ7MpfVx8Em75owgQ5mjBBjiZMkKMJE5I+mRnoDlHmEa67rLJMcsk9PAdEShyuFyw7iHBkLSbbe5KVXg+bRX0ifcpJXwnex+DwLNi2H/CPv3/4IrR5ur4CtrEI13/eLbrY/xBtITzjX45wgOYcSvonIpSdT9dxUKUvmjBBjiZMkKMJE+RowoRkULAqh6zWn0+50h7cxvYdCttNRihVYjIYxmyMmfvvzn0MtpfO+LKdq+Mz2Ne7KHkZ+wTXWO4cwdmI/qwfTC/U16ENHeAQdsmsSKjNb5CCPQfIOgs2w8L6ZzKhevDLL6Y4IPnZ3Jtg0xdNmCBHEybI0YQJSZeswWP7rLeH/v/6mCXzyAWoCqOE8oPFcaFy4PP+MW47mmC7H479E2wnj133jt84gHLvF4+eBFvnbxNga97Ba47c8t/ta2vHoc2TjUtge7SKfYXb8TjnXCf4DdpkDWpG4jZWNbtsfJ0HsRy7rzNK2IovCzmaMEGOJkyQowkTkl5eTr3RCQLNlISK9QpJ+rHicESZESYCWeDPCrwx+TKrwH00wXubi/0E6skqJhq/cfoy2H41+hzY9v40jfdx27+3Dy4chTa/q38bbL/Y9zrYHqnimtBDsf+OrrOq4iUD/0ZJ5U2Z1bYsCa0vmjBBjiZMkKMJE+RowgQqHWDrOiMS6JeBybtZkZcwwb9NirfUS1bIZgMJem/BRffHKKH+QQOVGo3jL4Lt53d+CraxD/0Avr6Mz332swWwPTV+EGzHq1hZphH5/U/HWAiG7eHJYAM0tpUPVP4kqo89h7+dvmjCBDmaMEGOJkyQowkTkjQi0hsS+IfSoYwF5izuJHts1mIiAQqCyps5VlqcjbCse5Ns28OqUbKgNQyUaySzXrAZELKX6LFFDNavLfu13eMu3hdbbzoR41pJJpsK9xddz7H/Kumf7XFaZ9UdS+zh2SO/eZdsQqovmjBBjiZMkKMJE+RowoSkSgYDEQmA+0E2nwWKBQkymS0m+weFwp4TKbsvlMqwYJ0F/h2SIe8O/XuLyZ6eDVJpcSLCtYz1GAPguBf0T2qyZBn2z2Rad3LsfzdYx5H+D3ucsj21GL3g3fbIe+0My11TiP87cjRhghxNmCBHEyYkAyIJ6g4x6A73h+pC+O5ck2XuHdnQlMh4QgnQ9QHbAB4D4usD3PB1ZdACW0wy5OH9suqFDfJMl/pY6r1KBgNhgry+QTaGXUdp0uUu9v9wFUvCT5HFwSEp+ZaskpL
" </g>\r\n",
" <g id=\"patch_13\">\r\n",
" <path d=\"M 380.134483 178.733082 \r\n",
"L 380.134483 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_14\">\r\n",
" <path d=\"M 534.065517 178.733082 \r\n",
"L 534.065517 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_15\">\r\n",
" <path d=\"M 380.134483 178.733082 \r\n",
"L 534.065517 178.733082 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_16\">\r\n",
" <path d=\"M 380.134483 24.802047 \r\n",
"L 534.065517 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_3\">\r\n",
" <!-- Digit 3 -->\r\n",
" <g transform=\"translate(411.401724 22.396875)scale(0.2 -0.2)\">\r\n",
" <defs>\r\n",
" <path d=\"M 40.578125 39.3125 \r\n",
"Q 47.65625 37.796875 51.625 33 \r\n",
"Q 55.609375 28.21875 55.609375 21.1875 \r\n",
"Q 55.609375 10.40625 48.1875 4.484375 \r\n",
"Q 40.765625 -1.421875 27.09375 -1.421875 \r\n",
"Q 22.515625 -1.421875 17.65625 -0.515625 \r\n",
"Q 12.796875 0.390625 7.625 2.203125 \r\n",
"L 7.625 11.71875 \r\n",
"Q 11.71875 9.328125 16.59375 8.109375 \r\n",
"Q 21.484375 6.890625 26.8125 6.890625 \r\n",
"Q 36.078125 6.890625 40.9375 10.546875 \r\n",
"Q 45.796875 14.203125 45.796875 21.1875 \r\n",
"Q 45.796875 27.640625 41.28125 31.265625 \r\n",
"Q 36.765625 34.90625 28.71875 34.90625 \r\n",
"L 20.21875 34.90625 \r\n",
"L 20.21875 43.015625 \r\n",
"L 29.109375 43.015625 \r\n",
"Q 36.375 43.015625 40.234375 45.921875 \r\n",
"Q 44.09375 48.828125 44.09375 54.296875 \r\n",
"Q 44.09375 59.90625 40.109375 62.90625 \r\n",
"Q 36.140625 65.921875 28.71875 65.921875 \r\n",
"Q 24.65625 65.921875 20.015625 65.03125 \r\n",
"Q 15.375 64.15625 9.8125 62.3125 \r\n",
"L 9.8125 71.09375 \r\n",
"Q 15.4375 72.65625 20.34375 73.4375 \r\n",
"Q 25.25 74.21875 29.59375 74.21875 \r\n",
"Q 40.828125 74.21875 47.359375 69.109375 \r\n",
"Q 53.90625 64.015625 53.90625 55.328125 \r\n",
"Q 53.90625 49.265625 50.4375 45.09375 \r\n",
"Q 46.96875 40.921875 40.578125 39.3125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-51\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-51\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_4\">\r\n",
" <g id=\"patch_17\">\r\n",
" <path d=\"M 564.851724 178.733082 \r\n",
"L 718.782759 178.733082 \r\n",
"L 718.782759 24.802047 \r\n",
"L 564.851724 24.802047 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#pafd654d0b3)\">\r\n",
" <image height=\"154\" id=\"image90870aabc3\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"564.851724\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAOcElEQVR4nO2dSY8cxxGFs9beZuFwRFmmZB8EAzbg3++fIkAX2bAWwxY1w56Z3mvzOfN9BAuSnby879aBqu6snGAxIvJlZPG37/46hRkMoYg+V0Fvuy6PcF8ptsO4ENtpauLPYyPX/NC9Ftv7biO2B7B98/h7sf3r51fR5/LnVq5ZvtPxv/62F9vVt49iC/95F39u9Pu7v3wltqevl2Lbf1mI7fx6jD4PV6Ncs7zXv8lXr7die7Pcia2f9NmXVRd9Pg36d3p3vBKbfpMx/wfsaCYLdjSTBTuayUI998ImDNHnthjkGgr8RwgoiSG57jJVck036nA7uK4qNFEpwVaUsW3mUJHi0omt3z7F10AyUB1/p7aLJktlp8lAeYltg+YCYZqV6oVwGXUeKdAfp/g3d52O9fkE4583DGN+G3Y0kwU7msmCHc1koW4KrXKngXkIIVQFRJozKOm+GQHqSIlF0IAYfxN+oKk0eamb2NYt9D7INcJU6jim6uP/ZqfuIrZigCSFpnpOUA9DqGv9Mpofoh/1C3fJqs72tNJrDrqy4TeayYIdzWTBjmayUG8KjRuG4uOxEKk3lhDvXcCXuwICnxD/309xIhVnibrUeGxR6diaJEa7tBrP9CsdR7/S+Rmv12Kr7u6iz9NF53psIBaFMjo9+rBM/gYw/vVCf/O6PYmthTmjIvexj4u4h4sWdS97LUz7jWayYEczWbCjmSzY0UwWagrgiTQw3MB9C8ghDpMa26BBa5OoQaiQ/I/zG7E991ocJCiwrcp4HMVCA+J+o1H45VqfadhoUFxt4gShWGtxs1vrfQNM5KC3hnEVj79a6pzdLjXwv23URsXwAQq2lyGej+NBlRrFi2YzfqOZLNjRTBbsaCYLdjSTBZRyNyAfWCbBOgX+BK0gpHtEQ9CqP6k35rIoNSimZOB2FQfFXa+B/3GtU3S5AUn5rQb19We3saEHWQbMI+RPaJspwhDmVPxDCOGXg652nJKVgP6gc7HY6t/ObzSTBTuayYIdzWTBjmayUJ8mCHahcp9SBq2izxV7UzLwMMSNQR57bRSyG7QKPXffKMmX05WBptZnOjb6VCTjITnRsInlMkUHUpyLfn+lyp5Qoi3+zbHTMRw7DfL3vcp4dr3O7QH2Z17O8cOXO52M+gBjVZMx/3vsaCYLdjSTBTuayUL9PKrMhhq4zHHJbmZg/gK/mQb/P160u+MeAtYzNCcJQYNdksGc+jiQvXQQ5Y9636/c4hqKbt6N9RkSl8vHm7z0F52Lc6/P9Nzp/D+f1dZ3+n3jMf6+dq/jarR5pN9oJg92NJMFO5rJgh3NZKHejioFoWQg7cB4KrXDYQurBZRsvBtuxPY0xOOgvQAPZx3rBcr0LciEHo5679M+FuKfYeNr9aQBcfuswXq71d+st3Hr9eJ4lmuGO21VX/bQsVKnW5OSXgPz/QlWAVqo+A/6nAOsNIQhOQbgqL+5fE+NZYzJgB3NZMGOZrJQd6DeeIFNhD+M99Hndanxxn0NlTqAmrXMaeDSwzXnYV5j8aYEeXobBz5dq981gG0qoFHhSePTYp8cjwPNc4a1xlD9EprI6GVhrD/e5KUA2TbRQqPCkpQrT/HYmr1+1+I9fNesURjzG7GjmSzY0UwW7GgmCxhJp8XTEEJ47OPC4hIqiOmZmyGEsIGk4QIJSJoMkFKDoE6OV43+Zg2Si/ReCpwfTzrWcaFJyQSdG0MZ26Za7+s3MBcbSBogGUinsYAO3NS8k7ptExMoV6pTfG+zgw7oO9hXO+sXjfmN2NFMFuxoJgt2NJOFeoDuIXOq9KdRA3+6bz+S/FrvTb/v/UVXJ0iVQd0LXzW6sXDbaYKzr+MIm86sfIYuisMCqvkrUHmsPp7QDLAKMDSwMqBTFqYmCcQh8B8hoKdkgLo7jiANr5P9pbjf9OxkwHwi7GgmC3Y0kwU7mslCTRX+NUR4abBOgT8F+SNIaiiROCYHxVPzlh4Slz2UzKmj4Rkk34ek2Um6zzOEECZsv6imOd0Xp1qfaYLSPZ4RmkqCQghTshJQliABBxsxzn2mxFbCeaPlSX3KbzSTBTuayYIdzWTBjmayUN9XqvOnfQRpZ8gOgusFJBbU/p3c+6qKpT33CxWjf7+/Exs1J9nWOo4nuG6XdDQ8HqE5zIPaqIlJDXsGQpfIkCDK5z2cMGfUHybJIyjwb2AvwNx9BEWl16V53FhDslTqH9hvNJMFO5rJgh3NZKG+L1Xp0FUQoyX/OR8KVSaUczvUQayyTlpRX4Mqo4P+EO8PqvIoC43HXvZqG/bxM5V7/f7lg/5bXGyht8QZYrSkGDs1VIlVE6kw0JbEUGWl46rBVkGMVsL3kzQ8LRyPoDSh5/QbzWTBjmayYEczWbCjmSzUpHQooTqYqjwqCPxpvyZBio5UDVLBGKj4SLH0Hg6UH5608FonTfaaFw1sF0/6/YtnSAag4/a0iOcjPbInhA9IueEw1GEJgf4qLggvF1qopuIszRmpN2hfZyo2oabow1L9wG80kwU7msmCHc1kwY5mslAfSH4N/pcG53TmZlvofj6SbdMZobOk4iC1Pp1gf+lRbc0W9l1u42dYbDUiJlvzAvsWD7DBcUqq6C00eYFkoNfFjjBcaTJwvY4VL9dLbW5DUAfuC8nYL+oHRZesdlSwL/jKyYD5RNjRTBbsaCYLdjSThZqCeiKVAC1hZeAADV1+LbQPkxrSTNS9EILYegdHyTzEwfoS5D/Ni65GNI8qrSqeoQ96FY+jhMY1IwTT1OqdWrsvmzgpWdTQkAbmh1YGzgWs6pB0KLmZ9qBebiwTMp8IO5rJgh3NZMGOZrIwT9cTPrA/M4HkRXMZk0CfmrzQeU6kk8etpCDpr0/xhfUBpDh0xtNRVwGmi9qKJl6hKHpozz5zygrYs1kl80Gt8EfaDNDrygnJxWhfZ/pnoU6UtNrhN5rJgh3NZMGOZrJQ07E6LOWOY5ABYqglxAOkBKEjgOZAsuS6hvPf6ZxJiEaHNokLYY/i3LCzgH4Tqe65AL009d4oQEJNUMyaUsM1JImn/Z9lq9cNy3i86RyGEMIAdXu/0UwW7GgmC3Y0kwU7mskCJgObQouPN0XcdIVUH9tRg3ySclMzmGPSXfsMGwapyQt1zS6gg3V3pbbT6/je6qz/7tonCMwp8F9CBDwmXbOPsO+S9lOCIqKCwPyqjaXbHcwZyd/T4ngIrPxoGv3NU6IiGVvong7njfqNZrJgRzNZsKOZLNjRTBZqUmUsCw1aUyiJOIEG+TSpjY7ySTt6L0oNYt9eaccVCmJ/qTdiewZ5dyoXr+Cadq/jqKjL5EGvK5Ku3GMLeydpMQJUEwUpV5JMooS/JakyUtXHh66jVZe0y2S6UhBCCBd4KL/RTBbsaCYLdjSTBTuayUK9LrUxCFXuU2k1yYSoMQtVoSloXVVpMqBB/pv2RWyfL/S8nB+bV2L7u1hCeKnipOEISUp10meqTtpKvgWJVHlMz9CBQQAkExphf2a6UkIyqrmBP3XwXLWaFO4XcYLQb3RcI0iH/EYzWbCjmSzY0UwW7GgmC3UbtPpLqwVVEV/XFnofJRED+HIDgf5yRrOZdanypfSczxBCqGETZwt7Hr+r7qPPj90rueYEKwPtDpqYdNBlMt3HOYEmaN72gDBCgnAe4rHRvs65LOHe64XO7W6TnHEK4xo6n9dpPhF2NJMFO5rJgh3NZKG+hZUB6uaY9u3YQqv3ud0jXwaV2QxJd0RaUaBVDJIh0QpFgJbqch/sSdhdbsRWnfW6YtBkIN0wXMB5UT2c+zSRTAimNq3608pAA0kbBf5XzbwVonPS2v0B/k5naL/vN5rJgh3NZMGOZrJQ00Hu0EctrMsq+azXjEGVFBgjgFQ8lYZ3cIxPA3FhO4HcGLpaX1cnsaXF3h4UEt+cNd44nFUqXoCaZWzigUCdOnTX1JUbCuYgq04LtC0UqinOaqHJS6qe+ZAtbRpDSpBto+oWv9FMFuxoJgt2NJMFO5rJQk3H3lTgfsvkCJc6aNHyLQTc60ITBGoisx3
" </g>\r\n",
" <g id=\"patch_18\">\r\n",
" <path d=\"M 564.851724 178.733082 \r\n",
"L 564.851724 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_19\">\r\n",
" <path d=\"M 718.782759 178.733082 \r\n",
"L 718.782759 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_20\">\r\n",
" <path d=\"M 564.851724 178.733082 \r\n",
"L 718.782759 178.733082 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_21\">\r\n",
" <path d=\"M 564.851724 24.802047 \r\n",
"L 718.782759 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_4\">\r\n",
" <!-- Digit 1 -->\r\n",
" <g transform=\"translate(596.118966 22.396875)scale(0.2 -0.2)\">\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-49\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_5\">\r\n",
" <g id=\"patch_22\">\r\n",
" <path d=\"M 749.568966 178.733082 \r\n",
"L 903.5 178.733082 \r\n",
"L 903.5 24.802047 \r\n",
"L 749.568966 24.802047 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#p674679b9d7)\">\r\n",
" <image height=\"154\" id=\"imagea498ea228b\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"749.568966\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAANpklEQVR4nO2du48kVxXGb736OT3TO++dffslwAuBkSwHRrYEEiKBgIiEkH+Dv8EpJCQICSGRkCAeQiIFbFiMsdde7eJ9enZ2e6ene2q6q6qJ7/2+1VzNeM8k3y+ro1vPPl0659R3z03ev3Nx4QI6SR2aXOb8YbVLYAwj3M8559pk11YSd7wY6gWekzEPth/WbRjzsFoBW4s8n5eKJ2C7mBXeduMaGDNd4LFKcv3lAp9Puci87VHTgTEZOWdBrr9ZpGBLE9yX/Z4hzDfw6EK8AORowgQ5mjBBjiZMyH/59C0w9tIZ2AZZ6W2v5/swppOG4TUPHjvk+HC+tARby2EQexr2mr63/XG5A2Nul2tg22yNwTZcmoJtK/PvsyFBfkEC54IkRgOSK00Wlbc9bfD5xAb0GUkQTgo7vt5owgQ5mjBBjiZMkKMJE/LffvwNMDbN8f7XVHE+mqQYGDJbmvi2dgcTiyLDgHVBKuaMhozLUj9QPjxqwZijwwJsS8uHYHt8aQls3xp84m0XSQVj+ukR2IYpHn9AEq3wylbIsRgNTUAwaWCEXyMK8uWBoTeaMEGOJkyQowkTkp/9920ImGrif6EK4Mb0IoyZVKh+KNKTFQJHsy7YwjjueUwrjKvyFGOJz8dDb3vyhy0Yc+HPI7Ddf3cItsmbWLDt9fyY6egIrysh95SyGJbYem2/ILzZP4AxLDbtZBjvbXexCH2lswe288VTb/vDQ/SDO9NVsOmNJkyQowkT5GjCBDmaMCH/bv9TMHaIeiAMpX80+B8ZgwF3GunLWXDOaUMKlAkea77Ac46JrUfu6Tfj17zt95Z/AGMWGZFQr2Ng/tbV22Bbb/vB+afjDRgzrzOwTeZYOGZp0P6hL93+8NEFGJNk+CxYwfzfOY5rtbHAHCYvRx+h1L27Kym3OCPkaMIEOZowQY4mTMjvVliB7xCVQThXj839ZPP5MiK/TiPmBg5IJX9IkgGWIDiSDDDCLyBVD6/r4BqqMtyrEzD9ZPsvYHuj5cvRH63jcw3VEM+35WAbNT1v++F8CGPYV557s3Ng+2yCiQr7wvLJ401vewlzQrf2EapP9EYTJsjRhAlyNGGCHE2YkLPAnxEG/yuR8h8Ma/ErAKMk+UJJGqLwfYk0hpzy1qEfALf3yH57+IVifoSB+XKCMup24gfTM5KksKSKPdtWgtcxbnxp0kaGUh/G6+27eKw+JoUzkpT8On/T2/7nMn4ZmG6hXExvNGGCHE2YIEcTJsjRhAl5L41LBmI6/R2RIQUJwuek2Uno8Syg52IZZNpgRbtDgunR3K+sFyi5d2lJ5pLO8Piscl8kfjDdJ1875uSW2HOcElsddGnsk8Ru3KDkaE6udZjinAfWGXL30P9SMriD97T88TOw6Y0mTJCjCRPkaMIEOZowIZ+Ttt8xDT9YEMuYkIYxrYjj98jEWjaXYUoSi9gEJw8q8Bn7HJES6VMPj886K4bPCFMI51gX/ZpdBkuEgn3vzFH+M2mwSl8u8Eq28xHY+g47cx4E8xmWb6Fkyn2K2iG90YQJcjRhghxNmBAdo4WjWCGWRV5tcqwYoTVbsofFYyxWrNlyNuQcs8YvXGakWXhS49XmOZ50SDuN+/MuWQhIpo3SZ8sogriNNfobZqyIi0oN3gWdzAkNDeQ3SVpYJNYbTZggRxMmyNGECXI0YQJ+xn8O8yAMjFFzOBcX+DuHQT0rUNLAn1Q8j4gEmXWPvj/xZcidp2QO6iGqPpqaKSLwP3u08PctyZgBSZZYIsTW8Ayfx0aGxVPW8ZGpMljgPyGF3XHpF4AHFfmFc3QrvdGECXI0YYIcTZggRxMm0GTgRSs6YmBnY4E/a4gyI/8flgzsz/zAdmmMgX9Soq2uOmDbrftg6yX+mqYNneWKsH8/k7azew+hvxv5nfYXqPLYrZbBdnDg33syI+oNgt5owgQ5mjBBjiZMkKMJE/LYwBmkN5HrMp0UFvyyJIVVvhsyribV9iKYZ1l1MLjOC8yXMtIqnUl0wq8p7Pod6YjJ5r3yjo9+YM7um13Xkxq7WLKGLo9IB8lFHfoBPtekoyYv4oyQowkT5GjCBDmaMCFn8pAYRg0Gp1ySEru4ux8AZyTZ4HMZcByTt7DK/eOxb9skAv7pVayOb557DLZLOTZJCRmzSZwE1hFzlcxVHQWPg80t7bNOkcTGkoZnNVmcd9eXSCVP7sOY+sI67gcWIV4AcjRhghxNmBAt5Q5jpnGDBb45lVDHddKG7tSkgzXt2UHCHiYzZ3MZD0d+wbMYkzmQl7H4uNk9Ph5zjvcKCWH6CybbvjnH7tejIO58tfVF1HWx3hurGXYhZL9n+4n/blpU+Psenu+BTW80YYIcTZggRxMmyNGECdFS7rAwypQCrNszC8xZYTEs9s7JOpyxc0lnJMROWWF65p8jm5J1JmumRCBFYtJwcB7cZ+z135hhwfPn994B2yxIyN5ZvwljnpH1WP+zfx5sOz3spH1rvAa2sC6dDLAQPtlmz18IA+RowgQ5mjBBjiZMoFJupuhoIpUH1nB5NJIx5UeQDNCGLiRdWipwbU721WISJEerGR6fLb3zqy/eAtu/PrgGto2/+7/J78aXYMxsQBI7MgH31nkcR3rBuAt/3PO2q1u3YUz9vR08Jx5KiC8fOZowQY4mTJCjCROiZUIhrPrOmrDEAvtGdndkyQCTt5Rk3UpQJqV4rKqL57zcfQK2FbKUzyxoHc/+1WHC4Jxz7z+4ALadv+IDGfz+Q2876WDzmeoVDMwZ2Rz3pUum3g+kSEQKNUNFk95owgY5mjBBjiZMkKMJE3KmH2+Izp+tYxTCZDAsaehEzCWNbevOvmywe5qQZAAul8zrrFto65FFo9g6VUdBoN8i8yBY18bpU5T2XLmxB7bq+kve9s0fo6Qp6eM8iMWMfC3o4D0lDzBBaD972dsu9smzuEzWMwWLEC8AOZowQY4mTMinZM3tOenDEMKWeWH9G2Lly2FMxpvpsRgH4zEmKS8XpGDbHF9gZqEdu/eHRPI9DhrlFQnOnRzVOAcymWLctmjjPd1715dRv/edX8CYfopKE/Z8mNT9pze/D7bybxvedkMWFy1W8Jx6owkT5GjCBDmaMEGOJkx4zrxONIeBfnbCBn6ngSUIsdcRM25RYBDeYK7heikWKddI0B0mKiOSeN2cbYMtK0kiNMDi6WzFT7RY4L9NmrdAQx3n3B65tqpmTXt85n0cM1zGJjh6owkT5GjCBDmaMEGOJkzImUqCVfPDBIFVxxlZZMfHGFhzmBn5MhBLKFWuu+QrA/YwcYMMm8Ew+omfNLDnervEhi7FPv4mVReD7mroP9uaJEtj8mkjJUlD+BXDOefGU0wQ1iv/HpjUfaVT4jnBIsQLQI4mTJCjCRPkaMKEE8/rZJzF14JYavKfWhR+YDtbwWSg6mEA3yFL3LD5mWGA3SNB+IMSJ0HmJNeoSTLQ35x428MMK/JMBpYSSTlL7iK617uqg4Mu9kd4zuMPJcTpkaMJE+RowgQ5mjCBJgNM+x/SIhV/NofTkQThpN7Nmrcw2PUzCc0i9QP9mgS29QDvc5+sK8XmZ4aw6vvdgyHYUsw1aEv18yv7x54ztvEOu7ZZie4RBv/TLTz+1S7OQdUbTZggRxMmyNGECXI0YULOFm6NkQDRMWSuMJP2MEIJTUkSi9hkIJTnOOfcoEDpymLgJw0HO1hFX95+GnUdzBZ+QbhXnYMxT6aYWKTkOY6voO1rwfpNbDI1+53Y/IYPSnKCx/g8wqY3h5cxc9kqcF0pvdGECXI0YYIcTZiQtyIl2WGBlhUCY+MxRmz89WXy1asPvO1PWlsw5ts7t8H2cusLsLG5sGH0wp5ZO8fnf4ChnJut4rjLXT9+ZLHphDS3YUqTKZF8N238PatusG+GASVTyuiNJkyQowkT5GjCBDmaMCGf0ULj8UE9W9OTdcg+KayhSyxMvcGC9R9u/8Pbvru6CmOud++CbZU0TtmtB8eekyVel5axIPzBK0tg297AImh4bWzeKJNyM8n9Eelmk61gMfY
" </g>\r\n",
" <g id=\"patch_23\">\r\n",
" <path d=\"M 749.568966 178.733082 \r\n",
"L 749.568966 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_24\">\r\n",
" <path d=\"M 903.5 178.733082 \r\n",
"L 903.5 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_25\">\r\n",
" <path d=\"M 749.568966 178.733082 \r\n",
"L 903.5 178.733082 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_26\">\r\n",
" <path d=\"M 749.568966 24.802047 \r\n",
"L 903.5 24.802047 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_5\">\r\n",
" <!-- Digit 1 -->\r\n",
" <g transform=\"translate(780.836207 22.396875)scale(0.2 -0.2)\">\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-49\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_6\">\r\n",
" <g id=\"patch_27\">\r\n",
" <path d=\"M 10.7 379.446928 \r\n",
"L 164.631034 379.446928 \r\n",
"L 164.631034 225.515894 \r\n",
"L 10.7 225.515894 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#pf20e339346)\">\r\n",
" <image height=\"154\" id=\"image7566adf216\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"10.7\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAQ60lEQVR4nO2dW5BU1RWG97n0fbrnPiAMN2UAI0HiFRUkatAEJYKaouIlhRVNxZgHjYmJD/FSMfEhqZRGNLESE1OJlSCKAiYqqMSoiGhpRIFBBIbL4MAMwww9M93Tp885ecjT3v+fmq5Kavuyvrf91+4zp0+vObXW3mut7WzaNz1WBsUobUoq75a18d2fLIU56qFWkLJbu3De6ChIcRhq42h4GOa42Sxei+C2tYB2bP4E0IZPcrVx8gQ8CuWP4PUzx6qgZbsGQXMGh7RxnMXn6gR4LVXG58OIy+WxJzkuaq6DGrmPOMbn4fj+2NcyfkullCJ3IQj/f8TQBCuIoQlWEEMTrOB7KgIxiH3QeqsFbVyN0EaTo3gtFRMtmUBtVHc8mePvpFJ4+UoFtJFZ40C7+I7NoH0xv1Mb94YFmFMM0YHfU24D7Z2+KaDtP2AEIBXyzPo90Ka8UAItsbcHNJVIakOHPVfimFd7joDmzZwOGnHzlTOqP+94AIMg876UkjeaYAkxNMEKYmiCFcTQBCv4zPFnJBx95dh3iZPPCGubByvOXm3/A06SOJ4V/JszMuhMz0oe18aFKq6051MYbCyu2wVa2Pw6aMFM5k6PzRWnfAe0jtvJKn2dHjDF5JnFh9Hx77n9fNAyi46Clk/hDkXXu+3aeOr6JpiT2H0YNHmjCVYQQxOsIIYmWIE6aKY/ppRSaSfQxo6DPkPs15YpEJfGzjoAn00pFYfoLzHcAH20gRAXgEPjK5RjXPAMI7z/3hDvLSTLm2bGSxDj4uzMBC7OXjq9E7S9hXbQnKqxGNvXD3OOXzUHtFtuXgvaN+sPgJZw8H63TNP/5j1nXQlzKvfjvcobTbCCGJpgBTE0wQpiaIIVfObEhjGxP2NaHJPFSCbl60CLKwHRDEffwYs5HjqnimiJviHQnuueC9o1sz7SxlkXFyg9hUEPI03mmc5/SP6vA5Iu3TWMi6DV1jze27D+zBy2yH1tH0jM8f/NwMmg7S5hlsotLa9p4ydnrII5i7+/AjR5owlWEEMTrCCGJlhBDE2wQm2pG0qp4UhPow5YKjfxm6MGDAZcVkNo1nGyekSCk82gWMRizIPbJ+G0GfrfYDsDEQmM2M5JwsGUaQXBANIfYTAzp74btC0ZrEv1e/Xgpf9cdN5/POMJ0N4s4/f87eOXgzb+bXyO13xvhjZ++ezHYM6q2X8ATd5oghXE0AQriKEJVhBDE6xAgwHPGTv9miUpsw0FCqk1jI2Ub4elHLGVb5/sFkQYlTR/gHe8f0mjNh7vnYA5IdmhaPUwXYl9dfMp9oaYds44M9cF2ssTLwAt85G+A3JiKtaznp/C1KF7jiwErWEPBjh+PzbaqV/drI1fOg13FBZm9oImbzTBCmJoghXE0AQriKEJVqh5Z8BMl2FNXhIkhnBGSUrQCObJQ5pQhBdjNZzxCNYfOCmc17QdU4dW9Z2jje+b8ALMeaj3QtDWdp4O2llT94M2PderjduT6JhflsMaUbZDQcoNlMroDWhKJ9dWUzE7hzsP26pza/psYkj/XV4fmAFzFkgwIHxWiKEJVhBDE6wghiZYwWf1ASxP3jXWuYMQP5cjhbssGIiqpOW5QUzm0JoBssugSJt171AvaG9tmK2N3RUYDBR8DDbGr8Fgo79nMmhbYz01ad28HMzpuBXTbM5IHQQtqCOF2EaHx6ZW3NnoJbski3Mfg7byZtwtSN+H3zPVP3ZrelaHIm80wQpiaIIVxNAEK9Tc5MX05SpV/KhD/AHWHM7Joa+iRoy0Ybe2/wHzaB+llHJY8z9yvanP6j7Nw0vmw5w7Wt4E7YkrzgPt1F/gInSY032cce/gnB/tvBq0dXN+j9fChuTKMepjRwNMmw9J/W2RaKvmPg7aDWfeAVrbP/WGfccrmEqfoD6+IFhADE2wghiaYAUxNMEKfsRsrba+JjV9jjnmMTm2JzbP8GSLs6QLJIWliucxAPEG9IyO55/CbtXf+vYboD1/0UrQlnei43zSFt35T3QPwJzjnZh+Xfw8OusR++pG58yRYjNMSZK0/GMRRhbNpMFN/xz8bNtaPYAaDvBaaZLnL280wQpiaIIVxNAEK4ihCVag3jULEMzsjYi0RWdt19Uophez9u+wwk92GRgsoyM226IrpRzSWCbK66vaU9Zid8RbFy0Hbf3MdaDdcP1G0J49dIk2bhjBlfuW90FSl+VvA23cARZU6c8otQezVooXYlp43sGMmhQr1GWvISNoq8a4M5B18TeRN5pgBTE0wQpiaIIVxNAEK/imk68UDwZMLSSp3O4o6eRIWr0r0vLcdOrdLJ7dpBIkNSmDzmhMUrmjDKYlRxndUS634Od6NuNq+6bJOO+6evTqN9x4qjYefvQkmNOwC+tNm97HAMq8V6WUitpbtfG4d/BZ/+zSxaA9NmU9aBtLE0Gr24dOvVPQ29CHpL43Ir+vvNEEK4ihCVYQQxOsIIYmWMFnDUUYZjBQrRJHsUqajESk7pKs5oNTn0GH28lhgBCTjo9RPTkENksOmjUOrQ1JfkvjTnRsV3ZfAtqj054G7dcdf9HGi6/+LszpeIDsWBDHn9U8VHP6vMxhDCwOPtIB2hkLbwMtcwifz0TS/j1q0oOBIKrxsN6aZgnC/4gYmmAFMTTBCjSVmy3i0jM8a8BJ1OYDwudIN2xFMjAc0rDPHcBu0iomflta90tyB9AnUS7eR+eb00Drn4I+TmTUT26c/zDMuXzZnaBN/vsgXot0KU8e1X2yKIuL0g078Fr1n9SWEh8l0f8Nc3rqtudgCngodZ3CZ4UYmmAFMTTBCmJoghV81tCFERkBguuS1GKPNItjDVfoH9AdSNaIT7FrkQVhp440kQnRQTWdXdakhmknr8aGd/dfiOdd/nLyWm0ckOz0m5a/CNrfNl8EWmIA09+jlBFosQCKaGzxemgC1mf6ZbzhxLD+vNvrBmBOWbI3hM8KMTTBCmJoghXE0AQr+LV04FZKKc/R53ke6e6YII1ZSEMX6rSaWRjkc06t53WSTAcnwKAhKBjp46Qu1SW7EWEdrsB/uGEmaIdv1B3stIP3sCy/DbSVSxeBNvNx1k1Tf47uEAYMitS49nypAbQrr38dtDXPLACtsVMfT80egzkjpKOkvNEEK4ihCVYQQxOsIIYmWKHmus6KcWBkOkmO3klhjaVPujSazUmUUsox5tGdAUKcw7/pMAd4YRNo2SU92rjrX9h9cdp6crYo2QFp+RD/ZueoXsc5L4NnejKuvmAraO8/8wXQzDQhGmSRZ83O/rym/l3QmpZjutWaQ3O18by6T/Bz5PUlbzTBCmJoghXE0AQriKEJVqDJ4+y8xSDWp6YSpB6RrdyncBVdDWNuPjSDIbn6Kk1qPctYV1iZ1gbaGTfgCvzD7a9q403TCzDnJx+uAK1hRxG0agY97K3FU7TxBZkumFOM8Se4rnELaJtbzwEteUh/ZnEWU30ccv020kTmkaMXg/bAhA2gmTsZrNX7mqEZoMkbTbCCGJpgBTE0wQq+R45wiWqo4TRrFpVSymXH8ZTHPoP7Px9mbaEN2PnpxAcstaF2ZfN7oG2r6H7VrAR25T6yAL9TYS/6PeleXNh9q2eKNr57PH7HY6SHCeuaffRs/E3y+/SUdZahEubRr013o4/5ytuzQTv81VdAG4n09PEHP8VMk+3PzgJN3miCFcTQBCuIoQlWEEMTrFDzgq1J0iOOZwLtNsFqJVnjFyP9mmZvsM+R61fJKmKaONjm9xwmi5uNE7BJSmB0plZKKX8Ev/twyWj0RzIpGOyMzbgdgw23pH+noAUb2ThVUs+axu857Tl83q9dgunpC7Ifa+Odq9Hxn/gG1r3KG02wghiaYAUxNMEKYmiCFWpr/aeUSrv6jn+CBANRitRTJmvs+GimIbNdAOZMk2N7WKp12sVgIG9+J5LWfvwYnrFZILsYIcneSCX1OktyWJHidbVIKkU+bXS7ZF0hEyPkuJ80/ibJPkzb/tUH2Gxm2fzt2vjEbLz++C2si6ggWEAMTbCCGJpgBTE0wQo
" </g>\r\n",
" <g id=\"patch_28\">\r\n",
" <path d=\"M 10.7 379.446928 \r\n",
"L 10.7 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_29\">\r\n",
" <path d=\"M 164.631034 379.446928 \r\n",
"L 164.631034 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_30\">\r\n",
" <path d=\"M 10.7 379.446928 \r\n",
"L 164.631034 379.446928 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_31\">\r\n",
" <path d=\"M 10.7 225.515894 \r\n",
"L 164.631034 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_6\">\r\n",
" <!-- Digit 2 -->\r\n",
" <g transform=\"translate(41.967241 223.110721)scale(0.2 -0.2)\">\r\n",
" <defs>\r\n",
" <path d=\"M 19.1875 8.296875 \r\n",
"L 53.609375 8.296875 \r\n",
"L 53.609375 0 \r\n",
"L 7.328125 0 \r\n",
"L 7.328125 8.296875 \r\n",
"Q 12.9375 14.109375 22.625 23.890625 \r\n",
"Q 32.328125 33.6875 34.8125 36.53125 \r\n",
"Q 39.546875 41.84375 41.421875 45.53125 \r\n",
"Q 43.3125 49.21875 43.3125 52.78125 \r\n",
"Q 43.3125 58.59375 39.234375 62.25 \r\n",
"Q 35.15625 65.921875 28.609375 65.921875 \r\n",
"Q 23.96875 65.921875 18.8125 64.3125 \r\n",
"Q 13.671875 62.703125 7.8125 59.421875 \r\n",
"L 7.8125 69.390625 \r\n",
"Q 13.765625 71.78125 18.9375 73 \r\n",
"Q 24.125 74.21875 28.421875 74.21875 \r\n",
"Q 39.75 74.21875 46.484375 68.546875 \r\n",
"Q 53.21875 62.890625 53.21875 53.421875 \r\n",
"Q 53.21875 48.921875 51.53125 44.890625 \r\n",
"Q 49.859375 40.875 45.40625 35.40625 \r\n",
"Q 44.1875 33.984375 37.640625 27.21875 \r\n",
"Q 31.109375 20.453125 19.1875 8.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-50\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-50\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_7\">\r\n",
" <g id=\"patch_32\">\r\n",
" <path d=\"M 195.417241 379.446928 \r\n",
"L 349.348276 379.446928 \r\n",
"L 349.348276 225.515894 \r\n",
"L 195.417241 225.515894 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#p8184f618cd)\">\r\n",
" <image height=\"154\" id=\"image87b14a4e1b\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"195.417241\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAANQklEQVR4nO2dy24kxxFFs6qzn+whqRGkkUaAYMiQdv4FAwbs3/GPGF74f+wf0MaAYXglCfILfnAeHJL9rq7yQqvKewSmB4OYzT27DmRlZRWDhYjMyJvNF7/57ZAK+iwmoenV1h4btXV17YZJ+VvH0Jyh/6P2PzmAbQ+24/gei1t9qPlrfYDJ/iy2ftaK7XiVR79vv8jSZvupPmer3afmpLZ+Wl6obfJG39n0XtstXuo4Lv6tN50+jN8HPvelPicMzZh3jx3NhGBHMyHY0UwIGQP/GvejfAGu62dwaQsXa8wqdEtIEKCr/KCdUbsyachbTQamrzSLmNw+iG3IE7E13dXYAMkAJVUNJAMtJELN8HjSNnujtvmtXre60aRn/mKn49iOs69+QX9gNfmLZkKwo5kQ7GgmBDuaCSH3K4hGiaJZ0z0+u1/bV0o660/B+zBVY48rCPr/c4bViGlhajuYpX/QgHjYqq2ZaVDcdOMHPS+kSernlOBAZgQrIOXfgFZh8k77n27BdqerAGXgn1JK6TS+SdvAas3BKwPmPWFHMyHY0UwIOc0gYIL4K5VxA8Rjfda+KN4YIABrj4XPw6QlQRUdNGFIYU85MdoeYfxnCiihM5iw7edj23kO44K4czjA5CwNo4jJJlTJAlUreaedTQ76wpsDlIwcipucNDBs52VZib9oJgg7mgnBjmZCsKOZEHI7hbJkivQLKLjmdnUTwn2RlLSHyv8BCpIrbWXFyDChSWgdRzPVYLd/shRbt6qYwaaSeIjBJzpHnHIR6LcnTSzmd3qDvIXAf6c3He43atuMbc1M38Wk1XfmL5oJwY5mQrCjmRDsaCaEfPFEp45PJ119Px3Htv6kPjr0MKMNqwVDB/5dZhc04Y8l4BDA6/CxpLxbjK89L+CZlnAhrAJ0l1qacbgat6P9prTHNW/VNrvXZ89FgjA5QFXGRgP/yU5n85sjrQLogPvtdnzdSd/PZKHvwl80E4IdzYRgRzMh2NFMCPmrD2/E+GK3FtvmOA76tgedEe46DZJp62GXNFofinIfDPxhon2AlY0OZqbpf2qyG9/zuNYbzNZa21OWaKeU0vFag+LTqnwmGBblN1AiVQb+P9jG48h77QzLf2D8TQcrRBX7RokBrvMXzYRgRzMh2NFMCHY0E0L+9We/F+PteSW2bw6fjH5//eYn0uYvN8/Edn+jiUWzhzKSMhmgGn+YvG5OtHlBTfleOyxVDmd3EDj3sJd0rsnM8Yk+091Px79/8cs/Spu/PjwV23dffy6262/1odbfj0t22jdbadM8qC0tYPMC7YMAmjx+9slz/Zufnusz+YtmQrCjmRDsaCYEO5oJIf8chEfe9C/FdtmOy4m+338obf7cfyq2ZqvB+vwVzNIX1Uok8kIbcLsLaEjJAMm/Q419ydBqkEyS5+UqQEopnVfj/tdQJ9TCg9LKAJUANftxuQ+V+gx7vWcZ0KeU0rCEFRBolwrbsNbEcf9M+/IXzYRgRzMh2NFMCPkPO42hbs86CffNYWz720Yn5Y4gwEbxBiFH9JBQS+2/RYVGTUop9bCPUy+E7s9QJUF7Mffj/v90+5m0ebnRGKdFkZfHpa6H6eMxVUopJWg3LECY5fpSx7G+GP0+QQn78cL7Os17wo5mQrCjmRDsaCaE/Lt//EqMXa/+ty327714uJA2pw0IfsDk6RmUqM+FRgoF/m97tE9KKfUzmHgtY2Loqz1BRQeoQE63+uz5YZzh/PP1lbQ57PW6Jez/JIbJuP8GKjCauZaY9ysN4AdQaexJGKdIoM4rSCwgyfIXzYRgRzMh2NFMCHY0E0L+9oVWYRDn4tib406DxwZWGUjEhI6SEY0XOvuzPFMnpTTAET3V8u81YpSwREHXkdpiqdy4uYNSmVL2Hq77UcqgG8RnEihWpqy2fqbXTiARKt9Hn+uyMX/RTAh2NBOCHc2EYEczIeTdBuqjiULNcdhD8AjlLWRr4cyiciWAVBupPAcl2+Hfpybwp7LtBIIxlFjQOGQMUNZeK1+PJeXTcX8tittA/0fIxpaa3CUSgzmPE4QJnJ9F+ItmQrCjmRDsaCYEO5oJIbc3WkZS1u8TLUwat3igLJioBKgI/vsZBf5wHc340z0huZDrINmggLg9k6Q6nLlUrJQ08H6o9IneD66KFDP8A5UJwV5PSlvw9cChr5QcSRNaJXn0KmPeAXY0E4IdzYSQMe6highpVBePUaUG2cqyYYpnuidQAr6A6goS9N5pf6LlQfEexGPNXuOe6YM+VN4UOhX0yjII/cHc6RlK0ctJ4gZiqv5Bz9xs4AgdKk8fDjqzXp7P2e61pJ80TfxFMyHY0UwIdjQTgh3NhJBJrZomB2tcEqsO8NxNsJUTttNagbq6SdCq/Z/UhiYoScGaVGnKSzFLgWSAzhulSfQajRoQ4sMNm3A2JzKDTKUCf9FMCHY0E4IdzYRgRzMhZKy4gKBVAngKREkgW4tD0lAj/EIxOFWMQAzbnvXi2a22m92P79keYGAUOFPJN1VOFOOlPa49JBv0zk4XsLJRqoPDKga97AEC/1IwJqWU2pWqUQ6FQEy/0OtISdNfNBOCHc2EYEczIdjRTAj5vKwTSalqU1sGQwsPUDokfVGCQJPtcBzP4pU2nN+NA+XJntQdKw+wpwPri2oiTLxgrFT6dLyGsqmbolQcSn1QLQcShGYGGQisAgzLcbtuqckA/Z38RTMh2NFMCHY0E4IdzYSQ8ayjOt2OOmhivTK+LqkdF+6LrNirSrP7tFcywSw6KSZS7X8NlODg/tjy/Cw446kBxccBFhCoXUOrFsWz14rs+ItmQrCjmRDsaCaEjHFPTSz0tirXKaXmXHmuTkHVftP/YxwS99SUY//oTaH7mriwEj6yqBBHhAnWZgFCizSxC3FnouN9FuM48LSC8+XXrt4w7wk7mgnBjmZCsKOZEDKVR9NmzHISsVYAj2DV6cfbcMStJlL9nu60Yd4VCtM7EK07QFkJHXtTQQNH7zRUFo4Xq6nc/zlMNaBvIMhHG1RvDEtNJMrzOU8rqCpZOhkw7wk7mgnBjmZCsKOZEFCMGQPxctslBf5USfyWZ2fSdQ2pR0Iyk7cU+INq9mYcnbcPut+x2WqtNR1039JxNsV4W1gR6WE1orb6pDwrs1/puCZrVWRE4RegX2iCcLwcu0wH+0073Q7qL5qJwY5mQrCjmRDsaCaETDLruFpQASURuFrwdlVCuPczb8G2U9v0AY7VuR8HxRj477SzBgL4Bs6tlESltoSdVk4gGTgXsX8/hbJtKh2qPNezX2quWIrNUODfXVj+3bwn7GgmBDuaCcGOZkLIpRDJO4dm+GuC4kohGBJhaclGh8wXZ1lS4I/nIeWKwz+TzuZX72Wgf388w7P4XSpAppRSBhEWuifsX+3nem23KJIBPVYqnUEvxl80E4IdzYRgRzMh2NFMCHVRLVC7CkAlQbX9aWe193y7s6yqgWRggEBcZNwr31kPG6VrNhCT7DrJujcdqbxAMgD9SQJSyvanlPqZVwbMe8KOZkKwo5kQ3m2MRlUf5Mo1cRvFXjhpWXvE0OM3baagnEeq1jAJ2meonKh4TnxnleJ2Ve8RxpXgqCASuCGRvbJ8HIV3wOYvmgnBjmZCsKOZEOxoJoRMZc9UNlwKitAB86lWhZqEWeQ4m7pxdUtoB4F/P1HBksX1R+PfN7rfcbLXgfQgpkKsbsYZ0+5jerFqmm50/HTsUFm5clqDsvYnuq9zsoeSC8gPDh/oH7lmEhr/vtDMmHeOHc2EYEczIdjRTAi5do9ljeJjrdw5zYYPZbJRoXD4Q2d148CjZArlxj5rwtB2auM9lo8rH9LZqPweqaRDG56L/g+XsDoBz912dasYu6fa7ng1Hhvt4Rwu9A/sL5oJwY5mQrCjmRDsaCaETGdKkrqgnA0JgfkAMpDV5yFVKD7Was5j0gD/UocPxr+3Jyh7psSFypWgfLmcRT89JcnKOuWX0xHOXHoyHm++phUFSAbgmehvXgb+KaXUfTRewlle6ZLFx5cPek/
" </g>\r\n",
" <g id=\"patch_33\">\r\n",
" <path d=\"M 195.417241 379.446928 \r\n",
"L 195.417241 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_34\">\r\n",
" <path d=\"M 349.348276 379.446928 \r\n",
"L 349.348276 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_35\">\r\n",
" <path d=\"M 195.417241 379.446928 \r\n",
"L 349.348276 379.446928 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_36\">\r\n",
" <path d=\"M 195.417241 225.515894 \r\n",
"L 349.348276 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_7\">\r\n",
" <!-- Digit 1 -->\r\n",
" <g transform=\"translate(226.684483 223.110721)scale(0.2 -0.2)\">\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-49\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_8\">\r\n",
" <g id=\"patch_37\">\r\n",
" <path d=\"M 380.134483 379.446928 \r\n",
"L 534.065517 379.446928 \r\n",
"L 534.065517 225.515894 \r\n",
"L 380.134483 225.515894 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#pc319afe7a6)\">\r\n",
" <image height=\"154\" id=\"image5f04ea44aa\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"380.134483\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAQNUlEQVR4nO2d228kRxXGq7ure3punhmvvfbeL9lcEERRiEAKJAIEAiHeeeEf4H9A4o/hjWd4QQikiIgIoZBNFkhIdrO7WeP1eu1d2+MZz/SV56rvk9aCUPvy/d58VN1T03PcOnXqO6eiH77+y9Z4tDb2TWBr4wjGRA3cyrQRjqv6ltgS5+8mxetqYqtyMq4DJlMOybjMM+DXNlGNtmRJbCfEVnrPoyH3x0dmIjIurnCgP7eYzJX9JoaY7IJ8KJtHTS72L7P4rMmjFeLLR44mgiBHE0GQo4kg2Kio0FoR/0vdYD1iLkoC/6jF4DEltqR0I8+yhwuG4izaplfxM5cXC7CN147BNsndqL5j8Vk0Ld5/UeE85kt/ZWHMvHTH1TVZZDVkkUKef7PAzzSle21c4HVRjfc35DMjMje2uIgL/zPJmJLY0CTEl48cTQRBjiaCIEcTQbBthkEmy+b7RCxD3GIquY1JAMwWDYV7bVZglFn18V7FGk7jZ2/8BWxvDT4FWxq5wf+dYgPGPCzGYFu1M7BtpAdga1p3vjX5v94u8f7HdQ62usVrHy1XnL8PS7xuks3BVjUJ2GKyRdGJcXG0feJ+5vbxCMaUbGEBFiH+D8jRRBDkaCII1pDkqUlIjObFWnQPv8IYLSox60fCNlQKkDFVh8xrgLHcyGJccskegO1Oecb5m8Vjj4oVsG0vMS75qL0IttXMjeWudR7DmHU7Bdur+RbYhjHKQw6anvP3fjWAMfMGpSx3l+tg65HMa4/IVKyXxbUx/uZDi9fpjSaCIEcTQZCjiSDI0UQQuHqjxoSeSYiu1+e0CwsCLBrIdTVZDHQHGHgO4wXYfj/7CtjefXLD+fvTfQySyxIT2mWBtnpG1BWx+zzyEc71+1cxkfy90cdgu2Kfgi33Es7Tugtj3jm6Brb3tq6CjSlLEvKbN57yoyXqlrURKmX0RhNBkKOJIMjRRBDkaCII1tQkm88UF36Cn7kouy4lCwu2aPAvZfWgpIazk+JiZqtYBdvnM5R5fHE0cf5uGpz/sIcLC9ND0yxHKffJ1FVTLPYxWP+DeQls/Ru4aLhAFgOj2B2XkiLUz6dnwFZ9OgRb5yk+WyIYMcZb81R9/C2313E3Qm80EQQ5mgiCHE0EQY4mgmDbLCXWZwf1LcncM4l2THYeIiIn8oP/uofzqvp42YAsBh4uUMazdTwGW5a4wfNrF+7BmDeGaGPSnoR0Zvnjobsb8bs7uDux3MYv9d4KZvO/2kXp0Le77tw2iRSqn6L8Jz3G36n3iDSRIQ1i6sy9thzgveYx7pLojSaCIEcTQZCjiSDI0UQQLM3ck8VAk/53HR+jJWarowK7gLS5G/zXXdIVkmTkVzLMop/UuJA4OMGax3NDN6j/7vgTGPN29z7YFkQak5O6yHrFfWYfr23CmNtHmEXfm+IC4QtSwOovBtZJ28nrgz2wfda9CjbWUdIunt1lsmHqqKU6PornhBxNBEGOJoIgRxNBsMzVWNbfz9zHBWkHSIgaIkM6wQAeFgMdnFjdIY1IWJdGg/Nn2v/IC+BfzHZgzLkEpT0fFPidElJSfTV1A/G31u7AmO0DLFAulriY2S1Q2rPvFQefifG5vtzD7/TbMflNSGfIuMDv1HiNdtjOQN3F6/RGE0GQo4kgyNFEECyTX7Mme/HCUwGQ2IvJr5lUnEm5o6Uba9U5OyYIb5WRZnGjFBOXNYlBepa0lPY4bjDuyQwmufcbzCb7cdu1zi7OoYPJ6/ke3uvW0/Ng2xm5KpVhisnZcYINb8wIPzNqMC5MFiTZ7um76VFKm2ryIp4TcjQRBDmaCIIcTQTBnjqoZ/JrnxiD/LZDInjShdAknjqE9YYh5aCswzTDWpy/L+V+UmPHxMfxk1Pdf0a+00HtBvV7FSZnE9Ix0ZCFyyFRnyxaN4BPiIKkT5K43T5JmCdYl8rODfV/A1bXeXEDa1D1RhNBkKOJIMjRRBDkaCIIlh4o37CMsBv00bpOIgtvcsw4xx1SS+qPOcVh9cYYU5FOJAXRF8dkoXLfa/Jya4Qt3NcTrOFksLpOv/X6zSnef/cxLhDsMT7HRUHk6bUr+WYKkvXkCG1DPGJo1sN5kM0ZkPBXKG4xFwcHYNMbTQRBjiaCIEcTQZCjiSBYKrUmuwB+A5c2IYE/Ofuz7pBxKfp3XDbe32QxQHYG8gQlL2c7GMB3Mxy3f+gG0+/1r8OYlzsP8f6nXCD4Zy69v30JxnTuYsY/wqlSeXfZus+WHZXFaj0vD3G34/0NlCFlU7Kr4xGTubIFmt5oIghyNBEEOZoIghxNBMEaUh/ANP1t7gaGLPBvSODfWrKDwOQnkevzVKJCbFmM2wXsANaNwTmw7f3b1dzffIyLgV+Q86HWBphZX1T4PHYeujsP3TsoxSHlDaZEtZLJSG2Bf1js6QRTxqyQg1tPNvHhdp7ieyj1vrqdE0nTErcL9EYTQZCjiSDI0UQQLG2KRzp1+8oM1iiPHekSERUGw1cF0ONhiI312RgmeKzOeo5nSCZH7ndY+5A00/sAO3zvT8Zga0mANPY+Mpvi/ZcTchQRkUefI4qLzJOzTIn+vSQP8nznAGzxGsZtxQhjrezYjeWyI/zM3WMMMvVGE0GQo4kgyNFEEORoIgiWNcWjTVi67gLBl3YbY4xpMDBMFtiEhXX0rvNTHAFEAu6GFoAiV7v7YHun5wa2liRPOwdE3UJqSVl3an+dwhKxTApdTfCZne2hYqT23hOPa7xZn0hBrnSwGcwLm5jkvr2L0vN8z/1S2SH6weMn2FVcbzQRBDmaCIIcTQRBjiaCYNtjzDgzebcZuIFmVJIgmXxAckQaihCVh78YYJ0EG0uOkSEyjzTCYNqXPRtjTJu496tYISOBBf6s5tSXnpd9/E6Lszj/ySbWYl7r42Im8eQs+6RJjUlwR8RXfRhjzHfWPwPbg0tjsJX33frP/g7xgyNSy4szE+LLR44mgiBHE0GQo4kg2GiER7+0FgPneOZKb+IlKehjuwWk/Xs1xlrGZOll6R+RRUSM1705/hxs4xhbnv/tKdZUpk/83QgYYrp7bB4oyV6O8X+2zL2GKOS80d4Lh2D7+Yt/AtuFFGsxH3sdJHsG51qSnvmsLvVbfVwM7FzFxi+/2Xvd+due4EPrP9B5neI5IUcTQZCjiSDI0UQQLGv1Hp0m0K8w+25ybIHeDMgZSTNyFpF3/ybDIJPVes4bDMxZG/fbj9bA1ttxv7td4AcUQ8xyzzdIR8ZVnFvjnS/KagG+sf4IbJdT3AXYJJ0bc08CVJP6AL9FvDHGFGTVc8Hi/X80vgW2Wy+4zWC297E5jMXNCL3RRBjkaCIIcjQRBNvmGOOYinTl9hOvKanrTNBvWd0os/lH9BgSo8UVxpP3F2fANq0xsVvtoczZzt2YaTnC+08v4vec3sD4NJ1gsjTyOoFnpDP4Zo6xUU10MB0iDxl7Koz9GiXULB47Q5rz9cj9X81Q8v3ds25i91dXMDitdjFW1xtNBEGOJoIgRxNBkKOJIFjWXdswG1Nm+LBFREnqOskRPW3mN/rDOSSk6dvWfAy2ustqQkmDlVV33OIM+Y6XUAny9jVUjJwjQf20chcl944xcN5bYnL5QYELnAsJqjxyL4BnyVlmG8YF2EgZrRlG+B661tl1/r68gaqSrXgCNr3RRBDkaCIIcjQRBDmaCIKlzVpOAwn82YKhGWCW3g/8jTGm6bi2uodjEoxhTdXg/8qVHAPUdIJdIE9mrrKkdwMD7h9f+RhsPxndBJuvpDDGmHulqxh5N3oJxrDFAJNfr5KjiPxTjHaqMc5hgaqVRyWO20gPwLZp8XnsefLxrsV52RR9Q280EQQ5mgiCHE0EQY4mgmDpcTwpaYgSe0fo2FM2ROkQORG5v9/kperi/VlzR3Ze58s5nrG5OcFaxgdzVyL1ytoujHlzcBts14lWmZ0olBi3i+JWjhn/JekY04tRcjSK8Zk9qd2g+++zCzDmna0bYJvNUcaTJPgNcnIsUFG6813OUGYWHajJi3hOyNFEEORoIgh
" </g>\r\n",
" <g id=\"patch_38\">\r\n",
" <path d=\"M 380.134483 379.446928 \r\n",
"L 380.134483 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_39\">\r\n",
" <path d=\"M 534.065517 379.446928 \r\n",
"L 534.065517 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_40\">\r\n",
" <path d=\"M 380.134483 379.446928 \r\n",
"L 534.065517 379.446928 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_41\">\r\n",
" <path d=\"M 380.134483 225.515894 \r\n",
"L 534.065517 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_8\">\r\n",
" <!-- Digit 8 -->\r\n",
" <g transform=\"translate(411.401724 223.110721)scale(0.2 -0.2)\">\r\n",
" <defs>\r\n",
" <path d=\"M 31.78125 34.625 \r\n",
"Q 24.75 34.625 20.71875 30.859375 \r\n",
"Q 16.703125 27.09375 16.703125 20.515625 \r\n",
"Q 16.703125 13.921875 20.71875 10.15625 \r\n",
"Q 24.75 6.390625 31.78125 6.390625 \r\n",
"Q 38.8125 6.390625 42.859375 10.171875 \r\n",
"Q 46.921875 13.96875 46.921875 20.515625 \r\n",
"Q 46.921875 27.09375 42.890625 30.859375 \r\n",
"Q 38.875 34.625 31.78125 34.625 \r\n",
"z\r\n",
"M 21.921875 38.8125 \r\n",
"Q 15.578125 40.375 12.03125 44.71875 \r\n",
"Q 8.5 49.078125 8.5 55.328125 \r\n",
"Q 8.5 64.0625 14.71875 69.140625 \r\n",
"Q 20.953125 74.21875 31.78125 74.21875 \r\n",
"Q 42.671875 74.21875 48.875 69.140625 \r\n",
"Q 55.078125 64.0625 55.078125 55.328125 \r\n",
"Q 55.078125 49.078125 51.53125 44.71875 \r\n",
"Q 48 40.375 41.703125 38.8125 \r\n",
"Q 48.828125 37.15625 52.796875 32.3125 \r\n",
"Q 56.78125 27.484375 56.78125 20.515625 \r\n",
"Q 56.78125 9.90625 50.3125 4.234375 \r\n",
"Q 43.84375 -1.421875 31.78125 -1.421875 \r\n",
"Q 19.734375 -1.421875 13.25 4.234375 \r\n",
"Q 6.78125 9.90625 6.78125 20.515625 \r\n",
"Q 6.78125 27.484375 10.78125 32.3125 \r\n",
"Q 14.796875 37.15625 21.921875 38.8125 \r\n",
"z\r\n",
"M 18.3125 54.390625 \r\n",
"Q 18.3125 48.734375 21.84375 45.5625 \r\n",
"Q 25.390625 42.390625 31.78125 42.390625 \r\n",
"Q 38.140625 42.390625 41.71875 45.5625 \r\n",
"Q 45.3125 48.734375 45.3125 54.390625 \r\n",
"Q 45.3125 60.0625 41.71875 63.234375 \r\n",
"Q 38.140625 66.40625 31.78125 66.40625 \r\n",
"Q 25.390625 66.40625 21.84375 63.234375 \r\n",
"Q 18.3125 60.0625 18.3125 54.390625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-56\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-56\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_9\">\r\n",
" <g id=\"patch_42\">\r\n",
" <path d=\"M 564.851724 379.446928 \r\n",
"L 718.782759 379.446928 \r\n",
"L 718.782759 225.515894 \r\n",
"L 564.851724 225.515894 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#pe90187bdf4)\">\r\n",
" <image height=\"154\" id=\"image7968d62fcd\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"564.851724\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAANx0lEQVR4nO2dy24cxxWGq6/TMyQlUpbsyE6MIICRhZFNHiKvkWfOIrsACRLHcQyLkkjOpadvWVf9H62OTJQ2/7ebg+6e6p7D5jlV/zlV/Onyz0tIWPo+NYWirmNDVckxSFmqbRj0+tttbEi/7zGWGWxySyEUhR72sI8+z3DfodDxl22jh6XjDyEUmzb+vv6s1weWMxw3TWpLnq38RiGEsNnouGr47eD3pPEup1P8+XjUY8ZRbOAFxjw9djSTBTuayYIdzWShLr7+Uoxlr8H6UiU+2WjguTQQZEIQToy7OMCW7wshFLMG+cWgQTIeN2rSUBzjYLc+r7jvEMKy0wB73miCkCYlNIZANqCgBGdecS4kYwuch78dXL4Y4kC/pARncDJgPhF2NJMFO5rJgh3NZKE+/ea5GMtBo8CpjX1ybtVH5wZm38GVx40eNyW2GSa5S40xQ33SIJmOKwc9rtnHiUTVa2KxlDrWcauB89TBjUL8/pSUY/wFdI+cGNHKiZoWsBWJa5QTJFlwfb/RTBbsaCYLdjSThfr4UoOhAoQCUxv/wx5VrBDmFuKZDq4F505t/H99gflDir2qE6grYA6xPqmtuY/PbQ76pQXNk9Z6n8MW4s7k3pdKj5lJBENz3BQvJc+jPuhgKYatziuDR1K8JCb6nQi/0UwW7GgmC3Y0kwU7mslCfb7UgI8D4PjzuIPAf6fnjRd6sXEH6oEkGQgbyEhGUHRAMlAd1FYfKBBPJ4khsYAEhJ7PCMnA4askwYETKZheavoB9PpVojxvHvSY5h5sexgHJBszCFLSRIiOwUROTcY8PXY0kwU7msmCHc1koSbFBa34pysDUyuHhGkD53UQeF5ooN/sYhn1druuBvJwUFn12OjgllIj1HIofvZzCI9JqMGkwwjnl+nUPSgpGlA/QNIwDzr+eZ/YQCpTjHpPlOCQ0iRV1ISgCd8E9z1trd4wnwg7msmCHc1kwY5mslCTZGSVdIVmkkF+PXca7HbPtJnKr67vos83m4McU0KQ/P5KNUffNddi6yddthiTVQWaWacgmZ4PyaGKTXzvV9d6T7uNJj2HXpOZ/qwP91wmTWT2el4JCywI3HoqFQ8hhCJZQhieg+z/Sr/UbzSTBTuayYIdzWTBjmaygG0VSQaTzian9X2P2fD68AV1GZ/cVTp9va20CQslCIcr1a7856i2MQm6J5DUUP0B1kCS3CcZ2gxanAVsVUmrBXD96cMNdKj+I601COGR8UNNa5oIzQ0kDCDx8hvNZMGOZrJgRzNZsKOZLNTUhGUV1CdkdV0qyUhi20WtUfh1ozPrF7WuMhxGnSF/f6krCPtTHNmer0AmBDIbus+F0qoVwfov4iMvTzIhzOOoHiC5T6n1CCF0O0ja1g3NmF+GHc1kwY5mssD74FAMskK9gV2cIU6hycc0bmtAdrCB4IImbF9s9mK7u1B5xfkcx2jTPTTYg3pQUkTM1YdrMWeozSSqEhqzVDCJm9rw+autnECxA41rKH5PJ3aLTr9g12nc7DeayYIdzWTBjmayYEczWWD1BgWQaQfoMwTJ0PGxgFrJAWoUH85xgeADTLpeQdvGBgZLKo9nGz33to3l3fstyJKh2/YCig7sfJgE/2uSoBBYvdFUoIhI6kQpeKca3WXltkl0T2ntbtnC82+8RY/5RNjRTBbsaCYLdjSTBU4GVswwYyt2CJKrowae5wcN9N81sbritruQYy5B0XGRtj38P5CgG2fCSddORZAfOQZIBqgUs4QEoUwShBmayEwb6GIJW/lgd0dq5JM07dl2mnhdd0f9Tr2UMU+PHc1kwY5msmBHM1moMfAnmfb8859DeKSGkCJbkEenkp3jqNFpP2nukkrAQwhhP2obQjpX6ixJir5GMvXYuSvqXMdZ/9ZbWAWgtK1KEpURZNXpflQhaNv4ELSjZwjczXFOVk+oSc0Okja/0UwW7GgmC3Y0kwU7mslCTYEttXZPNeXc/h3OgxnntBNiCCE0TRwAb6DJC9UHzFC8cIaWjMdBB5LKlbC+AXT+a+tX10CB/6bWe68oaUjkOCdKBuA3oX2rqC51hDbuaY3ARauBf0fNePTyxjw9djSTBTuayUI90H6dtAVNEpON2soC/6dPl3qxCuS/V9t4FpH+z1OtZ40zwjA2iHGkzhJjNLgY2ShuS76SdvshqGEfUafxXasDo0Z5tPUOTtLTZHXyjCj2pd4nfqOZLNjRTBbsaCYLdjSThRq32qEGbIlLru3KTXWd1Ik6rW+kgJIUGHWtyUBLSQNIoWUMVM8K8vRS8xQs2pybeEJ4vNGJ5G2tF7to1jUXnOckI6PGf2sTEKjhpC2X0v1F1zzXEPxGM5mwo5ks2NFMFuxoJgt1vacavw93/6MgeW0H6/NWo8z3mziw3YCqoYfo9KqAxi+QDKDSOlktKFdudI+lpFTqmQxjISXIiu2KHrPJCgIkXhU144F7IjUONY0p63gcpDShsfqNZrJgRzNZsKOZLNjRTBbq9h46Aq5o+02rByOtAkBDlPKo09B9sp/meAmyHlhRuB+0cPFtvxPbw0k1zdMpTi5amPHHWtW1s+1J0xWSok/wsFHStEI6hFJ0CPwpkaPujnTvc/IdVBjcUpt+vZQxT48dzWTBjmayYEczWairM4nF1ZTKSCjwXGAPo/Ij96ycIPh9gOYtd5AM/HTQbpH7g55bHOKbqk7rZtEL2EuJHtqc1FluGo2uaRWDmCBBIJuMihpWQtJD3R1J9kUSr5QGTvQbzWTBjmayYEczWXikKzf0XEikygUUKdLWLytLFCXE2fcQNAAUp7y716LT6U6v19zF51YqBAnVCZ7FyoaDSzJhu3JnnNWs6Sq+ZrulEDg+Jdtwjr9khAlnmpj2G81kwY5msmBHM1mwo5ks1BVs10Ir/kWi1iggyieJM27bQ0HmIc5L9kEnYodBc5cJJoSHO52crd+rPKFOtg+i8eOE7cqa1rKP/45PJ5W83PV6n1Ojf//UXHANlAzQfVICiM1gkknud0dQz2w0GfMbzWTBjmayYEczWbCjmSzUNJtfQBVkuhKAwS/VRYJSoDrQdjBxkCndGEMIp546kUBScqfHNXcfTl6qHma0IRkg6Lj6If7O86UmA/c7TVxIG0L7esrKwErot2sO6/bwrB/id9Pdvcrmf2gs5TafCDuayYIdzWTBjmayUNN2LRXE3LK1JW1gD9BG8Zg09LFtqahTpP5dUEdJlLzQCkVio8SFJDUkfeJzP9xengJ/2rbneasapjQZeLvTIHzq9Mek1v3tvdpINpWuphwhQbuHGlq/0UwW7GgmC3Y0kwU7mslCPeygHhEC8TVQcxiKdlG6kgTmSw3jIk08JBZVD8kGyX0S29paAHo6lCCkdZ3pXpchhHCx0Szl9e5Obd17sb0b4ln52xudpd/faK0E1eRiF0si/T0HaFIzQR3Byssb84uwo5ks2NFMFuxoJgs17fdD4AapCRQQ44ajJDFKZ/ixjwp1LIFxrLWlk9rYwn1de0eqoUhbqtedLh883+j0+1fbd2L7ZvtfsfWJjudNr81t/vJCbUOv+p9Rcw3ubJncZgHJwHBWp/IbzWTBjmayYEczWcD9OqmeL42ZqMkLgSqMNfESXavR4G7Z6jhOHTStuwV5933SYRrUCjR5TXEbdr9O5menUcdwCXtz3tQHsV2Uelxq+/0zjeP+dvNSbMP3GqPRb049AlNFR3MLMdqktZ5+o5ks2NFMFuxoJgt2NJMFnq4lJUJ6JLUvhPyAgnzqAD128clzB52dtxpxNxu1jdAMBpTWYanjwRVQI8qybZicBUn8ksx4FtC1nPa27EAXfl3txXZRxMqPfacS6t++eC22v77SSdxmD64AyZHs20rqmaPVG+YTYUczWbCjmSzY0UwWatyTEZp7rJm5p9V+Og9tSav0ZaNBctPqYHcdFGyC7aHSQHnYxDc6N3rjc6t/i1TvCJPhYdolG93DFj203yVRQaa1S1YGvmpu5ZjfXf4ktn98/kJsp/tnYmvfQwOgtOM8ZFlp7WcIfqO
" </g>\r\n",
" <g id=\"patch_43\">\r\n",
" <path d=\"M 564.851724 379.446928 \r\n",
"L 564.851724 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_44\">\r\n",
" <path d=\"M 718.782759 379.446928 \r\n",
"L 718.782759 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_45\">\r\n",
" <path d=\"M 564.851724 379.446928 \r\n",
"L 718.782759 379.446928 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_46\">\r\n",
" <path d=\"M 564.851724 225.515894 \r\n",
"L 718.782759 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_9\">\r\n",
" <!-- Digit 1 -->\r\n",
" <g transform=\"translate(596.118966 223.110721)scale(0.2 -0.2)\">\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-49\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"axes_10\">\r\n",
" <g id=\"patch_47\">\r\n",
" <path d=\"M 749.568966 379.446928 \r\n",
"L 903.5 379.446928 \r\n",
"L 903.5 225.515894 \r\n",
"L 749.568966 225.515894 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g clip-path=\"url(#p3b42bfde10)\">\r\n",
" <image height=\"154\" id=\"image5acd0cbbe2\" transform=\"scale(1 -1)translate(0 -154)\" width=\"154\" x=\"749.568966\" xlink:href=\"data:image/png;base64,\r\n",
"iVBORw0KGgoAAAANSUhEUgAAAJoAAACaCAYAAABR/1EXAAAPf0lEQVR4nO2dW28b1xWFz9zI4VWUdbFkybGcNG7coEnaAgWKAkVfC/SP9T/1D6RAg8Rp6qSJk9S3WJYsUSRFDjkX9qUv56wVmCia7Zf1vXHjzPDMcGu09p599on+8Ke/rF1AUtShycUr37aOIxhT9TOwjd8mtg8qsN06Ofc+3xudwZh3umjrJwXYynWCtiYFWzdZep+zCK+b2VoRzr8bL8E2b9re5+vgs3PO3c5ega1xMdhW5JqKxr+3xboFYxhs/vzacVx4TWfVAMacl2jDKxLiJ0COJkyQowkT5GjCBFTIjgt9ZguJVw3YkiXEGi4u0L+L0p9K2aD4rdeb/V00ZFwo/J1DATyIFzAmiXD+O8lso3kkzj92tcbb/dXycKNzMcL5d+MVjNlU+CcOf7tQ+Dvn3Ljuep/30imMYTY90YQJcjRhghxNmCBHEyakdU6Ef4L+17R8W3aFwjNZoshMCxIMrPA7l2WQ5a5ROM9qFKeNw3OxQGI7Q7EbwjLryxrfbDCYmA7fBLwshzDm0XwPbFerHGwVeTPQin2hv59jkHKrPQbbYYa2vXQCtlE0B1t4Tey4gwRteqIJE+RowgQ5mjAhbZLXJ2Kdcy4KhjU5agZGkzINiLotS3x9l8aoeViiMaxgcM65i1UPbEtSvbEMjmV6b1KiXspiokUjnO+rpZ/cvChwXpMCded01gFbNcPrjJb+c2Kd4X3t7KLO+uDwOdh+P3oEtjstrJYZJf75mB7rkiSxnmjCBDmaMEGOJkyQowkT0ookbOOaBAiBzlwnKK7jCsUo0epuTU4fBVUSYTLSOee6CSaJGdMYBfx31ztgC8X5y0kfxhQzFOvrFfn7jPHaXemPixd4XPuSVJpg8YPrnGOw0b7ybWUXzzV9C5PEf3sfr2lwH6tb2sMSbMOgwuWsxrJtVrKuJ5owQY4mTJCjCRPkaMIEGgyQJLcLiweaFH2UVWqEQYRzziVL/M7F0q+cKEjVBCvl3kox890hJc3nCxT6z89H3uf43xhEbD3DubamJOghL0rCKnDyYsPlY1JqPSOZdbLWNqr9HyodYPVJ2UPb4hXe239e3sR50Dcgvu26QuH/7RQDLz3RhAlyNGGCHE2YIEcTJqTM1ZiwDYOBNRH00RpFMgsQsil+6fwqaB4yQvE+66LwZOs1a9YkpSbrRK98Ubz1PQxxu59imj65IOs6Ezx/E8yX3Z9yGwOQso9vXcp9FPV12/8Nyi4MceWQvIYhwd7ZJWb4P2mOwbZY+fdseoUlTelzvRkQbwg5mjBBjiZMkKMJE1KWuSd9TVxYtZOscFBUk2AAtbrLSBlMVPhimol31skxbKTiHG92wtYgRJUvlFPs8QKdLp1zzp1fgKkeX+GxA19gRzkKf7d9G0zLIf79z26TAOoomBsp64nI+gz2m1crvLenj2+ArXXujxs9xXP1TvFe64kmTJCjCRPkaMIEOZowga17peUs4bikJM1byJoB1imSdoEkbxpC2ALidowCeDu7BtutPor1Zz1f7BY7KIjnx/iGorfAxizxigjxcNX1Fp6rbuHf+pos6i57eM96x35UdX/vFMa0SKnPOVnI/P05Cv/mB8zw3/jCn8fW1/iWJL7C0i090YQJcjRhghxNmJASiUO1FpQlNxuWbZNO3XGJ/h2Vvi4JqwSc441aWAfuQYzb9tzt4VY4L479NY9PStRedRu/czXYBVvnzghs6cy/uesM51p30BYT/ZuQTuaLhV/RMStRU530Mbm820ZdVVR4v59FqCnzCz9zn7wi2fcF3n890YQJcjRhghxNmCBHEyakTPizZGyYK90kqescb+hC+re4MCgJ13k659y0wuqHaY02Vt69S0pGfrf/nT+mgyL5y11c73h6hAnP/Aznm5/5AputB2Wl7qHg/u9IsFzFfu32w+kRjDk7QkH/6/0nYOtmWPHCdkRabvvzyIdYPx6Rru56ogkT5GjCBDmaMEGOJkxIN9wCE9YkRuztAXlbwGoyaAAStDJfrYj4JVvXXLZQjLKS7+MWZshvpn5FBwsY+hkGFg/zA7BdbJOW8zf8TH02xbvRf4K2Nmn80n+C2fb2JNjW6Du87vG7+Bbjk9+Ayd3oYMVFvYXzmJz435kucD1o/hIDIz3RhAlyNGGCHE2YIEcTJqRsr6aaZPjDPaM6U6wviklJEP3SJYrW8M1ATcZMyb5M12QPzz55MzBIcNFmHpEaqYBZF7+TdaNspyicpwN/bsUSj7skmfWSNLMZfYvn7zz1S9a73+B1t6ZYov28j7boPQzQbhxi+fuF2/I+JwXZo4q4gZ5owgQ5mjBBjiZMkKMJE+ibAfq2YIP9Y+k6AmJLClSL6SIQ/2S/papBG9szKicLIcY1Zu5bwQam3RjF9L38BdjY+tI8we88zfw1Cdc56do4xDWoL3dw/6ayj50VbwYtHrtfoHjvP8S1Ejtb+/idvW2w3XsXN5B99/1z7/PH6ds4V9JyXk80YYIcTZggRxMmpGssknBNwzpu+58Xu5ioSwtMsrYmqKFYw744aOwXrUj/CdKcjzXd20qwEuGyQo12Vfm6h3XzZrrwWTEC2xnZAqiogrJnktQdkOqQwzsTsP0jOwTbxdz/zvbZFoyJv8ay7Z2P8d7O91G3zU5Qa/354HPvc+8XeP8f7N/CeYBFiJ8AOZowQY4mTJCjCRPSsovCMEYNCAJ+RTpHs1JlBm3+F9iimlSVsEWiBJZ4jUmr8b9fveV9/uocBfF0gonS9ZxFUGhq7/oVIx8dPcNBhKN8DLbqEAOhh4d+gFPcxEqQ7vc41/XTH8DWf4Yl35MFqVwJosePBhhs3O2eg01PNGGCHE2YIEcTJsjRhAlpiYUCUFbtnMNuLWwbSNJNOiKbf7anZFP4YNliTN4MtBM8jpVtN+Tvh631PMj9DPznJWa0sydkj9BnODfWwGV64q95fBDj+f945xuwsTcUX73AQKX/ONhiaE467xxgF0uXke2P+nhNyyUGEp9N/C2FPhxiMMDW0OqJJkyQowkT5GjCBDmaMCFlGe2IdWQkOjOEbb3D9vVMSJfDuOPbWDAwJV0gZ2Rd54rUPs0bPPa68o+tK/y7SwucR36JN633AstlsoVfSnXRYOT11+oe2Npt/AHqx1jm1A7mEVU4r2qI2f3VCO/FfB+vc2+EHTCHmR+13crGMOad7CXY9EQTJsjRhAlyNGGCHE2YkHZPWfdFHAhdGsmbAdYSvjUhbwFm+OqhlYZZbhT0rCX8pMIyHvYWgK0tGGX+2oJOB8csOlh6Q07v0ike27v2rzMmc726xrUGDS7HcDvkdxo89n+omAQDy20MlmZHeG+LQ/ydjsgep8ftS+/z7QzXjf4s015Q4g0hRxMmyNGECWnvFP83J0u2x+YGTfZI6414ieePC0xIpm1f+DCNNiNN39genqw3xjDGRnwukEx3t7HS4bN9TJROp6gV21eo5doXvm6LSUJ7++vXNwN0jvcrCXudFLuYnJ0doaCcHeP5O4eYnL0/wL4jP8/9MvCTFI/bjvFe6IkmTJCjCRPkaMIEOZowIaVb7RDbJh231zEp5SYtvqOaBCCFb2NVH2uy1rPacI8h1pzvKPaTjx+OnsKYs2MMBp43O2C7XGGg0nnpC3E21daMlc+gaTkk5ddBw7v5AR64OMbAa3iAWxH99vAx2O7n2Ijvvdap93krxnk1JCrUE02YIEcTJsjRhAlyNGFCWufoa2uyPrNpvd4n2XY/Ecncp3MUzuF3skYwa7Jtz3WFWfolKX+ISc36TuJntVkH7tkeVj88yDCweNTCdZeLU39u7JoS0iWTUXVRYFfbvtDv7WKny1/tYln1L7dQ5LNr30ux82QdRCoXNQYbFw7fwuiJJkyQowkT5GjCBDmaMCGtWyjg6bY9gaavSXBAtrGk5JuUgZOSI1fhgVdLLI8+r7A8+k7rDGxhOdFJRsYMUOye5Fi+/GnvNtge3fK7KJaklfyclKczem0sFT/o+WL9bg/ndZJj98UTci/2EnxbUKzxBx03finSGEbwUno90YQJcjR
" </g>\r\n",
" <g id=\"patch_48\">\r\n",
" <path d=\"M 749.568966 379.446928 \r\n",
"L 749.568966 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_49\">\r\n",
" <path d=\"M 903.5 379.446928 \r\n",
"L 903.5 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_50\">\r\n",
" <path d=\"M 749.568966 379.446928 \r\n",
"L 903.5 379.446928 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_51\">\r\n",
" <path d=\"M 749.568966 225.515894 \r\n",
"L 903.5 225.515894 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_10\">\r\n",
" <!-- Digit 2 -->\r\n",
" <g transform=\"translate(780.836207 223.110721)scale(0.2 -0.2)\">\r\n",
" <use xlink:href=\"#DejaVuSans-68\"/>\r\n",
" <use x=\"77.001953\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"104.785156\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" <use x=\"168.261719\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"196.044922\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"235.253906\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"267.041016\" xlink:href=\"#DejaVuSans-50\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <defs>\r\n",
" <clipPath id=\"p48f6c38c3c\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"10.7\" y=\"24.802047\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"p938aaf3316\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"195.417241\" y=\"24.802047\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"pc3b91751e9\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"380.134483\" y=\"24.802047\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"pafd654d0b3\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"564.851724\" y=\"24.802047\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"p674679b9d7\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"749.568966\" y=\"24.802047\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"pf20e339346\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"10.7\" y=\"225.515894\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"p8184f618cd\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"195.417241\" y=\"225.515894\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"pc319afe7a6\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"380.134483\" y=\"225.515894\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"pe90187bdf4\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"564.851724\" y=\"225.515894\"/>\r\n",
" </clipPath>\r\n",
" <clipPath id=\"p3b42bfde10\">\r\n",
" <rect height=\"153.931034\" width=\"153.931034\" x=\"749.568966\" y=\"225.515894\"/>\r\n",
" </clipPath>\r\n",
" </defs>\r\n",
"</svg>\r\n"
],
"text/plain": [
"<Figure size 1152x1152 with 10 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
2021-03-30 00:07:48 -07:00
}
],
"source": [
"plot_random_images(grayscale_train_images,train_labels,2,5)"
]
},
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "7e7iSyWXz_GN"
},
"source": [
"## 2. MLP neural network classifier\n",
"* Build an MLP classifier model using the Sequential API. Your model should use only Flatten and Dense layers, with the final layer having a 10-way softmax output. \n",
"* You should design and build the model yourself. Feel free to experiment with different MLP architectures. _Hint: to achieve a reasonable accuracy you won't need to use more than 4 or 5 layers._\n",
"* Print out the model summary (using the summary() method)\n",
"* Compile and train the model (we recommend a maximum of 30 epochs), making use of both training and validation sets during the training run. \n",
"* Your model should track at least one appropriate metric, and use at least two callbacks during training, one of which should be a ModelCheckpoint callback.\n",
"* As a guide, you should aim to achieve a final categorical cross entropy training loss of less than 1.0 (the validation loss might be higher).\n",
"* Plot the learning curves for loss vs epoch and accuracy vs epoch for both training and validation sets.\n",
"* Compute and display the loss and accuracy of the trained model on the test set."
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 8,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {},
"colab_type": "code",
"id": "l14VCBFVz_GO"
},
"outputs": [],
"source": [
"def get_mlp_model(input_shape):\n",
"\n",
" model = Sequential([\n",
" Dense(64,activation = 'relu',input_shape = input_shape),\n",
" Dense(64,activation = 'relu'),\n",
" Flatten(),\n",
" Dense(128,activation = 'relu'),\n",
" Dense(128,activation = 'relu'),\n",
" Dense(11,activation = 'softmax')\n",
"\n",
"\n",
"\n",
" ])\n",
"\n",
" model.compile(\n",
" optimizer = \"adam\",\n",
" loss = \"sparse_categorical_crossentropy\",\n",
" metrics = ['accuracy']\n",
" )\n",
" return model"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 9,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 357
},
"colab_type": "code",
"id": "7eUgirn1pTWS",
"outputId": "913e6df2-c806-497c-d10e-816c446f5b56"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
2021-04-01 03:16:00 -07:00
"Model: \"sequential\"\n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
"Layer (type) Output Shape Param # \n",
"=================================================================\n",
2021-04-01 03:16:00 -07:00
"dense (Dense) (None, 32, 32, 64) 128 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense_1 (Dense) (None, 32, 32, 64) 4160 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"flatten (Flatten) (None, 65536) 0 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense_2 (Dense) (None, 128) 8388736 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense_3 (Dense) (None, 128) 16512 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense_4 (Dense) (None, 11) 1419 \n",
2021-03-30 00:07:48 -07:00
"=================================================================\n",
"Total params: 8,410,955\n",
"Trainable params: 8,410,955\n",
"Non-trainable params: 0\n",
"_________________________________________________________________\n"
]
}
],
"source": [
"model = get_mlp_model(grayscale_train_images[0].shape)\n",
"model.summary()"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 10,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 717
},
"colab_type": "code",
"id": "beEZO1kvz_GR",
"outputId": "0f9d1b8c-9422-4270-d9e8-9861d415d7c7"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Epoch 1/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 1.6253 - accuracy: 0.4408\n",
"Epoch 00001: val_accuracy improved from -inf to 0.65784, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 233s 120ms/step - loss: 1.6253 - accuracy: 0.4408 - val_loss: 1.1043 - val_accuracy: 0.6578\n",
2021-03-30 00:07:48 -07:00
"Epoch 2/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 1.0069 - accuracy: 0.6870\n",
"Epoch 00002: val_accuracy improved from 0.65784 to 0.70907, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 244s 126ms/step - loss: 1.0069 - accuracy: 0.6870 - val_loss: 0.9389 - val_accuracy: 0.7091\n",
2021-03-30 00:07:48 -07:00
"Epoch 3/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.8827 - accuracy: 0.7282\n",
"Epoch 00003: val_accuracy improved from 0.70907 to 0.73164, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 254s 131ms/step - loss: 0.8827 - accuracy: 0.7282 - val_loss: 0.8736 - val_accuracy: 0.7316\n",
2021-03-30 00:07:48 -07:00
"Epoch 4/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.8145 - accuracy: 0.7509\n",
"Epoch 00004: val_accuracy improved from 0.73164 to 0.73655, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 250s 128ms/step - loss: 0.8145 - accuracy: 0.7509 - val_loss: 0.8578 - val_accuracy: 0.7366\n",
2021-03-30 00:07:48 -07:00
"Epoch 5/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.7623 - accuracy: 0.7660\n",
"Epoch 00005: val_accuracy improved from 0.73655 to 0.75312, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 259s 133ms/step - loss: 0.7623 - accuracy: 0.7660 - val_loss: 0.8117 - val_accuracy: 0.7531\n",
2021-03-30 00:07:48 -07:00
"Epoch 6/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.7200 - accuracy: 0.7816\n",
"Epoch 00006: val_accuracy improved from 0.75312 to 0.76349, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 253s 130ms/step - loss: 0.7200 - accuracy: 0.7816 - val_loss: 0.7769 - val_accuracy: 0.7635\n",
2021-03-30 00:07:48 -07:00
"Epoch 7/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.6870 - accuracy: 0.7912\n",
"Epoch 00007: val_accuracy did not improve from 0.76349\n",
"1946/1946 [==============================] - 254s 131ms/step - loss: 0.6870 - accuracy: 0.7912 - val_loss: 0.7934 - val_accuracy: 0.7590\n",
2021-03-30 00:07:48 -07:00
"Epoch 8/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.6575 - accuracy: 0.7998\n",
"Epoch 00008: val_accuracy improved from 0.76349 to 0.77923, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 253s 130ms/step - loss: 0.6575 - accuracy: 0.7998 - val_loss: 0.7486 - val_accuracy: 0.7792\n",
2021-03-30 00:07:48 -07:00
"Epoch 9/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.6316 - accuracy: 0.8075\n",
"Epoch 00009: val_accuracy improved from 0.77923 to 0.78606, saving model to /content/checkpoint_mlp_best\\checkpoint\n",
"1946/1946 [==============================] - 270s 139ms/step - loss: 0.6316 - accuracy: 0.8075 - val_loss: 0.7351 - val_accuracy: 0.7861\n",
2021-03-30 00:07:48 -07:00
"Epoch 10/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.6104 - accuracy: 0.8145\n",
"Epoch 00010: val_accuracy did not improve from 0.78606\n",
"1946/1946 [==============================] - 248s 127ms/step - loss: 0.6104 - accuracy: 0.8145 - val_loss: 0.7439 - val_accuracy: 0.7826\n"
2021-03-30 00:07:48 -07:00
]
}
],
"source": [
"early_stopping = EarlyStopping(monitor = \"val_accuracy\",mode = \"max\",patience = 3)\n",
"\n",
"\n",
"\n",
"checkpoint = ModelCheckpoint(filepath = '/content/checkpoint_mlp_best/checkpoint',save_freq = \"epoch\",save_weights_only = True,verbose = 1, save_best_only = True,monitor = \"val_accuracy\")\n",
"\n",
"history = model.fit(grayscale_train_images,train_labels,\n",
" epochs = 10,\n",
" validation_split= 0.15,\n",
" callbacks=[early_stopping,checkpoint],\n",
" verbose = 1)"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 11,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 295
},
"colab_type": "code",
"id": "pPPbzGhVz_GW",
"outputId": "514028b1-670c-4e13-e206-51abc942834a"
},
"outputs": [
{
"data": {
2021-04-01 03:16:00 -07:00
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYgAAAEWCAYAAAB8LwAVAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAA3hUlEQVR4nO3deXiU9bn4//edfSU7WwIkYQdRxAAKilrrvqBWq6itnp6j1dZabW21/drWtvaq5+j3++ui1VKrPbVarDvuW6tYgkIUZEezASEsyYTse3L//niehCFMIMtMJsv9uq658uxzzyjPPZ/l+XxEVTHGGGO6Cgl2AMYYYwYnSxDGGGN8sgRhjDHGJ0sQxhhjfLIEYYwxxidLEMYYY3yyBGGMOSYRuUFE/h3sOMzAsgRhgkpE3heRgyISGexYjDGHswRhgkZEMoHTAAUuGeD3DhvI9zNmKLIEYYLp68BHwF+A6713iMgEEXlBRMpExCMiD3ntu1FEtolIjYhsFZF57nYVkSlex/1FRO5zl88QkRIRuUtE9gFPiEiSiLzqvsdBdznD6/xkEXlCRErd/S+52zeLyMVex4WLSLmIzO36Ad04L/JaD3OPnSciUSLyN/fzVYrIOhEZ05MvTkROFpFc97zPROQMr33vi8ivRWStiFSJyMsikuy1/xIR2eKe+76IzOzJ9+7uf9D9LopE5Hyv7TeISKH736RIRK7tyecwg5slCBNMXweecl/ndtwcRSQUeBXYCWQC6cAKd9+VwL3uuaNwSh6eHr7fWCAZmATchPP//xPu+kSgAfC+IT4JxACzgdHA/+du/ytwnddxFwB7VXWDj/f8O7DMa/1coFxVP8VJignABCAFuNmN4ahEJB14DbjP/Tx3As+LSJrXYV8HvgGMB1qB37nnTnNjuh1IA14HXhGRiKN9766FwA4gFfgf4M/iiHWvf76qxgOLAF/fhRlqVNVe9hrwF3Aq0AKkuuvbgTvc5VOAMiDMx3lvAd/t5poKTPFa/wtwn7t8BtAMRB0lprnAQXd5HNAOJPk4bjxQA4xy158DftjNNae4x8a4608BP3WXvwHkAsf38ru7C3jSx/dyvbv8PnC/175Z7mcPBX4C/MNrXwiwx/1+jva93wDke63HuN/3WCAWqAS+AkQH+/8te/nvZSUIEyzXA2+rarm7/jSHqpkmADtVtdXHeROAgj6+Z5mqNnasiEiMiPxRRHaKSDWwCkh0f0lPACpU9WDXi6hqKbAa+IqIJALn49z4j6Cq+cA24GIRicEp8Tzt7n4S58a+wq3G+h8RCe/B55gEXOlWEVWKSCVOwh3ndcxur+WdQDjOL//x7npHfO3usekc/XsH2Od1Xr27GKeqdcBVOCWgvSLymojM6MHnMIOcNdSZASci0cBXgVC3PQAgEufmfALODWuiiIT5uFntBiZ3c+l6nF+2HcYCJV7rXYcu/j4wHVioqvvcNoT1gLjvkywiiapa6eO9/hf4L5x/Q2tUdU93n5dD1UwhwFY3aaCqLcDPgZ+7Dfav41Th/Pko18KN7UlVvfEox0zwWp6IU1orB0qBOR07RETcY/cATXT/vR+Vqr4FvOX+t70P+BNOBwQzhFkJwgTDpUAbTtXHXPc1E/gQp+58LbAXuF9EYt3G3MXuuY8Bd4rISW799xQRmeTu2wBcIyKhInIecPox4ojHqfOvdBtxf9axQ1X3Am8Af3Abs8NFZInXuS8B84Dv4rRJHM0K4BzgFg6VHhCRM0Vkjltiqca5ibcd41oAf8MpkZzrftYocRrhM7yOuU5EZrmlll8Az6lqG/AP4EIROcstrXwfJzHkcvTvvVsiMsZt+I51r1Xbw89hBjlLECYYrgeeUNVdqrqv44XTQHwtzi/4i3Hq73fhlAKuAlDVZ4Ff4dxoa3Bu1B09dL7rnlfpXuelY8TxGyAa55f1R8CbXfZ/DeemvR04gNOwixtHA/A8kAW8cLQ3cZPNGpzG22e8do3Fab+oxqmG+gDn5o+IPCoij3Zzvd3AUuDHOG0Gu4EfcPi/5ydx2mD2AVHAbe65O3Aa2H/vfu6LgYtVtdlNID6/92MIwUk0pUAFTmL+Vg/OM4OcqNqEQcb0hYj8FJimqtcd8+ABJCLvA39T1ceCHYsZ2qwNwpg+cKuk/hOnlGHMsGRVTMb0kojciFOt84aqrgp2PMYEilUxGWOM8clKEMYYY3waVm0QqampmpmZGewwjDFmyPjkk0/KVTXN175hlSAyMzPJy8sLdhjGGDNkiMjO7vZZFZMxxhifLEEYY4zxyRKEMcYYnyxBGGOM8ckShDHGGJ8sQRhjjPHJEoQxxhifhtVzEMYYM9y1trVTVtvE3qpG9lU1sreqkZa2dm4+vbt5tPrOEoQxxgwSLW3t7K8+dOPv/FvdQGmls36gppH2LkPojY6PtARhjDFDVVNrGweqnV/+e6savBJAQ2ciKKttouv4qTERoYxLiGJ8YjRTR6cyLiGKsQnR7t8oxidEMyo6MLdySxDGGNNPjS1th/3a31vVyN7KQ+v7qhopr20+4rz4yDDGJTo3/BljRzE2IYpxCVGMSzyUAOIjw3CmDh94liCMMeYo2tuV8rom9hx0qnn2VNaz52ADeyob2FPZyL6qBg7WtxxxXkJ0eOdNfk56AuMSog8lgIQoxoyKIj4qPAifqOcsQRhjRrTm1nb2VTVS4t74O5NAZYOzXtVIc2v7YefER4aRnhTN+MRo5k1MPKLaZ1xCFDERQ//2GtBPICLnAb8FQoHHVPX+LvsTcCZpn+jG8qCqPtGTc40xpidqm1rdX/wdv/wb3Zu/kwQO1BxZ758WH0l6YjSz0xM4Z/ZY0hOjnZebFBKiB/cvf38JWIIQkVDgYeBsoARYJyIrVXWr12HfBraq6sUikgbsEJGngLYenGuMGeFUlfLa5s5f+3sq6ymtbKSkowroYD3Vja2HnRMeKoxLcG74p01NO+zmn57oVANFhYcG6RMNLoEsQSwA8lW1EEBEVgBLAe+bvALx4rTAxAEVQCuwsAfnGmNGgKqGFnZX1LOrop6dHufv7gq3Cqiy4ajVPzmTkjqX0xOjyUiKJi0ukpCQ4DT6DjWBTBDpOBO7dyjBufF7ewhYCZQC8cBVqtouIj05FwARuQm4CWDixIn+idwYM2Ba29rZW9XI7op6drqJoCMJ7PTUU9VweANwcmwEE5KimTVuFGfPGtNZAhjvlgJGSvXPQAhkgvCVorvU9HEusAH4EjAZeEdEPuzhuc5G1eXAcoCcnByfxxhjgqumscW58XsOJYCO156DDbR6PfkVFiJkJEUzMSWW4zMSmJgc475imZAcPeh7/gwngUwQJcAEr/UMnJKCt/8A7ldVBfJFpAiY0cNzjTGDRFu7sq+60U0Ade7Nv8FNCnVHdANNjAlnYnIMc9ITuHDOuENJICWGcQnRhFoV0KAQyASxDpgqIlnAHuBq4Joux+wCzgI+FJExwHSgEKjswbnGmAHU2NJGsaeO4vL6zjaBjlfJwXpa2g6VAkJDhPTEaCYmx3C+dwJIjmFCcoxVAw0RAUsQqtoqIrcCb+F0VX1cVbeIyM3u/keBXwJ/EZFNONVKd6lqOYCvcwMVqzHG0d6ulFY1UFhWR2FZLUXldRSW11FYVseeyobDjo2PCmNSSgwzx8Vz7uyxhyWB8YlRhIXaYNFDnWjXDsBDWE5Ojubl5QU7DGMGvar6FgrLa51EUO4mgrI6isrraPLqFRQXGUZWaizZabFkp8aRlRZLZoqTBBJjIoL4CYy/iMgnqprja9/Qf9TPGONTc2s7uyrq3CTgVSIoq8NTd2hcoNAQYWJyDNmpsZw6JZXstDg3IcSSFh8ZtHGABqXGaqjZC9V7oHovNFZCRCxExkPkKIiIc5e9XqFDtzrNEoQxQ5iqcqCmiQKvm39HIth9sIE2r95BqXGRZKfGcvasMW6pwEkEE5JiiAgb4dVB7e1QVwY1pVDtvmr2HrncXNv7a4dFQ6R34hh1aDmim+2dx3ttC4+BAU7WliCMGQIamtsoKKs9PBGU11JUVkddc1vncVHhIWSlxjF7fAIXnzCe7LR
"image/svg+xml": [
"<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"no\"?>\r\n",
"<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\r\n",
" \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\r\n",
"<!-- Created with matplotlib (https://matplotlib.org/) -->\r\n",
"<svg height=\"277.314375pt\" version=\"1.1\" viewBox=\"0 0 392.14375 277.314375\" width=\"392.14375pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\r\n",
" <metadata>\r\n",
" <rdf:RDF xmlns:cc=\"http://creativecommons.org/ns#\" xmlns:dc=\"http://purl.org/dc/elements/1.1/\" xmlns:rdf=\"http://www.w3.org/1999/02/22-rdf-syntax-ns#\">\r\n",
" <cc:Work>\r\n",
" <dc:type rdf:resource=\"http://purl.org/dc/dcmitype/StillImage\"/>\r\n",
" <dc:date>2021-03-31T21:43:32.463922</dc:date>\r\n",
" <dc:format>image/svg+xml</dc:format>\r\n",
" <dc:creator>\r\n",
" <cc:Agent>\r\n",
" <dc:title>Matplotlib v3.3.4, https://matplotlib.org/</dc:title>\r\n",
" </cc:Agent>\r\n",
" </dc:creator>\r\n",
" </cc:Work>\r\n",
" </rdf:RDF>\r\n",
" </metadata>\r\n",
" <defs>\r\n",
" <style type=\"text/css\">*{stroke-linecap:butt;stroke-linejoin:round;}</style>\r\n",
" </defs>\r\n",
" <g id=\"figure_1\">\r\n",
" <g id=\"patch_1\">\r\n",
" <path d=\"M 0 277.314375 \r\n",
"L 392.14375 277.314375 \r\n",
"L 392.14375 0 \r\n",
"L 0 0 \r\n",
"z\r\n",
"\" style=\"fill:none;\"/>\r\n",
" </g>\r\n",
" <g id=\"axes_1\">\r\n",
" <g id=\"patch_2\">\r\n",
" <path d=\"M 50.14375 239.758125 \r\n",
"L 384.94375 239.758125 \r\n",
"L 384.94375 22.318125 \r\n",
"L 50.14375 22.318125 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g id=\"matplotlib.axis_1\">\r\n",
" <g id=\"xtick_1\">\r\n",
" <g id=\"line2d_1\">\r\n",
" <defs>\r\n",
" <path d=\"M 0 0 \r\n",
"L 0 3.5 \r\n",
"\" id=\"me749cf5b61\" style=\"stroke:#000000;stroke-width:0.8;\"/>\r\n",
" </defs>\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"65.361932\" xlink:href=\"#me749cf5b61\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_1\">\r\n",
" <!-- 0 -->\r\n",
" <g transform=\"translate(62.180682 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 31.78125 66.40625 \r\n",
"Q 24.171875 66.40625 20.328125 58.90625 \r\n",
"Q 16.5 51.421875 16.5 36.375 \r\n",
"Q 16.5 21.390625 20.328125 13.890625 \r\n",
"Q 24.171875 6.390625 31.78125 6.390625 \r\n",
"Q 39.453125 6.390625 43.28125 13.890625 \r\n",
"Q 47.125 21.390625 47.125 36.375 \r\n",
"Q 47.125 51.421875 43.28125 58.90625 \r\n",
"Q 39.453125 66.40625 31.78125 66.40625 \r\n",
"z\r\n",
"M 31.78125 74.21875 \r\n",
"Q 44.046875 74.21875 50.515625 64.515625 \r\n",
"Q 56.984375 54.828125 56.984375 36.375 \r\n",
"Q 56.984375 17.96875 50.515625 8.265625 \r\n",
"Q 44.046875 -1.421875 31.78125 -1.421875 \r\n",
"Q 19.53125 -1.421875 13.0625 8.265625 \r\n",
"Q 6.59375 17.96875 6.59375 36.375 \r\n",
"Q 6.59375 54.828125 13.0625 64.515625 \r\n",
"Q 19.53125 74.21875 31.78125 74.21875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-48\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_2\">\r\n",
" <g id=\"line2d_2\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"132.998295\" xlink:href=\"#me749cf5b61\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_2\">\r\n",
" <!-- 2 -->\r\n",
" <g transform=\"translate(129.817045 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 19.1875 8.296875 \r\n",
"L 53.609375 8.296875 \r\n",
"L 53.609375 0 \r\n",
"L 7.328125 0 \r\n",
"L 7.328125 8.296875 \r\n",
"Q 12.9375 14.109375 22.625 23.890625 \r\n",
"Q 32.328125 33.6875 34.8125 36.53125 \r\n",
"Q 39.546875 41.84375 41.421875 45.53125 \r\n",
"Q 43.3125 49.21875 43.3125 52.78125 \r\n",
"Q 43.3125 58.59375 39.234375 62.25 \r\n",
"Q 35.15625 65.921875 28.609375 65.921875 \r\n",
"Q 23.96875 65.921875 18.8125 64.3125 \r\n",
"Q 13.671875 62.703125 7.8125 59.421875 \r\n",
"L 7.8125 69.390625 \r\n",
"Q 13.765625 71.78125 18.9375 73 \r\n",
"Q 24.125 74.21875 28.421875 74.21875 \r\n",
"Q 39.75 74.21875 46.484375 68.546875 \r\n",
"Q 53.21875 62.890625 53.21875 53.421875 \r\n",
"Q 53.21875 48.921875 51.53125 44.890625 \r\n",
"Q 49.859375 40.875 45.40625 35.40625 \r\n",
"Q 44.1875 33.984375 37.640625 27.21875 \r\n",
"Q 31.109375 20.453125 19.1875 8.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-50\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-50\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_3\">\r\n",
" <g id=\"line2d_3\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"200.634659\" xlink:href=\"#me749cf5b61\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_3\">\r\n",
" <!-- 4 -->\r\n",
" <g transform=\"translate(197.453409 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 37.796875 64.3125 \r\n",
"L 12.890625 25.390625 \r\n",
"L 37.796875 25.390625 \r\n",
"z\r\n",
"M 35.203125 72.90625 \r\n",
"L 47.609375 72.90625 \r\n",
"L 47.609375 25.390625 \r\n",
"L 58.015625 25.390625 \r\n",
"L 58.015625 17.1875 \r\n",
"L 47.609375 17.1875 \r\n",
"L 47.609375 0 \r\n",
"L 37.796875 0 \r\n",
"L 37.796875 17.1875 \r\n",
"L 4.890625 17.1875 \r\n",
"L 4.890625 26.703125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-52\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-52\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_4\">\r\n",
" <g id=\"line2d_4\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"268.271023\" xlink:href=\"#me749cf5b61\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_4\">\r\n",
" <!-- 6 -->\r\n",
" <g transform=\"translate(265.089773 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 33.015625 40.375 \r\n",
"Q 26.375 40.375 22.484375 35.828125 \r\n",
"Q 18.609375 31.296875 18.609375 23.390625 \r\n",
"Q 18.609375 15.53125 22.484375 10.953125 \r\n",
"Q 26.375 6.390625 33.015625 6.390625 \r\n",
"Q 39.65625 6.390625 43.53125 10.953125 \r\n",
"Q 47.40625 15.53125 47.40625 23.390625 \r\n",
"Q 47.40625 31.296875 43.53125 35.828125 \r\n",
"Q 39.65625 40.375 33.015625 40.375 \r\n",
"z\r\n",
"M 52.59375 71.296875 \r\n",
"L 52.59375 62.3125 \r\n",
"Q 48.875 64.0625 45.09375 64.984375 \r\n",
"Q 41.3125 65.921875 37.59375 65.921875 \r\n",
"Q 27.828125 65.921875 22.671875 59.328125 \r\n",
"Q 17.53125 52.734375 16.796875 39.40625 \r\n",
"Q 19.671875 43.65625 24.015625 45.921875 \r\n",
"Q 28.375 48.1875 33.59375 48.1875 \r\n",
"Q 44.578125 48.1875 50.953125 41.515625 \r\n",
"Q 57.328125 34.859375 57.328125 23.390625 \r\n",
"Q 57.328125 12.15625 50.6875 5.359375 \r\n",
"Q 44.046875 -1.421875 33.015625 -1.421875 \r\n",
"Q 20.359375 -1.421875 13.671875 8.265625 \r\n",
"Q 6.984375 17.96875 6.984375 36.375 \r\n",
"Q 6.984375 53.65625 15.1875 63.9375 \r\n",
"Q 23.390625 74.21875 37.203125 74.21875 \r\n",
"Q 40.921875 74.21875 44.703125 73.484375 \r\n",
"Q 48.484375 72.75 52.59375 71.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-54\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-54\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_5\">\r\n",
" <g id=\"line2d_5\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"335.907386\" xlink:href=\"#me749cf5b61\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_5\">\r\n",
" <!-- 8 -->\r\n",
" <g transform=\"translate(332.726136 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 31.78125 34.625 \r\n",
"Q 24.75 34.625 20.71875 30.859375 \r\n",
"Q 16.703125 27.09375 16.703125 20.515625 \r\n",
"Q 16.703125 13.921875 20.71875 10.15625 \r\n",
"Q 24.75 6.390625 31.78125 6.390625 \r\n",
"Q 38.8125 6.390625 42.859375 10.171875 \r\n",
"Q 46.921875 13.96875 46.921875 20.515625 \r\n",
"Q 46.921875 27.09375 42.890625 30.859375 \r\n",
"Q 38.875 34.625 31.78125 34.625 \r\n",
"z\r\n",
"M 21.921875 38.8125 \r\n",
"Q 15.578125 40.375 12.03125 44.71875 \r\n",
"Q 8.5 49.078125 8.5 55.328125 \r\n",
"Q 8.5 64.0625 14.71875 69.140625 \r\n",
"Q 20.953125 74.21875 31.78125 74.21875 \r\n",
"Q 42.671875 74.21875 48.875 69.140625 \r\n",
"Q 55.078125 64.0625 55.078125 55.328125 \r\n",
"Q 55.078125 49.078125 51.53125 44.71875 \r\n",
"Q 48 40.375 41.703125 38.8125 \r\n",
"Q 48.828125 37.15625 52.796875 32.3125 \r\n",
"Q 56.78125 27.484375 56.78125 20.515625 \r\n",
"Q 56.78125 9.90625 50.3125 4.234375 \r\n",
"Q 43.84375 -1.421875 31.78125 -1.421875 \r\n",
"Q 19.734375 -1.421875 13.25 4.234375 \r\n",
"Q 6.78125 9.90625 6.78125 20.515625 \r\n",
"Q 6.78125 27.484375 10.78125 32.3125 \r\n",
"Q 14.796875 37.15625 21.921875 38.8125 \r\n",
"z\r\n",
"M 18.3125 54.390625 \r\n",
"Q 18.3125 48.734375 21.84375 45.5625 \r\n",
"Q 25.390625 42.390625 31.78125 42.390625 \r\n",
"Q 38.140625 42.390625 41.71875 45.5625 \r\n",
"Q 45.3125 48.734375 45.3125 54.390625 \r\n",
"Q 45.3125 60.0625 41.71875 63.234375 \r\n",
"Q 38.140625 66.40625 31.78125 66.40625 \r\n",
"Q 25.390625 66.40625 21.84375 63.234375 \r\n",
"Q 18.3125 60.0625 18.3125 54.390625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-56\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-56\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_6\">\r\n",
" <!-- Epoch -->\r\n",
" <g transform=\"translate(202.232813 268.034687)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 9.8125 72.90625 \r\n",
"L 55.90625 72.90625 \r\n",
"L 55.90625 64.59375 \r\n",
"L 19.671875 64.59375 \r\n",
"L 19.671875 43.015625 \r\n",
"L 54.390625 43.015625 \r\n",
"L 54.390625 34.71875 \r\n",
"L 19.671875 34.71875 \r\n",
"L 19.671875 8.296875 \r\n",
"L 56.78125 8.296875 \r\n",
"L 56.78125 0 \r\n",
"L 9.8125 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-69\"/>\r\n",
" <path d=\"M 18.109375 8.203125 \r\n",
"L 18.109375 -20.796875 \r\n",
"L 9.078125 -20.796875 \r\n",
"L 9.078125 54.6875 \r\n",
"L 18.109375 54.6875 \r\n",
"L 18.109375 46.390625 \r\n",
"Q 20.953125 51.265625 25.265625 53.625 \r\n",
"Q 29.59375 56 35.59375 56 \r\n",
"Q 45.5625 56 51.78125 48.09375 \r\n",
"Q 58.015625 40.1875 58.015625 27.296875 \r\n",
"Q 58.015625 14.40625 51.78125 6.484375 \r\n",
"Q 45.5625 -1.421875 35.59375 -1.421875 \r\n",
"Q 29.59375 -1.421875 25.265625 0.953125 \r\n",
"Q 20.953125 3.328125 18.109375 8.203125 \r\n",
"z\r\n",
"M 48.6875 27.296875 \r\n",
"Q 48.6875 37.203125 44.609375 42.84375 \r\n",
"Q 40.53125 48.484375 33.40625 48.484375 \r\n",
"Q 26.265625 48.484375 22.1875 42.84375 \r\n",
"Q 18.109375 37.203125 18.109375 27.296875 \r\n",
"Q 18.109375 17.390625 22.1875 11.75 \r\n",
"Q 26.265625 6.109375 33.40625 6.109375 \r\n",
"Q 40.53125 6.109375 44.609375 11.75 \r\n",
"Q 48.6875 17.390625 48.6875 27.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-112\"/>\r\n",
" <path d=\"M 30.609375 48.390625 \r\n",
"Q 23.390625 48.390625 19.1875 42.75 \r\n",
"Q 14.984375 37.109375 14.984375 27.296875 \r\n",
"Q 14.984375 17.484375 19.15625 11.84375 \r\n",
"Q 23.34375 6.203125 30.609375 6.203125 \r\n",
"Q 37.796875 6.203125 41.984375 11.859375 \r\n",
"Q 46.1875 17.53125 46.1875 27.296875 \r\n",
"Q 46.1875 37.015625 41.984375 42.703125 \r\n",
"Q 37.796875 48.390625 30.609375 48.390625 \r\n",
"z\r\n",
"M 30.609375 56 \r\n",
"Q 42.328125 56 49.015625 48.375 \r\n",
"Q 55.71875 40.765625 55.71875 27.296875 \r\n",
"Q 55.71875 13.875 49.015625 6.21875 \r\n",
"Q 42.328125 -1.421875 30.609375 -1.421875 \r\n",
"Q 18.84375 -1.421875 12.171875 6.21875 \r\n",
"Q 5.515625 13.875 5.515625 27.296875 \r\n",
"Q 5.515625 40.765625 12.171875 48.375 \r\n",
"Q 18.84375 56 30.609375 56 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-111\"/>\r\n",
" <path d=\"M 48.78125 52.59375 \r\n",
"L 48.78125 44.1875 \r\n",
"Q 44.96875 46.296875 41.140625 47.34375 \r\n",
"Q 37.3125 48.390625 33.40625 48.390625 \r\n",
"Q 24.65625 48.390625 19.8125 42.84375 \r\n",
"Q 14.984375 37.3125 14.984375 27.296875 \r\n",
"Q 14.984375 17.28125 19.8125 11.734375 \r\n",
"Q 24.65625 6.203125 33.40625 6.203125 \r\n",
"Q 37.3125 6.203125 41.140625 7.25 \r\n",
"Q 44.96875 8.296875 48.78125 10.40625 \r\n",
"L 48.78125 2.09375 \r\n",
"Q 45.015625 0.34375 40.984375 -0.53125 \r\n",
"Q 36.96875 -1.421875 32.421875 -1.421875 \r\n",
"Q 20.0625 -1.421875 12.78125 6.34375 \r\n",
"Q 5.515625 14.109375 5.515625 27.296875 \r\n",
"Q 5.515625 40.671875 12.859375 48.328125 \r\n",
"Q 20.21875 56 33.015625 56 \r\n",
"Q 37.15625 56 41.109375 55.140625 \r\n",
"Q 45.0625 54.296875 48.78125 52.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-99\"/>\r\n",
" <path d=\"M 54.890625 33.015625 \r\n",
"L 54.890625 0 \r\n",
"L 45.90625 0 \r\n",
"L 45.90625 32.71875 \r\n",
"Q 45.90625 40.484375 42.875 44.328125 \r\n",
"Q 39.84375 48.1875 33.796875 48.1875 \r\n",
"Q 26.515625 48.1875 22.3125 43.546875 \r\n",
"Q 18.109375 38.921875 18.109375 30.90625 \r\n",
"L 18.109375 0 \r\n",
"L 9.078125 0 \r\n",
"L 9.078125 75.984375 \r\n",
"L 18.109375 75.984375 \r\n",
"L 18.109375 46.1875 \r\n",
"Q 21.34375 51.125 25.703125 53.5625 \r\n",
"Q 30.078125 56 35.796875 56 \r\n",
"Q 45.21875 56 50.046875 50.171875 \r\n",
"Q 54.890625 44.34375 54.890625 33.015625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-104\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-69\"/>\r\n",
" <use x=\"63.183594\" xlink:href=\"#DejaVuSans-112\"/>\r\n",
" <use x=\"126.660156\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"187.841797\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"242.822266\" xlink:href=\"#DejaVuSans-104\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"matplotlib.axis_2\">\r\n",
" <g id=\"ytick_1\">\r\n",
" <g id=\"line2d_6\">\r\n",
" <defs>\r\n",
" <path d=\"M 0 0 \r\n",
"L -3.5 0 \r\n",
"\" id=\"m7100a254f4\" style=\"stroke:#000000;stroke-width:0.8;\"/>\r\n",
" </defs>\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"225.018689\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_7\">\r\n",
" <!-- 0.45 -->\r\n",
" <g transform=\"translate(20.878125 228.817908)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 10.6875 12.40625 \r\n",
"L 21 12.40625 \r\n",
"L 21 0 \r\n",
"L 10.6875 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-46\"/>\r\n",
" <path d=\"M 10.796875 72.90625 \r\n",
"L 49.515625 72.90625 \r\n",
"L 49.515625 64.59375 \r\n",
"L 19.828125 64.59375 \r\n",
"L 19.828125 46.734375 \r\n",
"Q 21.96875 47.46875 24.109375 47.828125 \r\n",
"Q 26.265625 48.1875 28.421875 48.1875 \r\n",
"Q 40.625 48.1875 47.75 41.5 \r\n",
"Q 54.890625 34.8125 54.890625 23.390625 \r\n",
"Q 54.890625 11.625 47.5625 5.09375 \r\n",
"Q 40.234375 -1.421875 26.90625 -1.421875 \r\n",
"Q 22.3125 -1.421875 17.546875 -0.640625 \r\n",
"Q 12.796875 0.140625 7.71875 1.703125 \r\n",
"L 7.71875 11.625 \r\n",
"Q 12.109375 9.234375 16.796875 8.0625 \r\n",
"Q 21.484375 6.890625 26.703125 6.890625 \r\n",
"Q 35.15625 6.890625 40.078125 11.328125 \r\n",
"Q 45.015625 15.765625 45.015625 23.390625 \r\n",
"Q 45.015625 31 40.078125 35.4375 \r\n",
"Q 35.15625 39.890625 26.703125 39.890625 \r\n",
"Q 22.75 39.890625 18.8125 39.015625 \r\n",
"Q 14.890625 38.140625 10.796875 36.28125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-53\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-52\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-53\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_2\">\r\n",
" <g id=\"line2d_7\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"198.570012\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_8\">\r\n",
" <!-- 0.50 -->\r\n",
" <g transform=\"translate(20.878125 202.369231)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-53\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_3\">\r\n",
" <g id=\"line2d_8\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"172.121335\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_9\">\r\n",
" <!-- 0.55 -->\r\n",
" <g transform=\"translate(20.878125 175.920554)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-53\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-53\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_4\">\r\n",
" <g id=\"line2d_9\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"145.672658\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_10\">\r\n",
" <!-- 0.60 -->\r\n",
" <g transform=\"translate(20.878125 149.471877)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-54\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_5\">\r\n",
" <g id=\"line2d_10\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"119.223981\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_11\">\r\n",
" <!-- 0.65 -->\r\n",
" <g transform=\"translate(20.878125 123.0232)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-54\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-53\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_6\">\r\n",
" <g id=\"line2d_11\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"92.775304\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_12\">\r\n",
" <!-- 0.70 -->\r\n",
" <g transform=\"translate(20.878125 96.574522)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 8.203125 72.90625 \r\n",
"L 55.078125 72.90625 \r\n",
"L 55.078125 68.703125 \r\n",
"L 28.609375 0 \r\n",
"L 18.3125 0 \r\n",
"L 43.21875 64.59375 \r\n",
"L 8.203125 64.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-55\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-55\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_7\">\r\n",
" <g id=\"line2d_12\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"66.326626\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_13\">\r\n",
" <!-- 0.75 -->\r\n",
" <g transform=\"translate(20.878125 70.125845)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-55\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-53\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_8\">\r\n",
" <g id=\"line2d_13\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"50.14375\" xlink:href=\"#m7100a254f4\" y=\"39.877949\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_14\">\r\n",
" <!-- 0.80 -->\r\n",
" <g transform=\"translate(20.878125 43.677168)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-56\"/>\r\n",
" <use x=\"159.033203\" xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_15\">\r\n",
" <!-- Loss -->\r\n",
" <g transform=\"translate(14.798438 142.005312)rotate(-90)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 9.8125 72.90625 \r\n",
"L 19.671875 72.90625 \r\n",
"L 19.671875 8.296875 \r\n",
"L 55.171875 8.296875 \r\n",
"L 55.171875 0 \r\n",
"L 9.8125 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-76\"/>\r\n",
" <path d=\"M 44.28125 53.078125 \r\n",
"L 44.28125 44.578125 \r\n",
"Q 40.484375 46.53125 36.375 47.5 \r\n",
"Q 32.28125 48.484375 27.875 48.484375 \r\n",
"Q 21.1875 48.484375 17.84375 46.4375 \r\n",
"Q 14.5 44.390625 14.5 40.28125 \r\n",
"Q 14.5 37.15625 16.890625 35.375 \r\n",
"Q 19.28125 33.59375 26.515625 31.984375 \r\n",
"L 29.59375 31.296875 \r\n",
"Q 39.15625 29.25 43.1875 25.515625 \r\n",
"Q 47.21875 21.78125 47.21875 15.09375 \r\n",
"Q 47.21875 7.46875 41.1875 3.015625 \r\n",
"Q 35.15625 -1.421875 24.609375 -1.421875 \r\n",
"Q 20.21875 -1.421875 15.453125 -0.5625 \r\n",
"Q 10.6875 0.296875 5.421875 2 \r\n",
"L 5.421875 11.28125 \r\n",
"Q 10.40625 8.6875 15.234375 7.390625 \r\n",
"Q 20.0625 6.109375 24.8125 6.109375 \r\n",
"Q 31.15625 6.109375 34.5625 8.28125 \r\n",
"Q 37.984375 10.453125 37.984375 14.40625 \r\n",
"Q 37.984375 18.0625 35.515625 20.015625 \r\n",
"Q 33.0625 21.96875 24.703125 23.78125 \r\n",
"L 21.578125 24.515625 \r\n",
"Q 13.234375 26.265625 9.515625 29.90625 \r\n",
"Q 5.8125 33.546875 5.8125 39.890625 \r\n",
"Q 5.8125 47.609375 11.28125 51.796875 \r\n",
"Q 16.75 56 26.8125 56 \r\n",
"Q 31.78125 56 36.171875 55.265625 \r\n",
"Q 40.578125 54.546875 44.28125 53.078125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-115\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-76\"/>\r\n",
" <use x=\"53.962891\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"115.144531\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" <use x=\"167.244141\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"line2d_14\">\r\n",
" <path clip-path=\"url(#pdb95b80ba0)\" d=\"M 65.361932 229.874489 \r\n",
"L 99.180114 99.635955 \r\n",
"L 132.998295 77.863001 \r\n",
"L 166.816477 65.850913 \r\n",
"L 200.634659 57.848498 \r\n",
"L 234.452841 49.616739 \r\n",
"L 268.271023 44.511171 \r\n",
"L 302.089205 39.983282 \r\n",
"L 335.907386 35.922626 \r\n",
"L 369.725568 32.201761 \r\n",
"\" style=\"fill:none;stroke:#1f77b4;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_15\">\r\n",
" <path clip-path=\"url(#pdb95b80ba0)\" d=\"M 65.361932 115.07701 \r\n",
"L 99.180114 87.976081 \r\n",
"L 132.998295 76.038181 \r\n",
"L 166.816477 73.438812 \r\n",
"L 200.634659 64.67796 \r\n",
"L 234.452841 59.190384 \r\n",
"L 268.271023 61.549058 \r\n",
"L 302.089205 50.862744 \r\n",
"L 335.907386 47.252484 \r\n",
"L 369.725568 49.081687 \r\n",
"\" style=\"fill:none;stroke:#ff7f0e;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_3\">\r\n",
" <path d=\"M 50.14375 239.758125 \r\n",
"L 50.14375 22.318125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_4\">\r\n",
" <path d=\"M 384.94375 239.758125 \r\n",
"L 384.94375 22.318125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_5\">\r\n",
" <path d=\"M 50.14375 239.758125 \r\n",
"L 384.94375 239.758125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_6\">\r\n",
" <path d=\"M 50.14375 22.318125 \r\n",
"L 384.94375 22.318125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_16\">\r\n",
" <!-- Accuracy vs. epochs -->\r\n",
" <g transform=\"translate(156.353125 16.318125)scale(0.12 -0.12)\">\r\n",
" <defs>\r\n",
" <path d=\"M 34.1875 63.1875 \r\n",
"L 20.796875 26.90625 \r\n",
"L 47.609375 26.90625 \r\n",
"z\r\n",
"M 28.609375 72.90625 \r\n",
"L 39.796875 72.90625 \r\n",
"L 67.578125 0 \r\n",
"L 57.328125 0 \r\n",
"L 50.6875 18.703125 \r\n",
"L 17.828125 18.703125 \r\n",
"L 11.1875 0 \r\n",
"L 0.78125 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-65\"/>\r\n",
" <path d=\"M 8.5 21.578125 \r\n",
"L 8.5 54.6875 \r\n",
"L 17.484375 54.6875 \r\n",
"L 17.484375 21.921875 \r\n",
"Q 17.484375 14.15625 20.5 10.265625 \r\n",
"Q 23.53125 6.390625 29.59375 6.390625 \r\n",
"Q 36.859375 6.390625 41.078125 11.03125 \r\n",
"Q 45.3125 15.671875 45.3125 23.6875 \r\n",
"L 45.3125 54.6875 \r\n",
"L 54.296875 54.6875 \r\n",
"L 54.296875 0 \r\n",
"L 45.3125 0 \r\n",
"L 45.3125 8.40625 \r\n",
"Q 42.046875 3.421875 37.71875 1 \r\n",
"Q 33.40625 -1.421875 27.6875 -1.421875 \r\n",
"Q 18.265625 -1.421875 13.375 4.4375 \r\n",
"Q 8.5 10.296875 8.5 21.578125 \r\n",
"z\r\n",
"M 31.109375 56 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-117\"/>\r\n",
" <path d=\"M 41.109375 46.296875 \r\n",
"Q 39.59375 47.171875 37.8125 47.578125 \r\n",
"Q 36.03125 48 33.890625 48 \r\n",
"Q 26.265625 48 22.1875 43.046875 \r\n",
"Q 18.109375 38.09375 18.109375 28.8125 \r\n",
"L 18.109375 0 \r\n",
"L 9.078125 0 \r\n",
"L 9.078125 54.6875 \r\n",
"L 18.109375 54.6875 \r\n",
"L 18.109375 46.1875 \r\n",
"Q 20.953125 51.171875 25.484375 53.578125 \r\n",
"Q 30.03125 56 36.53125 56 \r\n",
"Q 37.453125 56 38.578125 55.875 \r\n",
"Q 39.703125 55.765625 41.0625 55.515625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-114\"/>\r\n",
" <path d=\"M 34.28125 27.484375 \r\n",
"Q 23.390625 27.484375 19.1875 25 \r\n",
"Q 14.984375 22.515625 14.984375 16.5 \r\n",
"Q 14.984375 11.71875 18.140625 8.90625 \r\n",
"Q 21.296875 6.109375 26.703125 6.109375 \r\n",
"Q 34.1875 6.109375 38.703125 11.40625 \r\n",
"Q 43.21875 16.703125 43.21875 25.484375 \r\n",
"L 43.21875 27.484375 \r\n",
"z\r\n",
"M 52.203125 31.203125 \r\n",
"L 52.203125 0 \r\n",
"L 43.21875 0 \r\n",
"L 43.21875 8.296875 \r\n",
"Q 40.140625 3.328125 35.546875 0.953125 \r\n",
"Q 30.953125 -1.421875 24.3125 -1.421875 \r\n",
"Q 15.921875 -1.421875 10.953125 3.296875 \r\n",
"Q 6 8.015625 6 15.921875 \r\n",
"Q 6 25.140625 12.171875 29.828125 \r\n",
"Q 18.359375 34.515625 30.609375 34.515625 \r\n",
"L 43.21875 34.515625 \r\n",
"L 43.21875 35.40625 \r\n",
"Q 43.21875 41.609375 39.140625 45 \r\n",
"Q 35.0625 48.390625 27.6875 48.390625 \r\n",
"Q 23 48.390625 18.546875 47.265625 \r\n",
"Q 14.109375 46.140625 10.015625 43.890625 \r\n",
"L 10.015625 52.203125 \r\n",
"Q 14.9375 54.109375 19.578125 55.046875 \r\n",
"Q 24.21875 56 28.609375 56 \r\n",
"Q 40.484375 56 46.34375 49.84375 \r\n",
"Q 52.203125 43.703125 52.203125 31.203125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-97\"/>\r\n",
" <path d=\"M 32.171875 -5.078125 \r\n",
"Q 28.375 -14.84375 24.75 -17.8125 \r\n",
"Q 21.140625 -20.796875 15.09375 -20.796875 \r\n",
"L 7.90625 -20.796875 \r\n",
"L 7.90625 -13.28125 \r\n",
"L 13.1875 -13.28125 \r\n",
"Q 16.890625 -13.28125 18.9375 -11.515625 \r\n",
"Q 21 -9.765625 23.484375 -3.21875 \r\n",
"L 25.09375 0.875 \r\n",
"L 2.984375 54.6875 \r\n",
"L 12.5 54.6875 \r\n",
"L 29.59375 11.921875 \r\n",
"L 46.6875 54.6875 \r\n",
"L 56.203125 54.6875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-121\"/>\r\n",
" <path id=\"DejaVuSans-32\"/>\r\n",
" <path d=\"M 2.984375 54.6875 \r\n",
"L 12.5 54.6875 \r\n",
"L 29.59375 8.796875 \r\n",
"L 46.6875 54.6875 \r\n",
"L 56.203125 54.6875 \r\n",
"L 35.6875 0 \r\n",
"L 23.484375 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-118\"/>\r\n",
" <path d=\"M 56.203125 29.59375 \r\n",
"L 56.203125 25.203125 \r\n",
"L 14.890625 25.203125 \r\n",
"Q 15.484375 15.921875 20.484375 11.0625 \r\n",
"Q 25.484375 6.203125 34.421875 6.203125 \r\n",
"Q 39.59375 6.203125 44.453125 7.46875 \r\n",
"Q 49.3125 8.734375 54.109375 11.28125 \r\n",
"L 54.109375 2.78125 \r\n",
"Q 49.265625 0.734375 44.1875 -0.34375 \r\n",
"Q 39.109375 -1.421875 33.890625 -1.421875 \r\n",
"Q 20.796875 -1.421875 13.15625 6.1875 \r\n",
"Q 5.515625 13.8125 5.515625 26.8125 \r\n",
"Q 5.515625 40.234375 12.765625 48.109375 \r\n",
"Q 20.015625 56 32.328125 56 \r\n",
"Q 43.359375 56 49.78125 48.890625 \r\n",
"Q 56.203125 41.796875 56.203125 29.59375 \r\n",
"z\r\n",
"M 47.21875 32.234375 \r\n",
"Q 47.125 39.59375 43.09375 43.984375 \r\n",
"Q 39.0625 48.390625 32.421875 48.390625 \r\n",
"Q 24.90625 48.390625 20.390625 44.140625 \r\n",
"Q 15.875 39.890625 15.1875 32.171875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-101\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-65\"/>\r\n",
" <use x=\"66.658203\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"121.638672\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"176.619141\" xlink:href=\"#DejaVuSans-117\"/>\r\n",
" <use x=\"239.998047\" xlink:href=\"#DejaVuSans-114\"/>\r\n",
" <use x=\"281.111328\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"342.390625\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"397.371094\" xlink:href=\"#DejaVuSans-121\"/>\r\n",
" <use x=\"456.550781\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"488.337891\" xlink:href=\"#DejaVuSans-118\"/>\r\n",
" <use x=\"547.517578\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" <use x=\"599.617188\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"631.404297\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"663.191406\" xlink:href=\"#DejaVuSans-101\"/>\r\n",
" <use x=\"724.714844\" xlink:href=\"#DejaVuSans-112\"/>\r\n",
" <use x=\"788.191406\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"849.373047\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"904.353516\" xlink:href=\"#DejaVuSans-104\"/>\r\n",
" <use x=\"967.732422\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"legend_1\">\r\n",
" <g id=\"patch_7\">\r\n",
" <path d=\"M 296.5625 234.758125 \r\n",
"L 377.94375 234.758125 \r\n",
"Q 379.94375 234.758125 379.94375 232.758125 \r\n",
"L 379.94375 204.401875 \r\n",
"Q 379.94375 202.401875 377.94375 202.401875 \r\n",
"L 296.5625 202.401875 \r\n",
"Q 294.5625 202.401875 294.5625 204.401875 \r\n",
"L 294.5625 232.758125 \r\n",
"Q 294.5625 234.758125 296.5625 234.758125 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;opacity:0.8;stroke:#cccccc;stroke-linejoin:miter;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_16\">\r\n",
" <path d=\"M 298.5625 210.500312 \r\n",
"L 318.5625 210.500312 \r\n",
"\" style=\"fill:none;stroke:#1f77b4;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_17\"/>\r\n",
" <g id=\"text_17\">\r\n",
" <!-- Training -->\r\n",
" <g transform=\"translate(326.5625 214.000312)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M -0.296875 72.90625 \r\n",
"L 61.375 72.90625 \r\n",
"L 61.375 64.59375 \r\n",
"L 35.5 64.59375 \r\n",
"L 35.5 0 \r\n",
"L 25.59375 0 \r\n",
"L 25.59375 64.59375 \r\n",
"L -0.296875 64.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-84\"/>\r\n",
" <path d=\"M 9.421875 54.6875 \r\n",
"L 18.40625 54.6875 \r\n",
"L 18.40625 0 \r\n",
"L 9.421875 0 \r\n",
"z\r\n",
"M 9.421875 75.984375 \r\n",
"L 18.40625 75.984375 \r\n",
"L 18.40625 64.59375 \r\n",
"L 9.421875 64.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-105\"/>\r\n",
" <path d=\"M 54.890625 33.015625 \r\n",
"L 54.890625 0 \r\n",
"L 45.90625 0 \r\n",
"L 45.90625 32.71875 \r\n",
"Q 45.90625 40.484375 42.875 44.328125 \r\n",
"Q 39.84375 48.1875 33.796875 48.1875 \r\n",
"Q 26.515625 48.1875 22.3125 43.546875 \r\n",
"Q 18.109375 38.921875 18.109375 30.90625 \r\n",
"L 18.109375 0 \r\n",
"L 9.078125 0 \r\n",
"L 9.078125 54.6875 \r\n",
"L 18.109375 54.6875 \r\n",
"L 18.109375 46.1875 \r\n",
"Q 21.34375 51.125 25.703125 53.5625 \r\n",
"Q 30.078125 56 35.796875 56 \r\n",
"Q 45.21875 56 50.046875 50.171875 \r\n",
"Q 54.890625 44.34375 54.890625 33.015625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-110\"/>\r\n",
" <path d=\"M 45.40625 27.984375 \r\n",
"Q 45.40625 37.75 41.375 43.109375 \r\n",
"Q 37.359375 48.484375 30.078125 48.484375 \r\n",
"Q 22.859375 48.484375 18.828125 43.109375 \r\n",
"Q 14.796875 37.75 14.796875 27.984375 \r\n",
"Q 14.796875 18.265625 18.828125 12.890625 \r\n",
"Q 22.859375 7.515625 30.078125 7.515625 \r\n",
"Q 37.359375 7.515625 41.375 12.890625 \r\n",
"Q 45.40625 18.265625 45.40625 27.984375 \r\n",
"z\r\n",
"M 54.390625 6.78125 \r\n",
"Q 54.390625 -7.171875 48.1875 -13.984375 \r\n",
"Q 42 -20.796875 29.203125 -20.796875 \r\n",
"Q 24.46875 -20.796875 20.265625 -20.09375 \r\n",
"Q 16.0625 -19.390625 12.109375 -17.921875 \r\n",
"L 12.109375 -9.1875 \r\n",
"Q 16.0625 -11.328125 19.921875 -12.34375 \r\n",
"Q 23.78125 -13.375 27.78125 -13.375 \r\n",
"Q 36.625 -13.375 41.015625 -8.765625 \r\n",
"Q 45.40625 -4.15625 45.40625 5.171875 \r\n",
"L 45.40625 9.625 \r\n",
"Q 42.625 4.78125 38.28125 2.390625 \r\n",
"Q 33.9375 0 27.875 0 \r\n",
"Q 17.828125 0 11.671875 7.65625 \r\n",
"Q 5.515625 15.328125 5.515625 27.984375 \r\n",
"Q 5.515625 40.671875 11.671875 48.328125 \r\n",
"Q 17.828125 56 27.875 56 \r\n",
"Q 33.9375 56 38.28125 53.609375 \r\n",
"Q 42.625 51.21875 45.40625 46.390625 \r\n",
"L 45.40625 54.6875 \r\n",
"L 54.390625 54.6875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-103\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-84\"/>\r\n",
" <use x=\"46.333984\" xlink:href=\"#DejaVuSans-114\"/>\r\n",
" <use x=\"87.447266\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"148.726562\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"176.509766\" xlink:href=\"#DejaVuSans-110\"/>\r\n",
" <use x=\"239.888672\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"267.671875\" xlink:href=\"#DejaVuSans-110\"/>\r\n",
" <use x=\"331.050781\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"line2d_18\">\r\n",
" <path d=\"M 298.5625 225.178437 \r\n",
"L 318.5625 225.178437 \r\n",
"\" style=\"fill:none;stroke:#ff7f0e;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_19\"/>\r\n",
" <g id=\"text_18\">\r\n",
" <!-- Validation -->\r\n",
" <g transform=\"translate(326.5625 228.678437)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 28.609375 0 \r\n",
"L 0.78125 72.90625 \r\n",
"L 11.078125 72.90625 \r\n",
"L 34.1875 11.53125 \r\n",
"L 57.328125 72.90625 \r\n",
"L 67.578125 72.90625 \r\n",
"L 39.796875 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-86\"/>\r\n",
" <path d=\"M 9.421875 75.984375 \r\n",
"L 18.40625 75.984375 \r\n",
"L 18.40625 0 \r\n",
"L 9.421875 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-108\"/>\r\n",
" <path d=\"M 45.40625 46.390625 \r\n",
"L 45.40625 75.984375 \r\n",
"L 54.390625 75.984375 \r\n",
"L 54.390625 0 \r\n",
"L 45.40625 0 \r\n",
"L 45.40625 8.203125 \r\n",
"Q 42.578125 3.328125 38.25 0.953125 \r\n",
"Q 33.9375 -1.421875 27.875 -1.421875 \r\n",
"Q 17.96875 -1.421875 11.734375 6.484375 \r\n",
"Q 5.515625 14.40625 5.515625 27.296875 \r\n",
"Q 5.515625 40.1875 11.734375 48.09375 \r\n",
"Q 17.96875 56 27.875 56 \r\n",
"Q 33.9375 56 38.25 53.625 \r\n",
"Q 42.578125 51.265625 45.40625 46.390625 \r\n",
"z\r\n",
"M 14.796875 27.296875 \r\n",
"Q 14.796875 17.390625 18.875 11.75 \r\n",
"Q 22.953125 6.109375 30.078125 6.109375 \r\n",
"Q 37.203125 6.109375 41.296875 11.75 \r\n",
"Q 45.40625 17.390625 45.40625 27.296875 \r\n",
"Q 45.40625 37.203125 41.296875 42.84375 \r\n",
"Q 37.203125 48.484375 30.078125 48.484375 \r\n",
"Q 22.953125 48.484375 18.875 42.84375 \r\n",
"Q 14.796875 37.203125 14.796875 27.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-100\"/>\r\n",
" <path d=\"M 18.3125 70.21875 \r\n",
"L 18.3125 54.6875 \r\n",
"L 36.8125 54.6875 \r\n",
"L 36.8125 47.703125 \r\n",
"L 18.3125 47.703125 \r\n",
"L 18.3125 18.015625 \r\n",
"Q 18.3125 11.328125 20.140625 9.421875 \r\n",
"Q 21.96875 7.515625 27.59375 7.515625 \r\n",
"L 36.8125 7.515625 \r\n",
"L 36.8125 0 \r\n",
"L 27.59375 0 \r\n",
"Q 17.1875 0 13.234375 3.875 \r\n",
"Q 9.28125 7.765625 9.28125 18.015625 \r\n",
"L 9.28125 47.703125 \r\n",
"L 2.6875 47.703125 \r\n",
"L 2.6875 54.6875 \r\n",
"L 9.28125 54.6875 \r\n",
"L 9.28125 70.21875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-116\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-86\"/>\r\n",
" <use x=\"60.658203\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"121.9375\" xlink:href=\"#DejaVuSans-108\"/>\r\n",
" <use x=\"149.720703\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"177.503906\" xlink:href=\"#DejaVuSans-100\"/>\r\n",
" <use x=\"240.980469\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"302.259766\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"341.46875\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"369.251953\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"430.433594\" xlink:href=\"#DejaVuSans-110\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <defs>\r\n",
" <clipPath id=\"pdb95b80ba0\">\r\n",
" <rect height=\"217.44\" width=\"334.8\" x=\"50.14375\" y=\"22.318125\"/>\r\n",
" </clipPath>\r\n",
" </defs>\r\n",
"</svg>\r\n"
],
2021-03-30 00:07:48 -07:00
"text/plain": [
"<Figure size 432x288 with 1 Axes>"
]
},
"metadata": {
2021-04-01 03:16:00 -07:00
"needs_background": "light"
2021-03-30 00:07:48 -07:00
},
"output_type": "display_data"
}
],
"source": [
"\n",
"try:\n",
" plt.plot(history.history['accuracy'])\n",
" plt.plot(history.history['val_accuracy'])\n",
"except KeyError:\n",
" plt.plot(history.history['acc'])\n",
" plt.plot(history.history['val_acc'])\n",
"plt.title('Accuracy vs. epochs')\n",
"plt.ylabel('Loss')\n",
"plt.xlabel('Epoch')\n",
"plt.legend(['Training', 'Validation'], loc='lower right')\n",
"plt.show() "
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 12,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 295
},
"colab_type": "code",
"id": "7b5_8VsCz_GZ",
"outputId": "a31960e5-06c1-40c6-db22-2ad53e44ab01"
},
"outputs": [
{
"data": {
2021-04-01 03:16:00 -07:00
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEWCAYAAABrDZDcAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAAy7ElEQVR4nO3deXxcddn38c+Vfd8nadq0TVKabpSmbWhLaZsi9aYCsiMtKFZUQL0FQVHxcUG9fR69RR/gUXBB4FaBgmwCAgrVtihSupfua9qmS9Zm3zPX88eZrE3SbJNJMtf79ZpXJ+ecOeeaUeY75/c75/cTVcUYY4z/CvB1AcYYY3zLgsAYY/ycBYExxvg5CwJjjPFzFgTGGOPnLAiMMcbPWRAYMwqJyFoR+Zyv6zAjgwWBGZZEJE9Elvm6DmP8gQWBMcb4OQsCM6KISKiIPCQiJz2Ph0Qk1LMuSUReF5EyESkVkXdFJMCz7hsickJEKkVkn4hc2sW+F4jIaREJbLfsWhHZ4Xk+T0Q2iUiFiBSIyM97WXOAiHxTRA6JSImIPC8iCZ516SKiInK75/2cEpGv9ub9etZfLSLbPDUdEpHl7Q49UUT+5XnPfxORJM9rwkTkj55aykRko4ik9Ol/CDOqWBCYkeZ/AQuAbGAWMA/4tmfdV4F8wAWkAN8CVESmAP8JXKiq0cBlQF7nHavq+0A18JF2i28GnvE8fxh4WFVjgEnA872s+S7gGiAXGAucAX7ZaZtLgMnAfwDfbNcs1u37FZF5wO+B+4A4YEmn93Uz8BkgGQgBvuZZ/mkgFhgPJAJ3ArW9fC9mFLIgMCPNLcAPVLVQVYuA7wOf8qxrBFKBiaraqKrvqjOYVjMQCkwXkWBVzVPVQ93s/1lgJYCIRAOXe5a17P88EUlS1SpPcPTGHcD/UtV8Va0HHgBuEJGgdtt8X1WrVfVD4MmWGs7xfj8LPKGqb6uqW1VPqOredvt8UlX3q2otTmhlt3sficB5qtqsqptVtaKX78WMQhYEZqQZCxxt9/dRzzKAnwIHgb+JyGER+SaAqh4EvoLzBVwoIqtFZCxdewa4ztP8ch2wRVVbjvdZIAvY62lOubKXNU8EXvY0w5QBe3DCqX1zzPFu3lNP73c80F2gAZxu97wGiPI8/wPwV2C1p7npv0UkuJfvxYxCFgRmpDmJ88XaYoJnGapaqapfVdVM4OPAvS19Aar6jKou8rxWgZ90tXNV3Y3zZfsxOjYLoaoHVHUlTlPLT4AXRCSyFzUfBz6mqnHtHmGqeqLdNuO7ek89vV/Pfif14vgdeM6Wvq+q04GFwJXArX3djxk9LAjMcBbs6dhseQThNNN8W0Rcns7P7wJ/BBCRK0XkPBERoALnV3eziEwRkY94fuXX4bSHN/dw3Gdw2vWXAH9qWSginxQRl6q6gTLP4p720+JXwI9EZKJnPy4RubrTNt8RkQgRmYHTrv+cZ3m37xf4HfAZEbnU0yE9TkSmnqsYEblERGZ6OsUrcJqKevM+zChlQWCGszdwvrRbHg8A/wVsAnYAHwJbPMvA6Wx9B6gC/g08qqprcfoHfgwU4zSXJON0JHfnWWAp8HdVLW63fDmwS0SqcDqOV6hqHYCIVInI4m729zDwKk6TVSXwPjC/0zbrcJq11gAPqurfPMu7fb+q+gFOaPxfoNyzj4mc2xjgBZwQ2ON53R97fIUZ1cQmpjHGd0QkHTgCBKtqk4/LMX7KzgiMMcbPWRAYY4yfs6YhY4zxc3ZGYIwxfi7o3JsML0lJSZqenu7rMowxZkTZvHlzsaq6ulo34oIgPT2dTZs2+boMY4wZUUTkaHfrrGnIGGP8nAWBMcb4OQsCY4zxcyOuj8AYM3o0NjaSn59PXV2dr0sZNcLCwkhLSyM4uPcDyloQGGN8Jj8/n+joaNLT03HGCjQDoaqUlJSQn59PRkZGr19nTUPGGJ+pq6sjMTHRQmCQiAiJiYl9PsOyIDDG+JSFwODqz+fpN0Gwv6CSH76+m7pGG3bdGGPa85sgyD9Tw+/+eYRNeWd8XYoxZpgoKSkhOzub7OxsxowZw7hx41r/bmho6PG1mzZt4q677jrnMRYuXDhY5XqN33QWL8hMJCQwgHX7C1k0OcnX5RhjhoHExES2bdsGwAMPPEBUVBRf+9rXWtc3NTURFNT112ROTg45OTnnPMZ77703KLV6k9fOCETkCREpFJGdPWyzVES2icguEVnnrVoAIkKCmJeRwLr9Rd48jDFmhFu1ahX33nsvl1xyCd/4xjf44IMPWLhwIbNnz2bhwoXs27cPgLVr13LllVcCTojcdtttLF26lMzMTB555JHW/UVFRbVuv3TpUm644QamTp3KLbfcQsvoz2+88QZTp05l0aJF3HXXXa37HSrePCN4CvgF8PuuVopIHPAosFxVj4lIshdrASA3y8WP3tjDybJaxsaFe/twxpg++P5ru9h9smJQ9zl9bAzf+/iMPr9u//79vPPOOwQGBlJRUcH69esJCgrinXfe4Vvf+hYvvvjiWa/Zu3cv//jHP6isrGTKlCl84QtfOOta/q1bt7Jr1y7Gjh3LxRdfzL/+9S9ycnK44447WL9+PRkZGaxcubLf77e/vHZGoKrrgdIeNrkZeElVj3m2L/RWLS1ypzgD7623swJjTA9uvPFGAgMDASgvL+fGG2/k/PPP55577mHXrl1dvuaKK64gNDSUpKQkkpOTKSgoOGubefPmkZaWRkBAANnZ2eTl5bF3714yMzNbr/v3RRD4so8gCwgWkbVANPCwqnZ39nA7cDvAhAkT+n3AyclRpMaGsW5/ESvm9X8/xpjB159f7t4SGRnZ+vw73/kOl1xyCS+//DJ5eXksXbq0y9eEhoa2Pg8MDKSp6ewpqLvaZjhMDubLq4aCgLnAFcBlwHdEJKurDVX1N6qao6o5LleXw2n3ioiQm+XinweKaWx293s/xhj/UV5ezrhx4wB46qmnBn3/U6dO5fDhw+Tl5QHw3HPPDfoxzsWXQZAPvKWq1apaDKwHZnn7oLlZLirrm9h2vMzbhzLGjAJf//rXuf/++7n44otpbh78+5DCw8N59NFHWb58OYsWLSIlJYXY2NhBP05PvDpnsYikA6+r6vldrJuG05l8GRACfACsUNVurzICyMnJ0YFMTFNe28icH77NF5dO4qv/MaXf+zHGDNyePXuYNm2ar8vwuaqqKqKiolBVvvSlLzF58mTuueeefu+vq89VRDarapfXu3rz8tFngX8DU0QkX0Q+KyJ3isidAKq6B3gL2IETAo+fKwQGQ2x4MLPHx9llpMaYYeO3v/0t2dnZzJgxg/Lycu64444hPb7XOotV9Zxd36r6U+Cn3qqhO7lZLn729n6Kq+pJigo99wuMMcaL7rnnngGdAQyU3wwx0V7LZaT/PFDs40qMMcb3/DIIzh8bS0JkiDUPGWMMfhoEAQHCkslJrN9fhNvt+2t4jTHGl/wyCMBpHiqpbmDXIN/SbowxI43fBsHiyU4/wbr9Xh/ZwhgzTC1dupS//vWvHZY99NBDfPGLX+x2+5bL1y+//HLKysrO2uaBBx7gwQcf7PG4r7zyCrt37279+7vf/S7vvPNOH6sfPH4bBElRocwcF2v9BMb4sZUrV7J69eoOy1avXt2r8X7eeOMN4uLi+nXczkHwgx/8gGXLlvVrX4PBb4MAYElWEluOlVFR1+jrUowxPnDDDTfw+uuvU19fD0BeXh4nT57kmWeeIScnhxkzZvC9732vy9emp6dTXOxcefijH/2IKVOmsGzZstZhqsG5P+DCCy9k1qxZXH/99dTU1PDee+/x6quvct9995Gdnc2hQ4dYtWoVL7zwAgBr1qxh9uzZzJw5k9tuu621tvT0dL73ve8xZ84cZs6cyd69ewftc/CbiWm6kpuVzC//cYj3Dhaz/PxUX5djjH9785tw+sPB3eeYmfCxH3e7OjExkXnz5vHWW29x9dVXs3r1am666Sbuv/9+EhISaG5u5tJLL2XHjh1ccMEFXe5j8+bNrF69mq1bt9LU1MScOXOYO3cuANdddx2f//znAfj2t7/N737
"image/svg+xml": [
"<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"no\"?>\r\n",
"<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\r\n",
" \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\r\n",
"<!-- Created with matplotlib (https://matplotlib.org/) -->\r\n",
"<svg height=\"277.314375pt\" version=\"1.1\" viewBox=\"0 0 385.78125 277.314375\" width=\"385.78125pt\" xmlns=\"http://www.w3.org/2000/svg\" xmlns:xlink=\"http://www.w3.org/1999/xlink\">\r\n",
" <metadata>\r\n",
" <rdf:RDF xmlns:cc=\"http://creativecommons.org/ns#\" xmlns:dc=\"http://purl.org/dc/elements/1.1/\" xmlns:rdf=\"http://www.w3.org/1999/02/22-rdf-syntax-ns#\">\r\n",
" <cc:Work>\r\n",
" <dc:type rdf:resource=\"http://purl.org/dc/dcmitype/StillImage\"/>\r\n",
" <dc:date>2021-03-31T21:43:33.381917</dc:date>\r\n",
" <dc:format>image/svg+xml</dc:format>\r\n",
" <dc:creator>\r\n",
" <cc:Agent>\r\n",
" <dc:title>Matplotlib v3.3.4, https://matplotlib.org/</dc:title>\r\n",
" </cc:Agent>\r\n",
" </dc:creator>\r\n",
" </cc:Work>\r\n",
" </rdf:RDF>\r\n",
" </metadata>\r\n",
" <defs>\r\n",
" <style type=\"text/css\">*{stroke-linecap:butt;stroke-linejoin:round;}</style>\r\n",
" </defs>\r\n",
" <g id=\"figure_1\">\r\n",
" <g id=\"patch_1\">\r\n",
" <path d=\"M 0 277.314375 \r\n",
"L 385.78125 277.314375 \r\n",
"L 385.78125 0 \r\n",
"L 0 0 \r\n",
"z\r\n",
"\" style=\"fill:none;\"/>\r\n",
" </g>\r\n",
" <g id=\"axes_1\">\r\n",
" <g id=\"patch_2\">\r\n",
" <path d=\"M 43.78125 239.758125 \r\n",
"L 378.58125 239.758125 \r\n",
"L 378.58125 22.318125 \r\n",
"L 43.78125 22.318125 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;\"/>\r\n",
" </g>\r\n",
" <g id=\"matplotlib.axis_1\">\r\n",
" <g id=\"xtick_1\">\r\n",
" <g id=\"line2d_1\">\r\n",
" <defs>\r\n",
" <path d=\"M 0 0 \r\n",
"L 0 3.5 \r\n",
"\" id=\"mc07e170b47\" style=\"stroke:#000000;stroke-width:0.8;\"/>\r\n",
" </defs>\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"58.999432\" xlink:href=\"#mc07e170b47\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_1\">\r\n",
" <!-- 0 -->\r\n",
" <g transform=\"translate(55.818182 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 31.78125 66.40625 \r\n",
"Q 24.171875 66.40625 20.328125 58.90625 \r\n",
"Q 16.5 51.421875 16.5 36.375 \r\n",
"Q 16.5 21.390625 20.328125 13.890625 \r\n",
"Q 24.171875 6.390625 31.78125 6.390625 \r\n",
"Q 39.453125 6.390625 43.28125 13.890625 \r\n",
"Q 47.125 21.390625 47.125 36.375 \r\n",
"Q 47.125 51.421875 43.28125 58.90625 \r\n",
"Q 39.453125 66.40625 31.78125 66.40625 \r\n",
"z\r\n",
"M 31.78125 74.21875 \r\n",
"Q 44.046875 74.21875 50.515625 64.515625 \r\n",
"Q 56.984375 54.828125 56.984375 36.375 \r\n",
"Q 56.984375 17.96875 50.515625 8.265625 \r\n",
"Q 44.046875 -1.421875 31.78125 -1.421875 \r\n",
"Q 19.53125 -1.421875 13.0625 8.265625 \r\n",
"Q 6.59375 17.96875 6.59375 36.375 \r\n",
"Q 6.59375 54.828125 13.0625 64.515625 \r\n",
"Q 19.53125 74.21875 31.78125 74.21875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-48\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_2\">\r\n",
" <g id=\"line2d_2\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"126.635795\" xlink:href=\"#mc07e170b47\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_2\">\r\n",
" <!-- 2 -->\r\n",
" <g transform=\"translate(123.454545 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 19.1875 8.296875 \r\n",
"L 53.609375 8.296875 \r\n",
"L 53.609375 0 \r\n",
"L 7.328125 0 \r\n",
"L 7.328125 8.296875 \r\n",
"Q 12.9375 14.109375 22.625 23.890625 \r\n",
"Q 32.328125 33.6875 34.8125 36.53125 \r\n",
"Q 39.546875 41.84375 41.421875 45.53125 \r\n",
"Q 43.3125 49.21875 43.3125 52.78125 \r\n",
"Q 43.3125 58.59375 39.234375 62.25 \r\n",
"Q 35.15625 65.921875 28.609375 65.921875 \r\n",
"Q 23.96875 65.921875 18.8125 64.3125 \r\n",
"Q 13.671875 62.703125 7.8125 59.421875 \r\n",
"L 7.8125 69.390625 \r\n",
"Q 13.765625 71.78125 18.9375 73 \r\n",
"Q 24.125 74.21875 28.421875 74.21875 \r\n",
"Q 39.75 74.21875 46.484375 68.546875 \r\n",
"Q 53.21875 62.890625 53.21875 53.421875 \r\n",
"Q 53.21875 48.921875 51.53125 44.890625 \r\n",
"Q 49.859375 40.875 45.40625 35.40625 \r\n",
"Q 44.1875 33.984375 37.640625 27.21875 \r\n",
"Q 31.109375 20.453125 19.1875 8.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-50\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-50\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_3\">\r\n",
" <g id=\"line2d_3\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"194.272159\" xlink:href=\"#mc07e170b47\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_3\">\r\n",
" <!-- 4 -->\r\n",
" <g transform=\"translate(191.090909 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 37.796875 64.3125 \r\n",
"L 12.890625 25.390625 \r\n",
"L 37.796875 25.390625 \r\n",
"z\r\n",
"M 35.203125 72.90625 \r\n",
"L 47.609375 72.90625 \r\n",
"L 47.609375 25.390625 \r\n",
"L 58.015625 25.390625 \r\n",
"L 58.015625 17.1875 \r\n",
"L 47.609375 17.1875 \r\n",
"L 47.609375 0 \r\n",
"L 37.796875 0 \r\n",
"L 37.796875 17.1875 \r\n",
"L 4.890625 17.1875 \r\n",
"L 4.890625 26.703125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-52\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-52\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_4\">\r\n",
" <g id=\"line2d_4\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"261.908523\" xlink:href=\"#mc07e170b47\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_4\">\r\n",
" <!-- 6 -->\r\n",
" <g transform=\"translate(258.727273 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 33.015625 40.375 \r\n",
"Q 26.375 40.375 22.484375 35.828125 \r\n",
"Q 18.609375 31.296875 18.609375 23.390625 \r\n",
"Q 18.609375 15.53125 22.484375 10.953125 \r\n",
"Q 26.375 6.390625 33.015625 6.390625 \r\n",
"Q 39.65625 6.390625 43.53125 10.953125 \r\n",
"Q 47.40625 15.53125 47.40625 23.390625 \r\n",
"Q 47.40625 31.296875 43.53125 35.828125 \r\n",
"Q 39.65625 40.375 33.015625 40.375 \r\n",
"z\r\n",
"M 52.59375 71.296875 \r\n",
"L 52.59375 62.3125 \r\n",
"Q 48.875 64.0625 45.09375 64.984375 \r\n",
"Q 41.3125 65.921875 37.59375 65.921875 \r\n",
"Q 27.828125 65.921875 22.671875 59.328125 \r\n",
"Q 17.53125 52.734375 16.796875 39.40625 \r\n",
"Q 19.671875 43.65625 24.015625 45.921875 \r\n",
"Q 28.375 48.1875 33.59375 48.1875 \r\n",
"Q 44.578125 48.1875 50.953125 41.515625 \r\n",
"Q 57.328125 34.859375 57.328125 23.390625 \r\n",
"Q 57.328125 12.15625 50.6875 5.359375 \r\n",
"Q 44.046875 -1.421875 33.015625 -1.421875 \r\n",
"Q 20.359375 -1.421875 13.671875 8.265625 \r\n",
"Q 6.984375 17.96875 6.984375 36.375 \r\n",
"Q 6.984375 53.65625 15.1875 63.9375 \r\n",
"Q 23.390625 74.21875 37.203125 74.21875 \r\n",
"Q 40.921875 74.21875 44.703125 73.484375 \r\n",
"Q 48.484375 72.75 52.59375 71.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-54\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-54\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"xtick_5\">\r\n",
" <g id=\"line2d_5\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"329.544886\" xlink:href=\"#mc07e170b47\" y=\"239.758125\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_5\">\r\n",
" <!-- 8 -->\r\n",
" <g transform=\"translate(326.363636 254.356562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 31.78125 34.625 \r\n",
"Q 24.75 34.625 20.71875 30.859375 \r\n",
"Q 16.703125 27.09375 16.703125 20.515625 \r\n",
"Q 16.703125 13.921875 20.71875 10.15625 \r\n",
"Q 24.75 6.390625 31.78125 6.390625 \r\n",
"Q 38.8125 6.390625 42.859375 10.171875 \r\n",
"Q 46.921875 13.96875 46.921875 20.515625 \r\n",
"Q 46.921875 27.09375 42.890625 30.859375 \r\n",
"Q 38.875 34.625 31.78125 34.625 \r\n",
"z\r\n",
"M 21.921875 38.8125 \r\n",
"Q 15.578125 40.375 12.03125 44.71875 \r\n",
"Q 8.5 49.078125 8.5 55.328125 \r\n",
"Q 8.5 64.0625 14.71875 69.140625 \r\n",
"Q 20.953125 74.21875 31.78125 74.21875 \r\n",
"Q 42.671875 74.21875 48.875 69.140625 \r\n",
"Q 55.078125 64.0625 55.078125 55.328125 \r\n",
"Q 55.078125 49.078125 51.53125 44.71875 \r\n",
"Q 48 40.375 41.703125 38.8125 \r\n",
"Q 48.828125 37.15625 52.796875 32.3125 \r\n",
"Q 56.78125 27.484375 56.78125 20.515625 \r\n",
"Q 56.78125 9.90625 50.3125 4.234375 \r\n",
"Q 43.84375 -1.421875 31.78125 -1.421875 \r\n",
"Q 19.734375 -1.421875 13.25 4.234375 \r\n",
"Q 6.78125 9.90625 6.78125 20.515625 \r\n",
"Q 6.78125 27.484375 10.78125 32.3125 \r\n",
"Q 14.796875 37.15625 21.921875 38.8125 \r\n",
"z\r\n",
"M 18.3125 54.390625 \r\n",
"Q 18.3125 48.734375 21.84375 45.5625 \r\n",
"Q 25.390625 42.390625 31.78125 42.390625 \r\n",
"Q 38.140625 42.390625 41.71875 45.5625 \r\n",
"Q 45.3125 48.734375 45.3125 54.390625 \r\n",
"Q 45.3125 60.0625 41.71875 63.234375 \r\n",
"Q 38.140625 66.40625 31.78125 66.40625 \r\n",
"Q 25.390625 66.40625 21.84375 63.234375 \r\n",
"Q 18.3125 60.0625 18.3125 54.390625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-56\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-56\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_6\">\r\n",
" <!-- Epoch -->\r\n",
" <g transform=\"translate(195.870313 268.034687)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 9.8125 72.90625 \r\n",
"L 55.90625 72.90625 \r\n",
"L 55.90625 64.59375 \r\n",
"L 19.671875 64.59375 \r\n",
"L 19.671875 43.015625 \r\n",
"L 54.390625 43.015625 \r\n",
"L 54.390625 34.71875 \r\n",
"L 19.671875 34.71875 \r\n",
"L 19.671875 8.296875 \r\n",
"L 56.78125 8.296875 \r\n",
"L 56.78125 0 \r\n",
"L 9.8125 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-69\"/>\r\n",
" <path d=\"M 18.109375 8.203125 \r\n",
"L 18.109375 -20.796875 \r\n",
"L 9.078125 -20.796875 \r\n",
"L 9.078125 54.6875 \r\n",
"L 18.109375 54.6875 \r\n",
"L 18.109375 46.390625 \r\n",
"Q 20.953125 51.265625 25.265625 53.625 \r\n",
"Q 29.59375 56 35.59375 56 \r\n",
"Q 45.5625 56 51.78125 48.09375 \r\n",
"Q 58.015625 40.1875 58.015625 27.296875 \r\n",
"Q 58.015625 14.40625 51.78125 6.484375 \r\n",
"Q 45.5625 -1.421875 35.59375 -1.421875 \r\n",
"Q 29.59375 -1.421875 25.265625 0.953125 \r\n",
"Q 20.953125 3.328125 18.109375 8.203125 \r\n",
"z\r\n",
"M 48.6875 27.296875 \r\n",
"Q 48.6875 37.203125 44.609375 42.84375 \r\n",
"Q 40.53125 48.484375 33.40625 48.484375 \r\n",
"Q 26.265625 48.484375 22.1875 42.84375 \r\n",
"Q 18.109375 37.203125 18.109375 27.296875 \r\n",
"Q 18.109375 17.390625 22.1875 11.75 \r\n",
"Q 26.265625 6.109375 33.40625 6.109375 \r\n",
"Q 40.53125 6.109375 44.609375 11.75 \r\n",
"Q 48.6875 17.390625 48.6875 27.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-112\"/>\r\n",
" <path d=\"M 30.609375 48.390625 \r\n",
"Q 23.390625 48.390625 19.1875 42.75 \r\n",
"Q 14.984375 37.109375 14.984375 27.296875 \r\n",
"Q 14.984375 17.484375 19.15625 11.84375 \r\n",
"Q 23.34375 6.203125 30.609375 6.203125 \r\n",
"Q 37.796875 6.203125 41.984375 11.859375 \r\n",
"Q 46.1875 17.53125 46.1875 27.296875 \r\n",
"Q 46.1875 37.015625 41.984375 42.703125 \r\n",
"Q 37.796875 48.390625 30.609375 48.390625 \r\n",
"z\r\n",
"M 30.609375 56 \r\n",
"Q 42.328125 56 49.015625 48.375 \r\n",
"Q 55.71875 40.765625 55.71875 27.296875 \r\n",
"Q 55.71875 13.875 49.015625 6.21875 \r\n",
"Q 42.328125 -1.421875 30.609375 -1.421875 \r\n",
"Q 18.84375 -1.421875 12.171875 6.21875 \r\n",
"Q 5.515625 13.875 5.515625 27.296875 \r\n",
"Q 5.515625 40.765625 12.171875 48.375 \r\n",
"Q 18.84375 56 30.609375 56 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-111\"/>\r\n",
" <path d=\"M 48.78125 52.59375 \r\n",
"L 48.78125 44.1875 \r\n",
"Q 44.96875 46.296875 41.140625 47.34375 \r\n",
"Q 37.3125 48.390625 33.40625 48.390625 \r\n",
"Q 24.65625 48.390625 19.8125 42.84375 \r\n",
"Q 14.984375 37.3125 14.984375 27.296875 \r\n",
"Q 14.984375 17.28125 19.8125 11.734375 \r\n",
"Q 24.65625 6.203125 33.40625 6.203125 \r\n",
"Q 37.3125 6.203125 41.140625 7.25 \r\n",
"Q 44.96875 8.296875 48.78125 10.40625 \r\n",
"L 48.78125 2.09375 \r\n",
"Q 45.015625 0.34375 40.984375 -0.53125 \r\n",
"Q 36.96875 -1.421875 32.421875 -1.421875 \r\n",
"Q 20.0625 -1.421875 12.78125 6.34375 \r\n",
"Q 5.515625 14.109375 5.515625 27.296875 \r\n",
"Q 5.515625 40.671875 12.859375 48.328125 \r\n",
"Q 20.21875 56 33.015625 56 \r\n",
"Q 37.15625 56 41.109375 55.140625 \r\n",
"Q 45.0625 54.296875 48.78125 52.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-99\"/>\r\n",
" <path d=\"M 54.890625 33.015625 \r\n",
"L 54.890625 0 \r\n",
"L 45.90625 0 \r\n",
"L 45.90625 32.71875 \r\n",
"Q 45.90625 40.484375 42.875 44.328125 \r\n",
"Q 39.84375 48.1875 33.796875 48.1875 \r\n",
"Q 26.515625 48.1875 22.3125 43.546875 \r\n",
"Q 18.109375 38.921875 18.109375 30.90625 \r\n",
"L 18.109375 0 \r\n",
"L 9.078125 0 \r\n",
"L 9.078125 75.984375 \r\n",
"L 18.109375 75.984375 \r\n",
"L 18.109375 46.1875 \r\n",
"Q 21.34375 51.125 25.703125 53.5625 \r\n",
"Q 30.078125 56 35.796875 56 \r\n",
"Q 45.21875 56 50.046875 50.171875 \r\n",
"Q 54.890625 44.34375 54.890625 33.015625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-104\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-69\"/>\r\n",
" <use x=\"63.183594\" xlink:href=\"#DejaVuSans-112\"/>\r\n",
" <use x=\"126.660156\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"187.841797\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"242.822266\" xlink:href=\"#DejaVuSans-104\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"matplotlib.axis_2\">\r\n",
" <g id=\"ytick_1\">\r\n",
" <g id=\"line2d_6\">\r\n",
" <defs>\r\n",
" <path d=\"M 0 0 \r\n",
"L -3.5 0 \r\n",
"\" id=\"ma5d7494381\" style=\"stroke:#000000;stroke-width:0.8;\"/>\r\n",
" </defs>\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"43.78125\" xlink:href=\"#ma5d7494381\" y=\"231.893414\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_7\">\r\n",
" <!-- 0.6 -->\r\n",
" <g transform=\"translate(20.878125 235.692633)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 10.6875 12.40625 \r\n",
"L 21 12.40625 \r\n",
"L 21 0 \r\n",
"L 10.6875 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-46\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-54\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_2\">\r\n",
" <g id=\"line2d_7\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"43.78125\" xlink:href=\"#ma5d7494381\" y=\"192.941647\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_8\">\r\n",
" <!-- 0.8 -->\r\n",
" <g transform=\"translate(20.878125 196.740866)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-48\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-56\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_3\">\r\n",
" <g id=\"line2d_8\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"43.78125\" xlink:href=\"#ma5d7494381\" y=\"153.98988\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_9\">\r\n",
" <!-- 1.0 -->\r\n",
" <g transform=\"translate(20.878125 157.789099)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 12.40625 8.296875 \r\n",
"L 28.515625 8.296875 \r\n",
"L 28.515625 63.921875 \r\n",
"L 10.984375 60.40625 \r\n",
"L 10.984375 69.390625 \r\n",
"L 28.421875 72.90625 \r\n",
"L 38.28125 72.90625 \r\n",
"L 38.28125 8.296875 \r\n",
"L 54.390625 8.296875 \r\n",
"L 54.390625 0 \r\n",
"L 12.40625 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-49\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-49\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-48\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_4\">\r\n",
" <g id=\"line2d_9\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"43.78125\" xlink:href=\"#ma5d7494381\" y=\"115.038113\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_10\">\r\n",
" <!-- 1.2 -->\r\n",
" <g transform=\"translate(20.878125 118.837332)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-49\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-50\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_5\">\r\n",
" <g id=\"line2d_10\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"43.78125\" xlink:href=\"#ma5d7494381\" y=\"76.086346\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_11\">\r\n",
" <!-- 1.4 -->\r\n",
" <g transform=\"translate(20.878125 79.885565)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-49\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-52\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"ytick_6\">\r\n",
" <g id=\"line2d_11\">\r\n",
" <g>\r\n",
" <use style=\"stroke:#000000;stroke-width:0.8;\" x=\"43.78125\" xlink:href=\"#ma5d7494381\" y=\"37.134579\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_12\">\r\n",
" <!-- 1.6 -->\r\n",
" <g transform=\"translate(20.878125 40.933798)scale(0.1 -0.1)\">\r\n",
" <use xlink:href=\"#DejaVuSans-49\"/>\r\n",
" <use x=\"63.623047\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"95.410156\" xlink:href=\"#DejaVuSans-54\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"text_13\">\r\n",
" <!-- Loss -->\r\n",
" <g transform=\"translate(14.798438 142.005312)rotate(-90)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 9.8125 72.90625 \r\n",
"L 19.671875 72.90625 \r\n",
"L 19.671875 8.296875 \r\n",
"L 55.171875 8.296875 \r\n",
"L 55.171875 0 \r\n",
"L 9.8125 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-76\"/>\r\n",
" <path d=\"M 44.28125 53.078125 \r\n",
"L 44.28125 44.578125 \r\n",
"Q 40.484375 46.53125 36.375 47.5 \r\n",
"Q 32.28125 48.484375 27.875 48.484375 \r\n",
"Q 21.1875 48.484375 17.84375 46.4375 \r\n",
"Q 14.5 44.390625 14.5 40.28125 \r\n",
"Q 14.5 37.15625 16.890625 35.375 \r\n",
"Q 19.28125 33.59375 26.515625 31.984375 \r\n",
"L 29.59375 31.296875 \r\n",
"Q 39.15625 29.25 43.1875 25.515625 \r\n",
"Q 47.21875 21.78125 47.21875 15.09375 \r\n",
"Q 47.21875 7.46875 41.1875 3.015625 \r\n",
"Q 35.15625 -1.421875 24.609375 -1.421875 \r\n",
"Q 20.21875 -1.421875 15.453125 -0.5625 \r\n",
"Q 10.6875 0.296875 5.421875 2 \r\n",
"L 5.421875 11.28125 \r\n",
"Q 10.40625 8.6875 15.234375 7.390625 \r\n",
"Q 20.0625 6.109375 24.8125 6.109375 \r\n",
"Q 31.15625 6.109375 34.5625 8.28125 \r\n",
"Q 37.984375 10.453125 37.984375 14.40625 \r\n",
"Q 37.984375 18.0625 35.515625 20.015625 \r\n",
"Q 33.0625 21.96875 24.703125 23.78125 \r\n",
"L 21.578125 24.515625 \r\n",
"Q 13.234375 26.265625 9.515625 29.90625 \r\n",
"Q 5.8125 33.546875 5.8125 39.890625 \r\n",
"Q 5.8125 47.609375 11.28125 51.796875 \r\n",
"Q 16.75 56 26.8125 56 \r\n",
"Q 31.78125 56 36.171875 55.265625 \r\n",
"Q 40.578125 54.546875 44.28125 53.078125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-115\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-76\"/>\r\n",
" <use x=\"53.962891\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"115.144531\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" <use x=\"167.244141\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"line2d_12\">\r\n",
" <path clip-path=\"url(#p3c53182167)\" d=\"M 58.999432 32.201761 \r\n",
"L 92.817614 152.63744 \r\n",
"L 126.635795 176.831627 \r\n",
"L 160.453977 190.120075 \r\n",
"L 194.272159 200.293769 \r\n",
"L 228.090341 208.521814 \r\n",
"L 261.908523 214.957967 \r\n",
"L 295.726705 220.693951 \r\n",
"L 329.544886 225.72957 \r\n",
"L 363.363068 229.874489 \r\n",
"\" style=\"fill:none;stroke:#1f77b4;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_13\">\r\n",
" <path clip-path=\"url(#p3c53182167)\" d=\"M 58.999432 133.681823 \r\n",
"L 92.817614 165.896565 \r\n",
"L 126.635795 178.613235 \r\n",
"L 160.453977 181.677817 \r\n",
"L 194.272159 190.668544 \r\n",
"L 228.090341 197.444745 \r\n",
"L 261.908523 194.22787 \r\n",
"L 295.726705 202.959819 \r\n",
"L 329.544886 205.575349 \r\n",
"L 363.363068 203.873747 \r\n",
"\" style=\"fill:none;stroke:#ff7f0e;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_3\">\r\n",
" <path d=\"M 43.78125 239.758125 \r\n",
"L 43.78125 22.318125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_4\">\r\n",
" <path d=\"M 378.58125 239.758125 \r\n",
"L 378.58125 22.318125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_5\">\r\n",
" <path d=\"M 43.78125 239.758125 \r\n",
"L 378.58125 239.758125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"patch_6\">\r\n",
" <path d=\"M 43.78125 22.318125 \r\n",
"L 378.58125 22.318125 \r\n",
"\" style=\"fill:none;stroke:#000000;stroke-linecap:square;stroke-linejoin:miter;stroke-width:0.8;\"/>\r\n",
" </g>\r\n",
" <g id=\"text_14\">\r\n",
" <!-- Loss vs. epochs -->\r\n",
" <g transform=\"translate(164.22375 16.318125)scale(0.12 -0.12)\">\r\n",
" <defs>\r\n",
" <path id=\"DejaVuSans-32\"/>\r\n",
" <path d=\"M 2.984375 54.6875 \r\n",
"L 12.5 54.6875 \r\n",
"L 29.59375 8.796875 \r\n",
"L 46.6875 54.6875 \r\n",
"L 56.203125 54.6875 \r\n",
"L 35.6875 0 \r\n",
"L 23.484375 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-118\"/>\r\n",
" <path d=\"M 56.203125 29.59375 \r\n",
"L 56.203125 25.203125 \r\n",
"L 14.890625 25.203125 \r\n",
"Q 15.484375 15.921875 20.484375 11.0625 \r\n",
"Q 25.484375 6.203125 34.421875 6.203125 \r\n",
"Q 39.59375 6.203125 44.453125 7.46875 \r\n",
"Q 49.3125 8.734375 54.109375 11.28125 \r\n",
"L 54.109375 2.78125 \r\n",
"Q 49.265625 0.734375 44.1875 -0.34375 \r\n",
"Q 39.109375 -1.421875 33.890625 -1.421875 \r\n",
"Q 20.796875 -1.421875 13.15625 6.1875 \r\n",
"Q 5.515625 13.8125 5.515625 26.8125 \r\n",
"Q 5.515625 40.234375 12.765625 48.109375 \r\n",
"Q 20.015625 56 32.328125 56 \r\n",
"Q 43.359375 56 49.78125 48.890625 \r\n",
"Q 56.203125 41.796875 56.203125 29.59375 \r\n",
"z\r\n",
"M 47.21875 32.234375 \r\n",
"Q 47.125 39.59375 43.09375 43.984375 \r\n",
"Q 39.0625 48.390625 32.421875 48.390625 \r\n",
"Q 24.90625 48.390625 20.390625 44.140625 \r\n",
"Q 15.875 39.890625 15.1875 32.171875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-101\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-76\"/>\r\n",
" <use x=\"53.962891\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"115.144531\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" <use x=\"167.244141\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" <use x=\"219.34375\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"251.130859\" xlink:href=\"#DejaVuSans-118\"/>\r\n",
" <use x=\"310.310547\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" <use x=\"362.410156\" xlink:href=\"#DejaVuSans-46\"/>\r\n",
" <use x=\"394.197266\" xlink:href=\"#DejaVuSans-32\"/>\r\n",
" <use x=\"425.984375\" xlink:href=\"#DejaVuSans-101\"/>\r\n",
" <use x=\"487.507812\" xlink:href=\"#DejaVuSans-112\"/>\r\n",
" <use x=\"550.984375\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"612.166016\" xlink:href=\"#DejaVuSans-99\"/>\r\n",
" <use x=\"667.146484\" xlink:href=\"#DejaVuSans-104\"/>\r\n",
" <use x=\"730.525391\" xlink:href=\"#DejaVuSans-115\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"legend_1\">\r\n",
" <g id=\"patch_7\">\r\n",
" <path d=\"M 290.2 59.674375 \r\n",
"L 371.58125 59.674375 \r\n",
"Q 373.58125 59.674375 373.58125 57.674375 \r\n",
"L 373.58125 29.318125 \r\n",
"Q 373.58125 27.318125 371.58125 27.318125 \r\n",
"L 290.2 27.318125 \r\n",
"Q 288.2 27.318125 288.2 29.318125 \r\n",
"L 288.2 57.674375 \r\n",
"Q 288.2 59.674375 290.2 59.674375 \r\n",
"z\r\n",
"\" style=\"fill:#ffffff;opacity:0.8;stroke:#cccccc;stroke-linejoin:miter;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_14\">\r\n",
" <path d=\"M 292.2 35.416562 \r\n",
"L 312.2 35.416562 \r\n",
"\" style=\"fill:none;stroke:#1f77b4;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_15\"/>\r\n",
" <g id=\"text_15\">\r\n",
" <!-- Training -->\r\n",
" <g transform=\"translate(320.2 38.916562)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M -0.296875 72.90625 \r\n",
"L 61.375 72.90625 \r\n",
"L 61.375 64.59375 \r\n",
"L 35.5 64.59375 \r\n",
"L 35.5 0 \r\n",
"L 25.59375 0 \r\n",
"L 25.59375 64.59375 \r\n",
"L -0.296875 64.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-84\"/>\r\n",
" <path d=\"M 41.109375 46.296875 \r\n",
"Q 39.59375 47.171875 37.8125 47.578125 \r\n",
"Q 36.03125 48 33.890625 48 \r\n",
"Q 26.265625 48 22.1875 43.046875 \r\n",
"Q 18.109375 38.09375 18.109375 28.8125 \r\n",
"L 18.109375 0 \r\n",
"L 9.078125 0 \r\n",
"L 9.078125 54.6875 \r\n",
"L 18.109375 54.6875 \r\n",
"L 18.109375 46.1875 \r\n",
"Q 20.953125 51.171875 25.484375 53.578125 \r\n",
"Q 30.03125 56 36.53125 56 \r\n",
"Q 37.453125 56 38.578125 55.875 \r\n",
"Q 39.703125 55.765625 41.0625 55.515625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-114\"/>\r\n",
" <path d=\"M 34.28125 27.484375 \r\n",
"Q 23.390625 27.484375 19.1875 25 \r\n",
"Q 14.984375 22.515625 14.984375 16.5 \r\n",
"Q 14.984375 11.71875 18.140625 8.90625 \r\n",
"Q 21.296875 6.109375 26.703125 6.109375 \r\n",
"Q 34.1875 6.109375 38.703125 11.40625 \r\n",
"Q 43.21875 16.703125 43.21875 25.484375 \r\n",
"L 43.21875 27.484375 \r\n",
"z\r\n",
"M 52.203125 31.203125 \r\n",
"L 52.203125 0 \r\n",
"L 43.21875 0 \r\n",
"L 43.21875 8.296875 \r\n",
"Q 40.140625 3.328125 35.546875 0.953125 \r\n",
"Q 30.953125 -1.421875 24.3125 -1.421875 \r\n",
"Q 15.921875 -1.421875 10.953125 3.296875 \r\n",
"Q 6 8.015625 6 15.921875 \r\n",
"Q 6 25.140625 12.171875 29.828125 \r\n",
"Q 18.359375 34.515625 30.609375 34.515625 \r\n",
"L 43.21875 34.515625 \r\n",
"L 43.21875 35.40625 \r\n",
"Q 43.21875 41.609375 39.140625 45 \r\n",
"Q 35.0625 48.390625 27.6875 48.390625 \r\n",
"Q 23 48.390625 18.546875 47.265625 \r\n",
"Q 14.109375 46.140625 10.015625 43.890625 \r\n",
"L 10.015625 52.203125 \r\n",
"Q 14.9375 54.109375 19.578125 55.046875 \r\n",
"Q 24.21875 56 28.609375 56 \r\n",
"Q 40.484375 56 46.34375 49.84375 \r\n",
"Q 52.203125 43.703125 52.203125 31.203125 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-97\"/>\r\n",
" <path d=\"M 9.421875 54.6875 \r\n",
"L 18.40625 54.6875 \r\n",
"L 18.40625 0 \r\n",
"L 9.421875 0 \r\n",
"z\r\n",
"M 9.421875 75.984375 \r\n",
"L 18.40625 75.984375 \r\n",
"L 18.40625 64.59375 \r\n",
"L 9.421875 64.59375 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-105\"/>\r\n",
" <path d=\"M 54.890625 33.015625 \r\n",
"L 54.890625 0 \r\n",
"L 45.90625 0 \r\n",
"L 45.90625 32.71875 \r\n",
"Q 45.90625 40.484375 42.875 44.328125 \r\n",
"Q 39.84375 48.1875 33.796875 48.1875 \r\n",
"Q 26.515625 48.1875 22.3125 43.546875 \r\n",
"Q 18.109375 38.921875 18.109375 30.90625 \r\n",
"L 18.109375 0 \r\n",
"L 9.078125 0 \r\n",
"L 9.078125 54.6875 \r\n",
"L 18.109375 54.6875 \r\n",
"L 18.109375 46.1875 \r\n",
"Q 21.34375 51.125 25.703125 53.5625 \r\n",
"Q 30.078125 56 35.796875 56 \r\n",
"Q 45.21875 56 50.046875 50.171875 \r\n",
"Q 54.890625 44.34375 54.890625 33.015625 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-110\"/>\r\n",
" <path d=\"M 45.40625 27.984375 \r\n",
"Q 45.40625 37.75 41.375 43.109375 \r\n",
"Q 37.359375 48.484375 30.078125 48.484375 \r\n",
"Q 22.859375 48.484375 18.828125 43.109375 \r\n",
"Q 14.796875 37.75 14.796875 27.984375 \r\n",
"Q 14.796875 18.265625 18.828125 12.890625 \r\n",
"Q 22.859375 7.515625 30.078125 7.515625 \r\n",
"Q 37.359375 7.515625 41.375 12.890625 \r\n",
"Q 45.40625 18.265625 45.40625 27.984375 \r\n",
"z\r\n",
"M 54.390625 6.78125 \r\n",
"Q 54.390625 -7.171875 48.1875 -13.984375 \r\n",
"Q 42 -20.796875 29.203125 -20.796875 \r\n",
"Q 24.46875 -20.796875 20.265625 -20.09375 \r\n",
"Q 16.0625 -19.390625 12.109375 -17.921875 \r\n",
"L 12.109375 -9.1875 \r\n",
"Q 16.0625 -11.328125 19.921875 -12.34375 \r\n",
"Q 23.78125 -13.375 27.78125 -13.375 \r\n",
"Q 36.625 -13.375 41.015625 -8.765625 \r\n",
"Q 45.40625 -4.15625 45.40625 5.171875 \r\n",
"L 45.40625 9.625 \r\n",
"Q 42.625 4.78125 38.28125 2.390625 \r\n",
"Q 33.9375 0 27.875 0 \r\n",
"Q 17.828125 0 11.671875 7.65625 \r\n",
"Q 5.515625 15.328125 5.515625 27.984375 \r\n",
"Q 5.515625 40.671875 11.671875 48.328125 \r\n",
"Q 17.828125 56 27.875 56 \r\n",
"Q 33.9375 56 38.28125 53.609375 \r\n",
"Q 42.625 51.21875 45.40625 46.390625 \r\n",
"L 45.40625 54.6875 \r\n",
"L 54.390625 54.6875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-103\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-84\"/>\r\n",
" <use x=\"46.333984\" xlink:href=\"#DejaVuSans-114\"/>\r\n",
" <use x=\"87.447266\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"148.726562\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"176.509766\" xlink:href=\"#DejaVuSans-110\"/>\r\n",
" <use x=\"239.888672\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"267.671875\" xlink:href=\"#DejaVuSans-110\"/>\r\n",
" <use x=\"331.050781\" xlink:href=\"#DejaVuSans-103\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" <g id=\"line2d_16\">\r\n",
" <path d=\"M 292.2 50.094687 \r\n",
"L 312.2 50.094687 \r\n",
"\" style=\"fill:none;stroke:#ff7f0e;stroke-linecap:square;stroke-width:1.5;\"/>\r\n",
" </g>\r\n",
" <g id=\"line2d_17\"/>\r\n",
" <g id=\"text_16\">\r\n",
" <!-- Validation -->\r\n",
" <g transform=\"translate(320.2 53.594687)scale(0.1 -0.1)\">\r\n",
" <defs>\r\n",
" <path d=\"M 28.609375 0 \r\n",
"L 0.78125 72.90625 \r\n",
"L 11.078125 72.90625 \r\n",
"L 34.1875 11.53125 \r\n",
"L 57.328125 72.90625 \r\n",
"L 67.578125 72.90625 \r\n",
"L 39.796875 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-86\"/>\r\n",
" <path d=\"M 9.421875 75.984375 \r\n",
"L 18.40625 75.984375 \r\n",
"L 18.40625 0 \r\n",
"L 9.421875 0 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-108\"/>\r\n",
" <path d=\"M 45.40625 46.390625 \r\n",
"L 45.40625 75.984375 \r\n",
"L 54.390625 75.984375 \r\n",
"L 54.390625 0 \r\n",
"L 45.40625 0 \r\n",
"L 45.40625 8.203125 \r\n",
"Q 42.578125 3.328125 38.25 0.953125 \r\n",
"Q 33.9375 -1.421875 27.875 -1.421875 \r\n",
"Q 17.96875 -1.421875 11.734375 6.484375 \r\n",
"Q 5.515625 14.40625 5.515625 27.296875 \r\n",
"Q 5.515625 40.1875 11.734375 48.09375 \r\n",
"Q 17.96875 56 27.875 56 \r\n",
"Q 33.9375 56 38.25 53.625 \r\n",
"Q 42.578125 51.265625 45.40625 46.390625 \r\n",
"z\r\n",
"M 14.796875 27.296875 \r\n",
"Q 14.796875 17.390625 18.875 11.75 \r\n",
"Q 22.953125 6.109375 30.078125 6.109375 \r\n",
"Q 37.203125 6.109375 41.296875 11.75 \r\n",
"Q 45.40625 17.390625 45.40625 27.296875 \r\n",
"Q 45.40625 37.203125 41.296875 42.84375 \r\n",
"Q 37.203125 48.484375 30.078125 48.484375 \r\n",
"Q 22.953125 48.484375 18.875 42.84375 \r\n",
"Q 14.796875 37.203125 14.796875 27.296875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-100\"/>\r\n",
" <path d=\"M 18.3125 70.21875 \r\n",
"L 18.3125 54.6875 \r\n",
"L 36.8125 54.6875 \r\n",
"L 36.8125 47.703125 \r\n",
"L 18.3125 47.703125 \r\n",
"L 18.3125 18.015625 \r\n",
"Q 18.3125 11.328125 20.140625 9.421875 \r\n",
"Q 21.96875 7.515625 27.59375 7.515625 \r\n",
"L 36.8125 7.515625 \r\n",
"L 36.8125 0 \r\n",
"L 27.59375 0 \r\n",
"Q 17.1875 0 13.234375 3.875 \r\n",
"Q 9.28125 7.765625 9.28125 18.015625 \r\n",
"L 9.28125 47.703125 \r\n",
"L 2.6875 47.703125 \r\n",
"L 2.6875 54.6875 \r\n",
"L 9.28125 54.6875 \r\n",
"L 9.28125 70.21875 \r\n",
"z\r\n",
"\" id=\"DejaVuSans-116\"/>\r\n",
" </defs>\r\n",
" <use xlink:href=\"#DejaVuSans-86\"/>\r\n",
" <use x=\"60.658203\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"121.9375\" xlink:href=\"#DejaVuSans-108\"/>\r\n",
" <use x=\"149.720703\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"177.503906\" xlink:href=\"#DejaVuSans-100\"/>\r\n",
" <use x=\"240.980469\" xlink:href=\"#DejaVuSans-97\"/>\r\n",
" <use x=\"302.259766\" xlink:href=\"#DejaVuSans-116\"/>\r\n",
" <use x=\"341.46875\" xlink:href=\"#DejaVuSans-105\"/>\r\n",
" <use x=\"369.251953\" xlink:href=\"#DejaVuSans-111\"/>\r\n",
" <use x=\"430.433594\" xlink:href=\"#DejaVuSans-110\"/>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" </g>\r\n",
" <defs>\r\n",
" <clipPath id=\"p3c53182167\">\r\n",
" <rect height=\"217.44\" width=\"334.8\" x=\"43.78125\" y=\"22.318125\"/>\r\n",
" </clipPath>\r\n",
" </defs>\r\n",
"</svg>\r\n"
],
2021-03-30 00:07:48 -07:00
"text/plain": [
"<Figure size 432x288 with 1 Axes>"
]
},
"metadata": {
2021-04-01 03:16:00 -07:00
"needs_background": "light"
2021-03-30 00:07:48 -07:00
},
"output_type": "display_data"
}
],
"source": [
"plt.plot(history.history['loss'])\n",
"plt.plot(history.history['val_loss'])\n",
"plt.title('Loss vs. epochs')\n",
"plt.ylabel('Loss')\n",
"plt.xlabel('Epoch')\n",
"plt.legend(['Training', 'Validation'], loc='upper right')\n",
"plt.show() "
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 13,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 68
},
"colab_type": "code",
"id": "b0kH6VYqz_Gc",
"outputId": "bed011f6-70b7-43ad-bb91-9c265421f55a"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
2021-04-01 03:16:00 -07:00
"814/814 [==============================] - 27s 33ms/step - loss: 0.9151 - accuracy: 0.7503\n",
"Test loss: 0.9151020050048828\n",
"Test accuracy: 0.7503457069396973\n"
2021-03-30 00:07:48 -07:00
]
}
],
"source": [
"test_loss, test_accuracy = model.evaluate(grayscale_test_images, test_labels)\n",
"print(f\"Test loss: {test_loss}\")\n",
"print(f\"Test accuracy: {test_accuracy}\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "ncPtDtCLz_Gg"
},
"source": [
"## 3. CNN neural network classifier\n",
"* Build a CNN classifier model using the Sequential API. Your model should use the Conv2D, MaxPool2D, BatchNormalization, Flatten, Dense and Dropout layers. The final layer should again have a 10-way softmax output. \n",
"* You should design and build the model yourself. Feel free to experiment with different CNN architectures. _Hint: to achieve a reasonable accuracy you won't need to use more than 2 or 3 convolutional layers and 2 fully connected layers.)_\n",
"* The CNN model should use fewer trainable parameters than your MLP model.\n",
"* Compile and train the model (we recommend a maximum of 30 epochs), making use of both training and validation sets during the training run.\n",
"* Your model should track at least one appropriate metric, and use at least two callbacks during training, one of which should be a ModelCheckpoint callback.\n",
"* You should aim to beat the MLP model performance with fewer parameters!\n",
"* Plot the learning curves for loss vs epoch and accuracy vs epoch for both training and validation sets.\n",
"* Compute and display the loss and accuracy of the trained model on the test set."
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 4,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {},
"colab_type": "code",
"id": "yk2mH3Npz_Gh"
},
"outputs": [],
"source": [
"def get_cnn_model(input_shape):\n",
"\n",
" model = Sequential([\n",
" \n",
"\n",
" Conv2D(64,input_shape = input_shape,kernel_size = (3,3),activation = \"relu\",padding = 'SAME'),\n",
" Conv2D(64,kernel_size = (3,3),activation = \"relu\",padding = 'SAME'),\n",
" MaxPooling2D(pool_size = (2,2)),\n",
" BatchNormalization(),\n",
" Conv2D(128,kernel_size = (3,3),activation = \"relu\",padding = 'SAME'),\n",
" MaxPooling2D(pool_size = (2,2)),\n",
" Dropout(0.5),\n",
" Flatten(),\n",
" Dense(64,activation = \"relu\"),\n",
" Dense(64,activation = \"relu\"),\n",
" Dense(11,activation = \"softmax\")\n",
" ])\n",
"\n",
"\n",
" model.compile(optimizer='adam',\n",
" loss='sparse_categorical_crossentropy',\n",
" metrics=['accuracy'])\n",
"\n",
" return model"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 12,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 527
},
"colab_type": "code",
"id": "lbgRgZ5cz_Gn",
"outputId": "af258135-eee7-4573-831e-5f1b1195bae1"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
2021-04-01 03:16:00 -07:00
"Model: \"sequential\"\n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
"Layer (type) Output Shape Param # \n",
"=================================================================\n",
2021-04-01 03:16:00 -07:00
"conv2d (Conv2D) (None, 32, 32, 64) 640 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"conv2d_1 (Conv2D) (None, 32, 32, 64) 36928 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"max_pooling2d (MaxPooling2D) (None, 16, 16, 64) 0 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"batch_normalization (BatchNo (None, 16, 16, 64) 256 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"conv2d_2 (Conv2D) (None, 16, 16, 128) 73856 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"max_pooling2d_1 (MaxPooling2 (None, 8, 8, 128) 0 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dropout (Dropout) (None, 8, 8, 128) 0 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"flatten (Flatten) (None, 8192) 0 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense (Dense) (None, 64) 524352 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense_1 (Dense) (None, 64) 4160 \n",
2021-03-30 00:07:48 -07:00
"_________________________________________________________________\n",
2021-04-01 03:16:00 -07:00
"dense_2 (Dense) (None, 11) 715 \n",
2021-03-30 00:07:48 -07:00
"=================================================================\n",
"Total params: 640,907\n",
"Trainable params: 640,779\n",
"Non-trainable params: 128\n",
"_________________________________________________________________\n"
]
}
],
"source": [
"cnn_model = get_cnn_model(grayscale_train_images[0].shape)\n",
"cnn_model.summary()"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 16,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 649
},
"colab_type": "code",
"id": "nkmS2vV2z_Gs",
"outputId": "fe2c9d1c-3e6e-4ce2-d475-54e20c33464a"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Epoch 1/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.7535 - accuracy: 0.7612\n",
"Epoch 00001: val_accuracy improved from -inf to 0.86113, saving model to /content/checkpoint_cnn_best\\checkpoint\n",
"1946/1946 [==============================] - 521s 268ms/step - loss: 0.7535 - accuracy: 0.7612 - val_loss: 0.4573 - val_accuracy: 0.8611\n",
2021-03-30 00:07:48 -07:00
"Epoch 2/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.4506 - accuracy: 0.8624\n",
"Epoch 00002: val_accuracy did not improve from 0.86113\n",
"1946/1946 [==============================] - 514s 264ms/step - loss: 0.4506 - accuracy: 0.8624 - val_loss: 0.4984 - val_accuracy: 0.8509\n",
2021-03-30 00:07:48 -07:00
"Epoch 3/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.3974 - accuracy: 0.8786\n",
"Epoch 00003: val_accuracy improved from 0.86113 to 0.87606, saving model to /content/checkpoint_cnn_best\\checkpoint\n",
"1946/1946 [==============================] - 554s 285ms/step - loss: 0.3974 - accuracy: 0.8786 - val_loss: 0.3995 - val_accuracy: 0.8761\n",
2021-03-30 00:07:48 -07:00
"Epoch 4/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.3600 - accuracy: 0.8904\n",
"Epoch 00004: val_accuracy improved from 0.87606 to 0.89180, saving model to /content/checkpoint_cnn_best\\checkpoint\n",
"1946/1946 [==============================] - 609s 313ms/step - loss: 0.3600 - accuracy: 0.8904 - val_loss: 0.3685 - val_accuracy: 0.8918\n",
2021-03-30 00:07:48 -07:00
"Epoch 5/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.3314 - accuracy: 0.8991\n",
"Epoch 00005: val_accuracy improved from 0.89180 to 0.90891, saving model to /content/checkpoint_cnn_best\\checkpoint\n",
"1946/1946 [==============================] - 645s 332ms/step - loss: 0.3314 - accuracy: 0.8991 - val_loss: 0.3094 - val_accuracy: 0.9089\n",
2021-03-30 00:07:48 -07:00
"Epoch 6/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.3104 - accuracy: 0.9049\n",
"Epoch 00006: val_accuracy did not improve from 0.90891\n",
"1946/1946 [==============================] - 632s 325ms/step - loss: 0.3104 - accuracy: 0.9049 - val_loss: 0.3592 - val_accuracy: 0.8950\n",
2021-03-30 00:07:48 -07:00
"Epoch 7/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.2948 - accuracy: 0.9112\n",
"Epoch 00007: val_accuracy improved from 0.90891 to 0.91300, saving model to /content/checkpoint_cnn_best\\checkpoint\n",
"1946/1946 [==============================] - 675s 347ms/step - loss: 0.2948 - accuracy: 0.9112 - val_loss: 0.3000 - val_accuracy: 0.9130\n",
2021-03-30 00:07:48 -07:00
"Epoch 8/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.2776 - accuracy: 0.9159\n",
"Epoch 00008: val_accuracy did not improve from 0.91300\n",
"1946/1946 [==============================] - 641s 330ms/step - loss: 0.2776 - accuracy: 0.9159 - val_loss: 0.3266 - val_accuracy: 0.9032\n",
2021-03-30 00:07:48 -07:00
"Epoch 9/10\n",
2021-04-01 03:16:00 -07:00
"1946/1946 [==============================] - ETA: 0s - loss: 0.2622 - accuracy: 0.9201\n",
"Epoch 00009: val_accuracy improved from 0.91300 to 0.91373, saving model to /content/checkpoint_cnn_best\\checkpoint\n",
"1946/1946 [==============================] - 625s 321ms/step - loss: 0.2622 - accuracy: 0.9201 - val_loss: 0.2985 - val_accuracy: 0.9137\n",
"Epoch 10/10\n",
"1946/1946 [==============================] - ETA: 0s - loss: 0.2498 - accuracy: 0.9240\n",
"Epoch 00010: val_accuracy did not improve from 0.91373\n",
"1946/1946 [==============================] - 713s 366ms/step - loss: 0.2498 - accuracy: 0.9240 - val_loss: 0.2917 - val_accuracy: 0.9126\n"
2021-03-30 00:07:48 -07:00
]
}
],
"source": [
"early_stopping = EarlyStopping(monitor = \"val_accuracy\",mode = \"max\",patience = 3)\n",
"\n",
"checkpoint = ModelCheckpoint(filepath = '/content/checkpoint_cnn_best/checkpoint',save_freq = \"epoch\",save_weights_only = True,verbose = 1, save_best_only = True,monitor = \"val_accuracy\")\n",
"\n",
"\n",
"history = cnn_model.fit(grayscale_train_images,train_labels,epochs = 10,validation_split= 0.15,callbacks = [checkpoint,early_stopping])"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": null,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 295
},
"colab_type": "code",
"id": "VytQECDVz_Gv",
"outputId": "2dcb2ab2-3619-4617-feb5-dd12495c861e"
},
2021-04-01 03:16:00 -07:00
"outputs": [],
2021-03-30 00:07:48 -07:00
"source": [
"try:\n",
" plt.plot(history.history['accuracy'])\n",
" plt.plot(history.history['val_accuracy'])\n",
"except KeyError:\n",
" plt.plot(history.history['acc'])\n",
" plt.plot(history.history['val_acc'])\n",
"plt.title('Accuracy vs. epochs')\n",
"plt.ylabel('Loss')\n",
"plt.xlabel('Epoch')\n",
"plt.legend(['Training', 'Validation'], loc='lower right')\n",
"plt.show() "
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": null,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 295
},
"colab_type": "code",
"id": "60mJypwQz_Gx",
"outputId": "7e1a0317-1578-47fe-c561-a46023e39ff9"
},
2021-04-01 03:16:00 -07:00
"outputs": [],
2021-03-30 00:07:48 -07:00
"source": [
"plt.plot(history.history['loss'])\n",
"plt.plot(history.history['val_loss'])\n",
"plt.title('Loss vs. epochs')\n",
"plt.ylabel('Loss')\n",
"plt.xlabel('Epoch')\n",
"plt.legend(['Training', 'Validation'], loc='upper right')\n",
"plt.show() "
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": null,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 68
},
"colab_type": "code",
"id": "w2v80qosz_G0",
"outputId": "fa802da4-ddf1-4373-9a50-e1e48b2a9d2c"
},
2021-04-01 03:16:00 -07:00
"outputs": [],
2021-03-30 00:07:48 -07:00
"source": [
"test_loss, test_accuracy = cnn_model.evaluate(grayscale_test_images, test_labels)\n",
"print(f\"Test loss: {test_loss}\")\n",
"print(f\"Test accuracy: {test_accuracy}\")"
]
},
{
"cell_type": "markdown",
"metadata": {
"colab_type": "text",
"id": "3iBYFPWUz_G4"
},
"source": [
"## 4. Get model predictions\n",
"* Load the best weights for the MLP and CNN models that you saved during the training run.\n",
"* Randomly select 5 images and corresponding labels from the test set and display the images with their labels.\n",
"* Alongside the image and label, show each model’s predictive distribution as a bar chart, and the final model prediction given by the label with maximum probability."
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": null,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 85
},
"colab_type": "code",
"id": "XMYYWs0oz_G5",
"outputId": "ed72eb4a-ed5f-4322-865b-9cadd3fd0059"
},
2021-04-01 03:16:00 -07:00
"outputs": [],
2021-03-30 00:07:48 -07:00
"source": [
"model_best_epoch_file = tf.train.latest_checkpoint(\"checkpoint_mlp_best\")\n",
"model = get_mlp_model(grayscale_train_images[0].shape)\n",
"model.load_weights(model_best_epoch_file)\n",
"\n",
"test_loss, test_accuracy = model.evaluate(grayscale_test_images, test_labels)\n",
"print(\"MLP best weights model \")\n",
"print(f\"Test loss: {test_loss}\")\n",
"print(f\"Test accuracy: {test_accuracy}\")"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 13,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 85
},
"colab_type": "code",
"id": "8yUPWbFCz_G8",
"outputId": "eba978e4-d225-4488-f3fd-4600fa4b51b6"
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
2021-04-01 03:16:00 -07:00
"814/814 [==============================] - 44s 54ms/step - loss: 0.3344 - accuracy: 0.9015\n",
2021-03-30 00:07:48 -07:00
"CNN best weights model \n",
2021-04-01 03:16:00 -07:00
"Test loss: 0.3344075083732605\n",
"Test accuracy: 0.9015442728996277\n"
2021-03-30 00:07:48 -07:00
]
}
],
"source": [
"model_best_epoch_file = tf.train.latest_checkpoint(\"checkpoint_cnn_best\")\n",
"model = get_cnn_model(grayscale_train_images[0].shape)\n",
"model.load_weights(model_best_epoch_file)\n",
"\n",
"test_loss, test_accuracy = model.evaluate(grayscale_test_images, test_labels)\n",
"print(\"CNN best weights model \")\n",
"print(f\"Test loss: {test_loss}\")\n",
"print(f\"Test accuracy: {test_accuracy}\")"
]
},
{
"cell_type": "code",
2021-04-01 03:16:00 -07:00
"execution_count": 14,
2021-03-30 00:07:48 -07:00
"metadata": {
"colab": {
"base_uri": "https://localhost:8080/",
"height": 716
},
"colab_type": "code",
"id": "W48syko0z_G-",
"outputId": "c841bce4-44eb-405b-8071-25c16b30810f"
},
"outputs": [
{
"data": {
2021-04-01 03:16:00 -07:00
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAsgAAAK7CAYAAADvHXkZAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAADBcUlEQVR4nOzdeZhcZZk28Puupdd0p5N0SMhGWAIKjiAGBBdEcQFF0bkch2XGZRSGGXAdR9HPGcBxwfkcx5lBRURER8QVFRUVRj+3QZEQQQiLBghk33vfanm+P87p8z5Vqequgk6qu3P/ritX3qo6dc5T1dXJW6fuel6aGUREREREJJJqdAEiIiIiItOJJsgiIiIiIo4myCIiIiIijibIIiIiIiKOJsgiIiIiIo4myCIiIiIijibIIiKzDMkBkkc8xX3cQPLDNW67kqSRzMSXf0TyjU/l+G7fLyD5sLu8geRLpmLf8f7WkTx9qvZ3IJE8neSmGre9guRX9ndNVY5dUueTfc7LXwsi+5MmyCIiFZA8n+SaeLK5NZ70Pb/G+xrJo/Z3jdWY2Rwze7SBxz/LzL402Xa1PE9m9iszO2Yq6qo06Tez48zs51Ox/0mObSS3j7+JiK/LkNxB8qBakKDW57z89TGVr4VJjttN8n9J7ibZQ/I3JJ+3v48r04smyCIiZUi+G8CnAHwUwCIAKwB8BsA5DSxrUn7yNRvMtscDoAfAWe7yKwDsbUwpTx7JdKNr2M8GAPwNgIUA5gH4OIDvz8LXo0xAE2QREYfkXAAfAnCJmd1sZoNmljOz75vZP8bbnByfVeqJzy5fTbIpvu2X8a7ujc8+/2V8/dkk74nvcwfJZ7pjnkjy9yT7SX6T5Nf9mU6SF5JcT3IPyVtILnG3GclLSP4JwJ/cdUfF41aS/0bycZK9JH9NsjW+7Zskt8XX/5LkcTU+R2mSnyC5i+SjAF5ZdvvPSb41Hh9F8hfxMXaR/Hq152n8o3iS7yO5DcAXq8QITiL5AMm9JL9IsiXe55tI/rqsFotruAjABQDeGx/v+/HtSWSDZDPJT5HcEv/5FMnm+Lbx2v4hPuu7leSba3m+nP8G8AZ3+Q0AvlxW75L4Z7wn/plf6G5rjc+C7yX5AICTKtz32yR3knyM5NtrKco9tg/EP6MNJC9wt99A8rMkbyU5COBFEx2rhjr9c56Oj/tI/Pq/m+TyiV4fbj9Pj19rPYxiG68uq/nTJH8Y7/dOkkfW8nyY2YiZPWxmRQAEUEA0UZ5fy/1ldtAEWUSk1KkAWgB8Z4JtCgDeBaA73v4MAH8PAGZ2WrzN8XHU4eskTwRwPYC/BbAAwOcA3BJPyJriY92A6D/gmwC8dvxAJF8M4GMAXg/gUACPA/haWT2vAfAcAMdWqPUTAJ4N4Lnx/t8LoBjf9iMAqwAcAmAtgBsneMzehQDOBvAsAKsBvG6Cbf8FwG2IJhjLAPwXUPl5ii8vjus8DMBFVfZ5AYCXAzgSwNEAPjhZwWZ2LaLH96/x8V5VYbP/A+AUACcAOB7AyWX7XgxgLoClAN4C4NMk5012bOe7AE4j2UWyC8ALAHyvbJubAGwCsATR8/pRkmfEt12O6DEfiejxJzlvkikA3wdwb1zfGQDeSfLlNda2GNHreWm832tJ+jjD+QA+AqADwB2THKtqnRW8G8B5iM6mdyI6czs0wetj/PFm4xpuQ/T6fRuAG8tqPg/AlYhee+vj+sfv/wOSl030hJD8A4ARALcAuM7Mdky0vcwuM26CTLLA6CzMOpL3knx3/A8DSK4m+Z817OOO+O+VJM+vss1h8TvZ8WNdPLWPRESmqQUAdplZvtoGZna3mf3WzPJmtgHRhPeFE+zzQgCfM7M7zawQ53NHEU3GTgGQAfCf8ZnqmwH8zt33AgDXm9laMxsF8H4Ap5Jc6bb5mJntMbNhf9D438a/AfAOM9scH/uOeD8ws+vNrD++fAWA4xmdQZ/M6wF8ysw2mtkeRBP4anKIJrtL4jNzv55gWyCavF9uZqPlj8e52h37I4gmQlPhAgAfMrMdZrYT0eTqr93tufj2nJndiuij+HoysSOIJnV/CeBcRBOvkfEbSS4H8HwA74ufq3sAXOdqeD2Aj8Q/640A/P93JwFYaGYfMrOxOIP++fg4tfqn+Hn/BYAfxscb9z0z+9/4rOqfTXKsieos91YAH4zP2JqZ3Wtmu2uo9RQAcwBcFdfwMwA/QOlr4WYz+138u3wjojc+AAAzO9vMrproAGb2TEST9vMBTPa6lVlmJuZphs3sBAAgeQiAryJ6R3+5ma0BsGayHZjZc+PhSkQv/K9W2GwrgOea2SjJOQDuJ3mLmW156g9BRKax3QC6SWaqTZJJHg3gk4jOnrYh+rf07gn2eRiAN5J8m7uuCdFZQgOw2cz8F7U2uvESRGd3AQBmNkByN6IzdxsqbO91Izob/kiFx5BGNLn8C0RZy6K7T+8Ej2W8Jn/MxyfY9r2IziL/juReAP9mZtdPsP1OMxuZ4HZUOPaSahvWaQlKH0v5vneXvSaGEE3S6vFlRG8oCOB9FY6/x8z6y2pY7W6v9rwfBmAJyR53XRrAr2qsa6+ZDZbt2z92f9zJjlXP62M5Krw+a7AEwMZ4wu6Ps9Rd3ubGT+Znhfi1eBPJB0neY2b3PolaZQaacWeQvfjjjosAXMrI6SR/AAAkF5K8neRakp9jlL/rjm8biHdxFYAXxGeJ31W277HxsywAmjHDnysRqdlvEJ3Ve80E23wWwEMAVplZJ4APIJrwVLMR0Rm1LvenzcxuQvRmfClJf//lbrwF0YQEAECyHdFZ7s1um2pdEHbFj6VS9vJ8RF86fAmikwwrxw8xweMYt7WsxhXVNjSzbWZ2oZktQRQx+Qwn7lxRS0eH8mOPn7gYRPSGBQBAcnGd+y55rsv2PVV+hSgqswj7npXcAmA+yY6yGsZ/1hM97xsBPFb2Gusws1fUWNe8+LXl9+0fe/kbuImOVfPrI95XTdngMlsALB//BNkdZ3OV7Z+qLICn1DpRZpYZP+mLP9pJIcogeZcD+JmZnYgo31fpF/QyAL8ysxPM7N/Lb4y/KPAHRL/AH9fZY5HZz8x6Afwzonzpa0i2kcySPIvkv8abdQDoAzBA8mkA/q5sN9tR+p/p5wFcTPI58Zv5dpKvjCdCv0GUab6UUduvcxBlX8d9FcCbSZ7A6AtjHwVwZxztmOyxFBFlnz/J6EtVaZKnxvvpQBTz2I1oUvnR2p8lfAPA20kuizO4VbOcJP+C5LL44l5EE61CfLn8earVJfGx5yN6czKeT70XwHHxc9WCKDbiTXa8mwB8MD7B0o3odTClvYPjTwpeBeDVZZ8aII4j3AHgYyRbGH2R8y0I2fBvAHg/yXnxc+o/kfgdgD5GX3BsjX/WzyBZ8gW5SVxJsonkCxBlzL9ZZbvJjjVRneWuA/AvJFfFvxvPJLkgvm2in9ediN4QvTf+/Twd0fNans+vG8lTSD4/fi5aSb4P0RuaO5/qvmXmmPET5FilMx7PR/yLYmY/xpNopRNn3J4J4ChEH48uekpVisiMYGafRPTloQ8C2InoTfKliL5kBQDvQXQGth/R5PfrZbu4AsCXGH27/vVx/OtCAFcj+rdoPYA3xccaA/DniCZCPQD+ClGWcjwn/FMA/wTg24jOzB2J+nKl7wFwH4C7AOxB1LIqheij/scRnXF7AMBv69jn5wH8BNGEdC2AmyfY9iQAd8af3N2CKA/9WHzbFXDPUx3H/yqiL2c9Gv/5MACY2R8RdSD5H0QdPcrP0H4BwLHx8b5bYb8fRhTT+wOi52zt+L4nw6gTw49q2dbM1pnZuio3n4fobP4WRCd3Ljez2+PbrkT0M3sM0eP/b7fPAqIJ4gnx7bsQTT5ryZQDURxhb3zcGwFcbGYPVal/smNVrbOCTyKaUN+G6E3nFwC0xrddgSqvj/j35tWI2ubtQtSG8Q3Vai7HqK/5B6rc3Azg04jePG5G9AXCV+ok2cGFZW9gpz2SA2Y2x10+AtE//N2IviTzHjM7m+S9AF4z/g8xyT0AjjazXeP7iN9xvsfMzq7huF8
2021-03-30 00:07:48 -07:00
"text/plain": [
"<Figure size 1152x864 with 10 Axes>"
]
},
"metadata": {
2021-04-01 03:16:00 -07:00
"needs_background": "light"
2021-03-30 00:07:48 -07:00
},
"output_type": "display_data"
}
],
"source": [
"num_test_images = grayscale_test_images.shape[0]\n",
"\n",
"random_inx = np.random.choice(num_test_images, 5)\n",
"random_test_images = grayscale_test_images[random_inx, ...]\n",
"random_test_labels = test_labels[random_inx, ...]\n",
"\n",
"predictions = model.predict(random_test_images)\n",
"\n",
"fig, axes = plt.subplots(5, 2, figsize=(16, 12))\n",
"fig.subplots_adjust(hspace=0.4, wspace=-0.2)\n",
"\n",
"for i, (prediction, image, label) in enumerate(zip(predictions, random_test_images, random_test_labels)):\n",
" axes[i, 0].imshow(np.squeeze(image))\n",
" axes[i, 0].get_xaxis().set_visible(False)\n",
" axes[i, 0].get_yaxis().set_visible(False)\n",
" axes[i, 0].text(10., -1.5, f'Digit {label}')\n",
" axes[i, 1].bar(np.arange(len(prediction)), prediction)\n",
" axes[i, 1].set_xticks(np.arange(len(prediction)))\n",
" axes[i, 1].set_title(f\"Categorical distribution. Model prediction: {np.argmax(prediction)}\")\n",
" \n",
"plt.show()"
]
2021-04-01 03:16:00 -07:00
},
{
"cell_type": "code",
"execution_count": 18,
"metadata": {},
"outputs": [],
"source": [
"import cv2\n",
"import PIL\n",
"from PIL import Image, ImageEnhance, ImageDraw, ImageFont\n",
"from IPython.display import display\n",
"\n",
"img = Image.open('no_3.png')"
]
},
{
"cell_type": "code",
"execution_count": 26,
"metadata": {},
"outputs": [],
"source": [
"\n",
"img = cv2.imread('no_0.png', cv2.IMREAD_GRAYSCALE)\n",
"img = cv2.resize(img, (32, 32))\n",
"my_img = img[np.newaxis,...,np.newaxis]"
]
},
{
"cell_type": "code",
"execution_count": 34,
"metadata": {},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAH4AAACPCAYAAAA87W80AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAAG5ElEQVR4nO2dbYhUVRiAn3d3XRfDD3RV8lvBPlBCQSXMSINQgwTbMEVCAyOoP/Uz7cPKxD9BP6Kw+qM/QgyxFAwLc93KUDI3LVIJ8wMF81tDXdfd0497dvfOeMe5szu799593weGe88959x55z6858w9w8yIcw5DHxVJB2Akg4lXiolXiolXiolXiolXSq8RLyL1ItLle1MRWS0iTkRmdz2q9JIq8f6Chx9NInJeRH4TkS9EZL6IVCYYW30n+1aKyGsickhEborIJRHZISIzyxxm/JjStIATyth3/bYSGARMAh4DqoFfgaXOuWN5fccA/ZxzR7oYQy1QC5xyzt3Ii22Pc252iecTYDPwHHAU2A4MBp4HaoA659w3XYm5UzjnUvMAXBBSZN1wfwEdcAoYlkBs9Z3ot8T3/RmoCR2fDjQB/wL9e/xaJy07rnhfXwHs9u0+yqurj+oL9AVWA8f9hf4HWOOP3yXTt3XAbF9e3hZXxGN1jNfU4NvOiajb6Ote7Olrnao5vhjOuVYCaQBL/DBaEF+/BXgHuAN8TDDULgc2xXzaRjqmnpN+v+1RX+T5+wIzgRvAjxFNvvXbJ2PGUj6SzvJSMj6Uwc2+7fh7ZTzwgm/XAFSHjg8CjhAj4/Niq4/7WnyfSb7f4QL103z9Psv4IjjnmoCLvji0SPNlfvumc+526BxXgPfLH91dDPTbqwXq244P6v5QcsmceE/bEF/slmQq0Arsjaj7qawRdY64r6PsZE68iNQQ3A4BnC/SfCBwyTl3J6LuXFkDi6YtowcWqB+Q167HyJx4YBZQBZxzzp0o0vYaMFhEqiLqhpc7sAj+BlqACQVimOi3xyLqupVMiReRCmCVL34Zo8tBgtcYtUI2q8SnbyVYUIqNfz+yF+gHPB7RZL7f/lBiLF0mM+JFZBjBLdhsggWctTG6bfTbNSJSHTrXQOCtEkO4CIwusQ/Ap6EYakIxTCdYvTtPcMvZo0QNP4kjIqv9bgUdS7azCJZs9xMs2V6IcaqNwGJgHvCHiGwD+gB1BEu/DxJkchx2AYtFZDtwgGBdoME511Ck3ybgWYIl24O+/xAC6ZXAS865azFjKB9J37tH3ceHHk3ABYIL/TmBwIoCfeuJXrmrAd4jWLFrAk4AHwAj/XN8HfM+fhjB9HKOYN6OtXLn+1YBrwOHgZvAZWAHMDOpa52qD2l6EhF5CvgOWOeceyPpeHqazMzxnUVERkQcGwKs88WtPRtROigp42sHV7pxo/t0Yzjl5/jJZm7ectzXT6iqEpqbHVevt9LSArWDKxg7KluvpxROnG7mwqWWyM8zSnpzN250H/bv7Mwb2+TYvO066zdc48+jt7l0pYWavsL0KX1ZvngAK5YOoMjnPJlmxtzTBetS+a6+nCxa0J9FC/onHUbq6PVzvBGNiVeKiVeKiVeKiVeKiVeKiVeKiVeKiVeKiVeKiVeKiVeKiVdKJj+dmztiSlnPt/NsY1nPlwUs45Vi4pWSyaE+TP4wfaO1/buRLBw1I9Y5Vp57JKe8dvihLseVdizjlWLilWLilZKZOf7pSXPa93ee3V2wXb+K6lC7xljnnjtyak556quvtO8fXPlJzAizhWW8Uky8UjIz1Ldcvtxt59555mBOecLWjtvA/FXC3rLKZxmvFBOvFBOvlMzM8T3J8YXrOwoLc+vCc37lwxNz6nbs+qoboyovlvFKMfFKsaG+RMK3c3Pv+q2N7GAZrxQTr5TMDPVpXDHLjyn8jj+N8YaxjFeKiVeKiVdKauf4B/Ysyykfe2JDQpH0TizjlWLilZLaoX78kt9zD5xNJo5SuP392FCpMakwYmEZrxQTrxQTr5TUzvFZZPekjj+FTvvyrWW8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8Uky8UlL7Far8rx1N2PJy+/7xuvWknVvPhP/6rDGpMApiGa8UE6+U1A71+Ty06q+OQl1ycdyL8L9Z7TnzWYKRFMcyXikmXikmXimZmeN3HGlo30/Lr03MGzMtpzxuX5+EIikdy3ilmHilZGaoD5P79yBTCrb7b9GjOeWLk6V933XsUnvYFWw39u1fCp5/8oHWnPKH9xdumzYs45Vi4pVi4pWSyTk+zL1v5+5VF5MVXT9FGrGMV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4qJV4o454q3amssch442X3hGGVmrHNuaFRFSeKN3oMN9Uox8Uox8Uox8Uox8Uox8Uox8Uox8Uox8Ur5HzcwDod71Qn4AAAAAElFTkSuQmCC\n",
"text/plain": [
"<Figure size 144x144 with 1 Axes>"
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"fig, axes = plt.subplots(1, 1,figsize = (2,2))\n",
"fig.subplots_adjust(hspace=-0.7, wspace= 0.2)\n",
"#for i,ax in enumerate(axes.flat):\n",
" # ax.imshow(np.squeeze(my_img))\n",
" # ax.text(6., -1.0, f'Digit {0}',fontsize = 20)\n",
" # ax.get_xaxis().set_visible(False)\n",
" # ax.get_yaxis().set_visible(False)\n",
"axes.imshow(np.squeeze(my_img))\n",
"axes.text(6., -1.0, f'Digit {0}',fontsize = 20)\n",
"axes.get_xaxis().set_visible(False)\n",
"axes.get_yaxis().set_visible(False)\n",
" \n",
"plt.show()"
]
},
{
"cell_type": "code",
2021-04-01 03:30:32 -07:00
"execution_count": 45,
2021-04-01 03:16:00 -07:00
"metadata": {},
"outputs": [
{
"data": {
2021-04-01 03:30:32 -07:00
"image/png": "iVBORw0KGgoAAAANSUhEUgAABREAAAJXCAYAAAAEpBPgAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuNCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8QVMy6AAAACXBIWXMAAAsTAAALEwEAmpwYAAAu/ElEQVR4nO3debxdZX3v8e+PnEQgaAQZM0AExSK2xgEKrbUqvUYQHHpbp16k1kq5VWttba+l3trRobfTVetAnagiUutEHYhesbbWVhQIVq1UFENIAgQZA8UMPPePvYMn4eRJ4ISzOee8369XXpx91jrP/u2VHYYPa61drbUAAAAAAOzIHqMeAAAAAAC4fxMRAQAAAIAuEREAAAAA6BIRAQAAAIAuEREAAAAA6BIRAQAAAIAuEZFZqaq2VNXKqvpGVV1WVb9RVXsMtz2+qt60C2t8afjXpVX1gs5+p1XVt4e/Ttt9rwIAAABgalRrbdQzwJSrqg2ttX2GXx+Y5ANJ/qW19tp7sdaTkryqtXbyBNv2S/LVJI9P0pJcnORxrbUb7/30AAAAAFPLmYjMeq2165KcnuRlNfCkqvpEklTVAVX12aq6pKreUVWrqmr/4bYNwyXekOSnhmc2vnK75Zcn+Wxr7YZhOPxskqdNzSsDAAAA2D1EREjSWvtuBn8eDtxu02uTXNhae2ySjyY5dIIff3WSf26tLWut/eV22xYlWT3u8dXD7wEAAABMG2OjHgDuR2qC7z0hybOTpLV2QVXd08uQJ1rTPQQAAACAacWZiJCkqg5PsiXJddtvmuTSVydZMu7x4iRrJ7kmAAAAwJQSEZn1quqAJG9P8pZ2908a+mKS5wz3e2qSfSdY4tYkD9zB8iuSPLWq9q2qfZM8dfg9AAAAgGnD5czMVntV1cokc5NsTvK+JH8xwX5/kOTcqnpuki8kWZdBNBzva0k2V9VlSd47/r6IrbUbquqPknxl+K0/bK3dsFtfCQAAAMB9rO5+4hWwVVU9IMmW1trmqjo+ydtaa8tGPBYAAADAlHI5M/QdmuQrw7MM35TkJSOeBwBg1qqqDcN7WU9mjfdW1R/v4r5Lq6pV1djw8aer6rTJPP+4tX+qqi4f9/h7VfUzu2Pt4XrfqKon7a71plJVPamqrt7FfX+/qt5/X8+0g+feZs57e8y3fy8A3F+JiNDRWvt2a+0xrbVHt9aOaa19Zec/BQBw/1VVL6iqrw6D3LphGHvCLv5sq6qH3dcz7khrbZ/W2ndH+PwnttbO3tl+u3KcWmv/3Fp7xO6Ya6Iw2lo7urX2j7tj/Z08d6uqa7eG1uH3xqrquqqaVZe97eox3/79sTvfC7vw3GdV1eVVdWdV/eIE219ZVddU1c1V9e7hlVkASUREAACYNarqN5L8VZLXJTkog6su3prkmSMca6fGB6qZYKa9niQ3JTlx3OOTktw4mlHuvaqaM+oZpsBlSX41ySXbb6iq5UleneSEJEuTHJ7BPeIBkoiIAAAwK1TVgiR/mOSlrbWPtNZua61taq39Q2vtt4b7HFtV/1pVNw3PUnxLVc0bbvun4VKXDc9ifO7w+ydX1crhz3ypqn5s3HM+tqourapbq+pDVXXe+DPmquolVXVFVd1QVedX1cJx21pVvbSqvp3k2+O+97Dh13tV1Z9X1arhWVNfrKq9hts+NO5sqn+qqqN38RjNqao/q6rrq+q7SZ6+3fZ/rKpfHn79sKr6wvA5rq+q83Z0nLZe9lpV/6uqrknynh1csntMVX2zqm6sqvdU1Z7DNX+xqr643SxtOMPpSX4hyW8Pn+8fhtvvujy6qh5QVX9VVWuHv/5q6xlm42b7zeHZg+uq6kW7crzGeV+SF457/MIkf7vdvAuHv8c3DH/PXzJu217DsylvrKpvJjlmgp/9cFWtr6orq+rXdmWoca/tzOHv0feq6hfGbX9vVb2tqj5VVbcleXLvuXZhzvHHfM7web8zfP9fXFVLeu+PcescNXyv3VSDS6Sfsd3Mf11Vnxyu++WqOmJXjkeStNb+urX2uSR3TLD5tCTvaq19o7V2Y5I/SvKLu7o2MPOJiAAAMDscn2TPJB/t7LMlySuT7D/c/4QMzlpKa+2Jw30ePbys+LyqemySdyf5lSQPSfKOJOcPo9W84XO9N8l+Sc5N8uytT1RVT0ny+iTPSXJIklVJPrjdPM9K8uNJHjnBrH+W5HFJfmK4/m8nuXO47dNJHp7kwAzOuDqn85rHe0mSk5M8Jsnjk/xcZ98/SvKZJPsmWZzkzcnEx2n4+ODhnIclOX0Ha/5CkuVJjkhyZJLX7Gzg1tpZGby+Px0+3ykT7Pa7SY5LsizJo5Mcu93aBydZkGRRkhcn+euq2ndnzz3Ox5I8saoeXFUPTvJTST6+3T7nJrk6ycIMjuvrquqE4bbXZvCaj8jg9d9138mq2iPJP2RwBt2iDN6Tv16Ds+Z2xcEZvJ8XDdc9q6rGXzr8giR/kuSBSb60k+fa4ZwT+I0kz8/grMwHJfmlJLd33h9bX+/c4QyfyeD9+/Ik52w38/MzOENw3yRXDOff+vOfqKpX7+SY7MjRGbz2rS5LclBVPeRergfMMCIiAADMDg9Jcn1rbfOOdmitXdxa+7fW2ubW2vcyiII/3VnzJUne0Vr7cmtty/B+gT/IIFgdl2QsyZuGZzx+JMlF4372F5K8u7V2SWvtB0l+J8nxVbV03D6vb63d0Fr7r/FPOgxLv5TkFa21NcPn/tJwnbTW3t1au3X4+PeTPLoGZ2LuzHOS/FVrbXVr7YYMIueObMogCC5srd3RWvtiZ99kEDhf21r7wfavZ5y3jHvuP8kgFu0Ov5DkD1tr17XW1mcQoE4dt33TcPum1tqnkmxIck/u0XdHBuHruUmel+T8jDvTraqWJHlCkv81PFYrk7xz3AzPSfInw9/r1Rl8oOFWxyQ5oLX2h621jcN7Yv7N8Hl21f8eHvcvJPnk8Pm2+nhr7V9aa3cm+dGdPFdvzu39cpLXtNYubwOXtda+vwuzHpdknyRvGM5wYZJPZNv3wkdaaxcN/yyfk0EcTpK01k5urb1hF55nIvskuXnc461fP/BergfMMCIiAADMDt9Psn917sdXVUcOz2S6pqpuyeDeift31jwsyW8OL7u8qapuSrIkg7PNFiZZ01ob/+Eaq8d9vTCDsw+TJK21DcMZF+1g//H2z+Csyu9M8BrmVNUbhpeR3pLke+N+ZmcWbvecq3a0YwZnPlaSi4aXnP7STtZe31qb6BLS8bZ/7oU72vEe2uZYT7D297eLy7dnEJTuib/N4DLmu13KPHyuG1prt243w6Jx23d03A9LsnC799iZGdzTc1fc2Fq7bbu1x7/28c+7s+e6J++PJZng/bkLFiZZPYya459n/J+La8Z9fW9+r3ZkQwZnTW619etbJ9gXmIVERAAAmB3+NYOzw57V2edtSb6V5OGttQdlEFCqs//qDM7MevC4X3u31s5Nsi7Joqoa//NLxn29NoNokySpqvkZnC25Ztw+O/p03+uHr2Wie8G9IIMPivmZDC7RXbr1KTqvY6t128146I52bK1d01p7SWttYQaXc7+1+p/IvCufVLz9c68dfn1bkr23bqiqg+/h2tsc6+3W3l3+OYPL0g9Ksv1ZmWuT7FdV489oOzQ//L3uHffVSa7c7j32wNbaSbs4177D99b4tce/9u0jd++5dvn9MVxrl+9VOM7aJEuGZ9uOf541O9h/d/pGBpe7b/XoJNfu4hmUwCwgIgIAwCzQWrs5ye9lcL+7Z1XV3lU1t6pOrKo/He72wCS3JNlQVT+S5H9ut8y1GXxi61Z/k+SMqvrxGphfVU8fxqJ/zeAeiy+rqrGqemYG9+Lb6gNJXlRVy2rwIR+vS/Ll4WXUO3std2ZwL8a/GH4QxpyqOn64zgMzuKT6+xmEt9ft+lHK3yX5tapaPLwn4A7vLVdVP19Vi4cPb8wgRm0ZPt7+OO2qlw6fe78MAu7W++VdluTo4bHaM4NLtMfb2fOdm+Q1VXVAVe2fwfvg/fdivh0annF6SpJnbHf2aYaX/n4pyeuras8afPjOi/P
2021-04-01 03:16:00 -07:00
"text/plain": [
2021-04-01 03:30:32 -07:00
"<Figure size 1800x720 with 2 Axes>"
2021-04-01 03:16:00 -07:00
]
},
"metadata": {
"needs_background": "light"
},
"output_type": "display_data"
}
],
"source": [
"\n",
"predict = model.predict(my_img)\n",
"\n",
2021-04-01 03:23:38 -07:00
"fig, axes = plt.subplots(1,2, figsize=(25, 10))\n",
2021-04-01 03:16:00 -07:00
"fig.subplots_adjust(hspace=0.4, wspace=-0.2)\n",
"\n",
2021-04-01 03:23:38 -07:00
"axes[0].imshow(np.squeeze(my_img))\n",
"axes[0].get_xaxis().set_visible(False)\n",
"axes[0].get_yaxis().set_visible(False)\n",
"axes[0].text(10., -1.5, f'Digit {0}')\n",
2021-04-01 03:16:00 -07:00
"for pred in predict:\n",
2021-04-01 03:23:38 -07:00
" axes[1].bar(np.arange(len(pred)), pred)\n",
" axes[1].set_xticks(np.arange(len(pred)))\n",
" axes[1].set_title(f\"Categorical distribution. Model prediction: {np.argmax(pred)}\")"
2021-04-01 03:16:00 -07:00
]
2021-03-30 00:07:48 -07:00
}
],
"metadata": {
"colab": {
"collapsed_sections": [],
"name": "Copy of Capstone Project.ipynb",
"provenance": []
},
"kernelspec": {
2021-04-01 03:16:00 -07:00
"display_name": "Python 3",
"language": "python",
"name": "python3"
2021-03-30 00:07:48 -07:00
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
2021-04-01 03:16:00 -07:00
"version": "3.8.5"
2021-03-30 00:07:48 -07:00
}
},
"nbformat": 4,
2021-04-01 03:16:00 -07:00
"nbformat_minor": 4
}