Notebooks/IntroCNTK.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "# Введение в нейронные сети\n",
    "\n",
    "## Эпизод 2: Многослойный персептрон и CNTK\n",
    "\n",
    "Дмитрий Сошников | dmitri@soshnikov.com"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "notes"
    }
   },
   "source": [
    "Данная презентация представляет собой введение в современные нейронные сети на основе Microsoft Cognitive Toolkit (CNTK). Идея однодневного мастер-класса основана на Neural Network Workshop в Microsoft Research Cambridge. Материал и фрагменты кода частично взяты из презентаций [Katja Hoffmann](https://www.microsoft.com/en-us/research/people/kahofman/), [Matthew Johnson](https://www.microsoft.com/en-us/research/people/matjoh/) и [Ryoto Tomioka](https://www.microsoft.com/en-us/research/people/ryoto/) из Microsoft Research Cambridge. [NeuroWorkshop](http://github.com/shwars/NeuroWorkshop) подготовлен [Дмитрием Сошниковым](http://blog.soshnikov.com), Microsoft Russia."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "notes"
    }
   },
   "source": [
    "## Обучение с учителем\n",
    "\n",
    "**Дано:**\n",
    "  * Обучающая выборка $\\mathbf{X} \\in \\mathbb{R}^{n \\times k}$\n",
    "    * $n$ - размер выборки\n",
    "    * $x_i$ представлено вектором свойств размерности $k$\n",
    "  * Известные значения целевой функции $\\mathbf{Y}$ ($y_i$ соответствует вектору свойств $x_i$)\n",
    "    * $\\mathbf{Y} \\in \\mathbb{R}^{n \\times 1}$ (задачи регрессии)\n",
    "    * $\\mathbf{Y} \\in C^{n \\times 1}$, где $y_i \\in C$ (задачи классификации на $|C|$ классов)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "notes"
    }
   },
   "source": [
    "## Задача\n",
    "\n",
    "**Дано:**\n",
    "  * Обучающая выборка $\\mathbf{X} \\in \\mathbb{R}^{n \\times k}$\n",
    "  * Входные значение целевой функции $\\mathbf{Y}$\n",
    "\n",
    "**Необходимо построить:**\n",
    "  * Функцию $f : \\mathbf{X} \\rightarrow \\mathbf{Y}$ который _точно предсказывает_ значение целевой функции на новом наборе входных данных $\\mathbf{X}_{new}$\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "%matplotlib nbagg\n",
    "import pylab\n",
    "from matplotlib import gridspec\n",
    "from sklearn.datasets import make_classification\n",
    "import numpy as np\n",
    "import cntk\n",
    "from cntk import Trainer\n",
    "from cntk.learners import sgd\n",
    "from cntk.ops import *\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "# pick the seed for reproducability - change it to explore the effects of random variations\n",
    "np.random.seed(0)\n",
    "import random"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Пример\n",
    "Рассмотрим пример двухмерной задачи классификации на 2 класса. Примером такой задачи может быть классификация опухоли на 2 типа - доброкачественная и злокачественная, в зависимости от её размера и возраста.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true,
    "scrolled": false,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "n = 100\n",
    "X, Y = make_classification(n_samples = n, n_features=2,\n",
    "                           n_redundant=0, n_informative=2, flip_y=0.3)\n",
    "X = X.astype(np.float32)\n",
    "Y = Y.astype(np.int32)\n",
    "\n",
    "# Разбиваем на обучающую и тестовые выборки\n",
    "# В реальной жизни обучающая - 80% данных\n",
    "train_x, valid_x, test_x = np.split(X, [ n//8, n*8//10])\n",
    "train_labels, valid_labels, test_labels = np.split(Y, [n//8, n*8//10])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true,
    "scrolled": false,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "def plot_dataset(suptitle, features, labels):\n",
    "    # prepare the plot\n",
    "    fig, ax = pylab.subplots(1, 1)\n",
    "    #pylab.subplots_adjust(bottom=0.2, wspace=0.4)\n",
    "    fig.suptitle(suptitle, fontsize = 16)\n",
    "    ax.set_xlabel('$x_i[0]$ -- (feature 1)')\n",
    "    ax.set_ylabel('$x_i[1]$ -- (feature 2)')\n",
    "\n",
    "    colors = ['r' if l else 'b' for l in labels]\n",
    "    ax.scatter(features[:, 0], features[:, 1], marker='o', c=colors, s=100, alpha = 0.5)\n",
    "    fig.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": false,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAADu/SURBVHhe7d0JnBx1nf7x71xJJsnkmJwkE0IggZCYhGBIQG4EAwpy6IrHAp7LX0FR1F3WW9djFRfXA3RdQdkVjKIggkIAlSsLuQhnSEhIyDE5IcdMZpLM+f8+1VXQmfSc3TOpnvq8X68nU13T0+mu6Zl+5le/qjYAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAJBDTZ5bUoux9CnPSs9+T6NnkKezxnv0OL8SXOo9sv3eveL5W2oxdk736PFdHlwCkBOF4UegtzrKc7NHxaHW86rnWc/PPTM83Um3/1XP4cGlA+lFTZ/rSomJIxUrPZ7pwaXcO9vznx597z7mucxT42mN7suFqcVDqru3S6Q5TFepYGXz9d0tm/vW1s8hAKAXOsGjkvCa5wbPRz2f8fzMoxGPaz3d6QqPXlhPCy4dSC9IGsWK04tSNqNI3T1K821PZ0b9WnssPT0C2FOjV308RanFLinxFKcWYyfbbdjWzyGQWIwAojdTyern0S9+lb1feH7g+X+eIzy3erpTgae1kQt9rrv093Tn7WfS3f/f6PBjVfgxX3R2u6jE6TnbWXUeFeSuqvc0pBZ7nbZ+DgEAvdCLnm2pxQ57n+cxz27PHs/znm94IgM93/Qs9Gh38l6P/p8veNJHYFQ+NeqgF2V9jJY18vTLtMvpn0sf4Rjj0W7qDR7NeVvn0Sim/v90v/Lo60d6VGj1eHVbGimLRk40AqKRz9Ue3V89pvd7WtJ1W46a6TFd51nu2efR7c/zTPREohGW9MeT6bYy0X18yKPtrdHaRZ73eiLRiJ1uO/32W7vt9OtH11XWeCR9BPACz1KPtsl6z796Mpnj+ZNHI8naBtp+V3va0952+aBHl7V7++se3UcVuXd6RNtB/6/um/7fLZ7bPRM8LaXfrnT2cWaaAxjd5ls8+pnQ90f3Qc/DTKON7/I849H/o+er/u+3enQ7HR290277ZZ7ovupnT9un5W1k83OoRCPAh3n+w/O0Z6dH00S0rD8SAQB56s8e/eK/OLjUvu979OLwlEcvJP/k0YvDc57IMZ5Kzw89n/CoCNzj0depsEXe5NGuZv3/ehFT4VK0XoXiDx597pOe6HMalRS9eG/2bPLoa7XrWiOXepH7P0/6C5zKpG5HL1oqC7pPKmwaRYoKoB6PXuD1wq+RUD0erdc8unRa17JY/daj9fd6dNvaFatRuB2eqATqfuvFWNf7qSd6PHqcbVEx0ciT7pu296c9Szy6nc96RKOZuq1HPHqcKuht3XZ0fd3Gw+GyEpWqqBipOOj7+GXPxz0qOLr9D3jS6T6qgGsbft5zped3Ht2Gni9taW+7RAVR3zvlcx5t42i+oB7z7z36fn7Eo+eitr2eF+WedLqdTAWwo49zrSdTAVQZ2+rR910/D9Fz/YuedJd6dLsrPNpO+v5pvqYKvdZ3pADq51TXfcnzzx5tjxc8Kq8tbyMXP4cy16M/jL7n0fdWz0FtI92OnpMAgDykkQuNnOiXuV6YtAtYBxDowJCWTvToeiqNbc2F0ucyTZ3QSJzKTLSrUvQCrxeezs4B1AuZXtxGBJfecL5H91G3G4lGE3WgS0tRAdzlGaUVIY2eaLRpu0dzxyK6bnqJOMejdf8TXHqDCozu+93BpZTOztPSNtQokUZv0h+n7k80WpV+n6Oi21EtH0skKkYqUmO1IqTCrKKjgh2J1s0PLh1IZUzf70yjcena2i5RAVTJSf8+RErDj+mi21NBStfy8XbmcUprBVCP8fjg0hs0yqcSGtEfJHq+bvSUaUVIZfxlj75v7T0v9HzQiJ/+8BmiFSHdnv5AaHkbufo57Bt+bEnbQiOCcZ0XCWSNOYDozfQiN9vza49GTD7k+S/PKo9GtNKLh0YFNE9If/W3NRdKn9MLo+jFYahnmEe7MfXzNMuTjcGe8zx/9Oj/0W1HedKj3XAqZul0vzVC2Bo9fr3oR7RrW9tB2+RUrWjFRR7d9reCS2/QqNJfPed6WnsBbc+bPeM8/+1REY1oF6jKlQrRO7Sim9zlUWmJ6A8Fbd/0Xdva9Tjco13r6d8H5T6Pio92cWbrJo8ed0sqwREVIf2/KovaXa7ndUd05HG25QmPRj/TaWRV5VwFT/S91K5UFdBqrQhpd6pG3zpCt1Hh0R8y+oMlotvLdBu5+jnU6G5Ezzn9TOh2HvRoGsVkD9ArUQDR22k3lEYONEdukkcjgNqt9XaPilFEL4gaJdD8rvZot62upxdTzQtTgYlGydJHL7riaI9+LjUHSbebHs2/04tu+shYRLuxWqNT4LSk+VKaHH9kcCkzjW7phVa75FpSEdELr0pcV0QjZ5pb2JJuu737li2NKrWk3dp68Y8c69H90POk5ffiAY/KcabvRWfoNjRKlolKjIqmCrtKX/QcUDHp6POsI4+zLRoZbElfL9Ft6Hupx5HpeaLnXkcOhIm+15meq3qOZLqNXPwc6jms0Xj9/Oh2NCKt24n+6Mn25xmILQogkkS7PTXCcJJHL7oa4UnfPdYRmtukeUd6YdTcPBVJ3c6/eCTbn6no6zXqpNttGY3+tdz9J3rxQsd1ZHeyvhcqNpoX1tr34jZPtjRS1pKmBvzdoxKq+Xs6OEL/n/5fFbCOPs868jjb0tbXp5eyjpS8XMrVz6FGzlUAF3g0J1aj2rqdaEQ9259nILZ4ciOJtLtN85hER9uKRi+0Sy+aHN4aTZ5XkdTBAZpvdL9H84UynZ5E5aE1rX1OIxH6nEYmdLuZohHMzsi0G2uKR/9PdHRsJvqc7odGJVua6tFcKx2lLG091kyi/1f3oyXdtrR133qCpgqo2GgELtP3Qck0wpaus9slot3vGu1VKVEZ0bxQ7XbXtAbt7oyTaBvowIyW9NzryDaIvteZnqt6PrS8jVz9HOp2tEtb8wRV5jWyq9vJtEse6FUogOjN9Jd8pue45nWd7NHuTb3Iy288erHXrh+VntZEIyLpIx6arK+3KWtJxUHXy/SCrc9Jy89pV5ZezN7jmakVLaikdrYA6EVOc7Qimk+mIx41kvS4VrRC8xB1/6NRlYjmn2num+5nNIeqtcfTGs0r06T/D3vSd0dqHpaOVNbt6oCcrtL9ybYo6fFpl6COws10Amqty3TwRrrObpdI9DxLP+Jb9L2I2+9tHbmtgzc0xzZ9O+lgIz3POkIH/uggEj0f0reVbi/TbeTq51C303J7am6w7gfQq1EA0Ztp5EQjVJpkr1Ng6Je6TsuhFxvNCfyOJ5pwrgMbdPCBDsDQqSt0MIjmC17v0TzCyJ0ezXnS3CydFkOnVtGIXKa3JYtOaaLr6MVRp8qIRrf0/+lF6d89mqOoz0WngdF9jY7U1OlDNB/wGs9PPCpNGvXoDO3u1sR/3Q+dWkPL2sWo5fRJ8C1pQr1OeaLREY1A6XQb2mZaryMk9fURzdPSC62uo+2ix9PWgQraLjp1h16UtZ2i08DooAMVX51mJP3Alc7S9tUfALqPui86grqztGtWj10HJ+gocv1xoN2NKmGaF6iDK9KPNs2kve2SXmDS6fml3fr6f/T/6Tlxh0f3R38kxIlKlLaz/sjQz46mKGgXrb6X0X1tbxRQzwedq1LlS7ehx6zTyei5qhLeUq5+DnU7OhBKfwDq5127g3VKHh2hDgDIUyoAKk16YdDEbpUdlQq9aFziyUSjZSpeetHWxHvtKv6SJ6IXbJWT6KTK2nWsEaKzPHohbHm6C53sVwdc6P/W56MT0Iq+TnOYtLup5ddqVEyFVCOU+n90//VCphKSPm9Rp0dp7ajl6JQhKg0qV9FttXYiaN2HlqeT0R+JejFWkdHX6iAEvVhmOopUR+1qW+t6uq1Mp2FpSafm0BGX0YmgVdz0At1SW48zE+22jm5X9yXaxajTo+iy5tW11Nr/oWkB2j2oU5+olKn4aX6etml7I4DS2nbR90WXW3uLMn3/NEKr3Zr6/mu766AbPRbtDk6n20n/3nX2cep52N5tRlo7hZFOBK3ypMepAqXraVe2noPv9nSErq/R4eg2vubRaLP+v/Sfj1z9HGo3u37O9H+p8OscmSqC7X1vAACIrc6emw/INY0Eqkh19LQ1AHoIu4ABANkq8bR8PdEcwKs82g3c8lyCAA4xCiAAIFva5a7dsXrLOM2T1O5fzZ3Vrmjtqu3M7nsAAJAF7QLONB8KyDUdWX+7R6eE0Vw6zVvU/MXW5toCAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAIDY+IpntWeXZ5vnPs8MDwAAAHqpSZ7BqUUr9lzr2eIp0AoAAIB8Vxh+xBtWeXanFq3I0+QZ4SnXCgAAAPROb/fs9Kj8NXiu9wAAACABhniu8bwruAQAANALMK+tfdpGGg081fOcVqTR58Z4qoNLAAAgX5R5Nnmag0sJQwFsnw4E0ZzAyzx3akWasZ6NqUUAAJBnKjyVqcVkoQAe7FOeeR6dAkYHf3zL827PsZ6tnnSDPLs3bNhggwZpEdn4whe+YN/+9rfDS+gqtmPusC1zh22ZG2zH3KiqqrJx48ZpUWf9qNJC0lAAD3aPZ5ZnoEdPisWeb3ie8rQUFEBHAcyBa6+91m644YbwErqK7Zg7bMvcYVvmBtsxN1QABw8OzviW2ALIaWAOdoHnMI/mBmgX70WeTOUPAAAgL1EAERtz584Nl5ANtmPusC1zh22ZG2xH5Aq7gLPDLmAAAPIMu4AZAQQAAEgcCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlTEH5E1wzy7HY2aJAWAaB32rBhgy1+/HFbtXCh1e3bZwOGDLFpZ5xhs+bMsaFDh4bXAvJDVVWVDR48WIv6p0oLSUMBzA4FEECv1tzcbH+5+2579s477biCAps2bJiVFhfbLi+BT+3caSv79bN3fOITNnPmzPArgPijAFIAs0UBBNCrPTR/vi3/1a/s8vHjbYiXvZbWegn8jf8OvOS662zy5MnhWiDeKIDMAQQAtGLPnj32xO9/b++tqMhY/mTC0KE2t08f++sddwSjhQDyAwUQAJDRU0uX2hG1tTZywIBwTWYzRo+2PStX2rp168I1AOKOAggAyGjT6tU2qbQ0vNS64sJCO9JTWVkZrgEQdxRAAEBGTY2NVlTQsaniejFpampKXQAQexRAAEBG5WPHWuW+feGl1mnu3yYvf+Xl5eEaAHFHAQQAZDRz1ix7vqDAauvrwzWZrdm50/aNGmXHHHNMuAZA3FEAAQAZjfJSd+Tpp9tda9daQyu7d6v377d7t2+3Ey+4wIqLi8O1AOKOAggAaNUlH/iA1Z5wgt2yapUt96LXGBbB/Q0Ntqiy0v57/Xo74pJL7BQvigDyByeCzg4nggbQ69XV1dmihQttyf33W60Xvr7aLezrD5sxw2afc45NmzbNCjp4sAgQB5wImgKYLQoggMTQUb6vvvpqUAgHDBjAewAjb1EA2QUMAOigwsJCGzlypFVUVFD+gDxHAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlTEH5E1wzy7HY2aJAWAQCIj+bmZlu/fr0tW7jQdm3ebEXFxTZuyhR786xZVlZWFl4reaqqqmzw4MFa1D9VWkgaCmB2KIAAgFhSyfntL35hO5Yts+MKC21Uaak1NDXZyr17bU3fvvaW97zHzjrnHCsoSF4VoABSALNFAQQAxE5tba394vrrbfzq1fb2I46wkqKi8DMp22pq7PbKSpty2WX2tvPOC9cmBwWQOYCZfMfzrGe3p9Jzu6fCAwBAXnjs4YetfMUKe+eRRx5U/mTkgAF2+bhxtui3v7Vt27aFa5EkFMCDNXmu8AzzHOtp9tzjAQAg9urr623Z/Pl22ujRbe7eLS8ttTc1NtqSJ58M1yBJKIAH+6JnmafBo2Hh73mme4KxYgAA4qyystL67Nhh4zowNelNQ4fa6kWLwktIEgpg++Z61nm0SxgAgFirq6uzfoWFHTq4o19xsdXt2xdeQpJQANt2tufLniuDSwAAxNzAgQOtqrk5OOK3PTv27rWB5eXhJSQJBbB153vu8HzA86BWAAAQd4cddpgNnDjRXujAwR1Lq6tt+hlnhJeQJAcfGgRR6fuF5x8892lFK/p6/rXaf4Aeeughmz9/frByov/gAQBwKGjXb0H//vbYI4/YtLIy65PhKGB53gviUr/eRZddZiUlJeHa3kuv0TfddFPw8YEHHrDFixdr9b979mshaTgP4MGu9nzDc4FngVa0gfMAAgBiR+8Acue8ebbpT3+y80aMsKOGDn19TuDe+npbsnmzPVpcbO/5/Odt0qRJwfok4TyAFMBMNGmi3hP9RaBtpFPB6EyZLQshBRAAEEtNTU224LHHbOG991qJF75RhYXB6S10VONhb36znX3xxXb44YcH100aCiAFMFsUQABArDU2NtqqVats165dVlRUZOPGjbPRo0eHn00mCiAFMFsUQAAA8gwFkKOAAQAAEocCCAAAkDAUQAAAgIShAAIAACQMBRAAACBhKIAAAAAJQwEEAABIGAogAABAwlAAAQAAEoYCCAAAkDAUQAAAgIShAAIAACQMBRAAACBhKIAAAAAJQwEEAABIGAogAABAwlAAAQAAEoYCCAAAkDAUQAAAgIShAAIAACQMBRAAACBhKIAAAAAJQwEEAOSFpqYm2717t+3cudPq6+vDtQC6oiD8iK4Z5PHfR7tt0CAtAgByrba21hYvWmRL77/fqisrraC52YrKymza2WfbnFNOsVGjRoXXBDqmqqrKBg8erEX9U6WFpKEAZocCCADdaMeOHfY///mfNnT1ajuxvNwmDRsWvHBtramxxVu32rOlpXbxpz9tU6ZMSX0B0AEUQHYBAwBiSrt5f/3jH9sxr7xil0+aZMcMH26FBQVW4Bk9cKBdcNRR9g99+9pdP/iBVVZWhl8FoCMogACAWHrhhReseNUqO3fChKD0ZXL0sGE2u67OFvz1r+EaAB1BAQQAxNLSv//dZpWWtlr+IrNGj7aVjz5qe/bsCdcAaA8FEAAQS9vXrrXxqXlabRrqJXFAXV0wXxBAx1AAAQCxpJG/5nC5XeHcQAAdQwEEAMTSqEmTbM3OneGl1m2vqbHavn1t2LBh4RoA7aEAAgBi6YQzz7Ql+/dbY1NTuCazRVu32tSzzrL+/fuHawC0hwIIAIilyZMnW9/jjrO716xptQQ+s2WLPVtWZid7AQTQcRRAAEAsFRUV2fuvvNK2TptmP3/5ZXtq82bbU1dne+vr7eUdO2ze6tX2l5ISu/Szn7WRI0eGXwWgI5gxmx3eCQQAuplOCP3ss8/a4gcftC0vvWTW3GwDhg2z4+fOtVmzZ0fv6AB0GO8EQgHMFgUQAHpQQ0ODNTU1WUlJCUf9ossogOwCBgDkkeLiYuvTpw/lD8gSBRAAACBh+BMqO+wCRqI1NzfbmjVrbOXy5ba/psb6Dx5sU6dNs7FjxzJCAyC22AVMAcwWBRCJtWHDBvvjLbfYvlWr7E1e9voXFVlVY6M9758bNmOGXfLBD9rw4cNTVwaAGKEAUgCzRQFEIq1fv95+/e//bmfW1dkJY8ZYceEbs0nqvAQ+4p9fNmKEffi66yiBAGKHAsgcQACdpN2+d918s53l5e+kiooDyp/0KSqycyZMsOnbt9u98+aFawEAcUIBBNApq1evtoaXXw5G/tpympfDjYsX23YvggCAeKEAAuiUFc8/b9MKC62oxchfS/1LSuzopiZbsWJFuAYAEBcUQACdsq+62gYUF4eX2jagudn27dsXXgIAxAUFEECnlA4aZNUNDeGltlUXFFhpaWl4CQAQFxRAAJ0ydcYMe7a52RqamsI1melN+1cVFdmUKVPCNQCAuKAAAr2Ejs7dtGlTMOdOB2rs3bs3/ExuHXHEETZg8mT7v40bwzUH033524YNNuGkk6y8vDxcCwCIC84DmB3OA4hDTmVr2bJldt99T9rKlVVWUDDE19XZgAHVdvbZ0zynR+e7ypnNmzfbr77zHZtTVWUnV1RY37Q5gTV1dUH5e8nXf/S663L+fwNAtjgPIAUwWxRAHFIqf3ff/Re7446VVlZ2lo0YMdWKikqCz+3Zs8WL2gKrqFhrn/vcFf65EcH6XNmyZYvdc9tttv3pp22y348Bvm635yUvg4fPmWPvfN/7bMiQIcF1ASBOKIAUwGxRAHFILVmyxG644VE7/PCPWL9+B4+0qSCuW/c3O+KI5+3LX77ay2FR+Jnc0W7nlStX2v59+6y0f3+bOnUq7/4BINYogMwBBPKWyt299z7hv8TOyVj+pKCgwMaPP9NWr7agpHWHMWPG2JlnnmnnnneenX766ZQ/AMgDFEAgT23YsMFefnmvjRhxbLgms4KCQuvT5832+OPLwjUAgKSjAAJ5ateuXVZYONzT/kmZBwwYZZs3a4YeAADxKoB9PR/x/NmzzVMffvyL52Oefh4AoeLgyNuOnZC5qaneSkpyP/8PAJCf4lIAr/Cs8/yTZ4nn457zwo+LPCqGr3gu9wBwFRUVXgK32r59u8I1rauqWmHTpx8eXgIAJF1cCuC7PG/zzPF81fMHz0Phx695TvTo87oeAKcjz0877WirrHwiXJOZCmJR0XI78cQTwjUAgKSLSwF8p+fZ1GKr9PkLU4sA5LzzzrQhQ572ErgwOCq4pX37dtu6dbfZRRfN5OhcAMDrOA9gdjgPIA65jRs32o9+9BsvgWU2YMAs699/hDU21tmuXcutsPB5L38z7MIL3+7LHPMFAMJ5AONZAPXNyHS44smeBanF2KAAIhbq6ursueees0ceedq2bauyPn2KbebMCfaWt5xgo0aNCq8FABAKYLwKYIXnHs90jw4IudLzoCeib1DcWhYFEACAPEMBjNdpYL7nWe453vMzz50ezQ2MsLsaAAAgB+JUAE/36LQvz3hUBi/23Oo52yMHz3AHAABAp8WpAA701KYWAzoNzGWeOzya/wcAAIAciFMB1Ly/aanF193rudqjuYF6pxAAAABkKU4FUG8B9+7U4gFu83zFUxJcAgAAQFY4sOJgl3qu8szwaLe0imeTJxOOAgYAIM9wFHC8RgDjYofnRs+ng0sAAAC9DAXwYDr34G89a4JLAAAAvQwFEAAAIGEogAAAAAkT1wKoIyre7/nn4JKZ3sx0dGoRAAAA2YjjUcDHeeZ7dnvGeHQk7rmej3oynSamu+idSf7mafco4Kuuusr69OkTrJg7d24QAAAQH/Pnzw8idXV1duONOt4zuUcBx7EAPuz5necmz07PUE+Z50VPhae7aVRUpU8F8D6P/u9GT52n5dvRcRoYAADyDKeBiecuYL0byM9Si68XrmqPilhP0NvP7fWo/Mkej96i7tTgEgAAQJ6LYwHUqJ/m/KU73LMltdjtbvVouxSFiZYf9QAAAOS9OBZA7f5VCZsUXErt9v2xR28JBwAAgCzFsQB+3bPJs9IzxLPO0+D5rgcAAABZimMB3O/5oGe450TPBM+7PFoPAACALMWtAOpcKjr6t59H78m7yLPeAwAAgByJWwHUqVbe69kXXAIAAEDOxXEXsM7SyJmUAQAAukkcTwStI341B/BPnrWe9Hfh+Er4MS44ETQAAHmGE0HHcwTwTZ4lHr0N3MkenYBZOcUDAACALMVxBDCfMAIIAECeYQQwngXwrPBjS3pbuL+nFmODAggAQJ6hAMazAKbP+YtE7wmst2SLEwogAAB5hgIYzzmAuk/p0VvB/dpziQcAAABZimMBbElvC/dJz/eCSwAAAMhKPhRA0a7qw1KLAAAAyEYc5wB+OPwYGeB5n0f76M/VihhhDiAAAHmGOYDxLIA6+XO6ao/OC/glj3YHxwkFEACAPEMBjGcBzCcUQAAA8gwFMJ5zAFv7RuwIPwIAACALcSyAjEoCAAB0oziVrW+EH//Z0/KUL0d7jvHMDC7FB7uAAQDIM+wCjtcI4KlhitOWlZM9jZ6PeAAAAJClOO5u/ann46nF2GMEEACAPMMIYDznAKaXPxVU3ccoAAAAyFIcS1W55zbPdk+Dpz4tAAAAyFIcC+B/eo70fMxT63mXRyeCvsYDAACALMWxAJ7teY/njx4d/KGP/+h5rwcAAABZimMB1Hv/bkgt2n5PiWeVZ5pWAAAAIDtxLIDrPRNTi7bac7HnrZ4arQAAAEB24lgAdRqYaLTvPzy3ex7waG4gAAAAspQPb7s21jPQszK4FC+cBxAAgDzDeQDjOQLYUqUnjuUPAAAgL8W1AGo47f0evS+wjPKMTi0CAAAgG3EsgMd5dNTv1zxf0Qo30/OT1CIAAACyEccCqIM9vu452hO9+8cCz4mpReSz5uZmq66utp07d1pdXV24FqJts2nTJlu1apWtW7fO6ut58xsAQPeI40Egr3lGeJo8Ozx6azjZ7QlmbMYIB4F0kMresmXLbP78xV5wXvU1hVZaWmCnn36s50SrqKhIXTGBVPwWL15s99+/yFav3mMFBWXW1LTPhg1rsLlzZ9oZZ5zq26o0vDYAIFscBBLPAqhz/53q2eyJCuDhngc9x3jihALYAbW1tXbTTf9rTz3lP2mDT7Lhw4+1wsJi27t3h23dusSKipbalVeebXPmzA6/IjmamprsN7+50/78502+bc6wESOmBNtGpXD37nW2bdtjNmXKbrvmmiusrKws/CoAQDYogPHcBfw7z62eScElMw0N/dhzW3AJeUVF5uab59myZUNs4sSP2qhR073wlVhBQYH17z/MJkyYa0OGXG433vhXW7kyeQd7P/zwY3bvvVt8O6S2jcqfaPsMGXKETZr0AVuxYoz98pd3BNsSAIBciEsBTB/a0Py/TR61gSGedZ4Gz3c9yDOay7Zo0at25JGXeLkpCtceaNCgCuvT5ywvQo+Fa5KhoaHBH/NCGzny7VZS0j9ce6CCgkIvh+fb4sVbrbJSZ0QCACB7cSmA6a9sd3o+6NE8QB34McHzLo/eFxh55vHHl3jxmxmM+rVl9Ojj7JlnttmWLVvCNb3fSy+9ZNu2ldqQIXqKt66oqI8XwRm2cOFT4RoAALITlwKowx0HpBaD+X+ig0EWefTewMhTa9dut7IyTeFsW3FxXy85o2379u3hmt5v165dXo5HB7t721NaOtrLsY6DAgAge3EpgPd7tMv3UY8Od9THTEGe6Ui5eUNzJ6+f34qKtEtcsxva19TU4CU58y50AAA6Ky4F8ArP5zwPeHT6l7+2EuSZiRNHWXX1mvBS6+rra625ebONGqU3fUmGcePG+WNeaw0N7c9uqK1dYcceOy68BABAduJSADUMMs/zTc/tHh0IkinIMyefPMuamp72krMvXJPZ5s3LbNassTZihKZ+JsOYMWNsxowR/tiXhmsy27Nni/Xvv86OP15viAMAQPbiUgDTfSj8iF5AJ3g+7bRxtmbNHdbYmPmdP3bseNn/fcTOP//01IoEefe7z7GCgr/b9u0vhmsOVFv7mm3a9Bu79NJTbODAgeFaAACyk5wJV92DE0F3wP79++3mm39jCxZUWWnp7OBkxzqytaZmu7366hJft9yuvvoCmz59evgVyaLzH/74x3+wXbvGWlnZ8b49yq2hYa/t3Pmcb6cX7L3vnWNz556dqPmRANCdOBF0fArg054ve+71ZDrbre7nOz1f88RpPxgFsIMaGxvthRdesL/+dbE999wGa2rS+f/62tlnz7CTTjohUbt+M6mpqbFly562hx9+1otgjfXtW2Jz5kyyE0+cZSNHjgyvBQDIBQpgfArgyZ4feXQEgA72eN4TvffvVM9bPds8n/Is8MQFBbALdAJkpW9fnfqFUS0AQM+iAMZvF/CZnks8szx6D2C9F7BmyOvk0H/zxA0FEACAPEMBZA5gtiiAAADkGQpgPI8CBgAAQDeiAAIAACQMBRAAACBhKIAAAAAJE/cCWBF+BAAAQI7EvQAuDz8CAAAgR+JeADlNDQAAQI4xBxAAACBh4l4Arww/AgAAIEfiXgAfDT8CAAAgRzgIBAAAIGE4CAQAACBhOAgEAAAgYTgIBAAAIGHiXgBvDz8CAAAgR9gFDAAAkDAUQAAAgIShAAIAACRMXArgSM/hnYy+pjt93VPpqfY87JnqAQAAyHtxOc/ezZ5HPJ25P6d6PppazLnPe672nOd52fNVz+Weoz21nsggz25ngwZpEQAAxF1VVZUNHjxYi/qnSgtJE5cC+H5PZ4/47crXdNQazw2enwSXzIo8mzzXem7TihAFEACAPEMBjM8u4K4Uue4qf2pyR3gWB5dSGj1Pe2YGlwAAAPJYPh0Eckb4sbtFQ3m7wo+RnR6G+QAAQN7Lp/favd6juXndTSVP5e8kz0KtCM33POf5XHApRdfdfdVVV1mfPn2CFXPnzg0CAADiY/78+UGkrq7ObrzxRi0yBzAG/uBpbRer7ucoT//gUvfLNAdws+czHuYAAgCQx5gDGK9dwFd57vGc2Uru8vSUmzwa6dOpX0o93/Ts9/TkfQAAAOgWcSqAWzwrPesy5BXPQ56e8n3Przz6P7d7tDv4XE/6KWAAAADyUj7NAYwjdgEDAJBn2AUcnxHAOeHHzujK1wAAACReXArgpZ5Mb/fWWsZ73uMBAABAJ8VlF7Dm1+ko387Y6rk/tXjIsAsYAIA8wy5g5gBmiwIIAECeoQDm1zuBAAAAIAfiXgB1bkCZ5FFLH+eZoRUAAADomrgXwN+HH9/t+Y7ni54LtAIAAABdky9zAPUWcToh8x7PcM9qTxwwBxAAgDzDHMD4jgDO8/wwtRiUrKM9Gz27PHEpfwAAAHkprgXwEU9UANXMH/R8NLgEoFdpamqy6urqIFoGAHS/uO4CfqfnPM89nsc81R4VwF944oRdwEAXqfAtXLjY5s9/yrZs0ewOs5EjB9jb3jbTTjppNj9TALoNu4DjWwBv8qzxnOA5zaNvzl2e6zxxQgEEumDz5s12ww2/tk2bxtiwYXNsyJAJwfrdu9fZa68t8iK4zq699gNWUVERrAeAXKIAxncX8JOe73v0FnGHeT7sWeUBkOf27NljP/jBr23HjhNt0qQPWHn5RCssLAoydOiRNnHie/2X8+leEG8LfkkDAHIvrgVwrUenfonu31TPsalFAPlsyZKlVlk52ioqTgnXHKyi4kTbtm28Pfnk4nANACCX4loANe9PB370CS6Zbfa8kFoEkK+am5vt/vuXWnn5HCsoaHsGyrBhs4P5gRwYAgC5F9cCKLs9+1KLwcEgv0wtAshX+/bts82bNfdmfLimdbrOtm01VlNTE64BAORKnAsgAAAAugEFEECP6devn40dO9h27dI037bpOqNHD7QBAwaEawAAuUIBBNBjNO9v7tw3286di4L5gG3R6WDmzj3eCgv5NQUAucZvVgA9atasN9u4cdtt/fpHWi2B69c/bocdVmlz5uhUoACAXKMAAuhR2qX7mc/8o40atdRWr/5fe/XVFdbQsN8aG+vstddeslWrfm3Dhj0RnAi6rKws/CoAQC7F9Z1A8gXvBAJ0kY7u1TkB58/XeQF10L/Z6NFlwS7i2bNn2cCBA4N1AJBrvBMIBTBbFEAgS9oNrNPDiA4Sae/8gACQLQogu4ABHGIqfKWlpUEofwDQMyiAAAAACUMBBAAASBgKIAAAQMJQAAEAABKGGdfZ4ShgAO3avn27vfjii8HRzjrSefLkyTZy5MjwswB6GkcBUwCzRQEE0KqdO3favHn32JNPrrfGxklWUKDfE3v840qbPbvC3ve+C2zYsGGpKwPoMRRACmC2KIAAMlL5++53b7ZNm461ioozrE+fAeFnzOrra23jxkdtxIhn7brrPmzDhw8PPwOgJ1AAmQMIAN3ittvu9vI3xY488h0HlD8pKelvEyaca6++epzdeutd4VoA6DkUQADIsa1bt9qiRRtt3LgzwzWZVVScbk8/vd0qKyvDNQDQMyiAAJBjy5cvt6amyVZSUhquyay4uK81N0+1559/IVwDAD2DAggAObZnz14rKAjmF7WrqGiQVVfvDS8BQM+gAAJAjvXvr5G9mvBS2xoba4LrA0BPogACQI4dc8wxVlDwope7unBNZo2N9f7vCzZlyuTUCgDoIRRAAMixsWPH2rRp5bZx4/+FazKrrFxokycPtPHjx4drAKBnUAABIMcKCgrs8ssvtIEDn7D16x+1pqaG8DMpurxhwwIrLX3UPvShi4LrA0BP4rdOdjgRNIBWbd682W655U5bsULzAd9kJSWDrL6+2peft0mT+tlHPnJJMFoIoGdxImgKYLYogADa1NzcbK+88oo999xyq67eZwMH9rNp0461CRMmMPIHHCIUQApgtiiAAADkGQogcwABAAAShwIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgJ4oOmev3g2e5o8Z3kAAAB6FQrggeo8f/C8w9OsFQAAAL0NBfBAKzw3e57yFGgFAABAb0PJaZ12AZ/t+VtwKbNBnt3OBg3SIpKsubnZ1q9fbwsWLLHVq7cG6448cqSdcsosGz9+vBUU8OMGAHFQVVVlgwcP1qL+qdJC0iTlFemXnis82q2b6TE/7Gk5348CiA7bt2+f/epXv/Pyt9kKC4/z58OEYH1V1Tpralpmc+aMsA9/+FLr379/sB4AcOhQAJNTAPWq2y+1mFG9pzq1+LoOF8CrrrrK+vTpE6yYO3duECRHQ0OD3XTTrfbkk/3syCPfbcXFfcPPpDQ21tuaNX+w44+vsk996kNWUlISfgYA0FPmz58fROrq6uzGG2/UIgUQB2EEEB2ybNky+/73F3j5u9KKijKXu6amBlu9+r/tM5+ZZSeccEK4FgBwKDACyEEgmWj4Jhot1Ku5LhcFl4AMHnposfXvP6fV8ieFhcVWVnaiPfDA4mCuIAAAhxIF8EDjPXs9NR69SuucgLWeL3qAg2g3wvLlm2zEiCnhmtbpOi+9tM1qa/WUAgDg0KEAHmidR9tEI37p+YYHOIjm/zU2+pOkKDUHtC0aIdR1G/UPAACHEAUQyEK/fv1s0KA+Vlu7PVzTutraV23gwGIrLS0N1wAAcGhQAIEsFBYW2lvfOt22b18Srmnd1q1L7Kyz3sRRwACAQ44CCGTp5JNnW9++z9nOnWvCNQfbvXu9F79ldsops8M1AAAcOhRAIEsjR460q68+36qq5tn69Qusvl7HEaU0NOyzDRuesB07fm0f//i5NmbMmPAzAAAcOpwHMDucBxCvW7Nmjd177yO2dOkmvzTKU2DNzVts5szRdv75p9mkSZOC6/VmekeUlStXWk1NTXBy9IkTJ9qQIUPCzwJAPHAeQApgtiiAOMj27dtt69bUewGPGDHCRo1SGezd9u/fbw/+5S/2zAMP2Ig9e2xIQYHt1XsjFxfbUaecYudefLGVl5eH1waAQ4sCSAHMFgUQiafyd+tPfmJ9ly61tx12mB1WVhZ+xn+r+uce27jRXvAS/KF/+ZegEAPAoUYBZA4ggCw98Oc/Wz8vf/84ceIB5U8G9e1r7zjqKJv12mv2u5//nHdBAYCYoAAC6LK9e/fasw88YHPHjLGiwtZ/nZw2bpzVvvhiME8SAHDoUQABdNmLXupG1dTYqIEDwzWZFXs5PK6oyJ5b0v75EgEA3Y8CCKDLdLRveUHHphIP7dvX9uzYEV4CABxKFEAAXaZ3NdHRvh2xr6HB+vA2eAAQCxRAAF2m8/ytLSy0mrq6cE1mOvjjuf37beL06eEa9CaNjY22efNmW79+ve1glBfIC5wGJjucBgaJd+uNN9qYRYvsnAkTwjUHe+m11+xOL4rXXn99cIJo9A468fcTCxbY0vvvt4YtW6xPQYHV+PoxM2fanHPOsalTp1pBB6cIAD2J08BQALNFAUTibdu2zW751rfslD177C0VFVaY9oKvkb/VO3bY7/2X7Ts++1mbzghgr7HHv9+3/uhHNuD55+2U4cPtqKFDg7KnXf3PeBl8zMvh1Pe8x8694AJKIGKHAkgBzBYFEHDa/ffbn/7UmteuDY72Hdqvn+2trw92+77mxeAdH/sY5a8XUbG/xcvf0MWL7aKjjjqg9Ed2eQG8Zf16O+Waa2z2nDnhWiAeKIAUwGxRAIFQU1OTrVq1yp7zUlCzY4eVlJba0TNn2rRp06xv377htdAbrFu3zuZ96Ut27RFHWIkX/tYs377dHhgyxD71b/9mhW2cJxLoaRRACmC2KIAAEueuefOs/3332dw25n1KU3Oz/eDll+2ir3/djjrqqHAtcOhRADkKGADQSTs3bbIx/fuHl1qnXcOjCws5MhiIIQogAKBTCouKrLG5Y+d/bPISyO5fIH74qQQAdMrYY46xVTU64UvbdETwei+KY8eODdcAiAsKIACgU948e7atKC4OjvRty9JNm2z0zJk2evTocA2AuKAAAgA6pby83I6/8EK7fd06q96/P1x7oJWvvmoPFxbaWRddFK4BECccBZwdjgIGkEg67c+ffv97W3HvvTazoMCmDhtmfYuKbMfevbZ01y5b678TL/nkJ+3YY48NvwKID44CpgBmiwIIILF0QugNGzbY4scft5cXL7b6/fttYHm5zTjrLDt+1ix+LyK2KIAUwGxRAAEAyDMUQOYAAgAAJA4FEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwFEAAAIGEogAAAAAlDAQQAAEgYCiAAAEDCUAABAAAShgIIAACQMBRAAACAhKEAAgAAJAwF8ECXeR73vObZ7vmb5y0eAACAXoMCeKCBnq97DveM9tztud8zxoNuNn/+/HAJ2WA75g7bMnfYlrnBdkSuUAAP9FPPg54aT6Pnh+HHEzzoZvxiyw22Y+6wLXOHbZkbbEfkCgWwbXM8AzzPBJcAAAB6gYLwY2/3S88VnmZPpsf8sOes1OLrxnke9fyP56takcEgz+4NGzbYoEFaRDa+8IUv2Le//e3wErqK7Zg7bMvcYVvmBtsxN6qqqmzcOL3M22Bd1ELSJKUA9vf0Sy1mVO+pTi0GJnoe8PzW869a0Yqxno2pRQAAkGcqPJWpxWRJSgHsjOkeHfjxE097f2Zp++kAkfTyCAAA4q/Ms8mjvYNIOJ3yRaeA+VRwCQAAAL2ezvvX4NF8AI3qKVq+zgMAAAAAAAAgyd7p0elidoRZ4nmXB53Du7Hkjuaz/sWz2dPkaXmkO9qmk8Jrcrj2BOhMAVM96JxLPTqbwm6PzqnKqce65jueZz3ajnpO3u7RwQvovK94Vnt2ebZ57vPM8ABddliYyKmeWs+04BI66uOeczw6/2KR5xqPdsPzbiydN9nzEc/xHr34UgA77vOedZ4pnr4eHRCmI/51RgF0nH6WVQI/5KEAdt23PDM9xR6dc+w2zzIPOm+SR6d+EW3Paz1bPBwUi5zQE+kUjwrgJVqBrOz0XJhaRBcxAtg5azxXpxYD+mNkq+cDwSV01ukeCmDuaMRK2zMqMuga/XH3aY+25TCtALpKf5mprOz36AX3EY+eYOg6vRtLneeI4BK6igLYcfo51vbScy+d3oPr+6lFdBIFMLf+2aM/UtA1b/fotVo/5zrw83pP4vDD2D69i4ieJPrlpY8tozlqEe2qHOrRuYU0/0/zr1Re0LntGNFp2ud5NP/lFa1AoCvbEh0Xva2P5gil0wsGb/mDQ+1sz5c9VwaX0BV6bdZrdbnns54nPcBBNOdHT5LWorLXmj97rkotJl5nt6PejUV/4ar84UBdeU6qGDIC2DGMAOYeI4C5cb5Hf4jooEPkhqZs6Y895usjp/R2cj9KLaITdPSqzs7+heAScoEC2DmZ5gDqiEHmAHYNBTB7eu6p/GkEELmjA0FqPMzXR5fp9CU6uki/4PS+w//Po/cYPteDjuPdWHJLc1D1fFQBnBteVplB2z7n0bQDnfql1KOR6A0ejgLuHP0+1HPubR4VQG0/XeaIy87RHyM6vdjJwSVkQ68tI1OLNsLzc4+27SitALriax6NGuicYTp/3QLPuz3oHN6NJXfGe1T89MKbHp0HC+3Tz7TOobjHw3kAu+YKT/pzMFo+zYOO03bTwYX6XRj9btRHCmHn3ePRz7W2oc6p+EePTpUFAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAxMW5nhs8c4JLrXu/52ZP9IbtuaT3Tn06tfi6Ys9tntc8en/VMk9v9yeP3qcXAACgW6lwHJ5aDKiMXe/R+p950ovX5Z706+bKUs8FqcXXvdez0TMguJQbf/d8I7XY4y71POrZ7Wn0FHpamu7Z4ukbXAKQOJl+MQBAd+vn+V/P1zy3ep70pBemgvBjLp3pGeW5N7j0homeNZ6a4FJ89Ak/dtYOz42eTweXMnvWs87zj8ElAACAbpI+AqjdwY+lFgMqYSokkZajhbnwY4/KZrpfevZ76j3a/ftnj0bFvu1Z7dFu4Yc9x3nSfcLznEejbJs8/+Mp98hPPQ2efZ5qj25X1no+nFp8XZPnrNRiMGqo+/gbj0rcTR7pyP3J5HRPayOA8nWPHi+ABGIEEEA2TvVod63Kyjs9H/fM87RH5W5najGwy1PhyeVu2JZmeZ5PLb7uQx6Vqyc8gzzv8PyXR9fVYxvh+Z1nvkefj2z2XOwZ7NGcxkkelTfRNlC5/Z5Hu7XTv649H/T8yqMyea1WuI7cn67QKOAJqUUASUMBBNBVKj/aparRL+1CPc+jYrLV055hHo2QReo82u3bnQdgqFRpxK4tul8qtFd5VPI0Qqdyq6873xO5y6MROdng+a7nbcGl7OjgDG1D0fbRfe7I/ekK3cbQ1CKApKEAAugq7Tq9M7UYjCTd41ERvEYrnMqhiksmKh/p8/wGepo9rwaXWqcjhLVbNdq1qlHDTOsy0W5Vlda2HBV+XOjR9RWNVI7xpN/uJZ4FHpVdjV5qPqPKWrZzF7WbOJ12jUt796crtC3SR2EBJAgFEEBXaYRKI1Jymiea0xftmlQ50sEImaz0qCBGtGtTR6Vq7lxbbvdolDDataqjdzOty0RHAE9NLbZK90FFVEfJqtApGiVTQdUuXRnr0W7YH3pUwoZ4LvNIVACj7ZJOBTV9F7dKXEstv64j96erpnmWpBYBJA0FEEBX6XQq/+TR6Vw08qaCo4KiXcEzPf/q0dy4THSakvGeaBekDlj4Q2qx22i08q2etkbp1nv+6FFxjQ5CUbHUQStRYVX50m3ogAwdPKLHqMeaTsXt6NTi61S23ufRyJuK6nc8Kndt6cj9aUm/13XgSHSKFx1xreWWj1u3oV3ZABKIAgigq4Z7VHIme1QkPurRrtHferZ7xnm2eTJRcVJ5/IpHBz5oNOqLnu70N4/ujw5WaYt2KWu08EGPdlW/6NFjiwqURi9V+LTbV5/XkcRaTvcfnmM80W5b+ZJHRVlzBhd7ot3nUQlsrQy2d39a0mjkXs99wSWzPZ5ajw4iiWhE8QhPy/sNAADQZdotqpM7qwRGOnNql+44DYxotHJZajHR7vbo4BIACcUIIIDuoNFBzcXTLuE40YEb2j2ddBd6dPQ2gISiAALoDjpFyjc9zwSX3tDW/DsAQA+hAALoKToq+FMenTi5LZrzpvlq6ecJBAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAg7sz+Pz1aC7N2/PGXAAAAAElFTkSuQmCC\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plot_dataset('Scatterplot of the training data', train_x, train_labels)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Подход\n",
    "\n",
    "  * Задаём функцию потерь (loss function) $\\mathcal{L}$\n",
    "  * Определяем модель $f_{\\theta}$ с параметрами $\\theta$\n",
    "  * Подстраиваем $\\theta$ для минимизации $\\mathcal{L_{\\theta}}$ на обучающей выборке\n",
    "$\\theta = \\mathrm{argmin}_\\theta \\mathcal{L_\\theta}(X,Y)$\n",
    "  * Проверяем качество модели на тестовой выборке\n",
    "\n",
    "Результат: $f_{\\theta}$, которая делает предсказания на новых данных: $\\hat{Y} = f_{\\theta}(X_{new})$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Функции потерь\n",
    "\n",
    "* Определяют (формализуют) цель обучения, т.е. фразу _\"точно предсказать\"_\n",
    "* Выбор обусловлен требуемыми свойствами (непрерывность, дифференцируемость)\n",
    "\n",
    "**Часто используемые функции для регрессии**\n",
    "\n",
    "Абсолютная ошибка: $\\mathcal{L}_{abs}(\\theta) = \\sum_{i=1}^n |y_i - f_{\\theta}(x_i)|$\n",
    "\n",
    "Среднеквадратичная ошибка: $\\mathcal{L}_{sq}(\\theta) = \\sum_{i=1}^n (y_i - f_{\\theta}(x_i))^2$\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "# helper function for plotting various loss functions\n",
    "def plot_loss_functions(suptitle, functions, ylabels, xlabel):\n",
    "    fig, ax = pylab.subplots(1,len(functions), figsize=(9, 3))\n",
    "    pylab.subplots_adjust(bottom=0.2, wspace=0.4)\n",
    "    fig.suptitle(suptitle)\n",
    "    for i, fun in enumerate(functions):\n",
    "        ax[i].set_xlabel(xlabel)\n",
    "        if len(ylabels) > i:\n",
    "            ax[i].set_ylabel(ylabels[i])\n",
    "        ax[i].plot(x, fun)\n",
    "    pylab.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAtAAAADwCAYAAAApZFODAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAFBHSURBVHhe7Z0FmBxV1obPv0AI7hYIEmQXX2yREGCx4O7uFtwJLos7hOAEd4JDcHeCs8DiAQKEQBIsDJL/vH2rQqfpmZZpqar+3uf50lV3JtN+69xzj5gQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCNJOPXDuEw4Yypete13euTxloEsu6Rrn+L3fWHM5yfeXicczPgBiH/q6Lw6EQQgghksCCrutdX7gwYD50XetaxNUKNMuAPtT1kmv83FljuMJ1VThMDEu5RrtmzJ0JIUQL87foVgiRbFZwPe8a6sKQmdz1T9cDrg1don7M6Xrb9VvurHWZy/W168vcWXV0iW5LUe7vVcp4rmZ68IUQQgjRQN5xDQiHHbKd6w3XCNfrrm1cMbO5/nBt73rN9YPrCdfMrj6uj13fui505RsZ/J+9Xc+4+D+vuBZwbeTicXFfN7smdsV0c93owtjC6L/BNZMrBg8r3vTzXN+4+J3jXB1R6IFe2sXj5zF/4DrJlW948feGuEa6CL04wQUTuC5wcZ/8DE8+z78YD7vaIuH15//Fr2MPV8zyLsZip8TRriddR7nYMeA58rrmOy143a9xxY9xsItF0WEu7u8X1/cu7ncWV+F9cHuQ610X4SUvuFZzxcS/zwKL3+E+WHDlvw97ut538TNej8tdxTjG9bOLRQSPic8YTOEiZIHngHF9j2seV0z8OvBefO5601UMPg98Xnh9478DfI7YZfnMxWeJ42ldMdO7bnfx/HkeW7h4zsu5IH4NNnXxGvAc+D+8dge4WBjx+X3RtaIrZiHXYy7+Lp8vfj63C/7t4pyf8b7y/HgdoHDnoB7fAyGEEEKUAZ4/jICVcmftg6GEIYS3GgOY38fYWccFseF3v2saFwYvF3+MYIxPDEu8rRgGGBwx/J+XXbO6CGPAIMBYuczF35guOj/EBRgnGNkYh5O68JbzfzA6YsMcwwFjZmMXY3jVMRoxeNoj34DmsWDM7+XiMfG4Mc7OdMHKLow6jFQgjnnJcGg7uXg+U+XOgkGF4doehUYRr+PvrkIDmrHYuMVwxADez8Xjw/ga7trWBV1dGHSXuuLH8Q9X93D4l/uEwvvAAGRhsLCLMd4z7jN+LrHxeLWL92Ey11Mu/jbwufrRNW/uLLyXxFm3B4+9MAb8LheLDD4DPCdipPmdeDHF68D7eriLxQ2/UwweE4+d+8BLzO/x+/91nRKd8zevdLEIiOG+73DxGcOIxZjmNSo0oG918TrzGee1YkHAgoXXANZ18XmaI3cWXqcjXHw2+X0Map4jYMzH7yPvLZ+riXJn475v/L96fA+EEEIIUQbLuDAK/p47ax8M4zPC4VjOdpEAB7EBzd+LwbOMkR1f0OFOV/7f4f/g2YvBIOfxYHjGnOvCSAE8w3gqMRhipnbxf/6VOwuGw0PhcCx4UPGotke+AU1cMkZwPuu5MIIAAwpPJh7ZQqMNrzzGay9XOXHN+UYRlGtAs6jI5yZXv3CY894Pc7V3/4X3CYX3wcIHD3I+GJB4cSH+/XgRAXu43gqHNrsLAxrjDeO6FIUGNLHQfDbYjYjh+fC8NsmdhdeBhUwpeL5Ph8OxrO8q/L88F+4Tz258nP+9ILGRsXwDmtcgNpRj8DqvEg7HgmHeNxzaIy486/nvcQy7HXiJeQyF5L9v9foeCCESQDwRCyGSC4YgBi7b+B2B95KLez4YcXhrY8a48mNYMaAweBiPYazQoCr8P8Djisn/PzxOtr0JPYjhHM92/mMhtCGfYvfbHu09VzyBbPET2nGwC0ObqhFsx+OVBjyCF7lOc7FtTrjAoq5a09Hzw3glZKYzcdW8BoSf5FP4fgNhATH5j4H738zFogTDmBh7zsuF++dzk/8YeD6fuPIfA+flwAIpH7z2GOl8dmKxy4DHlr+PAc395xv1PKdi5I+z8MOoJewo/rt8NjF448VG7GHGkObv41mfhAGHBSQ7Hizg3nPhzS52LW3E90AI0SRkQAuRfDCKuFBvnTtrH7x1XNjzwfOWb2A0Ah4H2+VxXCjgeWOsXGOqFNxHoXeQ54pxhVEMxIwTzoJBzTY/4QYYQXgoCfVguxwvIp5cfl4uscc+Nqgg38tbDhh0GNHteaB5jKUo9n5zXsn7zWuyuouQntNdxBgXemvbI/YO5z8Gwi8wDvPf53KeCxT+Hos2Xic+O7H4DPG6P+ciphrYEYjhNS1G/t/G+8znZC1X/t/FaI1j4Xluu7j4e3yG8FazGAM8+Fu6iGVmJ2E3F3kFhTTieyCEaBIyoIVIB7u62GrHyIm9V1zwMaqPz52FeFq8iWxb890mKYoLO97WmPxQjXrBFjSewvNdPEYMCEIXiDmlHFwtuM7F1j0GTxy7zbb6JS5YwkWIBuEbv7oI7cCIYvucJLDFXPw/4k35WSWeYLyIeF2JpcZgxJAnHrkS7nbhiSTcAuMViEWOY6AxHnlOHc3RvN8HuoiB5nEQNoExHL8GpSDZj9+PFxV4SvHo8hqVA4+R8CDCffDq4v0/1UUscxw21Bluc/Ee8b7GYRDcTxweggHNzgLx+3zGiHPnu5C/m1IM3nMSOnmsxJ0Dj53PS7x4wAMdL4rizwefIx4PibpxIiOLqfhnhTTieyCEaBIyoIVIB4+7SFbios6FGWOHShq9Xbe4gFsMOYwyjLNzXMQ453tXSxkXxaj0/2CM4d2b0IX3nHhj5hoStTr6W6XuJ//neFlXdRFyQIgGcaSEYsSJjCRt4WXmZ7wWGLvESFPHGCMM7zRJffyceFk8iZVAHDWGOH+bmNdyjdYYHgcLHB5nXDWF0BI8lBA348CbjsFeLHyH54dBxvvOcyFulrhhEtfKgSQ9kvtIiuP+CWlhQVYYStER/D5eYoxC3hMWAYTKEIbQWTBcCatgwRi/RiT3YejGEJvPohCPLiEVfNY55/XtCBYeVL8gjIP3kAURHmYMZOC95XuGgczrSXw2BjfwWcEw5mePuorFq0O9vgdCCCGEEELUDCqQ4EGfIXcmhBBCCCGEGAeqbtCJM06ypazdgy4hhBBCCCFEESjJSGgE4RRUGyEsQ95nIYQQQgghhBBCJA+yuGl7TBc3MrvJ8C9Vc5eMb0o+kdhCkg/dvvLLFQkhRFYY6CIpLr/ddSGaE4UQLYOqcAS4MFC2iHJSZJGTBU191I7gQkFrV1q/UvqIgv+0mRVCiCxBxRHKvJWqDqE5UQghWhzqqpLJ3Z73hLJKGN35LWwXcjFWynMthBBpgfmMMnXcduSB1pwohBAi1wK4sEVuPrRy/SkcjgO1R6n7KYQQWWCQa8dw2KEBrTlRCNFSNKIrWdqgCQDxfhu42iuHtJWLpgO0cs2Hzlz7u4ihzofXmZbBZIoLIZIJ3eK+cKmRRWAPF00/aNYDGNDMj4/kzsal0jkRNC8KkWw0J4qywVNCVyq8KR1RqbeF7nF8ACVJSrbi9s2tDu3JuXDGrcWh1h5ozYuSlHxpTmwHeaD/ZEvX+a6NXbQF7gji/Wh3S6w0LV2BY9rZzuaiNW4+k7tGrrDCELv99snt/xr0qvft29dOPPHE6Kwx6D7rh+6z9jz3nNl665ndffcoW2mlnK1I3gNt0lsdkqovcvFaxDMWSdZUKrrRtRsDeVQ6J0JuXhwyZIhNPjmHjUHfo/qh+6wfjbzPTz/1L+/Co+yPPzQnitLs6aLsUs/cWXlQpeN+FxeVaV2EexD6UQyuDmO6dRs5pn//MQ1jv/32i44ah+6zfug+a8v3348Z06PHmDFnnDFmzMiRI2NvS+MsuWTT1UV4Rb7wQONgoFxdMSqZEyE3L3799cjoHWkM+h7VD91n/WjkfZ588pgxK6+sObEUKmMXONc1ies+FystYvK4jQ1qlmGM5RvYW7u+cX3g+p+LLlh4bdqlf3+zAw/0X+a3hRBNZf/9zWad1WzffaMBkQ+hF4Rw5IuL6XAXdZ5rMifCg2q8LUSiuO46XymzVBYdIgM6wOswoYuVFiJwntunXTDExVh8DlxESJzBGzOVi1qpHW5zrLCC2Y47+i/6b/72WzRYR3r3jnN/Gofus37oPmvH3Xeb3Xij2YAB/uXXLFgu47niBMKazIlwyy3RQYPQ96h+6D7rR6Pu8+23zd57z2zNNaMB0S6KgW4MGOMjHZtggslt0UX9KuOXmcMPDz8UQjSOYcPMFlzQ7NRTw2IWRo0aZVNMkSv7rni/xpGbF7t2HWlffz25TYY5LoRoKkceafbuu2aXXqo5sRTyvTSYiSYyu/pqs//8x2ww6TVCiIYxZozZbruZ9exptjUBB6Lp9Ohhdscd0YkQomkwP15/vdnmm0cDokNkQDeBxRc3O+ywcAH/+edoUAhRd1i8Pv202UUXWcOq4YiO2WQTs2tpAi6EaCrPP282fLjZ6qtHA6JDZEA3CQxotiz79o0GhBB15ZNPzPbay+yyy8ympUaESAQbbWT28MNmX30VDQghmgILWb6PXanBI0oiA7pJjD++2VVXmV1yidkjxfp6CSFqxh9/mG23ndlmmyk5Jml07262zDIhqVMI0Rx+/dXshhtCfpYoDxnQTWSeecxOOy1c2EeQvy6EqAtnnx2aA5xxRjQgEsWWWyqMQ4hmQjlJcrR69YoGRElkQDcZEprmn99s772jASFETXnrrZBZTvzzpJNGgyJRsG386quqkS9Es2ABS/KgynqWj16qJkMiEzGZ99xjduut0aAQoia0tYUtyX32CWECIplMNVUIrZEXWojG88MPZrffrvCNSpEBnQC6dQtdCnfd1WwovbuEEDXh2GNDaaZjjokGRGIhjOOaa8L7JYRoHAMHms05Z6iPL8pHBnRCoJQTjYZ22kkXECFqwTPPhNhnjLIuXaJBkVjWWiuU0HruuWhACNEQCG9TXfzKkQGdIM4/3+y110JlDiFE9bAlyQXhuOPMFlggGhSVcpTrfRcpzl+77nMt7OqIx1y/uOhc9n10u5urJBNOaLbppqE6kRCiMXz+udmjj4YdIFEZMqATBHGAAwaYHXCAX7W4bAkhqoLvEOXR9tsvGhDVcL1rMdeUrm6uB12DXB21oGH/7GQXbbppzs3tha6yYNFDObtfMMGFEHXnuuvM/v3vEEoqKkMGdMJYeWWz7bc322Ybs99+iwaFEGVDQi71TFmMKqO8U1ATY2Q4tPFcf7imc03NQAdU3eORRE8cCffeGw0IIeqKwjeqR5eXBHLyyWbffmt26qnRgBCiLL75xmzHHc3OOcds9tmjQdEZ1nB95/rZdbrrTNdwV0fs7uJ33nad5JrEVRZUJaISABd1IUR9IWT0gw/M1l8/GhAVIQM6gUw8cbiAnHCC2SuvRINCiA4h+Za66ksvbbbtttGg6Cz4gqdy4XU+wFUqxe8w19yuaVybunq7LnWVDd4wdhFIKBRC1A/yDTbYQPXxq0UGdEJZYgmzQw4J3pjRo6NBIUS7UG3jySfNLr44eDJFTSGR8FzXZa6Oil1hYMd9Vd9w7eva0DUhA+Uw11xmiy8ewnCEEPWBEFHqrsvZUD26zDQGEmlGOjb55ByWB73pe/Y0W3ZZszPZOBVCFIU23QstFIxoyqFVyqhRo2yKKabgkH+oHCH+yvguYqKJmLyNgTJYzvWQi4mv0BWQmxf79OljXaI6g717986JRdCll5q98EJuWAhRY9jlYcfu44/NxiPDwRk0aFBO0NbWZv369eNQc2I7yIBuDFUZ0PDuu2aLLWZ2110hU1YIMS5//BGSb2kEUG0JSBnQRdnbhR+YEnYkD/7HtZFrXtdXrkKmdy3ietL1k2t+1wCXX6JtY1ch7c6LI0aYzTST2csvm803XzQohKgZG/s3cp55/EvNt7oImhNLoxCOhPP3v5udckrYZvHrjBCiABIG8aJol6bmrOJ6zUU951ddGMi+VBlrPHd38bOeuTOzrq7jXJ+7uOAOdOF93s5VEVNOabbeemZXXhkNCCFqBkUKcMpR7UtUTxo90MTS0bF9A9cSLhJcyBJ/ycWETf520qKGq/ZAA8lRq61mNuOMuqAIkc9bb5n9619sPYZQp2qRt6UpdDgv3n9/qKhCeE68xSyE6Dz9+4cEwmefjQaKoDmxNGnzQBPu/olrFxcGM+WSVo9uiZbz6Ta3XZipdRUJUZdfHlaMt5UbeShExmlrCxUb9t67c8azSCar4P92HqR9ixCiZuCIU/Jg50mbAU0296quJV1Hu251sUXI7TGupVz8nN/LFDPPbHbBBb5y8KXDl19Gg0K0MMceG+KfuRXZA68zC6QrrogGhBCd5u23Q/3nzTaLBkTVpM2AXsf1ejj8C3O55nDx83UZyBp84PHK7LRTCOsQolV55hmzs88O9dKjAg6tCOFs7Lrd4yLR79foltrNO7uISU41dGW9444QsymE6DwsSGmcQp6B6BxpTiK83BVv3LKWetdF69nNGcgqeKFffTWUeBKiFfnhh5D8gud5wY4qEmeblghnI4l60UXNrr8+GhBCVA2lcXE6sDAVnSfNBjQXi8Hh0PZzYUSv6aITVmaZaqqwgtx//9CCU4hW48ADQ0jTfnzrW5eWCWfjYk8OiBCic9x3X9ixW3HFaEB0ijQb0BO7qDU6mWseFxcOKoDP6so0hHFst13wwv3+ezQoRAtw773BG0kSTItXZugonC0mE+Fsm25q9t//hrhNIUT14HzDdlBVm9qQZgN6mIuC/qu5aB/7h2sSV0tEB1Mbevhws1NPjQaEyDjffBPKmhH7PPvs0aAoRpwPkgmocLfRRkomFKIzfP116D6IAS1qQ5oNaL+M5mL/6HR1AQMObWPfCofZZuKJQyzT8ceHmGghsgxJs7vvbrbkkroAFCHz+SA77BDatP/ySzQghKgI7IWePc169IgGRKdJswF9vmthF+1i72LAISp4t3CYfZZYwuzgg8222spsdNJaxwhRQ6691uzxx80uvjjURRfjkPl8kOWXD/kfVOQQQlQGDggKD1DBS9SONBvQ8L6LTHNg25IyTm/mzlqEww83m2gisyOOiAaEyBhDhpjtuWe4AExPM2lRSObzQVg04YW+7LJoQAhRNnQcHDrUbAP6N4uakWYDuiXL2BUywQRha/PCC80eeywaFCIj0CiFkI0NNzRbh7Q5UYyWyAehc9qjj5p9QvE+IUTZ4Hxgpxpnm6gdaTagW7KMXTGolXryyeECM3JkNChEBjjvPLOPPgqJg6JdWiIfpFs3XyH4EkHJhEKUz6hRZjfeGBKwRW1JswFd623LTV1PuDBBKQ5X6rXB30tKi3887fvotmnx13vsYfaPf5jts080IETKoeVs376hZN1kfMtFe9QrH+QoF2FyI1x0OLzPxf10BP3NrnXxf+gfeLVrCldNIIaTmtAq3ylEeWA8Yxssskg0IGpGmg3oWm9bMtn3c+2bOysN93Oya3IXl3duL3Q1hb/5O8mFhSSbgQOjQSFSSlub2dZbh9jnXr2iQdER9cgHof/fYi6M4m6uB104KTpK48R4ns5FGT0ex4wuXwLVhjXWCMbzAw9EA0KIDrnkEiUP1os0G9C13rbk4uBrNfswd1YeiaoHQHc2Wn3vsovZl19Gg0KkEMoz/vab2XHHRQOiI+qVD8LfiIPCaL2AkwLjeGoGisDuH6F1+7u+c+GUOMBF9Posrk4z/vihMyHVWIQQHfPKK24QuUW05ZbRgKgpaTagk1DGbnfXcNfbrpNceMCbyuZ+yVxpJbOddw6la4RIG889Z3bmmSE5dsIJo0HREfXMB1nDhTH8s+t0l78zuTmvGP90UVAz3/NNN8Q2Fz+rCcRy0hCCqgJCiPbB+7yZzwY0IxK1J80GNORvW8J7rkaVsePiNLdrGhfx071dl7qaDl7owX45VcknkTZ+/DGEbhxzjNmCC0aDohT1LGN3r2sqF15nvMmEy7UHl+liaczEQ9fsEj7HHGYrrqhkQiE6grmU+vnsSIv6kPaWBFw41nJxofjUdY/LPzadYnnXI64JXGxZlgvhIw+5uIgV9svKXVj69OljXbp0yQ307t07p3oxyC+ftL+lS+Gcc0aDQiQckmHf9CUw5crGI2igjgzyLwmCtrY269ePFIhcwhsJwWkCR8LargVcO7jwSLMb9pkL47dWcL3AG01U+hsMFECoxg0u5uV88Er7bGR3587+pOp58bbb3Jp3c/6DD0L+hxBiXFhgUr0IG6Dc5lMZmhMbQpoNaDwtGKxUNqQyKEY0huvKLmIAq6WzBjQXhcK+gLkLhWOTN3AvhQQsYqCeeKL+xogQneX++8022cTstdeCl7GRjBo1yqaYIlcsIo0XC/+m2ynhMBe+QUgbRvThrjg2uhaM78LDvLXLTdi/wBz8kYvQungnkGPCS2ZzYdDnU/W8+OuvZt27hwotdfRDCJFall46xD5jB1RDyufEhpDmtftZLrYqZ3ItHt3e5GK8GngtiLiMoy67ujgutsigHxrTduxpIQ77DBeNZhPTVPvUU82++cbstNOiASESyvDhodMcHpNGG88ZoF75IHu74t6PJA+SrI2T4mkGisAuICEfxEoT2jZtdHynq9B47hQ0kOLzctFF0YAQYix4nV9/PTRPEfUjzQb0Ei7ikH/LnYXazTS0Zrwa8KqQKEOtU/jBRVwh25XdXdR67ukCjGvqA3zuYmVG4Ti8z9u5EsPEbt5ffXWoZMAXSogkQrLr7rv7F9e/uVRYEFVRj3yQVVyvuZj7mEEwptnh+8oFhfMiMI/6sj1nwFPFg1S/bV01h9jOu+/2SZhZWAgxFhaWFBSYkgKUom6kOYRjiGtRF/WgY5jg2S6sScmkGtKUEI4YErJuucXspZfc8sf0FyJBkOiy334h9nn62N/ZYDKwXVmPfJB60+l5cc01zZZc0uwoWr4IIex7X9LStZM8ksXZm68ShXCUJs0eaDzFJKyQOMPFg5z9a1xsIYo8Dj889MA/Av+8EAliiC+D+/QJ5ZaaZTxnAPJB3nGR8UMMNCEdnP/dlWl22y3UhKZmuBAiOCT+7t/8zhjPojzSbEAf5CLEgjqjbCOy1Ui90UNcIg/iBQnluPBCs8cfjwaFaDJ//GG23XZmG25otu660aCohlrng6QGOhNShYO60EK0OoTDcZ1nYSnqT5oNaLLBKd1Ei9mlolu2MCmzJAqgF/5JJ5ltuy1bM9GgEE3kvPPMPvzQrbzMm3l1p9b5IKmB6kI0jerfPxoQooWhCdVHH4X4Z1F/0hYDXW5j36RFxDU1BjoGj99qq4WW32pCIJrJf/8bthjvu89sOQpANpmUx/ulKR8kn5rMi19+aTbbbCGGfm5aWwnRolB1Y5ppzM45JxroBIqBLk3aDOhHo9uOoIH1iuEwMSTCgIbPPgsd3jCg11svGhSigVDDlxqldJOj1GISSPnF4mIX7ZL2cX0YHVNWk6ocSe5DVrN5kXbFOAbO4FkL0YJ8/bXZrLOGilvsOHcWGdClSXMVjjSRGAMarrvOr7R+qcVjM8MM0aAQDYKKCbffbvbii2YTxlXXm0zKLxY8ZhKo13ThQGBeJ5maknJJDmmr2bz45JNm66wTStpRvlOIVoMQzYcfNnuIgro1QAZ0adIcAy2qhPgovH/EDpJ0IESjeP55s9NPD0mtSTGeM0DL54Msu2zoTHj99dGAEC3E77+H5EEqGonGIQ90Y0iUBxq+/dZsgQXMjj/ebMcdo0Eh6siPP5otskj4vB2SsFo5KfS2pDUfJJ+azos0j0Avv+wXNl3ZRAtxxx2hZTcJhOPTcL8GyANdGk0zjSFxBjTcf7/ZJpuEmKkePaJBIeoE3hHayz72WKiekCRSeLFIaz5IPjWdF3/4wWyWWczuvddsmWWiQSFagFVWMVthhdDzoVbIgC6NDOjGkEgDGvbYw+yNN5Jp1IjsMGiQ2cYbJ3expotFU6j5vEhHy6FDzW6gxZYQLcDbb5stuqjZp5/WthmV5sTSKAa6xTntNLOvvlL2uqgfw4ebbb+92ZlnaqcjZZzkolEVMdafu65zlSqL50tx+8XFBZcGV9w2rK0DuxwDB5p98UU0IETGOf/8UIVGnVwbT9oNaNwWW7gOzp2ZUVNixnAoymGSSUJC1zHHmL1GL0chaghJquxyUPNZsfap4w/Xtq5pXPO6CAm5y9UR/M7JLubmyaLbC10NYa65wnY2CVVCZJ0RI8yuuspsr72iAdFQ0mxA/9P1P5ebfmMTZRZx+XpMVMKSS5odeKDZ1lub/YLvSIgaQVWERx81u+QSJXalECIqX3HR4RBPMlW7F3Ll9nU7oKnvNMYEyYSay0TWoZ/DQv6NXGyxaEA0lDQb0Ge7jnXN4/qVAedpF2WcRIUceaRZly5mR9AAWIgaMGRI2FK/+GLVG88IvV2fuAjp6IjdXcNdb7sIA5nE1TDwQE81leKgRbahdB3hG/I+N480G9ALuuKNuriaMTF3bBuKCplgghDKccEFZo8/Hg0KUSW0jSfumW6X6niZCVZ2+TLbds2dtc9hLhpqE/axqQuj+1JXw/ibX9X23ju0M1ade5FV7r7bbPRos402igZEw0mzAU2TgEK/1qyuL8OhqJR55w3djLbdlgzcaFCIKsAz8v77wYgRdWG5MlULaMpys2tL14MMdMBzrhHh0N5w7eva0NXQtjnbbBNq4tKhUIgscvbZofYzzi/RHNIclXiia3EXvXeedxGb18/1sqvcJgONoublmuoFnsNVVw099S+/PBoUogLeeSfE5N13n1twtTLh6kwKSzaR4JcPvtb8+Tz2vXa2OCVGM3klG7uqaRLMJ4D/x8Q3moE8cvNinz59rAvxY07v3r1zqgUHHxwWcbfdFg0IkREoB0qtc8LkpmGvp0YMGjQoJ2hra7N+/TCpVMauPdJsQOPRuMi1Te4sXDBudzHhF07UzSY1BjTwpSQxYcAAs3XXjQaFKINffzVbemmzf/87lEhMCyk0oPMNY0IlNncRPvGRaw7Xf1xEAXemufWeLpwRtAknv6QUFNIikRu/70+u+V0+i9jHLgzwQuo6L1IXd+65zf77X5VPFNmC8LgJ3QKqZ7UZ1YEuTRby4qd2zeUidMOnzESSKgMarr02NCV4803VlxTlc/TRweP34otmXbtGgykg5ReL913sxsWhEzCV6yXXnLmz6sDLTYJ2XM+C6wWOitVdGNTdXSQKrhadE0JHqAeJ3Rj4zMm3uk5w/egqpO7z4qa+tOjWzeyss6IBIVIOfRtmm81s8GCz+eaLBuuADOjSpNmA5g0tNut+68KoThKpM6BJvuHiQymo22/3D0oWllqirrzwQmgn++yzZgsvHA2mhJRfLMgHmd2VXx1jSheeX26TSt3nxeeeCyFp7KqFt1eIdHPUUcFBQYhcPZEBXZo0JxHKpKsjGMz9+4cvKrUmheiIn34KdcSZ3NNmPGeAR12EauCPmji6vcb1iKulWWopswUXDHXIhUg7zLNUyjrggGhANJU0GtDE5CFyT+PjWMT8UadU1ACSEy67zGzffUNGuxDtQcLWdNOZHXRQNCAaCaXlxne96aKUJ9UvyBFpWAvtJIOxQTUY4vOFSDN0HZx5ZrOVVooGRFNJowHdKxIXjPgY9XT97lLD4Bqy+upmW20VSttRuF2IQkjaZmJH43W25oOohmGuVV2zuJZ2EZu8iutrV8tDIjQJVzcTnS1ESqFCFrH8LAgVUpkM0mhA/zsSm3LxMWJNRgWOwS5RQ6im8OWXZmecEQ0IEfHtt2Y77GB25pmqdNBkCCJeIdIXLmrkz+hqeVjUsYvG/KXGKiKt0Djlhx/MNtssGhBNJ80x0LSLFQ1gkkmCd/GYY8xefz0aFMKhVTc1n3fUvk8z+afrfy7/htpRDDiUk6N+s3Ao+/Xxx2aPEi0uRArBkUWHzahkukgAaTagV+xAosaQjMPWEYliVOYQ4oYbzB56KCRoaUuxqZztOtZF+bg40peycv6tFYATgK5tp54aDQiRIp55xuy118x2U1ZDokjzZa+wExfUqvtWrUldGbtikISDIb3KKmYnnxwNipbk889DdQO6Va63XjSYYlJesmm4azoXc2J+GU/K2iW5eFtD58Vhw0L93DSWWRStzfrrh6ZAjVwAqoxdadLsgeax54sEGko3beASdYCe+1dfbXbeeWZPPRUNipaDZBa2xEnOyoLxnAGoA03Mcz40NaGRiYigSgyf2zR1yBTinXdCzed99okGRGJIswFdCIkze7m0SVdH6Hz0n/+YbbON2fcUzBItB3VI33svlAYTieAm15WuuXNnwZngy1y7NncmxrL//qEaxycqdipSAsmvW2wRyteJZJElAxoISZkpHIp6QSLDHHOEzHbRWrz7rtmhh7q15uZaiqORsgbxzzgQ/N3JdR7EPPzNdYpL5DHnnGE7XBWFRBogVO6aa1RfP6mkOQZ6h+g2ZhLX5i5idVZjIEFkIgY6H1rjEgOLIcVWvsg+xMD37Gm23HJmp58eDWaEjMT7Efs8l4vQjU8ZSDhNmRdffdVsmWVCVY7pp48GhUggJO7TxOy226KBBqIY6NKk2YAu7I1HQMFLriNceGOSROYMaGBlzJbom2/qQtQKHHus2S23hPbuXbtGgxkhxRcLilpRhcO/iTaagRTRtHlxzTXN/vnPEI4mRBIZPjwkvVJ6cYklosEGIgO6NGkO4ZijQAu58EpXazxv6nrCReY6PfdKvTZslRJjOMJF5vvVrtynrVXYckuz5Zc322UXNSjIOhjNp5wSkkizZjynnDYXrRXqYTyf5KLyO3Pi567rXMRXd0Qq5sXDDjM7/3ys92hAiIRBsv7SSzfHeBblkTYP9HHRbSniZgKVQOtbtkAndl3qmsBVrFRezD0ufgfDm9fxRtePrmJ1CTLpgQZWyQssYHbiiSHDXWSPn34yW3TR0M4dwyOLpNzbcr1rgGtQ7qx24J+9xfWGi3mxv2s+F01a2iM182KvXmZrrJHdz7RIL3QcnHXWsOO3YpM6W8gDXZq0GdDl9JHCF9qZj9zyrkdcHRnQlIj62IXX+00GHI5fdfGzzxjII7MGNFBiZ1O/XNKlcPbZo0GRGfbay2zwYLMnnghtkbNIyi8WVNzYznWni9C2/HmrGmdCe1A92T8JOUdDMd9tqubF++8PjaGIhabRihBJgXrPAweGBirNalIlA7o0aQvh+HcZasR6jda5bJnGFwlgq5PtVH7WUqy+eiizg4fyd4JfRGZ48EGzAQNCK/esGs8ZYAEX+R/dXD1dvSIt66olvV1U+Ggv8CFV82JvfzYs+C++OBoQIgGw40eVmCOPbJ7xLMoj7WXs2FbcxHWga2NXo/wIOc9JOBwH4v6y52IuA6oyUHLnzDOjAZF6vvsuhOUwmVP+SySWYo4EVEtnwsouv6Tbrrmz4qRqXsQ4OeKI0FhldNrSL0VmueQSs1lmCY4pkWzSvL6Zx/WQayIXXhG2CH9xMdFTD7VaygnhWMd1gwsDPh+m4Y1cd+fO/iR3YenTp4916ULSPN6P3jllCVrkrrSS2XPPmS3Exq1INZtvHprl3HVXNj0hgwYNygna2tqsX79+HKZ9u5J3Kv/d6iiPo1zWcpEMuK2LMJH2SN28SPIz1Th29WXBHntEg0I0iV/cgunRIyS4Uq+80WR0ThRFIFnlLNf4uTMzNpgpj39v7qx6MKBLVeHAWOd32DqNIT6QsWJZ6lwoxowcOXJM1jn88DFjFlpozJjRo6MBkUquv37MmGmmGTNm6NBoIOPw3eQ7Gn1X08Y0LipfDHMxB+Wrs2zpolU4jolSpHJevOmmMWO6d9ecJZpP//5jxiywwJgxv/8eDTSRlM+JDSHNIRwUdyF/mo5bwCRNDehqi77wWkwYCSjWxXEx3xtNCjDUaSfBxWva6BjvTGGiTEtx1FEhVvboo6MBkToIxcEbR2zojDNGgyLJ4Ejo4drZ9ZNrQxcx0fu4OsOeLhIU8UCz21eKVM6LG/qrNdlkZldcEQ0I0QTwPlOXnGvo39IeXNsipPltIlzDp71x4Jzxatja9bPrvtyZ2Q8uLkYk43R30aiFBJ0Yfv8b1weu/7mGutjibGnYiaXBCjUsn3oqGhSpgS3tHXYwW2cdsw02iAZF0sE7TC7I7S4cCdxu5aI+dGc410VeCXMiW7jMgdzG82Am5kWMFRb8lOLEiBGiGVx+uRlFL1jQiXSQ5shGcqdJbcLL8mF0TAgHZZR2cSWJXKyfk8kydsU466xgRL/2WvDuiHRAyBsllChJGCoYtQYpL9lE4l78bn3lIlziV1f+eBJJzLz4xx9mCy5otueeZrvvHg0K0SBYuM01V0jC35hyCAlAZexKk2YP9EEuPMSUScILQq1RyiUd7BJNZh9f1lAiilbfIh28+67ZIYeYXXllaxnPGYDQCb/85njfRfrRSi4amIgykBdaNJPLLgtzrrzP6SLNBjTelbVd1D5dyjWzi1g9SiaJJsMFifrBN98cqjiIZPPbb2bbbBOqEaywQjQo0gIdAhcMh7ldOFpuP+A6mwFRHhttFIwYyogJ0SgoocjCjQWcYp/TRRberi9dL7omdc3BgEgGtCIljGOnncyGUR9AJBYm8B9/DEksInVc4BoYDu0212wuWm6fyoAoD4yX444L3wGaWQjRCC680GzaaeV9TiNpNqAvd8WdtkiWofYzSSubMyCSwVZbmfXqZbbLLiFBTSSPF335efLJZldfbdaV2jMibdAwJV9/d7EjV8tGKi0BtXe7dTPrj09fiDrzww9mJ51kdsIJ8j6nkTQnEZLdTeIgvoLnXZRLItD9NFfS2ni0XBJhPt98ExJ0mCi22y4aFIkAT9uii4Y27IdRFLJFSXnCTLFmKfFyNckN2BM5L953Xwhn+vBDJUCL+oLj4vbbQxOypDWrUhJhadK85qHbFcYzUxxdCW910UKHYv4iQbA9RYkeEgs/pkaKSAyHHmo2zTRmByv1Ns0wj+eLKhzXuFSIsApWW80vKH5FOeecaECIOuDrxlzFI7zPWez02gqk2YAmqnZel0939pwLLww1SxUokEDo609raDzQlIwSzefBB0PziKuuCs1vRGb4wrWXSzHQVYAxQ07AaaeZDR8eDQpRYzCeF17YbCXq5YhUkmYDmgxzum0NcJFEA8u53gqHImmcfrrZZ5+FGtGiuXz3ndn225udcYbZnARCiayBT2umcCgqZfnlzZZZJoSdCVFrhg51A8YtGEI45H1OL2l/66h9SivvODCAUI4urjdzZ8mhpWOg83nmGbNVVjF7/nmzBRaIBkXD2XJLsxEjzO6+WxM4pDzeb4foNoadOJKpeR7s0CWVRM+Lr7xi1rOn2TvvhIpCQtSKPfYw+/JLs9uomZNQFANdGl06G4MM6DwOP9zsnnuCET3hhNGgaBg33mjWp4/ZG2+YzSQfZY6UXyw+im5jaCzF7twRLsI5kkri58UttgiVacjhEKIWvP9+cB6xQJuXINSEIgO6NGkO4YClXZS9v991qWsZl0g4ccH4Y46JBkTD+Pzz0Kr4ootkPGcI6t/niypEeKU7azxv6nrCRdOq312lrhePuejjx8UWI57b3Vyp5fjjza6/3uwtBQaKGoEDiR3AJBvPojzSbEBv7WLCpgqHr+Vy25YPu7ZxiQTTpUuoOXzuuWZPPx0NirpDHe4ddzRbay0V7Rdl8a2rn2vf3FlpSOA+2YU7mXmZ2wtdqYX8AGrYq0qNqAXsuhI2R8MekX7SHMLxnmsf1325swDxfue55s6dJYfEb1U2gzPP9KuzX55ffVX1VhvBBReEpJXXXzebcspoUORI+XYlydPlgDe5GpZ3PeKawNVRDZ1HXU+6jsqdlSYV8yJ17DGkBw40W1GtaUSV4MAgOXU5/7ZSui7pKISjNGk2oHlDMQPyJ3Q86iNcSZuNZUAXgXJ2lPCZ25c7F18cDYq68J4vN2mYcuedMgKKkfKLBXMg3t/8+bzYebXFCisxoEkNZh7+ynWHC1PhR1cxUjMvsvC8+ebQtVMd40Q13OHfhp13DjHQaTADZECXJs1TwYOuwgzz3i7GRQrgQjRgQEhqY1tL1Ifffgud1Zi8ZTxnkq1c97qIfWYvh1u+UVu6MHoR1YnqDb0s2f2bxkX8NPMxuSmphyZQw4aZXXddNCBEBfz6q9khh4S8H/nQskPaDGgih2KRIHNzJBoG3BQdf+4SKWG22UIs9E47hQuUqD3Ush01KjSHEJmE+ZCcEMp34u3llqb5eH9J/otVb2hoxQ4gvOEidppo+9TX2ploovA9ot097e+FqIT+/YPDiHh6kR3SFsLBFmEp2KpMmp8tNVuVzYDYMJLaqEd8yy3hVtSGl18269XL7KmnQgiHKE7Ktyu/c83uolpGDOFt1MevRbR7uSEchRCb/ZCLSW80AwXk5sU+ffpYFzKLnd69e+eURAg5o7nKGmuYHVVulLdoeb791myuucLuBW3ik8ygQYNygra2NutHkpJCONpFpkpjkAFdArzPCy4Y2psSbiA6z88/B6OZkklHUBFYtEvKDWjaMXR1HejCaMaYZleuzbWBq1rYocRoxoAmWZvwEDzZ/F0cFflM71rE9aQLH+38LrrE8ng2dhUjdfPis8+GRlDvvms288zRoBAdsO++4fNyX365gxSgGOjSpDkGOh8WAjyXWCJlTDed2aWXmu21l9knn0SDolMcemiotsGtyDS7usZ3EbpB/WXCJwib6GwNZsJCfBk2ttLRDy6M416u7i7uq6cLMOAJJSGEjovtQBfeZ0JJMsPSS5utvXYI5RCiFHSxpOb+GWdEAyJTpNkDTaLKua5VXVMzkEe12eb1Qh7oMiFG7H//M3v4YV8JaSlUNQ+56bL++qHbFduHomMy4m3p5prF9ZkryR0IY1I5Lw4ZEppgPPhgMKiFKAahiYRs/OMfZuecEw2mCHmgS5NmE+UsVw/Xzi68IiSr0L6W2tAipVAb+tNPzc4+OxoQFfPdd2bbb2922mkynlsMjOYXXBO76Ego6kD37mFXh90y4qKFKMZdd5kNHqyOu1kmzQb0yq5NXLe7iMvjlnJOm7lESpl0UrOrrjI78kizN9mQFhWz554hnnxXNvZFK3C5a9lwmJv/3nX9z7U5A6L2HHhgSA67nFdeiAJGjzbbb79Q+WiqqaJBkTnSbEDTuntIOLRfXCS7cNFw00GkmZ49Q93VrXw51Ea6kiibm24ik9rssstUzaSFWN01OByaX7ZzRvSaLkXq1omuXcNuGbHQGNJC5MPuH/knO+wQDYhMkmYD+lNXvEH9vmt910qu9rpeiRTBthcGoLa/yueLL8x2283swgvNZpopGhStACEbhLFRJWMe160ualHN6hJ1Yt11zZZYwuzww6MBIZyPPgqdKy+4wGy8pGVjiZqSZgO6vyv2NpPjSo+oB1yKns0AlIW9+uqQfPHMM9GgaBcSVnbc0WzNNc022igaFK0CLYjmdVFllmYmROayQ1dYak7UEBb4551nduWVocW3EMzDxMZTOnTJJaNBkVnSbED7+i5XKgmogzqbaz4X9U9FBlhgAbPjjjPbemuzHyigJdoFrzMx41zQRcuB04AEauouMy8CTUzeCoeiXsw5p9nBB5vtvrvZ743o9SgSzZ13+grWl7B0rRTZJ80GdCHUHyV5RmQIEjHIej/ggGhA/AXK/h10kFtPbj4RdydajvNdC7toXnIXA84Hrs7WgRZlQEWOESNCu2bRuuDk2Xtvs1NOMZuGIrsi86TNgH7VtbarvfQoxtd1vZI7E6mHWtBskd5wg9k990SDYiy//RY89DvtZLYSGQCiVSEPhK5/Me+5VMemAZBQyA5Q375mn+PGES0J7d1nmy2UEBWtQdoM6D4u0sqovuFmlR3k2iW6ZfuSxEL/GNueLpERmJSIhSbG95tvokGRg2SVkSO1ZdiCyJmQIFZeOSQVEv8qWo+XXw6LKLoOqgFY69De5Jt0/u3awLW4iy6EFBLyj3AuFvoRV9JQJ8JOQnLGBv6Ok9V8883+wU3rJ7eGMGn36mX25JNmiy0WDYqqSGHXLVpo04l1BtfDLrzNvpTKPX5COdiP+Nq1t+tpVxLJ1Lw4bFjoOkcJyfXWiwZF5mEXkITBtdYyO/bYaDADqBNhaWSGNAYZ0DWACxSJhaefHsIWWpmffw5G8+abh6YzonOk+GKRNmdCPpmbFwk3ozb0228rH6FVOPXU0FDn1VdDOE9WkAFdGhnQjUEGdI2gPSrG8+uvm83awlVuSa589lmzp54yG3/8aFBUjS4WTSFz8yI7ZauvbjbLLGaXXhoNiszy3ntmiyxi9uCDZsssEw1mBM2JpVG0zriwAUMayPeux1xshbYHP6cDIh8sfp9bZb3XmbXXDnWOt9vO7A+q3bYgDz9sdskloeW5jGdRRzZ1PeEiNIQibaWuF/hcr3WNcOEJv9qVuwK3CoSWXXxx6Aj60EPRoMgkXH/Iy9l55+wZz6I8ZED/CYmIbpbZKq5pXbTvoJsXXb6KQZOCk124TugAxu2FLlFnzjrL7OOPQ2Jhq0G5LBYPtIqdh55zQtQPjOB+rn1zZ6XBeJ7ONYeLLrEzukj2binYGSO5l8o43+NaEZmkn38zqLryn/9EA6LlkAH9J7u73Cyxt114loksncBFi/D2UAhME5jMlyt4X484wuytFmsVQZY/ceC07BaizjzoutH1Ye6sYwioWt21v+s7F8Y31dvXcc3iain4fvboYXbggdGAyBTU3ifWndjnSej5KVoSGdABvMezu/IbsrJlSamoRXJnxcHoHu7C6KaQmL5KDWLZZYMxSTx0W1s0mHFuuSXUwibLX1VIRML4p2u0K7/29Osuvp38rKWglBnG1fXXm91/fzQoMgEdJ7fdNuwwrLBCNChaEhnQgTiDhdi9fPCktJfd4utPm9tFzyFiBXu7lDbSQCgZxGRGu++sM3So2a67hlqj3bpFg0K0T4/otlEwTxIrXQhzantzaKaZffYQbkac7HdcSUQmOOMMs+HDzU48MRoQLUvW/Fj7uNhyPNRFAgvlnMqBCZ6JfmnX8wxEEAP9hqucjbjlXKSNEA9NCEg+uYtLnz59rEuXLrmB3r175yQ6xxv+7iy1VDazoGPI7F9zTbOppza75ppoUHSaQYMG5QRtbW3Wj6DG7GScn+0irOJHF/kcj7smdFXTWGV5FyXxCGlrL3WXUI0bXIU5I3ilN3LdnTsbl8zPi3x3SXxmm59uqto5Sjev+LenZ0//Mvi3getO1sj4nFhzsvZ1xojt5cIInsh1l6tciPM703V+7sxsPNdQ134ukmNKERvQXBS4aOSTu1CojF19oC40nlnqcE46aTSYIXhuJKqwWFBt2fqQwZJNq7oecLGgP8JFKMVaro5C0tqjHAMaY/0j18KuOIyD48Gu2VyfMVBAS8yLX31ltuCCwXPZ6vXr00xce3/TTc2OPjoazDAqY1earIVwUMaczG88wJUW+LrAhaeZ0nUY3ye4+DsDXYVM78JNEntb+D8+PdodrkLjWdQZaiLPPHM2E3ZIVjnoILMBA2Q8i4qgCkYf10yuD1wkRW/jqgSuD3itETC/clzM8fKp616XL2dzYW1UMuL4Tlcx47llmGGGEA+9556+wmCJIVLJwQeHOfjww6MB0fJkzYDG47KXi8n7SwYqgMnezZScF3mYi3CO1Vw/ubq7KEhE+1zgQkLkLTWjWZlhZPP/KIMnGgztvekARsLOvVzCMwItYrdxk2eHHcxWojGzEOWDQ4D5iRJ0GLdAOFol4C/92XVf7szsBxfzIbt8hXMi8PvfuDDYfemX28Hb1tXy0OZ5q63MttjC7Ndfo0GRGmjgxTXm6qtVe1/8SdZCOLhYrOmimsbxLib/JKAQjgaAl/bQQ83efNNXUCyhUs4JJ5hde63Z4MFmE7EnIuqGtiubQkvNi4QALLlkyGc4iZpNIhV89pnZwgubnX++2eabR4MtgObE0mTFAz1DdPuai0Yot7v2YEC0DpQWWnrpUIOV5J008/LLIcsbj4eMZ1EFJFQTzkYy4WIMiObC9/jGG4Mh9gB7pSLxsAvIrsF667WW8SzKIysGNKEXJPrhgcaAfsdVTvF/kSHiNrpPPpnuahV4qkg2olD/4otHg0JUBtU2dnRR/UKFDxPCvPOanXtu+H7TxU4km2OOMfvmm/CeCVFIVgzozVxbuvA6kw1Oc80Waa8h8pluOrNLLw1NVj6NIz9TRt++ZuxoY0ALUSWdSagWdYRW/GusEao5KB46udC06pxzQgMrdRsUxciKAR0X8Kf03GWuU10qXd+iUHd1o43CheqP9opuJRTqi15ySWhVrmQV0QnihGpfUlacUC3qCDtllNf9/nstkpPKxx+HXYKLLjKbb75oUIgCslaFg9QMivmTQEhhf9Gi0AGMSTBNW28jRgSj/1Rf/s0zTzQoRHHIuls0HP6Fv7s2Dod2m+vZcCiSwsQTB88mu2U33RQNikRACN2GG4aYZ+KfhWiPrBnQV7oI59jN9QIDojWZbLJQdoianW+/HQ0mnL33Dt6O3XePBoRoH2KcqTa0c+5sXCghR+HDtXNnIpHMPXdIEqbV92ukv4umQ/L5zv6NIuETJ4wQHZE1A3oOF80DiIOemgHRuvTqFZoXsBXXlvCI+FtvNbv77tBwQe1+RRkwd6/holFJIQQu4UQ4KncmEgvhZjTooMrD8OHRoGgaGM2PPhp2B6Lu8kK0S9YM6ItcpI5RwimlKWSilhx3XChFdDxBPQll6FCzXXc169/frJvqJYjy6Od61/VV7uyvzOyiQ6pIOOySLbpoCBtI+kI/y9x3n9mRR5oNHGg2I+m3QpQgbQZ0OXF/d7nwQqvSprAJJwzbpGecYfbcc9FggmDLcKedzFZdNWTlC1Em1Hc+00Xex2wMFLCii1AOkXD+5ldhkoZHjQrhW2mvYZ9GaL612WYhJv1f/4oGhShB2gxoxf2JillooVDPk1COH3+MBhMCFTeIfyQrX4gK+M2Fw4D22s+7Brt8mZgznJnXl3A94hIpgDJpd94ZvKCnnx4Niobw9deh1fp++6lZiqiMtBnQPF7F/YmKOeAAs5lmMjvooGggAbz/fnhcV1xhNtVU0aAQ5fO7i5r35Hyc4JrM5UuynDNheVetqm8c66Ltx/eux1wdhYbwc2pP0/qX3+eWeVmUYJZZzO66K4SdqTJHY8ChgvG8zDJmRx8dDQpRJmkzoBX3J6pivPFCVQ46FOLlaTbEZW+zjdn225utQu9MIaqHyFnK1e3imtOFH+11F2FtnYUl53YuPqXTup5xDXJN7CoGAQgnuwi3w6Dn9kKXKIPFFgvtvpkXHn88GhR1gTl4k03MJp00ODGUvC0qJW0GtOL+RNXMMYd/gPwTtMMOzc94p9bzt9+6pYGpIURtoYTn1q6Xcmedg6KKp7koBoln+UjXBK71Xe0hU6QT0KWQ+vVU5nidZZCoOcSZk7g9ZIivPH3pSa6MEJWSNgNacX+iU+DZWXJJs912a16yziuvmJ1wQkhupKGCEHWis3steI9nd5F3EkPYyKuuRXJnxcHoZomK0Y2zQ42QK4Ta0ISbkVxMqJeoHcz7vLZ0fWU3csopox8IUSFpM6ChUXF/IoOwTXfxxWF79Npro8EGMnq02VZbmR16qK/2WO4JkVwwoGFEdBvznSv+WSE0p57bNY2LujK9XZe6RIXQ5pvE55VXNvvss2hQdJoTTwxz/0MPmc1M0KcQVZJGAzqmnnF/IsNMP30oV0STFbbwGknfviHmjlshEg4JgFDooyPlNf5ZIRSLjA3uN1z7ujZ0aZO8QljsE+qFF3rFFc2++CL6gagaKpyceabZAw+40YDVIEQnyGKs2uquBKSJjQPempGOTT55e44b0WjYJv34Y7MHH/SVZAOWknS4ovPY4MFm88wTDYpEMGrUKJtiiik45J/2jMNW5EMXeSfn587MxnMNde3nKmcPZznXQy4mvtEM5JGbF/v06WNdorZvvXv3zkn8yR9/hLnq2WfDHEI1IVE5dBmkoRaeZxrXiL8yaNCgnKCtrc36hfqqmhPbQckejUEGdAL5/vtQI3rffc32oXdlHfG33hZc0OyQQ8zcXhAJQwZ0uxzo2tO1pgtjmjKhW7nY6fvJlc/0LmKjn3TxMyoiDXD5MjWXu1KI5sUy+f33kPz8/PNmDz+s0INKoZEWeScYz1Q6EaXRnFiaNIdwCNEpJpssdAAjnOK//40G68Tee5vNO6/ZHntEA0KkA9p6YATjRR7mWtq1mgsDubuLWs89XdDVdZyLmtFccAe6+H+UwROdgDKcl19utuyyZr16mX30UfQD0SEkDB57rNlJJ4WFh4xnUUvkgW4M8rQkmIMPDpMrrb4noEBXjaFMEu2633hDnqOkIm9LU9C8WCGEc9Ax79Zb2W43m19dD9qF14pqG9dfH8L09FpVhubE0sgDLVoe4uJ+/TXc1povvzTbZRezCy6Q8SyE6BzkalDLngU5nuinnop+IMahrS1UO7rjDrMnn5TxLOqDDGjR8lBEn5rMZGgTY1gr2D7kQkenwc02iwaFEKITUJ3jmGNCE6bVVjO75ZboByLHiBGhGc3//mf2zDOqtiHqhwxoIZyFFw4XJequ/vhjNNhJKJX36qtmIZFZCCFqBztbhCeQXEiCXLMaQyUJms4stZRZ166hYgklS4WoFzKghYg44ACzGWcMcXOd5YMPzPbfPyT+TD11NCiEEDWEspiEcVxyidmWW9Zu8Z9GqLBBl1leE0I3qLcvRD2RAS1EBJnuV15pds01IUGnWig5tc02ZtttF5ogCCFEvaAU5wsvmH3+efC+ErrQSpAsSHfB9dYL5epOOy3M5ULUGxnQQuQxxxyh4P7225t9+200WCFM4MOHm51ySjQghBB1ZIYZggeWHjRLLGF2443RDzLOsGFm66wTwuVIFsRpIUSjkAEtRAHEFC6+eHU1m197LVTzIClx4omjQSGEqDOU4CQResCAMHcxj/3wQ/TDDMKCgdwV4p1fftlsEVr4CNFAZEALUQBZ7sQUPvJISNIpl9GjQ+kkYqjxAgkhRKMhlIGFPM1W6H5KMl2WYFHAAoHnedxxZjffbDbVVNEPhWggMqCFKAJbohdfHCbqzz6LBktwxBHBG3L44dGAEEI0gVlmCc2hSIwmxGG33cy++y76YYq5776wKKBz7OuvhzKhODyEaAYyoIVoBzwc668f4upIVOmIxx83u/DCkIBYj26GQghRCTRd2XPP4I3+5BOzv/89JEmXmsuSyKefmm24odkWW5gdckhYHPToEf1QiCYhA1qIDqDrFyXpzj8/GijCyJGh6gaNDbhICSFEUsDQvPfesMA/8sgQXkZ4WhqgKQoG8z/+YTbZZGbvvhu86SwOhGg2+hgK0QGTTx68NocdFrYNi7HPPsFwribpUAgh6g1hDhtsEAzQTTcNxyuvbPbEE9EvJAwMZ5KxMf5feinUuiY5Uo1RRJKQAT0ux7o+d33veszVUQf9KV3XuvyrbhQ8u9o1hUtkjOWWC8YxXQp//TUajBg4MBTtv+IKeUVEZtG8mBEmmsjs4IPNPvzQbJllQnx0r15mt95q9ttv0S81EUJNSMKeffYQpkGCINU2Fl00+gUhEoQu+X9C/zmqSK7imtb1jIt2Gu0VI+MiMZ1rDtdcrhldV7oSw6DOdAOpkqzeJ96QX34JLXOB+/zqq9BO94ILzGaeOYzXE72fogloXqwBSbtPuqNSweLjj4MRTdfUOec0O/roYFxXSzXPs60tOCJ4HPPME6qH3H23r9R8qbbSSqWTBPV+imYhA/pPdned5nrb5aaSHekiHWx9VyGzulZ3+bRj5DbjaTnA5VOAzeJKBJpYagfVNUgQpEkKXb/uv39QLgOcCX7zzaNfqjN6P0UT0LxYA5J6n1NOGTy+5Hmce26obEG8MR0NaQRF2NqYMdEvl0G5z/P778POHQnaM80UqoUstpjZe++Z3XKL2bLLRr9YBno/RbOQAR2Y3DW768XcWeB316uuYuXZ/+ka7Xozdxbwqcd8LZ37mcggFO0/6qgQyvGqfzIGDw7eZyEyiubFFmH88c3WXTd4gmkJvvPOIT6a0Al217bc0uycc8yefrrycniEhrz/fgjHICGwZ8/gAT/wQLPppjO7667wc7zfs80W/SchUoAqKAbwjnzqmtf1LgMRN7hGuXbJnf3JVi68Mr52HocvXXhfrsud/QkXopFDhgyxyclKaxB9+/a1E088MTprDFm/z9/dfFh9dbPnn+9rt956Yi4Rp1Ho/awfo0aNsu7du3NIvC7feaF5sWak9T5pDvWiL59I4sNhgOPg669D4xKMXQzgaaYJsdVdumBg97VFFjkx52GmzfbQoaEEHcw/v6+ifBlFFZDllzeblf2KGqD3sz5oThTlwuxNdcwlc2d/wp7J6eFwHNiS/CkcjgPel7XC4TgQIctGmCRJyVYDotlTg+ZFSZI0J7aDPNB/QurEma644u94Ll8/234uEmPyYe38kWthV7xdybGv0Y1NqMLedbzO3VxksQshkslkri9cXDREQPOiEK2L5kRRFge6PnZRomki10muIa72ss3vct3vmsZFdvqDroEuIYTICpoXhRBClOQYF96VH1z59U4JBMJL0jN3FqDe6TUu6p2SVnGVq3GBfEII0Rg0LwohhBBCCCGEEEIkja1dT7mGu4a5HnEt4ypFJR2/ClnIda8LTxGJPyu6SnG0i/5TZNhyn9wWxjV2RDX3CZ15nrCRi8baP7rechWrSZtPNc+zWd3XKrlffk5t3vzntZurXDZ10cx3pIvyZKXKWtbieVZ6n519jkDYAeXUuE9eW6pBlKpLXMv3VAQ0L3aM5sXiNHJOhFaYFzUnisRC8wE6d03iIulmHxcfcBJm2oOOX5+45nNN6KJeDUk37cUaFvIP144ump7yBSz3QsGXtlqquc/OPk8qAvzsWs/Fa7uBi8z/jpq9Vvo8K32M97gecE3lmtpF3Oftrkqp9H4fdXFxqRY+o0zc27vKmbRr8Twrvc/OPkf4j4u6xeO7CCfgIvCKqyNq9Z6KP9G82D6aF4vT6DkRWmFe1JwoUgXxgOuGw6KQ7b5nOMzBJPiVa8vcWWVU4mnpzIUin3Lvs7PP83LXreFwLLe5LgmHRan0eVbyGKk8wHNfIHcWwAPFWKXd1yp9bZhEjwuHnWJ5V6lJu5bPE8q5T6jVc8yHyhDcd3vek1o/V9E+mhcDmheL06w5EVppXtScWAWl3iRRG/AO4HV5LXf2V1gBVtLxq5bw95mQKD/FKpTHUS9q8TzpaPZCOBwLf6/U/y/3eVb6GGvVfa3a1wavHlvitFpmW47PWT2o1fOshlo/x94uvFpsXxajmc+1ldC8GNC8WJykz4nQzLmils9Tc2IVyICujCtcrLj4EnNbKGL6CiFTnc5dfMApB1UMJgogtigfvDNru/jbldxnudzsYmtsBhexiNR6fMhF5jx/u9b3WYvnyd8o9v/jv12M9p5nsW3Ajh5jsftgrNikw//v6DEVUun9wmGuuV2UDGP7j0nwUlc9qNXzrJRaP0d6Rx7p2jV3VpxmPde0onkxSPPinzDW2e9QpfcJjZwToRbPsxpq+Tw1J4qGwMRC7E97ouh4PnO52ILiItERfACZDIt1/DrbVey+YhXeJ/C3ytk2LKSLizi6NV3F7itWtfdZi+dJU4ZDwuFYmExeCodlET/PYo24O3qMtei+1h6V3m8xlnPhESBWsBLK2Tas1fOMKXerspBqnyPwOLn48lw6otbPNetoXgzSvPgntfgONXNOhFaYFzUnikRCfBAdfPrmzkpTLNbra1c9Y/0KiSdQEhoqpdz77OzzJNbvlnA4llKxfoWUep6VPEZiw5jw8mPD4niySmPDOvvaxJNo19xZ+ZQzadfyeUJnLxSVPkdeQy4UxYyDQmr9XMWfaF4sjubF4jRrToSsz4uaE0UiYTuM2KS9c2flUWnHr2Kw+uQLxKTNlg7nTDjtsbGLLSBgG48tSiasSmKpKr3Pzj5PvBGshEk8IoN4QxdlmzrKNq/0eTar+1ol9zu9i9c7/hn/h1hBtmXLhUma92tVFxMhf4vz9lr81+J5VnKftXiOwAWYskv5DT9KoY56tUfzYvtoXixOo+dEaIV5UXOiSCzEpeXX14zrNB7qiiEYP/8c2uv4VQ6zuZis+fLl6yhXTOF93uEigYT7Y1IiiaSHq1yquU/ozPMELg7UO+WCQQIFpZvyqcXzbFb3tXLvF4/A8y7uj8/Wey4uLpVc5Ld15b9/8THejHo9z0rusxbPEbiPuGZq/J3kNr6fer+nIqB58U80L5ZPI+dEaIV5kb+vOVEIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYRoDOO7ZguHQgjR8mhOFEII0SF/c/V1dc2dlc+Mrt3CoRBCZAbNiUIIIcZhOte5roGuRRhw9nAtEA4rprdr43AohBCpQ3OiEEKIkpzm2ta1lWtyFx6W612d4WZXl3AohBCpQnOiEEKIkgx29QiHOdZ27R8Oq2YvlzwuQog0ojlRtAzEJgmRRfB8ED93m2taBpztXJ2dzKGb63jXHK7NXEu5YCXXi+FwLL1c27gucK3j2t11g6s9nnKtFg6FEKJmaE4UQghREjwWbPu95pqLAYcLx/rhsNMQ3/doOBzLLa55w2GOKVwbhUM70NXfhXfmHAbagRjC58KhEELUDM2JQtSQ/4tuhcgak7lmdV3mir0hw1zzRbewn2umcDgOfC/GuE53fc1AEbZ2LeHaO3cWuN9FwsyHubPg8Wlz/eG60XWl615XzAwuLib9cmcByj296fpH7kwIIWqD5kQhhBBlcbhrn3BoC7reCYc14VTXzuFwLFe7FguHf2GoiwsYkFzTHvzshXAohBA1RXOiEDVCMdAiy0zvejcc2uquJ8NhTVjI9Xo4HAv3NUs4zEECzS6unq5Rru9dU7t4LGx3Huaa25UPsYmfhUMhhKgpmhOFqBEyoEWWwftBHVHKKu3kIhmlVszveiMcjoXtyuXCYQ4m/nlcbD1SF5XHsIGLrUu2TLu7CrdDF3cVxhEKIUQt0JwohBCibMZzMTmTKV4LiNN7Ohz+BbLJub9STOm60MUFI59iY0IIUUs0JwrRSeSBFlllGVfsXSGJ5VrXF7mz6pnZRTLMv1x4TIpxtovSUKWItyXZvowheYctzSG5MyGEqB2aE4WoIeWsCoVII3y2J3BRQokJ+UgXWeSdYSIXHhv+3hkuMskL4QLARYX7/4aBdvjW9YTrq9xZyHI/wHWSiyx1IYSoJZoThRBCZA6Se6iRKoQQQnOiEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBBCCCGEEEIIIYQQQgghhBAtiNn/A0qet3aclUEMAAAAAElFTkSuQmCC\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "x = np.linspace(-2, 2, 101)\n",
    "plot_loss_functions(\n",
    "    suptitle = 'Common loss functions for regression',\n",
    "    functions = [np.abs(x), np.power(x, 2)],\n",
    "    ylabels   = ['$\\mathcal{L}_{abs}}$ (absolute loss)',\n",
    "                 '$\\mathcal{L}_{sq}$ (squared loss)'],\n",
    "    xlabel    = '$y - f(x_i)$')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Функции ошибки для классификации\n",
    "\n",
    "**0-1 loss**\n",
    "\n",
    "Предполагается решающая функция вида $\\hat{y} = \\mathrm{sign}(f_{\\theta}(x))$:\n",
    "\n",
    "$\\mathcal{L}_{0-1}(\\theta) = \\sum_{i=1}^n l_i \\quad  l_i = \\begin{cases}\n",
    "         0 & y_i f_{\\theta}(x) > 0 \\\\\n",
    "         1 & в\\ противном\\ случае\n",
    "       \\end{cases} \\\\\n",
    "$\n",
    "\n",
    "**логистическая функция ошибки**\n",
    "\n",
    "$\\mathcal{L}_{log}(\\theta) = \\sum_{i=1}^n \\frac{1}{\\log(2)} \\log(1 + e^{-y_i f_{\\theta}(x)})$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# define and vectorize zero-one loss\n",
    "def zero_one(d):\n",
    "    if d < 0:\n",
    "        return 1\n",
    "    return 0\n",
    "\n",
    "def logistic_loss(fx):\n",
    "    # assumes y == 1\n",
    "    y = 1\n",
    "    return 1 / np.log(2) * np.log(1 + np.exp(-y * fx))\n",
    "\n",
    "zero_one_v = np.vectorize(zero_one)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAtAAAADwCAYAAAApZFODAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAD8oSURBVHhe7d0HnGNl2f7xG9SlSe9lWVY6i7C8KiBIF5feEREBAaW4gO7SZJEmig0Q0RVfmhRBehEQlqIUQQSkCQhIkwXpAqu05f3D//rl5OxkQzJJZpLMOSfX9/O5Nm12ksxkntx5zlPCzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMysU55Sdk/OdtVcyu+V15RnuGKIfE6ZosxQujQ0fqq8qPA4RnFFF6yjvK/MWLrUOYcq1yZnSz6qnKu8qvB851AeVHZWOmW4wn0tUbpkZmZmg/ZJ5bfKvxTeZJ9UeINfRekFQ1VAf1u5W6Gg6pZfK2cnZzNjdeUdZaHSpe6hgP5/SqcL6GpfUp5VZitdar8jlVuTs2ZWRN1utMzsw9ZV/qI8r1DI0Bs2WrlO2VaxzllSeVj5v9Kl3rWU8pLyQunSwAwrn+YBz5cPqW+WLnXGB+VTMzMz64BHlDOTs/36qvI35XXlAWUXJTVC4VD4bsr9yn+VW5RFlbHK08q/lV8plcME+D/7K7cr/J97lRWV7RQeF/d1kTKrklpEuUCh2KLoP19ZWEnRw0pv+s+VVxS+5rtKf6p7oD+r8Ph5zE8oP1AqCzS+32TlDYWhF99T8DHllwr3yW0USTz/Wm5UppZDrz//L/05fkJJVQ8zSHsXj1A4YsBz5Oda2SHBz/03SvoY71H4UMRQAu7vXeU/Cve7mFJ9H5wepDyqMLzkTmUjJZV+PR+w+Brugw9clb+HfZXHFW7j53GGUstRytsKHyJ4TLzGMKdyisJzoLi+WllGSaU/B34XzykMgajlI8p45SGF58vvi+eG6h5oLt+m8DNleAW/o5WVFMMgeBzclv4drKlgJeUmhZ8Xr5u7lKUV8Fh5PYHXJz//9xQeD98P1a/B5ZUrFH52fE/+Rvi94hsKPyd+trwGOKIwj4IvK+n3T3/HPMZar61m/qa57j6F78NjWE4xMzPrafSE8Sa5QelSfRRKvFnTW00BzNfz5ryFgvTNlnGe8yoUvBQ3FMEUnxSW9LZSCOygpPg/f1UWVxjGQGFM0XW6wveYv3z5EAUUOhTZFIcfV+gt5/9QrKSFOQUKBdn2CtfRq07RSHFUT2XxwmOhmN9P4THxuCnOTlDweYWiLi1mGMe8WnI2vqbwfOYuXYpYQKFwrad6OAU/Rwq66gK6ssijGKNAGqfw+CjSKOh2VTCzQlF7mpI+Dooeij/UGsJRfR8HKBSaFI9cx++M+0yfC1/P7+4chd/D7MqfFL43eF3Ru0oRCH6XjLOuh8dePQb8SoUCltcAz4kx0nxN+mGKnwO/18MUPtzwNbXw4eYx5VOlS9P/vqqfNx+ceL1QdDO8gg8mfPhLh9jwuvtfhdcz+NnzOwPP/zsKrzm+HwU1jx2VBTSqL6PyNcjr5mXlGIWfL9+Tx58WyVsr/IzB7/XPCkOuUrW+f/Vrq9m/aT4Y8Xj4GfNh9o+KmZlZT1tD4U112dKl+iiMj0/OTnOiwgQ4pG+2fL8UPcu8IaeFLX6nVH4f/g89ZinevHk8vGGnTlIuSc6WChx6KimcUxQV/J9VS5eSIu6G5Ow09KCmvY61VBYvjEumCK60lUJRjbUVekTpka0u2uito3hdS2lmXPNAC2g+VFS6UJmYnC313lN81bv/ZgpoPvjQg1zpcoVecqRfn36IAL2i9PKCiWoU0HyIobhupLqAZiw0rw2ORqR4PjyvL5YuJT8HPsg0Qs8pBWct1c+7Gh9AeBzppEZ60ekVXqF0aXoU+/SYV/7uUq0W0Acq9Ag3i9cnP5tUvQKa55I+vmb/ptMedmyipH8HZjaE6jVaZtYdFIIUuBzG7w+9XAxlqEQRR29tijGXlWNYKaB4U68ci8l11QVV9f8BjytV+X94nBwepyhKcZme7crHwmHtSrXut556z3UWZT6FwuRghUKbVSM4bE+vNNIeyp8oDAPg8Pz/KO3W3/OjeKXXdDDjqvkZMPykUvXvGwwvSFU+Bu6fiXIUhBTGjLHncrO4f143lY+B5/NPpfIxcLk//L7owaUHuhlMpuVDHhP8GNbA/fM40g909Mzzc7hU4XXLkZL0NoZD4A8Kz5ke88qhR63gd8gHsXq2URhqwuuPx8mRAD5IVn5YbaTZv+nq3zF/B37vNhti/iM0G1q8YVJcNFo+i54+hjJU4hBy9WH3TuNx0CvI+NgUhQPXNSqmmsV9VPci8lwZFkJRDMaMc+ibAo0eSYYbcMifHjuGejAMgLHa9ORye7PSHvvK1Rkqe3mbQfFKAVavB5rH2Eit3zeXW/l98zPZWGFIz3EKQwzSYQeNpD3LlY+BYRUUd5W/50bPhd8XPaaVY6f7wxAF/iboYWaox0iF30damPJBjSKaITGsUMPtaS8uj3lPhZ89r40NFcacDwS/w3T8dDVeDxxx+JnCB0oeZ/r3mz7Oej+Xyg+ztX7HQ/E3bWYD4ALabOjtpXConSIn7X2iJ5E3ZcZggvG09CZyyJu/2/UVJgzS25pqpfdroBiKwXjkXyg8Rgpphi4wSY7l4NrhPIUhLUz+S8duM1HtVAWfURiiwfANJmpRoFGwMBRgPYWxqvw/xudyWys9wfSm0+vJWGoKRgp5CrZWXKVQ6DHcguIVjEWmxxH0nPKc+mt/+X0zjIAx0DwOhk1QDKc/g0YoWPn69EMFRwwo3vgZNYPHyFACilN6eOn1/LHCOOx0iEGzmEzKOPx0DDQftviAUwtDg3isfJDhgxkfhiqLTsaC8zvhtU5vbDpZDwxDST/spL/39LZWMcSG4vhohR50flfpGOh0TDTj3vn+FNrVhTo/P/6WZypd6lP5N5qVv2kzGwAX0GZD72aFSVW8+VOgUkCwksYY5WIFnFLIUZRRnNH7xRjnyt7VykKjWa3+H4qxzRQKA3oKOcxNO7Kl0t/3anQ/lbfTA/cFhSEHHCJnPDVDMdKJjBQwFFbcxs+CYpcxqKxjTLFH7zTFDbczXpoxya1gHDWFON+bQqrZojXF46AY4nGmKywwtITiC4zTBb2zFOy1hu/w/Phgwu+d53KQwjhiJnA2gwlnTO5Lh0IwpIUPZIzzbRZfT08sH474nfAhgKEyFK6tOFyhWKQHnMKY13a9CY0UlHxY4OtYcYLfeyU+UDBEg7+Rfyj8jvjZgN8Zfz/8X35ODLGg6G9W5WuQIUy8dj6t8DPjd8VcgHSCKAUzwzaYBMiYds5XYmItX8dQH37H6dyEyvvo1N+0mZmZmZmZmZmZmZmZmZmZmZmZmZmZmZmZ1cHsbtaXZVJIfwv7p1i6iEkxTNBhkgiTSCqX9jIzyzO2KmeiKG0ck+quUSq31a6FNblZGSNdSYPTvRUzMyso1gyliGYZoWYKaGaHs8UqSzIxu/56hZ3CzMyKgOXZ0k4B1rQer7A8W39Lq7HNNEu/mZlZj2m0tSxY35PlvCq3uV1J4bpGO8qZmeUNyxZ+S6FtTNe2roUCmjW7zcysxzRTQG+hvJWcnQ7rv7JGrplZEWyisEYxnQNsTMJ60v2hgGb7eNauflhhA5XKXR3NzArBuxx9GAU0C/WzkxlvGrV8ReGNZOHSpT4c3uQwJzupVeLnzLbCjAk0s2xiZ0U2vvDmFR/GnA92+mNjlku4og52GGT7dMZNf1I5S2FDkR2Vam4XzbLNbaK1pBM90OwwxwvQcZxsJ90K2j6MgjctjJvFbn5sqV69pTXcLjpO9uM2sQ73QH9YMz3QjIFme1dmpD/IFcJ5trwdodBLU2kO5Y3JkyfHHHNwtjsmTJgQxx57bPlSdxT5PvfdVy2JmpJDD/XPtpOG4j6nTJkSw4cP5yyT5lg5wj6MiYSsUsQW35dyRRMooNmKnYaPDoZKbhc7yPfZOb1wn24TrRX0ONNL8gWFHuhZy5frfci4UrlWYULNfAqrcFym1MK7wwdvvPHGB900bty48rnuKfJ97rnnBx8cdlhy3j/bzhmK++Rvk7/R8t+qJfZXFkjOxvzKKQpLdi7IFTXwtWMU2k6MUu5SLipd+jC3ix3k++ycXrhPt4mNNVqqrZfQq/K2wlqn+K/CMI21FD6GMU5vTSXF17+iPKH8Q3leYYygFdRHP6pPVny0MusNLO15v0Lbd59Cgfx55UUF1e3izAorcDyn0GNFhwK9z19VzMwKxQV0Hya78PP4SDnpeTZXmawwmP42JcVYQCYTMrmGtaB3UTJ1mGPMGDqDuqvI9/kRvRr+j3UIxD/bzhmK+7SaNleYKE3bxzjIrRSGqaWq28VnlNUU2kN6rZZRDlXeVDLDf0ed4/vsnKG4T+ufx0B3B28mb0hXx/pZe41nfRU54YTk1IqD8X5zzlnaM8Tj/brH7aJZRrlNbMw90GZNquyBNjMzs97lAtqsSR4DbWZmZnABbdYk90CbmZkZXECbNck90GZmZgYX0GZNcg+0mZmZwQW0WZPcA21mZmZwAW3WJApo90CbmZmZC2izJnkIh5mZmcEFtFmTPITDzMzM4ALarEnugTYzMzO4gDZrknugzczMDC6gzZrkHmgzMzODC2izJrkH2szMzOAC2qxJ7oG2HnOE8rjyuvKSco2ystKfuZRzFf7Pv5VzlDkVM7NCcQFt1iT3QFuP+a3yKYWieBHlemWSMoNSD8Xz/MpIZSllIeUsxcysUFxAmzXJPdDWY/6hvJGcDb36432F4ngerqhhcWVjZbzymkIP9AHKFspiSk1PPVU+Y2aWIy6gzZrkHmjrQZsoFMNvK8cpJyivKrWMVt5RHixdSjygTFW4raYtVF4/+2z5gplZTriANmsSBbR7oK3H/F6ZW6HXmd7kO5R65lDSHutKjIfmtprWXTdigw0iXnyxfIWZWQ64gDZrEkM43ANtPYoi+CTldOWTXFHDFKXWhEHGUHNbTbPNNiFmnHF8jBo1Pi66iCHWZjYUJk2aFOPHjy9lwoQJ5Wutnv4mg1j7lHpmJOaYo25HjGWc2hY1LBEPPVS+wgpjypQpMeecpdqPf+oWez3uowo9zDsrl3JFFcZAM6KZlTrSYRycv0cZoVQP1JjWLs466xzxpS9FPP10xA03qOKm5DazIeM2sTH3QJs1yZMIrcfsryyQnC1NHvyl8q5yG1fU8IzCkA/GSs+rzFc+/zul31HODI8677yIhRaK2GSTiP/8p3yDmVlGuYA2a5InEVqP2VC5X6GcvU+hmP68ko5WHq5w25qlSwl6p19RnlBYxeN5ZVeloWHDIi6+mCEdEZttFvHWW+UbzMwyyAX09I5WnlN4U7hJGaXU82nlDwpLNbHJwCUKhzCtoNwDbT1mc2VhZXZlUWUrheEYqckKt1X2SDNW+isKgzCYfLiL0vTh35lnjrj88uT8Vrq3d1jTw8wsg1xA9zlI+apCrwuHHm9XmNEyq1KNseNXK2mvDJsGUFqx8YAVlHugLWNmUvZQaIv4EP9e+ZRhFF9XVI7mDz3QV12VDOPYbruIqSyCZ2aWMS6g++yj/ER5WGGc3+HKx5StlWoMqqfI/rVC4fymcrZSd61Tyz/3QFuGMCzin8qeyt0K7RebmHB6p0Jh/bRCD3DuzD57xDXXRLzwQpQmF77HRwMzswxxAZ1gNvgSyl2lSwn6GulhXqV0aXocppyo0Mszi8LhSnqvGcZhBeUeaMuQbZUvKKspRyq0PTeUT49SVle4na/LJVbiuO66iCefjNhpJ394NbNscQGdSNeWozCuxA5c9dadu1hhQg3j+5g0wzAONhqwgnIPtGUI22Ozy19/uH3L5Gw+zTNPsqzdww9H7LqrP8CaWXa4gE6kk1yqVx9lEkytCTBLKdcrP1MYI81EGsYh/lmhR9oKyD3QlhO0T3ygL4T55ou48caIe+6J2GOPiPffL99gZjaEvJFKnyeVE5RflC5FfERhCaZxyrlcUWEbhR25KLBTFNFsMsAh1cqhIChtGDB27NgYxlpNMmbMmFIsPx55JOJTn4p4kxHvlnvsukUwderUmDiRUVm53DTgjHL+pHxJob36QGFJuSxPbJ62kUozG0w9r9aYbb/XWivilFMiZnT3j1nHeCOVxlxA9zlQ2VfZVKGYPkJhOaZlleoVSVmu7u/KNxUmEjLZ8BBlvMJtFNKVWnqjsGx6/PGIFVf00lpFlPM3Cz7oL6nQTv1FYfMSngOToldSsqrldvG55yLWWSdigw0iTj7ZRbRZp7iAbszNTx/edM5UmIjzsvJZZSOFN6XqDQPYcYuxhbsrfC1rR6+nUHxXF89WEAzh8BhoyyCGkdFOcRRsGYWJhHStF25d+kUXjfjjHyOuvz5iv/0iPqCf3cxsCLiAnh6z19k44OPKuspDCmptGEChvYYyj8K2tXw9h1CtoJhEyBhov2lbxvAhfnmFD/x3KIwSnk0p5Ct1+PCkiL766ohvftN/j2Y2NPJYQBdy8wDLPnqg4UlMljEnKqwFzRG0X3KFrK2kHQCFM2JExE03RVxxRcS4cS6izaz78lZAF3rzAMs2eqDhYRyWMUx8XlkZpVzJFfKEsndytpiWWCIpoi+9NGL8eBfRZtZdeSugC795gGVX2gPtpewsgx5X6DwAy9hxZO7B0qUCGzkyKaIv0TvAAQe4iDaz7slbAd0TmwdYNrkH2jKKJew+l5wtLWP3qPIPZUeuKLpPfCIZE33xxS6izax7ijSJsFCbB1j2uAfaMophbPckZ0vr1lNEsyLQoVzRC5Zcsq+I9nAOM+uGPBfQPd3rYt3nHmjLqE4tY/cDhSN6LM3JUp3nKYsp/blJeVdh3ViW/uS0K2OxKaLTMdGeWGhmnZbnArrne12su9wDbRnVqWXs+D5M3GaZTr4/3y+dpFgPX/NDhZ1RKOg5/ZXSFQznoIi+/PKI/fd3EW1mnZPnArpnNg+wbHAPtGVUp5axO0y5V+EVT0/yjxV2NixtT9aPId3hNp1YeKVK/X339bKTZtYZeS6ge2rzABt6M6gsYOtg90BbxnRrGbsxCsuINtptlWVFX1UeVhgGQrvcVSxxd/PNEddcowejR+Mi2szaLc8FdM9tHmBDz9t5W0b9S1lVOVD5osKY5XYuY/d55XBlr9Kl+hhCt7TCsI8dFIru05SuY7MViugbb4z4+tddRJtZew3pobY2YOUNypl0/VOGcgxTsrb+KeMA35CYYw7OWl7NOmvEfffphcYrzQpjypQpMeecpZEJ/MNwhTzh1ch6+LMo9BAzjI2JfBS9TK4erM2UcxTGQ/+OK1pApwaPjaF2PKZKpXZx7NixMWwYzbaq7TFjSmmn5/RRYv31I1ZfPeKMM/qGYpnZ9CZNmlQKpk6dGhMnTuRsHtvErsh7AV2JYpqD60+VLmWLC+iC4Nd3xx0RK6xQvsIKIecF9NXKY8pBCh0KlIiMV2aI2ybKYOykMERke4VCuFVpAU3D9w5XVOhau/j88xEbbBAxenTE2Wf3TQg2s9py3iZ2RZ6HcHgZO+s6eq88hMMy5jMKQyfSVyYdCd9RuH4w9lV+rtAD3UzxvIBC9zETvMGY7OOVK5Tq4rmrFl44mVj44IN6s9C7xdSp5RvMzAYozwW0l7GzrqPnypMILWMYGsEQiUq1hky06iSFCYDXKPRApes6r6lguMJ16eWZle8qjL/m6y5TKLy/qgy5BVTes9nKU09FbLedKvohLenNLO/yXEB7GTvrOvdAWwZR4J6vrKjQLn5S+Y3ye2UweH+YSWF8BaGt5fQ2BZMVrksvP6Ospsyt8HW0y3RovKlkwrzzJpMKX3opYsst9QbCO4iZ2QDkuYD2MnbWde6Btgxi7DOlILsG0iN8n0Lv88GKVZlrrojrrkuK50031Q+Mn5iZWYvyXEB7GTvrOvdAWwaxLvPmyiLK6sqi5cuvK1YDcxavvTb5QMyiH6/7J2VmLcpzAd2tzQPMpnEPtGXYC8pd5VNrYLbZkt0KGdbBCh2vvFK+wcysCXlfxo7xfswQZ9wz4+9Yzikz4+0qMB7Qy9gVAOs/n3xy8oZrxZHDJZuYrNeMI8qnWZSJdpEVOXbeOVmh4/rrIxahH9+sx3kZu8by3APNBJVHFFb6ZgUOeqS5vKxi1hHugbaMWKuJpMt8Wj/Yw+W88yJWXTVi7bUjnk635TIz60eeC+ifKqy8sbDy6fLphQrXm3WEx0BbRqzXRNZXrAn8XZ9+esRGG+mThz56PNqO/RvNrNDyXEB3avMAs7rcA21WTDPq3fDnP0+Gc1BEs2W/mVk9eS6gO7V5gFldFNDugTYrphlmiDj22Ijx4yPWXTfitnSFazOzKnkuoDu1eYBZXR7CYVZ83/52xA9/mAzpmMT2XGZmVfJcQFdvHnC/MlU5RBmooxW2oeX73aSwRF5/2KKW+/+vwtJRrE1tBeYhHGa9Ye+9I045JWKbbSIuuqh8pZlZWZ4L6OrNAzhlSbvXlIGgIKcg3lCZT7ldoe+B3u1aDlAOV1h3mjWYRips6mIF5h5os96x444RF14YsdtuEaeeWr7SzEzytg50J9c+fVI5QWE5PKhUin8p45VzuaICY625bQelmSEjXge6IFj/eZddInbdtXyFFULO1zzdWfmbUjntbRVlBaW67cqS3LSLt94asfnmEYceGnHwwclYabMi8zrQjeWtB7pyjdN6Gcjap7TeSyjs4pXiQD1vSLwRVVtDoWd6OeUxheEbjMleSbECcw+0ZdCRSvXug88rDEmzNmBVjptuijjhhIiDDop4//3yDWbWs/JWQNda67Q6A1n7NO3+eL18mmI4SK2uEYZ40AexpbK2MkJhDPa1SvXKIFYgHgNtGbSAUl1Ac3nB5Ky1w+jRyaocl14asfvuEe+9V77BzHpSnsdAt1N6eGKu8mlqbqXWoYv0uu8rvFGxdN4EhUMd9E7XNGHChBg/fnwpkzy1O5fcA10c/A2mf4/8beYYvc3szFqJyy8lZwfsBwqTpJlvwuTq85TFlP7QhjJshM6IfyvnKKXjwEWw1FJJEX3vvRFbbx3xFtPYzawneSRXn1pjoHljGqdUjyPkTeQZZSPlOq4Qvp7CehulujrOzVg/6x9vmuuvH7HffuUrrBByPt7ve8rnlX0UhpRRPE9UblbYbGqg6CC4WGF8NUPWTlYYV11rWFvqauVjCvNDeH+5QHlT2Uqpltt28XV9PNhyy+TD9JVXRswzT/kGs4LwGOjG3APd55fKgQpL182i8KZEz/JlSrVnFa6n24rDpzMpxyj0uHjp/QJzD7RlEG3V48pfFd7oOH1KaXbSdT2HKfcqvOL5vj9WmOdRr0d5cWVjhYnXDH+jPWS1oi2URj3XuTLXXBHXXqvGX60/46MnTy7fYGY9wwV0n+MUlqG7QXlZ+axCDzMH6YYrrA29ppJiHQbetB5RKKhHK2MU1oS2gvIYaMugd5SvKPMrqyl8qN9JeVtpJ9q3fyoM6aiFNpDH8mDpUoIhIKzPz22FMsssyfrQn/tcxBprRDz0UPkGM+sJLqCnd5SysPJxZV0lbRLpX2ByYGXvMoXy1xQO3vHGtYnysGIF5q28LSPoHU7R00y+qdDbu3/Fde3CEBHWvd+rdKm20pCM5Ox0GA9dyLFrtAe/+lXEHnskPdEsd2dmvaFoY6B5Pixld0vpUnbkdqyfTY/1n5dZRtVLZfliuZfD8X6sP8+HdvyxfFrtA2UgqxJVY4MqJgNy1O13XFEHxfv5SvXmU/RKb6dcVbrUp9Qujh07NoYNG1a6YsyYMaXkERutjBsXcdZZEdtuW77SLEeYWJ0ucDB16tSYOJGpFB4DXU/RCmjGIjPkggl9WeICuiDoaVp88YgjWXnXCsMTZupiKAgTq7dXGN7WH8ZAM/Z6ZSUdxsH5exSW+mSoW6XCtYtMKPzylyO+//2I/TkOYJZTbhMby+MQDh5zvVA4e2UR6xhPIrQesq/yc4Ue6EbFM1iZiJ5x5pPMq7BePufpta4unguJ3Qpv0E/qmGMiDjzQG66YFRlFZ96wfH29MNGPw5ZmHeFJhJZB9XqHWAVjME5SZlPYZZX7oH3lNJ1MXWtyNduKv6I8ofxDYSnQntr4frXVIv7854grrojYcceIdxjAYmaFk8cCOp28x9i+6rCEklnHuAfaMqhTR914f2BYHOMrCBOpOU0nU9eaXM2EQVYEYUMVNqLaRem5w79suHL77RHPPBOx4YYRr75avsHMCiOPBTRbZjPOmU0CasVDOKxj3ANtGZKutMHGJen5NEzmY8k5GyLzzx/xhz8ka0V/9rMRT9Anb2aFkccCmmmh9Q5NMoxjt+SsWfu5B9oyhBWHiD7WTTtPGFLBx7w9FBtCrBV94YXJ2OjVV0+GdphZMeSxgGZr2OuTsx/ClI2zkrNm7eceaMuQ9co5teI82UBh9QxWv7Ahxofu44+POOqoZDjHBbyDmVnu5bGArqVQ28RadrkH2jJon/JpaillZHLWsmLs2KR4/vrXk2XuPvB0d7NcK0oB7R0ArSvcA20ZdIbyueRsfEl5VGEFjB25wrJj002T3QrZvXC33SLefbd8g5nlTlEKaE8ctK5wD7RlEKsPpcM1xikU0SrV4lCusGxZeeWIO++MeOihZEjHKyz6Z2a5U5QC2qwr3ANtGcTW2axMxJJyyyiXKOzHy86AlkELLxxx880RCy6YrBv9sI+hmuVOUQrovcqnZh1FAe0eaMuYl5XllY2UOxQmU7MBikfZZtis+tjDmGi2/maZu2uvLd9gZrlQlAL6vPKpWUd5CIdl0InK3cqZyi+5QtZWHkrOWlbNqHdgtv0++eSI7bbTL1K/SU8uNMuHvBbQHLJkmabjlFPKp1zmerOO8RAOy6BfKCsro5QruULYtmPv5KxlHb3QbLry4x9HfO1rnlxolgd5LKB5k3hMOUH5pMLWspz+VGH2ObebdYR7oC0jDiufgp0H2TJ79/J5wnbaX1QsJ1ZdNeKuuyIeeCBi/fUjXnihfIOZZVIeC2h2IjxbWUQZozDjnNOFld8o3G7WEe6Btoxgt8FU5S6ElUmXtrOcWHTRiFtuiRg5MuIzn4m4m4E5ZpZJeSygP6UcrVSXMVym5+XTpUtmHeAeaMuITcqnqNyFsDLrK5YzbP99zjkR++8fse66yXkzy548FtBTlCWTsx/yCeU/yVmz9nMPtPWQHZRblDcUXvWN3i9uUhi9SxtNO8ypx2EPwAwzRBx0UMQll0R885sR48ZFvPde+UYzy4Q8FtCnKdco+yqrKcuWT7l8tfK/illHuAfaMogVN2plVWVBZaD+rTAk7lulS42xfsQPFealsCY1p79SbIDGjEnGRd9wQ7LpyksvlW8wsyGXxwL6SIVZ5+OVPyt/L59ymeuPUsw6wj3QlkH0/P6xfJqGy6wJ/S/lemUghTT/7wLlydKl5nhX2DZbckm9wekdjk1XPvWpZBdDMxt6eSyg8ROF4RpzKey2xSmXWc7OrGPcA20ZxIobLF/HakT0/HJ6hbKbwpwR2nnWiu6GfZRXFfbW+4HChi42SB//eMT55yfDOdZbL+LUU8s3mNmQyWsBnWKM3bPlU7OOcw+0ZRCTp3dV2DjlzfIpS9ododyncNu6SqcdqiytzKswfprVkRhyZ23AuOgDD4y46qqIww6L2GOPiLffLt9oZl2XtwKaN4PNlXqHCbl+S+Xe0qXWsbrHcwoTYDgM2sya0vT4PK00M8nGco4C2j3QljEUrNX713GZ60Gb9vHkbEcxZOT15Gz8TWHs9LbKTFxh7UEP9D33RPz97xFrrBHxZCsDbMysbfJW8I1VGOM8WTlLOUjZs3zKNrbPKPS6MKGwVXyPryobKvMptyuTlEa7G3JolHHY1gMYwuEeaMuYmxUWO2NC9SzKcgrtIZ0AGK0wFnqo9DsuesKECTF+/PhSJk2iybVGFltMv1z9dtdeOxkXfQUDdswGib+/9G+Rv0vrX14nfLDG6TYKaz7PozBb/K/KpcoflIHgczy7GzIRESqVSm86TE48lytqoDf8OwqHLplw8zHlfaUas9HfkJhjDs5aXl17bXIY9cEHy1dYIUyZMiXmnHNOzvJP3oaELaD8VqFdpOeZdp1JhF9WXlQ4ksbzolOgFXSw0Kato7DyEUfb+Pg4Vanu8eYxrKLcqrylcJ8U8Ryd216pxe1iG1x0UTKcY6+9Io49Vr8wfmNmg5TzNrEr8jrkgDeH/ZTPKvS6cEqv80CLZ1rvJZS7SpcSvFEwZIQ3hVo4PPpzhV5r90n2CE8itAxicbMNlOEKbSGnXKZ4BmOiWy2esbPCKFuKZ/xXoThml0Pug6Fu6Y6IMyuMxWa4CG+2lyk3KLSP1kHb6+MJOxbSeb+OPupM5vismXWcx+wm0u6PdPxe6jWlXtfILxXWnPbwjR7iSYSWUQw1o5hl/ec1lHasfsEwOd4jOBpH0vNsrkKZRo/0bQoYPsd6/HMrtJnLKByZY1Kjddgy+mn/5S8Ro0ZFjB6dTDQ0s85yAZ1ID0+wHF4l3gxqHbr4ksKyeT8qXeobCpPXITHWJPdAWwZRrD6isOkJbROnXObonPUItgBnebuTTor48pcjDjggYiqDbcysI1zw9ak1Bvp5ZZxSPQb618p2yjulS8k4QXpdXlHUbJUm9FTitjfGjh0bw4YNK10xZsyYUixfbr9dFYpKlGfob7NcY8JMOmltqiqNiROpO3M53o8dWB9TmAjNxzvarh8ryyubKFlVahc9Brr9HtOrYYcdkvHQv/1tshmLWSs8BroxF9B9DlQYR72pQjHNah5sUEAvDuP+KvGCqjxEyiFTduwaobCJQPXqnH6jKAgOk269dcS/hnJNA2u7nL9ZMAaaDaXSD/RgNQ4+5s1fupRNbhc76B29Gg45JOLMMyNOPjnplTZrlgvoxjyEow+7GDJrnIkvLytMxtlIoXiunjDzhkIJlYavB+e9tH2BeQy0ZdC7CuORK3GZ661HzTxzxM9+FnHOORH77x+xyy4UReUbzWzQXEBPjzWmF1bYdICdu5i9juoJM9VYh5XDprWWsLMC8RhoyyBWyThfWVFhMiFbef9G+b1iPW6LLSIeeCA5arbKKhF3sN2NmQ1akQto1mg2ayv3QFsGMfaZI2Uqk0pHylh+k97ngxWzWGSRiOuui9h774j11484+mh3BJgNVlEKaPZhYg3oNKwTzYRAs7ZyD7RlEEPK6DBQmRSrK4uWL1cvy2k9bEa92x+kj1q33RZxwQXJLoaPP16+0cxaVpQC+mRFn6unhR25jlHM2so90JZhLyhsBsWpWU0M4/jrXyM+85nk/CmnRHxQva+kmTVUlFU4WL+5ureFVTKysoi/Z5sXxFNPJZsWvPde+QorhBzOOGfXv2awmlBWuV0cYtdfH7HbbhErrRRx2mnJUA8zeBWOxorSA13rUKV3wLK28xAOywi2026UzylmdW24YcTf/hYx77wRK64Ycd557o02a1YR14FmVy42FcgS97QUBDPZF100GcbBmEIrBve2DAm3ixly2WURe+2lT1362MW60QsuWL7BepLbxMaKWAIwicasI+iBhnuhzaxI2CDqoYeS3QtXWMG90WaNFLGA9u6K1jFMIoQnEtoQY6k6Vtqo195x/ZbKvaVLZk2Yf/5khQ4mFo4bF7HVVhHPPVe+0cymU8QC2p+ZrWPcA20ZMVZh4yc2eTpLYS3oPcun7KjKNt5MINxXMWvJttsmvdGMrBk1KuLUU90bbVbNozjNWuAeaMsIdkX9lLKzwvjEbZQDyqf/VXZVuL3e7qlm/ZpvvmQbcIZyHHNMxHrrRTyWtdlFZkPIQzjMWuAeaMsYNo3aT/mssmz5lF5nNpQarB2UWxQ2auEjY6P3C5YTPVdhVaR/Kyq/ShOQLMc22STpjWapu9GjI773vYipU8s3mvWwIhbQl5dPzdrOPdDWQyiCJyrfKl1qjOJ5fmWkspSykMLwEsu52WePOOkkfVrTx7WLLkoK6VtvLd9o1qOKWEDTW2LWEe6Bth5yvXKB8mTpUv8WVzZWxiuvKRTfDCnZQllMsQJYbbWIu+9ONl/ZWL9tTl9+uXyjWY/xGGizFrD28wwzuAfarMpo5R3lwdKlxAMKB/u5zQqCZe4OOigZ1vGaPiotu2zE//6v20TrPUUqoFn2fQNlXcUbklrHMIzDPdBm0yltipKcnQ7job1LSgGNGBFx+eXJRMMf/Shi9dUj7ryzfKNZDyjKhLv9lf9RnlU4yL6EQu/HD5Qs8I5bBTLLLHpx6dW19NLlKyz3Crjr1nbK/co/SpcGZx2FSYkfU97nihoYqnG+MmvpUh96pXksV5UuTa/ULo4dOzaGDRtWumLMmDGlWL68/XbEj3+cZIcd9Mard17vZJg/kyZNKgVTp06NiROZAuGdCOspSgG9ocJ4vUq1rhsqLqALhAk19LQsv3z5Csu9AhbQ31EoeHmVvqtQADPJbyDrJzRTQDMG+illZSUdxsH5e5QRCp0b1dwuFszTT0eMHx9x440RRxwRsd9+oQ9H5RstV7yVd2NFGcKxprKVQi/0SspGymqKWdsxkdBDOCzj/qYcqXxR+Z3ygsImK63g/WGmcjCzwvlaHS9s3PJ75ThlXmW+8nnuu1bxbAW0xBIRl16a5MwzI1ZcUS8AvQK8CYsVUVEK6J8oiypfVdiNiyEcP1PM2o4x0J4wYxlHycKOhLSHrA99jXKT0go2aXlb4f+CDVreUtZShiv/Uei8SPH1ryhPKAwdeV5hQxfrMRtsEHHvvcl24HvsEbHhhhH3sfm8WYHkrYDmOB+9zNXeVG5QWJmSTQR+pdC4m7Wde6AtB+j5PVShoD1DoVf4G0orWMOZ9wjmlZD0PJursIX47ErlTodMGPyKwoYqcyu7KD7026PoaNhnH32S0kepVVaJWGONZNm7Z308wgoibwW0PtPGXcrXS5emR48Hq3BsVrpk1iHugbYcmEdhGNuflX8pryo7KWZdNZc+Tv3kJ8myd+++myx7d6g+2r3Oxy2zHMtbAc3j3UShd6Uak1v2Vhj3Z9Yx7oG2HGDoxgLKjxQmVJsNqZEjI847L+Lmm5NJ2EsuGXHccckKHmZ5lLcCmjVVHlVeLF36MMZBj0rOmnWGe6AtB1j94hSFYRQMpzDLhE9/OuKGG5JimrAcKBuxvPde+QvMciJvBfSJygkK6zuzNFK19ZV2rHtqVpd7oC0HWIX3mwoTCKvXZjYbUuzmynLfbAt+gt7Rf/rTiOWWizj7bLetlh95K6D509peYTb4XxR6WY5XKJx5Lp9RWK90oI5WnlOYgMiM9Xq92fMrzHB/UmGSDKfHKl7xsge4B9py4ByFiX5jlYe5wixrZtS79he/GPHgg8m60UfrHXiU3nXPPddtrGVf3gpo8Gf1fYWF+7+nMBP8VIWeZxb8Z9LMQLBGKsvgMV6QNUxvV9iSp1bvzceVRxQmLbIyyOeVTZUfKlZw7oG2DGPIBkPZcKlCm8SwN7PMolNi1131pqp31YMPjjjssKSQ/s1v3NZaduWxgE6xoxZvEEyWWVLZUWH7bg5ZDsQ+CutJ01vDzl2HK+y8tbVSjR23eGPiFPRAs1TUeqVLVmjugbYMY+fBbykXKBydYzdAttI2y7yP6R2XdaMfeyzioIOSXml2fD39dLaWLn+RWUbkuYCudqfCQv53ly61hl5kNl9hibwUJRJLv69SutTYFxSGlFjBUUC7V8QyirWfOZq2g8JOgKzE4Ver5Qrbf6eFNEU0y+AttVTEz34W8Sa7PphlQJEK6FS6a1YrKKBRvTLla0p6W3/orR5dPrWC8xAOy4B6m0qBo3DMFWEnQDZDIWa5Q2fFzjsna0gz0fCccyJGjEjGSr/CFkFmQ6iIBfRApLtlsYNWJZZ/arST1jHK1xTGX7NhQV0TJkyI8ePHlzJpEsOrLY88hKMY+BtM/x7528yZZjaV2rx0ySzn6LTYdlu94PWKP//8iNtvTwrpsWMjHn+8/EVmXTZD+dSSccwskfeL0iX9zSr04IxTzuWKGliXmkmHvFkx470eeovekJhjjmY6tC3L1l47Yq+9Inbyvm6FMWXKlJhzzjk5yz952H6a+RdsHMUws3rr4lNgszJRVrldtAG7T6/844+PuOiiiI02ivjWtyLWWSdZIs8GL4dtYte5B7rPL5UDFZaum0VhhQ8mE16mVKO4pqhWKRVrKf0Vz1Yw7oG2DPCmUtbTRo9OhnTQA81Ew222iVhllYgzzvDuhtYdLqD7MOGGtZ1vUF5WPqvoc228pQxXWBt6TQWcfklh9Q8Ol/LpjNv9Ka0HeAy0ZYA3lTKTxRbTH4H+Cp59NuIb30jGSg/XO/Yhh0Q8la6TZdYBLqCnd5SysMI6z+sqDymgh5n1pm8rXYq4RaEXmjWiOfZIuN3HIXuAe6AtA/gI18lNpcxyZVa9G++5Z8QDDyTDOp54ItndcLPNIq66ym22tZ8LaLMWuQfaMoKSoBObSlVrdodWcDtD3yqPyjFW26wrGAO93noRF18c8eST+iSpj5J76xU4cmTEUUdFTPaAS2sTF9BmLXIPtGVMuzeVqtTKDq34QGGTqcqjcr9SzLpu0UUjjjwy4umnI37xi4i//lV/IPoL2XjjpJf6XT7qmQ2QC2izFrkH2jJuMJtKVWtlh9aU10GwTKHTY4stIq68MumVXmutiEMPjVhkkYj99ksK6w/46GfWAhfQZi1yD7TlxEA2lapE7/FAdmil6H5VoehmkuNsilkmMOmQZd//8Y+Iyy+PeOutiHXXjRg1KpmM+M9/lr/QrAEX0GYtooB2D7T1gHRSdCs7tLKV+NLKvArbiY9RTlPMMoWx0vREn356xIsvRhx+eMStt+rFq1cv1598csTLrMdlVocPtXUHbzbeMKAgdtklmd2dv83rrB5vGlATjRXFM0t6stJHijHQf1NYN78R1spnaVDGQ1ePOC21i2PHjo1hw4aVrhgzZkwpZkPlpZciLrww2fHwL3rVMyFxB30U3GorfSrkY2GBsTtrukvy1KlTY+JElpt3m1iPC+jucAFdILvvHrHEEhFHHFG+wnLPBXRdA9mhtVJaQNPwvcMVFdwuWqY980xSTDPh8J57kmKaLcUpphdcsPxFBeU2sTEP4TBrkScRWg9pZYfWBRS6j9MVOvg/rE19hVJdPJtl3uKL68WvVz890ex4yOodZ5+drO7xuc8lW4kzltp6kwtosxZ5EqH1kFZ2aJ1Z+a7CmtH0WFFk8/9YBs8s10aMiBg3LuK225JdD3feWS9uvbpXXDFihRUiDj44GUPtzpXe4SEc3eFDlQWy774Rs80W8aMfla+w3PPhyiHhdtFy7z/6CMmw4auvTvLeexFf+ELEJpskpwuzt3EOuU1szD3QZi1yD7SZmWH22SO22y7i17+OeP75pJhefvkI5t+xZN7KKye90/RWv/12+T9ZIbiANmuRx0CbmVk13htWXTXZMvzOO5Pl8b797YhXXonYbbeIueeO2GCDiGOPjbjjDr+P5J0LaLMWuQfazMwamW++iB13jDjjjGRFj/vvT1bxYOfDTTdNCmomJv7whxG3387SceX/aLngAtqsRe6BNjOzVrBxy7LLRnzjGxGXXJJs0vKnPyUF9F13RWy5ZQRDjtkV8bDDIq65JuI1tiyyzHIBbdYi90CbmdlgzKjqi/HR+++fFNRs4MJa0zvtFPHcc8n1bNzCCh/sPXDKKUkPtjtvssMFtFmL3ANtZmbtRA81kw+//vWIM89M1pdmDDXDOxZaKNkZkbWnWbCGU5bUO/fciEcecYfOUHEBbdYi90CbmVmnzT9/xBZbJJMO//CHiNdfj7j77oivfS3pxPn5zyNWWSUZ+kFRzRKrp5+efM073rqo47wOdHd4vdMCYf3nBx5IPv1bMXjN0yHhdtFskCik//73ZPjHffdF3HtvMtSD9amXWSZipZUiPvnJZMOXUaMiRo5MjqI24jaxMRfQ3eE3igI57rhk0scFF5SvsNzzm8WQcLto1gEffBAxeXLS0UMefDDioYeSQpvimaEilWFy49JLR8w0U/kbiNvExlxAd4ffKArkxBOT2dMXX1y+wnLPbxZDwu2iWRfRW/34433FNGEM9aOPJpu8sF05vdYU08OHT4lDDnGb2B+PgTZrkScRmplZ3jB/Z7nlkrWov/OdZBgia1Iz3OOf/4w49dRkzDVfd+ON5f9kdbmANmuRJxGamVlRsAII246zSyLrVP/0pxEXXVS+0epyAW3WIvdAm5mZ9TYX0GYtcg+0mZlZb3MBPb2jleeU/yg3KaOUeuZSWMjsdeXfyjlKacS9FZt7oK3HuF00M6viArrPQcpXlQ2V+ZTblUnKrEotvEnMr4xUllIWUs5SMmPSJB5+d/XCfdID/fLL/tl2ylDcp9XldrENfJ+d4/u0oeICus8+yk+Uh5V3lcOVjylbK9UWVzZWxiuvKfS0HKBsoSymZIIbls6gB/rVV/2z7ZShuE+ry+1iG/g+O8f3aUPFBXSCRUiXUO4qXUowyvU+ZZXSpemNVtgo88HSpcQDylSF26zA6IFmoXqzgnO7aGZWhzdSSdA78oyyvPIoV5Sdr7CA+J6lS32+otArs3DpUp8XFHpfzitd6lPaMGDy5Mld3TBgwoQJcSyb6HdRL9znVVdF7LHHhNh99+4+z9tumxBrrun77ISpU6fEaacN56w3DejjdrFNfJ+d4/vsDDaXGj7cbaI1Ruv9vrJa6VIfjpkcl5ydDock30rOTofel82Ss9NZVKHP0nGcbIe/VUu4XXQcx21iHe6B7vOkcoLyi9KliI8ozyvjFCbGVGKs31PKykp6uJLz9ygjlGe5ogI/50UUZrGbWTbNrvxL4U3DEm4XzXqX20RryoHK0wpLNM2i/ECZrNSbbX6lcq0yr8Ls9OuVyxQzs6Jwu2hmZg0dpdC78l+lcr1TBgLRS7Jm6VKC9U5/o7DeKTPOz1a6N5DPzKw73C6amZmZmZmZmWXNzsqflFeVl5U/KGsojbSy41e1lZTfK/QUMfFnfaWRIxX21GOGLffJafW4xv4M5D4xmOeJ7ZS/K28qDym11qStNJDnOVS7r7Vyv9zO2ryVz2tvpVk7KLcobygsT9ZoWct2PM9W73OwzxEMO2A5Ne6Tny2rQTRal9g76rWf28X+uV2srZttInqhXXSbaJnF5gPs3DWbwqSbbyq8wJkwUw87fv1TWUGZSWG9Gibd1BtrWG05ZQ/lfxT+AJt9o+CPdqAGcp+DfZ6sCPC2spXCz3YbhZn/PIZ6Wn2erT7Gq5XrlLmVeRTGfV6utKrV+/2jwpvLQPEapeHeTWmm0W7H82z1Pgf7HPF9hXWLP6ownIA3gXuV/rTrd2p93C7W53axtm63ieiFdtFtouUK4wG3TM7WxGz3fZOzJTSCLyo7lS61ppWelsG8UVRq9j4H+zzPUC5Jzk5zqXJqcramVp9nK4+RlQd47iuWLiXogeK6Vndfa/VnQyP63eTsoKyjNGq02/k80cx9ol3PsRIrQ3Df9XpP2v1crT63iwm3i7UNVZuIXmoX3SYOQKNfkrUHvQP0utxfuvRhfAJsZcevduL70yCx/BSfQnkcndKO58mOZncmZ6fh+zX6/80+z1YfY7t2Xxvoz4ZePQ6Js9Uyh+V4nXXCUO4y1+7nOEahV4vDl7UM5XPtJW4XE24Xa8t6m4ihbCva+TzdJg6AC+jW/FrhExd/xJxWhzF91Zipzs5dvMBZDqoWGgowtqgSvTObK3zvVu6zWRcpHBpbUGEsIms93qAwc57v3e77bMfz5HvU+v/p966l3vOsdRiwv8dY6z64rlajw//v7zFVa/V+caiytMKSYRz+oxE8TemEdj3PVrX7OX5eOVzZq3SptqF6rnnldjGJ28U+XDfYv6FW7xPdbBPRjuc5EO18nm4TrStoWBj7Uy8sOl5pKYVDULxJ9IcXII1hrR2/TlRq3Vea6vsE36uZw4bVhimMo9tUqXVfaQZ6n+14nmzKcEhydhoak7uTs01JnycNR7X+HmM7dl+rp9X7rWVthR4Bxgq2opnDhu16nqlmD1VWG+hzBI+TN1+eS3/a/VyLzu1iEreLfdrxNzSUbSJ6oV10m2iZxPggdvCZULrUWK2xXi8pnRzrVy1tQJnQ0Kpm73Owz5OxfhcnZ6dpNNavWqPn2cpjZGwYDV7l2LB0PFmrY8MG+7NJG9GZS5ea10yj3c7nicG+UbT6HPkZ8kZRqzio1u7nan3cLtbmdrG2oWoTUfR20W2iZRKHwxibtH/pUnNa3fGrFj598gdEo80hHS7T4NSzvcIhIHAYj0OUNFitjKVq9T4H+zzpjeCTMBOPmEG8rcKyTf3NNm/1eQ7V7mut3O8CCj/v9Db+D2MFOSzbLBppfl9fUGgI+V5crrfFfzueZyv32Y7nCN6AWXapcsOPRryjXvu5XazP7WJt3W4T0QvtottEyyzGpVWur5mu0/htJcVg/MrLqLfjVzNGKDTW/PFV5gglVX2fVyhMIOH+aJSYRPIJpVkDuU8M5nmCNwfWO+UNgwkULN1UqR3Pc6h2X2v2fukR+IvC/fHaekzhzaWVN/ldlcrfX3qe3oxOPc9W7rMdzxHcR7pmavo3yWl6P53+nVrC7WIft4vN62abiF5oF/n+bhPNzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMza46PKiOSsmZmJ20UzM6trRmWCMnPpUvMWUvZOzpqZFYrbRTMzm2Z+5STlMmUVrpBvKCsmZ1s2Rtk+OWtmlktuF83MrF8/UXZVvqLModC78ltlMC5ShiVnzcxyx+2imZn16x7lE8nZks2V8cnZAdtPcW+LmeWV20UzYdySWa+hx4Rxd5cq83GFfFVJ3wQWUY5RRipfUlZXsIFyV3J2mrWUXZRfKlso+yjnK/X8SdkoOWtmlhluF83MrF/0dHC48H5lKa4Q3jS2Ts6WMLbvj8nZaS5Wlk/OlsypbJecjQOVkxV6Zn7GFXUwfvCO5KyZWWa4XTQzs37NroxSKhvslxUa8dTOChNlKl2rVB66pMcmPYpzgbJJcnaaBZWxydlpWOrpkeSsmVlmuF00a4GHcFgv+o+ylZJOfPmk8qrCm0WK6/6WnJ2G2+dOzpa8o7yfnI21lVuTs6WJNXhRmZicnWZWZUpy1swsM9wumrXABbT1qgWUR5OzsbGSNvKplZQHkrPT8PWLJWdLmDyzp7KmQuPPG9A8Ct+PQ52HKksrlRhb+Gxy1swsU9wumjXJBbT1qnMU1h9lOaavKUxiqcShzOqeFg5V0qOSotFfRllOYU1Uvs82Coct6ZUZrrykVPq0Uj2G0MwsC9wumplZUz6i0KgzwzzFGL3bkrMfwkxy/k8jcym/UnizqFTrOjOzLHG7aNaAe6CtF62hpD0r7KB1rvIvZVHlSWVVhd6SWk5UWNqpkfSQJIcuUwsrHM6cXLpkZpYdbhfNWtDMJ0azouF1/zGFpZdoyA9XPlBmUehx4brjlXQiTCUaf95Q+B6vcEUd/1ZuUZgwgxmUA5QfKFO5wswsQ9wumplZ5jA5h/VRzcws4XbRzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMzMKkT8f70+3UbZeulqAAAAAElFTkSuQmCC\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plot_loss_functions(suptitle = 'Common loss functions for classification',\n",
    "                   functions = [zero_one_v(x), logistic_loss(x)],\n",
    "                   ylabels    = ['$\\mathcal{L}_{0-1}}$ (0-1 loss)',\n",
    "                                 '$\\mathcal{L}_{log}$ (logistic loss)'],\n",
    "                   xlabel     = '$y f(x_i)$')\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Строим нейросеть\n",
    "Рассмотрим решение нашей задачи при помощи простейшей однослойной нейросети такого вида:\n",
    "<img src=\"https://raw.githubusercontent.com/shwars/NeuroWorkshop/master/images/NeuroArch.PNG\" width=\"50%\"/>\n",
    "\n",
    "При этом модель будет описываться как\n",
    "$$\n",
    "f_\\theta(x) = W\\times x + b\n",
    "$$\n",
    "где параметры $$\\theta = <W,b>$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "### Cross-Entropy Loss\n",
    "\n",
    "* Повсеместно применяется в глубоком обучении\n",
    "* Основная идея:\n",
    "    - трактуем выход модели как распределение вероятностей появления того или иного класса\n",
    "    - минимизируем вероятность неправильной классификации\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Переходим к вероятностям\n",
    "Расширяем нейросетевую модель с помощью функции **softmax**: $\\sigma(\\mathbf{z}_c) = \\frac{e^{z_c}}{\\sum_{j \\in J} e^{z_j}}$ для  $c \\in 1 .. |C|$\n",
    "\n",
    "<img src=\"https://raw.githubusercontent.com/shwars/NeuroWorkshop/master/images/NeuroArch-softmax.PNG\" width=\"50%\">\n",
    "\n",
    "Можем рассматривать $\\sigma(\\mathbf{z})$ как распределение вероятности на классах $C$: $q = \\sigma(\\mathbf{z}_c) = \\hat{p}(c | x)$\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Ещё один взгляд на архитектуру сети\n",
    "\n",
    "![Архитектура нейросети](https://raw.githubusercontent.com/shwars/NeuroWorkshop/master/images/Cross-Entropy-Loss.PNG)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Cross-Entropy Loss\n",
    "\n",
    "Два подхода к пониманию Cross-Entropy Loss:\n",
    "  * Цена ошибки, которую мы платим за неправильную классификацию, т.е. $-\\log p_y$, где $y$ - правильный класс\n",
    "  * Разница между двумя распределениями вероятностей. Энтропия $p$ + KL-расстояние между $q$ и $p$:\n",
    "$\\begin{align} H(p, q) = & ~\\color{red}{H(p)} + \\color{blue}{D_{KL}(p||q)} \\\\\n",
    "    = & ~\\color{red}{-\\sum_{c \\in C} p(c) \\log p(c)} + \\color{blue}{\\sum_{c \\in C} p(c) \\log \\frac{p(c)}{q(c)}} \\\\\n",
    "    = & ~-\\sum_{c \\in C} p(c) \\log q(c)\n",
    "\\end{align}$\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "def plot_cross_ent():\n",
    "    p = np.linspace(0.01, 0.99, 101) # estimated probability p(y|x)\n",
    "    cross_ent_v = np.vectorize(cross_ent)\n",
    "    f3, ax = pylab.subplots(1,1, figsize=(8, 3))\n",
    "    l1, = pylab.plot(p, cross_ent_v(p, 1), 'r--')\n",
    "    l2, = pylab.plot(p, cross_ent_v(p, 0), 'r-')\n",
    "    pylab.legend([l1, l2], ['$y = 1$', '$y = 0$'], loc = 'upper center', ncol = 2)\n",
    "    pylab.xlabel('$\\hat{p}(y|x)$', size=18)\n",
    "    pylab.ylabel('$\\mathcal{L}_{CE}$', size=18)\n",
    "    pylab.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "scrolled": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAoAAAADwCAYAAACQcNXLAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAACySSURBVHhe7d0HnFTV2cfxR5SiaETECkRRYxdEMdgRRVexoFFiNLHENyFGLAnGV0UD2FsCKhJL0GjUWGIsEVDAGBWwooiCvrYgQREUbIjAqvA+/znnyrjMLjs7s7NTft/P58nMvTtg2Dtz73/OOfccAwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAFDiBnt97fW514L4eKcXAAAAypQC4FPhKQAAQPlpFh8BAABQIQiAmXX1mus1w0vdv5t6AQAAoExt69UxPLWNvO7wettrDe0AAAAodavER9SuhddnXod6PaYdafT729hLN4sAAIDSsZbXbK9lqa0KQwBcuSQAHuY1XjvStPd6LzwFAAAlpoPX++FpZSEArqiv1+Ne87028LrKa0+vHbwWeqX7ntdns2bNsu99T0/RlAYOHGiXXnpp3EJT4lgUF45H8eBYFIfPP//cOnZMjfZaW5t6UmkIgCt6yGtXr9Zen3hpSpjfe/3Hq6ZUAHQEwCIwYMAAGzp0aNxCU+JYFBeOR/HgWBQHBcC111b2q9wAyF3AK+rjpZa/Nb309eCnXpnCHwAAQEkiAKJsVFVVxWdoahyL4sLxKB4cCxQLuoBzQxcwAAAlhi5gWgABAAAqDi2AuaEFEHmxePFiq66ujlsA6tKiRQtr1apV3AKyRwsgATBXBEDkTOGvU6dONmfOnLgHQF023HBDmzFjBiEQDUYAJADmigCInCUnIuaTBFZOnxfN38Z5F7kgABIAc0UARM6SExHvI2Dl+LwgHwiA3AQCAABQcQiAAAAAFYYACAAAUGEIgAAAoHy98ILZxIlxAwkCYL6NGGF29tlxAwAANKlbbjF76KG4gQQBMN90V9GECXEDQCGMGTPG+vbtG7dQCr766iv73e9+Z1dccYVdfPHFdsYZZ9jXX38dfwrk0csvm+24Y9xAggCYb126mL3yitnSpXEHgMbykH+rP/PMM+3qq6+2+fPnx70oBYMGDUqFwLPPPtvOP/98a9asWeo5kFfffGP26qvh2ozvIADm29Zb66ut2TvvxB0AGkufPn3sj3/8o+2xxx5xD0qBlj28/vrr7cc//nHcY6kW3FtvvdWWLVsW9wB5oGuxWpa32iruQIIAmG/Nm5ttt53Z1KlxBwAg3VQ/Py5YsMA222yzuMds0003tU8++cSmTJkS9wB5oGuxrsm6NuM7CICNQWMNNOYAqGBq4RkyZEiqqy/x+OOP22GHHRa3UKwa+9hp2UNp3bp16lHWWmut1OPs2bNTj0BeMP6vViwFl5vMS8HdeafOYmZnnRV3ALXLemmrJUtCZaIL6qqrxo00GgezcGHcqKFly1B5NGHCBP+/uMSWLl1q55xzjr300kup/Rrov2jRIrvppptS2xoD1r9//28H/9fs/ltllVVS+/R47LHHWq9eveJPvuuCCy6wJ598MhVSipb+bQsWxI1GohDlv6tcFOLY3ennyOOPPz7197Vo0SK1T93CrVq1Sv3smGOOSe3LhKXgkJVDDjE74ACz00+POwKWgkOudPZZ5iciP88BDaP3T1bvo8GDdanNXNOmxRfVoP2ZXq/S35dnEydOTD36RX7ZkCFDUs+lS5cuy+666664lT/6b/Ts2TNuFSkd30y//3xWHs5FhTh2o0aNWtasWbNlHjTjnmXL5s+fv8zD4rL7778/7sks688LKluHDsuWPfFE3FgueR/F63hFogUwN3rj+PuIb6JouHJsAZQvvvjCNthgA5s2bZp16tQpNb5rvfXWs/fffz+1P59oAYzy0AIojX3sNM6vW7duNmfOnNTfKzNnzkz9t1544QXbeeedU/syoQUQ9aaZAdq1M38Dm7VpE3cGtAASAHNFAETOyvWCNnbsWDvttNPszTffTG1rypaBAwfa9OnTU9tSsxsxE/+ynrEbMV1JBMAS0tjHTt3LCpKjR4+2H/7wh6l9mstRr/vwww+/7RbOhACIetP54KSTzN59N+5YjgBIAMwVARA5K9cL2gMPPGCXXHKJTZ48ObWtcV3rrruuXXfddantfNINC0899RQBME8KcexOP/10a9mypV111VWpbY0JbN++vV122WWp7doQAFFvQ4eanxjMHnww7liOAMhdwAAaSe/evW3LLbe04cOH2zXXXGOjRo2yfffdN/40P8aNG2f9+vWzkSNH2rPPPms/+9nPUnewIjeFOHYKegpxCppqwV1nnXXswgsvjD8F8kBTwDABdK1oAcwNLYDIWbm2aOjfE79hp1qSDjzwwNT0H6uvvnpqH4pXMR87WgBRb5r+ZfBgsyOOiDuWowWQFsDGo0Gn+sZcXR13AJVDY8fatWtnb7zxRmqsmMaTafoQwl/x49ihLOja+9prtADWgRbA3NTeAqi1gHXX0YQJvAFRp3Js0dAqD+eee6517tw5FSj2339/q6qqij9FMSv2Y0cLIOpF3b977WX26admzVZs66IFkACYq9oDoOy5p1m/fhrdHHcAK+KCBtQfnxfUy223mY0cGRphMiAA0gXcuDT+gDWBAQAoLG4AWSkCYGPSm481gQEAKCzWAF4pAuDKPeC11Cv7ORAUAPUtRCsAAACAxqdrLi2AK0UArJsG7+nWt4YluO23N9MyR599FncAAIBG9f774eYPXYNRKwJg7Tp4aVbSX3g17GaZNdYwe/31FdYgBAAAjUTdv1ttZcbURXUiANbuZq+LvN5LbQEAgOJH92+9EAAzOyU+KgQCAIBSwQ0g9cI8gCvazGuiV3evWdrhdBNIL6+aK82n5gHs37+/tWjRIrVDE6Yy4S2ykcxHpaW2mNcMqJs+Lx07dmQeQNRuyy3Nrr3W7MAD445g7NixqZLq6mobMWKEnjIRNL51gteNXnpDJL+fdb10J8c9XidrR5QKgJyIkIvFixdbp06dbM6cOXEPgLpsuOGGNmPGDGvVqlXcA0RffOFXZr8ez56tN0rcuSImgiYAZqIzStvw9FsaB3i013ivT7UjIgAiLxQC9Y0UwMqpx4Xwh4yeecbs8MPN5s6NOzIjABIA6+sbr/29MnYBrzQA3nxz+EbSt2/cAQAA8m7YMLPx483GjIk7MiMAchNIfa3qVTP81d/ixWZhrAEAAGgsDz5odsghcQN1IQAWQp8+ZhMnms2bF3cAAIC8+ugjs0mTwjUXK0UALIQOHcx22sns4YfjDgAAkFe6xu68s1n79nEH6kIALJQjjjB7QMsKAwCAvNM1Vtda1AsBsFD0phw3LtyiDgAA8kfXVt38QQCsNwJgoWy9tdkBB5jNnBl3AACAvHj0UbNOncIawKgXAmAh/fOfZtttFzcAAEBe0P2bNQIgAAAoXZpEf/ToMAE06o0ACAAAStcTT5ituaZZt25xB+qDAAgAAEqXun/V+teMSJMNflsAAKA0LV1q9tBDdP82AAGwqehNCwAAGu7558Nyqz16xB2oLwJgUzj/fLPzzosbAACgQdT9q7V/mzePO1BfBMCmoGXhWBUEAICGW7Zs+fg/ZI0A2BSqqsKE0NOnxx0AACAruobOmhWuqcgaAbAptG5tdtRRZiNGxB0AACAruob27RuuqcjaKvERDfM9r8+cfe97epqFl14y22uv8O2lbdu4EwAArNT8+WYdO5pNmmTWtWvcWX+ff/65rb322nqq//lcTyoNLYBNReMAd9nF7Kab4g4AAFAvunZ2796g8IeAANiU/vAHs9694wYAAFgpLf02fLjZb38bd6AhCIBNScvWdO4cNwAAwErde28Y96fpX9BgBEAAAFAaNPXLsGFmv/mNJxgiTC747QEAgNLw1FNmM2aYnXhi3IGGIgACAIDSoNa/fv2Y+iUPCIAAAKD4vf222SOPmJ16atyBXBAAi8X48WZXXhk3AADAd1x7bVhEoUOHuAO5IAAWizZtzC68MExuCQAAltO18ZZbmPoljwiAxUKTQu+9t9kFF8QdAAAgZcgQsx49wvRpyAuWgstNw5eCy+T118MKIVombptt4k4AACrYa6+Z7byz2ZQpZltvHXfmhqXgaAEsLgp9v/yl2Zlnxh0AAFQ4XRN152+ewh8CAuCKBnm97fWp14dej3h18SqMwYPNnn023OkEAEAl07XwuefCtRF5RQBc0V1eO3u18drYa7zXWK/CdJevu67ZffeF5m4AACrVV1+ZDRgQxsa3bRt3Il8IgCt6y+uz8NRW9VrqtZ5X4d59++5rtv76cQMAgAp0ww3h8eSTwyPyigCYWW+vT7wWef3Ba6gX87MAAFAIH38cun2H+uW3efO4E/lEAMxsjNc6Xmr10x0Zz3oBAIBCULdv9+5mBx0UdyDfmAZm5fQ7UmvgXl6vakea/E4DAwBApXv+ebN99jGbPNls223jzvxiGhgCYH2s5qUxgcd53a8daVIBsH///taiRYvUjqqqqlTl1Zw5/l/y/9Qaa8QdAACUoYULzbp2NTvpJLNzzok782Ps2LGpkurqahsxYoSeEgDxrdO97vbSFDC6+eMSr6O8NDPzXK90hWkBPPxws/btzd+tcQcAAGXolFPMXn3V7IknzFbVfZiNgxZAxgBmsr/XVK8FXi976XbcXl41w1/hDBtmdvvtzA0IAChfusbdcYfZX//aqOEPQbm0AD7oNSPWjV5LvAqhMC2A8pe/mA0caDZtWpgrEACAcjFvntkOO5hdeqnZz38edzYeWgDLJwBO8drdS9O2JDp6Hek12WuidjSCwgXAZcvMfvSj8K3o73/3I0fvPQCgDOj6dqQu1+4f/yjI9Y0AWD5dwKO90sOfzPK62su/UtgE7Shp+kDcdJNHWc+yah4HAKAc6Jr29NNmN95I40YBlUsA/DI+buJ1kZcmbz7QS4MIrvcqj3fUeuuFruA2WqUOAIASN3Wq2amnmt1yS7jGoWDK7SaQmV6DvDRxkFoAk+nDG6sLuPA0KWafPnEDAIAS9eGHZocdZnb22Wa9tQAXCqlcAqDG/20fntoyL3X5TvdarB1Od/QCAIBiUF0dxv3ttpvZeefFnSikcgmA+3jpRhDN3fd3r128OnklFAoBAEBT000fmu/vyy9D1y/j/ppEuQTAq7w0eODXXvO8dOPHO15veQ33UiAEAABN7dprzUaNMnvwQVa4akLlErvX8qrZzasbQjSpsyZxPthLr8m3wk0DU5e//S0Mnt1f/1wAAIrUuHFmRxxh9q9/me26a9xZeEwDUz4tgJnG+OmGkJFeP/G6RjvK1jffhLEUzz0XdwAAUGR0jTrqKLMbbmjS8IegHAKgpnr5vdcBXi21I4N742N5Ou44s4suCncIv/JK3AkAQJHQdC8HHmh28cXhmoUmVw4B8BuvUV73eD3glfSDpi8kWP6p6IwzzM48M3QDv/FG3AkAQBPTNUnXprPOMjv99LgTTa1cuoD38NraSxMJjdcOpzGAnoqsfWqrEmit4JNOMuvVy+zdd+NOAACaiK5Fuib9z/+EaxSKRrkEQHX9zg1Pv/UfL439O9SrCe/QKCDdSq+FtE880WwBUx8CAJrQ7Nlm++1ndvjh4dqEolIuAbCuO3z/7NU3PK0ACoEaD7iDZsIBAKAJzJhhtvfeZj16mF1zDXP9FaFyCYDrx8dMNEZw9fAUAAA0qunTzfbYIyzvNnKkJ41yiRrlpVyOykteJ4WnGa0ZHwEAQGPRVC9q+fvVr0LLH+GvaJXLkbnV6xSvE1JbK9oiPla2t9+OTwAAyLPHHgt3+w4ZYjZ4MN2+Ra5cAuDXXsd4Xew1wet4r229NBDuT15aFq6yqUm+SxezezRbDgAAeXT33WZ9+vgV1y+5p50Wd6KYlVPbrNb91dTic7xu9nrVa4qX7hC+0quybbed2X33mfXrF76ZLV0afwAAQAPpWjJoUOjy1TXmZz+LP0CxK9f22XW9Nvd6z2u2djSS4lgLOBtqCTz0ULOddjK77Taz1q3jDwAAyMLChWYnnGA2ZYrZww+bbauOt9LAWsDl1QIoLeLjfK/nvRoz/JUmtQQ+77+ajz4y22svs/ffjz8AAKCeZs0K15B588KNHyUU/hCUQgBczavKS6t8rKzF8givf3ltkNpCZu3amY0fb3bwwWarM0MOACALEyea7bKLWbduZuPGhWsKSk4pBMBHvMZ4Pex1gXbU4T6vJV7/9mLql7q0aBEmjG7bNu4AAKAOGu93+eVmVVVmv/+92Y03hmsJSlIpBECt86s7Fh71Wlla0aTPaim80+t87QAAADlSV+8hh5jddJPZk0+a9e/PNC8lrhQC4Bte/lXDDvY6VTvq4Quvn4anyBp3CAMAEpMmmXXtGoYMvfRS6PpFySuFAHiL17LwtN46ezEooaGOPDJM5PnVV3EHAKDi6Bqga8EBB5iddVaY5qVNm/hDlLpSaL/VTSBPeo32Gua1yGtl/uulyaE3S201ntKbBqY+dEv/8cebtWxpdvvtZttsE38AAKgIr70WrgNLloTrwI47xh+UB6aBKY0WQAW5I72O9prldamXVviozVZeHbyeTW0he2rqnzzZbL/9QlP/MM/ddAsDQPnTuX7o0HCXr64BuhaUWfhDUAoBULS6x25eurnjTK+XvbSw7XVeCodreSV2jo/j4iMaQq1/V1xhNnas/5b917zvvmaLF8cfAgDKzptvmvXsaTZiRDj36xqgawHKUqkEQPnS6wyvLbwu91L39Sle93p95KUu4l5eG3tpzODjXg1xmdcrXp95aZbkv3mpRbEy7bmn2dSpZiedZNaqVdwJACgb1dVmF18cen86dw7nfJ37UdZK/R7urb0U+vb12s9Lc//N89L6Zg2dB/ASL80nqLWE1/C63ktTnPsnYwXlOQYQAFAZnn7a7Je/NFtttTDFS/fu8QfljTGApdUCmMn/eakb+EdeuutXj697qQVwU6+GOM9ripfGHupNcaWX7ipOvVMAACh58+ebnXyy2f77h5s9NNavQsIfglIPgOk0Z8lDXvt4qWv4Bq980DJ0M73UJYya7r7b7Prrzb7RHNwAgKL29ddmf/qT2Q9+ENbzfeUVs7PPNmvePL4AlaKcAmC6271+E57mRN3LmoT6V6ktrEhrQOou4Z12CrPDAwCK0xNPhHP11VeHqV1GjzbbfPP4Q1Qa1nGp3SFeCpIneP1TOzJIjQHs37+/tYjrIVZVVaWqomgA8TXXhLWF9W+/7DKzLXSvDgCgyb39ttm554Y7e7WG7xlnVOQavmP936+Sar9ujdDdzhU8BpAAmJmWkdPYwr5ej2lHLbgJJN0HH5gNHhy+Wd5xR1hRBADQND780OzCC81uvtnsuOPMLrjAbKON4g8rGzeBlG8XcC603vBwL7UA1hX+UJNOLLqL7MUXzXr0iDsBAAW1cGHokVFPjMb56ZysczPhD2loAVyRlrzQDSVLUlvhd6S7ig/ymqQdaWgBBAAUh0WLwk15msB5s83MrrqK+fxqQQsgLYCZ6Heiqc+V6FRaZUSPNcMfGuKFF8LakgCA/NAqTcOHh9Cn4Tfq8tX8foQ/1IEAiMJZtsxswIDQLaHBt/q2CgBoGJ1DdS7VlC5//nOY3kXdvYccYrYKHXyoGwEQhaMTkqaK0ULjGo/SqZPZlVeaLVgQXwAAWKnPPw/nTp1DFfx0Tn35ZbMjjiD4od4IgCisZv6W69s3nKxGjjR74AGzTTYxe+aZ+AIAQEbz5oWZFnTOfPDB0NU7ZUo4p+rcCmSBdwyahr6lqptC41T+8Y+wADkAYEVvvmn261+bff/74cuyvjhPmmR28MG0+KHBCIBoWjp59exp1rp13AEASI2ZnjjR7PDDwxdkTe2i8DdunNk++xD8kDMCIIrbpZea3XpruMsNAMqdznU653XrFnpJttoqrOTx17+adekSXwTkjgCI4rbhhmGwc8eOZuedZ/bee/EHAFBGdG7TOU7nOp3zfvGLsE9z+nXoEF8E5A8BEMXtpJPMpk83u/tus2nTwjxX6hJ59tn4AgAoUUuXmj36aDin6dymc5zOdTrnaczfmmvGFwL5RwBE8dNYl/32M3vooTAYevvtzebMiT8EgBIzd67Z5ZeHOVF//vNwTtO5Tec4nesY34cC4F2WG5aCAwCs3Ndfh9a+W24xGz3abO+9zU4+2eyww8yaN48vQqGwFBwtgCg3EyaYnXuu2VtvxR0A0IR0LtI5SVO4qFt3u+3MXn/dbPx4syOPJPyhyRAAUV40nYzumFOXyu67m91wg9nHH8cfAkAB6Jyjc4/OQToX6Zyklr933zW76KIw3g9oYgRAlJeddjL7+9/NPvjA7LjjzG67zWyjjcx+/GOzb76JLwKAPFuyJKzOcdRR4Zyjc8/xx4dzkc5JBx5otuqq8cVA02MMYG4YA1gKNLhaE6rqjmIAyBd9qXziCbO77jK77z6ztm3Njj02BL8tt4wvQjFiDCABMFcEwHLw3/+GebZYSxPAymjqFk1Dde+9obR99NFmxxxj1r07d/CWCAIgXcBAmG1fi6sPGBBO7FqCCQASOifo3KBzhM4VOmd88UVYsUOTNV9zjdmuuxL+UFIIgMCLL5r9+c9mn35qdtBB4W69M84I+wFUJnXvPvmk2emnh3OCzg06R+hcoXn8Ro40O+AAs9VWi38AKC18XckNXcDlprra7N//Nrv/frOuXcM8XQAqg9bhffzxcDOHSi16WqXjRz8y69nTrEWL+EKUOrqACYC5IgBWInUHqSVgnXXiDgAl65NPwsTMCnyaqLldO7M+fcIcfXvswZ27ZYoASADMFQGwEr3xRpjbSxcHjQVSbbUV43+AUqAvcPoMjxoVatIksx12CC19Cn6dO/NZrgAEQAJgrgiAlWrWrOUXkH/9y6xjR7ODDzY77TSzzTePLwJQFNS1+9RTZmPGhM+sbtzQmrvJFzh9flFRCIAEwFwRAGG2cGEIgepGUgBU6yCApqVVNx55JIQ+jetbd91wI4cC3777hlWDULEIgATAXBEAUT9qMXzlFbMePczWXDPuBJA3mpZFkzKPHRtqxgyzPfcMoa9377AGL127iAiABMBcEQBRP2oh7NcvBEGNHdx//1Bauo5B5kD2NE2Lpmp67DGz8ePDWD5N11JVFaZn0V27nJdRCwIgATBXBEBkR4vC62Kli5a6pdQioYtYp07xBQAy0s0bWtZRn5vk8yPqztWXqV69zLbYIuwDVoIASADMFQEQDacWjMmTzXbZJfMydPo5rYOoZDNnhnk5FfZU8+aFFvQk9O28M58RNAgBkACYKwIgGs+wYWbDh5vts8/yUhcXUK60LrfG8SWlIRP6gqTAp7t2d9vNrFWr+GKg4QiABMBcEQDReDSoXeOadCFUK4haCzt0CDeSXHutn7ZSJy+gNKlLV0MiND2LSsuuaXoWBb7kC49a+7hpCo2AAEgAzORor/5eXbx05mnutdQrEwIgCmfBArNnnjF7+mmzQYMydxsDxUpDGnQn/MSJZhMmhMf58826dzfbe+9QauFba634B4DGQwAkAGayv1dbrzW8RnoRAFE6brjB7IEHQsuJ6oc/5IKKpqEvLM8/H1qxVfryopuedt89TM+iUvijSxdNgABIAKxLDy/dZkYAROlQl5rWM9UFVy2F6lLr0iVcdC+/nO40NA5152rePYW8pJV66tQwZEFfRJLQpyXXuGkDRYAASACsCwEQpU8BUBfjF14wu+IKuo2RHxqfqjGpzz4bSqHvk0/MunYN3bgKfCoFQKAIEQAJgHUhAKIyDB1qduutZrvuGrrk1G287ba01CDQ2L3XXgvduc89FwLf9OlmG20U3jMqhT5Nar766vEPAcWNAEgArAsBEJXhww/DgHxd2HWR18TU6tLTBf3BB83aakgsKkLSlavWPbUaJ+8Hjd3TnHv6cpB8UWjfPv4hoPQQAAmAdal3AOzfv7+1aNEitaOqqipVQMlSi8///V8IAccfHy7+NSk0Ll5s1rFj5p+j+CnsaZ49BTwd66R080bnzmbdui1vEd56a1qEUfLGjh2bKqmurrYRI0boKQEQ39IgKYU+BcBHvHQLpV8RrdrLz5jfQQsgKtPIkWYnn2y2zjqhZSgptRpusgmhsNgo7L37rtlLL4VS6FNp3J66+3XsNP+eSuGvZcv4B4HyRAsgATCTE7z+4pWEPf2O9Lyn11PakYYAiMq1aFG40zMJEwoWGhum1sPNN48vQsGpBVdr5k6Zsrx0bNSyt/324UaNJLDrDnHG7aECEQAJgLkiAALp1C2s1qNMLYAaT/YX/261444heGhKkNat4w/RIAsXmr36agjiL78cwp4mWxa15Ol3nbTMKvzRsgekEAAJgLkiAAL1pTtJFQCTsKKF/X/wgxAGL7wwjDNDZurC1Tq5Cncq/Q5Vb71l1q7d8lCt1j3VllsyZg+oAwGQAJgrAiDQEAo0c+YsD4PHHZf5rlJ1W6qFS61XlfIZ8wuTTZsW/t0Ke8mj5t5TSFbLXtK6p9C34YaZW1wB1IoASADMFQEQaEwau9a7t9ncuWabbhqCoLqO9dizZ5iLrlQtWWL2xhsh7CWBT4+6WUOhTv9OlcKeHnWzBsumAXlBACQA5ooACBSCpp1JglISls491+yww+ILavj6a7PVVosbTeyrr0JXrbrA9f9dN8roUft0A0Z6qE1q/fXjHwbQGAiABMBcEQCBYqOxhRtvHMbBbbddaDlLSmMO45ydeacWPYW6118PYU9BT4+6I1dhVN236SFP/9++/326b4EmQAAkAOaKAAgUm6VLQzdqEsCSRwWz3/zG7JJL4gsbSOMS1XWrvy+93n47dNFus00oBU6FPJXmRuSmDKBoEAAJgLkiAAKlQsFQrXS1zXunFS/atAktdVttFe6uVevcRx+FwKf5DRX03nsvLI+XBL0k7Kk6dDBrprnkARQzAiABMFcEQKCUaR49ddGqtESUWgvVejh/fphQWTbYwOzYY0MwVCnwrbde+BmAkkQAJADmigAIFDvdhDFjRgh5GqOXBD616r3/vn+K/bOrFr+kkhbALbYIf94vFKkQmMmJJ4b5+fR6jTlUaZxhp05mzbWiJIBiRAAkAOaKAAgUA931qyCmgFez1KKn8XcKdApnSUhLAp9a8xp6I8bkyWEeQ/13koCpsYCa0/Cdd+KLABQbAiABMFcEQKBQ1JKnMKeApVLASgKXWvg0ubRa3tJDXlIdOxbuJgx1HetO5NpaDQcNMrvnnuWBVI8qrZ+82WbcLAIUAAGQAJgrAiCQT1rt4j//CeEuqSTsqYVP4UghKQlMSYDSo6ZUKZa5/+oye3aYx1D/LgXY5N+of7cmvNaNKDUtWhSC5Zprxh0AckEAJADmigAIZEN34n7wQQg7SSkAJY+a8HmttUK4q1kKerrLtlxbyBTwavu3qcXwJz8JE0Trd6EQnDxWVYWVQwDUGwGQAJgrAiBQ06efhi7ZpBTukkd14VZXhyCn8JJUeqhZd92Gj8krV+re1p3J6WFZj6orrjDr3j2+MM3ixWZjxoRucVWmlkWgQhEACYC5IgCi8mgiZAW5pBTukkeVfx5snXXC2r1JwFMASR41KXLLlvEvQ6PRHc6HHhqOzSefhACoY6JjcMIJZn36xBcClYcASADMFQEQ5UcBbubMEBySx6S0rZYojUVTkFCgSEJFsq3HcGJFsVCrbHIMFdK7djXbZ5/4wxpOOy0sl6djqbCu0nOOKcoIAZAAmCsCIEqLxuBpnJ1uqFCYU6U/Vyks6P2cfvFPL+2jm7Z8XXddmCMxCfx6VKtv795mo0fHF9WgCbW1wgqroKBEEAAJgLkiAKK4fPml2axZIdRlKv1My6HpZoIk4Onu2eS5SiGP8WJIaPyhvhToDm1Np5PJ0UebPfRQ+LneT0np/aTJsgmGKDIEQAJgrgiAKBzNg6cpRBTikkpCXfJc3bOtWq14IdZ2EvB0A0Zt6+ECDaFpapL3oFoNk+eaD/Gf/4wvquGFF8z+/e/w3kxq441ZQQUFQQAkAOaKAIj8ULjT9Cjvvbe8kmCXPJ8zJ7xWF8n0i2Z6yNNju3Z0z6L4Pf642Y03Ln+f68uNaEqbUaPCOMWaNIRBVQrzPaKoEQAJgLkiAGLlNB2H7shUKcwlj+mlcKeuto02CkFOS4mlhzy12ulRP+fih3Kk5fz0JUhhcIcdwnyQNb32WviZQqI+E+nVq1fm0AhkQAAkAOaKAFjJFNg+/nh5uMtUCnfqllVoU6hLKgl1qmRbFzW6v4DaabLsZBhE8vlSabtv31CZDBwYph5K/wyq2raltbxCEQAJgLkiAJYrDXjXhSa9dMGp+Vw3VOgkUvPCkpS6axXy1l+fgfBAU7noojBpdvLFTOXnbTvgALOxY+OLatBk2+pu1me4deu4E+WCAEgAzBUBsNRougp1M6mSMJfpuZ8cUi0GOvmr2zUJc8lj8lzFxQEoPToX6IveBhvEHTWccorZzTeHlWt0fk/OBXq87bbyXZKwQhAACYC5IgAWA3XF6tt8EuxUGlOXBLr0UrBTN6tO5MnJPL2SfQp2Ws2C7iGgciXDPNK/IGoezf/93/iCGu6912zQoOXnl+R8ouEdGqNYW9hEwREACYC5IgA2Jt0ZO3duCHPplYS55LkedaOFpjZJP/FmKp2MmcQYQGPQ+erll5efo9Jr2DCzXXaJL0yjL6XnnhvOTwqK6aXAyLjgRkEAJADmigCYLQ3i1k0RCm1JuKv5mJTmEFNQ07Qm6SfF5ESZfsLUcx0Dgh2AUqJ1mi+/PITE9PPfRx+FlsYrrogvrOHRR0M3tEKizoH6Yku3dL0RAAmAuSIAikKdwpoCXG2lE5oe1X2igdX6femklZy89FjzG7D26eYJvgEDqDTqAVGtsUbcUcOxx5q9+GI4t6oVUeFvvfXM9tjD7L774otqUKjU+Vdfqis8LBIACYC5Kt8AqC5VhbUktGV6TErhT2Nl9DtQaEsPdbVtsxIFAOSHVmJJzseaT1EhMBO1KF51VZiRQCFQX7CTc7LWgNa455p0bi/DnhUCIAGwLhd4/cJLyc6/Zll/r+le6UonACZdrwpvKn0TTJ5nKn2j1Ide3yh1ktBjeoBLP3Ekz7UEGQCgeKV/uU+v3/428xfz8ePNjjoqnOdrlvZ36RJfWFoIgATA2pzldarXQV7veA32Ot5rS68vvRJNFwAV6HR3moJceumDnf482U5a6TS7fhLqVEmwS7b1PNlXYmNKxo4da1VVVXELTYljUVw4HsWj5I7Fl37J05yIuo4oKCbXFT0/4QSzvfaKL0yja81OO5m1afPdRgSVVnLJ9GcKjABIAKzNf7yGel2X2vIY5DXba4DXndoR5S8Aaq4phbQkvKU/z1QKfxrLoTnokg9W+ocseZ4Eu2R/GXe9DhgwwIYO1WFDU+NYFBeOR/GoiGOha5Mm2K7ZIKHHbt3MhgyJL6xBU+houb/kepWUrmH77htflB8EQAJgJkpyn3rt5vWcdkSaLv5Vr9+ltoLMAVDffj71v0IhLr305q/tUV2uojdk8qbXGI30D0Gmqm2AcAXiIlc8OBbFheNRPDgWdVBonDYtXBPTr49acUk3vGTy2GNmd965/HqZ/rj99pnXlHYEQAJgJh28/uu1jdcb2hHd7aU3Sb/UVpAKgLNmzVoeADWf0w03hG9AuntVb0KtN6lHlbpVta3HZDt9f4sW4e9B1gYOHGiXXnpp3EJT4lgUF45H8eBY5NnUqWZjxoReMY1zV2hU6fkdd2See9EpAHbUGuwEQKTJpgWwvdd74SkAACgxavR5PzytLATAzDKNAfzA67de6WMA9fvb2GtBagsAAJQK9Q9rfP+y1Bbg1Mr3rtd2Xrpr4jKvWV4MuAMAAChjuk1JrX5feD3hpTAIAAAAAAAAoNxoRRANENU4v5W1BLbx0hhB3UTysdftXqn7zJEX9T0W63nd6qWxnLq7S4+67Y5brPMrm89GQmNuNLziG69m2oG8yPZYnOj1ipd6OOZ4Xe2F/MjmWHTzetxL14sPvf7h9X0v5O5or6e8PvOqz/mG6ze+QyuCzPTa1qull0KE7vqtbSzgaK9xXlpQsa3XeK8HvZC7bI5FJ69z4qNs5jXVi8m38ifbz0biZq9HvAiA+ZPtsTjTSysc7e6lY6Bxzjt6IXfZHAvdRDjXS+el1bxae93jNckLudvfSyHw5171Od9w/cZ3qOVIS8IldDewPrA/TW19l761LfXaPrUVdPbSPt1mjtxkcywyOcNrSniKPGjI8TjUS1MraUp/AmD+ZHMs1AKrlqneqS3kWzbHQi1O+hzskNoKDvZaGJ4iT3p4rex8U5HXb07AtdN8gJt6vZDaCvQmetmra2rru/QNerHXtNRWoC6Wai++Xecm22ORyQFeL4WnyFFDjse6XsO91PWo1yI/sj0WavVTa9TWXm96qftXLbK62CE32R4LdTWO8Pqll1phFQj1+VA3MAqrIq/fBMDa6cMs+pCm+8Qr+Vk67dNYg5r05zO9HvWX7bGo6fde+hDrEblryPH4k9eNXq+ntpAv2R6Ldl7qeuzjtbfXJl4aHvGoV+Y1s1BfDflc3OfVy0tjled5adiKuuhRWDo+FXf9JgDWLlkaRt/K0ml8QKZlY7Qv04BR/flMr0f9ZXss0l3k9QsvdQNowk/kLtvj8RMvjcO8IrW1fAJ6JqLPXbbHItl3iZda/5Z4DfTSuUutg2i4bI/FFl4aZ3aNl1plFcA1Du0ZL7UIonB0fCru+k0ArJ0Ouu5WTF9IUOM51JSfaSyZmvk16Dd9DEEXr+Ze+hkaLttjkVD3igYB7+n1tnYgL7I9HlVe6nLUWKiPvDSwWuFP82we54WGy/ZYZNpHEM+PbI+Fut2/9FLL+Fdei7z+4KUvS+nXETQ+rt9YQbYrgjzspa4UjXdSV4u+3T3ghdxlcyx00tXt/Fq7eQPtQN5lczz0zVpLJiZ1lJfGRmlwNS0ducv2PKUxZpqeZH2v5E5VvX5NL+Qmm2OhGw90w4d6KHTOauU12EtdkUw/kjs1cOn9rfHfOt/oGGi7ti88XL+xgtpWBOnopbvp9khtBWouvsNL4wY07uOvXmU7fqAJ1PdYaGyTPvD6dq1v5Sr9XI/In2w+G+nqc1cespPNsVDQG+mluc7UIjvGS9OWID+yORYa//e0l47FfC+9Xj0WyN0JXrqLV+caVfJc1weu3wAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADywuz/AfuM94VH4Qx1AAAAAElFTkSuQmCC\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def cross_ent(prediction, ground_truth):\n",
    "    t = 1 if ground_truth > 0.5 else 0\n",
    "    return -t * np.log(prediction) - (1 - t) * np.log(1 - prediction)\n",
    "plot_cross_ent()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Задача минимизации\n",
    "Описав нейронную сеть как модель $f_\\theta$ и функцию ошибки $\\mathcal{L}(Y,f_\\theta(X))$, можем рассмотреть $\\mathcal{L}$ как функцию $\\theta$ на всем множестве обучающей выборки $\\mathcal{L}(\\theta) = \\mathcal{L}(Y,f_\\theta(X))$\n",
    "\n",
    "В этом случае задача обучения сети будет формулироваться как задача минимизации $\\mathcal{L}$ по $\\theta$:\n",
    "$$\n",
    "\\theta = \\mathrm{argmin}_{\\theta} \\mathcal{L}(Y,f_\\theta(X))\n",
    "$$\n",
    "\n",
    "Минимизацию можно осуществлять разными методами, например, стохастическим градиентным спуском (stochastic gradient descent, SGD)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Реализация нейронных сетей\n",
    "\n",
    " * Вручную\n",
    " * С использованием готовых фреймворков\n",
    "     - Tensorflow\n",
    "     - Caffee\n",
    "     - Teano\n",
    "     - Chainer\n",
    "     - [Microsoft Cognitive Toolkit](http://cntk.ai)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Процесс обучения нейронной сети\n",
    "\n",
    "  * Определяем архитектуру сети, опысывая её конфигурацию в виде формулы над тензорами\n",
    "  * Задаём алгоритм обучения, параметры обучения - получаем объект `Trainer`\n",
    "  * Определяем, откуда будут браться данные\n",
    "  * Предъявляем данные алгоритму обучения, который подстраивает параметры модели\n",
    "  * Пользуемся моделью, вычисляя её на требуемых $x\\in\\mathbf{X}_{new}$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "input_dim=2; output_dim=2\n",
    "\n",
    "features = input_variable(input_dim, np.float32)\n",
    "label = input_variable(output_dim, np.float32)\n",
    "\n",
    "W = parameter(shape=(input_dim, output_dim))\n",
    "b = parameter(shape=(output_dim))\n",
    "z = times(features,W)+b\n",
    "\n",
    "loss = cntk.cross_entropy_with_softmax(z, label)\n",
    "eval_error = cntk.classification_error(z, label)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "#pp=cntk.logging.ProgressPrinter()\n",
    "\n",
    "learning_rate = 0.02\n",
    "learner = sgd(z.parameters, lr=cntk.learning_rate_schedule(learning_rate,cntk.UnitType.minibatch))\n",
    "trainer = Trainer(z, (loss, eval_error), [learner])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Вычислительный граф\n",
    "\n",
    "<img src=\"https://raw.githubusercontent.com/shwars/NeuroWorkshop/master/images/ComputeGraph.PNG\" width=\"600px\"/>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "def convert(labels):\n",
    "    xlab = [1-x for x in labels]\n",
    "    return np.vstack([labels,xlab]).transpose().astype(np.float32).copy()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Обучение сети\n",
    "\n",
    "  * Для обучения сети необходимо предъявлять ей примеры, считать ошибку и подстраивать коэффициенты\n",
    "  * В соответствии с принципом градиентного спуска, необходимо расчитывать изменение коэффициентов в соответствии с градиентом функции $\\nabla f_\\theta$\n",
    "  * Итерация обучения выглядит так:\n",
    " $$\\begin{align}\\def\\L{\\mathcal{L}}\n",
    " W^{i+1}&=W^i-\\eta\\frac{\\partial\\L}{\\partial W}\\cr\n",
    " b^{i+1}&=b^i-\\eta\\frac{\\partial\\L}{\\partial b}\n",
    " \\end{align}\n",
    " $$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Обратное распространение ошибки\n",
    "\n",
    "<img src=\"https://raw.githubusercontent.com/shwars/NeuroWorkshop/master/images/ComputeGraph.PNG\" width=\"300px\" align=\"left\"/>\n",
    "\n",
    "$$\\def\\zz#1#2{\\frac{\\partial#1}{\\partial#2}}\n",
    "\\begin{align}\n",
    "\\zz{\\L}{W} =& \\zz{\\L}{p}\\zz{p}{z}\\zz{z}{W}\\cr\n",
    "\\zz{\\L}{b} =& \\zz{\\L}{p}\\zz{p}{z}\\zz{z}{b}\n",
    "\\end{align}\n",
    "$$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Обратное распространение ошибки\n",
    "\n",
    "<img src=\"https://raw.githubusercontent.com/shwars/NeuroWorkshop/master/images/ComputeGraphGrad.PNG\" width=\"400px\" align=\"right\"/>\n",
    "\n",
    "   * Не повторяем одинаковые вычисления\n",
    "   * Вычисляем ошибку на каждом узле начиная с конца\n",
    "   * Обратное распространение ошибки\n",
    "   * Все вычисления фреймворк берёт на себя"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Тензоры\n",
    "\n",
    "> *Тензоры - это такие многомерные матрицы*\n",
    "\n",
    " * `W = parameter(shape=(2,2))`\n",
    " * `x = input_variable(2)`\n",
    " * `z = times(x,W)` - умножаем тензор $1\\times2$ на тензор $2\\times2$, получаем $1\\times2$"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Тензоры\n",
    "\n",
    "Для вычисления используем `eval` с подстановкой переменных:\n",
    " * `z.eval({ x : [1.0,2.0] })`\n",
    " * `z.eval({ x : [[1.0,2.0],[2.0,1.0]] })` - можем производить вычисления в матричной форме (построчно)\n",
    " * В качестве `x` можно передать любой многомерный тензор, последняя размерность которого заканчивается на 2"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "def train_epoch():\n",
    "    batchsize = 4\n",
    "    clabels = convert(np.asarray(train_labels,dtype=np.float32))\n",
    "    perm = np.random.permutation(len(train_labels))\n",
    "    taccuracy = 0; tloss = 0; cnt = 0\n",
    "    for i in range(0, len(train_labels), batchsize):\n",
    "        max_n = min(i + batchsize, len(train_labels))\n",
    "        x = np.asarray(train_x[perm[i:max_n]])\n",
    "        t = np.asarray(clabels[perm[i:max_n]],dtype=np.float32)\n",
    "        trainer.train_minibatch({features:x,label:t})\n",
    "        tloss += trainer.previous_minibatch_loss_average*\\\n",
    "                 trainer.previous_minibatch_sample_count\n",
    "        taccuracy += trainer.previous_minibatch_evaluation_average*\\\n",
    "                     trainer.previous_minibatch_sample_count\n",
    "        cnt+=trainer.previous_minibatch_sample_count\n",
    "    return (tloss/cnt,\n",
    "            taccuracy/cnt)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "def train_and_plot(n_epoch):\n",
    "    cvalid_labels = convert(valid_labels)\n",
    "    fig, ax = pylab.subplots(2, 1)\n",
    "    ax[0].set_xlim(0, n_epoch + 1)\n",
    "\n",
    "    train_err = np.empty((n_epoch, 3))\n",
    "    train_err[:] = np.NAN\n",
    "    valid_err = np.empty((n_epoch, 3))\n",
    "    valid_err[:] = np.NAN\n",
    "\n",
    "    for epoch in range(1, n_epoch + 1):\n",
    "\n",
    "        tloss, taccuracy = train_epoch()\n",
    "        train_err[epoch-1, :] = [epoch, tloss, taccuracy]\n",
    "\n",
    "        # evaluate\n",
    "        vloss = loss.eval({features:valid_x,label:cvalid_labels})[0]\n",
    "        verr = eval_error.eval({features:valid_x,label:cvalid_labels})[0]\n",
    "        valid_err[epoch-1, :] = [epoch, sum(vloss)/len(vloss), sum(verr)/len(verr)]\n",
    "        ax[0].set_ylim(0, max(max(train_err[:, 1]), max(valid_err[:, 1])) * 1.1)\n",
    "\n",
    "        plot_training_progress(train_err[:, 0], (train_err[:, 1],\n",
    "                                                 valid_err[:, 1]), fig, ax[0])\n",
    "        plot_decision_boundary(fig, ax[1])\n",
    "        fig.canvas.draw()\n",
    "\n",
    "    return train_err, valid_err"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "import matplotlib.cm as cm\n",
    "\n",
    "def plot_decision_boundary(fig, ax):\n",
    "    model = cntk.softmax(z)\n",
    "    draw_colorbar = True\n",
    "    # remove previous plot\n",
    "    while ax.collections:\n",
    "        ax.collections.pop()\n",
    "        draw_colorbar = False\n",
    "\n",
    "    # generate countour grid\n",
    "    x_min, x_max = train_x[:, 0].min() - 1, train_x[:, 0].max() + 1\n",
    "    y_min, y_max = train_x[:, 1].min() - 1, train_x[:, 1].max() + 1\n",
    "    xx, yy = np.meshgrid(np.arange(x_min, x_max, 0.1),\n",
    "                         np.arange(y_min, y_max, 0.1))\n",
    "    grid_points = np.c_[xx.ravel().astype('float32'), yy.ravel().astype('float32')]\n",
    "    n_classes = max(train_labels)+1\n",
    "    while train_x.shape[1] > grid_points.shape[1]:\n",
    "        # pad dimensions (plot only the first two)\n",
    "        grid_points = np.c_[grid_points,\n",
    "                            np.empty(len(xx.ravel())).astype('float32')]\n",
    "        grid_points[:, -1].fill(train_x[:, grid_points.shape[1]-1].mean())\n",
    "\n",
    "    # evaluate predictions\n",
    "    prediction = np.array(model.eval({features:grid_points}))\n",
    "    # for two classes: prediction difference\n",
    "    if (n_classes == 2):\n",
    "        Z = np.array([0.5+(p[0]-p[1])/2.0 for p in prediction]).reshape(xx.shape)\n",
    "    else:\n",
    "        Z = np.array([p.argsort()[-1]/float(n_classes-1) for p in prediction]).reshape(xx.shape)\n",
    "    \n",
    "    # draw contour\n",
    "    levels = np.linspace(0, 1, 40)\n",
    "    cs = ax.contourf(xx, yy, Z, alpha=0.4, levels = levels)\n",
    "    if draw_colorbar:\n",
    "        fig.colorbar(cs, ax=ax, ticks = [0, 0.5, 1])\n",
    "    c_map = [cm.jet(x) for x in np.linspace(0.0, 1.0, n_classes) ]\n",
    "    colors = [c_map[l] for l in train_labels]\n",
    "    ax.scatter(train_x[:, 0], train_x[:, 1], marker='o', c=colors, s=60, alpha = 0.5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "skip"
    }
   },
   "outputs": [],
   "source": [
    "def plot_training_progress(x, y_data, fig, ax):\n",
    "    styles = ['k--', 'g-']\n",
    "    # remove previous plot\n",
    "    while ax.lines:\n",
    "        ax.lines.pop()\n",
    "    # draw updated lines\n",
    "    for i in range(len(y_data)):\n",
    "        ax.plot(x, y_data[i], styles[i])\n",
    "    ax.legend(ax.lines, ['training error', 'validation error'],\n",
    "              loc='upper center', ncol = 2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAGquSURBVHhe7d0JfBvVtQbwEztx7Di2Yydx9n2DBEgCBEiAsJOwl0JLKUspZXm88FoI0EdDaaGloQVeoC3QlrLTUkqhZQezYyAsCUkgC0v2fXdsJ7HjVe98VzOWNBrJkuVF0nx/fh/SjGQ7liXN0T1zZ4SIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIKHl0si6pZfD49dfsNktERESUKvI0mzQ+s+QxLAATM0CzwX+ViIiIUsxAzUb/VW9hAZiYfE3F+vXrJT8fVyles2bNktmzZ1tLFC8+fonh45cYPn6J4eOXmEQev8rKShk0aBCuFmARV4jigarPV1FR4aOWufbaa61r1BJ8/BLDxy8xfPwSw8cvMYk8fthuY/ttbcc9KcO6JCIiIiKPYAFIHWratGnWNWoJPn6J4eOXGD5+ieHjlxg+fonhPoCJMfsAKu4DSERElCKwD2BBAXb/8+4+gBwBJCIiIvIYjgAmhiOAat++fVJbW2stERFRssvKypLs7GxryXs4AuidAvBWzWUaVGmfaWZolmqcMCd8mSb4oJBZmkxNH00ZVgTxfAGI4m/YsGGyZcsWaw0RESW7vn37yurVqz1bBLIA9EYBeIPmas0pmpWaX2ou1ozWVGma86yms+YssxTK8wWg/SLisRCJiFKDfQw8brtYAKa7VZo5mnvNkn80D6d+man5O1ZEgTN9rNacrnkdKxxYAFovIi8/BkREqYTv2ywAId0ngeCZPVQzzyz5NWgWaSaapeiu1KzVuBV/RERERCnJCwUglFuXtl2a5j72oO37I82fzBIRERFRmkj3FjCKPBR/kzWfYIWlRLNYc71ZcvddzSManCgaBaMbfP+KGTNmmBlVgANTeunglGwlEBGlFq++b5eUlJgAjlxx33334apnW8BegH0AMQnEhn0At2kuMEuRvaN52H81IrxyPH0uYPzu6fYYPPfcc745c+ZYS63rkksu8Q0bNsxais/QoUN9P/zhD60loo63Zs0aX6dOnXyPPfaYtSb25/gjjzxivnbt2rXWmtiUl5f7brnlFt/ChQutNQHHHnus77jjjrOWKJJ0fN+Ol/0YWNtxT/LCgaDv12Ckb5wmR3ObpkbzH00kYzXHaPC1bUafg/KLX/xCSktLpaEBuyZSMtACUO6++25rqXXh7/2f/0R76kWGf9fNN99sLRElp1if41r8mcRLC0C59dZbZcGCBdaagD/96U9y//1t+rZNlDa8UADepXlU86Zmuwbt4OkaHAIGx/3brTlSE+y/NPOttJm9e/fKpk2b5NxzzzXHZPrRj34kL730kjm2HqWGeA+AjWMmjh8/3lqKD74OX59K6urqrGuh6uvrrWstx4OPJ6dEnuOxwAfnSPbbbz+TVBHtOZzo87uxsZEDCxSVV04Fd4umn6a75liNfRDo9Zo8zYdmKeDHmsP8V9tO9+7d5cEHH5TNmzfLs88+a/bFuPrqq6VXr17y73//27oXtacf/vCH8thjj8nGjRslIyPDZPjw4ea2d9991yxjdOOKK66Q4uJiU7jDypUr5eKLLzb37datm4wYMUL++7//24xWBLvkkktCiri1a9ea7/nAAw/IL3/5S+nfv78UFhbKmWeeaf4NwYYOHSqXXnqptaSfah591HztJ598IhdeeKHZp2fAgAHyk5/8JGzjgQO+nnrqqZKbm2v+zddff735mfj6devWWfeKDM/HyZMnm6/Hv++73/2uOfZjMPxeF110kTzyyCOy//77S9euXeWVV15p+h0xOvO///u/5t+Ig89WVFSYr/v000/lxBNPlLy8PPOawPV584In7vsfNxy37OOPP5YjjzzSPMb4XhSfZ555xvwtlixZYq0JwPNj4sTAwRGwf9SUKVOkZ8+e5m+Ovz/+ns1xPscBz7/TTjvNPH/69Okj11xzjdTUoBET6p///KeccMIJ5rWF58PBBx8sjz/+uHWr//WC1xhGDi+77DLzu2RmZjbd59hjj5Xjjz/eXLd98803cvbZZ5vfAc8b/B72fmC2W265xXyvFStWyOmnn25+Nl5vv/71r617RFddXW2ej/i34XmPy9mzZ4cUq++99575GW7vH/bPX7p0qUyfPt38/PPOO8/cBuhIoLDF98Z7xP/8z//I7t0YuwjA1//85z+X3/3ud03/Dre/MxG1joT2AdRPaNa1AKzDvi2bNm2y1iS3dNuXZNWqVT7dUPl0I+XTwsSnxZVv0aJF5jYtAM0+SwMHDvRdfvnlPt2I+J5//nlzW2lpqe/GG280+w/iOvaJGjNmjE83oOZ2m3P/KHsfKqy74IILfK+99ppPN2Y+/RAQti+Tcx9ALQDN144ePdqnxaPvrbfe8t12220+3SCafaRsWgz6dIPg0wLK98QTT/heffVV3znnnOMbMmSITzcaze6DpYWb+Tm6wTVf+/TTT/u0wDPfc8+ePda9/P8+Le58Bx54oO+pp57yvf322+bxtH9HPG66Ifa9/PLLvhdeeMG3b98+3+eff+7LycnxHXrooT4tMk0mTZpk1n3xxRfWd/Y/brpRND/j3nvv9enG1Px9KD54zHv06OHTYsVa47d161Zf586dfVpoWGt8Pv2Q4NMPCeZ59frrr/u06DDPFzzvbbHsA2g///DcwP20iPSdddZZ5vnofP795je/8f3xj380PwM/F8/rrKws31/+8hdzuxaNPi2gzM/UYse8PpEdO3aY2537AOJ9FK8l/UDme/LJJ30vvfSS75RTTjGvEbzWbHi94HviuYv9f/GztUg16/A6i6a+vt531FFHmZ/zhz/8wTzvtfjz6Ycc8xjaor1/2D9/5MiRvttvv933zjvvmOc4/OxnPzO3/fjHPzZ/h3vuucenH5R8U6dONbfbcB88xliP1xG+/7Zt26xbQ6Xb+3ZL2I+BtR0niltCBeCNb9zoO+yvh/lufvtm3wdrP/DVNdRZt0Smn2Z9d9xxh2/58uXWmo6Vjm8k2IBh4+Rkv4GjeGoONgoffPCB2cDZBSREKgCPP/54a43fXXfdZb528+bN1prIBeCtt95qrfE7/fTTTfFpw8YT32v+/PnWGr/x48eHbYCdUOAVFBSY4i8Y/t3YMP/+97+31vj/fbm5uWEbHft3RJHnhMeysLDQV1lZaa3xmetFRUUhjzMeN/xbX3zxRWsNtRSKD+fzG4Vfly5dfFu2bLHWhMIHUzynTz75ZN+3vvUta21sBSCKSPztggt2fL9x48ZFff7ZPxP/3gkTJlhrAz/zoYcestYEOAvA6667zvxe+CBia2hoMK+PQw45xFrjL8Dwbwn+PQAF4bRp06wld/jAhq/F6z0YitmuXbv6tm/fbpajvX/YPx/Fb7CysjLzPS699FJrjd/f/vY3872CXw9YRgGIIrk56fi+HS/7MbC2457klRZwUvrJET+RGZNmyIqyFXLWU2dJrzt6yblPnysPLnhQ1leEttdsukEW/XQo+uYp+uZkJgWghaZvltY9khvaPjgEgVsi7a+C9W73R9zaSG1NN4DWtQDs64aWD1qfaDPpRkeOPvpoc9vXX39tLqM55RScqTAAf1torj2rb/qmdRcMXxv8dWgRDx48WHSDZ63x0w2RdS2yjz76yLSavv/975u/gx20cdGSwgSmYEcccYT07t3bWgp11lnhZ1N8//33m1puNlxHCxwts2B4TNFGTFa6TZHKGn1etmHwMxKFXRU2bNggb7/9trVGRAsK03pFe9b22Wefmb8N2pSdO3c2j/8bb7wR0/M5GNr2aN9PmjTJWuN/3mI3Aie0YM8//3wZOHCg+XkIdpOJ92fa8PzCc1ILUmuNv1WKn6EfzMz7aTDna+mAAw5o9jVYUlIiQ4YMMT8n+DVy0kknmV0x8PsHc3v/sDlvw9fiveWCC0IPWvG9733P/E2crxG0j+1DkhE1hwVgB+rbva9cPP5iefKcJ2Xr9VvljYvekAl9J8ijix6VYb8fJmPvGyszS2ZKyYoSqa6rNl+DfXSwH45+qpSbbrrJ7Humn8rNBtm5z1gyuv32282+am756quvrHuFwnq3+yP4fu2tXz/sThrqxhtvlF/96ldm44q/D/Zhw74+2GDHMqmnqKjIuuaH/XegpV8bXBhjH1Psb+QUvLGPZNu2beZ3QHFgb5ARbGSwf9HOnTute/q5PTY2t9vKyspc16Po2LUr9PCbKCxROCSr3bW7peC3+rxsw+BnJOqoo44y+7c98cQTZvnLL780M2p/8IMfmGVAgYh9MbEP67333ms+CMyfP98UGPFOUsPzz+255lyHSXH4mYsXL5Y77rhDPvjgA/Mzsd9rSz/oRXt+4XntfI65vZaa+33xGlmzZk3I6wM5/PDDzfM1kdcI/v3gXI/9HrFvpn27Ldr3JnJiAZgkMjMyZdKASfLzqT+XDy79QHb8dIfcdvxtsqd2j1zx0hVSdEeRTP/bdLn7o7tl2fZlZpQEnwKffPJJUww+9dRTZufgZPezn/3M7Pzvlkiz97De7f4Ivl97cytCsPM6NqD492BHdIy2oUBNBtgoYCPltGXLFutaZNjIwOOPP242xsFBkYuJJMGiFWhut2GD6/bvwDrstB8smYs/yMvKk4ob9XnZhsHPaA2YNISJPShuUAji/SR49Om1114zI+z/+te/zFEKDjvsMDMho6oKB0+ID55/W7dutZYCnH93FJmYWPTXv/7VjDhjRA0/M9JM8lhEen6hKMXzyfkcawm8RjDpAiOmbq+RM844w7qnXzyvEfz7Uag6fweMMKKwdBasyf4aoeTCAjBJ9cjuId/e/9vywBkPyJqfrJEFVyyQ6SOny+urXpdDHjhEhtwzRC5/4XJ5ZtkzUllXKcccc0zEF/8//vEPMzq1cOHCVmkhJQKfqDHb2S34VOsG693uj9gjZa0J3xOz+txEeoyxYURLJtjDDz+cFG/I2JCijYUNUjDMPG8OZoGiOFi+fLnZGDszatQo654tg+ctRkwx+mNDy/nFF1+U4447zlqTGvC3zu+qz8s2TGs9nzBbG+1PPAfwIRK7A2Bmts0u9IKf05hN++GHzgMmNA+zblHYYVcVG96Hnn76aWvJz+1nYoTuhRdesJb87Nd8pNdoMDy/0EYNbuNidxl8YMPzF7POE4VRUfx+mOHsfH0gwUVavH8/vHYx2o4P+MGwjCIQHzaJWooFYArAm8b+vfeXa464Rl694FUp+2mZPHjmg5LXNU9ufe9WKb6rWA594FC58c0b5c1Vb8q++tCWBd6AvvjiC5k6darZVwWHJ8En/HhbOV4xduxY01r585//bIqm4EMpRCqgsRF47LHHzKFOsJ/UVVddZUY0EtFaxfol1mE5cCgMjOS9+uqrZoOPEVTAPlGRoPi78847TasdvxM2xtjvCEXDlVdeGbZhihf2YcWGH4fuwIgUgjYgNu486HXbQeGOUT3suoDiBQVhMPwN8MEL6/F8xnMbp7jE+0e8MDKO59+3v/1t833w/MNoo/MwJvaHDZxaEx8KUCCiwHHuU4rWMUbd8NzDPqgYeXO2Qm3XXnut9OjRw+yPhw/COM4q9mvEvoa/+c1vrHslBvvn4d+O5zAO14J9K/H+itY5HrPg99l4X9MYobzuuuvMfpD4XfC3+P3vf29ei9jHOJn3iaXkxwIwBeV0yZGTR5wsc6bNkcVXLZaNMzfKtUdcK1v3bpVLnrtECn9XKCc9cZL87oPfyWebPpMTTzrRHP9rx44dpr2CDT423pgs0NEjgskIxxdDex37WGI/HkxIsEX6BP/HP/7R3A/H4cLXYkQrUnHk/B6Rvqfb/SLd1yn4ftgfCRsOHJwXGw4UhPYHAWiuVY1jlqHwwwgQ9nHERgdnYsAIxIQJE6x7Rf/3RVqP5yCOr4h/A/5dKBZwHRt2eyKMLdbfnWKD4g4HoseEC+doKz4EocjHyBkm79x1113m+HL2xKZgbn+X4HV4/r355pvmuYLiDn9ntEydBT6Of4qz3eB59Z3vfMe8/i6//PKwCRD43g899JAZHURhh0IWhZ0t+Gej/Yx9CTFpDs93TDzBfo0oMPG1wSI9vyKtt2HEEhNB8DrB+yteH2ixo7WO/S2DJ2VE+16RbkOhOmfOHFNUop2M/SPxGAb/zoCvb+7fShSMz5bEYPp4BUZS0I5MBijovtn5jRkJfHP1m/L26relc0ZnOX7Y8XLisBPlxOEnyoiiEeZ+2A8m0n6DuD2WNxPsJ4QNdjI9BhQbjIRgdiXau0TkHXzfDjwGCv+rxBWvYQGYmKQrAJ3qG+tl/qb5/oJQM3f9XBmYP9AUgshxQ4+T3rnhh+3AaBZO14XWJoKWkVtByDeS1IDWFPZ3wt/R3rkfIzxoc2OUhYi8g+/bLACBBWBikr4AdNpbu1feX/e+KQbfWPWGLN66WMYVj5Njhxwrxw49VqYOmWoKQhx6BfvqoO2Afb4wUohCEPuRBbdO+EaSGnCCfJzaCy09tNjGjBljThmHVhIReQvft1kAAgvAxKRcAei0o2qHlK4tlXfXvGuyZNuSpoLwuGHHmYKwm/6HIhDFIEaRgnee5hsJEVFq4fs2C0BgAZiYlC8AnVAQvrfmPX9BuPZdWbptqRxQfIAZHbRHCHt162Xdm28kRESphu/bLADBKwXgrZrLNHimf6aZoVmqiQR9sZma4RqcKwjTOa/ROKVdAei0fe/2wAihVRAe2OfAppbxhMIJMrzfcBaAREQpggUgC0DwQgF4g+ZqDU62ulLzS83FmtEat8PaX6fB8TFwYCycxBFHHR2jWaRxSvsC0Gnb3m1NBeE7a96RZeuXifzWPAgsAImIUgALQBaA4IUCcJVmjuZesySC001s0mCE7+9YEQTnWcJt52lewYpmeK4AdFq9ZTVHAImIUggLQBaAkO4HgsYze6hmnlnya9BgNG+iWQo1RdNNg5PSfqPBCRhf1RykIRc9u/nPFUtERESpI91HAAdqcBLI/TVfY4UF+/Sh4r/CLAXgkPNPaN7XYBRwlwb7D6JljDZw6LmLOALY9CkKp5PiCCARUfLD+/agQYM4AsgWcFrDM7tcM1nzCVZYSjSLNdebpYAzNM9rpmtexwqFUVIUft/W4OuCmQIQpzeyT/eDcz8iXoHzXOI8n1u2YLCUiIhSQd++fWX16tWSnZ1trUl/OGUfArW1tebYqIoFYBpz2wdws+ZajXMfQHvEMLgAxP3x5IhYAHr5UxSgCMSLqaUqayplwaYFMm/TvKbsrtkt4/uOl0n9JsmkAZr+k2RQwSBzNpLbb7/dnD8WJ4HPycmRkSNHmuDE8c7zhhIRUTgMWnip+HPiCKA3CkCM8mEW8GkaFIO/0FyoQUvXbRbwsxrs2PZdTYUGs4YxIxhtZBwSJhgLwDaA8xCv3LVSPt7wcVMWbVkkxbnFcsTAI5oyrnCcrFu5zpzL9ptvvpHi4mJzQnY3L7/8sjm1HU6FNmLECOnaFZO7iYjIi1gAeqMAhFs0V2owy3e+xj4O4CDNMg1G/D7UQHfNPRqM+GHCCCaQoIjE/ZxYALaTqroq+WzTZ6YY/GjDRyY4RiGOSYjRQeTQ/oeag1Z3yexifVXATTfdJC+99JIpFmtqamTIkCEyevRoOeSQQ0LObEJEROmPBaB3CsC2wgKwg2CUcF3FOn/LeKO/bfzZ5s+ktqFWJvSdIIf2O7SpdTy652jJzEAnX6SxsVE2bdpkRgwRvAn89Kc/Nbc54X5oMRcWFlpriIgoHbAAZAGYKBaASaTR1yjLdy43xeD8TfPN5cLNC03xd0i/Q5pGCVEYDusxzOxPGM11110nc+bMMaOF48ePlwkTJjRl6NChzX49ERElJxaALAATxQIwydU31suy7cuaRglRGH6x9QvJ65pnikGMFB7S/xA5uN/BMqRgSFhRV1ZWJp9//rksWrSoKatWrTLru3QJbzUTEVHyYwHIAjBRLABT0L76faYIRFGItjGCcxz3yO5hCkEEI4YoDN1GCjGZpHPnztZSqEcffVQef/xxGTduXEiKioqsexARUUdjAcgCMFEsANOEXRRiosmCzQtMUbhk2xLJzcr1F4V9tSjUghCF4YiiEZLRyf0kOitWrDCHqFm6dKnJsmXLZOPGjeaYWx9//LFpJxMRUcdiAcgCMFEsANNYTX2NKQLNKCEKwy0LTJGY3TlbJvadaIrBif0mmkknY3qOcZ19DOXl5aYQnDRpkmvbGIXhzTffLP369QvLAQccwNFDIqJWxgKQBWCiWAB6DGYZo11sjxIu3LLQFIUNjQ3mEDQoBsf3GW8uD+pzkBRkmzeYqDZs2CCvvfaabN68OSyYhHLOOedY9wzALOi7775bBg8eLPvtt585viGPbUhEFBsWgCwAE8UCkEzxhwNX42DVdj7f+rls2r1JhhcON8XghD5aGPb1F4aD8v1nNEkEjmV40UUXmQkpX331lTkby/Dhw2X//feX733ve3L++edb9yQiIicWgCwAE8UCkCLatnebfL7lc39RuFWLQr3+1Y6vJL9rvr8otEYJkbG9x5rWckvg2IYYRfzyyy9NcFq8008/3bo11HPPPSc9evQwhSLOnMJD2RCRF7EAZAGYKBaAFJfqumpZun1p00gh2sfInto9MqrnKFMMHlh8YFNh6HZomkRceOGF8v7778u6devMAa5xWrxBgwbJEUccEfGA2ERE6YYFIAvARLEApIRhf74NlRuaisHF2xaby693fi05nXPM6e6Ci0Jcj2Xfwmj27NkjX3/9taxevdqMHnbv3l0uu+wy69ZQv/vd7+Sjjz4yheLAgQObLhEcEDsjw31GNBFRsmIByAIwUSwAqc1gFjJaxsFFIbJ5z2YZXDDYFIKYeDKu9zgZVzxO9u+1v+R0ybG+uvXMnTtX5s2bJ+vXrzfFIoLrW7ZsMYWk28zmNWvWyMKFC6V///4yYMAA6dOnDw+cTURJgwUgC8BEsQCkdrejaocs3uovCNFONtm2VCprKs2kExSDpii0CsP9eu3X4v0Lo8G+h5FG/zCr+aabbjLnU966datZh30OURDef//9puXshJFQfM/MTP95m4mI2goLQBaAiWIBSEkBxRNmHdvFoF0Y4jR42L/QFIZBRSEux/Qa0yaFoVNdXZ0pAlEMIpMnTzYjgk4YUURbGQfNRqFoByOIxxxzjBx11FHWPYmIEsMC0DsF4K0a7OCEKu0zzQzNUo2bdzWTNTUaPD4+DfaO/7PGiQUgJTUUhht3bwwUhdYlCsO9dXtlROEIM0KIA1nj0k7Pbj2t79B+GhoaTGvZLhQRnEUFlyeccIJccskl1j1DzZo1S2pra5v2S7SDQjLSKfuIyNtYAHqjALxBc7XmFM1KzS81F2tGa6o0Tu9oSjW4X3NYAFJKQmG4vnK92ccwOJh4gpHEXt16+YvBnloc9goUh0N7DJXOGclVVP3pT38yh7+x909EMJo4ceJE+ewzfN4Lh1nQOKczisRu3bpZa4nIK1gAeqMAXKWZo7nXLIlgB6NNmpmav2OFAwrA9zW/MEvRsQCktIN9Cb/e8XVIUYjL5WXLze2jikb5i0KrOBzdc7RZ1xGjhpGg7YzXZa9evaw1oW688Ub5v//7P1ME5uTkSM+ePc19cfnss8/aG4YQe/fulR07dpj7oWjkMRSJUhcLwPQvAFGVlWvQ0v0EKywlmsWa681SKBSAB2iwdzv2Xn9ec5tmr8aJBSB5Rn1jvawpX9NUHH6540v5Zuc3pjDcsmeLFOUUNRWDuLSv4/iG3bO6W98leWDCya5du0xRt3PnzqZLHCvRbcYyJraceuqpZvQUp91DIYjzNOPA2jiX80knnWTdMxQOoZOXl2eOu4ig4GTxSNSxWACmfwE4ULNOs7/ma6ywPKXBH/wKsxQK0xO/0qBwPFDzmAZf63ZuLRaARAqjhst3LjfFIIpCuzBEsVhRUyH9uvcLKQrt65ic0rVz6pzDGPsplpeXNxWMZWVlZhmzmnEGFicUi8OGDTP32717t1mXlZVlisbvfOc7cu+9dmMi1OLFi81+jb179zZB0UhErYcFIEcA3UYAnaZq3tTkaTAxJJgpAGfMmGHe1GHatGkmROQvgHDYGmdhaC61YNxXv88c0xCjhCgMRxaNbLpMteKwOWg3o1hEMPKINvK4ceOsW0P913/9l2lFo9DEY5ibm2sKQcyK/uCDD1xHEDFZBueGRnGJDRsucYBvjjYS+ZWUlJgAPmDdd999uMoCMI257QO4WXOtxm0fQCe7AESxtw8rgnAEkKiFGn2NZsIJCsEVZStMYYjgOlLbUGuKQ7sobCoQtVgc1mNYWhWHkWDEEaOHGG3cvn272a/xjDPOsG4N9fTTT8v1119v7oPRDcBxGlEM4hzQU6firSzUvn375M9//rNpZTuDdjUP3k3piiOA3igAMcqHWcCnaVAMYnLHhZoxGucs4GLNRA0mgeA2fDx/VLNG8x2NEwtAojYQXBzaRaEpEHV55a6VIcXh8B7DZUTRCDNiiMPa4DLRU+WlOhSOaDnjvQkjjmhDu71HYSTyRz/6kSkycR2XSFVVlfzP//yP/OEPf7DuGeqBBx4w3xtFYvCIIybRDB8+3LoXUfJiAeiNAhBu0VypQRt3vsY+DuAgzTLNdM2HmsGaf2lwiBiMFG7RPKvhJBCiJIHicGPlRlMQrixbKat2rTJFoX1Zvq9ceuZoIYKCEIWho0AckD9AMjrx/MXRYGQQLWu0kN3Mnj1bvvjii6aWth0UhDgkj5t///vf8swzz5hC0Q6+P1rhZ555phl1dMK/AQUp9oFEeFxHai0sAL1TALYVFoBESWZX9a5AQegoEHHsQxzHEC1kFIQIrg8r1OgljnNYmFNofSdqTZ9++qm8/fbbTaOSGHHEuaSrq6vNiOKIESOsewagmBw7dqy1JKYljUIQRSPa3dddd511S6iXX37ZXGJE0g4KzkinLiTvYQHIAjBRLACJUghax2vL15qCEMXh6vLV/uxabQ5xs2vfLinoWtBUENrFIQpDu0DMzcq1vhu1NUyAwc76KBLRlsalfR0H8R48GE2bcN///vfNTGpMokHwPVD84XSC7733nnWvUCga33//fcnOzjaH+QnOeeedZw7l41RTU2O+v314H0odLABZACaKBSBRGkH7GIUgCkK7MLSLRKyvqquS4tzipmIQl0N6DDHXhxQMMde7deGZRZIJikgcxNsuBEeNGmXdEur55583M0RR1CFog9vXn3jiCdfzV3/yySfmEECAQhGFoJ2ZM2fKOeecY25zmj9/vikYsd3ADG8ER5LgjO32wwKQBWCiWAASeQQKie1V20OKQxSFayvWNl3isDa9u/X2F4QoDAusS6tAxGVe1/CRJEpdOOuM3dIOzvjx40Pa18EmTJggK1euNC1wW2Zmppx88snyyiuvWGtCoQj98MMPTbGIFrhdOOI6RjzdRiBRxGL7hPtwH8pQLABZACaKBSARGSgQt+3dFigIywOFoX25p3aPFGYXNhWIKAoH5Q+SQQUavcTM5r7d+0pmBuagUbrD2WjQzsYIJYI29dChQ61bQ6FFPXfu3Kb7InZbHJNr3FrUr7/+eshxabEPJYpBBKdCPP98t/MbiPz0pz81o5HBxSYu8W875phjrHuFwmGK8G9CIYug2LSvo9BKttFNFoAsABPFApCIYoICsay6rKkgRNZXrJd1levMJSao4JR6mKTSP69/U2E4OH9wU4FoX/bq1ovtQmoWnnMYoUShaMfeh3LIkCFmP0o3N910kxk5tItM+xIjl3Pm4LC64S677DJ5+OGHzc90wiGJ3GaUv/nmm/LDH/7QFGLOXHrppXLYYYdZ9wy1YcMGU/Biu9vS1wELQBaAiWIBSEStBpNUcIibdRVaFGpBaBeG9nWsx0SV7M7ZTQXhwPyBMjBPg0srWI9D4bBIpPaGAhDHoURwGB9colhzey6idb5s2TJzie1ocLD/5CGHHGLdMwDfH/tborDF927pzG4WgCwAE8UCkIja1d7avU0F4YbKDeY6LoODIrFrZteQojA4KB5x2Tu3N4+JSCkHrXOMKloFXIuwAGQBmCgWgESUdFAkbty9sakgtIvFDbsDRSLO0dwlo4v0y+snA/IGmANkm8ug6ygS0Y7O6cJDnFB6YQHIAjBRLACJKCVV11Wb0+2hUETbOeTSKh5xe31jvRTlFEUsElEgIhxNpFTCApAFYKJYABJR2sJp97bv3R6xSESBiGByCyavYAazXRD27+6/xAhj0zoN902kZMACkAVgolgAEpHn4fiHm3dvbioIm7JnU8j6ipoKycrMkn7d/UUhikNcR+GISyzb13HAbR4Oh9oKC0AWgIliAUhEFCPsm7h5j78gxEgiDnuDZcRc12IR1zGiiHYyDqrtLBLNZdC6Pt37SPes8EOMEEXDApAFYKJYABIRtbKa+hrZundrSFEYdl0vt+7ZKnWNdZLbJdcUgqYgzHVcOtZzQgsBC0DvFIC3ai7ToEr7TDNDs1QTDQ6rvlgzSNNF06hxYgFIRNRBcEw4HPIGBSGKQVya61bx2HSpt+EsLQ2+BsnLymsqDFEUImg3Bwe34bKga/KdwYJaBwtAbxSAN2iu1pyiWan5peZizWhNlSaShzT9NSdrWAASEaWwhsYG2Vm9M6RQRFFoUuW/tAtFpKahxhwmx1kUFncLLRbtYBY0DtBNqYEFoDcKwFUanLvmXrMkgr2KN2lmav6OFS7O0Pxc8zPNGxoWgEREHoGRxd21u5uKweDC0EQLRnvd9qrtsrNqp/j0P4wu2sWgKQy1WGy6jvXdAtdxOr8umdi0UEdgAZj+BSCqsnLNZM0nWGEp0aC9e71ZCtVTgzYxRgyLNW9rWAASEZErHCsRRSCKQbtIxOFzmq4Hr9fr5fuwWRIpzC40hSCKRBSHJnrdrLOuB19y/8XWwwIw/QvAgZp1mv01X2OF5SkN/uBXmKVQ/9Qs0tyuOUbDApCIiFoNJrngTCwoBlEo4tIsW9edy/YIY7cu3UIKQhSKdnB8xZDlbj3NOo4yumMByBFA5wjg9zTXaQ7XoOA7VvOWJkvToHEyBeCMGTMkKwt3EZk2bZoJERFRa8D+i5js0lQgBhWGKBR3VGv0smlZgxY2YCILikG3QhHX7UIx+DJd92UsKSkxgdraWrnvvvtwlQVgGnPbB3Cz5lqNcx/ARzTnavaZJf/IH4q8HRoUhk9ognEEkIiIkg5GGXE8RbsgNAVidaBAtJdRNNqXOFA3YKTRtTh0WYfTBCI9snuk1IG7OQLojQIQo3yYBXyaBsXgLzQXasZonLOA8UTI9V81pmjQEh6i2amp1gRjAUhERGmhrqHOjDQGF4Wul0HXUWTWNtRqMdHJFIF2QYgC0VzPdizbt2vxWJhTaL4GpxFsbywAvVEAwi2aKzU4tt98jX0cQBzjb5lmuuZDjRP3ASQiIooAM6ar6qpMIWgXhHZQJDYt7wtdxn1ROEJ+13xTFGJSjLnUwhCFIy5D1jnug1nXLT1OIwtA7xSAbYUFIBERUZxQOFbXV5ticFf1LjPyaF83l7psrmvh6FyHy0Zfo1xz+DVy9/S7re8YHxaALAATxQKQiIioHaH4211jTXLJNkVc3FgAimRYl0RERERJL6NThin8Wlr8kR8LQCIiIiKPYQFIRERE5DEsAImIiIg8hgUgERERkcewACQiIiLyGBaARERERB7DApCIiIjIY1gAEhEREXkMC0AiIiIij2EBSEREROQxLACJiIiIPMYrBeCtmo0anD36Xc04TSTPazZoKjT4moc0RRoiIiKitOCFAvAGzSWakzS9NHM1JZpuGjc/14zQ4CzTYzW43wMaIiIiorTghQLwKs2dmmWaGs3Nmi6aszVuFmtwP8Dj06gZbZaIiIiI0kC6F4D5mqGaeWbJr0GzSDPRLLmbranU7NScpblFQ0RERJQWvFAAQrl1adulsW9zM0uD20dq5mhWaIiIiIjSQifrMl2hiEPxN1nzCVZYsA8gWr3Xm6XoJmle0AzUYPQwGL5/xYwZMyQrK8usmDZtmgkRERElj5KSEhOora2V++67D1exvz86fp6T7gUgrNJgFO9esySSqdmsuVbzd6xoxpGaUk1vTRlWBDEFoJL8/GgDikRERJQsKisrpaAAtZ93C0AvTAK5X4ORPhz6JUdzmwaTPP6jcRqlweSQPLMkMkZzh+ZTjbP4IyIiIkpJXigA79I8qnlTs12DdvB0TZVmkAbHBsQoH2BEdKZmrQafCF7VfK7BRBAiIiKitOCFFnBbYguYiIgoxbAF7I0RQCIiIiIKwgKQiIiIyGNYABIRERF5DAtAIiIiIo9hAUhERETkMSwAiYiIiDyGBSARERGRx7AAJCIiIvIYFoBEREREHsMCkIiIiMhjWAASEREReQwLQCIiIiKPYQFIRERE5DFeKQBv1WzU7Na8qxmncdNb86hmlabSupytydIQERERpQUvFIA3aC7RnKTppZmrKdF00zh113ylOUGTrzlRc5rmtxoiIiKitOCFAvAqzZ2aZZoazc2aLpqzNU6rNSj2cAkYAXxYc5xZIiIiIkoD6V4AYhRvqGaeWfJr0CzSTDRLzTtZs8B/lYiIiCj1eaEAhHLr0rZLY98WDUYLJ1iXRERERGmhk3WZrlDkofibrPkEKyzYB3Cx5nqz5O7Xmos12B9wBVa4wPevmDFjhmRl+eeJTJs2zYSIiIiSR0lJiQnU1tbKfffdh6sFGkz69Jx0LwAB+/HN0dxrlkQyNZs112r+jhUu8KzApBEUf+uxIgJTACrJz49lQJGIiIg6WmVlpRQUoPbzbgHohUkg92sw0odDv+RobtNgMsh/NE4oDlEUTtUcrYlW/BERERGlJC8UgHdpcGy/NzXbNWgHT9dUaQZpcGzAIzWAy+9pRmiWa/CpALd78tMBERERpScvtIDbElvAREREKYYtYG+MABIRERFREBaARERERB7DApCIiIjIY1gAEhEREXkMC0AiIiIij2EBSEREROQxLACJiIiIPIYFIBEREZHHsAAkIiIi8hgWgEREREQewwKQiIiIyGNYABIRERF5DAtAIiIiIo/xSgF4q2ajZrfmXc04TSS/1izQ1GhKsYKIiIgonXihALxBc4nmJE0vzVxNiaabxs0Kzc2aB8wSERERUZrxQgF4leZOzTINRvVQ3HXRnK1x85jmZc0Os0RERESUZtK9AMzXDNXMM0t+DZpFmolmiYiIiMhjvFAAQrl1adulsW8jIiIi8pR0LwArrcse1qWtUGPfRkREROQpnazLdLZKM0dzr1kSydRs1lyr+TtWRPBLzQmaqWbJHUYRK2bMmCFZWVlmxbRp00yIiIgoeZSUlJhAbW2t3HfffbhaoPHkgJAXCsDrNVdrTtOgGPyF5kLNGE2VxqmzlZ9rjtGcqAFMIHEyBaCS/Hx2lImIiFJBZWWlFBSg9vNuAeiFWcB3aR7VvKnZrpmsma5B8TdIg2MDHqmx/VWD236mmaKptpaJiIiI0oIXRgDbEkcAiYiIUgxHAL0xAkhEREREQVgAEhEREXkMC0AiIiIij2EBSEREROQxLACJiIiIPIYFIBEREZHHsAAkIiIi8hgWgEREREQewwKQiIiIyGNYABIRERF5DAtAIiIiIo9hAUhERETkMSwAiYiIiDzGKwXgrZqNmt2adzXjNJH00PxdU64p0zyhKdAQERERpQUvFIA3aC7RnKTppZmrKdF007hB8ddbM0wzUtNX85iGiIiIKC14oQC8SnOnZpmmRnOzpovmbI3TYM0pmpmaXRqMAF6nOVMzUEOtrKQEtTi1FB+/xPDxSwwfv8Tw8UsMH7/EpHsBmK8ZqplnlvwaNIs0E81SqAmafZolZsnvC02tBrdRK+MLODF8/BLDxy8xfPwSw8cvMXz8EuOFAhCwP18wjO7ZtwXDugr/1RD4erf7ExEREaWcTtZlukLRhuJtsuYTrLDgY8NizfVmKQCt3qc0zv0DMSp4ruYlsxRgCsb169dLfj7rw5aYNWuWzJ4921qiePHxSwwfv8Tw8UsMH7/EJPL4VVZWyqBBg3AVkzwrccVr0r0AhFWaOZp7zZJIpmaz5loNJnwEwz6AqzXjNXYbGNcXaIZoNmBFkAEa5zoiIiJKDdi/H0cJ8RwvFIAY5btac5oGxeAvNBdqxmiqNE4vajBJ5AINHp9/aPZo3CaN4Pb+GhxehoiIiFJHnmaTxmeWKC3dosGoHwq54OMAYvwXxduRZskPxwH8mwatY+wr+LiG/V0iIiIiIiIiIiIiIiIiorQXzynmKOCXmnoNZl7hscOlc0IOBZynKdXgEEU4jqXz8E0Had7TYBcHTErC40sBzT1+jRrsDxz8fORr2e92DY6FiscO73VPapwHxefzL7JYHj8+/yLDPvsrNNgla5vmVQ0mZgbj84/aHU4xt1YzVtNVg7noePJFOsUcBeAFig0yxQanMUQR80ONs4DprsFOzLdpsjQHaNZrfqIhv2iPH2ADfJz/Kjn8RoOD5nfWYF9ofFBbqLHx+Rddc48f8PkX2SiNfS5+PIY4S9cWjT2Blc8/6hCYUYzZxTYcXmarBrOHKToWgC1zjMZZwPxAgzfE4HU/1iz3X6Ugbo8fYAN8vP8qNQOjL3gM7Y0yn3/xcT5+wOdfbDDQco0Gj19PrFB8/iXA+UZIscEnuXhOMUfh8DihYMZxF/GpGI8nxQ8bFIwoYCNiw/NyuAafjik2mPm/XTNfcxlWkKtpGnQ+7DMm8fkXH+fjZ+PzL7JTNTgiR7XmLg2O67tTA3z+JYAFYMvYh4WJ9RRzFOpfGrTO+2imaHAMpjc1bJ/HD883t+ch8LkYmxM0wzT9NDdr7tBcqaFQJ2rw+AQ/Nnz+xc7t8QM+/6J7RVOoKdJcp/lYY+Pzj9odnlj4xHG4WQrAKebwCYXig3038OkOb5AUmVsLE5+GsWN0MJz6EPfjJ+BQkVrATtjx/AP/VbKcrsGGFafLDMbnX2wiPX5u+PyLDPv+oeA70Czx+ZcQjgC2DGZprdFMMkt+2AcQbU3nDr4UOy+cmaa12bsdBL+WD9NgH1XMiqOW4XMxAPs1P6H5juYFrAjC51/zoj1+kfD55w7bWZypC5NDgM8/6hA4xRyKQEzXz9Fguj9mH7GN2Ty8Edo78aINjLOt4AWbixUUBm9u2AH6ZA0+2eI5hmVsJPApF4eX+LUmW4NPxus0nAUXEO3xw8bjYA02Kti44D7Yv2iGhvwT3co0wWdLCsbnX3TNPX58/kWHCR3F/qvSW/OABo8nthvA5x91mEinmKPontdgAggeNxTNmASCnXbJHWa6YZcDFC+IfX2qBnDoA8yq3qvBIRGwHxEFRHv80JpbpsGoPjYsGMG/XEN+eKxqNHh8go9TF1zQ8PkXWXOPH59/0eHc/NjG4nFDofecBgVzMD7/iIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIqDnnaUo1FZoGTYYmmh6av2vKNWWaJzQFGkoBzf1xiYiIyBtQxN2nucYsNQ/FX2/NMM1ITV/NYxoiIiIiSjHHaJobARysadQcYJb8DtJg3UCzREmNI4BEREQUrwmafZolZsnvC02tBrdRkutkXVLL4PHrr9ltloiIiKLL02zS+MxS28jWZPmvukKRhuItEowAvq3posGInpsLNXdq+pmlgC2amZonzRIlLRaAiRmg2eC/SkREFBO0SDf6r7a67F75+dU7KiutRVfY1w/br0hFYCwF4JmapzTdzFIAvue5mpfMEiUtFoCJyddUrF+/XvLzcbV1zJo1S2bPnm0tpS/+numHf9P0wt+zdVVqUTZo0CBcxUzZqBVaAsx26fXf/lZyszEQGGrvvn1y8o034mq0f0MsBSD2AVytGa+x28C4vkAzRMPBkSTHAjAx5oWmWrUAnDlzpsyZM8daSl/8PdMP/6bphb9n60IBWFBgjpLS5gXgh/fcI91zcvxrguyprpYjrzGTfN3+DZgXgKIPBeCrGrSrMRkELWO3lvWLGtz/Ag3qiX9o9mjO1lCS4yQQIiIigos01RoUf4BirkpztAZDl9jf/UiNDfffoVmpWa7ZrPmBhlIAC8AkNG3aNOtaeuPvmX74N00v/D1T1465c2V7aWlYsD4KHMMPdUGmFfs6Dg69XoMRwQ81NhwAGpNBcEDoQs3FmrYa2aRWxhZwYtqkBUxEROmnPVvAC++5R/JcWsC7q6tlYuQWMHkIRwCJiIiIPIYFIBEREZHHsAWcmFZrAT/wtHXFRemXIlMPtRZiULpS73+gtRBF6Qa93xhrIYrSrXo/nOkxitJyvQ+OKhVFabXep5e14KK0vlGmRnkYP82skqOz3Z+yC61OxuRO7sc+XSI7ZJLkWkuhvpYtMt7swhJulawzl2PN6S7DbZAVMtocTivcFvlKhshQaylUmXyhXzXaWgpVKQukWH+im33ysbksNEdbCFcvH0h3ifxkyah9V7rKZGvJxZ5Sycicai242FkqkhPl9k3YVUgVRLnPOus+xVHuA8v1fv2buY9tmd53WIz3XWT9/NEx3h8+1a85MI77B/tAv3ZiC782yN539PtMTvz7OJWVlkrXqa3/fZuzSX9uXgf83JYaccUV1rWWYwuYkglHAFNE6XzrSisr/dq60oxSHO2pGaWtcFjT0mbejt7f537w/InmPS+6ebLXuhZqjPSVz82+zOGGm0NdtdxaWWNdC7dRvrGuhcqXg2WbLLOWQmXLEda1yPZI9CdLjXxkXWuhaquAchNLwTY4xo3+KL2fXVDGYnWM953QgqLjMP2axXH8W5wWJvC1wT5qpe/jUKPFWEfY3UE/1wv2zJ1rHl9nsJ4IWACmgKn7+y9jLQKnjtD7LrYWophqna67uSJwah/rShRT3QfQQkzVD6OlOGBABFM7R386HtbgPOB8uI98OFxVuAMkytCjJVIRCMtku3Ut1EAZqWWce+XbV/azroUrMudMjy5aEbhL/7VuOstR5jJSEdiYdax1LYLuU6WxIcpGuWeMxVNFMxt2FIHbYtz4x1IEjm1BUfdNC4qPlhSBR1n/tgSLwNzjWvA7xqCog0bh+qfQ6F8q6jdlinmMncF6ImABmCLsIjAe8RSBzUER2NwoIIrAWEYBoxWBkOgoYLQiMNooYCT2KGCkIhAiFYEQaRQQRWC0UcDmNFcERtPcKGCzRWAso4DNFYHQXBGIUcB4xDsKGE8RiFHAlrKLwNaQRqOAKEgwKkVE7Y8FYIqJZxQwHu3VCsYoYDT2KGCkItAeBUymVjBGASOxRwGTqRVsjwJGLAK7x1isJFsr2B4FTONWcFuPArIVTOQdLABTSCq1gpsrAtkK9mMrWL8PW8FxMUVgG4wCshWcXmrmzjUFfVi4DyBZWACG+4VmhQZVwDYNTonjPuWyA6RKKzgWbAX7pWwrGNgKjg9bwa7YCm59hVOmmKLeGawnAhaA4XAy60M0KGP6a97QlGiS6pA58baCYykCga1gtoKbNNcKtkcB2QqOX2u1glu5CESBAB1RBAKLQKL2wwIwHE5oXeG/as6B2KjBQeCKsKKtlMYxKt+SVnAs2AoO1RGt4EhFILAVbGEr2OCsYCJKBAtAd6dqdmmqNXdp5mh2apIGW8EB6dQKjoSzgi1sBYdjK5iIWoAFoLtXNIUajPpdp/GffqENTZ2ghU4L9s1ti1nBKALZCmYruAlnBUfGVnCbYBHYCj7VDQqeF85gPZFiARgdtv5/0DykiXhytVmzZsnMmTNNSkqwu2DLtXUrONZ9AYGtYD+2ghVbwdGxFdxq0q0VjG2CvX3AtqK95E6dYp4bYdH1RMACsHnYD7CLZpRZcjF79myZM2eOybRp06y18cMoYLzYCg5gK9iPrWAXbAW3GFvBicE2wd4+YFtBlCxYAIb7sabYf9VM/rhfU6P5ECvaWnu1gjkrOFxbtYLdikC2gqNgKzhuGNkxWrkIZCuYKH2xAAx3kgZDKLs1izQoBk/UbNW0G84KDpeqreBI2AqOgq3guDUVga2MreAU9bluRPCccgbriRQLwHBnaPpp8jQDNN/SLNC0G7aCrSsuUASyFcxWcBO2gsOxFUwweYr/eeUM1hMpFoBJKplawck0K9jGVjBbwU3YCm7CVjARxYoFYJJLhlawja1gP7aCFVvB0bEV3GrYCiZqGywAkxhbwdYVF2wF+7EVbGErOBxbwUQUBQvAJMdWcHRsBbMV3ISt4CZsBZMs0w0HnoPOYD2RYgGYItgKDsdWcCi2gi1sBRtsBXvcIVP8H0ScwXoixQIwBbAVbF1xwVawH1vBFraCw7EVTEQuWACmCLaCo2MrmK3gJi1sBW/aUS5vL/hKSj5dKotWrJe6+gazvglbwU3YCiZKfSwAUwxbweHYCg7FVrAlxiKwurZeHn7hPbnzgX/L3Fc+lEVvfCxPPfW6/Oovz8o3612O/85WsMFWcJJboRsLPFedwXoixQIwhbAVbF1xwVawH1vBlhhbwT6fT554f6WsnfuhnNKnSI4aWCyHDyiWaQN6y7DaOvnrP1+Xjdt3WfdWbAWHYSs4SR04xf98dQbriRQLwBTDVnB0bAWzFdwkhlbw2s075eudmXJU7+6SVbnBWivSqVMnGV6YL33r6uW9BV9Zay3YiMaLreA2wSKQqOVYAKYotoLDsRUciq1gS5QicMnKjdJbL7v0GeZf4TBSi8AFi1dIQ0OjtSZIPKOANraCWw1bwUSJYQGYgtgKtq64YCvYj61gSzOt4H37aiU7I+htcNda64pfTpdMqa+vl7qGCBNC2ApuwlYwUWphAZii2AqOjq1gtoKbRGkFF/cqkF12cdd7iP8yqAjctrdaigrzpWuXztaaIGwFN2ErOAmt1Q0EZrg7g/VEigVgimMrOBxbwaHYCra4FIEHjxkse7OzZNueav8KuwhUDY0++bJirxw9aZzZJzAitoINtoKTzH5T/Ic6cgbriRQLwCRR+r51JQ5sBVtXXLAV7MdWsMVuBTuKwO7dsuW7Zx4lH1fskWXbdkltfYOZGbxl43J5Z+M26TtmiEw5IMonIbaCw7AVTJQaWACmOLaCo2MruONbwVGLQGjPVrCLw8YNkysuOVUah/WTl7eVyXO1ubJE1x81Pleu+Nax0jWri/+OkbAV3IStYKLUwQIwibRkFNDGVnA4toJDdVQrOKokaQXvN7SvXP39k+Q3N3xfbrnuPLnllp/I9AMHNF/8BWMr2GArOEls1o0CnuvOYD2RYgGYJKYe7r9kKziAreBwKALZCo6iha1gG1rChfm50rlzpn9/Kew0HwuPtoLrGxpk8fr18sqiRfLqF1/I11u2SGOj/5A5bAV3sBFT/M93Z7CeSLEADHe75gtNhQZb4Sc1MZY1ibGLwJZgKzi6dGkF29gKdpFgKziieIvAeKRwK3hDWZnc+dxz8q/XX5cVCxbIN/PmyRMvvyx/eOUV8R3s/8DBVjBR8mIBGA4fX3+g6anBOBkqgxc17Yat4AC2gsOxFRxFgq3gMBgFjJcHWsHlVVXykBZ+xXv3ysm9e8shmkOLi2WaXmZs3y4Pv/WW5E6ebN27fbEVTBQbFoDhbtIs1NRrMG50hwZb1QJNm2MrOBxbweHYCm5Ggq3gMGwFh5i3cqXkaPG3X2FhyCFyMvT6wT17SvWOHbJ0o/+5y1YwUXJiAdi8aRocGRYt4XbBVrC7WFrB0YpAYCuYreAmsbaC7VFAtoKbLNICcGg395FzFIQDunSRz9es4azgjrRdNwT4IOQM1hMpFoDRnai5WXOlWWpnbAUHxNoKjoat4FBsBVvYCjbiaQXX1NVJ18xMaylctt5WW+t/rdhFYHvzfCt44BT/68AZrCdSLAAjO13zL80FmjewIpJZs2bJzJkzTUpKSqy1iWErOBxbweHYCm5Gc0UgW8HhYhgFHNCrl2yrts6e4mJ7TY301/sE82orGNsEe/uAbQVRsmAB6A5F3xOa72hewIpoZs+eLXPmzDGZNg0d49bBVrA7zgoOx1awC4x2xIKt4CaxtoIPHzNG1tbXyz6NU0VtrWzt1EkOHT7cWhMYBfRiKxjbBHv7gG0FUbJgARjuas0fNRgBfBMrOhpbwQHpPCsYRSBbwZZYWsEoAtkKDmjHVvD+/frJxAMPlPd27pTVlZVS19goNQ0N8nV5uXygOfnww6Vfj9Ah+45uBXtuf8BKffPH68MZrCdSLADD/UGTq3lVg3Gi3dblkZp2x1ZwuHRtBdvYCrY01wq2YaPWnNZsBaMI9HgrGBM9zj70UDnjhBNke36+vFJWJq/t2iU1xcXy/enT5bixY617huuoVrDn9Jvi/5DkDNYTKRaA4fCYdNVgK4/kWZcfajoEW8HuOCs4HFvBLlq7FWzzeCs4IyNDJg0bJtecfrrccsEFcqvmqmnT5IABA6x7hPNyK5go2bAATCFsBQek86xgtoKDsBVsXYlDO88Kxmhgt6wsydHEgq1gouTAAjBFsBUcjq3gcGwFN4OzguMX47EB48VWMFHHYgGYQtgKdsdWcDi2gl100Kxgn88nG7fvkmU9Rsqasj3S2IizTcYoRWYFx4ut4HZQrW/4eM2EhZNAyI8FYApiKziAreBwnm0FQ5K1gldv3iFz/v6qzPnrf+Qf/yiRe1/5XH77+3tl8ZooT1g3KdAKjldHt4LTXtEU/+vGGawnUiwAUwxbweHYCg7nyVawPQqYJLOC12zZIfdr8ZejReApfXvKCf16yanjxkm/qlp55JEnZNHK9dY9m8FWcKtDEch9AcnrWACmoPZuBaMIZCuYrWBgKziKoCIQbd/n3/lMhjQ2ytjehdI5w/9Wm9GpkwwbNUYmZHeR/7zzsdQ3NJj1zWIruE2wCCQvYwGYwtqrFWxjK5itYOCsYBeOVvD28t2yZvUmGd2zwFoTalC3LNm3boWs2BR5dNcVW8GtJt1nBTc2zDUfpsLDfQDJjwVgimIrOBxbweE4K7gZbdQK3l1VI9mdfJKVmWmWnTr1Gyq5nTpJ5VdxbIzZCm51ab0/YPcp/g9UYeE+gOTHAjCFsRXsLp1bweXby+Tjl9+T1/78tLzz95dk7VerpX+j/5yrbAUH6eBWcPecroKnSF2D+4xftIirehRLXnYXa02M2ApuE2wFkxexAEwDbAUHpGsrGAVDxRvr5C83zJaNT5VIl8+WSfUbH8ubtz0gz9/9hPTc29+6Zzi2gqNoo1ZwcWGeDBnaX5aXVZhlp42790pWYXcZ1StPK/cWFB9sBbeadG8FE0XCAjDFsRUcLh1bwSsXLZMvHv23HFbcQwaNKJLhA4plfy0wjh0+QOoWfClvPfK8uR9bwS46oBXcac37csYxh8gqXfx6Z7k0NPqfK41ayK+r2CML91TLmSccJp0PsQphHiC6CVvBRO2DBWAaaO9WMLAVHFsrePfOMtmw7GvZvHyl1NfVmXW2WFvBGP37/MV3ZFRergzsFjoMivOxThg2QDZ+sli6bswz69gKDtKBreARtV/KledPk/KeBfLqlh3y9uYd8ppmTXaWXHDuCXLomKH+O6bpuYJbgq3g1lMjn5rXVng+te5BXscCMI20VyvYHgVkKzhyK3hPWZl8fv/fZc7M/5Pnf/cfefZX/5C/XXenLHnrfVPQxdMK3lNeKbuWr5H+xT3NcqEUyHapMtehS+dM6anfc8PydZwV7KYDW8GjBvaRn/7gDLn60jPl3O+eJFf84HS56bKz5eDRQ8ztIdgKNjq6FZwuGrOONq+v8Bxt3YO8jgVgkigt3Wddaxm2gsN1VCu4qqJCXrnjL1L7cY3kDjhRaodOleLhJ0qnzAPl7Qffkc9eeN3cL9ZWcGNDg3QSnzmGXLDgIjBTb8L9bGwFu+igWcGd9O82tG8vOWiElucDiiUz0+VtN5FzBSdSBLaGNGsFc19A8goWgEmktYrAluCsYP9lJPG0gr9690MpW58pvYYdKgO6+FvBKAK6FRRLzyFHyqf/+VAqd+w066G5VnD3HvnStVeR7KzYbd3iHwW0Yb+yMv3xPfsXm2UeINpFB88KjklLW8GJYCvYFYtA8gIWgEli6tR661riOCs4oL1bwTjR/9I3P5H8PmNM0Wfb4POPzmVld5fG+iJZs3CJWY6lFbyk8x7Zf/pU+XrrjpAzR9it4FUbt0n20P4y2N6nTLEV7KIDW8FxYSvY6OhWcKoXgXtloXm9OYP1RMACMImgCGQr2C9VW8H1NTWyb3e1ZHULHA+wr3Q1l3YRmNG5u+wtC3yzWFrB448/QgqOPEQ+WrlO1mshuKd6nxkRXLJyk3yu9edJV37HTAhxYivYRQe1gmOSSCu4JdgKdpUO+wN21g9keM2Fp/nRevIGFoDhztPgHQcH8MIWu90fI7aC/VKxFfyxL0u65mZLbXWgXQt2EQiNDXulW2GetRQQrQhc2mWvnPxf58vEH18sW/oXy0e7KgUP4fBzvi3H3HKxFA8KP3wMW8Eu0rkV3JJRQBtbwa7YCqZ0xgIwXJnmPs01ZqmdsRUcLpVawZ0yMmTsCZNk91b34mlNdaVkZOyQYRMPsNb4xdwKPmKifPvmq+XSB26Ti+6+SY741klyYNEBWo7xXMEGW8HWlTiwFewqXVrBRJGwAAz3huafGhzDtUOwFRyQiq3g8slHSkG/Gtm+eoE01AcOBl2we4/sXjtXup9xqOT3Di/4Yp0VHAnPFWzxeis4kSKwNbAVTJQSWAAmMbaC/VKtFdy1sFCKfny5DJmYLWXrSmTH6ndl28o3pH7ffDn9ByfIyLOnWfd219ysYDf2uYLdsBXsgrOC3bEV7CoVRwF3yRLzISw8/gloRCwAkxRbweFSqRWc07u3TLvmcjnvzmtl+nVnyRmzvifnz7lJDpp+omkTt/a5ggFFIFvBFraCrStxYCvYVaqOAmbLJPMaDM8k6x7kdSwAkxhbwQGpOiu4oE8fGXTQAdJ///2kS1f/RJC2OFdwMLaCLWwF+y/jwVawK7aCKR2xAGwFs2bNkpkzZ5qUlJRYa1sPW8F+qTgruLlzBUfDVjBbwQZbwU06uhXcEtgm2NsHbCuIkgULwHB4TDBUYx+3I1uD66Hn4Qoye/ZsmTNnjsm0adH374oXW8HhUqkV3By2gtkKjhlbwUZHtYJbCtsEe/uAbUV72S5fmdekM1hPBCwAw12kqda8apawbRJz0tUOO4M2W8EBqdoKdsNWsB9bwTFIpBXcEmwFp7w8GW9el85gPRGwAAz3mAaPS6YV+3qHv9uwFezHVrAfW8GW9m4Fx1oExqqtW8EtGQW0sRVMlLZYAKYItoLDxdoKjlYEshUcjq3gKGLdHxDYCjbYCiZKTiwAUwhbwQHxtIKbw1ZwOLaCm8FZwfFjK5goqbAATEFsBfuxFeyXiq3gSEUgsBXcDM4KbsJWcGSbZYV5jTqD9UTAAjDFsBUcjrOC/VKpFRwJW8FxYCvYYCvYXaG+a+B16gzWx+BWDd4Nd2ve1YzTRILbazT4+Iv74/K/NJTkWACmILaCAzgr2M9uBUcqAqEjWsGRikBgK9iBreCEcBSw1dyguURzkgafPPFxHwe4jfQJFm9ov9XgDSzPuvyzhpIcC8AUxlawH1vBftH2B+yoVnAkadUKbg5bwU3YCk4JV2nu1ODTG0b2btZ00ZytiSTicXIpebEATFFsBYdjK9iPrWDVnq3g5kYBbWwFG2wFt4/1ss58cHMG66PAJ9Chmnlmya9Bs0gz0Sy5Q9G4U4MX++2aXA0lORaAKSxVWsF1tftk1Tcfy1uv/FmqvvmDrFv2Hynfucm6tXnJ0gpuqKuTtYs/kzcful8+/+Nv5cE//lU2LP1CGhvw/hiKs4L92Aq2sBUcjq3gNlUso8zr1hmsj8JuQTg/Re7SRGpP/EyDb9pTc54Gp8N6UENJjgVgGkjmVnBlxTZ56Zk75e2Sl2TThk5Stj1Parcslz/PuUu+XPiWda/IkqUVXFO1V958+H4t/p6RzSsypHfVINm5rFae+L+/SenjD0t9rXuxxlnBHmoFc1ZwzNgKTlr2O5bzY3ChJtJH2o819hsO3qmv0ZyjsU+nSkmKBWCKS+ZWcGNjg7xb8pBUlHeX4j4nSI/CMZJXMEx6Fx8m2d2mynNPvyKb1i617h1ZW7WCoxWBzlbwvBefkQ1fVkjvwSdKjz77SW6PATJ24DjJHXiSLP94rXzxhn3mwIBEW8EoAtkK5qzgmLEVbLAVHO6jko/l7pn3mNw3635rrSsUefiUN8ks+eFMWGj/LjRLseN+gUmOBWAaSNZW8OYNX8r2rbukqNcE6dQp9L1gxIAektl5hCxb+J61pnmt3Qpujl0E7i0vkxXzFklR/0nSKQPvhQEZmV1kT4+D5ct3P5TaapxCOlRzrWAUgZFGAW2cFcxWcLPYCg7j9VHAFbLZvI6RntMGyWlzvmMybXa0uRwGKsTrNTj0C/Z4vk2DySD/0TgVa9DytT/N4mv+T/O8JrGNErU5FoBpJNlawVs3r9DCr09Y8WcbNWSYfDb/G2mor7PWRNaRreA3Fq4Vny9fOmeFz/4Y0lmkS7ciWb8rQ8q3RG6dJro/YDScFcxWsMFWcBO2gkUG6Kscr2VnsL4Zd2ke1bypwafEyZrpmirNIA2O9XekBrI1v9LgzQLvcigS8XU4jAwlORaAaaK1WsEoAlurFezzNUYs/qCT/ufTuqd0fqO1JrqOnBW8FW99EaAIjKY9WsGRikBgK1ixFRwdW8EU6hZNP013DV5c9r466zV5mg/NkpgpxRg6wD6C+LQ6WoNJIZHfkChpsABMI63RCra1Riu4d/FQaWzcrkWe++jWnt3rZfz+gyUjM8taE5v2nhV80pgh+kqplPpa9yqwpqpMMnN8sqTLAGtNuLZuBUfCVnAotoJdsBVM5EksANNQsrSCBww+UAp6ZEnFrvChuPq6Ktm37xsZN/5YOWZsp6Q+QHRuQZH0OWiifLlivvgaQw/50thQJ7u2LJATjp0inbNzWnyAaBtbwWwFR8RWcNzYCiaKjAVgmkmmWcGZnbvI8af8SLpkrZNtW943I37VVdtk5/bPZVfZ2zLxsCkyaFjg2KIdfYDoaEXgBeecK4UjC2TpV29I+davZG/5RinbvER2bHhDRk0aIgcdf0qbHyCarWC2guPCVrDh1VbwV7LDvK6dwXoiYAGYhpJlVjCKwKJeg+XM7/5UDj96knTrtkEyMr6UYaPy5NSzL5ODD/9W0z6CyXCu4GiycrrJFVf8t+z/ve9K/1E+6VawQYYc0FWmX3mRTP3+pdI5K9DGTuRcwWwFB7AV7MBWcEK8Ngo4VD++4cOdM1hPBCwA01hHt4Jt3XJ7yAETpstZ3/uZnHvRL+WYky6VvgP2ayr+bMl+ruDMLl2kaMzB0mXaVXLmtf8rx150uQzY70DJyAwcGibRcwXb2ApmKziiZG0FowhkK5goZbAAjOxWDbZ4mPL+rgbHN0oZydQKjlcyt4KT4VzBbAWzFRyX9moF29gKJkoJLADd3aDBcYxO0mCLijKmRBN9y5yA0lLUma0rWVrB8Uj2VjBEOlewE1vBfmwFK7aC48dWcEKWSIV5nTuD9UTAAtDdVZo7Ndgq4QjoN2u6aJo9hHoi2qIIhGSZFRyrZG8F22IZBWQrOICt4GZ+DmcFN2ErOHGjpI95rTuD9UTAAjActqxDNfPMkh+O/bFIE5iy2sqmTg09xVhraa1WMIpAtoID2AoOx1ZwFJwVHDe2gonaFgvAcPbQinPruEvT/LBLAlAEJmsr2JborOBYsRXsx1ZwAFvBDmwFJ4QTQsjrWACGszfHzs07TnXTTMOudaRrKzhebAUHsBXMVnBEnBUcNy+1gokiYQEYDptibL0mmSU/9GfR/l1olhxmzZolM2fONCkpwVyRlkv2VjCwFRzAVnA4toKj4KzguKV6KxjbBHv7gG1Fe1kgVeZ17wzWE0HkM/V72/WaqzWnaVZpfqG5UDNGE/zqwfBLhZL8/MS6ww88sM265lda2qBFW5611HpKSzvr9822llqm9BP/5dSj/ZfxKMWelGrqFP9lLEq/1Psfai00o3Sl/3Lqgf7LaEo36P3wF21G6Va93zBrIYJSraGmRj4VsJRW+y+nRu7KSml9o0yN8jT6NLNKjs52f8kutAanJ3dyP6/yEtmhn2hyraVQX8sWczk+bNAbT36c613rDOltLoNtkBXmcrS4/+Jb5CsZYnanDVcmX+hX4bzx4Sp1EwXF+lOd9snH5rJQ/7Vu6uUD6S7uT5aMWhzNSaSrTDaXYfb4C5WMzCiFwU69T06U2+2irSDKfdZZ9ylupgBZbt0vltHFZXrfYTHcDxZZ33d0jPeHT62vOTCOr7F9oF87sQVfF2TvO9bPn5zY93Eqs0YAu8ZQDBZfcYV1reUqKyuloKAAV/G/tuoome3SwxWrpVt++DakqnK3XFpg3tDa8t9AKYAjgO7u0jyqeVODIRBsMaZr2vWjE1vBfmwFB8TTCq6pqpLlH8+XBS+/IWve+Vje3b7euiUUW8EWtoIjYyuYKO2wAIzsFk0/TXcNthxLNe2Gs4LDsRUceyt4xacL5PGZd8pr974lc59aIasfWiFvXv+gPPLkM9JQ7/4cYCtYsRUcHVvBRGmDBWASS/dZwfHgrGC/WGYFv7R0iZTc+7x0yT5Y+o48VvqMwOVkGT7gVPnmxRUy99nXrXsGcFZwKM4KdpHGs4JRBKbbKOCn+mEQHwidwXoiYAGYAtK1FcwDREfW0lbwBF+erHz+XS3+Rkluj2JrrV/nrBwpGDJJXn/tE9lTHn42ALaCLWwFR5amB4i2pVMROF7yTFfAGawnAhaASY6t4HBsBUduBe8tK5NOX+2Q3cXuBVv/7N7iqy+QN76MXBmzFazYCo4ukVFAtoKJkgILwBTAA0QHsBXsF6kVXF9bp//PlIzMzrLBhxPYhCuQPGkw9wvHVnAotoJd8ADRRGmBBWAK4axgP7aCA5xFYLceBdIlu5MU7rWOO+Pg8+n9fRXSrVehOSaYG7aCLWwFR8ZZwUQpjwVgimArOBxbweGt4KycHBl7/CFSvmmp9PFlhY0CVmxdLYX9s+WY/Q4zy5GKQGjrVnBl+W75sGSe/PU3z8g/b/lS3nn6c1m08VPr1nBsBVs4K9hgKzi6ufrhEB8QncF6ImABmELYCg5gK9jPrRV80KknSp9RnWXbig+ktnKnrG+sl7qaKtmx5nPxNX4tx1/+bcnIzOzQcwVvWLVJ/vjzp+WlJ1bL1k19ZdfOwfLZS/ny0M/nyrz3l1j3DmjLVjCKQLaCre/LVrCBIjDVRwEP0fcGvD84g/VEwAIwBbEV7MdWcEBwEZiTlyenXH+FHPbdg6SwdolUrHpRKra+LaOPzJNv33y59BsVOiTa3q3gfVU1cv/vn5aG+pEyaOQkKeo9QHr07CsDhx8k+T0PkccefEvWrdps3TsgkVYwisBIo4A2toJbUJSlaSvYxlYwpTMWgCmGreBwbAWHf6LP7t5dDj7rVLngnpvlJ/feKgfcd4OccPn50mtQ6GnbOuJcweULfLJnZzfp1Te8iCzqPlI6ZQyU1955y1oTriWtYFubt4KbKwLZCg7HVjBRh2ABmILYCg5gK9gPRaCzFQyZnTtLt4IC6ZydbQ4C66a9W8Erl2yQgpzRUhHhexb3HCsrFpVZS6GSvhUcC7aCA9gKbjNzdROB9wxnsJ4IWACmMLaC/dgKDnArAgEHgG1OR8wKjlQEYrZyW8wKZis4Bu3dCga2glvdFP3QiA+OzmA9EfCZkKLYCg7HVnDs5wp2as9W8PBxA6Smeqt0jzDyWLFzs0yY6P8k0NoHiLZxVnAM2qsVbI8CshVM1K5YAKYwtoID2Ar2i9QKDtbRreD9Dt5P8ov2yc6t60wRGDwKWLWnXBobN8hhxx3YYQeI5qxgxVZwCBaBlI5YAKYBtoL92AoOSOZWcE5ujpz/k9MkI2O5rF/5qVRs3yIbypbLhlVfSPmOT+XsSw+XgcP7m/sCW8HN/BzOCm7S1q1gonTCAjDFsRUcjq3g5G8FDxwxUP77NxfIqReOlMH99kn3wtVy9KkFcvVtZ8uhx4y37iVtdq5gG2cFx4CzglPS3J36PqMfJJ3BeiJgAZgG2AoOYCvYLxVawXk98mTytMPlRz8/X6679Scy9ntDpe/AYuvWgJRuBceCreCAJG8Fp5Ip2fo+oR8mncF6ImABmEbYCvZjKzgg1WYFt/e5gtkKjgFbwURpiQVgmmArOBxbwakxK9jmPFdwMLaCm/k5wdgKNtgKJoqOBWAobGVe0eA8VI2a4zUpg63gALaC/VKhFRzMPlewG7aCFVvB8fPoKOBc3YrhA6YzWE8ELABDYUv4rOY0TfStZhJjK9iPreAAtoLZCo6IreC0NKVA3z/0Q6YzWE8ELABDfaV5SLNA0wkrUg1bweGaKwLr62pl7YrPJGPl4/LNBw/JsnlvmOPRNSfZWsGRikC2gv2SohUcDVvB7tgKJmoTLADTEFvBAc21givLt8lL/7hD3nzuGVm5rFLKNtTL8//6SJ79y22y9uvPrHuFs1vBsRaB0dhFYHOaawVHw1ZwQIe2gqONAtrYCg5gK5iozXilAHxEg336GqxLZ97WpB22gv0itYIb6uvknRf+KuU7c6V335OlqPcBsv/QMZLXa6ps33OovPPck7Jzy1rr3uFi3R8Q2AoOx1awC7aCw7EVTNQmvFIAztBgGKO3denMWZq0wlZwOGcRuGndUtmxdbcWfhOkU6dAx39IoUhWDoqagfJ1DBsezgr2YytYcVZwdGwFt5u5+tkV7znOYD0ReKUArNKURUlCQ2WzZs2SmTNnmpSUlFhrOx5bwQFureCNa76SzM79Qoq/YOV1w2TVV1+Izxe5ddpRreCG+npZv/Rz+aLkBfnijZdky4qvpbGxkbOCLZwVbGErOFw7jwJim2BvH7CtaC9Tevvfd5zBeiLwSgEYj64a+1jpXTRYjjqcNnv2bJkzZ47JtGnTrLXJg61gP2cruKGhTjIyOltLoTAK2KlTZ9m0HXsIRNfereC9m9fLw7/4uSy79w6pe+FfUvPcU7Jgzq/lnd/Plr278HlGvwdbwWwF29gKbtIRrWBsE+ztA7YVRMmCBWCoIZpqDbZw2ELimIAYPbxJk5LYCg5nF4HF/YZKXe1W/4KLoswNkt9naMQRQqf2aAXvrdgljU/cJcPKd8rkYSNl9NARst/QkXKkXuavXC4fPnCPTGmM/rdhK9iPrWAXbAUTeQYLwFDYOwKPCaqm4PxKk7LYCg4IbgUPHnmwZOfWyJ7KddaagPq6KqmtXSn9xkxNqgNEr17wkfTQ4q9vnwGyrjpQmGZokTpmsBara1bKxi8XsxVsSaQVvGPzOHnntbXy/L8+lfff/VIqKvBZMICtYMVWcNKau8L/odQZrCcCFoAewlawn90K7pqdK8ed/gOpq1ssO7Z+KtVV26VmX7ns2rFMyna8I+MPP0LOPNpfXCTLAaI3zf9A+hcUyRCrc702qCbBSGW/nBzZtOBTa41+D7aC424F19c3yL+fKJX7/vdJ+fJvZbL25bfkwwffk9/O/Ie899aysH1C2QpuQVHGWcFtbkp//3uSM1hPBCwAPYKt4HAoAvsPHitnXThTDjh0mPgaP5famo9kwNBOMv3ci+WQo75tiqpkOldw/b5q6dIZu6ZKUxEYLEtvw32AB4gOFWsruOQ/8+SrVxbJiQOL5PCRfeXAofl62SBHFeVKycOlsmB+4A/HVrAFRSBbwUQphQWgh7AVHBDcCi4o6ieTpn5HzrvyNvn+f/9OTjjrKi0CDwzb9y+eVnCsRWA0bq3ggsHDZdfu0MIqeBRw1949kj9oqLWk34MHiDZibQXvrqyST15bJIcN7inZWf4KO8MateyR21UO6JEjbz+3wMy4trEVHIStYKKUwQLQg9gK9nPOCo4m3nMFxyreVvDQI46TDbU1UltXZ5aDW8F7q6pka0aGDJ002b8yCFvBsbWCF2oB0722XvJyssyyDUVgrWySgT3zpGzdTtm2NfwBZSu4BUUZW8FEHYYFoMewFRwu3iIwVm3RCu4/epz0PuYUmbdhtWzeuU3qGxqkv9TJ1m2b5LMtm2TUORdKQZ9+/jtb2AoOFa0VXF/XIFlRZn03ZGyWznp7nd4vGFvBFraCk8ZcfZrjA6szWE8ELAA9iK3ggOBWcKzwJtqctmoFoy198Jnny+hLfixri3rLu5vWyntbNsi6IaOk/qL/lf2PPcm6Zyi2gv2aawUXFefKNl+ZNDSGPxYYBaysqpeGrM5S1LO7tTaAreAgbAV3uCnD9HWvH1qdwXoiYAHoYWwF+6VaKzgjI0OGTzxCTrzmFjn113+S0277s/xwxg1SOPpAnis4SEtawaOHT5ceIwtlyabwY2Vg9u+Xm3Jl7HFdJTcXx4d3x1ZwC4oytoKJ2h0LQI9iKzhcKrWCAaOBXbvlSla2/yTBsZ4rmK1gP7dRQDym51x6iazP7iLzV26V8r37pK6hUbaV75UPlm+RjJF95MQzh/EA0bFgK5goqbEATBKlpZHbYG2FreCAVGsFRxNtFJCtYL9oreD+g3rLD35xpPQ4tUg+2r1PXl23QxbrQzLhwqPlRzecIT3yjrfu6Y6tYGWPArIV3GHmLtD3Av2c4gzWEwELwCTSEUUgsBXsl4qzgp3sUUC2ggNa0goeUHyCnHr+OLn6vkPl53++XG68+2I58dSJkpvrP004zxUcA7aCO9SUMf73NGewnghYACaJqVP9G5b2xlZwuHiLwFi1VSvYia3ggERnBWdmZkhOTpbZ79INW8HN4KxgoqTFAjDJsBXsLllbwSgC2QoOlU6zgiHSuYIxChgNW8FBUqwVbIpATgihNMcCMInYo4BsBYdK5lawja3gcOnQCnY7V3AwtoJjkIKt4CYsAimNsQBMMmwFu2MrOBRbweHsVrBbEZhoK7g5bAU3g63gdjf3E31t6/ueM1hPBCwAkxRbwe44KziAreBwsewP6IatYAtbwSFSuRU8RZ/ueO9zBuuJgAVgEmIr2B1nBbtjKzgcW8Eu2ApuObaCKQ2xAExS6doKbo0ikK3gALaCw7EVHAVbwXHjrGBKVywAk1y6tYJbC1vBAWwFh2MruBlsBcclFYvAudjnT98nncF6ImABGOoizQeanRpsdd7WTNF0CLaC3bEVHA5FIFvB4dgKdsFWsCdMOVRf9/pe6QzWEwELwFDdNbdqsNXBVul5zWua/poOwVnB7vBGhk+zLZVurWAbW8EBbAVH0Vat4HiKwBRrBROlGxaAof6keUODrVSD5vfW5SRNh+KsYHctKQLboxWMIpCt4FBsBfuldSs4XinWCiZKJywAoztck6txf6dvJ2wFu8MoYEu1dSvYxlZwuERawW5FYCKtYBSBbAU383PYCiZKS14pAB/RNGowmodLZ7Cvn9MgzVOa2zWRdyRqJ2wFu2Mr2F26toIjaWkr2MZWcAw4KzilzJ27z3zIdgbricArBeAMDbY8va1LZ87SBMPW5D0NCsBfYkU0s2bNkpkzZ5qUlJRYa9sGW8HukrUVDGwFh2Ir2I+zgoOkcSsY2wR7+4BtRXuZMqXevMc6g/VE4JUCsEpTFiXB1Q22BnhneVDzM6xozuzZs2XOnDkm06ZNs9a2PraC3SVzK5izgiNjK9iPreAWFGUp1ArGNsHePmBbQZQsvFIAxgqHfHlH81tNUr5S07UV3BpFIFvB4dgKDmArOArOCibyHBaAoW7TFFiXGO5CsPm7UZNU0q0V3FrauxUcTxHIVnAotoL9OCs4CGcFt5q5c/eY92tnsJ4IWACGOl7TWYP+VZ4VXMeIYNJgK9hdR7SC48VWcDi2gv3apRUcrQhkKzitTJmSaT60O4P1RMACMEVxVrA7toLdsRUc4OlWcHPYCibyDBaAKY6zgt0l66xgtoLDtVUrGEUgW8Eu2AoO8EArmCgSFoApjK1gd8k8K9jGVnC41m4F29gKDsJWcLg0bwUTRcICMMWxFeyOrWB3bAUHsBUcRVu1gmPFVnDC5s7dYQYHnMF6ImABSC2WCq3glmiPCSGxFoGxjgK2Zis4mlhawS0VSyu4JWIpAt3E0gpuiVhawQmJtRXcGuIZBUQRGOsoYEskOgqYZqZM6WoGCJzBeiLoZF1Sy6CvVaEkP7/5FhcREXlXZWWlFBTgSGPmcGPN7FDRYma7dM89CyUnBweyCFVdvVuuuWYirrblv4FSAEcAiYiIiDyGBSAREVGamTt3k5SWbggL1sfgVg32GMY+Pu9qxmkiwc4lf9dgJ12cWvUJjRnmpOTGAjAJ4eThXsDfM/3wb5pe+HumrilTesjUqYVhwfpm3KC5RHOSBjvmYkocHqBIO/ii+OutGabBDrfYYfcxDSU5FoBJiG+66cUrvyfwb5pe+Ht60lWaOzWY5l6juVnTRXO2xglT8E/RzNTs0mAE8DrNmZo4DmRFHYEFIBEREQEmkAzVzDNLfg2aRRozc8QBx0zAIRuWmCW/LzQ43lMLjqdA7YmzgBNjZlutX7++VWcBz5o1S2bPnm0tpS/+numHf9P0wt+zdWEW8KBBg3C1zWcB//a3r0t2dq5/TZB9+/bKjTeejKtu/waM2q3T4MBWwUcgfUqD+15hlgIu1GC0sJ9ZCtiiwajgk2aJkhILwMQM0GzwXyUiIooJCq0oh2VPCM4OgMPCRzt4Jlq12H45D7iK4hGTOSZrPsEKC3rkOH/R9WYpAK1eFIfO/QPxfc/VvGSWKCmxAEwMHr/+mrY5JxoREaUbHJwPU3Gjnzw7MSgCs/xXXaFFG+lo+6s0czT3miURnPZps+ZaDSZ8BMM+gCg2x2vsNjCuL9AM0XCAhIiIiCgFYJQP50fEoV9wgsjbNes1kWYBv6h5TdNTg1nDb2j+oyEiIiKiFHKLBqN+ezTBxwHEDozoeB1plvxwXJm/adA6xkzgxzWtt1M8ERERERGRF2AH28812GEXma85R5NuLtJ8oNmp2a55WzNFk24O0ryiwSfrRs3xmnQRz5kDUtV5mlJNhQaHxkjXw2ih5YdDeeD3xN8UMznT8Zhuv9Cs0GDkapvmVQ32XyMi6nCYWh88vf5oTZXmQLOUPnDgURx1HscswA7HP9HgkAOYYJNO9tP8SHOwBgVEuhSAOHPAWs1YTVcNjqeBnb8j7TOUqvAcRRH4Q006F4C/0eCYb501aOVhx/+FmnQzSmOfsgy/Kw5bgsOXcHIkESUVvCkdpUEB+G2sSHPYl+Qs/9W0lE4jgJg1eLX/qoEifqvmArOUfo7RpHMB6IRRMfy+6Xx+V3xwuUaD3xOTGYiIOhw+gaMYwil5UDS8p8GbVTo7XIPDFOCI9OkqXQpAPD/xu+BvFgzHDbvLfzXteK0A/KkGRX46OlWD91c8h+s1OKgxkSfwVHAd4xEN3nCwEcGlM9gHzoZWaKEGx47C/n/YhwzFUSqI5/e0YZYZDiyK/ZBwKIJU0JLfM13Ys/2wH1UwbFQ5EzD1najBuWCvNEvpB++neH8t0uActh9riIjaDPaNwhtOpKDYi+RlzQz/1aQX7+85UoORBhR/qaQlf08UhhwBTE1eGQE8XYNCHpPRvAC72eCDTLrtY01EaeJ1zR/8V9MKZsji6PizzFL6S5cCENz2AcSsSu4DmLrwt0PxhxFAr8BEkL0aL+xjTURJDodHwUw1bGhwap//0tRppmvSCQ75gkPA/NgspTfsv4m/JQrAadYyCqZUFu+ZA1IVXof4e+FM+igA8fthOd1mjaKYx2Gngg/2m47wflPsvyq9NQ9o8Hv3wQoioo6Eo7FjdAXHVsPx8T7U4ATb6Qb7yGEHbOzviN8VwfUbNekE58ZE4YfiITg4Hlmqi3TmgHTyA03w38++PlWTTvB7YdIZXoP2axKX6VYQ4hRmeM7i98PxDp/T4BBNRERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERtTuT/AaQg6DiyP5J/AAAAAElFTkSuQmCC\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "res = train_and_plot(30)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "hidden_dim = 5\n",
    "W1 = parameter(shape=(input_dim, hidden_dim),init=cntk.uniform(1))\n",
    "b1 = parameter(shape=(hidden_dim),init=cntk.uniform(1))\n",
    "y = cntk.sigmoid(times(features,W1)+b1)\n",
    "W2 = parameter(shape=(hidden_dim, output_dim),init=cntk.uniform(1))\n",
    "b2 = parameter(shape=(output_dim),init=cntk.uniform(1))\n",
    "z = times(y,W2)+b2\n",
    "loss = cntk.cross_entropy_with_softmax(z, label)\n",
    "eval_error = cntk.classification_error(z, label)\n",
    "\n",
    "#pp=cntk.logging.ProgressPrinter()\n",
    "\n",
    "learning_rate = 0.2\n",
    "learner = sgd(z.parameters, lr=cntk.learning_rate_schedule(learning_rate,cntk.UnitType.minibatch))\n",
    "trainer = Trainer(z, (loss, eval_error), [learner])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Многослойная модель\n",
    "\n",
    "  * Можем описывать сложные графы вычислений\n",
    "  * Нельзя забывать про передаточную функцию (мы использовали `sigmoid`)\n",
    "  * К последнему слою передаточная функция `softmax` добавляется автоматически\n",
    "  * Надо подумать про первоначальную активацию весов (`init=uniform`)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "scrolled": false,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAHeuSURBVHhe7d0HnBT1+Qbwl350jt6biFTFgggKYgMVS1QsEVtM1Bj9G4MaDdGIRjFRQzSKJsZeiZpYsJ0VQREBEQRBeu+9H1zZ//v8dobb25vZOrs3u/t8/bzuzuxyZW9359lfGyEiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIi/7lYa5LWDq0SrapakTTSekVru9ZWrZe0GmoRERERZYVoYSgbIMSN07rZbEWH8NdMq5NWF62WWi9oEREREWWFKtZlLjhR63OtGlql2OGgvdZyrcO15mKHwvVZWrhtNXaEwOPXWmuX2SIiIqJMUV9rrVbAbOUYBsDyztEar1XHbJUp1Bqu9Z7ZKtNGKzwUEhERUWZoq7UmeDW3MACWd5nWQ1qtzFaZ9VojtV41W2UaaO1YtWqVNGiAqxSvUaNGyZgxY6wtihcfv+Tw8UsOH7/k8PFLTjKP386dO6Vdu3a4ijH+O3GFshcCYLRJIGgB3Bu8Wg5aAM8KXi0HqS+wY8eOACXmd7/7nXWNEsHHLzl8/JLDxy85fPySk8zjh+M2jt/WcTwn5cIkkHhgrF8trV5mK+gILbQa4jZH+BQycuRIUwUFBdZeIiIi8gscn+1jNY7buS4XuoARchHg0AL4oRYGfaIl8ICW08DPCVq4/wgtPD6vae3WOk8rnOkCVuwCThBekEOHDrW2KF58/JLDxy85fPySw8cvOck8fugCbtjQrPCWs13AuRAAr9R6TssOe/idcf0krWVa87RO1/paC7AO4ONa6PLF/RAIb9RyeoIwABIREWUYBsDcmgSSCgyAREREGYYBkAEwWQyAqrCwUA4cQI86ERFlgpo1a0peXp61lXsYABkAk5XzARDhr1OnTrJ+PVbKISKiTNCyZUtZtmxZzoZABkAGwGTlfAC0X0RcC5GIKDPgfRtr4PHYxQBIiWMAtF5EufwYEBFlEr5vMwAC1wEkIiIiyjEMgEREREQ5hgGQiIiIKMcwABKFeeedd+Tvf/+7teWtX/ziF9K5c2drKz6YbX311VdbW0SVb8WKFVK1alV58cUXrT2xP8eff/55829Xrlxp7YkNxq3dc889MmtWxbNznnTSSXLyySdbW0QUCQNgJXp65tPy1HdPWVvkF2+//XbKAuCf/vQneeutt6yt+ODnuuuuu6wtIn+K9TlepUoVU/Havn27CYAzZ8609pR58skn5YknnrC2iCgSBsBK1Lxuc/nTF3+SvUV7rT2UaeJdAButeEcccYS1FR/8O/z7TFJUVGRdK6+4uNi6ljguPu5PyTzHYxEIOJ3CPahbt26mMkWk53Cyz+/S0lIpKcFp74mcMQBWorO7ni1tG7SVJ6c/ae2hyobuqxdeeEHWrFljuqdQdnfWxIkTzTZaN6699lpp3ry5WUwVlixZIldccYW5b506deSQQw6R3/zmN6a1ItRVV11VLsTZXWhPPfWU3H333dK6dWvJz8+Xc845x/wMoTp27FiuC9juQvv222/lsssuM0satGnTRn77299WOHhgwdczzzxT6tata37mW2+91XxP/PtYuuD+97//Sf/+/c2/x8930UUXmbUfQ+H3uvzyy+W5556T7t27S61ateSDDz44+Duideb22283PyMWn0VXHkybNk1OPfVUqV+/vtSrV89cnz59urnNhscN65ZNnTpVjj/+ePMY42tRfN58803zt5g7d661pwyeH0ceeaS1JTJu3DgZMGCANGnSxPzN8ffH3zOa8Oc44Pk3bNgw8/xp0aKF3HzzzbJ//37r1jL/+c9/5JRTTjGvLTwfjjrqqHLdy3gu4TWGlsNf/epX5nepVq3awfsMHjy4QhfwwoUL5bzzzjO/A543+D0KCgqsW4NGjx5tvtbixYvlrLPOMt8br7c///nP1j0i27dvn3k+4mfD8x6XY8aMKRdWv/zyS/M9nN4/7O//448/yumnn26+/8UXX2xuA/RIINjia+M94v/+7/9k165d1q1B+Pd33nmn/PWvfz34czj9nYnIG1hAKaAHMn2dJ+b9he8Hmj3YLLBr/y5rT2bB757sY+AnS5cuDeiBKqAHqYAGk4CGq8CsWbPMbRoAA3rgCbRt2zZwzTXXBPQgEnjnnXfMbZMmTQrccccdgbfffttc1xAZOOywwwJ6ADW32/TgGNCDo7UVCCxfvtx8TewbMWJE4KOPPgrowSzQtGnTwEknnWTdK0gPSAENqNZWIKAB0Pzbrl27BjQ8Bj777LPAfffdF9ADYkAPKNa9AgENgwE9IAQ0QAVeeumlwIcffhi44IILAh06dAjoQSOgB1Xrns40uJnvowdc829ff/31gAY88zV3795t3Sv482m4C/Tu3Tswfvz4wOeff24eT/t3xOOmB+LA+++/H3j33XcDhYWFgdmzZwdq164dOOaYYwIaMk317dvX7Pvhhx+srxx83PSgaL7H448/HtCDqfn7UHzwmDdq1CigYcXaE7Rhw4ZA9erVAxo0rD2BgH5ICOiHBPO8+vjjjwMaOszzBc97m/23xfPdFv4ct59/eG7gfhoiA+eee655PoY//+6///7AY489Zr4Hvi+e1zVr1gz861//MrdraAxogDLfU8OOeX2iNm/ebG7XAFjudbN27VrzWtIPZIFXX3018N577wXOOOMM8xrBa82G1wu+Jp67Y8eONd9bQ6rZh9dZJMXFxYETTjjBfJ9//OMf5nmv4S+gH3LMY2iL9P5hf/8uXboEHnjggcAXX3xhnuPwhz/8wdx20003mb/DI488EtAPSoFBgwaZ2224Dx5j7MfrCF9/48aN1q3lZdv7diLsx8A6jhPFLekAWFpaGuj3736Bv0z+i7Uns2TjGwkOYDg4hbPfwBGeosFB4auvvjIHODtAglsAPPnkk609QQ8//LD5t+vWrbP2uAfAe+65x9oTdNZZZ5nwacPBE19rxowZ1p6gI444osIBOBwCXsOGDU34C4WfGwfmRx991NoT/Pnq1q1b4aBj/44IeeHwWObn5wd27txp7QmY640bNy73OONxw886YcIEaw8lCuEj/PmN4FejRo3A+vXrrT3l4X0Kz+khQ4YEfvazn1l7YwuACJH424UGdny9nj17Rnz+2d8TP2+fPn2svWXf85lnnrH2lAkPgLfccov5vfBBxFZSUmJeH0cffbS1JxjA8LOE/h6AQDh06FBryxk+sOHf4vUeCmG2Vq1agU2bNpntSO8f9vdH+A21detW8zWuvvpqa0/Qyy+/bL5W6OsB2wiACMnRZOP7drzsx8A6juckdgFXMn3Ryj2D75EHpzwoO/dn/2Lk6PbBCuxO5TZeBfud7o9y6kZKNT0AWtfKYKwbunzQ9YluJj3oyMCBA81tCxYsMJeRnHHGGda1ID3wmMto3bN4/qDrLhT+bei/Qxdx+/btRQ941p4gPRBZ19x98803pqvp0ksvNX8Hu9CNiy6pSZMmWfcMOu6446RZs2bWVnnnnnuuda3M5MmTD3a52XAdXeDoMguFxxTdiH6lxxTzGk5l4XskC0MVVq9eLZ9//rm1R0QDhel6Rfes7bvvvjN/G3RTVq9e3Tz+n3zySUzP51Dotkf3fd++fa09wecthhGEQxfsz3/+c2nbtq35fqinn3467u9pw/MLz0kNpNaeYFcpvgdmEesHHGtvUPhrqVevXlFfgwUFBdKhQwfzfUJfI6eddpoZioHfP5TT+4ct/Db8W7y3jBgxwtoTdMkll5i/SfhrBN3H+sHM2iKKjAHQB4YcMkS6Ne0mj337mLUnez3wwANmrJpT/fTTT9a9ysN+p/uj8PXSrVWrVta1MnfccYfce++95uCKcVIYw4axPjhgFxYWWvdy17hxY+taEMbvQKL/NjQYr1u3zow3Chd6sHezceNG8zsgHNgHZBQOMhhftGXLFuueQU6Pjc3ptq1btzruR+jYtm2btRWEYIng4Fe7DuyShn/R52UKC98jWSeccIIZ3/bSSy+Z7fnz55sZtVdeeaXZBgREjMXEGNbHH3/cfBCYMWOGCRixPCdD4fnn9FwL37dnzx7zPefMmSMPPvigfPXVV+Z7Ytxroh/0Ij2/8LwOf445vZai/b54jSxfvrzc6wPVr18/83xN5jWCnx/C92PcI8Zm2rfbIn1tonAMgD6AN4l7B98rf/vmb7KjMDgwPlv94Q9/MIP/ncpt9h72O90fha+Xbk4hBIPXcQDFz4OB6GhtQ0D1AxwUcJAKt379euuaOxxk4MUXXzQH49BCyMVEklCRAprTbTjgOv0c2IdB+6EifW0/qF+zvuy4Q5+XKSx8Dy9g0hAm9iDcIAii1TW09emjjz4yLexvvPGGDB8+XI499lgzIWPv3vhXLMDzb8OGDdZWmfC/O0ImJhb9+9//Ni3OaFHD93SbSR4Lt+cXQimeT+HPsUTgNYJJF2gxdXqNnH322dY9g+J5jeDnR1AN/x3QwohgGR5Y/f4aIX9hAPSJkzudLL1b9JZHv33U2pOd8IkaJx93KnyqdYL9TvdH2S1lXsLXxKw+J25vsDgwoksm1LPPPuuLN2QcSNGNhQNSqP/+97/WNXeYBYpwsGjRInMwDq9DDz3UumdiTjzxRNNiitYfG7qcJ0yYYBb1zST4Wzeopc/LFJZXzyfM1kb3J54Dr776qhkOgJnZNjvohT6nMZv266+/trZih1m3CHaY7W1DqHn99detrSCn74kWunfffdfaCrJf826v0VB4fqEbNbQbF8uj4AMbnr+YdZ4stIri98MM5/DXByo0pMX798NrF63t48ePt/YEYRshEB82iRLFAOgTeGPAWMCx34yVbfvKd0tQevXo0cN0rfzzn/80oSl0KQUcuJzgIPDCCy+YpU4wTur66683LRrJcPte8brKWpYDS2GgJe/DDz80B3y0oALGRLlB+HvooYdMVzt+JxyMMe4IoeG6666rcGCKFxa2xoEfS3egRQqFbkAc3LnodeoguKNVD0MXEF4QCEPhb4APXtiP5zOe20OHDjVj3eKFlnE8/84//3zzdfD8Q2tj+DIm9oeNG264wXwoQEBEwAkfU4quY7S64bmHMahoeQvvCrX97ne/k0aNGpnxeK+99pq89957Zlwjxhref//91r2Sg/F5+NnxHMZyLRhbiRZUdJ3jMQvtQo73NY0WyltuucWMg8Tvgr/Fo48+al6LGGPs5zGx5H8MgD4yuONgOarVUfL3qak5CwXFBuuLYZD1H//4RzOOBxMSbG6f4B977DFzP6zDhX+LFi23cBT+Ndy+ptP93O4bLvR+GI+EAwcW58WBA4EQB3KsUwjRuqqxZhmCH1qAMMYRBx2ciQEtEH369LHuFfnnc9uPCStYXxE/A34uhAVcx4Hdnghji/V3p9gg3K1du9ZMuAhvbcWHIIR8tJxh8s7DDz9s1pezJzaFcvq7hO7D8+/TTz81zxWEO/yd0WUaHvCbNm1qznaD59WFF15oXn/XXHNNhQkQ+NrPPPOMaR1EsEOQRbCzhX5vdD9jLGHPnj3N8x0TTzCuEQET/zaU2/PLbb8NLZaYCILXCbqv8fpAFzu61jHeMnRSRqSv5XYbgurYsWNNqER3MsZH4jEM/Z0B/z7az0oUis+W5GD6+A60pKA70guTV0yWYa8Ok2W/XSZN6gTHX/kZxgnhgO3lY0DpgZYQzK5E9y4R5Q6+b5c9Bgr/y/4lOBywBdBnBnYYKMe1Pc5MCCHyCrqm0DqB1ja05qH1B11xv//97617EBFRLmEA9CGMBXxs2mOyee9maw9RcjBw/pFHHjFdSOiixrhGdKOhi42IiHIPu4CT43kXsO3MV86U3s17y19P+6u1x5/YlUBElFn4vs0uYGALoE+NHjxaHp/+uGzYXXH9LCIiIqJk5EoAvEdrjRbWHZio1VPLzTFaOEcS1hXA6rlYLK29Vlod2+ZYszbgg18/aO0hIiIi8kYuBMDbtK7Swpz/plpTtAq06miFQ5f4+1qztHDuLJxAsljrNa20w1jAJ2c8Ket2rbP2EBERESUvFwLg9VoPac3TwgklsfhUDa3ztMJhLABC4nNaCH44PcGLWmWLnaUR1gQc2mWo/PVrf48DJCIiosyS7QEQo1s7ak03W0ElWmjhO9Jslbdda5wWpkbW1mqkhdbD6OfMSpHRJ46Wp757StbsRA82ERERUfKyfRZwWy2cBLK71gLssOAUDZj1c63ZKm+Q1j+1cJJTPD4Ii2dobdIKl9QsYJwWaPny5eY0SZEMf324tKzXUh4/83Frj3/YM6lwOinOAiYi8j+8b7dr146zgHN8FnC2wzO7VKuf2SqDMYAPB6+W00UL3cTXaaGbGK2AmECy2LoeDl8/oC8izXLx+/LLLwONGzcObNiwwdrjbM6GOYG8+/ICK7avsPb4x759+wItW7bECS5ZLBaLlSGF9228f+cqHLetxyJnWy5yYR3ApVpjtezms2pamFXxO61XsCPE+VrPaOWbraD6WjhrPkJkaFcy4ImzA+e3tM/3iJN/o2I1fPhwcy7JaCfVv+TNS6RRXiP551lonPQXnOz8wIED1hYREfkdjll5eXnWVm7AOZtRgGPWuHEY8ZW7LYC5EABv1bpRa5gWwuCftC7TOkxrr1YoLPcyX+u3WpgIglbA27VGauE2BMFQJgAm04y+fv166d69u7z44ovmLA1u5m+aL0f+60j56cafpGMjDGskIiKiRLALODdmAaOr93mtT7Uwjq+/1ulaCH/ttLA24PFagPGC52pdrYX7YubFSVoIj+HhzxMtW7aUv/3tb3L99deb8RhuujfrLsN7DJf7J91v7SEiIiJKTC60AKZS0i2AEAgE5LTTTpNDDz1UnnzySWtvRQu3LJTDnzxcfvzNj3JI40OsvURERBQPtgDmzplAfK1KlSry1FNPSVFRkZSWYs6Ks65NusrFvS6W+ybfZ+0hIiIiih9bAJPjSQtgPBZvXSy9nuglc66fI4c2wUo1REREFA+2ALIFMON0adxFRvQeIfdOutfaQ0RERBQfBsAMdOegO+WNH9+Qnzb/ZO0hIiIiih0DYAbqlN9JrjjiCrn3S7YCEhERUfwYAH0s0uLKfxz4R/nf/P/Jjxt/tPYQERERxYYB0Ke2b98uXbp0kUWLFll7yuvQqINcd/R1cvGbF8uqHausvURERETRMQD6VKNGjeTcc8+Va6+91qwT6ORvQ/8m/dv2l/7P9JcfNvxg7SUiIiKKjAHQx8aMGSNLliyRp59+2tpTXvWq1eWps58yLYEDnxsony39zLqFiIiIyB0DoI/Vr19f/vWvf8ltt90ma9bgrHQVYRHpu068Sx49/VE5Z/w58vIPL1u3EBERETnjQtDJSctC0Jdddpns3r1b3nrrLRP43Hy85GO58I0L5Y7j75A7Trgj4n2JiIhyFReCZgtgRnjkkUfMZJC1a9dae5wNOWSIfHnVl/LYtMfkN+//RopLi61biIiIiMqwiSg5aTsVHM4RXLVqbHl95Y6VcsYrZ8gh+YfIaxe8JnVr1rVuISIiIrYAsgUwY8Qa/qB9w/by1S++kp37d8rJL54sG/dstG4hIiIiYgDMWvm186XgsgLpnN/ZLBOzaIvzeoJERESUexgAs1it6rXklfNfkQu6X2BC4NTVU61biIiIKJcxAGa5qlWqyoOnPSijB4+WU188Vd756Z3gDURERJSzGAAzEM4M8otf/EKmTZtm7YnuxmNvlJfOe0lG/G+EjJs2ztpLREREuYgBMANhfT+cJ/iXv/ylHDhwwNob3Xndz5NPLv9E7p54t9z+ye1SGii1biEiIqJcwmVgkpO2ZWDCFRUVyTHHHCPNmzeXiy66SIYOHSrt27e3bo1s4ZaFZpmYfm36yXPnPmfGChIREeUKLgPDFsCMVaNGDXn//fdl8ODB8tJLL0nnzp3liiuusG6NrGuTrvLNL7+RJduWyEkvnCSrd662biEiIqJcwBbA5FRaC2A4/AwbNmyQrl27Wnui21e0T2768CZ5e8HbZrYwziRCRESU7dgCyACYLN8EwEgwaWTAgAHSo0cP01V86qmnSuPGja1bRV6Y9YLc8MENckv/W+RPJ/5JqlWtZt1Spri42ITM7du3m3GH3bt3t24hIiLKLAyADIDJyogAiNPIffHFF1JQUCAfffSRzJs3T/r27WvC4M9+9jPp06ePzNkwR4a/MdycRQStgc3rNpfzzz9fZsyYIdu2bZPdu3ebr4Wu56OOOkqmTnVeU3DChAny008/Sc+ePU3gxLjEeM5iQkRElGoMgAyAycqIABhu7dq18vHHH5swOHDgQLnhhhvM/l37d8k1E66RySsny3+G/0eqrq5qWg/z8/OlUaNGpmrXrm1mIbt58803Zfz48fLjjz/KokWLJC8vz7QWIgw++eSTUqdOHeuelKzNmzdLtWrVzN+HiIhixwCYOwHwHq1faSGlfaeFxPOjlpurtEZqddZC09d4rZu1wmVkAIwEge+J6U/I7z/9vdwz+B7TLRwp8EWCruKFCxeaFscFCxbInXfe6fi15s6dK99884107NhROnXqJO3atZNatTgz2Q264//xj3/I6NGjTYvsM888Y1pyiYgoNgyAuREAb9O6UesMrSVad2thuixmS+zVCneL1m+0LtdCPyeSyGFas7TCZV0AtE1bM00ufONCObLlkfL8z56XRnmNrFu898knn8hDDz0ky5YtkxUrVpiA07p1axMG0WrYq1cv654ECNaXXHKJ/N///Z+Z+PPrX/9aLr74Yhk7dqzUrVvXuhcREblhAMyNALhUa6zW42ZLBDMc1mqhhe8V7AhRXwu3Xaz1AXZEkbUBELbu2ypXvHWFzNs0T9648A05uvXR1i2pg/GK6KJevny5CYSnn366NGvWzLq1DILiVVddJYcffrgMGTLELIeTq+EHj8Vll11m3szee+89ay8REblhAMz+AIhUtl2rv9a32GEp0JqjdavZKjNUC8EPrYa/1sK//17rdq0ftMJldQAEnC3kwa8flD9P+rOMHTJWrj362oS7hL2EiSnvvPOOfPvtt2Zyy+rVq+WEE04wYfDSSy+NeVHsbFFSUmKCM7rPiYgoMgbA7F8I2k5lCIGhtmk5JbamWkg352oN0uqgNVvrIy20DuacqlWqyh0n3CHvX/q+OYXc5W9dLrsPBGcEVyZMfEALILqIly5dKvPnz5fhw4eb2cmrVq2y7pXZMC4Sk2ligckgDH9ERBQrtgCWd7bWO1qna32MHQoheZfW+Vr4d6FMCyBm0dasWdPswNIqqGy0btc6+fl/fy4b92yUNy96U3o062Hdkhk2bdok33//vZn5jNnMicAkmT179phPj5io0qRJE+sW7+DnvOOOO8xs6qeeekpGjBhh3UJERIlCbxEKMJZ63LhxuJqzLYC5AGMAMQnEhjGAG7WcjqpttUq1Qk+Jgfvv0XJKdQiAgR07dmguyA1FJUWBP3z6h0C9MfUCL89+2dqbGSZPnhxo165dQINb4LTTTgs89NBDgTfffDPw7LPPBtavX2/dq7y1a9cGevXqFWjfvn2gUaNGgapVqwbwN0f9/ve/t+7ljeLi4sCTTz4ZyM/PD/zsZz8LLFu2zLolcfiaDz/8cGD37t3WHiIiwnHbei936g3MCdneAgho5UMAHKaFMPgnrcu0MLPXaRbwf7XQrHOR1g4tzBrGjGCc+iK879O0AGbzGEA37y9833QHn9D+BPnVUb+SM7qcITWq1bBu9S993ZulafApEGshYhYtxoE88sgjjrONCwsL5fPPPzd/X7tw//r160v16tWte1V00UUXmdPy4Qwsxx13XLkzrziZPXu2/OpXv5KtW7eaJV6GDcPTNXn4eueee65pVXzttdfkyCOPtG4hIspdHAOYGwEQRmtdp4VxfDO07HUAMWhqnha6fL/Wgnpaj2ihy7dEa7oWQiTuFy5nAyCs2blG/vXdv+SF2S9IYXGhXNb7Mrmyz5VyeIvDrXvkJkzIePrpp80YvilTpsjixYvlsMMOk/79+5tgiJnN4TCZ5cMPP5Tbb7894e5pN1hW54EHHjB17733ysiRI3l2FiLKaQyAuRMAUyWnA6ANM4UnLp8oz896Xt6c96Z0a9pNrupzlVza+1JpWgfzaryzt2ivTFk1Rb5Y9oVMXDHRBE+MRezRVAuXWp3zOzuez7iy4IwdmJyCMNitWze54gosQ5l+CKQYT3jIIYfICy+8YNZaJCLKRQyADIDJYgAMs3P/ThMCEQa/XfOtDDt0mPyizy/k9C6nJ9RFjID3zapv5IvlGvg0ZE5dPVVa1GshJ3U8yVT9WvVl/qb5Mm/zPLNe4U+bf9IndRU5rOlhFYJhl8ZdMqKbOpXwpnfjjTdKixYtzOLbRES5iAGQATBZDIARLN66WF6c/WJcXcT7i/ebs5Ag8KEQ/hrXbiwndQoGPhRa+NzWIiwuLZZl25aZMGjKCoYIiUWlRdK1SddywXBwx8EmUOYadFNj6ZhwGCMJfljrkYgoVRgAGQCTxQAYg/Au4u7NustVR1wlP+/9c2lYq6FMXzvddOki8KF7F616dthDQENoSzaQ4GdYsX1FuWA4Z8Mc02I4sv9IuW3Abeb75jqclu/nP/+59OzZU3r00JCsZV9Hq6GXwRBjEzEWkeMRiSjdGAAZAJPFABin8C7iGlVrSF71PBP0TOjrdJJ0b9o9bS1Q6FK+7ZPbZMHmBTJ68Gi55qhrcrqbeN++fTJ37lyzAPW8efMOXuLUfP/73//kvPPOs+5ZBv8GM6rxhmrXrl27zCXOzoLzFjvp16+fWZexTZs2ZhHrtm3bmkuMk/zFL35h3YuIyHsMgAyAyWIATMKSrUvMpI6ezXuaM45UFnR7Tlg4QW7/9HYpKS2RB055QM7vfr5vu0HRzf39uu9Nq2qHRh3kwh4XpvxnxeLX6DLOy8uz9pTZsmWLnHbaaeY1YBeWycHliSeeKGeeeaZ1z/Lw77Zv327O3BJaWF7nscces+5V3oQJE8yMaQRFFFonO3TACXuIiGLHAMgAmCwGwCyCYPXs98+aU951atRJHjztQbPOYWVD9/Xs9bMPjouctGKSCcyDOgwy4yV7Ne8lTw570kxyyXbvv/++OQc0guLKlSvNmo5oOUTQRGhE8CQiioYBkAEwWQyAWQjnOh77zVh5aMpDcmrnU02LIJa2SRe0SP646ceD4yLR0odwOrDDwINjI/u07GOWutlRuENGfTZKnp/9vPxx4B/l1gG3Ss1qwdMS5oLdu3eb5XVQd999t29bbYnIXxgAGQCTxQCYxTbs3iD3fnmvPDvrWTNp5e7Bd0vLei2tW72DwLdgy4JygW9P0R7T+mgHvqNbHy3Vq7qfeQRjGa+dcK2UBErkX2f9yxctl37xzDPPyKRJk2Tw4MGmOnbsyKBIlOMYABkAk8UAmAMwQWTU56OkYHGBaWFD1auJE8bEB0FvW+E2Mxt5+fblpmasm2GC39Z9W2VAuwEm7J3c6WTp26Zv3C15RSVF8vepfzehdUTvEfKXU/8i+bXzrVtz18yZM80ElokTJ5rxg1gAG13GCIOXX3651KiR22tDxgqnFZw2bZp5DFFoccVEHqJMxADIAJgsBsAcgiVqMGMYk1cwY/iXR/6y3IxhBDwEOTvcoVbsKAt7qF0Hdpl1DTs07CAdG3WU3s17m5nPx7U9zsyG9gLWQfzNB7+RmetmyiNDH5FLel3CFi8LJrPgjCgIg7NmzTKTSpwem1deecWcMq9u3bqm6tWrd/D66NGjHc+pjL8/zvrSpEmTlC9t8+6778p7771nJuZ06tTJVOfOnc1lfn6+Z3/vBQsWyJgxY8yZbDDeEmeRQejD+a3PP/98M4M7HCb3YIzmEUccwecd+RYDIANgshgAcwwO8u8seMfMGIZTO516MOThEuMHm9RuYsKdXXbYM9cbdZAGtVL/XMHP+fqPr8tvP/qtGS/4xLAnzALaFBu0di1dutQERowzxKVdZ599tuPM402bNknz5s1Ni2KrVq1MS6NdOP/zsGHDrHuWh9CIwLRmzRpZvXr1wULofPzxx617lffWW2/JjBkzzILey5YtMz8rLhG+UI0bN7buWWb//v3meRE+kxv7wCmsrVixwnShI/Qde+yx0qxZM+sWdwUFBTJ8+HAzIQe/9xlnnGFmiTdq1Mi6B1HlYwBkAEwWA2COQncr1jJcuGVh+bCnAS+R7uFU2V64Xf7w6R/kxR9elLsG3SW39L8l50+Hl0p79+6VdevWydq1a8sVwtOFF15o3au8Pn36mBnNmM2MQqsaLg877DDXNRTd4KDm9l70n//8xyzyjUBqtxZivUa07o0fP14GDRpk3TN5Bw4ckK+//lo+/PBDU/Pnz5f+/fvLa6+9Zn43osrGAMgAmCwGQMoI6L6+7r3rzHVMEsF4Q/IHhKWaNVM/c7u0tFTWr19/sMUQVadOHdO617dvX6ldu7Z1T++hhfOjjz6SK6+8Mi2/K1E0DIAMgMliAKSMgVbLv33zN/nzpD/LFYdfIQ+c+oA0ynPulsOC2Gg9xJhGuzCBJXy7XYN28vNePzeLeRMl6uWXX5ZXX33VhFG7u9mpGztZ6Kb/9NNPzdluUOiuHzBggCmM66xVq5Z1T++hqx0toRg+gLGk4dCdj254nhoxPRgAGQCTxQBIGWfptqVy/fvXm8Wlzz3sXNm+Pxj0tu0rC3g79u8w98VMZExaCa38vPyDl3M2zjFnUTmsyWFm5jHO79y2Abv4KD6LFi0yXcX2DOMlS5ZI165dTRj8+9//bibWxAotnQhSTmMasV4kJvf06tXLFMZF2utIYuLPkCFDrHsmD+e6xkSjyZMnm2WIvvrqKzOeFAH0+OOPt+5V5oMPPjCz0nH6RNTAgQPl6KOP5iz1FGEAZABMFgMgZSS0RuCczJgpXCHg1Q4GPFTt6rWjzuTE+Z3fmv+WvDLnFbOOIdYgRBgc3mO4awsjUSRoqcOSM6g777zTMQQhYG3YsMGcr9pu0bPPYz19+nTp0aOHdc/o8HpAObW+odv87bffNq2EOPUgZl5Hg7CHyS84rSHCHsZX2oHOrQu8qKjILFmEwIjC18B5tjHjety4cdK9e3frnuQFBkAGwGQxABKFWLdrnfznx/+YMPjDhh9k2KHDTBgc1nWYZ8vcEMETTzwhN954o1maxm7R6927t7lE6yHClxcQKn/3u9+ZyTL4MIRAhjCIS6wn6TR2EpNrMNYSP0uiXbpoyUSXMcIgZlU3bdrUuqUMZqVj0hG6rkMLIZNdyZExADIAJosBkMgFFtB+dc6rJgxu3rtZLuh+gYw4fISc2OFEcxq7eGBMIr7Gut3rTMhcv3u9uQ6t67eWVvVaSav6WnrZpE4Tc65kym5oHUNIchpPlwoYo4cwaHcZo9Ayh6VuKguW3DnnnHPMRKJwzz//vJl04wQtknjsWrRoYVoW0VqKS8w8x8SgXMAAyACYLAZAoijQtTZ97XR55YdXZPyP480p7TBx5NLel0r3pt0PhjlzqeHu4PWQfRv3bDSnuUOXMkIeTsmHwIevjfvZ/w7d0TWq1jh4O+4bHhDNtl5vVqdZ3EGUyI/wOkAIxJhGu7DuItaSdIJ1JBGgsUQRWhlR8+bNM2EWSwLlAgZABsBkMQASxaG4tFg+W/qZaRV866e3zMLZ1apUkxb1WhwMaS3rBsObCXEhYQ+X0bqR9xzYUy4QHrzUWrtr7cFtTHTB9z2i5REmjF7c82Jp17Cd9VWIcg9CJEKhWwvgRRddZBZIt1sLcdm+fXszW9sKUhmFAZABMFkMgEQJ2le0z5war2mdpmnvst1fvN8EwYnLJ5puakxe6d+2v2mVxOQV/ExEVAYTcmbPnm1aCu0WQ7QgduvWzXSNO8GpFnHaxfz8fNMiaV+iMCEm/Kw06cQAyACYLAZAoiywYfcGeWPeGyYMzlg7Q07tfKoJg1gmp36t+ta9iCgUWg0LCwtdFxHH4t9Y3mf79u2ybdu2cpc4UwxaEMMhWP7yl780pxLEcRVlX8fpFDH5xgsMgAyAyWIAJMoyOK/z+Lnj5bW5r8miLYvkrK5nmTB4RpczpFb11C0UTETB83BjrUQENMymxqVdF1xwgWeTbhgAGQCTxQBIlMV+3PijCYKoLXu3yPndzzdjBk/qdJKZzEJEmYkBMHcC4D1av9JCSvtO6watH7UiQb/PHC2MDMcqpKVa4RgAiXIAurqmrZlmgiDWOcT2RT0vkmPbHGsmk2AMI2YUm8s4tnE2lQ6NOpgzrhBR+jAA5kYAvE3rRq0ztJZo3a11hVZXrb1abp7Raq2FcwMxABKRgTUJv1zxpbw25zVZuHWh2S4NlJplasxlHNuYjYyZ0e0btpdD8g8JVuPyl16MQcT3w/fCsjoY72gu92yQw1scbsY7EuUaBsDcCIBLtcZqPW62RLDw11qtkVqvYIeDs7Xu1PqD1idaDIBE5DmEwTW71siSrUtkyTYt+9K6jnMyY73Czvmdy4JhSDjEmMTwUFfuUvfjOi4ROOvVrGeW02lRt4U0r9tcPl/2uZzS+RT5+9C/mxBKlCsYALM/ACKVbdfqr/UtdlgKtNC9e6vZKg9nHUc3MVoMm2t9rsUASERphW5mtNot3bbUMRwiOEKdGnUOhrpyl/VaVLhet2b5s2YgGN7+6e3mvNB3DrpTRvYfye5oygkMgNkfANtqrdTCWbQXYIcFS53jD36t2SrvP1qztB7QOlGLAZCIfAfrKKL72Isu4skrJssNH9wgB0oOyLgzx5lWQUqdopIimbV+ljmzzaFNDrX2UjoxAIpk+wkz7T9qI+vSlq/l9Ae/RKuz1l/NVllAzoWuciLKILVr1PZsjcKBHQbKzOtmyq+P+bWc95/z5JI3L5E1O4MtjJQ8nKEG3e33TLxHTn3xVMn/a74MeXmI9H6ytwx5aYi8u+BdMxyAKJ1ydQwgziL/O63wMYDPaQ3XKjRbwZY/NO1t1rpF6yWtUKYF8IYbbpCaNYPdJkOHDjVFRJSJcLq8Wz+5VSYsmCB3n3i33NTvJqlRDW+FFCssGfTVyq9k8srJpmaum2m64ge2HxgsDdw9mvWQzXs3y9Mzn5YnZzxpZodff8z18sujfskz0aRIQUGBKcC5k8eNG4er7ALOYhjnh1nAw7QQBv+kdZnWYVrhs4DxRAgdJDNAC13CHbS2aO3TCsUuYCLKSjhNHrqFq+h/6BY+sSNGxJCTFdtXBMPeimDg+2nzT9KtabeDYQ+XWO7HDbry0Qr4+LTH5ZvV35hzU9947I1yTOtjrHuQ19gFnDtdm6O1rtNCf8kMLXsdQKzxN08LS4t/rRWOYwCJKGdhrNqj3z4q93x5jzkt3sNDHjYtWZkOvxfO+IIWuKLSIrONSwQx+zouzXbI7eH7Fm1dZFr6cF7po1oddbCF7/j2xyfciofFx5+Y/oS8+MOL0rNZT7mh7w1mzUmehcZbDIAc25YsBkAiynqrd66WWz6+RT5a/JHcO/heueHYG3x/JhQENIQ8hLTFWxeb0/rZ17EfPz9CGrq3a1TV0kvss6/j0mxHuL1dg3amha9fm34VZlgna+f+nfLi7BdNqyBmg19z1DVmjGa7hmi3oGQxADIAJosBkIhyxqdLP5UbP7jRtEY9ceYTpqWrMtkhzwQ8O+jpJcKeHfKwZmKXxl3k0MaHHrzEzNu2DdqaM7L4HZYD+mzZZzJu+jj5YNEHMuzQYaZ7+KSOJ0mVKjyEJ4oBkAEwWQyARJRT9hfvl7HfjJX7J98vnfI7SV71PKlVrZZZPxDBMPR6zaoV94VeR7gpLC6sWCUV92HZm/B96MLFKfWwKDZCXZd8DXh6aYc9hDzcni0w1vCfM/4p/575b7OQ93VHXycjDh/BSSMJYABkAEwWAyAR5SQsE4O17PaX7DfrByIYul03l7ptrpeW3Y4JJljOJq9angmS8Vazus1MN2w2hbxYIPy+/uPrZgbxt2u+Na2CV/W5Ss7ocobpnqboGAAZAJPFAEhERJUGZ4XBWMEXZr8ge4v2yojeI0wYPKLlEdY9yAkDIANgshgAiYio0pUGSuXL5V/K87OfN6f269qkq1x1xFVyae9LTUsplccAyACYLAZAIiLylV37d5kQiDD4zapvZFjXYSYMnnnomewitjAAMgAmiwGQiIh8K7yLGC2C6CLu07KPdY/cxADIAJgsBkAiIvK98C5izJTG+oUlgRKzuHUihbUPW9dvLa3raeEyrBrXbuzbpWoYABkAk8UASEREGQVdxP+d/19ZuGXhwQWv4y3MvN5zYI+s3bU2WLutS6uwkDWW+ykXCsOCYqO8RsHlgrAsULVa5a7jEt8nVQGSAZABMFkMgERERGF2H9gt63atKxcKTYUExR2FO8otFxTQ/0JhmaDwUBi6luQVR1whI/uPtO4dHwZABsBkMQASERElCYuCo1vZXjPScQ3JsNs6NuoovVv0tr5CfBgAGQCTxQBIRESUYRgARfx/IkQiIiIi8hQDIBEREVGOYQAkIiIiyjEMgEREREQ5hgGQiIiIKMcwABIRERHlGAZAIiIiohzDAEhERESUYxgAiYiIiHIMAyARERFRjmEAJCIiIsoxDIBEREREOYYBkIiIiCjH5EoAvEdrjdYurYlaPbWcNNN6Xmup1k7rcoxWTS0iIiKirJALAfA2rau0TtNqqjVFq0Crjla4elo/aZ2i1UDrVK1hWn/RIiIiIsoKuRAAr9d6SGue1n6tu7RqaJ2nFW6ZFsIeLgEtgM9qnWS2iIiIiLJAtgdAtOJ11JputoJKtGZpHWm2ohuiNTN4lYiIiCjz5UIAhO3WpW2bln1bJGgt7GNdEhEREWWFKtZltkLIQ/jrr/UtdlgwBnCO1q1my9mfta7QwnjAxdjhAF9/xw033CA1awbniQwdOtQUERER+UdBQYEpOHDggIwbNw5XG2ph0mfOyfYACBjHN1brcbMlUk1rndbvtF7BDgd4VmDSCMLfKuxwYQKgkgYNYmlQJCIiosq2c+dOadgQ2S93A2AuTAJ5QgstfVj6pbbWfVqYDPKWVjiEQ4TCQVoDtSKFPyIiIqKMlAsB8GEtrO33qdYmLXQHn661V6udFtYGPF4LcHmJ1iFai7TwqQC35+SnAyIiIspOudAFnErsAiYiIsow7ALOjRZAIiIiIgrBAEhERESUYxgAiYiIiHIMAyARERFRjmEAJCIiIsoxDIBEREREOYYBkIiIiCjHMAASERER5RgGQCIiIqIcwwBIRERElGMYAImIiIhyDAMgERERUY5hACQiIiLKMQyARERERDmGAZCIiIgoxzAAEhEREeUYBkAiIiKiHMMASERERJRjGACJiIiIcgwDIBEREVGOYQAkIiIiyjEMgEREREQ5hgGQiIiIKMcwABIRERHlmFwJgPdordHapTVRq6eWm0Zar2ht19qq9ZJWQy0iIiKirJALAfA2rau0TtNqqjVFq0CrjpYThL9mWp20umi11HpBi4iIiCgr5EIAvF7rIa15Wvu17tKqoXWeVrj2WmdojdTapoUWwFu0ztFqq0UeKyhAFqdE8fFLDh+/5PDxSw4fv+Tw8UtOtgfABlodtaabraASrVlaR5qt8vpoFWrNNVtBP2gd0MJt5DG+gJPDxy85fPySw8cvOXz8ksPHLzm5EAAB4/lCoXXPvi0U9u0IXi0H/97p/kREREQZp4p1ma0Q2hDe+mt9ix0WfGyYo3Wr2SqDrt7xWuHjA9EqOFzrPbNVxgTGVatWSYMGzIeJGDVqlIwZM8baonjx8UsOH7/k8PFLDh+/5CTz+O3cuVPatWuHq5jkuRNXck22B0BYqjVW63GzJVJNa53W77Qw4SMUxgAu0zpCy+4GxvWZWh20VmNHiDZa4fuIiIgoM2B8P1YJyTm5EADRynej1jAthME/aV2mdZjWXq1wE7QwSWSEFh6f17R2azlNGsHtrbWwvAwRERFljvpaa7UCZouy0mgttPohyIWuA4j2X4S3481WENYBfFkLXccYK/iiFvt3iYiIiIiIiIiIiIiIiIiyXjynmKMyd2sVa2HmFR47XIZPyKEyF2tN0sISRVjHMnz5psO1vtTCEAdMSsLjS2WiPX6lWhgPHPp85Gs56AEtrIWKxw7vda9qhS+Kz+efu1gePz7/3GHM/mItDMnaqPWhFiZmhuLzj9IOp5hbodVDq5YW5qLjyed2ijkqgxcoDsgUG5zGECHmF1rhAaaeFgYx36dVU6uX1iqt32pRUKTHD3AAPil4lcLcr4VF86trYSw0Pqh9r2Xj8y+yaI8f8Pnn7lAt+1z8eAxxlq71WvYEVj7/qFJgRjFmF9uwvMwGLcwepsgYABNzolZ4gLlSC2+Ioftu0loUvEohnB4/wAH45OBVigKtL3gM7YMyn3/xCX/8gM+/2KCh5WYtPH5NsEPx+ZeE8DdCig0+ycVzijmqCI8TAjPWXcSnYjyeFD8cUNCigIOIDc/Lzlr4dEyxwcz/TVoztH6FHeRoqBZ6PuwzJvH5F5/wx8/G55+7M7WwIsc+rYe1sK7vFi3g8y8JDICJsZeFifUUc1TeG1roOm+hNUALazB9qsXu8/jh+eb0PAQ+F2NzilYnrVZad2k9qHWdFpV3qhYen9DHhs+/2Dk9fsDnX2QfaOVrNda6RWuqlo3PP0o7PLHwiaOf2SqDU8zhEwrFB2M38OkOb5DkzqkLE5+GMTA6FE59iPvxE3B5bl3A4TDw/KvgVbKcpYUDK06XGYrPv9i4PX5O+Pxzh7F/CHy9zRaff0lhC2BiMEtruVZfsxWEMYDo1gwf4Euxy4Uz03jNHnYQ+lo+VgtjVDErjhLD52IZjGt+SetCrXexIwSff9FFevzc8PnnDMdZnKkLk0OAzz+qFDjFHEIgpuvX1sJ0f8w+YjdmdHgjtAfxohsYZ1vBC7YudlAFeHPDAOghWvhki+cYtnGQwKdcLC/xZ608LXwyXqnFWXBlIj1+OHgcpYWDCg4uuA/GF92gRcGJblu1Qs+WFIrPv8iiPX58/kWGCR3Ng1elmdZTWng8cdwAPv+o0ridYo4ie0cLE0DwuCE0YxIIBu2SM8x0w5ADhBeUfX2QFmDpA8yq3qOFJREwjojKRHr80DU3Twut+jiwoAX/Gi0KwmO1XwuPT+g6daGBhs8/d9EePz7/IsO5+XGMxeOGoPe2FgJzKD7/iIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIKJqLtSZp7dAq0aqqFUkjrVe0tmtt1XpJq6EWZYBof1wiIiLKDQhx47RuNlvRIfw10+qk1UWrpdYLWkRERESUYU7UitYC2F6rVKuX2Qo6XAv72pot8jW2ABIREVG8+mgVas01W0E/aB3Qwm3kc1WsS0oMHr/WWrvMFhERUWT1tdZqBcxWauRp1QxedYSQhvDmBi2An2vV0EKLnpPLtB7SamW2yqzXGqn1qtki32IATE4brdXBq0RERDFBF+ma4FXP5TVt0GDf5p07rU1HGOuH45dbCIwlAJ6jNV6rjtkqg685XOs9s0W+xQCYnAZaO1atWiUNGuCqN0aNGiVjxoyxtrIXf8/sw79pduHv6a2dGsratWuHq5gpGzGhJcEclz7+y1+kbh4aAsvbU1goQ+64A1cj/QyxBECMAVymdYSW3Q2M6zO1OmixccTnGACTY15oytMAOHLkSBk7dqy1lb34e2Yf/k2zC39PbyEANmxoVklJeQD8+pFHpF7t2sE9IXbv2yfH32wm+Tr9DJgXgNCHAPihFrqrMRkEXcZOXdYTtHD/EVrIE69p7dY6T4t8jpNAiIiICC7X2qeF8AcIc3u1Bmqh6RLj3Y/XsuH+m7WWaC3SWqd1pRZlAAZAHxo6dKh1Lbvx98w+/JtmF/6emWvzlCmyadKkCoX9EWANP+SCalbZ17E49CottAh+rWXDAtCYDIIFofO1rtBKVcsmeYxdwMlJSRcwERFln3R2AX//yCNS36ELeNe+fXKkexcw5RC2ABIRERHlGAZAIiIiohzDLuDkeNYFfNk9IoOOsTbiNGmJ/tve1kYMJlmT8wcdFryMZNIGvR/O8hjFpO16P6wq5WIShhWrQU2Dl04mFZfKIJeHcVo1jEMWGZjn/JT9XnZK/yrO657Olc3SV+paW+UtMGuWYu0CDGEpb6msNJc9zKkuy1sti81lV7OUVnnr5Sdz2UE6mstwW+UH/Vddra3ydspMaa7f0UmhTJV8s8qCs2L5SuqJ+5Oo6oGJUkv6W1sOdk+SqtUGWRsOtkwSqR3hdlir92kY5T6wUu/XPIb7LdL7tY7hfrZ5ev9OcdzfNkv/XdcE/l2oafo1eif5NSL5Sr/+kSn8+kna84X+fP39+/Mlq+6111rXEscuYPITtgD6yKQZ1pUETJpjXYnBIOssjZMWBC8jGdRC77csWNFMirCs6SDrfWgS5otFMMnl7ejYkuBao5ML3RfP/yaAlQoq6iVNZbrssbbKO8ycu9xZZ7PMlbO25rznzlpKN+taYjbKPOtaeXlynGyT2dZWJdmnB/l0Q6gkX8v28JeJdk+ZIrsmTapQ2E8EDIA+Mah78DKREDjokGAhBMYaBOMNgRApBA6yGtCSCYGDqgefjomEwCPNh97EQ+BsM5mtIoTAebLJ2ioPIXChy2L+CIErZLm1VV5jOVz/1UJrq7wGcpR1LX7V5QTZLUl8ioimSQwHeLTW7fAwsB3KUEGUiFYDBujLcVCFwn4iYAD0kWRCICAEAkOgcwgEtxAIbiEQ3EIguIVAcAuB4BYCIRWtgKU1B8t++cbaclBvkJSWsLWNiCgXMAD6DEIgiiFQb/c4BKIVEJxCoN0V7BQC7a5gpxBodwU7hUC7K9gpBKIV0E0yrYCQ0lZAIiLKCgyAPmWHwES7hKEyQyAq10Kgk0jjASN1BUMirYDoBo4mYitgLLwaB7iRrY1EqbJ/yhTZP2lSxeIYQLIwAFb0Jy1M8UQK2KiFU+K4T71MoWTHBUJlhUDI1hDoJNJ4QIi3K9huBXQLgdG4tQKiGziaiN3AsYwDjEX7FI7tW5aFwdLnM4DJf/IHDJDGgwZVKOwnAgbAinAy66O10JnZWusTrQKtSlkyJ90hEJWKEOgWBDMxBMY7HjAVXcHJtgK6qudRyPByIkg8ejAkERHFggGwIpzQekfwqjkHYqkWFoJrjB2VIZ0hEOwQGC0IxhMCIRNDoJtExwO6SaQrGCJNCInUCph0N3Ak8azbRxmPS8AQZSYGQGdnam3TwvLFD2uN1dqiVWkqIwRCrodAL8cDQqRWwEhdwU7QCugm2VbAqLOBK2M9QCIi8gwDoLMPtPK10Op3i9ZUrUrHEBhbCHQSSwh0k0gI9LIrGBJtBYwk4VZAr8YBElHqTJuib3j6QS28sJ9IMQBGhiP/P7Se0XI92dqoUaNk5MiRpgoKMFwwdZINgahsD4FOrYBgh0AnCIFeTgoBr7qCk2kFTGYySNJiGQcY60xgng2EMhSOCfbxAceKdKk7aIDUPWlQxdL9RMAAGB3GAdbQOtRsORgzZoyMHTvW1NChQ629qZNMCAQ7BMYaBOMJgSi/h0CnVkCbV5NCoo0HTGRCSCpaAV0l2w0cyzjAWGcC82wglMFwTLCPDzhWEPkFA2BFN2k1D141kz+e0Nqv9TV2+IUXIRC8DoGQqSEw0ZnB4OV4wHgnhCTTCshuYCKi3MQAWNFpWmhO2aU1Swth8FStDVq+ghCIYgg0F47cQiB4NTM4mfGAbuLtCgbPWwEVTw1HlKFmTxH5Xl+/4YX9RIoBsKKztVpp1ddqo/UzrZlavmWHwETHBUIqQ2CkIJjKEOiXmcHgVVcwxNsKCJFOD+faCujFmoCVtR4gUa7rP0DkBH0Nhxf2EykGwCyRTJdwqkMgZFMIhHgmhUQaDwjxdAUn0goYaUmYpCaDoBs42XGAwFPCERGlHQNgFmEI1NtTEALDeTkeMJGuYEhbK6BKaTdwqk4JF+/p4Proz7GQQZSIcgcDYJZhCNTbPQ6B8UwKSUdXcFpbAb06NVyyMBM41qVgeDo4IqKoGAB9YpKH43IZAvV2D0MgeDEpJJGuYHDrCva6FTAhsXQDcxxg1uJp4Hxsnh5U5ujfJ7ywn0gxAPrEoD4aWhgCjcoOgeGSmRQSLt6uYLsVMJ6uYEikFTDSZJCUzwbmOEAibx09QN/wNJyHF/YTKQZAH2EILONVCHQSLQR6NSkE4l0axouu4LS3AkIy5wZO1ThAIiJyxQDoMwyBZbwIgU6tgGCHQDfxhEAvxwNCPF3B4NYVHG8rICQ0GSSWRaEzoBt47Y698vnsn6Tgux9l1pJVUlRcYt1CRJR9GAB9yA6BXgVBhkBrIwxCYKpnBsc7HjBaV3C4RBeHdmoFTNlkkFiXg4kmnokgcdi3/4A8++6X8tCE72XKx1/LrM+nyvj/fSz3PvdfWbjGd+u/E8VmsR5AMLM9vLCfSDEA+hRCIDAE6n2SDIHgFgLB65nB4RIZDxjv2oDxTAhJphUwomS6gcHrcYAxLAUTCATkpQ+/lhWzF8kZ+XXlhNbNpZ/W0FbNpNOBIvn3fz+WNZu3WfcmyiC9BwSXNwov7CdSDIA+xhBYJpkQmM6ZwRDPeEBIZVcweNkKmLJuYK/HAca4FMyKDVtkwY/LNPg1k5rVyt4Oq1SpIp0bNZCWxcXy5eyfrL0xwCxLIqIMwADocwyBZfwUAr0aD5jqruC0twK68aob2GNzl66RZnpZA+GvZQeRLSuCN1i6aAic+eNiKSkptfZEgBmWREQZggEwA+RaCIzEDoFuUhkCw3kdAsO5dQVDpbUCqohLwiTbDRwLD8cBFu4/IHkhLX/halevJsXFxVJUwgkhRJRdGAAzRC6FwEitgIAQ6NYKCHYIdJJMCExkUki4SOMBY+0KdlsbMC2tgJEmg3jRDRxtHCAmgnioeeOGsi1CuNu4Z580btRAatWobu0hyhAr9GCBcbDhhf1EigEwgzAEloklBEaaGQzxhkCId1JIsuMB4+0KhkpvBXRTGd3AOOBFcFTX9rKnVk0T9MKVlAZk/q49MvDonmZMIFFG6TYgOBY2vLCfSDEAZhiGwPJSGQLDeTUpJJVdwXYrYHgITLQV0FG0VsB0dAPHAge7KOrVzpOLhp0gU3fslnmbtsmBklIzM3j97r3yxdqN0rJLBxnQw3qiExFlEQbADMQQGBRtUogtWgh0ghCYjkkh4RLpCg4XaW3AeFsBPZ8MAtEWhY5lORgPxwEe272TXHvZmVLaoZW8v32vvL1+s8ytInLCKcfJtWcPllo1alj3JCLKHgyAGcoOgV7xawiEVM0MBoRAp1ZAm5eTQsIhBHrRFRzrhBCvWwETmgwSrRs4luVgPB4HCN3at5QbLzpN7h/eV0af2k5G/3K4nH5ML3+Fv++9C72UA9ZNCX5QCi/sJ1IMgBkMIdCrVkDwYwi0ZwanMgRCOiaFxDoe0O4KdgqB8XYFh0MITHkrYCyTQXyqXr9TJL9OLalerZq1JwGpWAvwBH8+psWlpTJn1Sr5YNYs+fCHH2TB+vVSqvvIBw4ZEPywFF7YT6QYACt6QOsHrR1aOAK/qmXFFf9hCAxKJgR6PSkEUjUeEGLtCoZYJ4Qk1AqoEpoMAunqBsY4wCgTQTyVQ2sBrtqyVR6aOVve+PhjWTxzpiycPl1eev99+ccHH8iW3butexGRXzEAVoSPr1dqNdFCHMKRf4KWbzEEBqU7BKZ6PCDE2hUMyS4LA3G1AiY6GcSn3cAUu+179so/P/xYWjfOlyGFe+XoZs3kmObNZaheVt20SZ797DPZX1Rk3ZuI/IgBsKI/an2vVayFOPCgFppYGmr5FkNgUKpDYLhEQ6CTZLqCI00I8W0roJ/hpPnkauriJZK3Z4/00AAYukROVb1+VJMmsm/zZvlxjcuLkIh8gQEwuqFaOD8UuoR9jyFQ7xNjCHQSLQQmMikknNN4QK+6gr2YEOLUCghxtwJCpFZAL7qBYxVPNzBOmE8RzVy0RDrVcf5QhEDYpkYNmb3cebwqpckmPRjgNRRe2E+kGAAjO1XrLq3rzJbP2TODGQL1PlYIdIMQGGlmcCTxTgqJdzygk1R0BYPbhJBwCS0MncxkkFi7gWMdB0ieKjxQJLUiTJTJ09sOHHAeH0tp0nZA8HUUXthPpBgA3Z2l9YbWCK1PsMPNqFGjZOTIkaYKCgqsvZWDIbAMQqBbK6AtUghM5aSQSOMBY+0KhmQmhFR6KyBEawXMRJgIkoqZwD7StnlT2bC34tlTbJv275fWTZ1bwHMNjgn28QHHCiK/YAB0htD3ktaFWu9iRyRjxoyRsWPHmho6FD3GlSvXQmAkkUJgpPGAtnRMCnESS1ew3QrotDSMF62A4SHQ81bAWE4Nhy6ryuK3cYBYCsYnawEe3+0wWVFcLPu0wu04cEA2VKkix3TubO3JbTgm2McHHCuI/IIBsKIbtR7TQgvgp9iRiVIZAhORaAiMBiEwUiugzS+TQpzEOh4QYukKtlsBnUJgsotDJzQjOFHoroomnm5gjgP0TI82reSYI3rLxM1bZNm+QikqLZX9JSWyYPt2+UprSL9+0qpRlHEYlFo79c0fLezhhf1EigGwon9o1dX6UAuH/l3W5fFaGSVVITCRVkCwQ2CsEAKjtQJCtBCYypnB8U4KSWZpmFR2BcezOHTcoi0Jg4NSJJXZCkiOMNHjwn7HyPlDTpFNtfPkg61b5aNt22R/8+Zy6emny0k9elj3pErTakDw9RVe2E+kGAArwmNSSwtHcVR96/JrrYzjxxAYayugLZYQCKmeGezGq/GATiqzKziRVkDPl4SJpRXQr7J8HGDVqlWl3yGd5OY+vWX0iBFyj9b1Q4dKrzZtrHsQkZ8xAOaAVIRASDQEQmXODI4UAr2aFJLIeMBUdQU7ibUrGDxpBYRUTQZJVTcwJDoOMIfOCILWwDrfTZXaNWtae4goEzAA5gg7BHolk2cGR5PopJBwXo4HDBVvV7AvWgEzcTKIX8cB+mQiiK3uSbkTdomyCQNgDkEIzJWZwdFCYGWPB4RYxwNCPF3BTsJDIGRMK2Cs3cCxtAJWgkAgIGu2bJN5q9bK8o2bpbQUZ5tMEGYCE8Vin77Z4/VWoTzuCqKMxQCYg3IlBEbjdQiEWMcDxrM0TLxdwbFMCLFbAcNDIGRkK2Cs5wZOczfwskkfyNj/fShjX3lLXnu7QB4f/678RWvOCpcnH5FXGg8IvubCC/uJFANgjknVpBBIZwiMxquZwU7cJoV4NR4QvO4Khli6giu9FdBNZU0GSaIbePmGzfLEV3Oltl6e0ayJnNK8qZyp1Wr3Hnnu3QKZtWyVdU8iovRjAMxBqQyBibBDYKwQAmOZGexFCEzXpJBQqegKdlsbEGJZFiZtrYDJTAYBn3QDo9v3ncnfSYfSgPRoki/VqwbfaqtWqSKdGjaQPrVry1uTpkpxSYnZHzefjQMkoszDAJijUhUCE50ZjBAYayugLZYQCH6bFOLE665giKcr2IlTCHRrBXQMgZEk2gqYId3Am3bskuXL10rX+vopYuMKa2+ZdvXqSqHeZ/H6in/LqHw4DtBMBPmGodRPSkummA9hFYtjACmIATCHeT0zGJIJgZAtk0LAi/GAiXYFx7M2IMQzISQcWgEdZUsrYALdwLv27Ze8KgGp2a6Ttac8LJ1SV6rIzgjn0yVKSr0B5jVYsTgGkIIYAHOc1zODbZk2MxiSCYHhvOgKtoWGwO2btsjc96fKs/98Rr545T1Z8dMyM6s03q7gUBnVCghetAJCvK2AcaiXV0vwpy8qcZ7xiy7ivVr1a+dZe4iI0osBkIxcnxmc7KSQRMYDOnHrCkZg+P6Tr+S/t/1VZPw0afjdIln3yUT59L6n5J2/vyT79uw190tmQkgyy8J42goIyS4JEw26geMVRzdw80b1pUOH1rJo247gjrBu4DW790jNhvXk0FbNrT1xQjcwxwESURIYAIkzgy3JTAqBeMcDxtMV/OGsafLD8/+T/s2byJGHtJfD2xwiXTq2lMGd20jRzPny2XPvRGwFDA2B8UwIgVgnhIAnrYBeLAlTyd3A6OI9+4SjZaleX1C7oZRogIdSvVy5c7d8v3efnHPCsVK9WjWzP2twHCBRxmAA9IlJk60rlSRXZgZDKiaFuI0H3L1li2yb/5O8N3eRFBcVWXvLxNIVjNa/ZRMmS379GlK/TvmmyC1VC6VPpzay5ts5smnNBhMCndYGDBdrV3DWtwKmsBv4kFbN5LrhQ2V7fkP5cPse+XzjZvlIa3leTRlx1ilyTJeO1j2zA88I4i/7ZZr5QFaxpln3oFzHAOgj2RoC/TQzOB2TQmDP1q0y8amn5Y1RY2Ttw2/L9w+8JGNvHiPzPv/SBDqINB4wtBVwz/YdUn3RJmnePN/aE5QvDc3l9ur7pYl+zdWLVpptSLQrGJJZFgZwkIlLKloBIRWtgHHOBj60TQv5/Yiz5caTDpfh3RvLtReeJX+89Dw5qnMH6x5JYDcwRVBac6D5UFaxBlr3oFzHAOgTg/pZVypZKmYGQ6bNDIZExwN+unqHfPTI47J0+jbJbz1EmnY8Rbp1GCZVqh4uXz79qXw/4SPr3rGNBywtKZUqEpDmVerLeik0+2x2CKxWBfcLrimXrgkh4NtWQJ9MBgF0B3cccqYc3iJfurRqLtWq8W2XiCof34l8prJbAW25MB4wkmTGA26YMkkWLquqwa+vVKsRnOWJENCpQRvZ2/oE+e6tSbJrc/l/HKkruG6jBlKraRPZsiPYvxweAjGubFmgUJq0LptQ4NYV7LQ2YKITQhJpBXQMgVBZrYApngySkzgOkCgjMAD6iN0KmM3jAdMVAitrPCCWZKn69VTJa9ZNVh6oYu0tUz2vnqzfny8rvi/7ZaJ1BVerXl0OO32wLNywWfJLKjY/bl9TKFU7tpDdh9W19pTxsisYkm0FdJRJrYBJnBoO5waWOR6HI591A3McoH/ske/NazO8sJ8IGAB9xm9dwZk6KQQqYzxg8f79Urh7r3Sq65we2wRqSJVq9WWPvTyIJVpXcK+TB0j944+RqUtWSOGGfbJ033bZsmOXfL9kpayqkyfnX/drqWqdbszmdVdwpFZAHFjCpa0VMBq2AlIOqq6vV7w+K1bsi7xTdmMArOhiLby74wiNQVWV8hj5oSs4FeMBk5kUAqkaDxhNrOMBq9eqJbXq1JaiwmB37Yr95qKcxsWFsrRufWurPLeu4Oo1asgpv75cet90taxr3UKmbdstX2jEan7BUDl39E3SvF0rc79ETxMHXi4Lk9ZWwGhLwsQqHa2A4HUrIPhtMgi7gYl8jwGwoq1a47RuNluVwC9dwTYvWwFt6RwPGEsIjKUr2C0Egt0KiFa4bgOPk50bf5IOVYNdwKEhsKhwt1SttkWaHN47rrOEHOwKPu4oOeeum+X/nvqHnPz3kXLcz06TBo2DP6DTuYLtVsDQEJjOZWGyuhUwEegG9prPzg3MbmCizMAAWNEnWv/RwhqulSYXuoL9NCkEEh0PGN4VfNgJJ0rDFkWyeeUMaVtatvZf4a7NsmXlZDn8jBPkxMbBZUCSPUtIPOcKDpXshJCkloXxcytgrBJYEqacVLQCEhHFgQHQ57K5KzhRlTUeEGLpCq7bKF+G3nijtOtVR7at+VDqrvpC5i4okKLCGTJgxMly5Dnnmvu5nSUEIs0KDhceAqEyuoLBqRXQjS9bAVO8JIyRilZAYDcwhdgmc81rtGLNte5BuY4B0Mf81BWMEOiXrmBbuscDxrM0TP2mzeTU634jF/zpDjnt+uHS66bLpdWo0dLztCEVJmvE2xUcyj5XcKh4WgHDeTEhxElWtgKCXyaDsBuYwuRJX/M6rVh9rXtQrmMA9Dm/dAXbsr0rONbxgJGEzgpu0LyFtO15uJzdvadUq1XL2lvGbgVMRVdweCug09qAwFbAEPG0AvptSRjgmUGIKEYMgB4YNWqUjBw50lRBQYG111vsCq4o3q5ghMBorYC2ZJeGcYKzhISfKxjcuoIRAlPdFWy3AoaGwLQtC8NWQG/5sRWQ3cDmmGAfH3CsIPILBsCK8JigqcZursGpHHC94qq+ljFjxsjYsWNNDR061NrrHT+1AqaiKziZpWEQAmNtBbSlY2mY0FbAcE4hEMJbAW2V1RXs5YSQSMvCOLYCIgRW5tlB2ApIHsExwT4+4FiRLpvkJ/N6DS/sJwIGwIou19qn9aHZQmOGyF6tSj2DNkKgX5aFgUwfDxiN113BNrQCOvGiKxj8PiHEs2Vh0nF2kHiwFdAdWwErRX05wnxoCy/sJwIGwIpe0MLjUs0q+7ov3sXYFVxRtncFQyxdwXYrYGgIrKy1ASt1QghkSisgZPGSMJwMQuRfDIAZhF3B7rK5K9htVjB43RWcFRNCvGwFjGdZmERaAVO1MDS7gYkoCgbADMSuYHe51BVstwKmsis451sBY8VWQFecDELkTwyAGcZvrYBeY1ewd13BobyeEAKxtAIiBOZMK2CiZwdhKyClwDpZbF634YX9RMAAmKH80grIruAy6eoKdpLutQHtVsDQEGi3AsbSFQxZ1wqYjFTNCPYTtgKmVb5+PMSHt/DC/hjco4U3hl1aE7V6arnB7TjjOd7JcH9c/lqLfI4BMAP5bXFoYFewdSWCRLqCw0VaG9CrruB0TAixWwGdQqBny8JkUitgKvioFZCTQTLKbVpXaZ2mhTcXvLtjgVu3rgl8Uv2LFj6h1rcu/6lFPscAmMH81ArotUzsCoZEuoLBrSs4nrUBw+XUhJBkFodORStgol3BbAWkyne91kNaeGGjZe8urRpa52m5cV0nl/yLATBDsRUwunR3BdutgG4hECK1AqaiKxg4IUQl2xUMmbgsDFsBc9YqWWlev+GF/RHgzaWj1nSzFVSiNUvrSLPlDKFxixZC4wNadbXI5xgAM1wmtAIWHSiUpQunymcf/FM+eucf8t3Ut2T71rXWre68aAX0siu4pLhItiz+Tv71yBPyzuN/kYnj/y2rF/wgpSV4fwyK1BVstwJ60RUMybYCOq0NGIoTQkKksxUwFfw0IYStgGnRXA41r+Hwwv4I7E+X4Z8at2m5ffL8gxa+aBOti7VwOqyntcjnGAAzWCa0Au7csVHee/Mh+bzgPVm7uops3VRfZn+3SN567WGZP+cz617ukp0QEi+3VsD9+/bIp68+IVsL3pQdK6vK4tXtZOW8A1Lw3Msy6fVnpbiofBjzsisYkl0b0GlCSDhOCIlye6YuDu2js4OwFdD37Heg8I+y+Vou704yVct+g8FH7pu1LtCyT6dKPsUAmAX82gpYWloiEwuekR3b60nzFqdIo/zDpH7DTtKs+bF6OUimTPxA1q760bp3ZOmcEOIUAqd//KasXrxDmrU5Vbp36Ca16reR/JY9pWmb02TR9yvkhy/tMwfq10njhJBwmTwhpAK3CSHAxaHjx1bAnPVNwVT5+8hHTI0b9YS11xFCHj7x9TVbQTgTFrp/vzdbseO4QJ9jAMxwfmsFDF0WZt3q+bJpwzZp3LSPVKlS/r2gVq1GUqPGITLvhy+tPe7SPSEk3J4dW2Xx7FnSuGVfqVIV74VBK7bpC6haDclvfpTMn/K1HCjEKaSDEl0bEHJ1QkiFVkBLhRBotwL6fUKI3QqY6KxgtgJSEhbLOvNhDtVkaDsZNvZCU0PHRJrLYSAh3qqFpV/wbnWfFiaDvKUVrrkWunztT6n4N3/TekerEDvIvxgAs4Sfzg5i27BusQa/FhXCnw2tgatXLDRj62JRWRNCtqxfIYHSBlK9Rlly61DPuqJq1Wks+/dVle0bKyY+TgjhhJCE2K2AWTohxGArYEq10Y94+EAXXtgfxcNaz2t9qoU3h/5ap2vt1WqnhbX+jteCPK17tfCGgXcthET8OywjQz7HAJgF/NoKGAiUuoY/qGL1EJTq/aKp7FZAN2gFdJNJE0JC4SARzq0rOLwVECEwZyaEsCs4YWwF9L3RWq208FEXL0x7rM4qrfpaX5stMVOKcQTCGEF8Gu2qhUkhFT99ku8wAGYRv7UCNmveUUpLN2kQdO663L1rlbRo1V6qV69p7YkumQkhibYCNmnZQapU3SnFB/ABuIzdCrh/71apVScgjZq3Ce4IkwkTQsJbARECE5kQYkvFhBDXrmA3qZ4QEitOCHFkQiBbAYkqDQNglvBjK+DSNb2lYaOasmNbxVkVxUV7pbBwofQ8YnDEVsJQybQCxiu0FbBuw8bSpc+RsnXDDAmUli35Au1qF8nCpTOle/8BUjOvYqLjhJCgeCeExNUVnGgroFsItFsBve4KZiugM4ZAokrBAEgpgwkSJ5/xS6lRc6VsXD/ZtPjt27tRtmyaLdu2fi5HHjtA2nWKtLaos8poBTx2yHBp26WhbFz9iWzf9JPs2blGA+Fc2bz2E2neo4PsaH9G8I4uOCEkKNYJIW7i7gqONCEkEr+tDcgJIRSnn2Sz+VAXXthPBAyAWQStgH7qBkYr4NyF7eWci34v/Qb2lTp1VkvVqvOl06H15czzfiVH9ftZzK1/Ni9aAeNdFgZq5tWRUy/9jQwZcZG07hSQOvVXS4duteT0Ky6Xq6+8WqrVcO/G9roV0MYJIRauDRg/TgjJeh31Ixw+2IUX9hMBAyClXJ26jaRXn9Pl3Ev+IMMvv1tOPO1qadmmW9zhz1ZZi0NXq15D2nc7Sk75+fVyzrW3y+Dh10ibLr2larXg0jCRzhOc6LIwCIFurYBuOCEkBNcGjIwTQohyFgOgu3u0cMjGlPeJWljfKCP4bTJIKs4RnKxEWgEjiXaeYFu8y8LYUrEsjN8nhDiuDRhtQohTCIRsWBsw27uC2QpIlFYMgM5u08I6RqdpofkEEaZAy73ZxSf8OBkkVdLVCogQ6HR2ECfRWgHdRGsFdJJsK6DNrxNCbEl3BdutgOwKrohdwVlrruwwr+3wwn4iYAB0dr3WQ1pousAK6Hdp1dCKuoQ6OfO6FTCdYwFjlWwrIEJgZbQChounKzijJoS4qYyuYM4KroBdwd46VFqY13d4YT8RMABWhKNnR63pZisIa3/M0op/ymol8dtkkFTJplbASBJZFibVrYA2ryeEeLI2oN+7gm1+6gr2S0sgWwGJ0oIBsCK7+ST8iIhzPrg3rfiI37qBbX5sBfSaX1oBbU4h0OtWwHCxTghBCHSaEBIuobUBnbAr2J1PxgMebAVkCCRKOQbAiuxDbHhbDU5143L4pWj82goYTzdwJrYCuknlsjC2rO0KjhYCIV1dwV6GQGBXMFHOYACsCCEPR7O+ZisI63yg+/d7sxVm1KhRMnLkSFMFBZgr4g9+mw2cCmwFDKrsxaHDZezagLF0BUdjdwVn2tIw7ApOCRwT7OMDjhXpMlP2mg964YX9RMAA6OwJrVu1sPQL5mfep4XJIG9pVTBmzBgZO3asqaFDh1p7K1eudAN7IdGzg0STbCtgIotDh0vXsjBeTwiJa21ADYGOrYAIgZFaAVPdFRyrZJaGAXYF+xqOCfbxAceKdOkuTcyHvfDCfiJgAHT2sNbzWp9q4ejXX+t0LX50SkKquoHTuTB0utYFjLQsDMTSCrh/715ZPHWaLHv/M3n98y9k56ayRIkDgRuvJ4SEhsBIrYAJrw1o8bwr2C0EpqorOBGp6Ar2ydIw7AomSi0GQHejtVpp1dNC08OPWpSlsq0VcMm0GfLayDHy2eMfy6bxq+THZ76Xl259VL569S0pKS627uX9sjDh3LqCnSaEhPO0K9gtBEbqCo4kFV3BHA9YgQmBnBBClBIMgFnMb+cGtqWqGzhTWwHdJNoK+O738zX4/U9q5B0lzbucJM0POVoadTlO9rUeLDMnzJdp//3Q3DcdrYC2Su8KjiQdXcEcD5gchsC4TQscMON/wwv7iYABkNIqld3A6RZrK2AkaAWMdHo4N26tgIFAQFZM+FTDX1ep06gsgbaUWlKtZm1p2uE4mfXRdNmzvexsAJXVChjOqRXQltFdwRwPmBQuDZOYI6S+GQMcXthPBAyARCqRJWFigVbASN3A0cQ7I3jP1q1SY8F62dGkk7WnvA218qSkuKGsmR9skfNbK2CsawPafNMVzPGAKcXxgETeYwDMAewG9jcvWwFLig5IIFBNqlSrbu0pg1bAoBpSfKB8N1C6WgGdJoR4vjag113BlbE0DMcDVsDxgETeYgDMcn5cDsbP3cCVMRkkFrG2AtZu2Ehq1q4iTffskZVlcz0OQhfxpsA2qd+0bCmIeFoBk1kWxou1AVPeFczxgBVxPCBRVmIAJLJk4pIw4a2ANWvXlm4n9pMda+eYsBeuzoY1Uq91LWnT7VBrTxBCYCytgDYvuoJ3bt8tkwu+k2funyp/Hv20THj9G1m3Zou5DbzoCq4QAqN1BbvJtPGACIGpGA9YySGQ4wFjN6UwYJaFCi/sJwIGQKo02dINXJlLwthCWwF7DRkizbvUkBqLv5HF2zabIFi0f49sWT5LAqULpeevfibfVi2x7h2dUytguHi7glcuXSdj7/yvvP3SSg2rR8uOLYfIZ+/tlofu/FC+nTwv7rUBHUUbD+jGj+MBOSnkII4HjM3RJXXMqgDhhf1EwABIlSJbuoH92AqYV7++nHbTDXLM+UdK6f7vZNPSd2Tnxs+ly/EN5Zy7fi0nH+r84KerFbBw7wEZ9+gbUlJ8qHTocow0btZamjfpJU06t5D8JsfI+Kdnyoql6/3ZFVxZ4wETke2TQtgKSJQUBkCiEPF2A3sp2VbAUHn16kmfs86W//vrA9Ll4T/KFeNGy+BrLpMm7coSK9YEi5WXrYDrZ9aUXVvqSq2WDi0R9Q5IlaptZcoX860dldgVnE3jAbNwUojBEEiUMAbAHODXBaFTKRO7gaOJ1grotDB0terVpWbDhlIzL8/aE4T1wJykohUwfELI4rlrpV7tisGwljnxjkh+k5Yyb9Y6cz0tXcG5MB4QvAqBHA+YEabs0vcbfU8IL+wnAgZAqlSpGAeYrd3AycDgbyextgIiBCbaCmhzmhCyU8omfdj26r7Q+Ssp7Qqu7PGACIHpGA+YpTODGQLdDdAPhfhgGF7YTwR8JlClSdU4wGT5uRs43oWhAQO/ncTTChhJrMvC2A7p2Ur279sgtaViIkYr4PYtm6TdkRUDa0q6gm2VNR7Qlq4QmM0zg4koLgyARB6JpRs42TODRIJP95GkqxXQ5jYhpPtRXaVR40LZsmGV2RfaCrhn9w6pXrpP+p7UwdoT5NQKaHPrCnYLgRUk2hVsixYCvR4PmOikEFu2zgxmKyBRXBgAKWslOw4wFd3AsYjlzCCZ0AoYzm4FrFO3toz47VCpWnWRbF6ySrZv2iCrty6QVUvnyPbN0+TCq4+Rtp0bx3WauHjGA8bdFYwQGK0rON2TQhAC/TIpxCczgw2GQKKYMQBSVkp2HGBldgNHE8+SMOH80grY7pA28n/3XyRnXdZR2rY6IPXzl8rgM+vLzfedLcee2NvxDCG2pLqCLa4h0KkV0JZoCIx3Ukgmzgz2QQjkeMDypmwJflAML+wnAgZAqnSpWhDar2LtBvZ6MkgqWwERAuNpBYQGjerL8UP7ynV3XihX3zNY+lzSQlq1bWbdGjxNnFMroJt4u4I9Hw8YSbbPDLYxBPrGgLzgh8Xwwn4iYADMEX5dCsavE0ESgW7gWJeDiSaZNQHRCujUDRxNMq2AkURbFgaczhNsS1VXsKNYxgO6hUCIZVKI32YGexUCOTOYKKMwAFJWS+c4wHTCJ/lEoBXQqRs4na2ANqdlYezzBNsqrSvYTaRJIbGMB/TjzGBgCCTKOQyA5aEZ4gMtrEJbqnWyFmUov48DTHU3cCKtgLHyohUwnN0KGB4CIe1dwZHGAyY7KSSVM4OTCYFeYQj0hSl6FMP7R3hhPxEwAJaHPrD/ag3Tch4tTxRFrMvBRJPMmoCJTAZBK6BbN3C6WgGduoLtVsDwEAhedQXHNR7Q5seZwZBoCPR6Ugj4JQTmoAENg+8h4YX9RMAAWN5PWs9ozdSqgh2U/YqLDsiKxd/JVx+/KF++/4zMm/mJ7N0de+tWKC+Xg0kVt8kgbtAN7CRSK2C8i0OHi6Ur2G4FjLUrGCHQsSs4FeMBvZ4UEm8ITEQ2h0B2BRNVwABIvlBZM4F3bt8o7732oHz69puyZN5OWbmkWKZ+/o3897n7ZMWi76x7pY4X3cDpmgwSTyugG7dlYULFOyHETXgroC2h8YCJhkCvJoVAPCEwkVZAG0MgUU7IlQD4nBbG9JVYl+H1uRZVklTPBHabCFJSXCRfvPtv2b6lrjRrOUQaN+sljZocJs1aDZKatY6RL957VXrWX5GyiSBedQMnIpHJIE7ibQUMZ7cCpmpCiGfjAd1EmhRiy6QQ6PWkEPBJCDQYAokOypUAeIMWjmBYZAyX4XWuFmWhSBNB1q78UTZv2KXBr49UqVK+x79O3Zb6/7ayYHZiBwyvloPxgt9bAeOZEIIQ6NYKGE9XsCO3rmBbqsYDxhsC4+G3EFiJcm1SyJQV+tpfVrGwnwhyJQDu1doaoXZpJWzUqFEycuRIUwUFBdZe8rs1y3+SatVbVQh/tnoNOsnShT9IIBDffKB0jAMsKS6WVfNnyw+fvitrJr4n701fIKWlaMwuL9HJIE5S1Qpo80VXsIbAlHQFQywhMBqEwHTODPY6BObgzGAcE+zjA44V6TKgmb7+W1Qs7CcCjgGsqJaWvVZ6DS1sVzNbLsaMGSNjx441NXToUGsv+V1JSZFUrVrd2qoIt5WWVAxVXsOn8kjQDRw6DnDr2lXyyd/ulHn/elCKPnhDunw8XjY/+Wf54tExsmcbPs/EJt7JILZ0tQLa0toVbKm0EBitFdDGEJiwdIdAHBPs4wOOFUR+wQBYXgetfVo4wqFpBGsCovXwj1qUZZq36ihFBzZYWxXt2bVaWrbt6NpC6AV8Io/Hnh3b5Jt/Pyxtt2+R/h26SNf2h0g3vTxaLxssWSRfP/WIFB+o2H0bbzew25IwmdAK6FVXcMLjAROdGWxL1cxghsCDcq07mMgJA2B5GB2BxwQtfqF1rxZlmfZdjpK8uvtl986V1p4yxUV75cCBJdLdOnj65Ywgy2Z+I400/HVo0aZcMMX1w9prWF2+RNbML//DJtIN7JVUtwLG2hWMEOjUFRxpaZh16/fJhx+Pl/+9/Z1M/GqB7NiBz4YKIdBtPGC0SSGVOTMYGAIPyvYQOGWxvm8tqFjYTwQMgJSzauXVlZPOulKKiubI5g3TZN/eTbK/cLts2zxPtm7+Qo7od5y07XR4QmcE8fK8wKHWzvhKWjdsbG2V6VBdZOW+KtKqdm1ZO3OatTe6aN3Abq2Abt3AybYCIgS6tQIm0xVsi2U8YHFxibz2ylR5+P61MvP1ZbKy4Af58oWv5J5Rr8vnX/5UNiY0Ugh0awW0MQQyBKbYgNbB96Hwwn4iYACknNa6fQ8597KR0uuYThIonS0H9n8jbTpWkdOHXyFHn3B+Srt/Q8U6DrC4cJ/UqI6hqc5q6m24j5NEuoHjgW5gJ/GuCwip7AqONh5wwjuzZO5Hc+W0to1kQOf6ckS7PXJi5+YyML+uvP/y1zLj+xWRxwPa0jkzmCEwYewOplzFAEg5r2HjVtJ30IVy8XX3yaW/+auccu71GgJ7py38xTMOsGH7zrJtl3MrG2zbs1satOtobZWJ1A3stiZgNKlsBXTjRVewEzsE7ty5T74umCv92+VL7ZrVNVFjWLBIILBC8uvWkt4Nassn788KzrhO18xghsCUYwikXMQASFkPawG6LQadaToed5KsPrBfDhQVWXvK7Nu3V344UFU69u1v7UleIpNBnKSyFdCrrmCEwLmLPpW6B4qlfu2a1l4VEgLbNa4nW1ZtlQ0brZWjGAK9wRBIlHYMgEQZpHXXntLsxDNk+uplsm7LRikuKZGi4iJZtWGtbNy6VhqedZk0bNHKund8MqEVECEwvBXQlmxXMBQXlUq1KlusrRBWCKxWtYqWSFERTipk8WJmMEMgQ6DHpujLAZPXwgv7iYABkChDYBzg5LVV5Khzfi5dr7pJVjRuJhPXrpAv16+WTZ0OlT7X3S4tjz/NundFkc4NnOhkECfxtgIiBMbaCmiLdUJIvF3BTdoMlh0SkP2lFWeGIwRu37tESmpUlyaN61o7LbHMDGYIjI4h0DMDOulr/pCKhf1EwABIlEKpmAlctWpV6XzkcXLqzaPlzD8/KcPu+6eceO1t0qZbb+se3op3Mogt1lZAN5FaAZ0gBIa3AgJCoFNXsNPSMJ06N5PGXQ+XhesqTqQJBAIyR/cfc3xA6tbF+vAOooVAN/GEwGgYApPG7mDKBQyARDHAJ2d0n8QDSy7EChNBos0EDodJKrXq1JWaebWtPUGTNltXEuBVN3BltALanEIgxDIeEI/pRVcPlFV12suUpfNk2579UlRSKuu375UvF22U6of1kjNPbxv/mUIAIdCtFRDsEBgJQmC0VkBgCEwaQyBlOwZAoiwyqHwWdJSObuBo3FoBY10cOt4JIdG6gkNDYNt2TeQ3fzpXOmjQm7xrhby3cqsg+/e7tJ/ceMsQqd/qFHO/hEIgRAuBkVoBIddCYCUGwUwOgVNm6mtdn9bhhf1EwABIlGFCzwscr2hnBXETrRvYrRXQqRs4UiugE6fFocFtQkgiXcHhmjdvIOddfrX8+R/HyehxXeTehy6U08/oXdb1a50uzlEyM4OBIbAMQiD4IQRmmAGH6eu9e8XCfiJgACTKIJgI4jeJtgK6qYyuYKfxgFCl9slSu3Z1Kar6rbUnhIZAx1ZASGZmsI0hMIghkCglGACJ6KBoi0I7dQNH49YK6NQNnMiyME6idQXHMh7QZi8S7SZiCEzlzGAbQyARJYABkCjLYBxgtIkg8Z4WDhLtBk5EKlsB4xkPGCr0fMEHWV3BriEQUhkC7ZnBDIFEFCcGwBwx6VsNBgOtDcppiY4DjCRaN3BltgLG2xXsJPx8weVECoGxzAwGhsDYMATGbIq+50+aUrGwnwgYAIl8IpGlYFLFy27gdLQCRpoQ4iSZrmCGwDgwBFaaAfq5aFCfioX9RMAASJSBkpkJHE2k5WAidQOjFdDt1HBuvGoFtKW6KziWEOiIIZAhkMhnGACJMoxXM4ETGQeYKLclYaJxagWMtCyMk2S6guOeFBLLzOBoIdBNpodAFEMgkW8wABKlEM4GkorTwUUTbSJIsuMAI3UDx9sKCPG0AtrimRCSSFew23hAm2MroCWpEOjWCgiZHALBDoFeBUGGQFdTMOZvcsXCfiJgACzvcq2vtLZo4Yj0udYALaKcEmk5mGjdwJHEszC0za0V0IndCuhFV7DN0/GAYIdAN7kQAoEhMKUGHKMf9PpVLOwnAgbA8upp3aOFIxJGrr+j9ZFWay0iSkK0ySBetQIm0hWMEJhoV3DCIdCtFdDGEBg7hkCiuDEAlvek1ida6MMq0XrUuuyrRUQhvOwG9rIV0BZPV7AtrSEQEp0UAgyB5SEEohACGQSJomIAjKyfVl0t57UiMgTWACQKh3GAiU4ESbQbONpkkFS3AtoidQXHOx4w2qQQcAyByc4MBj+EQJRfQiCwNZAoJrkSAJ/TKtVCax4uwwtj/cK10xqv9YCW82jzDMJFoCle0U4L57V0twLGOx4QIdCpFRAQAl0nhVgh0FE2hECwQ2AiQZAhMCWmTCmUSZMqFvYTQa4EwBu00CzRzLoMr3O1QqHJ4UstBMC7sSOSUaNGyciRI00VFBRYe4kqVyynhEulSN3A8S4Jk0wroFddwTa3EAiRQmBSM4MhE0IgMASWg2OCfXzAsSJdBgwolkGDKhb2E0GuBMC9Wlsj1C4tG44aeMd4WusP2BHNmDFjZOzYsaaGDh1q7aVYTZplXaG4pHIx6FigG9htHGC0bmA3bgtD2+JtBUxVV3Dc4wEtDIERZGkIxDHBPj7gWEHkFxwDWB6WfPlC6y9afKWm0SAuthMXrxaDziSRWgHdFoe2ed0V7CbpmcGQjhCIYggkymkMgOXdp9XQukSrIArD5O/Qogw1ab4GJq595SraRJBkxgEm2g0cbyugLd4JIZG6gt2WhoFo4wFd+SUEgp9DIIohMClTpuyWSZN2VSjsJwIGwPJO1qquhSmO9a3CdbQIEmWdaGcEiXRe4GiS6QZ2E60V0A1CoNvi0ODUCmhLZDxgLJNCfBUCowXBdIdAsEOgV0Ewx0LggAHVZNCgioX9RMAAmOWwBAxnAFOqRBoHGIt0tQLaEu0Kjnc8oC1jQiDEEgJR6Q6B4GUIRCEEskuYchwDIBGllFs3cGW0ArqJ1hXsJqlJIZkYAsEOgbEGQb+FQOC4QCIGQCJKnWjnBk6Gl62ANreu4GjjAd1kdQgEhkCijMUASERRpXJBaLdu4EhLwqSyFTCR8YCxTAqJFgJd2SHQTSaFQBRCYCJBkCEwLlOmbJZJkzZVKOwnAgZAqnSZsgTMoN7WlTgNOsy6EoNBLawrHsFi0MmKNhEk0mnhoonUDZwqqegKjibizGCIJQS6tQKCHQIjsUNgNHYIjIUdAuNhtwYmwg6BXrJDYJYZMKCWDBqUV6GwnwiqWJeUGBz5dihp0CDxgyAREWW/nTt3SsOGWGnMLDeW4Jm4ozLHpUce+V5q18ZCFuXt27dLbr75SFxN5c9AGYAtgEREREQ5hgGQiIgoy0yZslYmTVpdobA/BvdoYZYVToYwUaunlhucl+gVLQzmxalVX9IyzZzkbwyAPoSTh+cC/p7Zh3/T7MLfM3MNGNBIBg3Kr1DYH8VtWldpnaaFafxTtPAAuQ0GRvhrptVJC7OzMLD3BS3yOQZAH+KbbnbJld8T+DfNLvw9c9L1Wg9pYTr8fq27tGponacVDgt2nqE1UmubFloAb9E6R6utFvkYAyAREREBJpB01JputoJKtGZpmZkjYfpoFWrNNVtBP2jh9EC4jXyMs4CTY2ZbrVq1ytNZwKNGjZIxY8ZYW9mLv2f24d80u/D39BZmAbdr1w5XUz4L+C9/+Vjy8uoG94QoLNwjd9wxBFedfga02q3U6q61ADss47Vw32vNVpnLtNBa2MpslVmvhVbBV80W+RIDYHLaaK0OXiUiIooJgpb7qWySk6e1TCvSIpvoqsXxC613oRAeMZmjv9a32GFBH/kcrVvNVhl09SIcho8PxNcdrvWe2SJfYgBMDh6/1lqYKUVERBQNFufDVNzUnV4nGAJrBq86QhdtePizLdUaq/W42RKpprVO63damPARCmMAETaP0LK7gXF9plYHLTaQEBEREWUAtPLhZNpY+gXnEnpAa5WW2yzgCVofaTXRwqzhT7Te0iIiIiKiDDJaC61+u7VC1wHEAEb0eB1vtoKwrszLWug6xkzgF7W8GxRPRERERESUCzDAdrYWBuyiZmhdoJVtLtf6SmuL1iatz7UGaGWbw7U+0MIn61Ktk7WyRTxnDshUF2tN0tqhhaUxsnUZLXT5YSkP/J74m2ImZzau6fYnrcVaaLnaqPWhFsavERFVOkytD51eP1Brr1Zvs5U9sPAoVp3HmgUYcPxbLSw5gAk22aSb1i+1jtJCgMiWAIgzB6zQ6qFVSwvraWDwt9uYoUyF5yhC4C+0sjkA3q+FNd+qa6ErDwP/v9fKNodq2acsw++KZUuwfAknRxKRr+BN6QQtBMDzsSPLYSzJucGrWSmbWgAxa/DG4FUDIX6D1gizlX1O1MrmABgOrWL4fbP5/K744HKzFn5PTGYgIqp0+ASOMIRT8iA0fKmFN6ts1k8LyxRgRfpslS0BEM9P/C74m4XCumEPB69mnVwLgL/XQsjPRmdq4f0Vz+FiLSxqTJQTeCq4yvGcFt5wcBDBZXhhDJwNXaH5Wlg7CuP/MIYM4SgTxPN72jDLDAuLYhwSliLIBIn8ntnCnu2HcVShcFDlTMDMd6oWzgV7ndnKPng/xftrYy2cw3aqFhFRymBsFN5w3Aphz837WjcEr/pevL9nFy20NCD8ZZJE/p4IhmwBzEy50gJ4lhaCPCaj5QIMs8EHmWwbY01EWeJjrX8Er2YVzJDF6vijzFb2y5YACE5jADGrkmMAMxf+dgh/aAHMFZgIskcrF8ZYE5HPYXkUzFTDgQan9vm1VpHW6VrZBEu+YAmYm8xWdsP4TfwtEQCHWtsITJks3jMHZCq8DvH3wpn0EQDx+2E722aNIsxj2anQxX6zEd5vmgevSjOtp7Twe7fADiKiyoTV2NG6grXVsD7e11o4wXa2wRg5DMDGeEf8rihcv0Mrm+DcmAh+CA+hhfXIMp3bmQOyyZVaoX8/+/ogrWyC3wuTzvAatF+TuMy2QIhTmOE5i98P6x2+rYUlmoiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIUk7k/wEk71rRrWGHGgAAAABJRU5ErkJggg==\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "res = train_and_plot(30)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Определение модели в функциональном стиле\n",
    "\n",
    "  * Модель обычно состоит из множества последовательно-применяемых слоёв\n",
    "  * В глубоком обучении количество слоёв может быть весьма большим (100+)\n",
    "  * Для описания удобно использовать функции комбинирования слоёв\n",
    "  * Попробуем другую передаточную функцию (`relu`)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [],
   "source": [
    "from cntk.layers import *\n",
    "z = Sequential([\n",
    "    Dense(10,init=glorot_uniform(),activation=relu),\n",
    "    Dense(output_dim,init=glorot_uniform(),activation=None)\n",
    "])(features)\n",
    "loss = cntk.cross_entropy_with_softmax(z, label)\n",
    "eval_error = cntk.classification_error(z, label)\n",
    "\n",
    "#pp=cntk.logging.ProgressPrinter()\n",
    "\n",
    "learning_rate = 0.05\n",
    "learner = sgd(z.parameters, lr=cntk.learning_rate_schedule(learning_rate,cntk.UnitType.minibatch))\n",
    "trainer = Trainer(z, (loss, eval_error), [learner])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "outputs": [
    {
     "data": {
      "application/javascript": [
       "/* Put everything inside the global mpl namespace */\n",
       "window.mpl = {};\n",
       "\n",
       "mpl.get_websocket_type = function() {\n",
       "    if (typeof(WebSocket) !== 'undefined') {\n",
       "        return WebSocket;\n",
       "    } else if (typeof(MozWebSocket) !== 'undefined') {\n",
       "        return MozWebSocket;\n",
       "    } else {\n",
       "        alert('Your browser does not have WebSocket support.' +\n",
       "              'Please try Chrome, Safari or Firefox ≥ 6. ' +\n",
       "              'Firefox 4 and 5 are also supported but you ' +\n",
       "              'have to enable WebSockets in about:config.');\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure = function(figure_id, websocket, ondownload, parent_element) {\n",
       "    this.id = figure_id;\n",
       "\n",
       "    this.ws = websocket;\n",
       "\n",
       "    this.supports_binary = (this.ws.binaryType != undefined);\n",
       "\n",
       "    if (!this.supports_binary) {\n",
       "        var warnings = document.getElementById(\"mpl-warnings\");\n",
       "        if (warnings) {\n",
       "            warnings.style.display = 'block';\n",
       "            warnings.textContent = (\n",
       "                \"This browser does not support binary websocket messages. \" +\n",
       "                    \"Performance may be slow.\");\n",
       "        }\n",
       "    }\n",
       "\n",
       "    this.imageObj = new Image();\n",
       "\n",
       "    this.context = undefined;\n",
       "    this.message = undefined;\n",
       "    this.canvas = undefined;\n",
       "    this.rubberband_canvas = undefined;\n",
       "    this.rubberband_context = undefined;\n",
       "    this.format_dropdown = undefined;\n",
       "\n",
       "    this.image_mode = 'full';\n",
       "\n",
       "    this.root = $('<div/>');\n",
       "    this._root_extra_style(this.root)\n",
       "    this.root.attr('style', 'display: inline-block');\n",
       "\n",
       "    $(parent_element).append(this.root);\n",
       "\n",
       "    this._init_header(this);\n",
       "    this._init_canvas(this);\n",
       "    this._init_toolbar(this);\n",
       "\n",
       "    var fig = this;\n",
       "\n",
       "    this.waiting = false;\n",
       "\n",
       "    this.ws.onopen =  function () {\n",
       "            fig.send_message(\"supports_binary\", {value: fig.supports_binary});\n",
       "            fig.send_message(\"send_image_mode\", {});\n",
       "            fig.send_message(\"refresh\", {});\n",
       "        }\n",
       "\n",
       "    this.imageObj.onload = function() {\n",
       "            if (fig.image_mode == 'full') {\n",
       "                // Full images could contain transparency (where diff images\n",
       "                // almost always do), so we need to clear the canvas so that\n",
       "                // there is no ghosting.\n",
       "                fig.context.clearRect(0, 0, fig.canvas.width, fig.canvas.height);\n",
       "            }\n",
       "            fig.context.drawImage(fig.imageObj, 0, 0);\n",
       "        };\n",
       "\n",
       "    this.imageObj.onunload = function() {\n",
       "        this.ws.close();\n",
       "    }\n",
       "\n",
       "    this.ws.onmessage = this._make_on_message_function(this);\n",
       "\n",
       "    this.ondownload = ondownload;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_header = function() {\n",
       "    var titlebar = $(\n",
       "        '<div class=\"ui-dialog-titlebar ui-widget-header ui-corner-all ' +\n",
       "        'ui-helper-clearfix\"/>');\n",
       "    var titletext = $(\n",
       "        '<div class=\"ui-dialog-title\" style=\"width: 100%; ' +\n",
       "        'text-align: center; padding: 3px;\"/>');\n",
       "    titlebar.append(titletext)\n",
       "    this.root.append(titlebar);\n",
       "    this.header = titletext[0];\n",
       "}\n",
       "\n",
       "\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(canvas_div) {\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_canvas = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var canvas_div = $('<div/>');\n",
       "\n",
       "    canvas_div.attr('style', 'position: relative; clear: both; outline: 0');\n",
       "\n",
       "    function canvas_keyboard_event(event) {\n",
       "        return fig.key_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    canvas_div.keydown('key_press', canvas_keyboard_event);\n",
       "    canvas_div.keyup('key_release', canvas_keyboard_event);\n",
       "    this.canvas_div = canvas_div\n",
       "    this._canvas_extra_style(canvas_div)\n",
       "    this.root.append(canvas_div);\n",
       "\n",
       "    var canvas = $('<canvas/>');\n",
       "    canvas.addClass('mpl-canvas');\n",
       "    canvas.attr('style', \"left: 0; top: 0; z-index: 0; outline: 0\")\n",
       "\n",
       "    this.canvas = canvas[0];\n",
       "    this.context = canvas[0].getContext(\"2d\");\n",
       "\n",
       "    var rubberband = $('<canvas/>');\n",
       "    rubberband.attr('style', \"position: absolute; left: 0; top: 0; z-index: 1;\")\n",
       "\n",
       "    var pass_mouse_events = true;\n",
       "\n",
       "    canvas_div.resizable({\n",
       "        start: function(event, ui) {\n",
       "            pass_mouse_events = false;\n",
       "        },\n",
       "        resize: function(event, ui) {\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "        stop: function(event, ui) {\n",
       "            pass_mouse_events = true;\n",
       "            fig.request_resize(ui.size.width, ui.size.height);\n",
       "        },\n",
       "    });\n",
       "\n",
       "    function mouse_event_fn(event) {\n",
       "        if (pass_mouse_events)\n",
       "            return fig.mouse_event(event, event['data']);\n",
       "    }\n",
       "\n",
       "    rubberband.mousedown('button_press', mouse_event_fn);\n",
       "    rubberband.mouseup('button_release', mouse_event_fn);\n",
       "    // Throttle sequential mouse events to 1 every 20ms.\n",
       "    rubberband.mousemove('motion_notify', mouse_event_fn);\n",
       "\n",
       "    rubberband.mouseenter('figure_enter', mouse_event_fn);\n",
       "    rubberband.mouseleave('figure_leave', mouse_event_fn);\n",
       "\n",
       "    canvas_div.on(\"wheel\", function (event) {\n",
       "        event = event.originalEvent;\n",
       "        event['data'] = 'scroll'\n",
       "        if (event.deltaY < 0) {\n",
       "            event.step = 1;\n",
       "        } else {\n",
       "            event.step = -1;\n",
       "        }\n",
       "        mouse_event_fn(event);\n",
       "    });\n",
       "\n",
       "    canvas_div.append(canvas);\n",
       "    canvas_div.append(rubberband);\n",
       "\n",
       "    this.rubberband = rubberband;\n",
       "    this.rubberband_canvas = rubberband[0];\n",
       "    this.rubberband_context = rubberband[0].getContext(\"2d\");\n",
       "    this.rubberband_context.strokeStyle = \"#000000\";\n",
       "\n",
       "    this._resize_canvas = function(width, height) {\n",
       "        // Keep the size of the canvas, canvas container, and rubber band\n",
       "        // canvas in synch.\n",
       "        canvas_div.css('width', width)\n",
       "        canvas_div.css('height', height)\n",
       "\n",
       "        canvas.attr('width', width);\n",
       "        canvas.attr('height', height);\n",
       "\n",
       "        rubberband.attr('width', width);\n",
       "        rubberband.attr('height', height);\n",
       "    }\n",
       "\n",
       "    // Set the figure to an initial 600x600px, this will subsequently be updated\n",
       "    // upon first draw.\n",
       "    this._resize_canvas(600, 600);\n",
       "\n",
       "    // Disable right mouse context menu.\n",
       "    $(this.rubberband_canvas).bind(\"contextmenu\",function(e){\n",
       "        return false;\n",
       "    });\n",
       "\n",
       "    function set_focus () {\n",
       "        canvas.focus();\n",
       "        canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    window.setTimeout(set_focus, 100);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items) {\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) {\n",
       "            // put a spacer in here.\n",
       "            continue;\n",
       "        }\n",
       "        var button = $('<button/>');\n",
       "        button.addClass('ui-button ui-widget ui-state-default ui-corner-all ' +\n",
       "                        'ui-button-icon-only');\n",
       "        button.attr('role', 'button');\n",
       "        button.attr('aria-disabled', 'false');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "\n",
       "        var icon_img = $('<span/>');\n",
       "        icon_img.addClass('ui-button-icon-primary ui-icon');\n",
       "        icon_img.addClass(image);\n",
       "        icon_img.addClass('ui-corner-all');\n",
       "\n",
       "        var tooltip_span = $('<span/>');\n",
       "        tooltip_span.addClass('ui-button-text');\n",
       "        tooltip_span.html(tooltip);\n",
       "\n",
       "        button.append(icon_img);\n",
       "        button.append(tooltip_span);\n",
       "\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    var fmt_picker_span = $('<span/>');\n",
       "\n",
       "    var fmt_picker = $('<select/>');\n",
       "    fmt_picker.addClass('mpl-toolbar-option ui-widget ui-widget-content');\n",
       "    fmt_picker_span.append(fmt_picker);\n",
       "    nav_element.append(fmt_picker_span);\n",
       "    this.format_dropdown = fmt_picker[0];\n",
       "\n",
       "    for (var ind in mpl.extensions) {\n",
       "        var fmt = mpl.extensions[ind];\n",
       "        var option = $(\n",
       "            '<option/>', {selected: fmt === mpl.default_extension}).html(fmt);\n",
       "        fmt_picker.append(option)\n",
       "    }\n",
       "\n",
       "    // Add hover states to the ui-buttons\n",
       "    $( \".ui-button\" ).hover(\n",
       "        function() { $(this).addClass(\"ui-state-hover\");},\n",
       "        function() { $(this).removeClass(\"ui-state-hover\");}\n",
       "    );\n",
       "\n",
       "    var status_bar = $('<span class=\"mpl-message\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.request_resize = function(x_pixels, y_pixels) {\n",
       "    // Request matplotlib to resize the figure. Matplotlib will then trigger a resize in the client,\n",
       "    // which will in turn request a refresh of the image.\n",
       "    this.send_message('resize', {'width': x_pixels, 'height': y_pixels});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_message = function(type, properties) {\n",
       "    properties['type'] = type;\n",
       "    properties['figure_id'] = this.id;\n",
       "    this.ws.send(JSON.stringify(properties));\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.send_draw_message = function() {\n",
       "    if (!this.waiting) {\n",
       "        this.waiting = true;\n",
       "        this.ws.send(JSON.stringify({type: \"draw\", figure_id: this.id}));\n",
       "    }\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    var format_dropdown = fig.format_dropdown;\n",
       "    var format = format_dropdown.options[format_dropdown.selectedIndex].value;\n",
       "    fig.ondownload(fig, format);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.figure.prototype.handle_resize = function(fig, msg) {\n",
       "    var size = msg['size'];\n",
       "    if (size[0] != fig.canvas.width || size[1] != fig.canvas.height) {\n",
       "        fig._resize_canvas(size[0], size[1]);\n",
       "        fig.send_message(\"refresh\", {});\n",
       "    };\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_rubberband = function(fig, msg) {\n",
       "    var x0 = msg['x0'];\n",
       "    var y0 = fig.canvas.height - msg['y0'];\n",
       "    var x1 = msg['x1'];\n",
       "    var y1 = fig.canvas.height - msg['y1'];\n",
       "    x0 = Math.floor(x0) + 0.5;\n",
       "    y0 = Math.floor(y0) + 0.5;\n",
       "    x1 = Math.floor(x1) + 0.5;\n",
       "    y1 = Math.floor(y1) + 0.5;\n",
       "    var min_x = Math.min(x0, x1);\n",
       "    var min_y = Math.min(y0, y1);\n",
       "    var width = Math.abs(x1 - x0);\n",
       "    var height = Math.abs(y1 - y0);\n",
       "\n",
       "    fig.rubberband_context.clearRect(\n",
       "        0, 0, fig.canvas.width, fig.canvas.height);\n",
       "\n",
       "    fig.rubberband_context.strokeRect(min_x, min_y, width, height);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_figure_label = function(fig, msg) {\n",
       "    // Updates the figure title.\n",
       "    fig.header.textContent = msg['label'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_cursor = function(fig, msg) {\n",
       "    var cursor = msg['cursor'];\n",
       "    switch(cursor)\n",
       "    {\n",
       "    case 0:\n",
       "        cursor = 'pointer';\n",
       "        break;\n",
       "    case 1:\n",
       "        cursor = 'default';\n",
       "        break;\n",
       "    case 2:\n",
       "        cursor = 'crosshair';\n",
       "        break;\n",
       "    case 3:\n",
       "        cursor = 'move';\n",
       "        break;\n",
       "    }\n",
       "    fig.rubberband_canvas.style.cursor = cursor;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_message = function(fig, msg) {\n",
       "    fig.message.textContent = msg['message'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_draw = function(fig, msg) {\n",
       "    // Request the server to send over a new figure.\n",
       "    fig.send_draw_message();\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_image_mode = function(fig, msg) {\n",
       "    fig.image_mode = msg['mode'];\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Called whenever the canvas gets updated.\n",
       "    this.send_message(\"ack\", {});\n",
       "}\n",
       "\n",
       "// A function to construct a web socket function for onmessage handling.\n",
       "// Called in the figure constructor.\n",
       "mpl.figure.prototype._make_on_message_function = function(fig) {\n",
       "    return function socket_on_message(evt) {\n",
       "        if (evt.data instanceof Blob) {\n",
       "            /* FIXME: We get \"Resource interpreted as Image but\n",
       "             * transferred with MIME type text/plain:\" errors on\n",
       "             * Chrome.  But how to set the MIME type?  It doesn't seem\n",
       "             * to be part of the websocket stream */\n",
       "            evt.data.type = \"image/png\";\n",
       "\n",
       "            /* Free the memory for the previous frames */\n",
       "            if (fig.imageObj.src) {\n",
       "                (window.URL || window.webkitURL).revokeObjectURL(\n",
       "                    fig.imageObj.src);\n",
       "            }\n",
       "\n",
       "            fig.imageObj.src = (window.URL || window.webkitURL).createObjectURL(\n",
       "                evt.data);\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "        else if (typeof evt.data === 'string' && evt.data.slice(0, 21) == \"data:image/png;base64\") {\n",
       "            fig.imageObj.src = evt.data;\n",
       "            fig.updated_canvas_event();\n",
       "            fig.waiting = false;\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        var msg = JSON.parse(evt.data);\n",
       "        var msg_type = msg['type'];\n",
       "\n",
       "        // Call the  \"handle_{type}\" callback, which takes\n",
       "        // the figure and JSON message as its only arguments.\n",
       "        try {\n",
       "            var callback = fig[\"handle_\" + msg_type];\n",
       "        } catch (e) {\n",
       "            console.log(\"No handler for the '\" + msg_type + \"' message type: \", msg);\n",
       "            return;\n",
       "        }\n",
       "\n",
       "        if (callback) {\n",
       "            try {\n",
       "                // console.log(\"Handling '\" + msg_type + \"' message: \", msg);\n",
       "                callback(fig, msg);\n",
       "            } catch (e) {\n",
       "                console.log(\"Exception inside the 'handler_\" + msg_type + \"' callback:\", e, e.stack, msg);\n",
       "            }\n",
       "        }\n",
       "    };\n",
       "}\n",
       "\n",
       "// from http://stackoverflow.com/questions/1114465/getting-mouse-location-in-canvas\n",
       "mpl.findpos = function(e) {\n",
       "    //this section is from http://www.quirksmode.org/js/events_properties.html\n",
       "    var targ;\n",
       "    if (!e)\n",
       "        e = window.event;\n",
       "    if (e.target)\n",
       "        targ = e.target;\n",
       "    else if (e.srcElement)\n",
       "        targ = e.srcElement;\n",
       "    if (targ.nodeType == 3) // defeat Safari bug\n",
       "        targ = targ.parentNode;\n",
       "\n",
       "    // jQuery normalizes the pageX and pageY\n",
       "    // pageX,Y are the mouse positions relative to the document\n",
       "    // offset() returns the position of the element relative to the document\n",
       "    var x = e.pageX - $(targ).offset().left;\n",
       "    var y = e.pageY - $(targ).offset().top;\n",
       "\n",
       "    return {\"x\": x, \"y\": y};\n",
       "};\n",
       "\n",
       "/*\n",
       " * return a copy of an object with only non-object keys\n",
       " * we need this to avoid circular references\n",
       " * http://stackoverflow.com/a/24161582/3208463\n",
       " */\n",
       "function simpleKeys (original) {\n",
       "  return Object.keys(original).reduce(function (obj, key) {\n",
       "    if (typeof original[key] !== 'object')\n",
       "        obj[key] = original[key]\n",
       "    return obj;\n",
       "  }, {});\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.mouse_event = function(event, name) {\n",
       "    var canvas_pos = mpl.findpos(event)\n",
       "\n",
       "    if (name === 'button_press')\n",
       "    {\n",
       "        this.canvas.focus();\n",
       "        this.canvas_div.focus();\n",
       "    }\n",
       "\n",
       "    var x = canvas_pos.x;\n",
       "    var y = canvas_pos.y;\n",
       "\n",
       "    this.send_message(name, {x: x, y: y, button: event.button,\n",
       "                             step: event.step,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "\n",
       "    /* This prevents the web browser from automatically changing to\n",
       "     * the text insertion cursor when the button is pressed.  We want\n",
       "     * to control all of the cursor setting manually through the\n",
       "     * 'cursor' event from matplotlib */\n",
       "    event.preventDefault();\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    // Handle any extra behaviour associated with a key event\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.key_event = function(event, name) {\n",
       "\n",
       "    // Prevent repeat events\n",
       "    if (name == 'key_press')\n",
       "    {\n",
       "        if (event.which === this._key)\n",
       "            return;\n",
       "        else\n",
       "            this._key = event.which;\n",
       "    }\n",
       "    if (name == 'key_release')\n",
       "        this._key = null;\n",
       "\n",
       "    var value = '';\n",
       "    if (event.ctrlKey && event.which != 17)\n",
       "        value += \"ctrl+\";\n",
       "    if (event.altKey && event.which != 18)\n",
       "        value += \"alt+\";\n",
       "    if (event.shiftKey && event.which != 16)\n",
       "        value += \"shift+\";\n",
       "\n",
       "    value += 'k';\n",
       "    value += event.which.toString();\n",
       "\n",
       "    this._key_event_extra(event, name);\n",
       "\n",
       "    this.send_message(name, {key: value,\n",
       "                             guiEvent: simpleKeys(event)});\n",
       "    return false;\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onclick = function(name) {\n",
       "    if (name == 'download') {\n",
       "        this.handle_save(this, null);\n",
       "    } else {\n",
       "        this.send_message(\"toolbar_button\", {name: name});\n",
       "    }\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.toolbar_button_onmouseover = function(tooltip) {\n",
       "    this.message.textContent = tooltip;\n",
       "};\n",
       "mpl.toolbar_items = [[\"Home\", \"Reset original view\", \"fa fa-home icon-home\", \"home\"], [\"Back\", \"Back to  previous view\", \"fa fa-arrow-left icon-arrow-left\", \"back\"], [\"Forward\", \"Forward to next view\", \"fa fa-arrow-right icon-arrow-right\", \"forward\"], [\"\", \"\", \"\", \"\"], [\"Pan\", \"Pan axes with left mouse, zoom with right\", \"fa fa-arrows icon-move\", \"pan\"], [\"Zoom\", \"Zoom to rectangle\", \"fa fa-square-o icon-check-empty\", \"zoom\"], [\"\", \"\", \"\", \"\"], [\"Download\", \"Download plot\", \"fa fa-floppy-o icon-save\", \"download\"]];\n",
       "\n",
       "mpl.extensions = [\"eps\", \"jpeg\", \"pdf\", \"png\", \"ps\", \"raw\", \"svg\", \"tif\"];\n",
       "\n",
       "mpl.default_extension = \"png\";var comm_websocket_adapter = function(comm) {\n",
       "    // Create a \"websocket\"-like object which calls the given IPython comm\n",
       "    // object with the appropriate methods. Currently this is a non binary\n",
       "    // socket, so there is still some room for performance tuning.\n",
       "    var ws = {};\n",
       "\n",
       "    ws.close = function() {\n",
       "        comm.close()\n",
       "    };\n",
       "    ws.send = function(m) {\n",
       "        //console.log('sending', m);\n",
       "        comm.send(m);\n",
       "    };\n",
       "    // Register the callback with on_msg.\n",
       "    comm.on_msg(function(msg) {\n",
       "        //console.log('receiving', msg['content']['data'], msg);\n",
       "        // Pass the mpl event to the overriden (by mpl) onmessage function.\n",
       "        ws.onmessage(msg['content']['data'])\n",
       "    });\n",
       "    return ws;\n",
       "}\n",
       "\n",
       "mpl.mpl_figure_comm = function(comm, msg) {\n",
       "    // This is the function which gets called when the mpl process\n",
       "    // starts-up an IPython Comm through the \"matplotlib\" channel.\n",
       "\n",
       "    var id = msg.content.data.id;\n",
       "    // Get hold of the div created by the display call when the Comm\n",
       "    // socket was opened in Python.\n",
       "    var element = $(\"#\" + id);\n",
       "    var ws_proxy = comm_websocket_adapter(comm)\n",
       "\n",
       "    function ondownload(figure, format) {\n",
       "        window.open(figure.imageObj.src);\n",
       "    }\n",
       "\n",
       "    var fig = new mpl.figure(id, ws_proxy,\n",
       "                           ondownload,\n",
       "                           element.get(0));\n",
       "\n",
       "    // Call onopen now - mpl needs it, as it is assuming we've passed it a real\n",
       "    // web socket which is closed, not our websocket->open comm proxy.\n",
       "    ws_proxy.onopen();\n",
       "\n",
       "    fig.parent_element = element.get(0);\n",
       "    fig.cell_info = mpl.find_output_cell(\"<div id='\" + id + \"'></div>\");\n",
       "    if (!fig.cell_info) {\n",
       "        console.error(\"Failed to find cell for figure\", id, fig);\n",
       "        return;\n",
       "    }\n",
       "\n",
       "    var output_index = fig.cell_info[2]\n",
       "    var cell = fig.cell_info[0];\n",
       "\n",
       "};\n",
       "\n",
       "mpl.figure.prototype.handle_close = function(fig, msg) {\n",
       "    fig.root.unbind('remove')\n",
       "\n",
       "    // Update the output cell to use the data from the current canvas.\n",
       "    fig.push_to_output();\n",
       "    var dataURL = fig.canvas.toDataURL();\n",
       "    // Re-enable the keyboard manager in IPython - without this line, in FF,\n",
       "    // the notebook keyboard shortcuts fail.\n",
       "    IPython.keyboard_manager.enable()\n",
       "    $(fig.parent_element).html('<img src=\"' + dataURL + '\">');\n",
       "    fig.close_ws(fig, msg);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.close_ws = function(fig, msg){\n",
       "    fig.send_message('closing', msg);\n",
       "    // fig.ws.close()\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.push_to_output = function(remove_interactive) {\n",
       "    // Turn the data on the canvas into data in the output cell.\n",
       "    var dataURL = this.canvas.toDataURL();\n",
       "    this.cell_info[1]['text/html'] = '<img src=\"' + dataURL + '\">';\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.updated_canvas_event = function() {\n",
       "    // Tell IPython that the notebook contents must change.\n",
       "    IPython.notebook.set_dirty(true);\n",
       "    this.send_message(\"ack\", {});\n",
       "    var fig = this;\n",
       "    // Wait a second, then push the new image to the DOM so\n",
       "    // that it is saved nicely (might be nice to debounce this).\n",
       "    setTimeout(function () { fig.push_to_output() }, 1000);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._init_toolbar = function() {\n",
       "    var fig = this;\n",
       "\n",
       "    var nav_element = $('<div/>')\n",
       "    nav_element.attr('style', 'width: 100%');\n",
       "    this.root.append(nav_element);\n",
       "\n",
       "    // Define a callback function for later on.\n",
       "    function toolbar_event(event) {\n",
       "        return fig.toolbar_button_onclick(event['data']);\n",
       "    }\n",
       "    function toolbar_mouse_event(event) {\n",
       "        return fig.toolbar_button_onmouseover(event['data']);\n",
       "    }\n",
       "\n",
       "    for(var toolbar_ind in mpl.toolbar_items){\n",
       "        var name = mpl.toolbar_items[toolbar_ind][0];\n",
       "        var tooltip = mpl.toolbar_items[toolbar_ind][1];\n",
       "        var image = mpl.toolbar_items[toolbar_ind][2];\n",
       "        var method_name = mpl.toolbar_items[toolbar_ind][3];\n",
       "\n",
       "        if (!name) { continue; };\n",
       "\n",
       "        var button = $('<button class=\"btn btn-default\" href=\"#\" title=\"' + name + '\"><i class=\"fa ' + image + ' fa-lg\"></i></button>');\n",
       "        button.click(method_name, toolbar_event);\n",
       "        button.mouseover(tooltip, toolbar_mouse_event);\n",
       "        nav_element.append(button);\n",
       "    }\n",
       "\n",
       "    // Add the status bar.\n",
       "    var status_bar = $('<span class=\"mpl-message\" style=\"text-align:right; float: right;\"/>');\n",
       "    nav_element.append(status_bar);\n",
       "    this.message = status_bar[0];\n",
       "\n",
       "    // Add the close button to the window.\n",
       "    var buttongrp = $('<div class=\"btn-group inline pull-right\"></div>');\n",
       "    var button = $('<button class=\"btn btn-mini btn-primary\" href=\"#\" title=\"Stop Interaction\"><i class=\"fa fa-power-off icon-remove icon-large\"></i></button>');\n",
       "    button.click(function (evt) { fig.handle_close(fig, {}); } );\n",
       "    button.mouseover('Stop Interaction', toolbar_mouse_event);\n",
       "    buttongrp.append(button);\n",
       "    var titlebar = this.root.find($('.ui-dialog-titlebar'));\n",
       "    titlebar.prepend(buttongrp);\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._root_extra_style = function(el){\n",
       "    var fig = this\n",
       "    el.on(\"remove\", function(){\n",
       "\tfig.close_ws(fig, {});\n",
       "    });\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._canvas_extra_style = function(el){\n",
       "    // this is important to make the div 'focusable\n",
       "    el.attr('tabindex', 0)\n",
       "    // reach out to IPython and tell the keyboard manager to turn it's self\n",
       "    // off when our div gets focus\n",
       "\n",
       "    // location in version 3\n",
       "    if (IPython.notebook.keyboard_manager) {\n",
       "        IPython.notebook.keyboard_manager.register_events(el);\n",
       "    }\n",
       "    else {\n",
       "        // location in version 2\n",
       "        IPython.keyboard_manager.register_events(el);\n",
       "    }\n",
       "\n",
       "}\n",
       "\n",
       "mpl.figure.prototype._key_event_extra = function(event, name) {\n",
       "    var manager = IPython.notebook.keyboard_manager;\n",
       "    if (!manager)\n",
       "        manager = IPython.keyboard_manager;\n",
       "\n",
       "    // Check for shift+enter\n",
       "    if (event.shiftKey && event.which == 13) {\n",
       "        this.canvas_div.blur();\n",
       "        // select the cell after this one\n",
       "        var index = IPython.notebook.find_cell_index(this.cell_info[0]);\n",
       "        IPython.notebook.select(index + 1);\n",
       "    }\n",
       "}\n",
       "\n",
       "mpl.figure.prototype.handle_save = function(fig, msg) {\n",
       "    fig.ondownload(fig, null);\n",
       "}\n",
       "\n",
       "\n",
       "mpl.find_output_cell = function(html_output) {\n",
       "    // Return the cell and output element which can be found *uniquely* in the notebook.\n",
       "    // Note - this is a bit hacky, but it is done because the \"notebook_saving.Notebook\"\n",
       "    // IPython event is triggered only after the cells have been serialised, which for\n",
       "    // our purposes (turning an active figure into a static one), is too late.\n",
       "    var cells = IPython.notebook.get_cells();\n",
       "    var ncells = cells.length;\n",
       "    for (var i=0; i<ncells; i++) {\n",
       "        var cell = cells[i];\n",
       "        if (cell.cell_type === 'code'){\n",
       "            for (var j=0; j<cell.output_area.outputs.length; j++) {\n",
       "                var data = cell.output_area.outputs[j];\n",
       "                if (data.data) {\n",
       "                    // IPython >= 3 moved mimebundle to data attribute of output\n",
       "                    data = data.data;\n",
       "                }\n",
       "                if (data['text/html'] == html_output) {\n",
       "                    return [cell, data, j];\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "    }\n",
       "}\n",
       "\n",
       "// Register the function which deals with the matplotlib target/channel.\n",
       "// The kernel may be null if the page has been refreshed.\n",
       "if (IPython.notebook.kernel != null) {\n",
       "    IPython.notebook.kernel.comm_manager.register_target('matplotlib', mpl.mpl_figure_comm);\n",
       "}\n"
      ],
      "text/plain": [
       "<IPython.core.display.Javascript object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/html": [
       "<img src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAIRvSURBVHhe7d0JfFTl2Tbwm0AS9n3fQUAUF8AVwYgLImq1atW+FZe2tmqxvhW1r9papa1286O2SrW21qrVulXrbtxFXAFREBBl33dIAiQkJPnu65nzkJPJmcnsmXPm+vd3d2ZOJphkJjNX7mc5QkRERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERERESUPZo5l5QY/Px6a5WZW0REROQX7bTWa9WaWzmGATA5fbTWhq4SERGRz/TVWhe6mlsYAJPTXqtkzZo10r49rlJTuPnmm+WOO+5wblFT4ePQ9PgYND0+Bk0vlsegtLRU+vXrh6sdcBNXcg0DYHJMAFQMgE1o6tSpMn36dOcWNRU+Dk2Pj0HT42PQ9GJ5DBAAO3RA9svdAJjnXBIRERFRjmAAJN+bOHGic42aEh+HpsfHoOnxMWh6fAxiwyHg5HAImIiIyGc4BMwOIBEREVHOyZUO4DSty7XQppurNUVroZaXI7V+rzVSa5/We1rXaq3WCscOoKqoqJDKykrnFhERZbuCggJp2bKlcyv3sAOYGwHwBq2rtSZpLdO6VesSrWFae7Tc8PPYqPWo1k+1CrX+oYV9gsZqhcv5AIjwN2jQINm4ET82IiLyg549e8qKFStyNgQyAOZGAFyuhfXg95hbIs21sPP3VC0EPbeOWtu00P1bgAPqDK0ntdqYW/XlfAC0v0TcC5GIyB/wuo098PjexQAYZHhm79Qao/UxDjiKtRDwrje36vuzc/l/WugA/k2rXAtdw3AMgM4vUS7/DIiI/ISv2wyAEPRFIPaZjRDotkMr0rP+aa1TtPCE2Ko1SOs6LSIiIqJACHoAtKkeQ7tunbS8Ev8Qrde1/qTVWgsnin5J60OtVlpEREREvpercwA3aGFlb/gcwHO1HtBCQLQQAku0jtGajQMu6CKWTJkyxayoAmxAmUubUHIogYjIX3L1dbu4uNgUYOeKGTNm4GrODgHnAszzW6k1QgtdvN9ordFChy9cf63dWtgyBkERy6OwahgB0EwWCIPfnFr9JarNVfjeg/Yz+O9//1s7ffp051ZqXXbZZbWDBg1ybsVn4MCBtd/97nedW0RNb+XKlbXNmjWrfeihh5wjsT/HH3zwQfO5q1atco7EZufOnbW33XZb7bx585wjdcaPH1974oknOrcokiC+bsfL/gyc9/GclAsbQd+p9U+tN7S2aGFByGla2AKmn1aZlt3iBXv9na31PS3cd53WiVpYCYwQmJCtW7fK5s2bnVuU7TQAyh//+EfnVmr94he/kGeffda5FR98Xbfccotziyg7xfoc1/BnKl4aAGXatGny6aefOkfq3HvvvfKXv/zFuUVE0eTKmUBu0+ql1VZrvJbdBBqdQAzxvm9uhSAoHqfVWauLFu4/Syth11xzjdx1113OLQqSeDfAxp6Jhx9+uHMrPvg8fL6fVFVVOdfq27cPe6wnh5uPZ6dknuOxqK1F08bb8OHDTflFtOdwss/vmpoaqa6udm4RNcRTwWXABRdcIE8++WTUFy7KDt/97nfloYceknXr1kleXp6pwYMHm4+988475ja6Gz/84Q+le/fuZjNVWLZsmVxyySXmvq1bt5YDDjhAfvSjH5luhdtll11WL8StWrXK/Jv333+/3HrrrdK7d2/p1KmTnHXWWeZrcBs4cKB873toTof885//NJ/78ccfy+TJk82cnj59+sj//u//NnjzwIavp59+urRp08Z8zddff735b+LzV6/2OslNfc8884yMGTPGfD6+PjynsfejG76viy++WB588EE56KCDpLCwUF5++eX93yO6M//3f/9nvkZsPltSEmqqf/LJJ3LKKadIu3btpG3btub67Nn1p9vi54Z9yz766CMZO3as+Rnj36L4PP300+ax+OKLL5wjdfD8GDVqlHNLzPyo4447Trp06WIeczz+eDwbE/4cBzz/zjjjDPP86dGjh/zkJz+RvXv3Oh+t88QTT8jJJ59sfrfwfBg9erQ8/PDDzkdDvy/4HUPn8PLLLzffS/PmzfffZ/z48XLSSSeZ69ZXX30l55xzjvke8LzB92HngVm33Xab+beWLl0qZ555pvlv4/ftV7/6lXOP6MrLy83zEV8bnve4vOOOO+q95r/77rvmv+H1+mH/+wsXLpTTTjvN/PcvvPBC8zHAiASCLf5tvEb8+Mc/lrIyDF7Vwef//Oc/l9/97nf7vw6vx5mIUiOmOYD64lCrb2y1n376qXMkOII2l2T58uW1+kZVq29StRpMajVc1X722WfmYxoAzZylvn371v7gBz+o1TeR2ueee858bObMmbU33nijmT+I65gTdeCBB9bqG6j5uBU+P8rOocKxiy66qPbVV1+t1Tez2q5duzaYyxQ+B1ADoPncYcOG1Wp4rH3zzTdrf/3rX9fqG6KZI2VpGKzVN4RaDVC1jzzySO0rr7xSe95559UOGDCgVt80Gp2DpcHN/Hf0Ddd8rv4xU6sBz/ybu3btcu4V+vo03NUeeuihtY8//njtW2+9ZX6e9nvEz03fiGtfeuml2ueff762oqKi9vPPP69t1apV7ZFHHlmrIdPUUUcdZY7Nnz/f+ZdDPzd9UzT/jXvuuadW30zN40Pxwc+8Y8eOtRpWnCMhmzZtqm3RokWtBg3nSG2t/pFQq38kmOfVa6+9Vquhwzxf8Ly3YpkDaJ9/eG7gfhoia88++2zzfAx//t1+++21d999t/lv4L+L53VBQUHtX//6V/NxDY21GqDMf1PDjvn9RG3dutV8PHwO4Pr1683vkv5BVvvYY4/Vvvjii7WTJk0yvyP4XbPw+4J/E89dzP/Ff1tDqjmG37No9u3bVztu3Djz3/nzn/9snvca/mr1jxzzM7SivX7Y//6QIUNqf/Ob39S+/fbb5jkON910k/nYNddcYx6Hu+66y7yfFBUVmY9buA9+xjiO3yP8+5s3b3Y+Wl/QXrcTYX8Gzvs4UdxiXgTyne98xwSEoAniCwnewPDmFM6+gCM8NQZvCrNmzTJvcDZAQqQAeNJJJzlHQu68807zuRs2bHCORA6A06ZNc46EnHnmmSZ8WnjzxL81Z84c50jI4Ycf3uANOBwCXocOHUz4c8PXjTfmP/3pT86R0NfXpk2bBm869ntEyAuHn2WnTp1qS0tLnSO15nrnzp3r/Zzxc8PX+sILLzhHKFEIH+HPbwS//Pz82o0bNzpH6qupqTHP6VNPPbX2m9/8pnM0tgCIEInHzh3Y8e+NGDEi6vPP/jfx9Y4cOdI5WvfffOCBB5wjdcID4HXXXWe+L/whYlVXV5vfjyOOOMI5Egpg+Frc3wcgEE6cONG55Q1/sOFz8fvuhjBbWFhYu2XLFnM72uuH/e8j/Lpt377d/Bvf+973nCMh//rXv8y/5f59wG0EQITkxgTxdTte9mfgvI/nJA4BZwiHgUMw7IMtCLwq0nwVHPe6P8prGCnd9A3QuVYHc90w5IOhTwwz6ZuOHH/88eZjS5YsMZfRTJqEU1XX0Tcec9nY8Ky+6JuhOzd8rvvzMETcv39/0Tc850iIvhE51yL78MMPzVCT/gFjHgdbGMbFkNTMmTOde4Yce+yx0q1bN+dWfWefjfVV9b333nv7h9wsXMcQOIbM3PAzxTBitsLvdulefV6msVLx+oGpCmvXrpW33nrLOSKigcIMvWJ41po7d655bDBM2aJFC/Pzf/3112N6Prth2B7D90cddZRzJPS8xWtiOAzB/s///I/07dvX/PdQf//73+P+b1p4fuE5qYHUORIaKsV/Q/8wE/0DxzkaEv67dMghhzT6O1hcXCwDBgww/x3378iECRPMVAx8/25erx9W+MfwuXhtueiii5wjId/+9rfNYxL+O4LhY7slGVFjGAAzBHsD6l+CnivXcslvfvMbM1fNq7788kvnXvXhuNf9Ufj3Mq1XL6wnqu/GG2+UX/7yl+bNFfOkMIcNc33whl1RUeHcK7LOnbHmqA7m70Cin+sOxhs2bDDzjcK53+wjwep1fA8IB/YNGYU3Gcwv2rYNp86u4/Wzsbw+tn37ds/jCB07duCEPXUQLBEcslVZZZl0+K0+L9NY+G8ka9y4cWZ+2yOPPGJuL1682LwuXXrppeY2ICBiLibmsN5zzz3mD4E5c+aYgBHLc9INzz+v51r4sd27d5v/5oIFC+T3v/+9zJo1y/w3Me810T/0oj2/8LwOf455/S419v3id2TlypX1fj9QxxxzjHm+JvM7gq8fwo9j3iPmZtqPW9H+baJwDIAZgknv+GsNf1HmsptuuslM/veqSKv3cNzr/ij8e5nmFUIweR1voPh6MBEd3TYE1GyANwWvbYg2btzoXIsMbzLw8MMPmzdjdyHkYiGJW7SA5vUxvOF6fR04hkn7btkc/qBdQTspuVGfl2ks/DdSAYuGsLAH4QZBEF1Xd/fp1VdfNR32p556Sr71rW/J0UcfbRZk7NmD3bPig+ffpk2bnFt1wh93hEwsLPrb3/5mOs7oqOG/GWkleSwiPb8QSvF8Cn+OJQK/I1h0gY6p1+/IN77xDeeeIfH8juDrR1AN/x7QYUSwDA+s2f47QtmFATCDsMLOdnZyFb5/7DzvVfir1guOe90flY6fJ/5NrOrzEukFFm+MGJJx+8c//pEVL8h4I8UwFt6Q3P7zn/841yLDKlCEg6+//tq8GYfX0KFDnXsm5oQTTjAdU3R/LAw5v/DCC3LiidiC0z/wWLcv1OdlGitVzyes1sbwJ54Djz32mJkOgD9SLRv03M9prKZ9/333jlmxwapbBDus9rYQajAlxs3rv4kO3fPPP+/cCrG/85F+R93w/MIwqnsYF9uj4A82PH+x6jxZ6Iri+8MK5/DfD5Q7pMX7+OF3F932xx9/3DkSgtsIgfhjkyhRDIBEYQ4++GAztHLfffeZ0OTeSgFvXF7wJvDQQw+ZrU4wT+qqq64yHY1kRPpvxesyZ1sObIWBTt4rr7xi3vDRQQXMiYoE4e8Pf/iDGWrH94Q3Y3SyERquuOKKBm9M8cLG1njjx9Yd6EihMAyIN3duep0+CO7o6mHqAsILAqEbHgP84YXjeD7juY1pLJjrFi90xvH8O/fcc82/g+cfuo3h25jYPzZwak38UYCAiIATPqcUQ8fouuG5hzmo6LyFD4Va1157rXTs2NHMx/v3v/8tL774opnXiLmGt99+u3Ov5GB+Hr52PIexXQvmVqKDiqFz/MzcQ8jx/k6jQ3ndddeZeZD4XvBY/OlPfzK/i5hjnM1zYin7MQAShcH+Yphk/bOf/czM48GCBCvSX/B33323uR/24cLnoqMVKRyF/xuR/k2v+0W6bzj3/TAfCW8c2JwXbxwIhHgjxz6F0NhQNfYsQ/BDBwhzHPGmgzMxoAMxcuRI517Rv75Ix7FgBfsr4mvA14WwgOt4Y7cLYaxYv3eKDcLd+vXrzYKL8G4r/ghCyEfnDIt37rzzTrO/nF3Y5Ob1uLiP4fn3xhtvmOcKwh0eZwyZhgf8rl27mrPd4Hl1/vnnm9+/H/zgBw0WQODffuCBB0x3EMEOQRbBznL/tzH8jLmEI0aMMM93LDzBvEYETHyuW6TnV6TjFjqWWAiC3xMMX+P3A0PsGFrHfEv3ooxo/1akjyGoTp8+3YRKDCdjfiR+hu7vGfD5jX2tRG58tiQHy8dL0EnBcGQuwjwhvGHn8s/Ar9AJwepKDO8SUe7g63bdz0Dh/0pxJdfkSgdwmhZOq4Axh3e0Rmh5secGxpPBFvr3mIVcf7YtkY9gaArdCXTb0M1D9wdDcT/96U+dexARUS7JhQB4g9ZlWuj3d9X6QAvnAWqtFc6eGxh/Etl6SQvnP/KeZJIA7MuG4QGiTMHEeZyPGkNIGKLGvEYMo2GIjYiIck8uDAEv15qudY+5JYKlpuu1pmo9igNR9NFaoXWm1ms4EAYBMe4hYMw/ufLKK815Lf0+Z4NDCURE/sLX7bqfgeIQcEDhmT1Qy31meZxu4jOturOeR3aF1iotr/CXMKywwwo4dAKJiIiIMi0XAiDsdC4tbP/e2J892Izq+1r3mlsphFVh2AYhfB8sIiIiokwIegC0bd2OzqWF7d8ba/meq4XPe9DcSjFsR4Bd9rEpKREREVEm5eocwA1a12pFmwP4thbm/33P3PKGLmIJ9rayez1h409UY3CScJyPEns5YRNRv+JcEiIif8nV123s14gCvAfPmDEDV3N2DmAuBMDrta7WwpbpCIO/0JqsdaBWpBNbHqyF0z8crVX//Fn1mQCY6C8RNibFqYKw8bBfMQASEfkLX7frfgaKATDgbtPCgg5s8YJAN0VroRb2/VukdZqW+ySXf9Y6VgsBMJqkAiBOCxSUVcA4nRQDIBFR9sPrdr9+/RgAGQApCUkFwCDAeS5xns+NGzc6R4iIKNthCtKKFSukZcuWzpHcwgDIAJisnA+AgBCI+RREROQPmLeeq+EPGAAZAJPFAEhEROQzDIC5cy5gIiIiInIwAGYJLAghIiIiygQGwCywePFiOeSQQ6S6GmepIyIiIkovBsAsMHToUNm8ebO8/757JxoiIiKi9GAAzAItWrSQ8847j+cGJiIiooxgAMwSODfw008/LXv2RDo5CREREVFqMABmiRNOOEGGDBkiU6dOdY4QERERpQcDYJZo3ry5PProo/L444/Lm2++6RwlIiIiSj0GwCwyYMAAmTVrlukGEhEREaVLrgTAaVrrtMq03tEaoRXNZVrztXZp4SS3d2llBLaDwaIQIiIionTJhQB4gxYC3QStrlofaBVrtdbycp3WLVpXauH8boO0/qlFREREFAi5EACv0vqD1iKtvVoId/la52iFa6d1m9aPtRAUa7TKtT7TStgby9+QLbu3OLeIiIiImlbQAyA6eAO1ZptbITjdBgLdKHOrvuO00BkcrvWVFoZ/X9E6TCthf5n9F+n7x75y/lPnS/HSYqmu4Rk/iIiIqOnkQgCEnc6ltUPLfswNQ8TNtM7WKtIaoPW51qta6A4m5JkLn5GFP1ooQzsPlcueu0wG/3mwTHtnmqwpWePcI7JFixbJzTffzHMFExERUcog7AQZQh7C3xitj3HAgTmAC7SuN7fqfEPrOa3TtF7DAYWQjMUj52rh89zw75dMmTJFCgoKzIGJEyeaimRfzT55+euX5e+f/l1eXfqqnDL4FLl89OXyjWHfkPzmGJmub8OGDXLYYYfJ9OnT5eKLL3aOEhERUTyKi4tNQWVlpcyYMQNXO2iV4kquCXoAhOVa07XuMbdEmmtt0LpW61EccOmrtVrLHQBxfzw5IgZAJe3bezUUo1tXuk7++dk/5YF5D8juqt3y3ZHflRuOu0G6tO7i3CPkpZdekv/5n/+RefPmyQEHHOAcJSIiokSUlpZKhw7IfrkbAHNhEchftNDpw9YvrbR+rYXFIM9qhVurheM3a3XXKtT6ldZ2rfe1UqpP+z7ys6KfydJrlspj5z4m8zfNlyF3D5E/fvhHqayudO4lcsYZZ8hll10m3/nOd6Sqqso5SkRERJSYXAiAd2phG5c3tLAUF8PB6PDhpLv9tDC8O1bLulRrqdaXWgiEI7Uwpos9AdMir1menDz4ZHn5opfliW89If/47B8y4i8j5NnFz+6f+/f73/9eKioq5NZbbzW3iYiIiBKVC0PA6ZTUEHAkmCf4j3n/kFvevkWGdx0u00+dLkf0PsIsCBk3bpx88cUX0rt3b+feREREFA8OAedGB9B3WuS1kB8e8UP5+sdfy9h+Y+X4B4+Xy/57mXTo20FWrFjB8EdERERJYQDMYu0L28sdJ98hi6cslr3Ve2XYPcPkj/P+KLsrdzv3ICIiIoofA6APDOg4QP593r/ljYvfkOJlxWZ+4MxVM52PEhEREcWHAdBHxvQbI+9/732ZOmaqTHp0ktz0xk31VgsTERERxYKLQJKTlkUgsVi4eaFMfnayPoDN5OI2F8uA1gPk3HOxVSERERFFw0Ug7AD61ojuI+Sj738kEwZPkJtW3CTfnv5tefTR8H2tiYiIiBpiAPSxwhaF8rsJv5Pii4ul0xmd5NLXLpX/d///cz5KRERE5I0BMABOGHiCLLl2iZx47Ilyw/Ib5Af/7wfOR4iIiIgaYgAMiI4tO8rrV70u046ZJg9sfUDG/GaMlO3FSU6IiIiI6mMADJhbzrlFXvrGS1LTvkYOvfdQeXP5m85HiIiIiEJyJQBO01qnhZbYO1ojtCLBx/dqYVUQ7o/LK7V8Y9Jxk+TDH30oPx37U/nmE9+UK1+8kt1AIiIi2i8XAuANWpdpTdDqqvWBVrFWay0vtVq/1cK+Lu2cy/u0fCWvWZ786Kgfyfwr58tX276SQ+49RN5Y/obzUSIiIspluRAAr9L6g9YiLXT2btHK1zpHK5LA7I84qNMgeeOSN+TGsTfKOU+cI8OmDpNX337V+SgRERHloqAHQHTvBmrNNrdCqrU+0xplbnlDaNymhdD4G602Wr6FbuBVR10lc78/V6o7VsvpL54ux192vCxbtsy5BxEREeWSXAiAsNO5tHZoRTp1x01aQ7W6aF2oNVHr71q+N6z7MFl6y1L57Rm/lY8HfCwHXn+gTJk6RZYvX+7cg4iIiHJB0E8Fh5CH8DdG62MccGAO4AKt682t6Iq0MHkO8wExhOyGf79kypQpUlBQYA5MnDjRVLZbuXOlfPuxb8v8dfOl+tlq2TBrg3Tu3Nn5KBERUbAUFxebgsrKSpkxYwau5uyp4HLhXMBob03XusfcEmmutUHrWq1Yzp1mAyDCXgUOuJgA2BTnAk6F2tpa+evcv8oNr90glxx+iTmrSNuCts5HiYiIgonnAs6NRSB/0UKnD1u/tNL6tRY6ec9qheuuhfadXSGMz8G51Z7TCg9/vtesWTO58sgr5fOrPpcFmxfIyPtGyqzVs5yPhvztb3+Thx9+GCnXOUJERER+lwsB8E6tf2qhi7dFC8PBp2nt0eqnhQ3yxmpBS61famHPQPxFgJCIz8M2MoE1uNNgeeeyd2TKUVNk4r8myvWvXS8V+0J5F13CP/7xj9KzZ0+5+OKL5Z133jHHiIiIyL9yYQg4nXw9BOxl8ZbFcul/L5Vdlbvk4XMeliN7H2mOL1y4UB544AHTDezUqZP8/Oc/l0svvdR8jIiIyE84BMwAmKzABUDYV7NPfjfrd3L7e7fLDcfdID8r+pkUNA8tctm7d68899xzUlhYKGeffbY5RkRE5CcMgAyAyQpkALQ+2/iZ6QY2b9ZcHvrmQ3Joj0Odj0Rmh4cxv5CIiCgbMQDmxhxAStDIniPlk8s/kUlDJslRfzvKhMElW5c4H/U2b9486d+/v1x++eXy9NNPy44d2HKRiIiIsgkDIEVV2KJQbj/5dln4o4WSn5cvh993uHznP9+RRVtwkpSGDj74YPnHP/4hHTt2lNtuu026desmxx13nEybNk3WrcPaGiIiImpqDIAUkwM6HyB/P+vv8uXVX0r7wvYy+q+j5YKnLpD5m+Y79whp2bKlTJgwQe6880754osvZOXKlaYbiEUkaLkTERFR0+NEreQEeg5gNGtK1sjv3v+dPDDvATltyGlyS9EtMrrXaOej8ZkzZ4784he/kMMPP1wOO+wwU8OGDZP8/HznHkRERKnDOYDsAFKC+nXoJ/ecfo8su2aZDOwwUMb9Y5x849/fkDnr5zj3iF2vXr3k9NNPl23btsmf/vQnOfroo6Vt27ZyxBFHyEcffeTci4iIiFKFHcDk5GwHMNzGXRvlzg/ulHvn3GsWjfz6pF/L8K7DnY/Gp6amRpYvXy6zZ8+W8ePHm4BIRESUKuwAMgAmiwEwzPqy9fKrd38lD372oFx06EVy6/hbpX+H/s5HU+err74y8wpPPfVUadOmjXOUiIiocQyAHAKmFOvdrrfce+a98sWPvpDyfeUy/J7hMrV4qmzZjbPwpc6yZcvkpz/9qVllfNppp8n1119vVh9/+OGHZrNqIiIiiixXAuA0LexBgvP+vqM1Qqsx7bRWalVrMSjHaUjnIfLYeY/JB9//QJZsWyIH/PkAmfbONCnbi4cgeZMmTTJdQCwgOeOMM6S8vFz+9a9/ybnnniubN2927lUfz2FMREQUkgtDwDdoXa01SWuZ1q1al2gN09qjFckDWr21TtXCctQarXAcAo7Re6vek5vevMmEwZ8d/zO54ogrpFV+K+ejmfHCCy/IVVddJaNHj95fo0aNkr59+/LMJUREOYRDwLkRAJdrTde6x9wSaa61Xmuq1qM44OEbWj/XuknrdS0GwBRAB+7lr1+Wn731M1lbulYuH325/OioH6VljqCX3bt3y9y5c+XTTz81ZyzB5aJFi6Rz584mHB577LHOPYmIKMgYAIMfAJHKdmqN0foYBxzFWgu0rje36uuiNVcLHcPuWm9pMQCmEILgOyvfkbs/uVte+volOXPYmfLjo38sJww4IeOduD179siCBQtk+PDh9sWgHpy95Oc//7kccMABMmTIEFO43qlTJ+ceRETkNwyAwZ/bZlMZQqAbTlAbKbH9ReuvWovNLUo5hLwTB50oz1z4jHx19VcytPNQOe/J88xp5u6fe7/srtzt3DP9WrduLcccc4xn+IO8vDxzbuMvv/xS7rrrLjP3EB3DLl26yEMPPeTci4iIyF/YAazv21rXaR2jhY7feK03tQq0sBgkHDuAKVJeVS6PLXjMdAVXlayS74/6vkw5aooM6jTIuUf2wOO9dOlS6d69u/Tr1885WgcdTixMwcfQWbRnOOnatatzDyIiakrsAObuHMANWtdqhc8BfFDrW1oV5lZo6BfJbqsWguEjWm4mAE6ZMkUKCpARRSZOnGiKEoPwNGv1LBMEn1vynHxj2DfkujHXyZh+yPD+UF1dbbqDX3/9tZlj+Pnnn8uqVaukd+/ecvXVV8tNN2FqKRERZVJxcbEpqKyslBkzZuAqA2CAocuHVcBnaCEM/kJrstaBWuGrgPFEcO8qfJzWE1oDtLZplWu5sQOYRqtLVsufP/6zGRY+tMehJgiefeDZ0jwPGd5f8ByZP3++GXLGKe68TJs2TcrKysz8Qgwz28uePXuaDiIREaUGO4C5EQDhNq0rtLC3H05WO0VroRbG7xZpnab1vla4E7S4CKSJlVSUyN8//bvc9fFdUti8UK499lq5bORl0qYgWGcA+fOf/2w2uN6xY4ds377dXKLQOXzjjTece9X3zjvvmE4jhpsxVxGX7drhaU5ERJEwAOZOAEwXBsAMqqqukqcWPWXOOYx5glcdeZVcffTV0rNtT+ceuQdDzY8++qisXr1a1qxZY1Y140WtT58+MnPmTLNYJVxVVZW5zM/H3zVERLmHAZABMFkMgE3AbiNz54d3ylsr3pILRlwg3znkO3LSoJMkv3nuhhr8XNAxRBBcv369TJgwQVq0aOF8tM6LL74oZ511lgwYMECOPPJIOeqoo8wlhqadF0QiokBjAGQATBYDYBNbtGWR/G3u30xnsGJfhZx70LkmEI4fOF5a5DUMPySyb98+2bhxo9naBqfSmz17trlEFxFDzSeffLJzzzr4nE2bNpm5jHjhdBdWOUea10hElI0YABkAk8UAmCVqamvkgzUfyJMLnzRhsLqmWs476Dy58JAL5fj+x/ty4UimIeDhedyqVcNT9GGzbCxEadu2rbmPu77//e/Lt7+NHZQaOvroo6WiosIsZOnVq5cpzFM86KCD5KSTTnLuRUSUWQyADIDJYgDMQgh/2ErmiYVPyNOLnjbh71sHfct0Bsf2Hyt5zYK+/3nq1dTUmCHm5s3jC9I45R7OprJhwwbTdcTQNIaocf7l++67z7lXfS+99JLZPgfD1+E1efJkzl0koqQxADIAJosBMMvtq9kn765814TBZxY/IwXNC0xn8PwR58vYfmPZGcxCf/3rX83qZgw7hxfO2dyyZUvnnnVeffVVueaaa8y8RtTAgQP3X8cQNec2EpEbAyADYLIYAH0EYRCLR55a+JQ88+UzZo6gCYMHny/j+o9jGPQxbJszd+5cWblypdl02xZuI1DiFH7hsBr62muvNWdosdWjRw9TWEXN0EgUXAyADIDJYgD0KdsZxJxBGwbPHX6u6QxyzmBuwJY5t912m2zdutXU5s2b9xeGmiMNUf/tb38zwdIOi+MShfmR+PeIKPsxADIAJosBMABsGMTiEQwTY0HJmcPOlLMOPEtOPeBUaVvQ1rkn5QoMN2POoZc//OEPZsPuvLw8U82aNTOXeDP55S9/6dyrvrvvvlsefvhhc25oLICxhc27MaSNzw+HOZMY8t61a5e5jQ2+bR1yyCHmc4koMQyADIDJYgAMGCwg+WjtR/L8kufl+a+el+U7lsvJg042YRDnJe7Tvo9zT6LYYYudjz76SBYvXmy238HlkiVLzAppuygm3MKFC+W6664znUXAaQJt3XDDDXLJJZeY4+GwIhuvR0OGDJEDDjhgf/EMMUR1GAAZAJPFABhwX237Sl5Y8oI8t+Q5s83MyJ4jTRhEHd7jcNP9IUpEdXW1mbuI8z3Hu7o6mgcffNCcHnDp0qWmU4nCaxSC4b///W/nXvWhQ/nJJ584t0Jw3moEx6lTp0bshhL5FQNg7gTAaVqXayGlzdWy5wL28pwWdrXFn8sYe3lV6wat7VrhGABzyNY9W+Xlr1823cFXl74qXVt3lW8O/6YpLCLhxtOUjTBPEUFz9+7dEYeNn3nmGdOZdMPQM7bw+ec//+n5hw66mOhSduvWzQxjuwv7PhYWFjr3JMo+DIC5EQAR3q7WwjLAZVq3amHsZJjWHq1wh2p9pbVXC08MzATHxmPf0grHAJijcNYRnIbuv1/+13QHMY8QQ8QIg5g32Dq/tXNPomB69tln5fbbbzfhEkPZ7nrvvfdk7Nixzj3rYF7jqFGjzF6OBQUF9S4vuugisyrby3/+8x/zho3XWVSbNm3M5+EScymJ4sUAmBsBcLnWdK17zC0RjLWs15qq9SgORNFJC5+HUHgYDoRhACQzb/DjdR+bMPjsl8/K2tK1JgR+88BvmsUk3dp0c+5JFHzoOIJX17CyslI+++wzc4lteNyXgwcPlpEjRzr3rO/66683n4c3bRS6mfgcbNkzf/5851713XnnnTJt2jTp2LGjdOrUyZS9fuutt8qgQYOce9bZu3evGTrHvEu74CaWjcfx30EHFQEXwXTYsGFmwQ++H68gTE2PATD4ARCpbKfWGK2PccBRrLVA63pzq6E7tNA1xOxrdAnRMXxGKxwDINWDN7/FWxfvD4OfbvhUjux9pJx2wGkyaegkOar3UdxihigD8LqMIewdO3aY2rlz5/7rP/jBD8xpCcMh/I0ePdoMf9sgi0CHIHjTTTeZRTleEDYxpxND3+iAYoEPCsPjGEL3grPd4GtCFxOB015i7qXXqnBKLQbA4AdALK1brYUxgiU44HhcCw/4D82tyAZrXab1tJbXn5kMgBTVxl0bzXzBV5a+Iq8te02aN2tuuoOThkySiUMmSvc23Z17ElG2wL6O5eXl+1ddIxCic4gzzKQKFtc89dRT5t9GRxOdUAvdTa/O45w5c8z+lLY7ifcd26UcP3686aKGw5ZGxx13nPk+8D24tyFChxKbnuciBkB2ACN1AN2O0npeC2GyGgdcGAApZpgn+Mm6T+SVr18xgXDexnkyutdoEwYnDJ4gR/c5WgpbcOI8US5C6EMQRHltCwToGj7xxBMmzCHA2ICK8HjLLbdIUVGRc8/6MIcSHcZt27aZxTu2JkyYIH/605+ce9X31ltvmfmdCJDobtpL/DsXXnihc6/68LWjc4r7ZPsOCQyAuTsHcIMWZhs3NgcQMIFjphYmcoWvBDYBcMqUKWaYACZOnGiKqDGbdm2S4mXFJgy+veJtKdlbIsf1O07GDxgv4weOZyAkoiaDs+FgSBxbFGEbIFyiEE6x1ZCXX//61yaI4n6Yb4lCGMTnP/744zJ06FDnnnXWrl0reA/F6nHcF4VhcFyeeOKJcvzxxzv3rA+fh84nOqCtWrWKKXAWFxebAgTuGTNm4CoDYIChy4f5fGdoIQz+Qmuy1oFa4auA8ew8ROsNrTIt3OcfWpiQgS5iOHYAKSXwV/OSbUvMuYptle4tDQVCDYMozB9kICSibIUuITpreE/E/EYUuoLoHGKI2um41YMu42OPPWbmTtoOKAqnajzzzDPlvPPOc+5ZH86Gg22IAOHPLtzBsPZLL71kjkfDDmBuBEDACTqv0MLefnO07D6A/bQWaZ2m9b4WtoZ5QGuEFjZ126qFfQDx+Zu1wjEAUlpECoRj+4+VkwaeJCcNOkmO6H0E9x4kopyFVduYQ2nnaeISC2iOOeYY5x6RMQDmTgBMFwZAyggEwi+3filvr3zb7D+Iy6rqKikaUGTCIOqwHodJXjOuHiQiagwDIANgshgAqUnU1NbI/E3zTRhEzVw1U/Kb54eGiweMN0PHCIQ4RkRE9TEAMgAmiwGQsgJWGM9dP9eEwXdWvSMfr/1Y9lbvNXsQHtvnWDm277Eypt8Y6d2ut/MZRES5iwGQATBZDICUldAhXLJ1iXy09qNQrftIvtj8hfRp18eEQRRWGY/sOVLaFmC/cyKi3MEAyACYLAZA8o2yvWUyZ/0cEwg/XPuhzF4/22xFM7zrcLOg5IheoRrVaxRDIREFGgMgA2CyGADJ19aXrTdDx3M3OKXXcfaSA7seuD8QYhiZoZCIgoQBkAEwWQyAFDgbyjbsD4M2GOIYOoUIg7YwfNw6v7XzWURE/sEAyACYLAZAygnuTiGGkVFb9myRg7sdbMIgOoWHdj9URnQfIV1bd3U+i4goOzEAMgAmiwGQchL2JUQotGHw042fmkUmq0tWS482PeSQ7ofIiG4jQpcaCnG9Q0vzYktE1OQYABkAk8UASOSCs5Us2rLIhMGFmxfKF1u+MNcxr7Bv+74mCKIO6naQ6R6iOrbs6Hw2EVFmMAAyACaLAZAoBtv2bJOFWxaaULh462ITElEbdm2QXm177Q+DtoZ1GWY6ibGc4J2IKF4MgAyAyWIAJErCjvId9QKhrTWla8wCk8GdBps6oNMB9a4P7DhQClsUOv8KEVF8GABzJwBO07pcCyltrtYUrYVa4bpp/UGrSAsz2bdqPa51m1alVjgGQKI0KK8qlxU7V8jyHctl2fZlocsdoUtUZXWl9GnfxwTBAR0GhKpj/ctW+a2cf42IqD4GwNwIgDdoXa01SWuZ1q1al2gN09qj5TZI60KtJ7RWaA3WelbrTa2pWuEYAIkyDGc5wbY0CISrdq6SVSVa9lILC1Eq9lVI9zbd6wfDsJDIuYdEuYsBMDcC4HKt6Vr3mFsizbXWayHQPYoDjfhfrcu0Rplb9TEAEmUZrFDevHtz/WDoCoi4XrJXf2cL23sGxP4d+pvq2ban5DXLc/5VIgoSBsDgB0Cksp1aY7Q+xgFHsdYCrevNrehe0tqo9X1zqz4GQCIfKqko8QyI6B7iEquW8/PypV+HfiYMIhzaS6xm7t2ut6nOrTpzoQqRDzEABj8A9tVarXWQ1hIccGBeHx7wH5pbkd2idaXWUVroGoZjACQKoL379sra0rV1oVADog2H68rWmT0QseVNQfOC/WHQVNu665ij2KddHxMY2xS0cf5lIsoGDIDsAEbrAP5KC3MFT9ZaigMeTACcMmWKFBQUmAMTJ040RUTBtqtyl5mLiDBYr3atl3WloZCIELm3eq90KOxggiDKhkIExH7t+5mVzRh6btmipfMvE1E6FBcXm4LKykqZMWMGrjIABpjXHMANWtdqRZoDiGfFBC2EvzU4EAE7gEQUEeYjbi/fboIgOofmUsOhvY2uIlY7o+OIQDio46D92924i3siEqUWO4C5EQDR5cMq4DO0EAZ/oTVZ60Ct8FXACIcPax2mdYrWJq1oGACJKClY1bxp16b9W9yY2ll3HZ3EFnktzDmWUd1ad2twvVub0CUWrmBjbc5NJIqOATA3AiBgH78rtNppzdGy+wD201qkdZrW+1rY/+9trb1a+7QAP6NaLa+ExwBIRGmFPRFxxpQtu7fI1j1bZcse59K5vbU8dB3HsXgFQ9OYm4gwiLmICIQoc71d6HqPtj3MNjkIkNxQm3IRA2DuBMB0YQAkoqxi5yYiNNo5iua6cxuX2CYHp+er1f9hfiLCoLsw5IxLGxhxiUDJeYoUFAyADIDJYgAkIl/aV7PPhECEQdSm3Zv2X0ehm4hCYMQQdXVttdk82wZC21l0h0R72a6gHYegKasxADIAJosBkIgCr7qm2gw3u7uIJhzaTqOW6TTqbax6xnmc3aEQw8/oKmLoGZfoJtphaAxXE2UaAyADYLIYAImIHFj1vLNiZ72gaC/RYURoRDcR1+0QdKeWnfYHQxMKW9cfjsYCF3sdw9XsLFIqMAAyACaLAZCIKAEYgsbiFYRBGwoREHFs857NoUvXkDQ6izg7i13xjOrSqkuoWntfYsi6Q8sO7DJSAwyADIDJYgAkIkozdBbLKsv2h0KseEYHcVu5lr10X3cuK6srzedj8Qq6hwiD9S61bEg0lxFu47zRzfOwSxgFBQMgA2CyGACJiLIQQmPFvgop2Vtizv0c6RJD1ua6lrnufMxex+IXwMIW7K/YqVWn0GXLsEvnuA2MNmjieqsWrTh0nWUYABkAk8UASEQUUAiRu6t2myC4o2KH7CjX0kuc3QXXzaVz25Y7YCKAAjbyDg+FKIRKlLleGLqOS/sxXCJQ2sLiGgbJ1GAAZABMFgMgERF5whB06d5SUwiF5tIJiBjSxu2yvWXmeoPbeum+L2AOpDsQotB5RLBsW9B2f7XJb1Pvti0bLlG5Pi+SAZABMFkMgERElFZYMINwiK4jhqZtoftoh6rRqcQm4JHKhko7pF3YvHB/GHQXQiKGrPFxnCUm2mWr/FZmfiXuH+k6LvOb50teszzz380WDIAMgMliACQiIl+w8yIRJqMV7oNV13v3aell+G1c4pit8n3l5pSF7uvY4scNw+DoOqIQHu11W+hQIoCaIfIC5xK3C51LvY1hcQRKr0Bq/11cx3+rMQyAuRMAp2ldroWUNlfLngvYy6+0ztAaofWxFs4PHAkDIBERkQuCZlVN1f5QiOsIjRgSDy8bKNHBRPi0Q+Xm+t66YXN7DP+e/bfs54aHzUO6HyILrlrg3PLGAJgbAfAGrau1Jmkt07pV6xKtYVp7tMJdqrVV6zStw7UYAImIiLIQwiaGyN0dShzr076Pcw9vDIAi2TUonx5Xaf1Ba5HWXq1btPK1ztHy8pDWS1oIgURERJSlsCoacwwxhIwNwHHawcbCH4UEPQCiLTdQa7a5FYIZsJ9pjTK3iIiIiHJMLgRA2OlcWju0OGZLREREOSnocwAR8hD+xmhhQYdVrIUZotebW94wV/BkrUbnAE6ZMkUKCkJ7Kk2cONEUERERZY/i4mJTUFlZKTNmzMBVLgIJsOVa07XuMbdEcELHDVrXaj2KAxHEHAC5CISIiMg/uAgkNxaB/EULnT5s69JK69daWAzyrJYXbCDUUgsLRRCQC50iIiIiCoRcCIB3av1T6w2tLVoYDsYWL9gCpp8WzrEzVsv6mxY+dpPWcVrlzm0iIiKiQMiVjaDThUPAREREPsMh4NzoABIRERGRCwMgERERUY5hACQiIiLKMQyARERERDmGAZCIiIgoxzAAEhEREeUYBkAiIiKiHMMASERERJRjGACJiIiIcgwDIBEREVGOyZUAOE1rnRbO+/uO1gitSDpqPaq1U2u71iNa5nwxREREREGQCwHwBq3LtCZoddX6QKtYq7WWF4S/blqDtIZo9dR6SIuIiIgoEHIhAF6l9QetRVp7tW7Rytc6Rytcf61JWlO1dmihA3id1llafbUoCxUXI89TU+Pj0PT4GDQ9PgZNj49BbIIeANtrDdSabW6FVGt9pjXK3KpvpFaF1hfmVsh8rUotfIyyEH/ZswMfh6bHx6Dp8TFoenwMYpMLARAwn88N3T37MTccKwldrQef73V/IiIiIt9p5lwGFUIbwtsYrY9xwIE/DxZoXW9u1cFQ7+Na4fMD0RX8ltaL5lYdExjXrFkj7dszHzaVm2++We644w7nFjUVPg5Nj49B0+Nj0PRieQxKS0ulX79+uIpFnqW4kmuCHgBhudZ0rXvMLZHmWhu0rtXCgg83zAFcoXW4lh0GxvVPtQZorcUBlz5a4ceIiIjIHzC/H7uE5JxcCIDo8l2tdYYWwuAvtCZrHai1RyvcC1pYJHKRFn4+/9bapeW1aAQf762F7WWIiIjIP9pprdeqNbcokG7TQtcPQc69DyD6vwhvY82tEOwD+C8tDB1jruDDWhzfJSIiIiIiIiIiIiIiIiIKvHhOMUfJuVBrpha26cFejuFbGB2m9a4WhvmxMOdWLUqt32hhX0w8BnjeP6YVvkE6H4f0whzmpVqYorJZ6xUtLFRz42OQWc9q1WidZG6F8DFIP/xM92lhBS/eg3HpXtjJx4DSBqeYW6V1sFahFtac40kW6RRzlBycyg8h8Lta4QGwrRYm8v5aq0DrEK01Wv+rRalzuxY2UG+hhXmxeLGdp2XxcUi/oVr23OR4HHDWoo1adkEfH4PMukTrVS28JtkAyMcgMxDo0BTwwseA0gorirG62ML2Mpu0sHqY0ucErfAAeKkW3gTdx67R+jp0ldIEnSc8FjaQ8HHILPzh+RMtPAZdcEDxMcgcdL9XOpfuDiAfg8yIFgD5GMTA/cOh2KH7Ec8p5ii9EETQicKLsIXHZrAW/hKk9JiohS64PXsOH4fMOF0LOxSUa92phX1Ot2kBH4PMeUDrV1oY+XHjY5A5eL9F4wX792JEAu/LwMcgBgyAibHbwsR6ijlKL/zMvR4L4OORHqdo3aJ1hbkVwschM17W6qTVWes6rY+0LD4GmfEj5xIhMBwfg8x4SgtTsHpoHaeFvfxe18I0LD4GMWAATIw9bQz2DHTDi3JOnlKmieFn7vVYAB+P1DtTCy++mO6AF1yLj0Nm4Q3uz1oIIYfigOJjkH7oIv1c63JzqyE+BpmxSAvz+gD7/H5PC8PxCIN8DGLAAJgYPIEw9+MocysEcwDRjkbbmTLLDr27n89Ha2GeJlaAUeog9D2idb7W8zjgwsch8/C6gzMXYXEI8DFIv+O10H2dq7XFKfiP1n1aeAxGa/ExaBpYEMXfA0ornGIOIRBbv7TSwhYZ+GuEq4DTA7/ImPR+qhbmW+LnjNv4ZcecDmxLgvk4LbXQDVmtxRVfqYVFT9u13GfOcePjkH6YyN49dFW6ad2vhccEw2DAxyD98HPFKUDdhblm+KMIXSc+BpmBn7dd/ITnP87ahYDXRouPAaVdpFPMUephVRdeZBH+UPZ6kRZgmT9WhO3WwvJ/zE+j1MLPfK8WOuAou/eWOxDycUgvnKscrzn42eMN7r9a6Da58THIPLwWufcB5GOQfs9pYQEI3n/RfMEiEAzPW3wMiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIiIyLpQa6ZWiVa1Vp5WNB21HtXaqbVd6xGtDlrkA409uERERJQbEOJmaP3E3Gocwl83rUFaQ7R6aj2kRUREREQ+c4JWYx3A/lo1WoeYWyGHaeFYX3OLsho7gERERBSvkVoVWl+YWyHztSq18DHKcs2cS0oMfn69tcrMLSIioujaaa3XqjW30qOlVkHoqieENIS3SNABfEsrXwsdPS+Ttf6g1cvcqrNRa6rWY+YWZS0GwOT00VobukpERBQTDJGuC11NuZZd27cv31pa6tz0hLl+eP+KFAJjCYBnaT2u1drcqoN/81taL5pblLUYAJPTXqtkzZo10r49rqbGzTffLHfccYdzK7j4fQYPH9Ng4feZWqUayvr164erWCkbNaElwbwvvfbb30qblmgE1re7okJOvfFGXI32NcQSADEHcIXW4Vp2GBjXP9UaoMXmSJZjAEyO+UVTKQ2AU6dOlenTpzu3govfZ/DwMQ0Wfp+phQDYoYPZJSXtAfD9u+6Stq1ahY647Covl7E/MYt8vb4GrAtA6EMAfEULw9VYDIIhY68h6xe0cP+LtJAn/q21S+scLcpyXARCREREcLFWuRbCHyDM7dE6XgutS8x3H6tl4f5btZZpfa21QetSLfIBBsAsNHHiROdasPH7DB4+psHC79O/tn7wgWyZObNB4XgU2MMPuaC5U/Y6Nodeo4WO4PtaFjaAxmIQbAjdSesSrXR1NinFOAScnLQMARMRUfBkcgh43l13STuPIeCy8nIZFXkImHIIO4BEREREOYYBkIiIiCjHcAg4OSkbAp48ObQdU1FR/WX7Mz8OXRZhCq7LzM/02HHODTVzceiy6MjQ5UxMyVVFh4YuZzoL8osODF3O3KTXcfZGXMcsDlXUR69j+i+ud9Xr+0Kr/4v0W/ukOeYBixzfspnMk1IZ06xAvjBzf0WOkjayxOz9iT0AOspyWS0HSzdZK0vNsWHSRz/6pQyQgbLdbBSPDaiG6b+C3QJEuuu9K+Qj6aSfvU9mmWNt5UjJq3zHXC+UMSK7MAVF/2JpXiSyLXRdWun19c71Dnp9tXO9u16Hr53bvZ3bi/T2IOc6fOZ8fJjr2Cd67FDXbZjl3G9U/eO733aOjwm7v2P7zNDHC4u8P+623rlvuxjuG81K59/pluS/Q0T1HfbDHzrXEschYMomDIDJSVkAvP/+XTJzZgtzPZYQiABo2SCYSAgEBMFEQiC0axa69AqB0F5KzKUNgdDO+VyvEAjtnBOrpC0Egg2C4SEQAdByB0GGQKKc5rcA+N4FF0jbfOzQUt+uqio5/skncZUBMMcxACYnpQEQGguB4BUEw0MgeAVBGwIBQTAVIdDdDWzvhDevEAj24+5uYDuz00D9EOjuBravDH0cCndVmcuIIRDCg2C8IRBsEIwnBIJHELQhEBoLgjYEQjJB0IZAYBAkSp7fAuDSKB3AIewAkmIATE7KAyDYEAjxdAMTHRJ2h0CIJwi2bRkKdJGGhG23zz0kbEMgeHUD2zvH0jokHB4CIVI3kEPCRDmPAZCChgEwOWkJgFY8Q8IQqRsYHgLB3Q1Mx5AwROsGeg0Jg1c30A4Jg+0Gxh0CIZPdQIZAokBhAKSgYQBMTsoC4OTJGzToYY/N+iKFQEh3N9ArBBodQyEQWnaKbUgYonUDvYaEodFuoDMkDHnO12vscC4hw0PCkKogmKohYWAQJEqc3wLgwgsukHYecwDLqqpkBOcAkmIAbOgXWtjNvKsWzn84Vwtnzv5cK1xKAyB4hUBIZIFIsiEQ4u0G2iFh8Fog4u72xbpAxIZASNsCERsCobEFIhwSJso5fguA6++6S9p7dABLy8ulNzuApBgAGxqqtVkL6QSp6xqtn2r10go/GXbKAuD99+M/qaFqJs67raEqjm5gvAtEbAgErwUiqRwS9uoGpmOBSMwhELJwgQhDIFF2YwCkoGEAjK5Q6yqt/6fVXWubllvKAyDEEgIh0wtEbAiESEHQDglDky8QcQ8JR+sG2hAIXgtE4g2BwG4gUaAwAFLQ8Ewg3k7XwiwyRJw7taZrhYe/tCkqwrm3NVTNLDPlVlS0zxTMnBnaPNoqOiZ0OfO90CUUjQxdzvwgVFB0UOhy5pzQZdEBocuZC0KXRX1DlzOX6PUeoZq5Qg/oT6QIp/zGx9bpdee1ZaZmu6IWoadSxY7WcnR1a3N9V0U7GaWvRR/WVkpZbSggz5bdcqD0NNfL9GODpb8ski36KmReFPWynX50uLmOj8M6+UqvjTbXS/VaSzlWv5TP9eOhgLxL5khNwXhzfa98qIkwFGhq8LV2ccJNuYYd2+Ur0ev9neub9fpQvY4ChMSD9TpqhV5HjdTrqK/0OgqOdu6/QG+jYJweQ8E855ijzYnO8Q/rH7c6OyFsrxPKount3LcshvtGM9D5d3CCeCIiyi3sAEaHCHGpFnpi/8GBMGnpALplYkgYvLqBthMIsSwQyaYhYeCegbGxnUBgN5DIm+86gN+5QNoXNFwEUlpZJb0f4yIQYgCMBX5G6AYiSjk9sv3ML9qUKVOkoKDAHJg4caKpeEUKgBAtBEJTLBBBCIREFog02ZAw9wyMikPCRJElGgCLi4tNQWVlpcyYMQNX0x4AS+6LPATc4UoOARMDYCyQrtCWuljrGRxwCf2ipaADOHnyQg1w3Zxb3pLpBrpDIDS2QMSGQEjXAhHuGegcZwgkynp+6wAyAFJjGAAbwqrfx7XQkkMiu13rW1qYOefEnv1SGgChKAUhEJpqgYg7BBrcMzAkQgiEVAXBVA0JA4MgUX0MgBQ0DIANvaCF+NNWC78cs7V+qRUac6wvZQHw/vuXaYCrW9RRlKFuYKpCIMTbDeSegXXYDSTKbr4LgFddIO0LPeYA7q2SDvdyDiAxACYrpQHQskGwKA3dwHgXiNgQCF4LRFI5JOzVDeSegXWaMgQCgyDlMt8FwIfvkvatPTqAe8qlwyXsABIDYLLSEgAh1m6gDYGQLd1AdwiESEEw0HsGQrRuoA2BwG4gUdZjAKSg4T6AWQqBzYa2mTO3mEsv2DPQvW9gOO4Z2ER7BgL3DCQioizFDmBy0tYBdEvFkDAk0w20nUDw6gbaTiDEskAkm4aEgXsGxoZDwpSr2AGkoGEATE5GAqCVyrmBmR4ShnQsEElkSBjSvkDEhkDgAhEi3/NdALwxyiKQ33IRCDEAJiujARCycYGIDYGQrgUi3DPQOc4QSNQkfBcAn4rSATyfHUBiAExWxgOg5eduoHuBiHR2LoF7BoZECIGQqiCYqiFhYBCkXMAASEHDRSA+FcsCEYh1gYgNlJCuBSLmetgCEU1n+xeIyM68BgtE3quoNQtEwL1ABAtA3AtEwGuByCpZuf/jZRrx3AtEIOICkbb53gtEOmk1tkAEnUK7QATCF4hgcYjXAhHLLhDB4pA0LRDB4hAuEKlv886d8vGXX8r7CxfKl2vWSFV13Qp7IqKgYQcwOaG/tJqgA2jVC25NtF1MrAtEUjkk7NUN5J6BdRJZIJKqTiD4qRtYUVkpr374oaxYtky61Naacz/iadmsXTuZdMIJMrCH89cL5TTfdQB/c4G0b+kxB7CiSjrcxDmAxACYrCYPgFYm5gZmYkjYF3sGxrpAxIZA8FogYkMgRFsgYkMgcG5gStVq4HvmnXdkp4a/I7t2lYLmoY45jq8pK5Mva2rk22eeKT06ofVLucx3AfDFu6R9G48h4N3l0uFMDgETh4ADI5Eh4fBhYQwJe+0biCFhFIaE7bAwhoRROblnYLUGHO4ZGJGfhoTXb9sma1askKO7ddsf/qBZs2bSX/+o67Vvn8z9MrSoiIgoSNgBTE7KOoCTJ7+r4ctJSElKZTcwHQtEbCcQInUD3Z1Aw1kgkuiQcKwLRLhnYF0nEJLpBvphSPjdzz+XdXPnyigNgF7KKivl/T175JqLLpLmefx7OZexA0hBwwCYnJQGQMimEAheQdCGQLBB0IZAaGy7mMaGhCGeuYHcM7AOh4Tj88bs2VKycKEc3KWLc6S+yupqeX3HDvnx5MlSmN9wPhXlDgZAChoGwOSkLADef/98DVuhPUZSFQKhqbuBkUIgpGuBCPcMdI4zBDZq7ldfybz33pOx3bs7R+rbsGuXLC0okB+ce64ZFqbc5bsAOOMCad/KYxFIeZV0mMJFIMQAmKyUBkAr1UEwKAtEuGegcyyGEAjZFgSzMQTuqaiQ+596So4oLJSurep3S2pqa2XW5s0yatw4OXp4aP4o5S7fBcA3o3QAT2YHkBgAk5WWAAhNFQIh093AaCEQ4u0GxjokDNG6gU02JAyRgiCHhFNuwYoV8sbbb8sBLVrIAP09zs/Lky3l5bKkrEzaDxgg544fLwUc/s15DIAUNAyAyUlbAIQgDwlDtAUiqRwS9uoGcs/AOoksEAlaCFyxcaN8smCBrFmzxtxu3aaNHD5ihBx14IEMf2QwAFLQMAAmJ60BELIhBEI2dAPDh4QjBUHuGejI8m5gtg4J76uultYtW0oL17YwRL4LgP+6QNq39pgDuKdKOkzmHEBiAExW2gMgpCMEQrZ1A6OFQEjlAhF3CIx1gYg7BHotEEn5kDA01g20IRC4QIQyDGF52fr1snHbNmmWlyf9uneXAVp5Adwyx3cB8MO7pH1bjw7grnLpMIYdQGIA9PIbrTO0BmhhbA/7s/xUy4kj9WQkAIINgZBtQ8LgFQRtCAQbBG0IhFi6gTYEQqRuoDsEGtwzMCTBBSKJDAlD0LqBFN3G7dvl+bfflqqdO6Vrs2Zm0Qy2oe/Qo4ecPX68dGzbNnTHgGAApKBhAGzodq2ntRZo4dQT92odrDVKK1zGAqDVlEPCkE0LRBACIR0LRLJ2z0AI6AIRhkD/KN2zRx55/nnpV1kpQzp2FLtFDkLggm3bZHfnznLx6acHav4kAyAFDQNg4w7Xwjs9NiGpWy0QkvEACH4IgRBrN9CGQIilG5iOIWHw6gZyz8DQxzMdAoFBMHu9v2CBLP3kEznaY/9EnEd55pYtcvzJJ8uIgQOdo/7HAEhBwwDYOAz/Xqk12Nyqr0kCIDT1vEDItm6ge4EI9wx0jqVgSBjYDSS3B/77XxlUXi69IgzzLt2xQ6r69zdb6ASF7wLg8xdI+zYei0B2V0mHs7gIhPQ9yLkkb6do3aJ1hbmVRYqKOpnLme5JcilgA9vMmZjNE11RUWiV5MyZdaHJKiraZy4RKG2ohKJjQpcz3wtdQtHI0OXMD0KXRQeFLmfOCVXRAc7tBaGymXfmEr3ew7m+Qv9PQ1RRx9BtTWdSZP/43ZknRS1CT/WKHa3l6OrW8l5FreyqCAXXD2srpaw2FOBLNc4dKD3N9TLzOqp5S7bocfOibT7eU4bLKlm5/+NlGvHay2hzvdQ5tkM+1+Ohf3+XzJGagtAb4d62+oLcNhRqavC1dnECDh5OG/BKNPz0d65v1utD9ToKnULUwc7HVuh11Ei9jfpKr6PgaOc+C5zbME6PoebpMZRLmxOd+39Y/7jV2Qlie10dukh6O/cti+G+kQx0/o0tSfwblD5VVVVSGGWVND5WVVnp3KIm0Vf/osbrSHjhOJFiBzCyM7Ue0bpU63kc8GD+0poyZYoUFBSYAxMnTjQVr3g7gFY2dQIhk93AeBeIcM9A17HGhoQhRQtE2AkMnv+8/bY0X71aDuzsbrXXmbdli/QcOVJOGh36wygIEu0AFhcXm4JKDcUzZszA1fR3AD+9S9q38xgCLiuXDqM5BEwMgJFcpHWP1vlab+BABKFftCYYAg7X1PMCId1DwoAgmMiQcKQgyD0DHVwgQnFYun69vPzKK3K8BsCWLerm/UKphpwPSkvlonPOke4dbUve/3w3BMwASI1gAGzoaq1fan1D630ciCJrAiBkUwiEZIKgDYEQTzcwHQtEuGdg/eMWQ2DuwkKP12fPlq/mz5ehrVpJ77ZtzQrgNWVlskwD4DFjxsixB2PzhODwXQB85wJpjyknYUp3VUmH8ZwDSAyAXpAKMFN/r7kV+hnVak3SCg+EWRUAIRuGhCFbF4i4Q6DBPQNDElwgwiHh3FVTUyNfrFoln36hvyFbQ78jfXr3liMPOUSG9tFftIDxXQBcEqUDeCA7gMQAmKysC4DghxAIXkHQhkCItRtoQyCEdwNtCIR4u4GB2TMw1iFhSHM30IZASDQI2hAIDIJND93Aiqoq82bS0pkLHUQMgBQ0DIDJycoACH4OgZCNC0S4Z6BznEPClIMYACloGACTk7UB0MqGeYEQy5AweHUDE1kgApG6geELRLhnoHMsBUPCEG83kCGQ/IABkIKGATA5WR8AwQ8hENLdDUx2gUisQ8IQ6wKRXD+NXCpCIGRzEMQQ6eadO2VXebkZIu3VubPk5XELVr/xXQD87AINgB6LQMqqpMNILgIhBsBk+SIAQi4NCYO7G5jIApFYhoS9uoE5uWdglg0JW9kQBtdu3Spvf/KJbNu4UVo3ayYVGgbbaAAsOuqoQC6UCDLfBcDVd+n7kkcHsLRcOvRnB5AYAJPlmwAI2RICIVVBsLEFIhCpGxjvAhHuGejI8m4gZMNCkXUa/p5+5RUZpKFvkL7pt8jLM1ulrCsrk4V798qkCRNkeL9+zr0p2zEAUtAwACbHVwEQghgCIZ4hYUh1N5B7BjrHsygEWk0RBjHs++/XXpPWGzd6ni1j/a5d8nWLFnL5uedKiyinVKPswQBIQcMAmBzfBUDLL/MCwSsI2hAIsXYDU7VAJNEhYe4ZGPpYrCEQ/BoEt+kb/UP/+Y+c0qmT5HsEPATEt7ZulTNOP10G9Qyde5qym98C4I4VF+j7ksccwNIq6TSIcwCJATBZvg2A4PcQCKlaIALJdAO5Z2CdWEIgNEU30Ep3GFyzZYu88MILcmK3yL8HH2kAPHL8eDl0kD7ZKOv5LgBuidwB7NSNHUBiAEyWrwMg+DEEQqzdQBsCIZluYKJDwuDVDUx0z8CtW8rl8082SdnKrdKqbb4cOeoUGdZ7ieTlNYstBIKPFoikMwRCuhaOoAP48NNPyyldupi5f+HQAXxbA+CkSZNkcK9ezlHKZgyAFDQMgMnxfQAEP80LhGzpBmZyz8B2tSXywRsr5ZNH10vn6o3SqWVzqa7qLBsqN0jfwzvLD75zgLRpE/q5+GXPwGwJgVYqu4IIeI8VF0u7zZtlaKdOztE6G3btkiXNm8sPzjuPcwB9ggGQgoYBMDmBCICQiyEQ3N3AVC4QSfWegV/OWy/v3vmmjOnTTtq3zpcC51TVzWt6yUdfL5Bux3aXH131Pd/tGRhrCIRMBUFIRRjEMPB/XnlFhjZrJgP1TT9PL7EKeMPu3fJFeblMOOkkGTFwoHNvynYMgBQ0DIDJCUwAhKCEQEhVN9AdAg13MyeGBSIfbFspezZtlSMKWsnmga2leX6+PmkiDwlDeDcQ3aTnfvW89FhfKgf3HCz7JPTFtZQeUqOfX6UB9O0VO+WaX4+WwX1OCfSegZkMgZBsEFy1aZO89fHHUrp1q7TRAFiuj2WhBoDjjzxSDhowwLkX+YHfAuDGLd/R96WG52YuLa2Unt0ew1UGwBzHAJicQAVAKwjzAqEpu4HNatfKsqeeky1zvpIWefoiXFslAzvlS5ezD5OBJx0jRzdrG/MCEdmxUf51zdNy3qChsi8v9EUUOh1AGwI/WloiYy8/R8YfZz+efXsG7g+BkIIhYchUEIREwyAC/Ppt22R3RYXgTCB9unaV5jwTiO/4LQCuL7k3Ygewd4ercJUBMMcxACYnkAEQ/BQCobEhYQhfIAKp7gYiBL6xfYcsvPtP0m57K6nod5Dk5beUfs1rZXXpOtmzaZ4c/u0RcuDZJ8a8Z2DJ1jJ58dqH5NTBXaRDs64a/TaYj7fRwGi7gZ8v2yKHXjZcJp18jq/3DExkSBgyGQQhlfMFyR8YACloGACTE9gACOkcEi7KYAiEZIeEIdZu4Jo3n5fVb30mbQeNk2bNmkmLlqE9+/rrl7e2YpuGwHfl2junyuqutea415CwuxvYZt9OeeqGJ+SY2rbSrmNoeLlQKs0l5NdWyJvLdsolP/ueDD5ohTmW7XsGxhICIZYgCAyDlG4MgBQ0DIDJCXQAhFybFwjuIGhDIETqBrpD4LheNfLHW34mefmjZUj3brKqJhTyBhSKrGsWCmJ7Vr0rB19ymPSfUBTznoHLij+Q5f98T44e0kNaNQ/9O+2li+kGfr22REp65ssVvzzBbAeTsT0DIZYFImmeF+jmDoLQVEPEwDAYLH4LgF+X/FDaecwBLCutlKEd7sdVBsAcxwCYnMAHQAhSCIRULRCB8CD41qZy+eTOG2X44DM0vDkvvi1DIRDQDSxbNV8mfKOXFFxwkjkWy56B+6r2yZK/fixrPnhfBnZoJd3b58neympZtXWXlHfKl3NuKJLD+h3X4DRyYLuBcYdAyJJuYDwh0MqWriAwDPqf3wLgipJ/aABsHTriUla6RwZ1+B6uMgDmOAbAhi7UmqJ1uFZbLZxLp27Dt/pyIgBaflwckooQCLF2A8cNqJHpt94szQuPlCE9usqqfaHjA/R12HYD92jYGnLRKOl78kn7t4sZE8Oegav2LZHlc5bKmtc/kdI126VLm27S/4SOckjREOnTuS5k2jOIuE8jV68b6AwJQ7bsGZiObqDVlF1BYBgMBgZAChoGwIYmaGFKP35z/q7FAOgSlMUh4BUCIZFuoDsErv7gv7J3wRdS3n1c6IBrGk51szIp3/SWTPn9jbK4ZxtzzOsMIsnsGQhNcho5yLIh4XBN2RUEhkH/YgCkoGEAjOwErbe0GADD5HIIBHc30GuByOvLdsgXT94lHas1enU8TPJaFMgA/RKXlmyV8s2fyMTzxsjuSWeb+9sziEC0bmCsewaC12nk3N3AuIeEIZluoA2B0EgQbCwEQiKLRLxkUxhkEMx+DIAUNAyAkTEARpGL8wIh1m7ga19tkRXvPCU7ln2tKa+d1NZUSX7rWul72onSa+wEaYZ94Dw2j471DCKR9gyM1g2MOCScSDfQhkBwdwMzNCQM6QiCwDBIXvwWAD8tmaoBsDB0xKWsdK+M7jAdVxkAcxwDYGQMgI3IhRAI8QwJgzsIFn+5SSp2bpKjB+bLl20HS/OCwrjOJxzLAhHwGhIGr25g2oaEIdZuYIpCoMUwSOnmtwC4qOTfETuAB3f4H1xlAMxxDICRMQDGIFdDILiDYCwLRBI9n3BjQ8Je3UCvIWHw6gZmfM/AREIgxBkEgWGQUoUBkIKGATCymAPglClTpKAgtOXHxIkTTcXLrwHQQhD0SwiEVMwLhFiGhCGWIBhrNzBVQ8KQ9gUiqR4ShhiCIKSqKwhcPEKJBsDi4mJTUFlZKTNmzMBVBkBqcgyADeEknQh9CICvaCFJIFXg1At1e22EmF+0XO4AWukIgJBtIRBiXSACyXQDk1kgksiQMGR8z8A4QiAkGwSBYZAS4bcO4Lslt0rb9g1f23aVVsgJHabhKgNgjmMAbOhSrQe1bNjDzwjXT9Sq/8rLALhfugKg5bchYYi3G2jPJ2zEuEDEq9uX7JBwTHsGxrJAJE0h0GIYZBjMJP8tAnlG2rUPbTXlVla6W0Z3OBdXGQBzHANgchgAVbrmAYbzewiEZLuBjS0QcXf7snLPwMZCINggaEMgxBoEgWHQYBhMLQZAChoGwOQwAKp0d//c/BQCIVo30B0CjU7OJcTYDfQaEgYb9LJ6z8BY5wVCImEwxiAI6ZovCAyDwcAASEHDAJicnA+Amer+uflhcQikshuY6QUiadkzMJkhYSvGIAgMgyHuMMggmDgGQAoaBsDkMABmsPvn5ofFIRAeAiHRbmCy28Vk1Z6BiQwJu7mDIKRhiBgYBsnyWwB8qeT30qa96zyUjt2l5XJGh5/iKgNgjmMATE5OB8Cm6P65BS0EQlN0A5tsz8BIIRBiDYKQaFcQGAYNhsHG+S0AflDysrT16ADuKt0tx3U4HVejfQ1YJny5Fv6tuVpTtBZqecFfhvpXoezVQqbAokkkzPu0KIsxACYn5wNgU4U/CyGwKI4AaGV6XiCke4EI2G5gVi8QiXdI2MqSMJjOxSPAMJidcigA3qB1tdYkLbxK3ap1idYwrboXmzpva+EJhPuRjzAAJidnA2BTd/+sRAMgZFMIhGS6gYlsF+O1QCTWIWFIeM/AeEIgRAuCENAwyCCYXXIoAC7XwsmC7zG3RJprrdeaqvUoDoRBAHxP6xfmFvkGA2BycjoAZkP4g6IEAyBkQwiEpuoGpn3PwETmBYJXEIRku4KQgcUjwDAYLH4LgE+U3CetPeYA7iktlws7XImrXl8DPhe/vRjSdV7ZDJzKZIHW9eZWfQiAh2jhJAp4tXpO69dau7UoizEAJicnA2C83b+qqr2yZs0iWbHiS71eJd269ZQDDjhcOnbs4dwjMcl0/9xinRf4zju1smPHAmnX7jPZvRsv5F1kyJBjpHfvETJrNv5I1n8jRfMCIdICEXcQTGbz6FgXiDTZkDDYIAjRuoLAMJgWDIIhfguAb5e8KW3btw0dcdlVuktO7HAyrnp9DXhRx4vCQVpLcMDxuBbu6/VDOFYLLxp4VcKr10Na+FxzvjnKXgyAycnZABhr+Cst3SZvvvm4bNtWLYWFfaV583ypqNgmzZptlGOPLZKDDgprj8UoFd0/N4TAaAFw797dGgAfkk8/3arfwwDp37+jVFbu1EC7SsPsUBk37lL5YG7ofNCpDIGQbDcw1QtEUrZnoFcIhHiCIDAMZoQNgrkaAnMkAOJz4+0AhsMT5A0tvKBiYQhlKQbA5ORcAIyn+1dTUy0vvvg32b69nXTuPEJDX93Tbe/eEv3BfSiTJp0jvXtjbnF8UtX9sxoLgLNmPSpLlqyTbt3GyOrVOFW0hqMBLfR7rJLNm9+VI444SkaPPtscj2dIOJkQaKRxuxj7MYjWDUzLkDA0FgShCcJgovMFwR0G/bh4JJe7gX4OgB8WfyQfaUFlZaU8PeM/uBrpa/CaA7hB61otrzmA4fDEQADE1xH6S52yEgNgcnIyAMba/Vu37it59dUXNDSdXC/8WTt2fKXhr1JOOeUi50hsUt39g2gBcPfu7fLUU3/QF+5TpEWL0JyaVasw3SUUAvfu3a71kZx//jQpKAh9PN3zAiHWBSIQbzcwmQUiEYeEbQiE0N8R9UMgRAuCkEwYdAdBCGgYzGQQzKUQ6LcA+LeSf0nr9q1DR1z2lO6RH3SYjKuRvgZ0+bAK+AwthEEs7sAn4JWnbpJxSHetUVpYBIKPjdD6p9ZKrfO1KIsxACYnpwJgvHP/Pv30Nfnss40aAA93jtS3b1+5/vDekosvvsEMDccqHd0/iBQAV6/+XN588yXp2nW8cyQEIRABELZseVXOPPNy6d59iLkN2RACG1sg4tUNdAe98G5gInsGxj0kDPEEQYgWBhvrCkIsYTCeIWJogjBogyBDYOr5LQC+XPKBtPEYAt5duktO72BefKJ9DbdpXaGFF8U5WnYfwH5ai7RO03pfq7/WU1oYxkGnEH9Jor3IRSA+wACYnJwLgLGGP5g7t1jmz9+iwck1lulSXb1Xdu58Qy666DrJzy90jkaX6e4fJBoAIZMhEBrrBiazXUzSC0Qa2zgaIRC8giDkQBhMRRDMZDcwl0JgjgVAygEMgMnJmQAYb/cPVq/+Ql5//XXp1u1EzyHgkpLl0qXLTjnttMs8P+4l090/qBsCPllatKgbUrEBMDQE/LGcf/5t+4eA3RACvRaGQKrmBUKy3cBo28VALN3ARoeEG5sXCF5BELy6guCnMNgEQZAhMDUYACloGACTk1MBMJ7wB9XVVfLss/dKeXkf6dixfmcMw7/bts2SU089Tfr3xxZSjWuK7p81a9ZjsmTJGg2zx2lYDW35ggDYr1+thC8CCRepC2ilOwQaSWwXA7F0AxMaEnZ/jQiCkI1hMNXzBeMMgtkeAgFBMMghkAGQgoYBMDk5EQAT6f5Z27evl9dee1x2724rrVv3k+bNC2TPns1SU7NWDj/8cA1NE7K6+2dVVu6Rt9/+p6xZs1kKCwdo6OsgXbuWapBdvX8bmBYtQtvAeInWBYRoQ8LuEAjxzAuEWLuByWwX4+4U2iAYLQSC55AwRAuCEMsQMcQaBhtbPALxhsEUBkG/hUAIYhD0WwCcXvK8tPI4E0h56W6Z2uEsXGUAzHEMgMnJmQCYSPiz9uwpleXLP5Nlyxbv3wj6wANHSY8eg+MKf1DUBN0/Cx3NdesWyiuvzNPvo1QOOaS7DB16rPTqdbDk5YW6gl4a6wBaCIHhARAyEQJTvV1MQkPC4UEQ0h0G09kVjHVoOI5uIENg0/FbAHym5FNp077h69vu0jI5t8NoXGUAzHEMgMkJfABMpvuXSk3Z/QuHU8NFOi2cl8a6f1akAAiJhECINC8QwheIQCq3i/EaErYhELyGhMEEQUhHGHQHQYgUBpMNgvF2AwM2JBzEEMgASEHDABjZNK3LtfDLNFfLLoN3y4kAmA3hD4qasPtnNXZe4HDJdv/cYgmBkKluoHvYN5YFIl5Dwg32DIRkw2Ck+YIQKQzG0hWMFgST6AYyBPoDAyAFTWg3Wwp3g9ZlWhO09K1RPtDCqXAa7qoZYLb7lw2K0tD9S1Q83T+IpfvXGLsoJFzRAc4VF5vXZzpn8ixyTrk8c0Xosqhj6HLmOr3uLFqeqdmuqEXo5WCmviUcXR16qu+qaCej9P3kw9pKKasN/ZFTqpEOykzcs8fMm5r5WE8ZLqtk5f6PlWnMg1Ln9g75XI+F/o1dMkdKC0If3ysfhqptvibDUGioqZ4ZKnzNXfQYCso1XKAQ4myQK9HbqP562xZs1mMoGKrHUOAOjwfrMRSscB2Hkc7xr8KOw9HOxxZ4fAzGOR+fF+Hjqs2Jzn0+jHwft85OoNrrBKx49XY+vyzBz4/VQOe/syXN/x3y9oX+Ufa57GxQOE4EDIDertL6gxY2vMS5DG/Rwk7F52jllGzp/qVaMt2/WNnuX2PsApDGhHf/ook3BKIQAmVnngmCCIEVO0Ih8L2KWhMEwR0C3UEQEAJRX8m6Bh9zh0AbBBECW8g4cx0hEFVTENpr0QbBqGEQbBDEKfFsGLRB0B0GwSsIIgSGB0FACHQHQYRAFEJgeBBMUQg0QRAhMIYgyBBIjRkqPeRA/XMsvHCcCBgAG8K700Ct2eZWCFpGeJvGKW9yArt/3tLV/Ys2/Bup+9eY8OweLQSCVzcQIdDdDQSEwFi7geAOge4g2FKO3d8NtEHQdgQRBMPDoAmC7jDo1RWE8K4ghAdBK1XdQIRAFEKgVxCMIQRCPN1AP4VAFEIggyBR9mAAbCj0biXi3qEMkIjsx3ICu3+Ja8ruXzQ2BFqxhECvIWForBsYugwNCbsDIkJgexktm2WRCYLgDoIoBEF3GAQ7RBweBA0bBG1HEMJDIMQaAiHVQ8IIgSiEwBQNCfslBAK7gUTZhQGwITsp1nlr3A+DTDkxYZbdv4biXfkLmej+2UUgXrAYxL0i2M12AaGxEOgeEkYQDB8SPsRMkw2FPXCHwEhDwuv0aPiwsO0IenUFG3QEbRBUdmjYiNQNtEPCECkENjYk7JZF8wIRAlEIgYkEQYZAotzEANgQQt5KraPMrRBs8obh33nmVpibb75Zpk6daqq4GGtF/I/dvzrZPvfPvQI4UTYEWu4QCNG6geELRDDPCEFvsDlPvEhfCZ0Fxh0CO8thzvVQNxDQEUQIRAGCYHhHMDwIRuwGgg2BEGlI2D0vECINCUMWh0BIphuIEIhCCOS8wNTCe4J9f8B7RaZ8KntktuxuUDhOBNwGxtv1WldrnaG1XOsXWpO10E9x//bgXS9Q28Bw37+GmmLfP7Ddv0gB0GsLGMtrT0AL28LYLWHcsD2M3SPQwjYx2CLGwlYx2CYG7FYx0fYMtBtH27OHuE8h594qpo9+BEr17QncG0hj2xhwbx0DkbaPabB1jN0yBmyw89o/0Gu7GBscwW4Vw21iUsJv28T4bRuYf5SskNYe28DsKS2T73UwLwDp/BrIB9gB9Han1j+13tDaooV3mNO0cuJPJ3b/6vi5+3fsgD2yfMFHMv/9l2XJnLelbMeW/XsChrN7AzbGDgeD7QRiSDh8XiA6DYBtJ9AJXKS/RugE2uFg91Yx6AZiSBgV3g0EOyzsHhKGep1ASPe8QLs4BJ1AdzcQnUAUOoFei0PAJ51AyOTiEOBwMFHTYACM7DatXlqYqIR3mvBNoAOHc/+8+XHu39Zln8iTd90mbz/1ksx5baHMen6WPP3nO2TFu0/I2H77nHvW59X9C2c3i44EG0bbOYEYCnazIRAQ9xACAUHQDgl7hcDwIWGIOQSC17xAyNTiEIRAFEJgpMUh0EgINEEQITBAi0MYAomaDgMg1cPuXx2/dv9K1i2SnZ88IfkFo6V7v5OlW9+j9PJ4KW11qqz75HP59I3/OvcMiTT0C3b4F8HPfaYQ8BoCDocQaLuAVqwh0K4UDu8Ges0LhHohUKvRxSGQqRAI0bqBCIEohMAULg4BP4RAFEIgg2DqfFJbaebnhheOEwEDIBno/jV1+LOK2P2LKlr37901tbJm7quSXzhMWrer68Ct2iXSPL+VDB96nCyc9YHsKQ2N+XoN/XqFP0Dws6eJ8wp/6P6BPWUc2HMHgx0KBhsCIVIIhEhDwuDuBtrFIQiBUYeEwR0CUQiB7sUh0BQhEFI8JIwQiEIITHRxCKQ7BAK7gal1uIQWaYUXjhMBAyBlDXb/6iTS/cPQb+Wu7dJq9xpp37nuHHEIfzCgk2gwbKuBqIO8Mn/x/s6f7f4h+NlFH/bcwNG6ftHCn10EAlgIAlgMEg5dQAgPgdHmBaKSmhcINgRCeDcQIRCFEGiDIEIgCiEwfF4gZHEIhGS6gQiBKIRADgkTBQcDILH7F0G2dv+irfo9emCl1EpzycsLBVh3+LM2VeVLTVVlg+AHjXX93MHPHf4Q/FAIftHCH1YDW+4uILhDIESaFwhJzQuMJQRCrN3AHAiBwHmBRMHCAEhZgd2/Oo1t+xLOveVLq7YdpaCwmSzbutOEPwQ/G/5W6Y94ZXmtdG9ZImOHhZKeO/h5df3Ch3vBHfxs+AMb/NzhD8HPK/xhSxhUuMZCoJ0XCHHPC1T1QiAKITAV8wIRAlFeIRCFEBgeBBkCI2IIJEo/7gOYHAyM+XofwGzp/nHfP/34Yv24R/hzBz93988GP7D7/WGbl1XvPS1rP14sIw4eJ82aNTPBz+pUsVRatlsnXa7+ueQ1b76/4wfRhnsh2nAvNNb1Cw98vXa2ly8+XiSL56yQfVXV0ungWjl47GDp0qez2SPQDfsF2r0CAfsFYq9AiLZfoN0rEMx+geF7BUL4foE22CWyVyDEu19gCvYKhHj2C+RegfHz2z6AF29cJwUe70uV+jU80tO0/7kPYI5jB5CaHLt/+vFGwh+Cn1f4Q/Bzhz84/7yJcsiIfNmsoWXpti1SW1srvQt2S9vSebKuaokUfvM79cKf7fqFD/dCtOFeiNb1Q/ALD3/YCBrVernIvT9/VF5+ZKlsWd9TNmxrJ7Nf3CvP/Hy2bH0vtvckdycw0rxAuzgETDcQnUAtdAKjLg6BRDqBEO+QMDqBKHQCvbqBMXQCgSuEye2I6tCpG8MLx4mAATCHBXnfv0TCn5XquX82/Hl1/xD8vMIfgp87/FkIfqjw4GfDH87w0bJNO2n9zaul1bhRUlP1qbTe8ayUbXtDqg/tKIdeeY2cecRQz+FecAc/G/7Aa7g3fK6fDX/gDn4oG/ygYk+FPPCnR6RsX1fpNGSw5HcrlHZdusmBg4+Tjl2Olmf+/pGsXb7e3Bfs2ULc7JxANzskDEnPC0QIRCEEuheHQDpCIEQbEkYIRCEEpmhI2C8hEDgkTJR6HAJOjmm1+3UIOBuGf233rygLAqDt/sUaABsb+nV3/cLDn3uxh1f4g8aGe8Ed/Cy7tQsWeVTv2ydvb98tzQsKpXlhy3pdP4h3uBfcwQ8iBT+woQ/sKeAWzvpKXr1vpQwfMsHcDrdh1WIZNm69nPH9o81t99Cv5T5lnBuGg+1QMGA42J46DlJy+jiv4WDI0dPHZWo4GJpySNhvQ8B3rdshrTzel8r1a/hJHzMxmEPAOY4BMDm+DYC2+5cNAbDIh3P/Yg1/kbp+EEvwA/dwr9VY8LOire4FG/zA3fEDd8cPvOb62eAHCH/ueX42/NngB5jb9+R9r8rCufnSo89g56i+KYnzDanyXWVStXee/P7ua5wjDbnnAFrhcwGtSCEQPOcF8hzC5jJeQZ8X6LcAeMGXOyS/XcP3paqyUnlyOAMgcQg4p2VL9y/V0jn3D8Ev2rw/BL9I4c8O94I7/CUz3AsIfuHhz27tguCXyuFelNdwrzv82eFeBD8b/hD8whd2IPTZgvbSxVRbjXCta82b5H4IfO6KNfx5scPB+7uA0VYIW8nMC4w2HGxXCIfjCuGIOBwcm+Na5Jlzd4cXjhMBO4DJMX9p+a0DyJW/9cU69GuDX6TOX6q6fokO94Lt+EG8w73g1fWLNNwL4cEPwjt+lp3LN/+9pfL8XzfIQUNONbfDrV31pRw5rpmc9v3OzpGQ8NBnRQt/4d0/C13A/QHQ2jWz/upgCMAKYXYCU8N3Q8BLS6SVRwewvKxUfjIk7V8D+QADYHIYABOUDXP/siH4gVf4S+VwLyD8hQ/3QqS5fl7DvRBtrp9X8AtfwIHe4J7dFXLnTU/Kvqoh0rVHP+cjWKCxQfbsKpMdW+bJD28dKaMHhxZyRNJY18+9HYxbg3mAltcWMYAQmKrhYEj1kHAObxMDmQqCDIAUNAyAyfFdAAxi9y+Rzl8s4c891OsV/mzwg3Qs8rDBD9zDvVZ4188GP4i165eK4AfuoV5wBz+EvnCrlq2Xv05/THaVdpK27XuYbWn27dwnzfI2yYXfHSXHnjDCuWcdG/isxoIfxBz+wKsDCOEBEBAC3QEQmjIEAoIgQ6C5TAcGQAoaBsDkMAAmIJXdv3jDn3uuXyzhL93DvZBo1y+e4V5wz/MDhL9Eh3vBq+tng59X6MPcPbeyneWy9uPm8tnsNVJVVSNDD+omR48bJr36hr6ZWAOfFS34WZ5DvxCt+wdeARBiCYGAIJipEAgpHhJmCPThIpCPSyS/bcP3papdpfLkMQyAxACYLF8FwKB1/+IJf9kQ/CDW4V6Ip+sXPtwLTdX1s+EvPPBBpHl8EB74IFrocwc+K1rws2Ie+gWv7p/l1QW0EAQDFgIhl+cF+q4D+HmUDuDhDIDEAJgsBsA4pSL8Jdr1y+bhXkj3Io/w4Afurl948INEun7u4NdUgc+KGvygsfAHXgGwsfAHXgEQGALNZbqkKwQyAFLQMAAmxzcBMAjhzwY/8EvXL1XDvRCp6xfrcC+4u36NDfdCol0/r+AXb+CD8NAXT+ADz9BnRQt/EKn7F2n4FyKFP8urC2jFGwQZAiNKRwhkAKSgYQCs7zCt32qN0uqhdYrWW1qRMADGwM75g6IEA6Bfun6NDfdCsos8snm4N9L+fFa6Ax9EDX3gBD+IGv4gke5fpPAHkbqAFkJgeACERLuBMYRACOLikFSHQN/NAXy1RPLbNHxfqtpdKk+exgBIDIDhhmuN1ZqnNVsL56ryfQDMhvBXlEXBD4K2yCM8+AHCX7oWeQDCn9dwrzv0ZVvgg4ihz2os/EGi3T+IFP4gUgAEhsCEpCoI+q4D+GGJtPJYBFK+q1R+MoYBkBgAo8E7bSA6gE0RAJPt+mVyuHffvkpZt3aBrFm9UL5cWSVtO/SXs846Slq3CXXHrHQv8ohluBcQ/sKHe6Gpu36xBL945/GlIvBBzKEPoi36gES6f8mGPyuL5gXmWghkAKSgYQCMLBABsCnDX5EPhntLSzfLW6/dL4uX7taQ0EeaNcuXrp02SX5BqRRN+B8ZMPiItC3yiGW4FxJd5JHq4Afurl8swS/ZhRuQlsAH7tAHkYIfZCL8QTIBEDIcAiEVQdAPIZABkIImVwLgg1qXatVqeX3PeMc5KXR1P98HQIQ/yFQATFXwg0ws8qjeVyUvPvd7+XJZa2ndbqQM7F/31Nize6OU75kt3UddI207Dsiq4V7wWuSR7uFeiBT+3MEvrQs3rHiHdSGewGfZ4AfRwh8ksvADYg1/gAAYKfxZPg2BkM3zAhkAKWhyJQC21oo2KaxKqyx0dT9fB8BMhr9sX+QRaZ7ff1//TBbNeVwOOXSiNGtW/1dh1RZ9E9w5T44f31WOm3Cxc1T/zRQN94KfF3k0FvziGdbNqsAHsYQ+K9l5f6kOfxZCYKQACAyBcYdA3y0CebxE8ls3fF+q2lMqT36bAZByJwAmIuYAOGXKFCkoCL0RT5w40VS8UhUAbfCDTIa/Ih8M91p2gcfyxY+L7N0kXbrVhRgEP6tn551SUfG+XPSj35uAmMxwLyTT9QsPfjX79knfRcvl01WLpFleM+k0dICcOnSEfJ232Xwc3F2/xoIfxLLIw2u4t7Hgl5GFGxAe+CDeLp8Va/CDppz356WxDqAVz+IQhsCEA2BxcbEpqKyslBkzZuBq2gPgXW9G6QCezABIDIBeCrXwc8E77yQtvHvt06obn6xjftGypQPYFF2/Ip8M91ru1b3vv/2ILFtSKp26hM47a8PfgN6hy6rKXbKr7G0ZcPqdJgCmargXInX9YhnuHbp2i8ya8XfZuWaFdMnLk861zWWZlEuL4QNl9I++JWM6D4h7uBfi7frZ4BdL6Ev7wg0rXYEP3KEPIgU/KxVDv+kKfxZCYCMBEOLpBgZ1cYjvhoAZAKkRDID1DdBaoYW5gm7TtH4ZulpPVgTATHb9sn24F6J1/cBu7fL14vdk5huvS3nzuumfNvzB4pVfSvvuVXLwST9utOuXqeHeXTt2yqO3TZNBe8rlqN59TTDdKrukprZWtq/cKmUD+sjIn39DWhTkN9r1izf4AcJfpI6fO/RlxcINK9HAB/GGPisVQ7/pDn8WQ6C5bCwEMgBS0DAAJqfJA2AudP2iBT+Ip+vntrdit9x99y81RI2QYUP6O0dDlm/ZI3t2vC2Tr5ws/Q6oGyLOxCKP8OAHCH+Y57fs5Xel8rEXZcKQISb4WT2lpWyv3SkfL10nQ6eeL5OOGJv0cC801vVLJvRlbB4fJBD4Nmwrl/nLdsju/KHSuXNbGTW8v3Ro18r5qAcb+qxUDP1mIvxBDAEQMjkvMNtCoO/mAP61RPJbNXxfqiovlSevYAAkBsBkNVkA9NMij2wY7g1nt3YZ0n2RvPHfB6V6Xzdp026QrC/Ll8o966W6aoVMOONYOeKEc02XLd5FHrEM9wLCX/hwL0Ra5LH65ntkyK7dktc59DNC8IMdUmIuS9eWyeYjuknRVaeZ2+ka7o0p+Pkh8EFYl29f57Hy1Cuz5ZMPF0u3mhpp3TxPSqprpCS/hZx5xjFy4jEHmueEEU/os1Ld/Utz5y9cPHMCISjzAn3XAXyhRFp5nAmkfHep/OQbDIDEAJisjAdALvLQ+yQw3Gt57elXsn2DfPXFLHnv48+lprpKRh0+UIaPGie9Bx0i762r+xWJ1vWLNtwL8Xb9woOfXd1737U/lUPzmsmwdl3MbRv8upmF7iJfblouW4b2liunXmVuxzrcC16LPLyGe234axD8sn3hhtXIsO4zxXNlzpvz5Pg+XaSVhj5rx569Mmv51/LtMw+Uo4Y6DyjEEvqsbAh/cXb9wsXbBYQghEAGQAoaBsDkZDQAcpGH3i8FXT8/7+k3++4nZMhnK6Vzv1DgA4S/Uo128MWyjTL0nNNl+Lm9zG1I9XBvveDnCn1+DXxupbvK5bbfPSkndm4r7QpDIVy2rQpdqpUlFbK+1xC58YdnSV5ennO0ETb0Waka+vVJ+LP8HgIZACloGACTk5EAyEUeep8UBD9whz8/7um38ouv5OXfTpejB/SQPvmhf9CGv4I9BfL+pu1yym8nSudeHZMe7gWEP8/hXif4NRr6siHwQYyLN+YsXCnP3/tvOamH67nbDmvDQqprauXlDVvl+qvPk15dzZuot3hDnxVr989n4c/y8+IQBkAKGgbA5JhftHQFQA736n1SPNxrZdOefhCt6wd2T7/a2lrZ9NgnsvKl96RXxxrp3qWtdKppJ2u37JAv9myWQy4dJ2dPONN8TrzDvdBo16+xjl+igQ9SsHBjv1hX64JrHt+HS7bIm++WyLg+kX8HXl6/Ra6+4pvSv2dn54hKNPC5BTz8WQiBiQZAaKoQ6LtFIL8rkfyWDd+XqipK5cn/YwAkBsBkpS0AcrhX75fG4V6ItesXLfhBpK5fpOFeiKfrF76n3+qar2TZJ1/L169ooFuxS8qblUr3Q/rKiNMOlRMOPb7BcC+kZJGHV9fP54FvP2ce37K1W+Tev78gk3p1leZ5DV8eSyoqZWbpbvnl6X2lTWHd89hIJvRBLMO+gAAYb/hLMPhBKsMfJBsAoSlC4Mn/+pe5TEZGO4BPlkgrjzOBlO8plZ9cwABIDIDJSnkA5HCv3icNXb/Ggh/Y8Jctw70Q7Uwe6Aau2jPfnAlkWKtQ0It1uBdiXuTRWPBLd+CDOObxNRAl8IXDz/T3D7wobTftkBHdOzlH1ZZV5mPvb9klQw7tLd8eo0+MRAIfuEMfxBr8IN7uXxaGP0g2AFqZnBfIAEhBwwCYnJQGQHb99H4BW+SRzHCv5T6TR7ybOUO8w71gwp/XcG88wS9DCzc8JbI9i2PNpu1y758elA7llTKsfStpm58n2yr2yeKa9tKqbw+ZcuEEadc68nO4gfDAB/GEPrDBD+IJf5BAANwf/CBLw5+VqRB4gN/mADIAUiMYAJOTsgA4efK7GQ1+UJSBrp/fhnshma5fssO94O76NXYKt2SGeyHmRR6xBL8mWrhhJBH49nPN49tcWiHvbO0osz//Sir3Vkm7tq1l7FEHS9Hhw6RNK5wtMopUBD63eLt+kIrwl6LgB+kKf1YmQqDfAuAFN0aZA/hbBkBiAExWygLg/fe70kqacJGHc0VF6/pFC34Qb9cvkeAHmTiFW0yLPGz4Cw9+AQp8hseQbnV1jVTu2yeF+S0ib/uS6sAHiXT83BIc+vVj+LPSHQJ91wF8MEoH8LsMgMQAmCxfBEAO9+rxDC7ySNVwL8TS9UvJcC/E2vVzB78sWLgRs1Ss1LWSmccXiTv0QSLBDxLs/vk5/AED4H4MgBQTBsDkZHUADPIij2wY7oV0dv3SMdwLcS3ysMEvFaGvqQMfNMXCjUhSFfjcsiT8ZTL4WQiAHAI2GAApJgyAycnaAJiNw70QrevXFMO90JSLPHwx3GvDX7Tgl40dPkhV4INUDutCKgKfW7Lz/hj+omIApKBhAExO1gVADvfq8TQM90IqFnmkergXInX9kh7ujRb8kg18kKF5fDHxc+CzEgh+4Ofwl4nFH5bvFoFcWSL5hQ3fl6r2lsqT9zEAEgNgsrImAAZ5uBcS7fr5ZbgXEu36JTLcC3F3/ZIZ0oVcC3yQytAXHvggwdBnpXLoN8jhD3zXAfxLibRq1fB9qby8VH7yIwZAYgBMVlYEwKbq+iUz3AvZ0PWLZ7gXUrnII1XDvRCp67c/+EGiXT8b/Pwc+CDV8/h8GPjcUhX+mmrIFzIV/oABkIKGATA5TRoAM931y4bhXvDrIo+sGe6FWBZ5uDt+sYQ/LtxIXoqGdRvD8Bc/BkAKGgbA5DRZAMzGRR5NPdwL4V2/aMEP4l3kkUjwA98O90YKfqkIe8DA51xxpCnwWfuDH6Ro2DeoQ77hfDcHcHKJ5Bc0fF+qqiyVJ//FAEgMgOEu1rpC6yAtJIIFWj/X+kDLS8YDIBd56PE0LPJI93AvROv6NRb8IG3DvdBY1y9VgQ+4cKNOJgOflcIFH7kS/sB3HcC7onQAf8IASAyA4a7Swjs2Ah+S1tVav9IarrVeK1zGAmAuLfIIwnAvuLt+WTXcC7F2/dzBLxcCH/hoHl+4dAY+t0wO/WZD+AMGQAoaBsDG7dC6TOs5c6u+jARAPw73QqSuX7qGeyGZRR7hwQ/i6foFbrjXhr9k5/Ex8DlX0qNB6EtD4AuXqe5ftoQ/YACkoGEAjO4Yrfe08E69EgfCpDUAcrhXj2dwuBfi6folOtwLXl2/rBvujTX4pSrwgd/m8eVI4LMy1fnLpuBnMQBS0ORKAHxQ61KtWi2v7xnvqieFru7XTwuvQg9r3YoDHtISADncq8c9un5+Ge6FaF2/rB/ujRT8vBZsQC4FPgjQPL545HL4A98tArlgk+TnN3xfqqoqlSef7IGrDIA5LlcCYGutyMlGfye0ykJXjSFar2k9oXUTDkRgftGmTJkiBQWh4DBx4kRT8bIBsKm6ftGCH/ih6xfPcC+kc5FH1g/3Qqzhzx38kgl7wIUbjcqWwGfZ4Ae5Gv4g0QBYXFxsCiorK2XGjBm4mvYAeNdd66J0AM2LJgNgjsuVABiPw7Re1bpH6w4ciML8oqWiAzh58kLnmoaVDHT9smG4F/y6yCOTw70QsesX63AvxNP1S1XoC8I8vhwOfJCJuX6QzeEP/DcEzABI0TEA1ocY84LWNK0/40AjUhoAiwI+3AvJLPKIFvwg3kUeiQQ/SNcijyYZ7gV3+Es2+HHhRkyach5fuPDAB5kKfVa2hz9gAKSgYQCs7y0tvAIhMdifDeYNohP4W3OrvpQFwPvv3+xcix0XeYQum3q4F9xdv3iDHzT5cG+iwY+BLyYMfJH5IfyB/+YALpH8/IbvC1VVZfLkk+YFlwEwxzEAJqfJAmBQFnn4YbgXonX9fDfcC17hr7Hg5xX2gAs3GsimwAdNNawbCwTAbA9/4L8O4FJp1arh+0N5eZn85CeY5s4AmOsYAJOT8QDYFMEPUtX1i3W4F5JZ5BEe/CCZrp+vh3shka5feOBLRdCzgh74IAfn8cXLL+EPGAApaBgAk5OxAOjH4V5IpusXy3AvIPyFD/dCPF2/RId7wd31Cw9+gPCX9HAvhHf9Eh3uhUhdv3SFPga+tPJL4HPzy9CvxQBIQcMAmJyMBMAgLvLw63AvuLt+gRnudQe/dAzpAufxpUy2zeOLh9+Cn8UASEHDAJictAbAXF7kEc9wL6RzkUeyw73QWNcv7cO90Fj4Syb4MfCllZ8Dn2WDH/gp/K10vu6T//Uvc5mMzC4C+Ujy89uGjrhUVe2SJ588FlcZAHMcA2By0h4AY+36AQJgtOC3X6gxFhm2zY4k1ERrAAHQK/y5g5+FAOgOf4AAGD7ka4OfhQBowx8gANquHyAA2q4fIADarh8gANquHyAA2q4fIADarh8gANrwBwiANvwBAqANf4AAaMMfIADa4AcIf/uDn6UBsF74AwRAd/gDBEB3+AMEwPDwB7udSzeEv0iLPBAAk+36IQCmeljXDQEwzYHPzYS/Jl644YYA6LfAF85P8/3cEAC76dd9mO86gPOidABH4SoDYI5jAExOygIgEREFGwMgZZM855KIiIiIcgQDIBERUcB88MF6mTlzbYPC8RjgbFjrtHCOfExcHqEVCebVPKqFmdzbtR7RMm1Oym4MgFnInjg86Ph9Bg8f02Dh9+lfxx3XUYqKOjUoHG/EDVqXaU3QwkzsD7TwA4o0OxzhD5OpMbMby4t7aj2kRVmOATAL8UU3WHLl+wQ+psHC7zMnXaX1B61FWnu1btHK1zpHK1x/rUlaU7V2aKEDeJ3WWVp9tSiLMQASERERYAEJtj6YbW6FYD8ybA5mVo6EGalVofWFuRWC/bIqtfAxymJcBZwcs9pqzZo1KV0FfPPNN8sdd9zh3Aoufp/Bw8c0WPh9phZWAffr1w9X074K+Le/fU1atmy4b1dFxW658cZTcdXra0DXDhukHqS1BAccj2vhvuF74UzWQrewl7lVB5uuoiv4mLlFWYkBMDnYNM51ngsiIqJGIWhhkUU6YDPYFVqYixcJhmrx/oXunRvCIxZzYMNS1/mizBzABVrXm1t1MNSLcBg+PxD/7re0XjS3KCsxACYHP7/eWlgpRURE1BhszoeluLXmVnogBEbb8h9DtOHhz1quNV3rHnNLpLnWBq1rtbDgww1zABE2sQO+HQbGdZwmaYAWGyREREREPoAu30otbP3SSus3Wmu0Iq0CfkHrVa0uWlg1/LrWs1pERERE5CO3aaHrt0vLvQ8gJjBixGusuRWCfWVwomQMHWMl8MNaqZsUT0RERERElAswwfZzLUzYRc3ROk8raC7WmqW1TWuL1ltax2kFzWFaL2vhL+sarZO0giKeMwf41YVaM7VKtLA1RlC30cKQH7bywPeJxxQrOYO4p9svtJZqoXO1WesVLcxfIyJqclha715ef7zWHq1Dza3gwMaj2HUeexZgwvH/amHLASywCZLhWt/XGq2FABGUAIgzB6zSOlirUAv7aWDyd6Q5Q36F5yhC4He1ghwAb9fCnm8ttDCUh4n/87SCZqiWPWUZvldsW4LtS7g4koiyCl6UxmkhAJ6LAwGHuSRnh64GUpA6gFg1eHXoqoEQv0nrInMreE7QCnIADIeuGL7fIJ/fFX+4/EQL3ycWMxARNTn8BY4whFPyIDS8q4UXqyA7RgvbFGBH+qAKSgDE8xPfCx4zN+wbdmfoauDkWgD8qRZCfhCdroXXVzyH92lhU2OinMBTwTWNB7XwgoM3EVyGF+bAWRgK7aSFvaMw/w9zyBCO/CCe79PCKjNsLIp5SNiKwA8S+T6Dwq72wzwqN7ypciWg/52ihXPBXmFuBQ9eT/H62lkL57D9SIuIKG0wNwovOJEKYS+Sl7SmhK5mvXi/zyFa6DQg/PlJIo8ngiE7gP6UKx3AM7UQ5LEYLRdgmg3+kAnaHGsiCojXtP4cuhooWCGL3fFvNreCLygBELzmAGJVJecA+hceO4Q/dABzBRaC7NbKhTnWRJTlsD0KVqrhjQan9rlSq0rrNK0gwZYv2ALmGnMr2DB/E48lAuBE5zYCk5/Fe+YAv8LvIR4vnEkfARDfH24HbdUowjy2nXJv9htEeL3pHroq3bTu18L33QMHiIiaEnZjR3cFe6thf7z3tXCC7aDBHDlMwMZ8R3yvKFy/UStIcG5MBD+EB3dhPzK/i3TmgCC5VMv9+NnrRVpBgu8Li87wO2h/J3EZtECIU5jhOYvvD/sd/lcLWzQREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREREaWdyP8Hjdf/5PP6XvYAAAAASUVORK5CYII=\">"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "res = train_and_plot(50)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Важное замечание\n",
    "\n",
    "Простая линейная модель \n",
    "* высокий training loss - \"недообучение\", выразительности модели не хватает, чтобы разделить данные\n",
    "* valiadation loss и training loss примерно совпадают - модель хорошо обобщается\n",
    "\n",
    "Сложная многослойная модель\n",
    "* низкий training loss - почти идеально приближает обучающую выборку (но может переобучиться)\n",
    "* validation loss >> training loss и может возрастать - плохо обобщает данные"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Выводы\n",
    "\n",
    "* Простые модели с небольшим числом параметров (\"low capacity\") менее склонные к переобучению\n",
    "* Более сложные модели (high capacity) могут переобучиться (надо следить за validation error)\n",
    "* Для более сложных моделей необходимо иметь больше данных\n",
    "* \"bias-variance trade-off\" - необходимо достичь компромисса между недообучением и переобучением (обучением на распознавание нерелевантного шума во входных данных)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Как использовать модель\n",
    "\n",
    "  * Для предсказаний можно использовать формулу `out = softmax(z)` и `out.eval(...)` для вычисления распределения вероятности на выходе\n",
    "  * Можно сохранить модель на диск в виде двоичного файла: `out.save_model(...)` и впоследствии загрузить её и использовать для предсказаний\n",
    "  * Эту же модель можно загрузить из C# SDK, из C++ библиотеки CNTK и т.д."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Обучение с `cntk.exe`\n",
    "\n",
    "Обучать нейросети можно и без знания Python, с помощью утилиты командной строки.\n",
    "\n",
    "  * Готовим входные данные в виде текстовых файлов (или изображений) в специальном формате\n",
    "  * Описываем архитектуру сети и используемые learner/trainer на специальном языке **BrainScript**\n",
    "  * Запускаем cntk.exe и тренируем модель\n",
    "  * Получаем файл модели, который можно затем загрузить из Python API, из C# SDK и т.д."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Описание сети\n",
    "```\n",
    " BrainScriptNetworkBuilder = [\n",
    "        LDim = 1 : SDim = 2\n",
    "        features = Input (SDim)\n",
    "        labels   = Input (LDim)\n",
    "\n",
    "        b = Parameter (LDim, 1)\n",
    "        w = Parameter (LDim, SDim)\n",
    "        p = Sigmoid (w * features + b)    \n",
    "    \n",
    "        lr = Logistic (labels, p)\n",
    "        err = SquareError (labels, p)\n",
    "\n",
    "        featureNodes    = (features)\n",
    "        labelNodes      = (labels)\n",
    "        criterionNodes  = (lr)\n",
    "        evaluationNodes = (err)\n",
    "        outputNodes     = (p)]\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Описание оптимизатора и входных данных\n",
    "```\n",
    "   SGD = [\n",
    "        epochSize = 0 # 0 - вся входная выборка\n",
    "        minibatchSize = 25\n",
    "        learningRatesPerSample = 0.04\n",
    "        maxEpochs = 50 ]\n",
    "\n",
    "    reader = [\n",
    "        readerType = \"CNTKTextFormatReader\"\n",
    "        file = \"Train_cntk_text.txt\"\n",
    "        input = [\n",
    "            features = [\n",
    "                dim = 2\n",
    "                format = \"dense\"\n",
    "            ]\n",
    "            labels = [\n",
    "                dim = 1\n",
    "                format = \"dense\" ]]\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "slide"
    }
   },
   "source": [
    "## Возможные операции\n",
    "\n",
    "  * `train` - обучение сети\n",
    "  * `test` - запуск на тестовых данных\n",
    "  * `output` - запись результатов в файл\n",
    "  * `dumpNode` - сохранение узла сети для последующего использования\n",
    "  \n",
    "Подробный пример: [тут](https://github.com/Microsoft/CNTK/blob/master/Tutorials/HelloWorld-LogisticRegression/lr_bs.cntk) (аналогичный разобранному здесь)"
   ]
  }
 ],
 "metadata": {
  "celltoolbar": "Slideshow",
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  },
  "livereveal": {
   "start_slideshow_at": "selected"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}