Task 2.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This task evaluates action-value methods of solving a maze that balance exploration and exploitation. If an agent knew the best action to take at each location, then solving a maze would be trivial, as the agent would already know the way. Our agent does not initially know the way to solve the maze, but must discover it through trial-and-error.  \n",
    "\n",
    "\n",
    "In each state, the agent could explore by taking actions which update the agent's estimate of the value of those actions, or exploit by taking the best action based on it's current information. Since only one action can be taken per step, there is a need to balance this exploration and exploitation. The ε-greedy policy is one such solution explored in this task.  \n",
    "\n",
    "\n",
    "The policy evaluation code and associated output is demonstrated in this interactive Jupyter Notebook."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Install rl-gym-maze environment from GitHub.\n",
    "!pip install gym\n",
    "!git clone https://github.com/AngusMaiden/rl-gym-maze\n",
    "!pip install -e ./rl-gym-maze"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Run this code if using this notebook in Google Colab. Restarts the runtime after installing rl-gym-maze.\n",
    "import os\n",
    "\n",
    "def restart_runtime():\n",
    " os.kill(os.getpid(), 9)\n",
    "\n",
    "restart_runtime()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import the necessary libraries.\n",
    "import gym\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# Invoke the model maze environment  from Task 1.2C.\n",
    "env = gym.make('rl_gym_maze:rl-gym-maze-v0')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "###  ε-Greedy Policy\n",
    "This policy sees the agent taking a maximum of 1000 steps to complete the maze, iterated over 2000 episodes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Episode:    1 | Total Reward:    -4 | Finished Maze?: Yes\n",
      "Episode:    2 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:    3 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:    4 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:    5 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:    6 | Total Reward:    39 | Finished Maze?: Yes\n",
      "Episode:    7 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode:    8 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:    9 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode:   10 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:   11 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:   12 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:   13 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:   14 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:   15 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   16 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:   17 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:   18 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:   19 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:   20 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:   21 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:   22 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:   23 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:   24 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:   25 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:   26 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:   27 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:   28 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   29 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:   30 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:   31 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   32 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:   33 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:   34 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:   35 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:   36 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:   37 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:   38 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:   39 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:   40 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:   41 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:   42 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:   43 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:   44 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:   45 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:   46 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:   47 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   48 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:   49 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:   50 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:   51 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:   52 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode:   53 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:   54 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:   55 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   56 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:   57 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:   58 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:   59 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:   60 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:   61 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:   62 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   63 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:   64 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:   65 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:   66 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:   67 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:   68 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:   69 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:   70 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:   71 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:   72 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:   73 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:   74 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   75 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:   76 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:   77 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:   78 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   79 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   80 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:   81 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:   82 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:   83 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:   84 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   85 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:   86 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:   87 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:   88 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:   89 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:   90 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:   91 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   92 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:   93 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:   94 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   95 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:   96 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:   97 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:   98 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:   99 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  100 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  101 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  102 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  103 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  104 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  105 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  106 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  107 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  108 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  109 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  110 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  111 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  112 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  113 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  114 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  115 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  116 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  117 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  118 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  119 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  120 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  121 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  122 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  123 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  124 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  125 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  126 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  127 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  128 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  129 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  130 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  131 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  132 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  133 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode:  134 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  135 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  136 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  137 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  138 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  139 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  140 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  141 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  142 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  143 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  144 | Total Reward:   -59 | Finished Maze?: No \n",
      "Episode:  145 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  146 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  147 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  148 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode:  149 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  150 | Total Reward:   -58 | Finished Maze?: No \n",
      "Episode:  151 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  152 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  153 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  154 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  155 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  156 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  157 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  158 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  159 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  160 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  161 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  162 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  163 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  164 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  165 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  166 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  167 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  168 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  169 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  170 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  171 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  172 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  173 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  174 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  175 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  176 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  177 | Total Reward:   -27 | Finished Maze?: No \n",
      "Episode:  178 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  179 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  180 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  181 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  182 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  183 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  184 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  185 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  186 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  187 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  188 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  189 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  190 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  191 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  192 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  193 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  194 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  195 | Total Reward:    52 | Finished Maze?: Yes\n",
      "Episode:  196 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  197 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  198 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  199 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  200 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  201 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  202 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  203 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  204 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  205 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  206 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  207 | Total Reward:   -55 | Finished Maze?: No \n",
      "Episode:  208 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  209 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  210 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  211 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  212 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  213 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  214 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  215 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  216 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  217 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  218 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  219 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  220 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  221 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  222 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  223 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  224 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  225 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  226 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  227 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  228 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  229 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  230 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  231 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode:  232 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  233 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  234 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  235 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  236 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  237 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  238 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  239 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  240 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  241 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  242 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  243 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  244 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  245 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  246 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  247 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  248 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  249 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  250 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  251 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  252 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  253 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  254 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  255 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  256 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  257 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  258 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  259 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  260 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  261 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  262 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  263 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  264 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  265 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  266 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  267 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  268 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode:  269 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  270 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode:  271 | Total Reward:   -27 | Finished Maze?: No \n",
      "Episode:  272 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  273 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  274 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  275 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  276 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  277 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  278 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  279 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  280 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  281 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  282 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  283 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  284 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  285 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  286 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  287 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  288 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  289 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  290 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  291 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  292 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  293 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  294 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  295 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  296 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  297 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  298 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  299 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  300 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  301 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  302 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  303 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  304 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  305 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  306 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  307 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  308 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  309 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  310 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  311 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  312 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  313 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  314 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  315 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  316 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  317 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  318 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  319 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  320 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  321 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  322 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  323 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  324 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  325 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  326 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  327 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  328 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  329 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  330 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  331 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  332 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  333 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  334 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  335 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  336 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  337 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  338 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  339 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  340 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  341 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  342 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  343 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  344 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  345 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  346 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  347 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  348 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  349 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  350 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  351 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  352 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  353 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  354 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  355 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  356 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  357 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  358 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  359 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  360 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  361 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  362 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  363 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  364 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  365 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  366 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  367 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  368 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  369 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  370 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  371 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  372 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  373 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  374 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  375 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  376 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  377 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  378 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  379 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  380 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  381 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  382 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  383 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  384 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  385 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  386 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  387 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  388 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  389 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  390 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode:  391 | Total Reward:    50 | Finished Maze?: Yes\n",
      "Episode:  392 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  393 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  394 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode:  395 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  396 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  397 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  398 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  399 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  400 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  401 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  402 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  403 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  404 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  405 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  406 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  407 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  408 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  409 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  410 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  411 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  412 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  413 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  414 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  415 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  416 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  417 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  418 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  419 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  420 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  421 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  422 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  423 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  424 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  425 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  426 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  427 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  428 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  429 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  430 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  431 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  432 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  433 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  434 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  435 | Total Reward:   -29 | Finished Maze?: No \n",
      "Episode:  436 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  437 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  438 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  439 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  440 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  441 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  442 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  443 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  444 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  445 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  446 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  447 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  448 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  449 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  450 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  451 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  452 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  453 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  454 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  455 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  456 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  457 | Total Reward:   -57 | Finished Maze?: No \n",
      "Episode:  458 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  459 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  460 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  461 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  462 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  463 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  464 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  465 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  466 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode:  467 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode:  468 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  469 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  470 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  471 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  472 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode:  473 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  474 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  475 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  476 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  477 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  478 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  479 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  480 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  481 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  482 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  483 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  484 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  485 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  486 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  487 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  488 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  489 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  490 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode:  491 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  492 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  493 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  494 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  495 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  496 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  497 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  498 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  499 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  500 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode:  501 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  502 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  503 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  504 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  505 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  506 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  507 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  508 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  509 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  510 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  511 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  512 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  513 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  514 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  515 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  516 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  517 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  518 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  519 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  520 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  521 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  522 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  523 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  524 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  525 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  526 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  527 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  528 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  529 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  530 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  531 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  532 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  533 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  534 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  535 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  536 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  537 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  538 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  539 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  540 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  541 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  542 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  543 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  544 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  545 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  546 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  547 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode:  548 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  549 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  550 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  551 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  552 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  553 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  554 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  555 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  556 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  557 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  558 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  559 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  560 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  561 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  562 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  563 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  564 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  565 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  566 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  567 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  568 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  569 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  570 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  571 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  572 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  573 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  574 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  575 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  576 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  577 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  578 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  579 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  580 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  581 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  582 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  583 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  584 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  585 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  586 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  587 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  588 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  589 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  590 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  591 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  592 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  593 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  594 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  595 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  596 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  597 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  598 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  599 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  600 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  601 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  602 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  603 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  604 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  605 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  606 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  607 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  608 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  609 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  610 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  611 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  612 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  613 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  614 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  615 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  616 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  617 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  618 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  619 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  620 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  621 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  622 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  623 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  624 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  625 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  626 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  627 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode:  628 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  629 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  630 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  631 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  632 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  633 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  634 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  635 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  636 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  637 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  638 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  639 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  640 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  641 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  642 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  643 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  644 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  645 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  646 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  647 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  648 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  649 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  650 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  651 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  652 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  653 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  654 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  655 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  656 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  657 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  658 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  659 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  660 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  661 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  662 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  663 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  664 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  665 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  666 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  667 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  668 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  669 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  670 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  671 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode:  672 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  673 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  674 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  675 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  676 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  677 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  678 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  679 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  680 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  681 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  682 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  683 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  684 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  685 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  686 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  687 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  688 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  689 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  690 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  691 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  692 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  693 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  694 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  695 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  696 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  697 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  698 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  699 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  700 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  701 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  702 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  703 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  704 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  705 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  706 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  707 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  708 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  709 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  710 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  711 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  712 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  713 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  714 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  715 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  716 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  717 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  718 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  719 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  720 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  721 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  722 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  723 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  724 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  725 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  726 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  727 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  728 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  729 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  730 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  731 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  732 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  733 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  734 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  735 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  736 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  737 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  738 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  739 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  740 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  741 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  742 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  743 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  744 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  745 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  746 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  747 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  748 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  749 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  750 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  751 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  752 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  753 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  754 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  755 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  756 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  757 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  758 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  759 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  760 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  761 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  762 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  763 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  764 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  765 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  766 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  767 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  768 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  769 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  770 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  771 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  772 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  773 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  774 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  775 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  776 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  777 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  778 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  779 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  780 | Total Reward:   -59 | Finished Maze?: No \n",
      "Episode:  781 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  782 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  783 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  784 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  785 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  786 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  787 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  788 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  789 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  790 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  791 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  792 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  793 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  794 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  795 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  796 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  797 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  798 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  799 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  800 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  801 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  802 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  803 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  804 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode:  805 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  806 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  807 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  808 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  809 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  810 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  811 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  812 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  813 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  814 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  815 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  816 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  817 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  818 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  819 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  820 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  821 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  822 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  823 | Total Reward:   -57 | Finished Maze?: No \n",
      "Episode:  824 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  825 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  826 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  827 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  828 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  829 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  830 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  831 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  832 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  833 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  834 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  835 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  836 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  837 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  838 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  839 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  840 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  841 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  842 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  843 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  844 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  845 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  846 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  847 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  848 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  849 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  850 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  851 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  852 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  853 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  854 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  855 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  856 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  857 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  858 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  859 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  860 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  861 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  862 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  863 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  864 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  865 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  866 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  867 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  868 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  869 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  870 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  871 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  872 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  873 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  874 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  875 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  876 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  877 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  878 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  879 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  880 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  881 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  882 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  883 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  884 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  885 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  886 | Total Reward:   -58 | Finished Maze?: No \n",
      "Episode:  887 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  888 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  889 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  890 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  891 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  892 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  893 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  894 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  895 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  896 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  897 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  898 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  899 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  900 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  901 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  902 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  903 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  904 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  905 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  906 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  907 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  908 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  909 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  910 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  911 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  912 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  913 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  914 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  915 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  916 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  917 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  918 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode:  919 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  920 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  921 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  922 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  923 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  924 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  925 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  926 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  927 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  928 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  929 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  930 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  931 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  932 | Total Reward:   -55 | Finished Maze?: No \n",
      "Episode:  933 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  934 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  935 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  936 | Total Reward:   -56 | Finished Maze?: No \n",
      "Episode:  937 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  938 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  939 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  940 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  941 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  942 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  943 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  944 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  945 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  946 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  947 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  948 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  949 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  950 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  951 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  952 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  953 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  954 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  955 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  956 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  957 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  958 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  959 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  960 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  961 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  962 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  963 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  964 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  965 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  966 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  967 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  968 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  969 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  970 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  971 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  972 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  973 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  974 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  975 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  976 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  977 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  978 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  979 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  980 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  981 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  982 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  983 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  984 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  985 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  986 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  987 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  988 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  989 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  990 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  991 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  992 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  993 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  994 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  995 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  996 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  997 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  998 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  999 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1000 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1001 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1002 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1003 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1004 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1005 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1006 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1007 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1008 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1009 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1010 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1011 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1012 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1013 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1014 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1015 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1016 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1017 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1018 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1019 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1020 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1021 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1022 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1023 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1024 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1025 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1026 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1027 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1028 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1029 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1030 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1031 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1032 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1033 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1034 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1035 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1036 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1037 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1038 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1039 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1040 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1041 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1042 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1043 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1044 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1045 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1046 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1047 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1048 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1049 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1050 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1051 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1052 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1053 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1054 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1055 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1056 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1057 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1058 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1059 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1060 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1061 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1062 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1063 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1064 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1065 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1066 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1067 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1068 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1069 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1070 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1071 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1072 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1073 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1074 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1075 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1076 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1077 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1078 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1079 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1080 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1081 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1082 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1083 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1084 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1085 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1086 | Total Reward:   -28 | Finished Maze?: No \n",
      "Episode: 1087 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1088 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1089 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1090 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1091 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1092 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1093 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1094 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1095 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1096 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1097 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1098 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1099 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1100 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1101 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1102 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1103 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1104 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1105 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1106 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1107 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1108 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1109 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1110 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1111 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1112 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1113 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1114 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1115 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1116 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1117 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1118 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1119 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1120 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1121 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1122 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1123 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1124 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1125 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1126 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1127 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1128 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1129 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1130 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1131 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1132 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1133 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1134 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1135 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1136 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1137 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1138 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1139 | Total Reward:   -29 | Finished Maze?: No \n",
      "Episode: 1140 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1141 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1142 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1143 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1144 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1145 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1146 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1147 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1148 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1149 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1150 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1151 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1152 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1153 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1154 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1155 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1156 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1157 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1158 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1159 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1160 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1161 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1162 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1163 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1164 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1165 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1166 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1167 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1168 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1169 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1170 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1171 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1172 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1173 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1174 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1175 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1176 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1177 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1178 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1179 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1180 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1181 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1182 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1183 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1184 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1185 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1186 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1187 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1188 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1189 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1190 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1191 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode: 1192 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode: 1193 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1194 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1195 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1196 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1197 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1198 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1199 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1200 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1201 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1202 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1203 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1204 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1205 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1206 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1207 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1208 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1209 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1210 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1211 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1212 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1213 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1214 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode: 1215 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1216 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1217 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1218 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1219 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1220 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1221 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1222 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1223 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1224 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1225 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1226 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1227 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1228 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1229 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1230 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1231 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1232 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1233 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1234 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1235 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1236 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1237 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1238 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1239 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1240 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1241 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1242 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1243 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1244 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1245 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1246 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1247 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1248 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1249 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1250 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1251 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1252 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1253 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1254 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1255 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1256 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1257 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1258 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1259 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1260 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1261 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1262 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1263 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1264 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1265 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1266 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1267 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode: 1268 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1269 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1270 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1271 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1272 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1273 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1274 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode: 1275 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1276 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1277 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1278 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1279 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1280 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1281 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1282 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1283 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1284 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1285 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1286 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1287 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1288 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1289 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1290 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1291 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1292 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1293 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1294 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1295 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1296 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1297 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1298 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1299 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1300 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1301 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1302 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1303 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode: 1304 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1305 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1306 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1307 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1308 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1309 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1310 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1311 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1312 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1313 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1314 | Total Reward:   -55 | Finished Maze?: No \n",
      "Episode: 1315 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1316 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1317 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1318 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1319 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1320 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1321 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1322 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1323 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1324 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1325 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1326 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1327 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1328 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1329 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1330 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1331 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1332 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1333 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1334 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1335 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1336 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1337 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1338 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1339 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1340 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1341 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1342 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1343 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1344 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1345 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1346 | Total Reward:    52 | Finished Maze?: Yes\n",
      "Episode: 1347 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1348 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1349 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1350 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1351 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1352 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1353 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1354 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1355 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1356 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1357 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1358 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1359 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1360 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1361 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1362 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1363 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1364 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1365 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1366 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1367 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1368 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1369 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1370 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1371 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1372 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1373 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1374 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1375 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1376 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1377 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1378 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1379 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1380 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1381 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1382 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1383 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1384 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1385 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1386 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1387 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode: 1388 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1389 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1390 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1391 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1392 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1393 | Total Reward:   -29 | Finished Maze?: No \n",
      "Episode: 1394 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1395 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1396 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1397 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1398 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1399 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1400 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1401 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1402 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1403 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1404 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1405 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1406 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1407 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1408 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1409 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1410 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1411 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1412 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1413 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1414 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1415 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode: 1416 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1417 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1418 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1419 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1420 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1421 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1422 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1423 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1424 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1425 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1426 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1427 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1428 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1429 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1430 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1431 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1432 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1433 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1434 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1435 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1436 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1437 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1438 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1439 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1440 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1441 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode: 1442 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1443 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1444 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1445 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1446 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1447 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1448 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1449 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1450 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1451 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1452 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1453 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1454 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1455 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1456 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1457 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1458 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1459 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1460 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode: 1461 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1462 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1463 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1464 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode: 1465 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1466 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1467 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1468 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1469 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1470 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1471 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1472 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1473 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1474 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1475 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1476 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1477 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1478 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1479 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode: 1480 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1481 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1482 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1483 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1484 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1485 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1486 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1487 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1488 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1489 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1490 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1491 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1492 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1493 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1494 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1495 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1496 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1497 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1498 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1499 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1500 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode: 1501 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1502 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1503 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1504 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1505 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1506 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1507 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1508 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1509 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1510 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1511 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1512 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1513 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1514 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1515 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1516 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1517 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1518 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1519 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1520 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1521 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1522 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1523 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1524 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1525 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1526 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1527 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1528 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1529 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1530 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1531 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1532 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1533 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1534 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1535 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1536 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1537 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1538 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1539 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1540 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1541 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1542 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1543 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1544 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1545 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1546 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1547 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1548 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1549 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1550 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1551 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1552 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1553 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1554 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1555 | Total Reward:   -60 | Finished Maze?: No \n",
      "Episode: 1556 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1557 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1558 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1559 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1560 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1561 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1562 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1563 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1564 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1565 | Total Reward:   -28 | Finished Maze?: No \n",
      "Episode: 1566 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1567 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1568 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1569 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1570 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1571 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1572 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1573 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1574 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1575 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1576 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1577 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1578 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1579 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1580 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1581 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1582 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1583 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1584 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1585 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1586 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1587 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1588 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1589 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1590 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1591 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode: 1592 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1593 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1594 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1595 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1596 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1597 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1598 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1599 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1600 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1601 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1602 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1603 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1604 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1605 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode: 1606 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1607 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1608 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1609 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1610 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1611 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1612 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1613 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1614 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1615 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1616 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1617 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1618 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1619 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1620 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1621 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1622 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1623 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1624 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1625 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1626 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1627 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1628 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1629 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1630 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1631 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1632 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1633 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1634 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1635 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1636 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1637 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1638 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1639 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1640 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1641 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1642 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1643 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1644 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1645 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1646 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1647 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1648 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1649 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1650 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1651 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1652 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1653 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1654 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1655 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1656 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1657 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1658 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1659 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1660 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1661 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1662 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1663 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1664 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1665 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode: 1666 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1667 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1668 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1669 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1670 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1671 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1672 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1673 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1674 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1675 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1676 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode: 1677 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1678 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1679 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1680 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1681 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1682 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1683 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1684 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1685 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1686 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1687 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1688 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1689 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1690 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1691 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1692 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1693 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1694 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1695 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1696 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1697 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1698 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1699 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1700 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1701 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1702 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1703 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1704 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1705 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1706 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1707 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1708 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1709 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1710 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1711 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1712 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1713 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1714 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1715 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1716 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1717 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1718 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1719 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1720 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1721 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1722 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1723 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1724 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1725 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1726 | Total Reward:    47 | Finished Maze?: Yes\n",
      "Episode: 1727 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1728 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1729 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1730 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1731 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1732 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1733 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1734 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1735 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1736 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1737 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1738 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1739 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1740 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1741 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1742 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1743 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1744 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode: 1745 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1746 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1747 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1748 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1749 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1750 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1751 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1752 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1753 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1754 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1755 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1756 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1757 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1758 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1759 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1760 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1761 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1762 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1763 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1764 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode: 1765 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1766 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1767 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1768 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1769 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1770 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1771 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1772 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1773 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1774 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1775 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1776 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1777 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1778 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1779 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1780 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode: 1781 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1782 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1783 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1784 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1785 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1786 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1787 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1788 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1789 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1790 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1791 | Total Reward:   -23 | Finished Maze?: No \n",
      "Episode: 1792 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1793 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1794 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1795 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1796 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode: 1797 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1798 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode: 1799 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1800 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1801 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1802 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1803 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1804 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1805 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1806 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1807 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1808 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1809 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1810 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1811 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1812 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1813 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1814 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1815 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1816 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1817 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1818 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1819 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1820 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1821 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1822 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1823 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1824 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1825 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1826 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1827 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1828 | Total Reward:   -28 | Finished Maze?: No \n",
      "Episode: 1829 | Total Reward:   -61 | Finished Maze?: No \n",
      "Episode: 1830 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1831 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1832 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1833 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1834 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1835 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1836 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1837 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1838 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1839 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1840 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1841 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1842 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1843 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1844 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1845 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1846 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1847 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1848 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1849 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1850 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1851 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1852 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1853 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1854 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1855 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1856 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1857 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1858 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1859 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1860 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1861 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1862 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1863 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1864 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1865 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1866 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1867 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1868 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1869 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1870 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1871 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1872 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1873 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1874 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1875 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1876 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1877 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1878 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1879 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1880 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1881 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1882 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1883 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1884 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1885 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1886 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1887 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1888 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1889 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1890 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1891 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1892 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1893 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1894 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1895 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1896 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1897 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1898 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1899 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1900 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1901 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1902 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode: 1903 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode: 1904 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1905 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1906 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1907 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1908 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1909 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1910 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1911 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1912 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1913 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1914 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1915 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1916 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1917 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1918 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1919 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1920 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1921 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1922 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1923 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1924 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1925 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1926 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1927 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode: 1928 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1929 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1930 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1931 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1932 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1933 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1934 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1935 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1936 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1937 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1938 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1939 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1940 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1941 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1942 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1943 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1944 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1945 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1946 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1947 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1948 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1949 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1950 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1951 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1952 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1953 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1954 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1955 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1956 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1957 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1958 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1959 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1960 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1961 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1962 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1963 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1964 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1965 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1966 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1967 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1968 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1969 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1970 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1971 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1972 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1973 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1974 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1975 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1976 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1977 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1978 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1979 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1980 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1981 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1982 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1983 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1984 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1985 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1986 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1987 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1988 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode: 1989 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1990 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1991 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1992 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1993 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1994 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1995 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1996 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1997 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1998 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1999 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 2000 | Total Reward:    72 | Finished Maze?: Yes\n"
     ]
    }
   ],
   "source": [
    "# Initialise dictionary to store flattened index of (x,y) coordinates.\n",
    "states = {}\n",
    "count = 0\n",
    "for i in range(10):\n",
    "    for j in range(10):\n",
    "        states[i, j] = count\n",
    "        count+=1\n",
    "\n",
    "# Initialise lists to hold episode rewards and maze completions.\n",
    "episode_rewards = []\n",
    "episode_finished = []\n",
    "\n",
    "# Initialise variables for Q table, N table, epsilon, gamma and number of episodes.\n",
    "Q = np.zeros((100,4))\n",
    "N = np.zeros((100,4))\n",
    "epsilon = 0.1\n",
    "gamma = 1\n",
    "episodes = list(range(1,2001))\n",
    "\n",
    "# For loop for each episode.\n",
    "for episode in episodes:\n",
    "    \n",
    "    # Initialise state, done, and total_episode_reward.\n",
    "    state = env.reset()\n",
    "    done = False\n",
    "    total_episode_reward = 0\n",
    "    \n",
    "    # For loop for step iteration.\n",
    "    for step in range(1000):\n",
    "        \n",
    "        # Get Q and N value at current state.\n",
    "        current_Q = states[state[0], state[1]]\n",
    "        current_N = states[state[0], state[1]]\n",
    "        \n",
    "        # The action is selected randomly between exploition and exploration.\n",
    "        \n",
    "        # Exploitation with 1-epsilon probability.\n",
    "        # This code selects the action with the highest Q value, or random if a tie.\n",
    "        if np.random.uniform(0,1) > epsilon:\n",
    "            action = int(np.random.choice(np.flatnonzero(Q[current_Q] == Q[current_Q].max())))\n",
    "        \n",
    "        # Exploration with epsilon probability.\n",
    "        # This code selects a random action.\n",
    "        else:\n",
    "            action = env.action_space.sample()\n",
    "               \n",
    "        # Get next state, reward and done from Gym model's step() function.\n",
    "        next_state, reward, done, info = env.step(action)\n",
    "        \n",
    "        # Increment N.\n",
    "        N[current_N, action] += 1\n",
    "        \n",
    "        # Increment Q according to the Bellman equation:\n",
    "        # Q(n+1) = Q(n) + (1/n)(reward-Q(n)).\n",
    "        Q[current_Q, action] += (1/N[current_N, action])*(reward - gamma*Q[current_Q, action])\n",
    "        \n",
    "        # Increment total episode reward.\n",
    "        total_episode_reward += reward\n",
    "        \n",
    "        # If we reach the end of the maze, end the episode.\n",
    "        if done:\n",
    "            break\n",
    "        \n",
    "        # Update the state variable.\n",
    "        state = next_state\n",
    "    \n",
    "    # Create a variable for calculating and displaying 'Finished maze' statistics.\n",
    "    if done:\n",
    "        finished = 'Yes'\n",
    "    else:\n",
    "        finished = 'No'\n",
    "    \n",
    "    \n",
    "    # Display end of episode results\n",
    "    print(\n",
    "        f'Episode: {episode:4} | Total Reward: {total_episode_reward:5} | '\n",
    "        f'Finished Maze?: {finished:3}'\n",
    "    )\n",
    "    \n",
    "    # Update episode rewards and maze completions lists.\n",
    "    episode_rewards.append(total_episode_reward)\n",
    "    episode_finished.append(finished)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<function matplotlib.pyplot.show(close=None, block=None)>"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEWCAYAAACJ0YulAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8+yak3AAAACXBIWXMAAAsTAAALEwEAmpwYAABD3UlEQVR4nO3dd3hUZfbA8e9JIQmEkgChQ0A6SO9dEVAREWxYsfd1V38WbFgWV9a1obL2guKC2EClqCCCSO9SpYUOoZNAQkjy/v64d25mkskwKTMTyPk8T56ZuXPnzslkcs99uxhjUEoppQDCQh2AUkqpkkOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHJoUlDnNBGZLiLDi/mYz4nI+OI8Zq7jrxWRPoE6vlK+aFJQJZ6IJIlImoikuv287c9rjTGXGGPGBTpGf9m/y0W5tt0iIvNcj40xLYwxv53hOIkiYkQkIkChqlJKv1DqbDHIGDMz1EGcK0QkwhiTGeo4VMmjJQV1VrOvsv8QkbdE5JiIbBCRvm7P/yYid9j3G4rIHHu/gyLypdt+3URkif3cEhHp5vZcfft1KSLyC1AlVwxdRGS+iBwVkVVFrfpxL02ISCcRWSoix0Vkv4i8Zu821749apecuopImIg8LSLbRSRZRD4TkYr2cVwli9tFZAfwq4hMFZG/5Xrv1SJyRVHiV2c3TQrqXNAZ2Ip1sn4W+FZE4r3s90/gZyAOqA28BWDvOxV4E6gMvAZMFZHK9uv+Byyzj/9PwGmjEJFa9mtHAfHAI8A3IlK1mH63McAYY0wF4Dxgkr29l31byRgTa4xZANxi/1wANABigdzVbL2BZsAAYBxwo9vv0hqoBUwrptjVWUiTgjpbTLavxF0/d7o9lwy8YYw5bYz5EtgIDPRyjNNAPaCmMSbdGOOqxx8IbDLGfG6MyTTGTAA2AINEpC7QEXjGGHPKGDMX+MHtmDcC04wx04wx2caYX4ClwKX+/i7Af33sexpoKCJVjDGpxpiFPva9AXjNGLPVGJMKPAEMy9Xu8Jwx5oQxJg2YAjQSkUb2czcBXxpjMny8hzrHaVJQZ4srjDGV3H4+cHtut/Gc2XE7UNPLMR4DBFhs9/C5zd5e036Nu+1YV801gSPGmBO5nnOpB1yd6yTfA6jh7+8C3Odj39uBxsAGu1rrMh/75v49tmO1G1Zz27bTdccYcwqr5HGjiIQB1wGf+zi+KgW0oVmdC2qJiLglhrrA97l3MsbsA+4EEJEewEwRmQvswTq5u6sLzAD2AnEiUs4tMdQFXO+1E/jcGHMnAWCM2QRcZ5+0hwJf29Va3qY3zv171AUygf1Y1WV4ed04rEQwDzhpV0OpUkxLCupckAA8KCKRInI1Vp15nnpxEblaRFwnxyNYJ8gse9/GInK9iESIyLVAc+BHY8x2rOqg50WkjJ1MBrkddjxWNdMAEQkXkWgR6eP2PkUiIjeKSFVjTDZw1N6cBRwAsrHaDlwmAA/ZDeOxwL+wqoPy7WVkJ4Fs4FW0lKDQpKDOHj/kGqfwndtzi4BGwEHgReAqY8whL8foCCwSkVSsksTfjTHb7H0vA/4POIRVzXSZMeag/brrsRqzD2M1ZH/mOqAxZicwGHgS60S9E3iU4vvfuhhYa8c8Bhhmt4ectH/XP+xqqy7Ax1gn9rnANiAd+Fs+x3X3GXA+VoJTpZzoIjvqbCYitwB3GGN6hDqWs5WI3AzcpZ+hAi0pKFWqiUhZrIbu90MdiyoZApYURORjewDNGrdt8SLyi4hssm/j3J57QkQ2i8hGERkQqLiUUhb7/+wAVkP0/0IcjiohAlZ9JCK9gFTgM2NMS3vby8BhY8xoERkBxBljHheR5liNZJ2wutXNBBobY7ICEpxSSimvAlZSsAf5HM61eTBWFzjs2yvctk+0BwdtAzZjJQillFJBFOxxCtWMMXsBjDF7RSTB3l4LcB+pucveloeI3AXcBVCuXLn2TZs2DWC4Sil17lm2bNlBY4zXqVhKyuA18bLNa72WMeZ97EaxDh06mKVLlwYyLqWUOueISO4R/I5g9z7aLyI1AOzbZHv7LqCO2361sUZnKqWUCqJgJ4XvyZlhcjjWhFyu7cNEJEpE6mMNRFoc5NiUUqrUC1j1kYhMAPoAVURkF9ZI0NHAJBG5HdgBXA1gjFkrIpOAdVhztdyvPY+UUir4ApYUjDHX5fNUX28bjTEvYg3bV6rYnT59ml27dpGenh7qUJQKmujoaGrXrk1kZKTfrykpDc1KBdSuXbsoX748iYmJiHjr16DUucUYw6FDh9i1axf169f3+3U6zYUqFdLT06lcubImBFVqiAiVK1cucOlYk4IqNTQhqNKmMN95TQpKKaUcmhSUCpLw8HDatGlDy5YtGTRoEEePHvW5/y233MLXX38NQJ8+fXAN1Lz00kvP+NqCeP3114mOjubYsWPFdsxASUtLo3fv3mRlZTFkyBAmT57sPNekSRNGjRrlPL7yyiv59ttveffdd/nss8+8HC1/7p93oGzYsIGuXbsSFRXFK6+84vHcjBkzaNKkCQ0bNmT06NHO9sOHD9OvXz8aNWpEv379OHLkCAB//vknt9xyS7HEpUlBqSCJiYlh5cqVrFmzhvj4eMaOHVuo40ybNo1KlSoVW1wTJkygY8eOfPfdd2fe2Q9ZWYHrTf7xxx8zdOhQwsPD6datG/Pnzwfg0KFDxMbGsmBBzmqiCxYsoFu3btxzzz3cfPPNAYupsOLj43nzzTd55JFHPLZnZWVx//33M336dNatW8eECRNYt24dAKNHj6Zv375s2rSJvn37Ognj/PPPZ9euXezYsaPIcWlSUCoEunbtyu7duwFYuXIlXbp0oVWrVgwZMsS5+stPYmIiBw8eJCkpiWbNmnHnnXfSokUL+vfvT1paGgBLliyhVatWdO3alUcffZSWLVt6PdaWLVtITU1l1KhRTJgwAYB33nmHxx57zNnn008/5W9/sxZwGz9+PJ06daJNmzbcfffdTgKIjY1l5MiRdO7cmQULFvDCCy/QsWNHWrZsyV133YVrNub84srKyuLRRx+lY8eOtGrVivfee89rvF988QWDBw8GoHv37k5SmD9/PpdddhkHDhzAGMO2bduIiYmhevXqPPfcc86VeJ8+fXj88cfp1KkTjRs35vfffwesEsiwYcNo1aoV1157rfM5gpU0zz//fFq2bMnjjz8OwKRJk3j44YcBGDNmDA0aNHA+zx49/FurKCEhgY4dO+bpLrp48WIaNmxIgwYNKFOmDMOGDWPKFGuc75QpUxg+3Br/O3z4cI+S0qBBg5g4caJf7+2LdklVpc7zP6xl3Z7jxXrM5jUr8OygFn7tm5WVxaxZs7j99tsBuPnmm3nrrbfo3bs3I0eO5Pnnn+eNN97w61ibNm1iwoQJfPDBB1xzzTV888033Hjjjdx66628//77dOvWjREjRuT7+gkTJnDdddfRs2dPNm7cSHJyMldddRVdu3bl5ZdfBuDLL7/kqaeeYv369Xz55Zf88ccfREZGct999/HFF19w8803c+LECVq2bMkLL7xgfR7NmzNy5EgAbrrpJn788UcGDRqUb1wfffQRFStWZMmSJZw6dYru3bvTv39/j66UGRkZbN26lcTERADat2/PmjVryMjIYP78+fTu3ZutW7eyfv16VqxYQffu3b3+zpmZmSxevJhp06bx/PPPM3PmTN555x3Kli3L6tWrWb16Ne3atQNgz549PP744yxbtoy4uDj69+/P5MmT6dWrF//5z38A+P3336lcuTK7d+9m3rx59OzZE4CHHnqI2bNn53n/YcOG+fyb7N69mzp1cmb9qV27NosWLQJg//791KhRA4AaNWqQnJzs7NehQwdGjx7tkdALQ5OCUkGSlpZGmzZtSEpKon379vTr149jx45x9OhRevfuDVhXf1dffbXfx6xfvz5t2rQBrJNkUlISR48eJSUlhW7dugFw/fXX8+OPP3p9/cSJE/nuu+8ICwtj6NChfPXVV9x///00aNCAhQsX0qhRIzZu3Ej37t0ZO3Ysy5Yto2PHjs7vk5BgTXQcHh7OlVde6Rx39uzZvPzyy5w8eZLDhw/TokULevbsmW9cP//8M6tXr3baUI4dO8amTZs8ksLBgwc9qs2ioqJo0aIFy5cvZ+HChTz22GNs3bqV+fPns2LFCud9chs6dKjH5wUwd+5cHnzwQQBatWpFq1atAKtk06dPH6pWtSYUveGGG5g7dy5XXHEFqamppKSksHPnTq6//nrmzp3L77//7hz/9ddf9/m3y4+3NW786UWUkJDAnj1FnzJOk4Iqdfy9oi9urjaFY8eOcdlllzF27FinKqCwoqKinPvh4eGkpaV5Pal4s3r1ajZt2kS/fv0A60q8QYMG3H///Vx77bVMmjSJpk2bMmTIEEQEYwzDhw/npZdeynOs6OhowsPDAWtMyH333cfSpUupU6cOzz33HOnp6T7jMsbw1ltvMWBA/osuxsTE5Olz361bN+bOnUtKSgpxcXF06dKFt99+mxUrVnDPPfd4PY7rMwsPDyczM9PZ7u3E6yvmrl278sknn9CkSRN69uzJxx9/zIIFC3j11VeBwpcUateuzc6dO53Hu3btombNmgBUq1aNvXv3UqNGDfbu3eskZbA+95iYmHyP6y9tU1AqyCpWrMibb77JK6+8QtmyZYmLi3Pqtj///HOn1FBYcXFxlC9fnoULrSVK8qtnnjBhAs899xxJSUkkJSWxZ88edu/ezfbt2xk6dCiTJ09mwoQJXHvttQD07duXr7/+2qmyOHz4MNu3552B2XXirlKlCqmpqc7Vv6+4BgwYwDvvvMPp06cB+Ouvvzhx4kSe3ysrK8sjMXTv3p333nuP1q1bA9ZV/sKFC9mxYwctWvif/Hv16sUXX3wBwJo1a1i9ejUAnTt3Zs6cORw8eJCsrCwmTJjg/H169erFK6+8Qq9evWjbti2zZ88mKiqKihUrAlZJYeXKlXl+fCUEgI4dO7Jp0ya2bdtGRkYGEydO5PLLLwfg8ssvZ9w4a52ycePGOe0rrs8sv7ajgtCSglIh0LZtW1q3bs3EiRMZN24c99xzDydPnqRBgwZ88sknRT7+Rx99xJ133km5cuXo06ePc6JyN3HiRKZPn+6xbciQIUycOJHHH3+c5s2bs27dOjp1shZBbN68OaNGjaJ///5kZ2cTGRnJ2LFjqVevnscxKlWqxJ133sn5559PYmKiU93kK6477riDpKQk2rVrhzGGqlWrejSiuvTv35958+Zx0UUXAVZJYevWrTzxxBMAREREkJCQQJ06dQgL8/+a99577+XWW2+lVatWtGnTxvmda9SowUsvvcQFF1yAMYZLL73UORH37NmTnTt30qtXL8LDw6lTpw4FWfRr3759dOjQgePHjxMWFsYbb7zBunXrqFChAm+//TYDBgwgKyuL2267zUlwI0aM4JprruGjjz6ibt26fPXVV87xZs+ezcCBA/1+//wEbI3mYNBFdpS/1q9fT7NmzUIdRtCkpqYSGxsLWN0Y9+7dy5gxY0IcVdHjWrFiBa+99hqff/55oEI8K506dYrevXszb948IiI8r/W9ffdFZJkxpoO3Y2lJQalz0NSpU3nppZfIzMykXr16fPrpp6EOCSh6XG3btuWCCy4gKyvLacNQsGPHDkaPHp0nIRSGlhRUqVDaSgpKuRS0pKANzarUOJsvgJQqjMJ85zUpqFIhOjqaQ4cOaWJQpYZrPYXo6OgCvU7bFFSpULt2bXbt2sWBAwdCHYpSQeNaea0gNCmoUiEyMrJAq08pVVpp9ZFSSimHJgWllFIOTQpKKaUcmhSUUko5NCkopZRyaFJQSinl0KSglFLKoUlBKaWUQ5OCUkophyYFpZRSDk0KSimlHJoUlFJKOTQpKKWUcmhSUEop5dCkoJRSyqFJQSmllCMkSUFEHhKRtSKyRkQmiEi0iMSLyC8issm+jQtFbEopVZoFPSmISC3gQaCDMaYlEA4MA0YAs4wxjYBZ9mOllFJBFKrqowggRkQigLLAHmAwMM5+fhxwRWhCU0qp0ivoScEYsxt4BdgB7AWOGWN+BqoZY/ba++wFEry9XkTuEpGlIrJUF2FXSqniFYrqozisUkF9oCZQTkRu9Pf1xpj3jTEdjDEdqlatGqgwlVKqVApF9dFFwDZjzAFjzGngW6AbsF9EagDYt8khiE0ppUq1UCSFHUAXESkrIgL0BdYD3wPD7X2GA1NCEJtSSpVqEcF+Q2PMIhH5GlgOZAIrgPeBWGCSiNyOlTiuDnZsSilV2gU9KQAYY54Fns21+RRWqUEppVSI6IhmpZRSDk0KSimlHJoUlFJKOTQpKKWUcmhSUEop5dCkoJRSyqFJQSmllEOTglJKKYcmBaWUUo58RzSLyA+Aye95Y8zlAYlIKaVUyPia5uIV+3YoUB0Ybz++DkgKYExKKaVCJN+kYIyZAyAi/zTG9HJ76gcRmRvwyJRSSgWdP20KVUWkgeuBiNQHdHUbpZQ6B/kzS+o/gN9EZKv9OBG4K1ABKaWUCh2fSUFEwoCKQCOgqb15gzHmVKADU0opFXw+q4+MMdnAA8aYU8aYVfaPJgSllDpH+dOm8IuIPCIidUQk3vUT8MiUUkoFnT9tCrfZt/e7bTNAAy/7KqWUKqSdh0/y6fwkth5IZdSQ86lVKSboMZwxKRhj6gcjEKWUKu0uHfM7KacyAVi87RBD2tYOegx+rdEsIi2B5kC0a5sx5rNABaWUUqWRKyEAJB8PTfPtGdsURORZ4C375wLgZUCnuFBKqQB6afoGjpzICPr7+tPQfBXQF9hnjLkVaA1EBTQqpZQqZXYePpln277j6UGPw5+kkGZ3Tc0UkQpAMtrIrJRSxWpTcgoA427rxPjbOwPw1/6UoMfhT1JYKiKVgA+AZcByYHEgg1JKFd6qnUfZsO94qMNQBXTkxGkAalWKoW58WQDm/HUg6HH40/voPvvuuyIyA6hgjFkd2LCUyjFjzT5+3bCfl69qHepQSoSjJzNIP51N9YrRXp8fPPYPAJJGDwxmWKqIXpq+AYDYqAiqV4ymXuWypJ/OCnoc/jQ0fyYid4pIU2NMkiYEFWz3jF/GpKW7MCbf5T1KlTs/W0qXl2axaOuhUIeiilFiZat0UK2C1WS7/dBJpv25L+iJwZ/qo0+BGsBbIrJFRL4Rkb8HNiyl8hq/aEeoQygRliQdAeDa9xd6bE/LyCIrOydx/rx2H2t2HwtqbKrwKpWNpEXNCogIAJ3qWxNHNH1mRlDj8Kf66FcRmQN0xOqSeg/QAhgT4NiUH+b+dYB6lctSr3K5UIcScP9btIObutQLdRghV6lsJEdPnnYeG2Oo/8S0PPvd9fkyQKuRSjpjDFsOpDJzfTIVonNOyR8N78D5z/0c9Hj8qT6aBfwBXAtsBDoaY5r6fpUKhhOnMrn548XcM355qEMJqLJlwgEoH+3XWMtz2qHUU3kSwqnM7BBGVDJkZRsOu/Xpz8jM5qaPFvH1sl0hjMo/n/yRxEWvWeuWdUjMmVYuNirn+34o9RSD354XlJKfP9VHq4EMoCXQCmgpIsGfkEPl4fonWL/3uEe1wbnG9budzMg8w57nvpU7jwLQuFosAAu2HOJ4+mmPfRLKl+xhRLuPpjF/88FiPebLP22g3T9/4Via9Vm8N2cLv286yCNfrWLZ9sPF+l7F7YUf1zn3r+tU17nvqkYCmLhkJ6t2HePfMzYEPJ4zJgVjzEP2cpxDgEPAJ8DRAMel/DB7Y7Jz/5M/toUwksDJyMx2roRT0kt3UsjIzOb2cUsBuKJtLQCu/3AR7/y2xWO/ijGRHhOphWJUrC/dR//K9R8uYtn2I8V2zB9W7gHguJ0UXv3lL+e5jftSi+19iltahmcjcny5Mh6P372xHYDzWR05Gfi/pT/VRw+IyJfASuAK4GPgksCGpfJzIOUUt3+6hGMnT/PT2n3O9i0HToQwqqL7ftUevl2et6i/47D1e5UrE+78w5dWySk5o1v7N6/u3P/kjySP/W7oXJc/RlzIm9e1BeDQiaLNoTNh8Q6+WrqzSMdwce9BtmBL0UsLn/yxjcQRU9lzzPpsZqzZx6ZcA76e/O7PIr9PoDzxrWdnztxJoVdja+XjzclWYluz+zjH00/nSSbFyZ9K2hjgNWCZMaZ0X6qVAO/O2cKsDclMWrqTGhVjKB8VQcqpTKqW8CqD/BxLO81V78xnk/2lH9rOmhXSGMO+4+lOXWvDhFjW7jmOMcajWF2SZWcbUjMy2XHoJC1rVSzy8Y6nWf9+79zQjoYJsZQJDyMjy7M9wb1RubxdJ/3M5LX8787Ohf7cnvjWOqle3aFOoV7v7mCqZ71/YSUdPMHWg6k8/8M6j+0vTlvPi9PW59l/z9E0aoZgGur8bE5O5b+/bWayXcJxyZ0UYiLDEYEdblNgfL9yD09PXsOzg5pza/fin8Tan95H/xGRHsBNwCciUhWINcacm/UVJVy2faW1aNshZq5PplqFKAyQepZWrYyZuclJCACTV+zmH1+uBODpgc2c7RXLliEz25B2OouyZc6OBue7xy/jl3X7PbY9OqAJ91/Q0Hl87ORpWr9g9TCZ+XAvGiaUz/d4KXbbQfnoSAD+evESpqzczd8nrgTgvKqePdBcDfMLth7ivCen8c293WhbN65ov1QRpbi1f7w7ZysP9WtcqGT1wITlrNnte9T2f65qRZgI//fVKvYeS6NKbBRlIvxpRg2MWev3s3bPcRZtO8Qfm3PGmDRMiHVKAhVydaYQEVyFqy4N4lm49TB/2O0x363YHZCk4O8sqY8DT9ibIoHxRXlTEakkIl+LyAYRWS8iXe0V3X4RkU32bWi/vSWU62px5nqrPSGubBlioyKY9udeEkdMZf7mg2RnGw6klPxVU/cdS+fT+dtoUi3nROhKCACjpuZc8ZWzeyCdOBWYYvPaPcfo+tIs5hdDlYZL7oQA8J+fNnrusz5nn5U7ffcscbWpVIjJOXFUKptzZTnr//p47B/rdoLJNjDkv/PPHHQuOw7lnaStMLKzDUuSDnPhq3OcbRlZ2dR/YhpjZ29m0pKdbD2QSouRM0gcMdVpMM7tg7lb6ffaHLYfPHNcvRpXpUYla9T3le8soPHT09m4L/hzCW07eILEEVO5fdxSXvvlL4+EAPBI/ybMfLg3H97cwWeCrF/F6lwwfY1Vbfz5bZ0DEq8/aXMI1lTZJwCMMXuA/C9n/DMGmGF3bW0NrAdGALOMMY2AWfZj5Wbs7M18k6veffwdndl3PN2ZTfH6DxfR4MlpdHxxJqN+XFeie+zsOZZGtoF7+5znc7/7+pzHBU0TgMD0QNp6IJWBb85j77F0Fm4NfE8V955iP67OqT44U5tJyinPkgJA5/rxREWE8XC/xnn2j4kMz7PtdFbBqmySDuW0VR0+Q4P1yzM2cMErv3l97pP5SVz97gKvz/3np4089s1qLntrHifsuvK1Xrpezt9ykBenrWdTcqrHugMu793U3rlfrkw4CeWjaGCfSF22Hgh+o/Pibb5HnoeHCQ0TYrmoebV8nwd4sG9Dj+2xAeqi7U9SyDBW65ABEJEijZKyZ1rtBXwEYIzJMMYcBQYD4+zdxmE1aiugx79/5ep35+fpZQJQJTaKHg2reH3dh/O25bkyLUlW2d0rfdX1PnlpUx67uKlTrH7u+7XO64qL+6RjJ+2TTWZWdoFPoGC1hew9luZzn1T7PfYeS+O3jTnv/eHvW32+zlVScB+vER0ZzsZRl/Bg30Z59ncvReS8xza/f6+sbMPNH+fMfTlq6jofe8N/f9vCtoMnvE7L4P7a/AYgnnRrPP1m+W6PGUL3H0/n+g8W5XnN3b0asPVfl7Jx1MUMaFGdpNEDWTmyH8tH9kNEqF4xmq3/upSHLrKS5p8hGOF9ptlZOjfwveT9ipH9WPv8AGpUjOH6zlaX1RGXNHWSRXHzJylMEpH3gEoicifWVfyHRXjPBsABrPaJFSLyoZ1oqhlj9gLYtwneXiwid4nIUhFZeuBA8GcQDIVdR9JYknTEaU8oVyacGhWj6W9fWXw4vAOLn+xLldi8J4H8iuElwbtzrCTnLW6XGhWthFE7zpoXZvbGAwwe+0exVgO4z1n/4bxt7Dh0kmveW0Cjp6az7WDBenXN3phM15d+5d7x1mjihgmx3N6jPrFREdzSLRHIqVfflqvHmKsHTX68JQVfKsZEsuKZfnx4cwdevdqaTHDan3tp9NR0Vu866vO1ExbvyNNltIbbBHyZWdlkZGaz91hannUAco+bAM8T4/m1KvL4xb7Hv36zfBf9X5/rPPa2CtnNXevx6IAmhIUJURE5paJKZct4PA4LE+7ubc32H4puzb6aTF6+qhUV3Ep+3lSIjqSc3Wkg0k4EkeGBaxvxZ5zCK8DXwDdAE+AZY8ybRXjPCKAd8I4xpi1WtZTfVUXGmPeNMR2MMR2qVq1ahDBKvvTTWR7dNF1XUpVjo1jwRF/ev7kDYF0tJlSIZv6IvjxzWXOPY3y7fDe7jhRPvXBxc03N0aBqLFPu787ip/qy9OmLSBo9kEVP9uXBCxtycUur62Xu3jtjZv2V53iFMW/TQd6b43mFfuGrv7F8x1HAGgTlLjvbkO1joOC6PVbjp6vet9t5lXnmsuaseX6AM5fN8bRMMjKzuf5D68r301s7cmOXunl6nuR2PO00ZSLCPE54ZxJXrgwXNa/Gle1rUyW2jHOlvML+/VwOpJzikz+2kZ1tlXSe+PZPrnnPqu6JKxvpcVVqjKHhU9Np/PR0ur70Kz1fnk2SW/J0tXu5uFf5NatRgas71ObePuex+cVLeO0a/2a+feVnq8Tr3vmgc/3KRPh5coyODKdOfIxTSgsmVy+ri5olsOGfF3NRs5xqooJO8nhL9/rUq1yWQa1qFGuM7nx+oiISLiJVjDG/GGMeBZ4E6otI3j5f/tsF7DLGuMqCX2Mlif0iUsN+3xpYi/mcM05lZvHEt3+ydo//xdf//raFhyetyrN9ZK4Tv0uZiDBu656Yp3g+LNfEaSXBCz+sY/G2wzSvUQGA1nUqkVA+miqxVtfaahWiebh/E48rogZVcmout9kNjUXtr/3GzLzJJdPtpD955W6PJND6+Z8Z+Na8fI8XHub5L/WAW08j1xXhVe/Od3qQALSqXYnYqEhS0k97PUnsOHSS5JR0jqdn5umdUhANqubUr+e+er3ug4U8/8M61u87nqft4PVr21AhOsI52b83N281Vx+3toTNySmkpJ8mccRUEkdM5Um7S+uNXeoy/e89ncbUiPAwhrarTdLogdzaPdF5/bOD8n6/l++wSi2ufvsAMWUKdrVcITrSo42kOI2evoHGT0/Ps33vsTSembIWgLevb0d0ZLhTaqlaPoqejQp2YVu/SjnmPHoBCRW8T5teHPL9VEVkGHAYWC0ic0TkAmAr1sC1Gwr7hsaYfcBOEWlib+oLrAO+B4bb24YDUwr7HiXR8u1HmbB4B+/O8V1v7G6Hly/w3b0b5NsgBVYXthGXeBbNdx3xXccdCCt2HPE55e/H9gjsdvUq+X3MK9vXdu6npJ/m+1V7aDZyBp8vSCpwfGkZWbzy00aWulWRdK6ft243/XQ2fV/L6TGTciqT9XuPc8OHC72ewNftzekm+f5N7T3+eV3VPiczsjBWEx1f3NGZ+HJlKB8dwemsvPMY3TFuCb3+M5tOL85iwuIdHo3MBTVmWBvnfu5k6upllJKeyU9r9nk8VzEmkiMnT/P5wu1MWbmb0dN9T7Vwz/jlHv3qV++yLoQuPT//q9tFbg387lfSLh0T42lZqwKJbhM/tqpdyWccuSVWKVcs/wvGmDzVsu/O2UJGZjbX5boAu8eelLBiTCRRdnfYjonxJI0eyJKnLipRYydcfKXap4H2xpiawEPADOBvxpghxpiizsD2N+ALEVkNtAH+BYwG+onIJqCf/fic4apHTvZjzdWkgydIPZWJ+ynHdYVYzo8++q4J5ELl+1V7GPLf+Xy7fHee55KPp9Nh1EznsfvI3DO5vUd9Zj7ci1u6JbLrSBr/tk9Oi5MKPl3ClJW7eXv2ZufxR8M78Pb17ZzH0//e00murnYF92qQPzYfYtG2vD2VNrqteNYiV5WXe1vAl0usEcKueYpcf9/bPl3iMSJ31gbPAnOFmMInBVf7DMCRk97bmjbuS8kzQrqi23u6xkScyf+5lXC3HjxB0+rl6Xae9w4RAK/a1Ujjb+9MnfiyPHhhQ0RwSmmp6ZnERkV4jDOI99KQ7kvNitEcSDlV5Ha28Qu30/r5n7ngld9YtfOoR5vKgq2H+GHVHn5YtYcxMzexatcxBrSoxqpn+581gy59JYUMY8xmADsJbDPGfFccb2qMWWm3C7QyxlxhjDlijDlkjOlrjGlk35bsWawKyDWz5dF8/hld0jKy6PPKb/x9wgqPqhPXaFL34nN+RIRv7u3KWPsk55o8LVhc9cs7vCxE/uuGZA6m5jQanqke3V10ZDgNE8oz0K5P3X3Uuur7YdUeXy/zKiZX4uzbrBpVy0eRNHogSaMH0qxGBdrUqeQ8v2b3MZqP/MnjNfu8NAynpmdyVXurSqRWrqtA95XSflprjU+oFWft09geqzF/yyE+X7jd2S93YeQfXnoZFcT5dqI6ejKDXzfsZ9eRk+w8fNIZGb0pOSVPd09v07IPbVfL6/Fd1X8bcnUEONOJuFmNCiSNHkiPRlbiiC9XBmMgOeUUxhhST2USG2UlJ9fo/bAC9r5xTQXz3PdrC/S63GbY08tsO3iCwWP/4LsVnhc/f5uwgr9NWMHrM/+iTnyMM93I2cLXZWeCiDzs9jjW/bEx5rXAhXV2S8vIotnIGTx+cVOnD75rIqsTblebz0xeQ4WYCB4dkFPdszjJyoWuK8ToyDC+uKMz7evF8+iAJkR76XvuTft6VlXI9DU1nMbPYHFVG6V5GVPg3vvjvj7n0aJmhQIfv2NiPCMuaepUYxSma95xP3qhuFdVXOalHSH3ie+p7/5kz7F04sp6v5ovWyaC8bd35saPrOa0quWjnNHZndyqrlwn0MW5SiIvX9XKGa9RWJPv706/1+aw73g6t326lOjIMNJP51RZTVycd44jb59v/crlSBo9kOxsw5y/DnDrp0uA/BtO/3tDO6/b85Notx91eWkWlcuV4dCJDKf308yHerP3eMGrgR7s24hfNySfscvwmWTn6tH72i/5d3oYM6xtgToGlAS+SgofYA1Sc/3kfqzy4erh4T7N7WE7Kew6kubMaPr5wu2Mne3Zu+VorlkQ68WXc07w/iYEdxViIr12EQwkVw+PQ14GO6Wkn0YEtv7rUh67uGmhi9Rl3EpR/laXnczIdMY4uA8UW/LURV73r14xmpUj++XZ/tsjfQBrqhF3X9grw/Xw0XjoXoXkPurc/XNYs/sYl789z+n9A3B1+9pOF+SiCA8TqpSPYrvdhuCeECCnkf3JS60Llb52Enrl6ta454Zb7IbhsDDxKL3+X/8mzpgAgAVPXEjS6IEFnl7D/XNyfY9cF1YVy0bStHrBLyba1KlEr8ZV2Xm4aEkhqwA9hs7U3bQkyrekYIx5PpiBnEsy3QYHHTmRQVy5Mhw9kXMSev6Hdfle3ebuMtc+sWizfZSPjvDrqrg4OUkhNW9SOG7XDRe06J9b/xbVGL9wOy1qVeTH1Xv8mijvwQkrmLk+mUl3d3UG9b1/U3ufkwlWKluGHg2rMM+tt1Dl2DJULleGFTuOWr3KvvmTqzrkNILXicu/8bC+2/xEuTsEVIktw8HUDK8z3v7nav+6bvqjXJlwFp9h/EXPRlX58W9VaGDHe1X72lzVvjbPTllDx/rxHg3e7t/lOvHWAKs1e44RVzbSox2jILzNb/X6tW0KdSx3VWLLMPevNJ6e/Cejrji/UMfwtxtpnfgYalYKXC+hQAnd7FDnMFf3OYAldnXQ4ZMZNK1enrrx1iCskVO812vmntiuqGvVV4iOJCMzm/TTWUFb+N71OyzYeogNbg2vJ05lWvMBFUMYtePK8usjfTi/VgWM8RwNmx/XfFGuK/Ch7WrRv8WZG7obuJ3Ib+9Rn/LRkc7Va5OnZ/Dtit0eo23LReVfK+t+5VjP/i64LH26H/+7I+98Nl/e1eWMMRZEppdxFqOH5pwgt710Kc1qVKBlrYp5Ts7PD27JZa1q5nn95Pu707R6eVrWtNosPri5Ay9fVfhE5mqAb107p7G+bq7PqzCeHdQCgPELC7/ed37zio0Z1sbpYfTikJb8/tiFZ83kje40KQSAe0PdyYwsFmw5RHLKKeLKlvHa+OrO1Wjluugt6prErn+ups/M4MJX5xQ4Mew5mkbjp6bT+V8zycjM9jlw6+jJDDq9OJOf3SaCc3U1/HntPlo8+xO7j6Z5nbemsFyNj2eal8dbQ+dr17Tx6z3cBwQ+dak1eMp9/IG7ZjUqUDXW9zTm9/Y5j96Nq9LXS9dLbzo3qOzXfv4a1DrvSX1Q65pc1b42nevHF6pKr02dSsz4Ry/iCtBxwJfKsVH8+Vx/pjzQg4tbVCc8TIql907FIvTecnFdgFzToTbrX7jY2T64TS3+fWUrykdHeEzyeLY5+9LYWcD9av+rZTudWREvPd/7VWlmVjazNx7gsa9XOV0Ft71UPIutD2lbi/fnbmVTcirbDp7gREYWT377Jwnlo3g6n0Fw7h76ciUZWdnsP36Kd37bwge/b2XuYxd47TU0fuF2knNdRSUdOkHDJ6d5XJ32LWJjqbtyUVZ7wh3jlnJ1h9rc0bOB1/3cezwVlHsvMFe1V2KVvD1y6sTHMO3BHmc8efma4sF9gNmYYW2K5eo4N/fSyns3tSf9dBbloiJ4pRirqIqDq4rqvze0K1A9fqCdOJXJbd3rM9IeZLfhnxc7U9Bc0bYWl7euWeTq0VA6Y1IQkWpY4whqGmMuEZHmQFdjzEcBj+4slZKeSe24GHYdSfOYJjcun37V6/Ye587PlgYklojwMAa0qM6mZKtP/r3jl/H7Jqt+/OTpLP41xHe9qnu1zOv26N89R9O8JoXcV+M1K0bn6fMO+Bx8V1Dt7AbMjftTGDV1PaOmruf9m9rnqRYq6noTfz7Xnwi30cq9Guftc5+RmV3kq9nqFaP56p6ulCsTQfNC9Mzyh6un0wVNqjLAj+qzUAsLE8IovpNsz0ZV+H2TNcV8QU/eB1JOcSIji8pu83Xl7gByNicE8K/66FPgJ8BV5vwL+EeA4jknpKSfJq5sGTrU82wkjggTFj7Rl/b14vjklo5Or5k9Rz17Q7iPPC0OjavnFGVdCQHgf4t2nLH/uLdzXO7eTMYYVu08yrG0006jbY2K0dyQT9VXvcrFd/XrrXfHxCV5u1VusadMdtXZRxVwsZXy0ZEeYxsSykezcdTF9G2awO09rIVOwoppcFLHxPiAJQSwxgAkjR7IJ7d2Cth7lGS97N5hJ/ychv2/v22mz39mAzljY5pWP3urh87En/+MKsaYSUA2gL0kZ+AWCD0HHE/PpEJMhEcDJUDH+vFUrxjNN/d244KmCXz/QHcgpyujS+sCDt8/k8tb1+SPERd6bBtoTznQ+vmfCzzCM/eEZ/O3HGLw2D+YtHQX5aMjmPlwb6Y92DNPyeiyVjX4/oHuPke2FlSFmAiiIz2/xr/mGgUMVttGdGQYnerH8+8rz2fmw72L/N5REeF8dEtHettdMns2Kr7fSwVOlfLW9/KRr/LOK5bb/uPpvDxjI0mHTnIqM8vpbl6UkeUlnT9J4YSIVCZnPYUuQPAnJT+LbDmQSpXYqDzz1OTuteF63nX13rl+PH+NusRrfXVR1aoU44w2BejnVoWzetfRfGeP3OK2VOa7N1qLmBxL82zUda+vb1ClHA0TYokrV4aGCZ4jqUdd0bLA89WciYhwuZeG08xcawaknDpNrUoxRISHcW3HutQpxrr6Hg2r8OKQlrwwuGWxHVMFziUtrQuin9buP+MYns7/muXcP5Z2mmcmrwEKNhL/bONPUngYa7K680TkD+AzrLmLzhmnMoun4PPZgiQufOU3jp48TeNq5Yk4Q91iQq7+8W3rxgV0Ddm7etVHBJY9fZHHCfumjxbT8tmf8kxg99vGZGclrH9e0ZKu51m9YB7/5k8aPz2d3zZaV+Qvz8hZyKe724I/nerH89jFTZzHsT66ahaFqw3bfaGZjftTSBwxlWXbrd5Pe46mF2kyOV/CwoQbOtcr1OBCFXzRkeG0sru6PvbVaiYt2ems7eEu92JEExblVEueVzW4U8cEkz/rKSwHegPdgLuBFsaY1YEOLFimrt5Lk6dnOAtnP/b1KhJHTPU5w2d+Rk5Zy1Z7UFDZMuHO1UR8uTIe88C7iIjHNMF39/Lec6a43NXrPDb+8xIqx0bluYoHa8RoWkYWr/3yF4dSTznTO//wQA9u6lLPY9rmjMxsRk/fgDHG47PKXcd/X5+crpv+zn1fUJXsonyduBhevqoVAA9/aVUNXPmONSZhS3LqWd1NUBUv1xoHK3ce5bFvVnud+TX3gjxTVlrdxS9pWfIb54si30s3ERmaz1ONRQRjzLcBiikoNuw7TkSYcP//rAlf1+89TsOEWCYttRa1+WntPga38T7pV25pGVkeU1q4DOtUl7rxZRnQonq+PRIublmdN2Zu4oo2NYutj7cvrpJIdGQ43z/Qncvf/sN5rutLv3J1+9p8tWwXK3cepWbFaBLKR3G+fVUlIlzXqQ4T7PlxNuxL4dWf/yKuXBlErEVP+jTJO8XDxLu6sLKYl9B0d3WHOuw6kkb/FtWd5L7Rnmk0PEyYvSGZlFOZ7E858wy1qnTo3rAKG/alkOz2nbj/f8t56KLGzgVTSq6qJdcFX3GMrC7JfJXnB9m3CVilhF/txxcAvwFnbVLIyMzm4jd+99gWESYeA7OyjWHLgVQuHfM7X9/TzTkx5paVbWg2ckae7eFhQsWYSC7xMYc8WNMZr7TXkw02b/X7Xy2zkuLBlFNkZWfnaVDLXRKYsHgHh05kcG2HOvzbvkrPrUuDynQp5gFY7ppUL8+79qLt7epW8nguK9vw6i9W9dbgNnnbHlTp1KNRFT6atw33sZhTV+8lvmwZ/nmF1TY0Pde6EmBNYniuVxP6mvvoVgAR+RFo7lo/2V4VbWxwwgsMbwOZ7v0i7xIRszckcyozm0lLd+abFPJbycnboun5KYnzrGcbw8Kth7momedAsyi3f4gGVcux1Z6np6SccEWEoe1qeazlsO+Y9ff2tciLKl0uaOJ9AOXhkxl8vnA7B1JO8easTQD8+8rz2XbwJO/O2ULDc7gtwcWflr9EV0Kw7Qca57fz2eBMUyIAZGYZp9+5r6mZ1+z27Ij12MVNCBPhsrPkBJQ02ho5nThiqsd217TQHRM9VyM7Zs9UOah1TU5nZjtJoagT9xUnV9vBnT3r88Hv25yLgLNtCmMVWBFhkmceqKmr9zJ1dc7prkm18vRvXp1v7elngj3jcCj40/L3m4j8JCK3iMhwYCowO8BxBVTl2DIefcq9Xainnsp0Fh6Zt/mgs7bylgOpLNyaM0o590pUrWtX4p7e5511oxpdReaXhp7v0S6QuxTzUL/GPD2wGW8Oa+NMbxwdWbDF5APt9h71mXBnF564JKdx39sSj6p0m/f4hT6fb1wtlp8esuZzutCemmW923Kr56ozlhSMMQ+IyBCgl73p/eJagS1UalSM4fPbOzPnrwNkZmWzetcxxthFRZfnf1jnLCa+OTmVgW/OI2n0QPq+aq3XmzR6YJ6+8FA8E26Fwk1d6jmT7812G/zVKVdJoVLZMs78Qq72hpI2Z3xEeJjTfdbllau9t3eo0qt6xWjmPNqHfcfSOZZ2mrvs9ZRdKsXkVAHXr1KOB/s28rqO97nG347j84FMrAFsiwMXTnC5RqLmNz3BzPX7PR7nnjLX1WXtrl4NeH/uVgAq5bPq1tnEVaB+/vIW+balQM5CKLknwStJ2tWtxPIdRwM2RkKd3epVLud1uVGAdrmmqXm431lda+63M1Yficg1WIngKuAaYJGIXBXowILpgqYJTLm/e57tu494zkm0zW1hku2HTjjz6XSoF0f7enFEhkuedXnPRq7ptd1Xv/ImUIPBitMnt3Tiu/u6BWyMhDp3fHFHZ2pVimHqgz14cUhL/l7E9bDPVv5cPj0FdDTGJAOISFVgJvB1IAMLtiZeJrjKvXTAfV/kFC/Hzd9OR7txtXZcWb64ozNZ2Wde/ets4Pq9fS0WAzlJ48YudQMdUqFVLBtZ4KUgVenUvWEVZ46wFjXzLyGf6/y5fApzJQTbIT9fd1Zx73s8Mp91Bg66LS85d9MBpxtr+egIoiPDz3gSPVu4Fok5U3/s3o2r0q95NW7qkhiEqJRSweDPWWyGiPwETLAfXwtMC1xIoXdbj/rc2j2ReZsPcjwt0xn17NKhXhxLt+csuVnlDCttnW2eGdSc+lXL0e083wPOqlWI5oObOwQpKqVUMPjT++hRe8qLHoBwDvQ+ys8/r2jpTGInIvRsVJUTpzLzLNyeezoK93n2zwWxURHc0/u8UIehlAoBf1ZeKwdMMcZ8KyJNgCYiEmmMOedGcXhbD7lcVATj7+hMcko6nV6cRafEeAa3qWktQM+5V0pQSpVu/lQfzQV6ikgcVgPzUqwqpBsCGVhJk1A+mhXP9COmTDjRkeGs3HGUX9bv5/2btPpEKXXuEHOGBbFFZLkxpp2I/A2IMca8LCIrjDFtgxNi/jp06GCWLg3M2sZKKXWuEpFlxhivV7T+9CISEemKVTJwTZBzbnSzUUop5cGfpPAP4AngO2PMWhFpwFk+95FSSinv/Ol9NAeY4/Z4K/BgIINSSikVGr5WXnvDGPMPEfmBnOlwHMaYywMamVJKqaDzVVL43L59JRiBKKWUCj1fK68ts2/niEgZoClWiWGjMebMq9QopZQ66/gzeG0g8C6wBWtEc30RudsYMz3QwSmllAouf7qWvgpcYIzZDCAi52F1TdWkoJRS5xh/uqQmuxKCbSuQnN/O/hKRcBFZISI/2o/jReQXEdlk3+p8x0opFWT+JIW1IjLNbY3mH4AlIjLUniivsP4OrHd7PAKYZYxpBMyyHyullAoif5JCNLAf6A30AQ4A8cAg4LLCvKmI1AYGAh+6bR4MjLPvjwOuKMyxlVJKFZ4/g9duDcD7vgE8Brgvd1bNGLPXfs+9IpLg7YUichdwF0DduiV3xS+llDob5VtSEJFJbvf/neu5nwv7hiJyGVY7xbIz7uyFMeZ9Y0wHY0yHqlWrFjYMpZRSXviqPnJftbpfrueKcjbuDlwuIknAROBCERkP7BeRGgD2bZEbs5VSShWMr6Tga05t3/Nt+3qhMU8YY2obYxKBYcCvxpgbge+B4fZuw4EphX0PpZRSheOrTaGsiLTFShwx9n2xf2ICEMtoYJKI3A7sAK4OwHsopZTywVdS2Au8Zt/f53bf9bjIjDG/Ab/Z9w8BfYvjuEoppQrH19xHFwQzEKWUUqHnzzgFpZRSpYQmBaWUUg5NCkoppRy+Vl5r5+uFxpjlxR+OUkqpUPLV++hVH88Z4MJijkUppVSIae8jpZRSDn8W2UFEWgLNsWZMBcAY81mgglJKKRUa/izH+SzWlNnNgWnAJcA8QJOCUkqdY/zpfXQV1kjjffY02q2BqIBGpZRSKiT8SQppxphsIFNEKmDNXtogsGEppZQKBX/aFJaKSCXgA2AZkAosDmRQSimlQsOfldfus+++KyIzgArGmNWBDUsppVQonLH6SERmue4bY5KMMavdtymllDp3+BrRHA2UBaqISBzWOgoAFYCaQYhNKaVUkPmqProb+AdWAnCf0uI4MDaAMSmllAoRXyOaxwBjRORvxpi3ghiTUkqpEPGn99F7IvIg0Mt+/BvwnjHmdMCiUkopFRL+JIX/ApH2LcBNwDvAHYEKSimlVGj4amiOMMZkAh2NMa3dnvpVRFYFPjSllFLB5qtLqmuAWpaInOfaKCINgKyARqWUUiokfFUfubqgPgLMFpGt9uNE4NZABqWUUio0fCWFqiLysH3/PSAcOIE1fXZbYHaAY1NKKRVkvpJCOBBLTokB+zFA+YBFpJRSKmR8JYW9xpgXghaJUkqpkPPV0Cw+nlNKKXUO8pUU+gYtCqWUUiVCvknBGHM4mIEopZQKPX9WXlNKKVVKaFJQSinl0KSglFLKoUlBKaWUQ5OCUkophyYFpZRSjqAnBRGpIyKzRWS9iKwVkb/b2+NF5BcR2WTfxgU7NqWUKu1CUVLIBP7PGNMM6ALcLyLNgRHALGNMI2CW/VgppVQQBT0pGGP2GmOW2/dTgPVALWAwMM7ebRxwRbBjU0qp0i6kbQoikog1DfcioJoxZi9YiQNIyOc1d4nIUhFZeuDAgaDFqpRSpUHIkoKIxALfAP8wxhz393XGmPeNMR2MMR2qVq0auACVUqoUCklSEJFIrITwhTHmW3vzfhGpYT9fA0gORWxKKVWahaL3kQAfAeuNMa+5PfU9MNy+PxyYEuzYlFKqtPO1yE6gdAduAv4UkZX2tieB0cAkEbkd2AFcHYLYlFKqVAt6UjDGzCP/BXx0DQellAohHdGslFLKoUlBKaWUQ5OCUkophyYFpZRSDk0KSimlHJoUlFJKOTQpKKWUcmhSUEop5dCkoJRSyqFJQSmllEOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHJoUlBKKeXQpKCUUsqhSUEppZRDk4JSSimHJgWllFIOTQpKKaUcmhSUUko5NCkopZRyaFJQSinl0KSglFLKoUlBKaWUQ5OCUkophyYFpZRSDk0KSimlHJoUlFJKOTQpKKWUcmhSUEop5dCkoJRSyqFJQSmllEOTglJKKUeJSwoicrGIbBSRzSIyItTxKKVUaVKikoKIhANjgUuA5sB1ItI8tFEppVTpUaKSAtAJ2GyM2WqMyQAmAoNDHJNSSpUaEaEOIJdawE63x7uAzu47iMhdwF32w1QR2Rik2AqjCnAw1EH4oPEVjcZXNBpf0RQlvnr5PVHSkoJ42WY8HhjzPvB+cMIpGhFZaozpEOo48qPxFY3GVzQaX9EEKr6SVn20C6jj9rg2sCdEsSilVKlT0pLCEqCRiNQXkTLAMOD7EMeklFKlRomqPjLGZIrIA8BPQDjwsTFmbYjDKoqSXs2l8RWNxlc0Gl/RBCQ+McaceS+llFKlQkmrPlJKKRVCmhSUUko5NCkUkojUEZHZIrJeRNaKyN/t7c+JyG4RWWn/XOr2mifs6Ts2isiAIMSYJCJ/2nEstbfFi8gvIrLJvo0LRXwi0sTtM1opIsdF5B+h/PxE5GMRSRaRNW7bCvx5iUh7+3PfLCJvioi3rtbFFd9/RGSDiKwWke9EpJK9PVFE0tw+x3dDFF+B/55Bju9Lt9iSRGSlvT0Un19+55TgfgeNMfpTiB+gBtDOvl8e+Atrao7ngEe87N8cWAVEAfWBLUB4gGNMAqrk2vYyMMK+PwL4d6jic4spHNiHNaAmZJ8f0AtoB6wpyucFLAa6Yo27mQ5cEsD4+gMR9v1/u8WX6L5fruMEM74C/z2DGV+u518FRobw88vvnBLU76CWFArJGLPXGLPcvp8CrMcakZ2fwcBEY8wpY8w2YDPWtB7BNhgYZ98fB1zhtj1U8fUFthhjtvvYJ+DxGWPmAoe9vK/fn5eI1AAqGGMWGOu/8zO31xR7fMaYn40xmfbDhVhje/IV7Ph8KBGfn4t9JX0NMMHXMQIcX37nlKB+BzUpFAMRSQTaAovsTQ/YxfmP3Yp63qbw8JVEioMBfhaRZWJNDwJQzRizF6wvIZAQwvhchuH5z1hSPj8o+OdVy74f7DgBbsO6KnSpLyIrRGSOiPS0t4UivoL8PUP1+fUE9htjNrltC9nnl+ucEtTvoCaFIhKRWOAb4B/GmOPAO8B5QBtgL1aRFPyYwiMAuhtj2mHNOnu/iPTysW8o4kOsQYqXA1/Zm0rS5+dLfvGE6nN8CsgEvrA37QXqGmPaAg8D/xORCiGIr6B/z1D9na/D88IkZJ+fl3NKvrvmE0uRYtSkUAQiEon1x/vCGPMtgDFmvzEmyxiTDXxAThVH0KfwMMbssW+Tge/sWPbbxUtXUTg5VPHZLgGWG2P227GWmM/PVtDPaxeeVTgBj1NEhgOXATfY1QXYVQqH7PvLsOqbGwc7vkL8PUPx+UUAQ4Ev3eIOyefn7ZxCkL+DmhQKya6D/AhYb4x5zW17DbfdhgCung7fA8NEJEpE6gONsBqDAhVfOREp77qP1SC5xo5juL3bcGBKKOJz43GFVlI+PzcF+rzs4n2KiHSxvyM3u72m2InIxcDjwOXGmJNu26uKtT4JItLAjm9rCOIr0N8z2PHZLgI2GGOcKpdQfH75nVMI9newOFrNS+MP0AOrSLYaWGn/XAp8Dvxpb/8eqOH2mqewrjg2Ukw9FnzE1wCrZ8IqYC3wlL29MjAL2GTfxociPvv9ygKHgIpu20L2+WElp73AaayrrdsL83kBHbBOfluAt7FnDghQfJux6pVd38F37X2vtP/uq4DlwKAQxVfgv2cw47O3fwrck2vfUHx++Z1Tgvod1GkulFJKObT6SCmllEOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSjlRkSyxHP21hFn2P8eEbm5GN43SUSqFPU4ShWVdklVyo2IpBpjYkPwvklAB2PMwWC/t1LutKSglB/sK/l/i8hi+6ehvf05EXnEvv+giKyzJ3+baG+LF5HJ9raFItLK3l5ZRH62J1x7D7f5akTkRvs9VorIe66RtUoFgyYFpTzF5Ko+utbtuePGmE5YI0Tf8PLaEUBbY0wr4B572/PACnvbk1jTGAM8C8wz1oRr3wN1AUSkGXAt1mSGbYAs4Ibi/AWV8iUi1AEoVcKk2Sdjbya43b7u5fnVwBciMhmYbG/rgTVlAsaYX+0SQkWsBV+G2tunisgRe/++QHtgiTVtDTHkTICmVMBpUlDKfyaf+y4DsU72lwPPiEgLfE9j7O0YAowzxjxRlECVKiytPlLKf9e63S5wf0JEwoA6xpjZwGNAJSAWmItd/SMifYCDxpoj3337JYBr8ZlZwFUikmA/Fy8i9QL2GymVi5YUlPIUI/bi7bYZxhhXt9QoEVmEdTF1Xa7XhQPj7aohAV43xhwVkeeAT0RkNXCSnCmQnwcmiMhyYA6wA8AYs05EnsZaMS8Ma0bP+wFfS5UqVWy0S6pSftAuo6q00OojpZRSDi0pKKWUcmhJQSmllEOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjn+H3K+6CBUpSCUAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "import pandas as pd\n",
    "\n",
    "# Plot the results as a moving average (to see trends).\n",
    "rolling_episode_rewards = pd.DataFrame(episode_rewards).rolling(100).mean()\n",
    "plt.plot(rolling_episode_rewards)\n",
    "plt.title('Episode History')\n",
    "plt.ylim([0,100])\n",
    "plt.xlabel('Episode')\n",
    "plt.ylabel('Total Episode Reward')\n",
    "plt.legend(['Rolling Average (Window=100)'])\n",
    "plt.show"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "###  ε-Greedy Policy (With optimistic initialisation)\n",
    "The experiment is then repeated with the initial entries in the Q-table set to +1. This is called optimistic initialisation, and causes the agent to explore much more before it begins exploiting."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Episode:    1 | Total Reward:  -154 | Finished Maze?: No \n",
      "Episode:    2 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:    3 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:    4 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:    5 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:    6 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:    7 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:    8 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:    9 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:   10 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:   11 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:   12 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:   13 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:   14 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:   15 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:   16 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:   17 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:   18 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:   19 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:   20 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:   21 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:   22 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:   23 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   24 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:   25 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:   26 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:   27 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:   28 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:   29 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:   30 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:   31 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:   32 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   33 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:   34 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:   35 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   36 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:   37 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:   38 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:   39 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:   40 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:   41 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:   42 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:   43 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:   44 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:   45 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   46 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   47 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:   48 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:   49 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:   50 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:   51 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:   52 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:   53 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:   54 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:   55 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:   56 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   57 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   58 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:   59 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   60 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:   61 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:   62 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:   63 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:   64 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:   65 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:   66 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:   67 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:   68 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:   69 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:   70 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:   71 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:   72 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:   73 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:   74 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:   75 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:   76 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:   77 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:   78 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   79 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:   80 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:   81 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:   82 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:   83 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:   84 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:   85 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:   86 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:   87 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:   88 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:   89 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:   90 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode:   91 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:   92 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:   93 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:   94 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:   95 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:   96 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:   97 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:   98 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:   99 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  100 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  101 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  102 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  103 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  104 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  105 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  106 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  107 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  108 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  109 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode:  110 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  111 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  112 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  113 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  114 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  115 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  116 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  117 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  118 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  119 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  120 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  121 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  122 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  123 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  124 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  125 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  126 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  127 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  128 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  129 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  130 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  131 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  132 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  133 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  134 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  135 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  136 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  137 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  138 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  139 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  140 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  141 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  142 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  143 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  144 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  145 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  146 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  147 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  148 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  149 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  150 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  151 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  152 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  153 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  154 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  155 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  156 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  157 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  158 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  159 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  160 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  161 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  162 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  163 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  164 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  165 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  166 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  167 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  168 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  169 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  170 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  171 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  172 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  173 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  174 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  175 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  176 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  177 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  178 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  179 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  180 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  181 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  182 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  183 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  184 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  185 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  186 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  187 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  188 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  189 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  190 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  191 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  192 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  193 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  194 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  195 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  196 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  197 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  198 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  199 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  200 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  201 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  202 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  203 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  204 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode:  205 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  206 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  207 | Total Reward:   -55 | Finished Maze?: No \n",
      "Episode:  208 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  209 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  210 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  211 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  212 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  213 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  214 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  215 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  216 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  217 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  218 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  219 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode:  220 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  221 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  222 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  223 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  224 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  225 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  226 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  227 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  228 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  229 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode:  230 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  231 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  232 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  233 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  234 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  235 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  236 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  237 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  238 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  239 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  240 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  241 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  242 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  243 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  244 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  245 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  246 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  247 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  248 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  249 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  250 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  251 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  252 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  253 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  254 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  255 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  256 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  257 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  258 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  259 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  260 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  261 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  262 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  263 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  264 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  265 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  266 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  267 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  268 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  269 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  270 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  271 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  272 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  273 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  274 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  275 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  276 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  277 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  278 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  279 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  280 | Total Reward:    49 | Finished Maze?: Yes\n",
      "Episode:  281 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  282 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  283 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  284 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  285 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  286 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  287 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  288 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  289 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  290 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  291 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  292 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  293 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  294 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  295 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  296 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  297 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  298 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  299 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  300 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  301 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  302 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  303 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  304 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  305 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  306 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  307 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  308 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  309 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  310 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  311 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  312 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  313 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  314 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  315 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  316 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  317 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  318 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  319 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  320 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  321 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  322 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  323 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  324 | Total Reward:   -64 | Finished Maze?: No \n",
      "Episode:  325 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  326 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  327 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  328 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  329 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  330 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode:  331 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  332 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  333 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  334 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  335 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  336 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  337 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  338 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  339 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  340 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  341 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  342 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  343 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  344 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  345 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  346 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  347 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  348 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  349 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  350 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  351 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  352 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  353 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  354 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  355 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  356 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  357 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  358 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  359 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  360 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  361 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  362 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  363 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  364 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  365 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  366 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  367 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode:  368 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  369 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  370 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  371 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  372 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  373 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  374 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  375 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  376 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  377 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  378 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  379 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  380 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  381 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  382 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  383 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  384 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  385 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  386 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  387 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  388 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  389 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  390 | Total Reward:   -58 | Finished Maze?: No \n",
      "Episode:  391 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  392 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  393 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  394 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  395 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  396 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  397 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  398 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  399 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  400 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  401 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  402 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  403 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  404 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  405 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  406 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  407 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  408 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  409 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  410 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  411 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  412 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  413 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  414 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  415 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  416 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  417 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  418 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  419 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  420 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  421 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  422 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  423 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  424 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  425 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  426 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  427 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  428 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  429 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  430 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  431 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  432 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  433 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  434 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  435 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  436 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  437 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  438 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  439 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  440 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  441 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  442 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  443 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  444 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  445 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  446 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  447 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  448 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  449 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  450 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  451 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  452 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  453 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  454 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  455 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  456 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  457 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  458 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  459 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  460 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  461 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  462 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  463 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  464 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  465 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  466 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  467 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  468 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  469 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  470 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  471 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  472 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  473 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  474 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  475 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  476 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  477 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  478 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  479 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  480 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  481 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  482 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  483 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  484 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  485 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  486 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode:  487 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  488 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  489 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  490 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  491 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  492 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  493 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  494 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  495 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  496 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  497 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  498 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  499 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  500 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  501 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  502 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  503 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  504 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  505 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  506 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  507 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  508 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  509 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  510 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  511 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  512 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  513 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  514 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  515 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  516 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  517 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  518 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  519 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  520 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  521 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  522 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  523 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  524 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  525 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  526 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  527 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  528 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  529 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode:  530 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  531 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  532 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  533 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  534 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  535 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  536 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode:  537 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  538 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  539 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  540 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  541 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  542 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  543 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  544 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  545 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  546 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  547 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  548 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  549 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  550 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  551 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  552 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  553 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  554 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  555 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  556 | Total Reward:   -55 | Finished Maze?: No \n",
      "Episode:  557 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  558 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  559 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  560 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  561 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  562 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  563 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  564 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  565 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  566 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  567 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  568 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  569 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  570 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  571 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  572 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  573 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  574 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  575 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  576 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  577 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  578 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  579 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode:  580 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  581 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  582 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  583 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  584 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  585 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  586 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  587 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  588 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode:  589 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  590 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  591 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  592 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  593 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  594 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  595 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  596 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  597 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  598 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  599 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  600 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  601 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  602 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  603 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  604 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  605 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  606 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode:  607 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  608 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  609 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  610 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  611 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  612 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  613 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  614 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  615 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  616 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  617 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  618 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  619 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  620 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  621 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  622 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  623 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  624 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  625 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  626 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode:  627 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  628 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode:  629 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  630 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  631 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  632 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  633 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  634 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  635 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  636 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  637 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  638 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  639 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  640 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  641 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  642 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  643 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  644 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  645 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  646 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  647 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  648 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  649 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  650 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  651 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  652 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  653 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  654 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  655 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  656 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  657 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  658 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  659 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  660 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  661 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  662 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  663 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  664 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  665 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  666 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  667 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  668 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  669 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  670 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  671 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  672 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  673 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  674 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  675 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  676 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  677 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  678 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  679 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  680 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  681 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  682 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  683 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  684 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  685 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  686 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  687 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  688 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  689 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  690 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  691 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  692 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  693 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  694 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  695 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  696 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  697 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  698 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  699 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  700 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  701 | Total Reward:   -27 | Finished Maze?: No \n",
      "Episode:  702 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  703 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  704 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  705 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  706 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  707 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  708 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  709 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  710 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  711 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  712 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  713 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  714 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  715 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  716 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  717 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  718 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  719 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  720 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  721 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  722 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  723 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  724 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  725 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  726 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  727 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  728 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  729 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  730 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  731 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  732 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  733 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  734 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  735 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  736 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  737 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  738 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode:  739 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  740 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  741 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  742 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  743 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  744 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  745 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  746 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode:  747 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  748 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  749 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  750 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  751 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  752 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  753 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  754 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  755 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  756 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode:  757 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  758 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  759 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  760 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode:  761 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  762 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  763 | Total Reward:   -61 | Finished Maze?: No \n",
      "Episode:  764 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  765 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  766 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  767 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode:  768 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  769 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  770 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  771 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode:  772 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode:  773 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode:  774 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode:  775 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  776 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  777 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode:  778 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  779 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  780 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  781 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  782 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  783 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  784 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode:  785 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  786 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  787 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  788 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  789 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  790 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  791 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  792 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  793 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  794 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  795 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  796 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  797 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  798 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  799 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  800 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  801 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  802 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  803 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  804 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  805 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  806 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  807 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  808 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  809 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  810 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  811 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  812 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode:  813 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  814 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  815 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  816 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  817 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  818 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  819 | Total Reward:   -29 | Finished Maze?: No \n",
      "Episode:  820 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  821 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  822 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  823 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  824 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  825 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  826 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode:  827 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  828 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  829 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  830 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  831 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  832 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  833 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  834 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  835 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode:  836 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  837 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  838 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  839 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  840 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  841 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  842 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  843 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  844 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  845 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  846 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  847 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  848 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  849 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  850 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  851 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  852 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  853 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  854 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  855 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  856 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  857 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  858 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  859 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  860 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  861 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  862 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  863 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  864 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  865 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  866 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  867 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode:  868 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  869 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  870 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode:  871 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  872 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode:  873 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  874 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  875 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode:  876 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  877 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  878 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  879 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  880 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  881 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  882 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  883 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode:  884 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  885 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  886 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode:  887 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  888 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  889 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  890 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  891 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode:  892 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  893 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode:  894 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  895 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode:  896 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  897 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  898 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode:  899 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode:  900 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode:  901 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  902 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  903 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode:  904 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  905 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  906 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  907 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  908 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  909 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  910 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  911 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  912 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode:  913 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  914 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode:  915 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  916 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  917 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  918 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  919 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  920 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  921 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  922 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  923 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  924 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  925 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  926 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  927 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode:  928 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  929 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  930 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  931 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  932 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode:  933 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  934 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode:  935 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  936 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode:  937 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode:  938 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  939 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode:  940 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  941 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  942 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  943 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  944 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode:  945 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  946 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  947 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode:  948 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  949 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  950 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  951 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  952 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode:  953 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  954 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  955 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  956 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode:  957 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  958 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  959 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode:  960 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode:  961 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode:  962 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode:  963 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  964 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode:  965 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  966 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  967 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  968 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode:  969 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode:  970 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  971 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  972 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode:  973 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  974 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  975 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode:  976 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode:  977 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode:  978 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode:  979 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode:  980 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  981 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode:  982 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode:  983 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode:  984 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode:  985 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode:  986 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode:  987 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode:  988 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  989 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode:  990 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode:  991 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode:  992 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode:  993 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode:  994 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode:  995 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode:  996 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode:  997 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode:  998 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode:  999 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1000 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1001 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1002 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1003 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1004 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1005 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1006 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1007 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1008 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1009 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1010 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1011 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1012 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1013 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1014 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1015 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1016 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1017 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1018 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1019 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1020 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1021 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1022 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1023 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1024 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1025 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1026 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1027 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1028 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1029 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1030 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1031 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1032 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1033 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1034 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1035 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1036 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1037 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1038 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1039 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1040 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1041 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1042 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1043 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1044 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1045 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1046 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1047 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1048 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1049 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1050 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1051 | Total Reward:   -56 | Finished Maze?: No \n",
      "Episode: 1052 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1053 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1054 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1055 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1056 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1057 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1058 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1059 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1060 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1061 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1062 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1063 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1064 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1065 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1066 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1067 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1068 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1069 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1070 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1071 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1072 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1073 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1074 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1075 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1076 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1077 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1078 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1079 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1080 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1081 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1082 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1083 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1084 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1085 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1086 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1087 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1088 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1089 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1090 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1091 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1092 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1093 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1094 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1095 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1096 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1097 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1098 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1099 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1100 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1101 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1102 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1103 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1104 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1105 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1106 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1107 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1108 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1109 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1110 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1111 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1112 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1113 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1114 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1115 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1116 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1117 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1118 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1119 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1120 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1121 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1122 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1123 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1124 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1125 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1126 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1127 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1128 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1129 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1130 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1131 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1132 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1133 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1134 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1135 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1136 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1137 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1138 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1139 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1140 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1141 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1142 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1143 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1144 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1145 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1146 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1147 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1148 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1149 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1150 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1151 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1152 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1153 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1154 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1155 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1156 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode: 1157 | Total Reward:   -57 | Finished Maze?: No \n",
      "Episode: 1158 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1159 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1160 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1161 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1162 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1163 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1164 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1165 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1166 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1167 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1168 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1169 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1170 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1171 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1172 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1173 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1174 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1175 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1176 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1177 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1178 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1179 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1180 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1181 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1182 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1183 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1184 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1185 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1186 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1187 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1188 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1189 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1190 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1191 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1192 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1193 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1194 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1195 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1196 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1197 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1198 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1199 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1200 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1201 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1202 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1203 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1204 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1205 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1206 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1207 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1208 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1209 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1210 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1211 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1212 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1213 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1214 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1215 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1216 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1217 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1218 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1219 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1220 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1221 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1222 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode: 1223 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1224 | Total Reward:   -59 | Finished Maze?: No \n",
      "Episode: 1225 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1226 | Total Reward:    49 | Finished Maze?: Yes\n",
      "Episode: 1227 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1228 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1229 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1230 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1231 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1232 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1233 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1234 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1235 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1236 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1237 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1238 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1239 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1240 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1241 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1242 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1243 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1244 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1245 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1246 | Total Reward:   -28 | Finished Maze?: No \n",
      "Episode: 1247 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1248 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1249 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1250 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1251 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1252 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1253 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1254 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1255 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1256 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1257 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode: 1258 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1259 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1260 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1261 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1262 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1263 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1264 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1265 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1266 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1267 | Total Reward:   -61 | Finished Maze?: No \n",
      "Episode: 1268 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1269 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1270 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1271 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1272 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1273 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1274 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1275 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1276 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1277 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1278 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1279 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode: 1280 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1281 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1282 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1283 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1284 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1285 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1286 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1287 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1288 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1289 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1290 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1291 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1292 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1293 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1294 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1295 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1296 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1297 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1298 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1299 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1300 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1301 | Total Reward:    53 | Finished Maze?: Yes\n",
      "Episode: 1302 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1303 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1304 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1305 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1306 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1307 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1308 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1309 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1310 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1311 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1312 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1313 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1314 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1315 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1316 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1317 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1318 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1319 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1320 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1321 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1322 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1323 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1324 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1325 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1326 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1327 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1328 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1329 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1330 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1331 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1332 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1333 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1334 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1335 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1336 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1337 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1338 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1339 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1340 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1341 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1342 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1343 | Total Reward:   -29 | Finished Maze?: No \n",
      "Episode: 1344 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1345 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1346 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1347 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1348 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1349 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1350 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1351 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1352 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1353 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1354 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1355 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1356 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1357 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1358 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1359 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1360 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1361 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1362 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1363 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1364 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1365 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1366 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode: 1367 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1368 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1369 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1370 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1371 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1372 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1373 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1374 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1375 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1376 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1377 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1378 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1379 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1380 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1381 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1382 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1383 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1384 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1385 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1386 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1387 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1388 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1389 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1390 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1391 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1392 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1393 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1394 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1395 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1396 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1397 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1398 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1399 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1400 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1401 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1402 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1403 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1404 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1405 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1406 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1407 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1408 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1409 | Total Reward:    56 | Finished Maze?: Yes\n",
      "Episode: 1410 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1411 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1412 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1413 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1414 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1415 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1416 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1417 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1418 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1419 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1420 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1421 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1422 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1423 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1424 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1425 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1426 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1427 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1428 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1429 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1430 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1431 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1432 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1433 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1434 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1435 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1436 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1437 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1438 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1439 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1440 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1441 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1442 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1443 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1444 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1445 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1446 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1447 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1448 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1449 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1450 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1451 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1452 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1453 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1454 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1455 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1456 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1457 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1458 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1459 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1460 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1461 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1462 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1463 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1464 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1465 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1466 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1467 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1468 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1469 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1470 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1471 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1472 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1473 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1474 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1475 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1476 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1477 | Total Reward:   -27 | Finished Maze?: No \n",
      "Episode: 1478 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1479 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1480 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1481 | Total Reward:   -54 | Finished Maze?: No \n",
      "Episode: 1482 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1483 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode: 1484 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1485 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1486 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1487 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1488 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1489 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1490 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1491 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1492 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1493 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1494 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1495 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1496 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1497 | Total Reward:   -29 | Finished Maze?: No \n",
      "Episode: 1498 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1499 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1500 | Total Reward:    52 | Finished Maze?: Yes\n",
      "Episode: 1501 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1502 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1503 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1504 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1505 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1506 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode: 1507 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1508 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1509 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1510 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1511 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1512 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1513 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1514 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1515 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1516 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1517 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1518 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1519 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1520 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode: 1521 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1522 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1523 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1524 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1525 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1526 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1527 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1528 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1529 | Total Reward:   -56 | Finished Maze?: No \n",
      "Episode: 1530 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1531 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1532 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1533 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1534 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1535 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1536 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1537 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1538 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1539 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1540 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1541 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1542 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1543 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1544 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1545 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1546 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1547 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1548 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1549 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1550 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1551 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1552 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1553 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1554 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1555 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1556 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1557 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1558 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1559 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1560 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1561 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1562 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1563 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1564 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1565 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1566 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1567 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1568 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1569 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1570 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1571 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1572 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1573 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1574 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1575 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1576 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1577 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1578 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1579 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1580 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1581 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1582 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1583 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1584 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1585 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1586 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1587 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1588 | Total Reward:   -57 | Finished Maze?: No \n",
      "Episode: 1589 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1590 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1591 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1592 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1593 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1594 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1595 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1596 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1597 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1598 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1599 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1600 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1601 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1602 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1603 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1604 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1605 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1606 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1607 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1608 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1609 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1610 | Total Reward:   -50 | Finished Maze?: No \n",
      "Episode: 1611 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1612 | Total Reward:    54 | Finished Maze?: Yes\n",
      "Episode: 1613 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1614 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1615 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1616 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1617 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1618 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1619 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1620 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1621 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1622 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1623 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1624 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1625 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1626 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1627 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1628 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1629 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1630 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1631 | Total Reward:    55 | Finished Maze?: Yes\n",
      "Episode: 1632 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1633 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1634 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1635 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1636 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1637 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1638 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1639 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1640 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode: 1641 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1642 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1643 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1644 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1645 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1646 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1647 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1648 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1649 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1650 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1651 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1652 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1653 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1654 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1655 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1656 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1657 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1658 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1659 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1660 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1661 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1662 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1663 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1664 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1665 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1666 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1667 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1668 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1669 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1670 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1671 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1672 | Total Reward:   -53 | Finished Maze?: No \n",
      "Episode: 1673 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1674 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1675 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1676 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1677 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1678 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1679 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1680 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1681 | Total Reward:    66 | Finished Maze?: Yes\n",
      "Episode: 1682 | Total Reward:    46 | Finished Maze?: Yes\n",
      "Episode: 1683 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1684 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1685 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1686 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1687 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1688 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1689 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1690 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1691 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1692 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1693 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1694 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1695 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1696 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1697 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1698 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1699 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1700 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1701 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1702 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1703 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1704 | Total Reward:    60 | Finished Maze?: Yes\n",
      "Episode: 1705 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1706 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1707 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1708 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1709 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1710 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1711 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1712 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1713 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1714 | Total Reward:   -48 | Finished Maze?: No \n",
      "Episode: 1715 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1716 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1717 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1718 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1719 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1720 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1721 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1722 | Total Reward:    65 | Finished Maze?: Yes\n",
      "Episode: 1723 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1724 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1725 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1726 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1727 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1728 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1729 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1730 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1731 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1732 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1733 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1734 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1735 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1736 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode: 1737 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1738 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1739 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1740 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1741 | Total Reward:   -47 | Finished Maze?: No \n",
      "Episode: 1742 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1743 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1744 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1745 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1746 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1747 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1748 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1749 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1750 | Total Reward:   -37 | Finished Maze?: No \n",
      "Episode: 1751 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1752 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1753 | Total Reward:    46 | Finished Maze?: Yes\n",
      "Episode: 1754 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1755 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1756 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1757 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1758 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1759 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1760 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1761 | Total Reward:   -27 | Finished Maze?: No \n",
      "Episode: 1762 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1763 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1764 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1765 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1766 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1767 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1768 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1769 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1770 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1771 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1772 | Total Reward:    69 | Finished Maze?: Yes\n",
      "Episode: 1773 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1774 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1775 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1776 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1777 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1778 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1779 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1780 | Total Reward:   -30 | Finished Maze?: No \n",
      "Episode: 1781 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1782 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1783 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1784 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1785 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1786 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1787 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1788 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1789 | Total Reward:   -28 | Finished Maze?: No \n",
      "Episode: 1790 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1791 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1792 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1793 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1794 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1795 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1796 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1797 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1798 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1799 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1800 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1801 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1802 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1803 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1804 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1805 | Total Reward:   -36 | Finished Maze?: No \n",
      "Episode: 1806 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1807 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1808 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1809 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1810 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1811 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1812 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1813 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1814 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1815 | Total Reward:    57 | Finished Maze?: Yes\n",
      "Episode: 1816 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1817 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1818 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1819 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1820 | Total Reward:   -32 | Finished Maze?: No \n",
      "Episode: 1821 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1822 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1823 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1824 | Total Reward:    79 | Finished Maze?: Yes\n",
      "Episode: 1825 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1826 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1827 | Total Reward:    47 | Finished Maze?: Yes\n",
      "Episode: 1828 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1829 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1830 | Total Reward:    72 | Finished Maze?: Yes\n",
      "Episode: 1831 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1832 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1833 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1834 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1835 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1836 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1837 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1838 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1839 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1840 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1841 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1842 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1843 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1844 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1845 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1846 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1847 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1848 | Total Reward:   -41 | Finished Maze?: No \n",
      "Episode: 1849 | Total Reward:   -43 | Finished Maze?: No \n",
      "Episode: 1850 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1851 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1852 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1853 | Total Reward:    61 | Finished Maze?: Yes\n",
      "Episode: 1854 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1855 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1856 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1857 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1858 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1859 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1860 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1861 | Total Reward:    51 | Finished Maze?: Yes\n",
      "Episode: 1862 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1863 | Total Reward:    73 | Finished Maze?: Yes\n",
      "Episode: 1864 | Total Reward:    70 | Finished Maze?: Yes\n",
      "Episode: 1865 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1866 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1867 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1868 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1869 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1870 | Total Reward:    82 | Finished Maze?: Yes\n",
      "Episode: 1871 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1872 | Total Reward:    67 | Finished Maze?: Yes\n",
      "Episode: 1873 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1874 | Total Reward:   -38 | Finished Maze?: No \n",
      "Episode: 1875 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1876 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1877 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1878 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1879 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1880 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1881 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1882 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1883 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1884 | Total Reward:    92 | Finished Maze?: Yes\n",
      "Episode: 1885 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1886 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1887 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1888 | Total Reward:   100 | Finished Maze?: Yes\n",
      "Episode: 1889 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1890 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1891 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1892 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1893 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1894 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1895 | Total Reward:   -39 | Finished Maze?: No \n",
      "Episode: 1896 | Total Reward:   -56 | Finished Maze?: No \n",
      "Episode: 1897 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1898 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1899 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1900 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1901 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1902 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1903 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1904 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1905 | Total Reward:   -34 | Finished Maze?: No \n",
      "Episode: 1906 | Total Reward:    80 | Finished Maze?: Yes\n",
      "Episode: 1907 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1908 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1909 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1910 | Total Reward:   -42 | Finished Maze?: No \n",
      "Episode: 1911 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1912 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1913 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1914 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1915 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1916 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1917 | Total Reward:   -31 | Finished Maze?: No \n",
      "Episode: 1918 | Total Reward:    62 | Finished Maze?: Yes\n",
      "Episode: 1919 | Total Reward:    59 | Finished Maze?: Yes\n",
      "Episode: 1920 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1921 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1922 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1923 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1924 | Total Reward:    76 | Finished Maze?: Yes\n",
      "Episode: 1925 | Total Reward:   -40 | Finished Maze?: No \n",
      "Episode: 1926 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1927 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1928 | Total Reward:   -57 | Finished Maze?: No \n",
      "Episode: 1929 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1930 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1931 | Total Reward:    58 | Finished Maze?: Yes\n",
      "Episode: 1932 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1933 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1934 | Total Reward:    99 | Finished Maze?: Yes\n",
      "Episode: 1935 | Total Reward:    64 | Finished Maze?: Yes\n",
      "Episode: 1936 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1937 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1938 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1939 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1940 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1941 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1942 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1943 | Total Reward:   -51 | Finished Maze?: No \n",
      "Episode: 1944 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1945 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1946 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1947 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1948 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1949 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1950 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1951 | Total Reward:    98 | Finished Maze?: Yes\n",
      "Episode: 1952 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1953 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1954 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1955 | Total Reward:    89 | Finished Maze?: Yes\n",
      "Episode: 1956 | Total Reward:    88 | Finished Maze?: Yes\n",
      "Episode: 1957 | Total Reward:    68 | Finished Maze?: Yes\n",
      "Episode: 1958 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1959 | Total Reward:   -33 | Finished Maze?: No \n",
      "Episode: 1960 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1961 | Total Reward:    63 | Finished Maze?: Yes\n",
      "Episode: 1962 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1963 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1964 | Total Reward:    77 | Finished Maze?: Yes\n",
      "Episode: 1965 | Total Reward:    83 | Finished Maze?: Yes\n",
      "Episode: 1966 | Total Reward:   -45 | Finished Maze?: No \n",
      "Episode: 1967 | Total Reward:    87 | Finished Maze?: Yes\n",
      "Episode: 1968 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1969 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1970 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1971 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1972 | Total Reward:    78 | Finished Maze?: Yes\n",
      "Episode: 1973 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1974 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1975 | Total Reward:   -49 | Finished Maze?: No \n",
      "Episode: 1976 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1977 | Total Reward:    97 | Finished Maze?: Yes\n",
      "Episode: 1978 | Total Reward:    71 | Finished Maze?: Yes\n",
      "Episode: 1979 | Total Reward:    81 | Finished Maze?: Yes\n",
      "Episode: 1980 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1981 | Total Reward:   -35 | Finished Maze?: No \n",
      "Episode: 1982 | Total Reward:    96 | Finished Maze?: Yes\n",
      "Episode: 1983 | Total Reward:   -46 | Finished Maze?: No \n",
      "Episode: 1984 | Total Reward:    93 | Finished Maze?: Yes\n",
      "Episode: 1985 | Total Reward:    86 | Finished Maze?: Yes\n",
      "Episode: 1986 | Total Reward:    91 | Finished Maze?: Yes\n",
      "Episode: 1987 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 1988 | Total Reward:   -44 | Finished Maze?: No \n",
      "Episode: 1989 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1990 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1991 | Total Reward:    85 | Finished Maze?: Yes\n",
      "Episode: 1992 | Total Reward:   -55 | Finished Maze?: No \n",
      "Episode: 1993 | Total Reward:    94 | Finished Maze?: Yes\n",
      "Episode: 1994 | Total Reward:    90 | Finished Maze?: Yes\n",
      "Episode: 1995 | Total Reward:    75 | Finished Maze?: Yes\n",
      "Episode: 1996 | Total Reward:    95 | Finished Maze?: Yes\n",
      "Episode: 1997 | Total Reward:    84 | Finished Maze?: Yes\n",
      "Episode: 1998 | Total Reward:   -52 | Finished Maze?: No \n",
      "Episode: 1999 | Total Reward:    74 | Finished Maze?: Yes\n",
      "Episode: 2000 | Total Reward:    52 | Finished Maze?: Yes\n"
     ]
    }
   ],
   "source": [
    "# Initialise lists to hold episode rewards and maze completions.\n",
    "episode_rewards_optimistic = []\n",
    "episode_finished_optimistic = []\n",
    "\n",
    "# Initialise variables for Q table, N table, epsilon, gamma and number of episodes.\n",
    "Q = np.full((100,4), 1)\n",
    "N = np.zeros((100,4))\n",
    "epsilon = 0.1\n",
    "gamma = 1\n",
    "episodes = list(range(1,2001))\n",
    "\n",
    "# For loop for each episode.\n",
    "for episode in episodes:\n",
    "    \n",
    "    # Initialise state, done, and total_episode_reward.\n",
    "    state = env.reset()\n",
    "    done = False\n",
    "    total_episode_reward = 0\n",
    "    \n",
    "    # For loop for step iteration.\n",
    "    for step in range(1000):\n",
    "        \n",
    "        # Get Q and N value at current state.\n",
    "        current_Q = states[state[0], state[1]]\n",
    "        current_N = states[state[0], state[1]]\n",
    "        \n",
    "        # The action is selected randomly between exploition and exploration.\n",
    "        \n",
    "        # Exploitation with 1-epsilon probability.\n",
    "        # This code selects the action with the highest Q value, or random if a tie.\n",
    "        if np.random.uniform(0,1) > epsilon:\n",
    "            action = int(np.random.choice(np.flatnonzero(Q[current_Q] == Q[current_Q].max())))\n",
    "        \n",
    "        # Exploration with epsilon probability.\n",
    "        # This code selects a random action.\n",
    "        else:\n",
    "            action = env.action_space.sample()\n",
    "               \n",
    "        # Get next state, reward and done from Gym model's step() function.\n",
    "        next_state, reward, done, info = env.step(action)\n",
    "        \n",
    "        # Increment N.\n",
    "        N[current_N, action] += 1\n",
    "        \n",
    "        # Increment Q according to the Bellman equation:\n",
    "        # Q(n+1) = Q(n) + (1/n)(reward-Q(n)).\n",
    "        Q[current_Q, action] += (1/N[current_N, action])*(reward - gamma*Q[current_Q, action])\n",
    "        \n",
    "        # Increment total episode reward.\n",
    "        total_episode_reward += reward\n",
    "        \n",
    "        # If we reach the end of the maze, end the episode.\n",
    "        if done:\n",
    "            break\n",
    "        \n",
    "        # Update the state variable.\n",
    "        state = next_state\n",
    "    \n",
    "    # Create a variable for calculating and displaying 'Finished maze' statistics.\n",
    "    if done:\n",
    "        finished = 'Yes'\n",
    "    else:\n",
    "        finished = 'No'\n",
    "    \n",
    "    \n",
    "    # Display end of episode results.\n",
    "    print(\n",
    "        f'Episode: {episode:4} | Total Reward: {total_episode_reward:5} | '\n",
    "        f'Finished Maze?: {finished:3}'\n",
    "    )\n",
    "    \n",
    "    # Update episode rewards and maze completions lists.\n",
    "    episode_rewards_optimistic.append(total_episode_reward)\n",
    "    episode_finished_optimistic.append(finished)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<function matplotlib.pyplot.show(close=None, block=None)>"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEWCAYAAACJ0YulAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8+yak3AAAACXBIWXMAAAsTAAALEwEAmpwYAABFXklEQVR4nO3dd3xT9frA8c/TQVvaAgXKHqVMAZGNgCwR3KK4J269br0O1KviunK9buXnug5cIKKIA1FBhgxZMmRaRtmzrJbV9f39cU5OkzYJ6UhS2uf9evWV5OTk5Gmanud8txhjUEoppQAiwh2AUkqp8kOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHJoUlAVmoj8JCLDyviYI0Tks7I8ZqHjrxCR/sE6vlL+aFJQ5Z6IpIvIERHJcvt5K5DXGmPONsaMDnaMgbJ/lzMKbbteRGa5Hhtj2hljph/nOCkiYkQkKkihqkpKv1DqRHG+MWZKuIOoKEQkyhiTG+44VPmjJQV1QrOvsmeLyJsickBEVovIQLfnp4vIzfb9FiIyw95vj4h86bZfLxFZYD+3QER6uT3XzH5dpoj8CtQuFMOpIjJHRPaLyNLSVv24lyZEpLuILBSRgyKyU0ResXebad/ut0tOPUUkQkT+JSIbRWSXiHwiItXt47hKFjeJyCbgNxH5UUTuLvTey0TkwtLEr05smhRURdADWI91sn4K+EZEanrZ71ngFyAJaAS8CWDv+yPwBlALeAX4UURq2a/7AlhkH/9ZwGmjEJGG9mufA2oCDwJfi0hyGf1urwOvG2OqAc2Bcfb2vvZtDWNMgjFmLnC9/TMASAUSgMLVbP2Ak4AzgdHANW6/yylAQ2BSGcWuTkCaFNSJ4lv7Stz1c4vbc7uA14wxOcaYL4E1wLlejpEDNAUaGGOOGmNc9fjnAmnGmE+NMbnGmDHAauB8EWkCdAOeMMYcM8bMBL53O+Y1wCRjzCRjTL4x5ldgIXBOoL8L8H9+9s0BWohIbWNMljHmDz/7Xg28YoxZb4zJAh4FrijU7jDCGHPIGHMEmAi0FJGW9nPXAl8aY7L9vIeq4DQpqBPFhcaYGm4/77s9t9V4zuy4EWjg5RgPAwLMt3v43Ghvb2C/xt1GrKvmBsA+Y8yhQs+5NAUuLXSSPw2oH+jvAtzhZ9+bgFbAarta6zw/+xb+PTZitRvWddu22XXHGHMMq+RxjYhEAFcCn/o5vqoEtKFZVQQNRUTcEkMT4LvCOxljdgC3AIjIacAUEZkJbMM6ubtrAkwGtgNJIhLvlhiaAK732gx8aoy5hSAwxqQBV9on7aHAeLtay9v0xoV/jyZALrATq7oML68bjZUIZgGH7WooVYlpSUFVBHWAe0QkWkQuxaozL1IvLiKXiojr5LgP6wSZZ+/bSkSuEpEoEbkcaAv8YIzZiFUd9LSIVLGTyfluh/0Mq5rpTBGJFJFYEenv9j6lIiLXiEiyMSYf2G9vzgN2A/lYbQcuY4D77YbxBODfWNVBPnsZ2UkgH3gZLSUoNCmoE8f3hcYpTHB7bh7QEtgDPA9cYozJ8HKMbsA8EcnCKknca4zZYO97HvBPIAOrmuk8Y8we+3VXYTVm78VqyP7EdUBjzGZgCPAY1ol6M/AQZfe/dRawwo75deAKuz3ksP27zrarrU4FPsQ6sc8ENgBHgbt9HNfdJ8DJWAlOVXKii+yoE5mIXA/cbIw5LdyxnKhE5DrgVv0MFWhJQalKTUSqYjV0vxfuWFT5ELSkICIf2gNolrttqykiv4pImn2b5PbcoyKyVkTWiMiZwYpLKWWx/892YzVEfxHmcFQ5EbTqIxHpC2QBnxhj2tvbXgT2GmNGishwIMkY84iItMVqJOuO1a1uCtDKGJMXlOCUUkp5FbSSgj3IZ2+hzUOwusBh317otn2sPThoA7AWK0EopZQKoVCPU6hrjNkOYIzZLiJ17O0NAfeRmlvsbUWIyK3ArQDx8fFd2rRpE8RwlVKq4lm0aNEeY4zXqVjKy+A18bLNa72WMeY97Eaxrl27moULFwYzLqWUqnBEpPAIfkeoex/tFJH6APbtLnv7FqCx236NsEZnKqWUCqFQJ4XvKJhhchjWhFyu7VeISIyINMMaiDQ/xLEppVSlF7TqIxEZA/QHaovIFqyRoCOBcSJyE7AJuBTAGLNCRMYBK7HmarlTex4ppVToBS0pGGOu9PHUQG8bjTHPYw3bV6rM5eTksGXLFo4ePRruUJQKmdjYWBo1akR0dHTArykvDc1KBdWWLVtITEwkJSUFEW/9GpSqWIwxZGRksGXLFpo1axbw63SaC1UpHD16lFq1amlCUJWGiFCrVq1il441KahKQxOCqmxK8p3XpKCUUsqhSUGpEImMjKRjx460b9+e888/n/379/vd//rrr2f8+PEA9O/fH9dAzXPOOee4ry2OV199ldjYWA4cOFBmxwyWI0eO0K9fP/Ly8rjooov49ttvnedat27Nc8895zy++OKL+eabb3jnnXf45JNPvBzNN/fPO1hWr15Nz549iYmJ4aWXXvJ4bvLkybRu3ZoWLVowcuRIZ/vevXsZNGgQLVu2ZNCgQezbtw+Av/76i+uvv75M4tKkoFSIxMXFsWTJEpYvX07NmjUZNWpUiY4zadIkatSoUWZxjRkzhm7dujFhwoTj7xyAvLzg9Sb/8MMPGTp0KJGRkfTq1Ys5c+YAkJGRQUJCAnPnFqwmOnfuXHr16sXtt9/OddddF7SYSqpmzZq88cYbPPjggx7b8/LyuPPOO/npp59YuXIlY8aMYeXKlQCMHDmSgQMHkpaWxsCBA52EcfLJJ7NlyxY2bdpU6rg0KSgVBj179mTr1q0ALFmyhFNPPZUOHTpw0UUXOVd/vqSkpLBnzx7S09M56aSTuOWWW2jXrh2DBw/myJEjACxYsIAOHTrQs2dPHnroIdq3b+/1WOvWrSMrK4vnnnuOMWPGAPD222/z8MMPO/t8/PHH3H23tYDbZ599Rvfu3enYsSO33XabkwASEhJ48skn6dGjB3PnzuWZZ56hW7dutG/fnltvvRXXbMy+4srLy+Ohhx6iW7dudOjQgXfffddrvJ9//jlDhgwBoHfv3k5SmDNnDueddx67d+/GGMOGDRuIi4ujXr16jBgxwrkS79+/P4888gjdu3enVatW/P7774BVArniiivo0KEDl19+ufM5gpU0Tz75ZNq3b88jjzwCwLhx43jggQcAeP3110lNTXU+z9NOC2ytojp16tCtW7ci3UXnz59PixYtSE1NpUqVKlxxxRVMnGiN8504cSLDhlnjf4cNG+ZRUjr//PMZO3ZsQO/tj3ZJVZXO09+vYOW2g2V6zLYNqvHU+e0C2jcvL4+pU6dy0003AXDdddfx5ptv0q9fP5588kmefvppXnvttYCOlZaWxpgxY3j//fe57LLL+Prrr7nmmmu44YYbeO+99+jVqxfDhw/3+foxY8Zw5ZVX0qdPH9asWcOuXbu45JJL6NmzJy+++CIAX375JY8//jirVq3iyy+/ZPbs2URHR3PHHXfw+eefc91113Ho0CHat2/PM888Y30ebdvy5JNPAnDttdfyww8/cP755/uM64MPPqB69eosWLCAY8eO0bt3bwYPHuzRlTI7O5v169eTkpICQJcuXVi+fDnZ2dnMmTOHfv36sX79elatWsXixYvp3bu31985NzeX+fPnM2nSJJ5++mmmTJnC22+/TdWqVVm2bBnLli2jc+fOAGzbto1HHnmERYsWkZSUxODBg/n222/p27cv//3vfwH4/fffqVWrFlu3bmXWrFn06dMHgPvvv59p06YVef8rrrjC799k69atNG5cMOtPo0aNmDdvHgA7d+6kfv36ANSvX59du3Y5+3Xt2pWRI0d6JPSS0KSgVIgcOXKEjh07kp6eTpcuXRg0aBAHDhxg//799OvXD7Cu/i699NKAj9msWTM6duwIWCfJ9PR09u/fT2ZmJr169QLgqquu4ocffvD6+rFjxzJhwgQiIiIYOnQoX331FXfeeSepqan88ccftGzZkjVr1tC7d29GjRrFokWL6Natm/P71KljTXQcGRnJxRdf7Bx32rRpvPjiixw+fJi9e/fSrl07+vTp4zOuX375hWXLljltKAcOHCAtLc0jKezZs8ej2iwmJoZ27drx559/8scff/Dwww+zfv165syZw+LFi533KWzo0KEenxfAzJkzueeeewDo0KEDHTp0AKySTf/+/UlOtiYUvfrqq5k5cyYXXnghWVlZZGZmsnnzZq666ipmzpzJ77//7hz/1Vdf9fu388XbGjeB9CKqU6cO27aVfso4TQqq0gn0ir6sudoUDhw4wHnnnceoUaOcqoCSiomJce5HRkZy5MgRrycVb5YtW0ZaWhqDBg0CrCvx1NRU7rzzTi6//HLGjRtHmzZtuOiiixARjDEMGzaMF154ocixYmNjiYyMBKwxIXfccQcLFy6kcePGjBgxgqNHj/qNyxjDm2++yZln+l50MS4urkif+169ejFz5kwyMzNJSkri1FNP5a233mLx4sXcfvvtXo/j+swiIyPJzc11tns78fqLuWfPnnz00Ue0bt2aPn368OGHHzJ37lxefvlloOQlhUaNGrF582bn8ZYtW2jQoAEAdevWZfv27dSvX5/t27c7SRmszz0uLs7ncQOlbQpKhVj16tV54403eOmll6hatSpJSUlO3fann37qlBpKKikpicTERP74w1qixFc985gxYxgxYgTp6emkp6ezbds2tm7dysaNGxk6dCjffvstY8aM4fLLLwdg4MCBjB8/3qmy2Lt3Lxs3Fp2B2XXirl27NllZWc7Vv7+4zjzzTN5++21ycnIA+Pvvvzl06FCR3ysvL88jMfTu3Zt3332XU045BbCu8v/44w82bdpEu3aBJ/++ffvy+eefA7B8+XKWLVsGQI8ePZgxYwZ79uwhLy+PMWPGOH+fvn378tJLL9G3b186derEtGnTiImJoXr16oBVUliyZEmRH38JAaBbt26kpaWxYcMGsrOzGTt2LBdccAEAF1xwAaNHW+uUjR492mlfcX1mvtqOikNLCkqFQadOnTjllFMYO3Yso0eP5vbbb+fw4cOkpqby0Ucflfr4H3zwAbfccgvx8fH079/fOVG5Gzt2LD/99JPHtosuuoixY8fyyCOP0LZtW1auXEn37tYiiG3btuW5555j8ODB5OfnEx0dzahRo2jatKnHMWrUqMEtt9zCySefTEpKilPd5C+um2++mfT0dDp37owxhuTkZI9GVJfBgwcza9YszjjjDMAqKaxfv55HH30UgKioKOrUqUPjxo2JiAj8mvcf//gHN9xwAx06dKBjx47O71y/fn1eeOEFBgwYgDGGc845xzkR9+nTh82bN9O3b18iIyNp3LgxxVn0a8eOHXTt2pWDBw8SERHBa6+9xsqVK6lWrRpvvfUWZ555Jnl5edx4441Oghs+fDiXXXYZH3zwAU2aNOGrr75yjjdt2jTOPffcgN/fl6Ct0RwKusiOCtSqVas46aSTwh1GyGRlZZGQkABY3Ri3b9/O66+/HuaoSh/X4sWLeeWVV/j000+DFeIJ6dixY/Tr149Zs2YRFeV5re/tuy8ii4wxXb0dS0sKSlVAP/74Iy+88AK5ubk0bdqUjz/+ONwhAaWPq1OnTgwYMIC8vDynDUPBpk2bGDlyZJGEUBJaUlCVQmUrKSjlUtySgjY0q0rjRL4AUqokSvKd16SgKoXY2FgyMjI0MahKw7WeQmxsbLFep20KqlJo1KgRW7ZsYffu3eEORamQca28VhyaFFSlEB0dXazVp5SqrLT6SCmllEOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHJoUlBKKeXQpKCUUsqhSUEppZRDk4JSSimHJgWllFIOTQpKKaUcmhSUUko5NCkopZRyaFJQSinl0KSglFLKEZakICL3i8gKEVkuImNEJFZEaorIryKSZt8mhSM2pZSqzEKeFESkIXAP0NUY0x6IBK4AhgNTjTEtgan2Y6WUUiEUruqjKCBORKKAqsA2YAgw2n5+NHBheEJTSqnKK+RJwRizFXgJ2ARsBw4YY34B6hpjttv7bAfqeHu9iNwqIgtFZKEuwq6UUmUrHNVHSVilgmZAAyBeRK4J9PXGmPeMMV2NMV2Tk5ODFaZSSlVK4ag+OgPYYIzZbYzJAb4BegE7RaQ+gH27KwyxKaVUpRaOpLAJOFVEqoqIAAOBVcB3wDB7n2HAxDDEppRSlVpUqN/QGDNPRMYDfwK5wGLgPSABGCciN2EljktDHZtSSlV2IU8KAMaYp4CnCm0+hlVqUEopFSY6olkppZRDk4JSSimHJgWllFIOTQpKKaUcmhSUUko5NCkopZRyaFJQSinl0KSglFLKoUlBKaWUw+eIZhH5HjC+njfGXBCUiJRSSoWNv2kuXrJvhwL1gM/sx1cC6UGMSSmlVJj4TArGmBkAIvKsMaav21Pfi8jMoEemlFIq5AJpU0gWkVTXAxFpBujqNkopVQEFMkvqfcB0EVlvP04Bbg1WQEoppcLHb1IQkQigOtASaGNvXm2MORbswJRSyp8PZ20gPiaSy7s1CXcoFYrfpGCMyReRu4wx44ClIYpJKaWO65kfVgJwaZfGRERImKOpOAJpU/hVRB4UkcYiUtP1E/TIlFIqAFnZueEOoUIJJCncCNwJzAQW2T8LgxmUUkoF6s+N+8jLN+w7lM2Py7ZjjM/hVSoAx21oNsY0C0UgSlUkn8xNp3+rOjSpVTXcoVRIOXn5zv3rP1oAwD/6N+ft6et48ry23HianrZKKqA1mkWkPdAWiHVtM8Z8EqyglDrRTF+zi/Q9h7i+dzMOHs3hyYkraFY7nWkP9g93aBVS5tGiVUZvT18HWG0NzZLjGdC6TqjDqhCOW30kIk8Bb9o/A4AXAZ3i4gSUvucQE5dsBWDUtLXc8slCct2uuFTJXf/RAkZ8v5IV2w4wenY6AOkZh5zndx08yiu/rCE/X6s2ysKq7QcBqBbr/br2ho8WcFjbGkokkJLCJcApwGJjzA0iUhf4X3DDUsFw3puzyDqWS/dmNfnvz2sAmLZmN4Pa1g1zZBXHuW/Mcu6n1o537j/y9TKmrdlNn1bJdEvRfhqltWTzfgB6Nq/Fzyt2et1n/oa99NfSQrEF0tB8xBiTD+SKSDVgF5B6nNeociYv35B1zLpy6vnCb872jCwdclJaOX5KW67njuTkAXDUvlWlk3Usl+hI4eXLOnJbv1QivXRJPeilikkdXyBJYaGI1ADex+p59CcwP5hBqbL3yq9rvG4f/s1frN2VFeJoKobcvHyu/t8f/N+0dc62gW0KrkzX7T7E72m7AcjJs6qNRs/ZGNogK6jMozkkxkaTEBPFo2efRL1qVnPnqKs68/oVHQGYtnoX2bn5tPrXT/Qe+Zufoyl3gfQ+usO++46ITAaqGWOWBTcsVdbSMw77fO6MV2Yw8c7enNK4RugCqgA27T3M7LUZzF6bAcDDZ7Xmjv4t2J15jJ0Hj3Lem7NYsyOLCBEWbdwHQMYhLZmVhayjuSTEFD19ndywOg1qxDLyp9VMWLyVCYutNrSt+4+Qn2/IOJSNCNROiAl1yCeMQBqaPxGRW0SkjTEmXRPCiSkj6xhJVaOdx88MaceLF3dwHg8ZNTvoMWzMOMSR7IpRfZLvVh3nkmyfaJITY2jXoBqREULWsRyPklhibDQ5efna4FxK3y7Zxqa9BRc6/Vpbc3QmxkYRFRnBm1d2KvKarOxcbvlkIV2fm8KhY1q15EsgDc0fA6cBb9qzpS4BZhpjXg9iXKqM7cnKJqlqFfYdzgHgup4pAMzbsJev/9wCwLHcPGKiIoP0/sfo99/p3H16C/45uHVQ3iMUflu9kxs/9j5285yT6zv3RYT4KpH8vTOL6Wt2AdCjWU12HjhKy8d/AuDtqztztttrVGDSdmYW2Tbi/Hbc2ieVpPgqAFSLiy6yz8EjOU4D9bsz1vHACfw9DKbjlhSMMb8BzwNPYPU66gr8I8hxqTKWeTTHa6+XxjXjnPv7DuUE7f13HDgKwLsz1h9nz/LNV0IAqFrFM6HGREeyIH2v055QK6EKa9xOaA+N10J3SfyxYS8AX9zSw9lWJSqCFLfeXq5SW5WoglPc7syCqrtfVnrvsaQCqz6aCswGLgfWAN2MMW38v0qVNweP5JIYG8W/LzqZr27v6Wy/oXczp6/3/PS9QavWcA02ys7L56PZG4LyHsF2LLdo1Vez2vGs+/c5/PnEIEQ8e8Bc1rUR++2S2T/6N6darOfVa9axXPK0GilgOXn5HM3J4+AR6zPt0jTJ575J8VX44e7TmP/YQL642Uoe9325xHm+cNWfKhBI76NlQDbQHugAtBeROP8vUeVJTl4+R3LySIyN5qoeTTxKDNXjonnDrn+9Z8xiZvy9u8zed/6GvSzfegCALfsK6n+f/n5lmb1HKGV56eLYPDmByAihpl1t4c6VEABqxVdhQJuifeYfGLekTGOsyC59Zy5tnpjM90u3ARy3qrN9w+rUqFqFk+pXA2Cj3dkiNTmeHQeO6hxJPgRSfXS/vRznRUAG8BGwP8hxqTLkOpkl+hj9meh2Bbvz4NEyeU9jDJe9O9cZMPf9su1+98/PN6zZkVmuR6GO/Gk1ADWqRpP2/Nl8dH03Xr38FJ/739C7YP6dmvFVPLqrukxcsq3sA62gXO0BMdHFa/dKKpSwT6pfjdx849FQrQoEUn10l4h8idXAfCHwIXB2cMNSZSnzOEmhelzB9rIqVh9262W0MeMQMwuVQNxLDgeP5pD62CTOfG0m75SDNoeF6Xu9DkhbumW/9fzjZxAdGcGANnU8EmphLeokOP3na8ZXISoygj+fGMTMhwbw+Dkneey7bMt+Br483SlZKd/SdmbSr1XJVwQ+p73VuO9t/iQVWPVRHPAK0MYYM9AY87Td+KxOEAePWtUYvk5gjZIKZvLcXUYjnN2Ti+ufz33U6f9+38C9YxczYfEWOoz4xdm+bnd4B9J9u3grl7wz1+nf7vLb6p38vTOLkxtWJyoykH8by8CTrNJBwxpWjWvN+Co0qVWVFnUSnH1emLSK39P2sG73IcYv2lIGv0XF4+qoANYFxx/rM4r1+hcvKeh+nRRv/R+MnpNeJrFVNIFUH/0XiAauBRCRZBHReWnLob93ZrIwfW+R7a6eFr4mD4uNjmTpk4NJrR3PuzPW88qvf5e6AdT9KuyK9/4A4KEzWxNnF/2XbN7PxCXbuP/LggX9alSNJkLKdgWtt35LY8LiwE+0c9btAXDGU+TnGyb9td3pdeSrtOXLs0PaM+WBvrSsm+ixfUCbOiQnWj1k3p253pmLyt+UGZXZgJemezweefHJxXr9ZV0bO/fb1LPaGBbaAwqVp0BnSX0EeNTeFA18Vpo3FZEaIjJeRFaLyCoR6Wmv6PariKTZt767Fqgifl6xg8GvzuSSd+Z6bF+yeT9vTE0DoHFN33P7V68a7dS9vjE1jW/+LN0Va+bRot1bj+bk8eyF7Z243C19cjBNalb1+rqSMsbw0i9/eySeQLnmKJr+9y7u+PxPZ3vhbqfHExEhtKiT6PW53s1rFdnmPrOqggNHckgZ/qMzd5TL6W2KP4njlAf68cXNPagZX4VzT66PruDpXSDl4Iuwpso+BGCM2QZ4/5YH7nVgst219RRgFTAcmGqMaQlMtR+rAN326SLnvvuka9+6VYP4SwqAx7QBW/cfKVU8v6dZV9yf3tSdS7s0AkAQLu7ckBQvC8/Ex0SSGBtFRlY2K7cdLJORz4VPJIFwFZBc1V9LNu33eD7jUHZpw3LUrRZbZNuezLI7fkXwxLfLvW73NsXF8bSok0CvFrUBq8SnbQreBZIUso3Vd8sAiEj8cfb3y55ptS/wAYAxJtsYsx8YAoy2dxuN1ahdKVz9vz9IGf5jiccIFD6BujdWFmc4/8kNqzv3D5fypLwr06oDbl0vkXrVrZNfZIQ10veTG3t47FslMoKoyAjW7Mjir60HOOeN33lrWlqp3h+sq0yXQKvDXD21XCeMjwvVOzdPTij8khK7f1ArHhzciqSq0dx8WjMu6dKIzfu0R4w71/fI3Un1q3mdFbU4UmrHsyvzmNfjB1t5n+IkkKQwTkTeBWqIyC1YV/GlWU8hFdgNfCQii0Xkf3aiqWuM2Q5g33qdCF1EbhWRhSKycPfusutTH06uCdUKX9lu3nuYp79f4feEdiQ7j5OenOyxzb0KyXXFO+GOXseN44KODZz7pa3GiRQhMTaKOomx3HxaKhd1asi19tQa7qOoJ93Th7mPng7AhW7vP2tt8RoSvTntP9Oc+8u3HiBl+I+kDP+RzYW6Im7Zd5hfVuzgwOEcJq/YAeB0V6zi1hf+63/05L9uDZalFRsdyV2nt2Txk4P513ltiYoQDmfnsbcMSyMnus17rRLrBac0YPbw0/n7ubP5/q7epT5uh0bWBdD0NaE9h+Tk5ZP62CQeKcej2QNpaH4JGA98DbQGnjDGvFGK94wCOgNvG2M6YVVLBVxVZIx5zxjT1RjTNTm55N3SyoNdmUfZ5DZ76aFCffTv+3IJH81OZ8U2390UV+046HX7iO9WAFZS6NykBp2aHL+JplXdRBY8fgapyfEcPFK6ovXsdRlOj5vqVaN59fKOVLfno3Ef+du2QTVq2VMSuM8DtLRQm0Nx5ecbj2Q6zZ5/COC9mZ7dXi8cNYdbP13Esz8WDKpLzzjEmh2Z7Mk6Ro2q0Wx44Ry6NK1ZZNRyWeqRag0q3He4YieF/YezA1pXIjs336nGfGZIOxrWiKNKVESxen/54hpd/vD4ZV47ZwRL//9OB+DLhZtD9p7F5ffTFZFIEaltjPnVGPMQ8BjQTERWleI9twBbjDHz7MfjsZLEThGpb79vfazFfMJu7a5MjxNKcYyek87stXt8Pn/XF4vp+9+Cq9nuz0/1eN7VE+WDWRt49Ju/vB7DfVDmgsfPcO5/PCedw9m5HDyaS4KfvvSFJSfGUD0u2unGWhJ/bTnA2l1ZHiWPwpY+NZgZD/X32Fa/etE69pI6XOik4z7vzcw0z6vDPXY3XFd30MSYKNbvPsR3S632mP2Hc4KaDFxcSbO0jfzhNG7BZv7cZPXq+d/v6/nKPvm9M2Odc7/jM786PdJ8eeDLJbT6lzVx4C19mlGjatER46UR79Ym4apuHfbhfB6f4P3/rKwUp60uOzc/LL3RfCYFEbkC2AssE5EZIjIAWI81cO3qkr6hMWYHsFlEXFMUDgRWAt8Bw+xtw4CJJX2PsmKMYchbs7nhowVF5r2ZuGQrn8/zv2DKU9+t4Or/zfPY9uvKndw8egFD3prF/A1Fr1BcV7cTl2xl2ZYD9v1tjJm/qUi1B3g2KhdufBv6f3PIPJJT7G6U1WKjnfllSmLrfitOfwOMqsdF07SWZ/NUgxpxTP1nP5onW9tLM7q6cPXX5/M2Ofc3ZhwmI+sY4xZsLlI1Vy02ypntdJS9eM6UB/qWOI7icLVXjHJbtOdEcjg7l4e/XsbD45eRm5fPcz+u4qHxy0gZ/iMjf1rtMQFg4d5n7n76azvfuHWQ8DY9SGnVSSxYT2HE9yv5a8sBZvy92+N7Utb+9jK7qz///GopXZ+bEqRofPNXUvgX0MUY0wC4H5gM3G2MucgY86ef1wXibuBzEVkGdAT+DYwEBolIGjDIfhxy//t9PV/YX4xvl2zlkN3g+u8fVzkNRHn5hnvHLuHxCct9Nhr5uiK45ZOFTFm1i6VbvFcJuRo67x27pMhz3k6SrpPfld2bEFclknG39eTaU5sCsHpHJuv3HCr2HC8GWLrlQInrtl1X5dW9TF98PM2TE2hvN3j/e1LJC6SuRW1u79fc6/NjF2zm4a+XOVevLo1rVuUa+/Nz8dWltKw1rRVPZIQUu9treeFq2F+7K4sW9vTghbkPTpznYwBa4fm3EmOK/z06nvhCF1Cz3Er0wZos7+FC7QjHa3D+fuk2DhzJ4dJ35rAp43DIqrn8JYVsY8xaADsJbDDGTCiLNzXGLLHbBToYYy40xuwzxmTYI6Zb2rehq+hz89yPq3hswl/k5Rs2ZRSc2EfP3cicddaX2P0qeoGXP9Sq7Qd5eHxB33hXETCQKQymrt7pc1Rr4SodYwwvTrYGPf3DPvl1b1aTe89o6UyvAP6v2L1pU886CZ7/5qzj7Ondqh2ZxEVHeu1yGYi7T28JQGkqbO76YjEAnZvUcLbVTojh+l4pJMZGOf/46RmHPfqrP3the6e3FMA713QuRRTFN6RjA5LKuKokVAJphxr48gzn/uU+qpCyjuWSWjueTvbfrlW9suvx5c41mLNj4xoe8yAV7oZcVlylo/vPaAVYPdz2H85mxHcr/CaiBen76PvfaVzyzlxShv/ItNW7SBn+Ixv2BGdMi796hToi8oDb4wT3x8aYV4ISUTnx4awNvDrlb49tH8/ZwEezN/CP/gVXn976rZ/9+u8ej1dtP8joORudxWzcfXRDN7o2TWLFtoNc8d4fvD41zZnNsU5iDLvc6sIL96t+dUoa6+0vhmvoPlgnvwl39qLnC9ZsJB0a1QjkV3Y8enYb3pu5nq37j3A4O5eYqMhidQE8cCSH+tVjiS5hg2CLOglUiYrg2yXbeP6ik4tc1RVH2wbVnPvV4qKc/ulvT7eqaN6ZYd3e2jeV4We1ISJCyMnLJ6VWVfq3rsNZ7UO7CE612NK154RTWcSdm5fPD/bkiWueO4v8/OPPhlpSs4afzv1jlzB19S6P6qxrPphH+shzS3TMnQePUj0umthCk/YZY4gQawr1lNrWOJ0BL093SuMfz0nnxUs6MOikuizauI/Z63y3Rb5sr7c+4KXpJY7TH3//te9jDVJz/RR+XKE976XqYsqqXUxdvYt33XqvBDIOYPqa3V4Twlnt6jGgtTWp2qmptYiLjnQSQlSE8NnNPWjpNkdO4Xr+I3ZvpXeu6VJkXqP61eO4c4CVvGp5mdbZHxHhxt7NiI4Uer7wG80fm8Qrv/59/BcCPyzbRtrOTBKK2Y5RWHauVbpa5qOazR/XuI2hnRrSKKkqk+/rA8CLF3egiY8BfHUSY4iwE190ZATTHxrAiAvalST0UqkeF03m0VwmLtl6/J3LmcLtOPMfH8iif53BpHv6cHWPJgEdw/0iKCYqkrggVqVVi43msXNPonuzootPeVs743gyj+bQ499Tndl03R3OziPfWPOPuabyLlw9+92Sbdz+2SJu/mShU4U96qqiJdXlW60eh64SfVnzmRTsie98/gQlmjALdIBTvNsX9aHxy3jllzUez7safLvai4AUPqHOffR0Vj97Fu9c28Vj+2ktrdGWL17SgbX/PodWdRP57q7TeP+6rgAcLFRScHVMGNTW+5D/Bwe3ZuG/zqBOCapxkqpGk5NnnHpi11QZ/qzYdoC7vljM3zuzit24Xdj/7N/5eEnXmKJrJX9oL+Lj+udrU68a6SPPpWtKTVLtRuyTG1Z3kgVQZAGccHF9d7y1KQVTTl6+zxPh8q0HuHDUbI/qiolLtpIy/Efed7tAclUf/d/VnblzQHOSE2KolRBD2wbVeP4i33MV5ebl8+BXS1m6eT9Pf7+ijH6jwDRPTmDcbQWLTj12jrV+2PCv/2LNjuI1DG+3J+37Yv4m51zy/dJtpAz/0TkHJMZGeV17A6x2jXW7rc84ISaKvq2S6dOqts/3C6SbeUmUvsNvBXLz6AVet896ZIDH42/tOfDb2iedN35by9pd1hfItaD73ae38FjhDKBbShJDOzWkfvW4IsVLgPeu7cLs4ad7TN4VVyWSQW3rEhMV4VE8z8nL58PZG6gSFeGzakdEqJ0Q4/W54+ndsuiX8Xi9J9yfL23joOvk7a2udev+I05JotvzU2j/1M+sdhuvsWXfEaIjhZtOKzpvY2rtBKIjhRt6p3iMTq6VUD7q8V2JLNSu+d88Wv9rstdOCRMWb2XJ5v0MeGm68z13Ja3nJ63iri/+ZM7aPc7KZt1SavLQmW2KdON9Zkg7buidQvrIc7n79BaA9ffdtv8o4xdtYcio2fy8IrzLZLracyYs3soNH80v1mvT7aSZnZtPzxemciQ7z2kf/GCWdaGSGBvt9wLE9flnHMomLjqCarHRzB5+Ovec3qLIdOuPn3uSt0OUWuku5yoQazxC0dGNTWtV9XqCO6tdPd65tgtz1u3hqvfnsTszmxZ1IMuu0qkeF13kn+KegS3p09J3o6+IOAO+CjuWm8/stXsYv2gLD361lA+vt66kL+7cKODfsTiaeqlmWbHtAK3q+i6yuq9Mll/KVa1c1U+ZhZLC0Zw8eo/8jYs7N+LfQ9uzJ8sqgq/ZkcnKbQd5+vuVHDiSQ1SEONVB7pLiq5D2/DnO49XPnsX0NbsZ0Lrsuz2WRAiGQxSxO/MY8+zu0at3ZBZJTO7TVP9n8hrevtqzSuOHZduddgDwPZPsdfaIdoCu9up/c9dl0KBG0ZLsr/eHphuwy4LHz8BgPKbo3pl5jPx84/V75I17r6ldmcdIzzhUpCdV9bhoqkRFcNNpzZi7LoOV2w/SuGYcxlgXM3WrxTrtlK7R9A1rxPHAYKsHv6tau1XdhBLN/xQILSnYXD2L3K185kwm39uXxNgoWtZJoLXbCdFV9eNKGJlHc0jbmemsDeDtD+ZvQZZALN96kAe/sno1vTDJqrd0711TltzbBB492ypSR0X4/7rsPVRQkinJZHTuXJ/rB7+v58DhHB76ailrd2U5paVfVu5wehiBVbX2wLilTnVXboBVgbHRkZzVvl7A//jB1rFxDef+vWMXs/3AEX5bvZN9QZz64rulBau/uS8hCjB5+XZWbCsohdWvHutRevv8Zs95rE5rUdtrKbgwV334rsyjRbpan9uhfpGpxoMtOTGGOomxHp0y8vIND361FGMMc9bt8duF9OnvVxQZ43DDR0VrHrrbyfCJ89oy6d4+TLijF7/e38/pvLJye8Fn3cvLLLqu6TlKWgMQiOOmGhGpizWOoIEx5mwRaQv0NMZ8ELSoQiw/3/DsD0XXDa5apeDj+enePkRGCM0eneSxj+uqKPNoLnPdrqjq21f8o2/szrAPrWKor0bOQLStX83jC5O2y+rvXdYjPV1ioiJ59sL29Gpei4SYKF74afVxe5ek7SqoPirtCODYaCsBpWccptvzU8jOy2f/kRyG2wkq82guv64sqGoo3Mh5fa+UUr1/uMTHRHHTac34YNYGJi7Z5izXeUmXRrx0qe+lP0tj76GCxt1Xf/2bns2tas+0nZmM+K7g/6JOYgyfzN3olArObl+PZrULBiAOP7uNz3EhhbkumvYfziky7ciZ7eqV7BcpI5ER4rQJfLN4K1ef2pSr3p9HizoJ/HJfX48LiNem/M1rU7y3t+2wk11Kraqk2x1ICjecu9oF+nspqXrrdfflrT1ZveNgUJNCICWFj4GfAdecBX8D9wUpnrCYvGIHOXnWl8C9u6m7qMgIRIQruzfxWMXJdUWddSzXo8uoq9dQv1bJbHjhHP4aMdhnA1Mg3BOCu75+GqJK69pTm9I8OcGpAy18FVmY+5w9J9Uv3ZWeiHCKfVWUbbeoZ2Qd463f1nrdv3Af+WolGDhXXnirfinuaNhAGWM8RlC799e/64vFzoktQnAGFbp6zQzt3KjEHQqqVrG6OW/ee5iNGYd56MzW9EytxTvXdOGCU3xPjxIK397hOeHegSPW77t2VxZjFhSUBowxRRLCPae3YMT5bT22fXRDd8CaPsWXhjXiinQYifRyYRVXJZJOTZKOOw1+aQSSFGobY8YB+QDGmFyg9JPdlyOuesTPb+7BI2e1YdxtPfnp3j5e931h6MkeDcGuf4r/TF7trJ4FnqN5RaTUVUeuNgSAU1MLutAFqw+3O9dVu+v3M8Z49ArKzs3nlk8WMnttBv1aJfPFzT2cATql8fktp3o8zjNFG56fsv8B3525zmMQWge3acBPNK7vint70bItB1hmrxFdllwn/XrVYmlTL9F5DHhcET9yVhtqF2qMrxYbRbxbafrK7oF1OwXrfyIv3zB2gTWivH71WMbceipntQ9vKQHg5Eae352pqwrmPtuyr2BAa+GpOoZ2bsgDg1s706S4uOb0urBTQ7/v6y0JhEMgSeGQiNSiYD2FU4EKtbq4q6vdqalWHV73ZjUD7gUSExVJlagIj/UHPrmxe6kGXHlzepu6pI88l+kP9mdMoZNlsIkIjZLiiIwQJi7ZSrNHJ9HuqZ+duujN+w47VTkptarSK8B65eOpGu05aG7p5v1FJhhMtXsQGeOZiDsFqa0lFKLs37lKlOdJIm1n2a9f7brqH3FBW2eWXmOsGWZXuZVOb+vXnPW7PUfQVouL9kgcJZnWxGVPGa0NXlZ+ub+vc8G3ML1g2U73buuu2gWXG3tbvd0KXwDGRkey+IlBzgWMLzHRnqfjwkk4VAI5cz2ANVldcxGZDSQDlwQ1qhDbuPcwzWrHl3jhjsSYKDJyrX+uqAihbzGnlSiOFLsO9+VLT3HW+A2FIR0bMGraOo/+8y/9vIYLTmngUW3Ws3nZVWdFRAjjb+9JbHQkd37xJ+t3H+Jwdh7Nasfz1Plt2bzvCH1b1ubizo2Yu24PO90GPpW2ZBZOzjQjHRpQM74K8TFRvDh5TZF2k8cm/MUX8zYVe1TrD8u2ERsVyRlt67LSbkSuUy2Wq3s0ZeRPqzmUncccL7P73nRaM491jV1VdB9d3835XhZH16ZJrNudRfuG1Y97FR1qreomMvHO3pz+8gzWuFXdxUYVnLjXuHWDdv8bxFWJZMoD/ahR1eppBDhL3frzn4s70KFRDS7s2IC/th6gR2rRhuZQOG5SMMb8KSL9sNZSEGCNMebEHIfvQ+bRHJ9dQQPhPtVFaVeECtTFXYLTFdWXwjOaAk6PGPeR1mXd39/VEPfg4NbOWskNa8R5NMwlxkaxza4CHNKxAW3qVXP+GU9EPVJrsfrZs4iNjqRXi9rk5OXbSSGXt35L47UpaUy4o7cz6rU43Sbz8o3Tayt95LlOl9429RL52x6sdfBIjkfvsV/s7qFnn1yfH+4+jfPsObFq2p0cSjqL6bjbemII3f9McTXzkuj22e1qOw4c5YmJ1kC71l56SrWoU/z5mmKjI52xNd4ankPFZ1IQkaE+nmolIhhjvglSTCGXeTS3TObyb1knwe/IzROZt55TmcdyeennNYyZX9D4luIleZQF94FmhUtIg9rWdZbNHNy2Hud2CO18RcHgXv0WHRmBCLzsNjJ+7vqCK/nMo7lUr1pQMsrPNyxI31vkSvNoTh49/l2wZocxhv9Mtro2x0VHOtU/B47k8Jfb9CLuY1Pc/w6lnYKivHQD9kVE6NOytrPeOFjVXAcO53DqC9bn2LVpEl/e1tPXIU5I/koK59u3dYBewG/24wHAdOCETgrGGN6ZsZ5+rZLJPJpTqhG4i/51Bmt2ZtKrDKtOypvCvUzuP6MVr075m7emFfQGeuSsNkGr0mpdL5EnzmvLsz+sLNKQ1zWlYLj/2eWgoTIYCo8FdK/PXrRpL6e3Kei58sGsDTw/aRWf3dTDmToFrBKt+7rVG91W/RMRpzrIfULHwu1XsdEnbgmsJJ46vx0Tl2zlptOace/YJfy0fIfH/EzbDxwttyWdkvKZFIwxNwCIyA9AW9f6yfaqaKNCE17wLN96kP9MXs2stbvZefBYqebqqZUQQ68g9hsuD9yvENNHnusxRsDltr6pQY3hptOacWPvlCJjINx7YJX3q8+y8suKHcRFR3IkJ69Id9zVdjXQtgOea3osKLSok6uDxUNnWqNlC0+/8ODgVvQsNIBKRGhdN9EZRFXRtaiTwD/t0cQPndmaGX/vdtbqgLJdLbC8CORMmOJKCLadQOn7G4bZwo3WP8hse4H4cCx7dyKJjY70aEyrGe95AkmMjQrJCdnfoLghfpb/PNHd2jfVY5CX+yJN9325xKOh1uB95O33biOXAcbbM/e6+rxXi/M8HfiaRmHyfX1CsjxpedO+YXW6NE3ySArjKljVEQSWFKaLyM/AGKxuqVcA0/y/pPwrfHUVjCX/KrIuTWvy7IXtmbc+gx+WbQ/aaNtABWNe+fLksXNOol+rZJonJzj12cdjjOH7pduoEhXBme3qFRk86Zpi3DXupXASyPMxq0NlTAguqbXjnaSw9vmzK2TJ9LgVhMaYu4B3gFOwls58zxhzd5DjCrpVhUYIn8gjYMPl2lOb8tZVnUkfeW7YpyaoDHq3qO2xKhzAQPtiZrt7VZF9Ms86lsfdYxZz26eL7Me5tKyTwA29UwD4bbU1KKtGnJUsaiXE8PoVHZ3DVLzTXek9eGZr535UCReRKu8C/a3mYDU0TwVmBy+c0MjNy+fnlTto57YqV2m6pCoVSlMe6Ofc72Ff5a/bVTCwbI/dVdh9Pq/8fMOijfuoXyOOm/t4tv24d98d0rGgGipYs3CeyE7UpVKL47hJQUQuA+ZjDVi7DJgnIif04LW9h7Mxxpr+emjnhrxy2SklXk9YqVBz7wPvGijp3qto+/4jRV6zfNsBdmUeo1vTJI+Rx+4lA5ff/tmP63ulMLRz+RpQVh5UiYrgsq6NisxvVJEEcinwONDNGLMLQESSgSnA+GAGFkyuid2aJcdz98CWYY5GqZKrmxhLZIQwb0MG53aoT36+cWbQdXfBW1YBv1ZCjLNy4Bkn1fUoGbikJieEZSnSE8WLl4S3/SzYAkkKEa6EYMvgBF+HITs3n0ZJcdSKr9jdSFXFdXqbOqzefpCk+Cp0alzDWTrSfZZTb7qlJCEizH9soLajKa8CSQqT3XofAVwOTPKzf7nXvmF1Zj1yerjDUKrEPry+m3M/Kb4Km+1kkGGvjfDWVZ08FiECa5yHa/GakqzbrSqHQHofPQS8C3TA6oH0njHmkWAHppQKTLXYaGdSQteiPDWrVuHFSzrQKCnOYz+ljieQldfigYnGmG9EpDXQWkSiK9qkeEqdqKrHRTsNza6R+d2a1aRXZAQXd25E88esgn3hwWlKeRNI28BMIEZEGmI1MN+AtRqbUqocqB4XTdaxXNbsyHRWUYu2+9BHltF6B6ryCCQpiDHmMDAUeNMYcxFQcftjKXWCaVnX6qLqPlutuy9u6cE1pzbh7PYn/uyxKvgCKU+KiPQErgZuKsbrlFIh4Jq+wjV9eGG9mteu0DP4qrIVSEnhPuBRYIIxZoWIpFIB5j5SqqIoPMNv01rBW9RdVXyBrLw2A5jh9ng9cE8wg1JKBc69V1GEeHZXVaq4/K289pox5j4R+R6KzsVrjLkgqJEppQLiPkfR6W3qeKx9oVRx+SspfGrfvhSKQJRSJeNefdSkZnCWQ1WVh7+V1xbZtzNEpArQBqvEsMYYk+3rdUqp0IqKjKB2Qgx7skq3gqBSENgsqecC64A3gLeAtSJydrADU0oF7rFz2tCmXqIuFqVKLZDLipeBAcaYtQAi0hz4EfgpmIEppQI3tHMjhnZuFO4wVAUQSJfUXa6EYFsP7PK1c6BEJFJEFovID/bjmiLyq4ik2bdJpX0PpZRSxRNIUlghIpNE5HoRGQZ8DywQkaEiMrQU730vsMrt8XBgqjGmJdYKb8NLcWyllFIlEEhSiAV2Av2A/sBuoCZwPnBeSd5URBoB5wL/c9s8BBht3x8NXFiSYyullCq5QAav3RCE930NeBhIdNtW1xiz3X7P7SLitcVMRG4FbgVo0qRJEEJTSqnKy2dJQUTGud3/T6HnfinpG4rIeVjtFItK8npjzHvGmK7GmK7JycklDUMppZQX/qqP3BcvHlToudKcjXsDF4hIOjAWOF1EPgN2ikh9APu21I3ZSimlisdfUigytUWAz/lljHnUGNPIGJMCXAH8Zoy5BvgOGGbvNgyYWNL3UEopVTL+2hSqikgnrMQRZ98X+yfOz+tKaiQwTkRuAjYBlwbhPZRSSvnhLylsB16x7+9wu+96XGrGmOnAdPt+BjCwLI6rlFKqZPzNfTQglIEopZQKv0DGKSillKokNCkopZRyaFJQSinl8LfyWmd/LzTG/Fn24SillAonf72PXvbznAFOL+NYlFJKhZn2PlJKKeUIaO0+EWkPtMWaMRUAY8wnwQpKKaVUeBw3KYjIU1hTZrcFJgFnA7MATQpKKVXBBNL76BKskcY77Gm0TwFighqVUkqpsAgkKRwxxuQDuSJSDWv20tTghqWUUiocAmlTWCgiNYD3gUVAFjA/mEEppZQKj0BWXrvDvvuOiEwGqhljlgU3LKWUUuFw3OojEZnqum+MSTfGLHPfppRSquLwN6I5FqgK1BaRJKx1FACqAQ1CEJtSSqkQ81d9dBtwH1YCcJ/S4iAwKogxKaWUChN/I5pfB14XkbuNMW+GMCallFJhEkjvo3dF5B6gr/14OvCuMSYnaFEppZQKi0CSwv8B0fYtwLXA28DNwQpKKaVUePhraI4yxuQC3Ywxp7g99ZuILA1+aEoppULNX5dU1wC1PBFp7tooIqlAXlCjUkopFRb+qo9cXVAfBKaJyHr7cQpwQzCDUkopFR7+kkKyiDxg338XiAQOYU2f3QmYFuTYlFJKhZi/pBAJJFBQYsB+DJAYtIiUUkqFjb+ksN0Y80zIIlFKKRV2/hqaxc9zSimlKiB/SWFgyKJQSilVLvhMCsaYvaEMRCmlVPgFsvKaUkqpSkKTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHKEPCmISGMRmSYiq0RkhYjca2+vKSK/ikiafZsU6tiUUqqyC0dJIRf4pzHmJOBU4E4RaQsMB6YaY1oCU+3HSimlQijkScEYs90Y86d9PxNYBTQEhgCj7d1GAxeGOjallKrswtqmICIpWNNwzwPqGmO2g5U4gDo+XnOriCwUkYW7d+8OWaxKKVUZhC0piEgC8DVwnzHmYKCvM8a8Z4zpaozpmpycHLwAlVKqEgpLUhCRaKyE8Lkx5ht7804RqW8/Xx/YFY7YlFKqMgtH7yMBPgBWGWNecXvqO2CYfX8YMDHUsSmlVGXnb5GdYOkNXAv8JSJL7G2PASOBcSJyE7AJuDQMsSmlVKUW8qRgjJmF7wV8dA0HpZQKIx3RrJRSyqFJQSmllEOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHJoUlBKKeXQpKCUUsqhSUEppZRDk4JSSimHJgWllFIOTQpKKaUcmhSUUko5NCkopZRyaFJQSinl0KSglFLKoUlBKaWUQ5OCUkophyYFpZRSDk0KSimlHJoUlFJKOTQpKKWUcmhSUEop5dCkoJRSyqFJQSmllEOTglJKKYcmBaWUUg5NCkoppRyaFJRSSjk0KSillHJoUlBKKeXQpKCUUsqhSUEppZRDk4JSSilHuUsKInKWiKwRkbUiMjzc8SilVGVSrpKCiEQCo4CzgbbAlSLSNrxRKaVU5VGukgLQHVhrjFlvjMkGxgJDwhyTUkpVGlHhDqCQhsBmt8dbgB7uO4jIrcCt9sMsEVkTothKojawJ9xB+KHxlY7GVzoaX+mUJr6mvp4ob0lBvGwzHg+MeQ94LzThlI6ILDTGdA13HL5ofKWj8ZWOxlc6wYqvvFUfbQEauz1uBGwLUyxKKVXplLeksABoKSLNRKQKcAXwXZhjUkqpSqNcVR8ZY3JF5C7gZyAS+NAYsyLMYZVGea/m0vhKR+MrHY2vdIISnxhjjr+XUkqpSqG8VR8ppZQKI00KSimlHJoUSkhEGovINBFZJSIrRORee/sIEdkqIkvsn3PcXvOoPX3HGhE5MwQxpovIX3YcC+1tNUXkVxFJs2+TwhGfiLR2+4yWiMhBEbkvnJ+fiHwoIrtEZLnbtmJ/XiLSxf7c14rIGyLirat1WcX3XxFZLSLLRGSCiNSwt6eIyBG3z/GdMMVX7L9niOP70i22dBFZYm8Px+fn65wS2u+gMUZ/SvAD1Ac62/cTgb+xpuYYATzoZf+2wFIgBmgGrAMigxxjOlC70LYXgeH2/eHAf8IVn1tMkcAOrAE1Yfv8gL5AZ2B5aT4vYD7QE2vczU/A2UGMbzAQZd//j1t8Ke77FTpOKOMr9t8zlPEVev5l4Mkwfn6+zikh/Q5qSaGEjDHbjTF/2vczgVVYI7J9GQKMNcYcM8ZsANZiTesRakOA0fb90cCFbtvDFd9AYJ0xZqOffYIenzFmJrDXy/sG/HmJSH2gmjFmrrH+Oz9xe02Zx2eM+cUYk2s//ANrbI9PoY7Pj3Lx+bnYV9KXAWP8HSPI8fk6p4T0O6hJoQyISArQCZhnb7rLLs5/6FbU8zaFh78kUhYM8IuILBJrehCAusaY7WB9CYE6YYzP5Qo8/xnLy+cHxf+8Gtr3Qx0nwI1YV4UuzURksYjMEJE+9rZwxFecv2e4Pr8+wE5jTJrbtrB9foXOKSH9DmpSKCURSQC+Bu4zxhwE3gaaAx2B7VhFUghgCo8g6G2M6Yw16+ydItLXz77hiA+xBileAHxlbypPn58/vuIJ1+f4OJALfG5v2g40McZ0Ah4AvhCRamGIr7h/z3D9na/E88IkbJ+fl3OKz119xFKqGDUplIKIRGP98T43xnwDYIzZaYzJM8bkA+9TUMUR8ik8jDHb7NtdwAQ7lp128dJVFN4VrvhsZwN/GmN22rGWm8/PVtzPawueVThBj1NEhgHnAVfb1QXYVQoZ9v1FWPXNrUIdXwn+nuH4/KKAocCXbnGH5fPzdk4hxN9BTQolZNdBfgCsMsa84ra9vttuFwGung7fAVeISIyINANaYjUGBSu+eBFJdN3HapBcbscxzN5tGDAxHPG58bhCKy+fn5tifV528T5TRE61vyPXub2mzInIWcAjwAXGmMNu25PFWp8EEUm141sfhviK9fcMdXy2M4DVxhinyiUcn5+vcwqh/g6WRat5ZfwBTsMqki0Dltg/5wCfAn/Z278D6ru95nGsK441lFGPBT/xpWL1TFgKrAAet7fXAqYCafZtzXDEZ79fVSADqO62LWyfH1Zy2g7kYF1t3VSSzwvoinXyWwe8hT1zQJDiW4tVr+z6Dr5j73ux/XdfCvwJnB+m+Ir99wxlfPb2j4HbC+0bjs/P1zklpN9BneZCKaWUQ6uPlFJKOTQpKKWUcmhSUEop5dCkoJRSyqFJQSmllEOTglJuRCRPPGdvHX6c/W8XkevK4H3TRaR2aY+jVGlpl1Sl3IhIljEmIQzvmw50NcbsCfV7K+VOSwpKBcC+kv+PiMy3f1rY20eIyIP2/XtEZKU9+dtYe1tNEfnW3vaHiHSwt9cSkV/sCdfexW2+GhG5xn6PJSLyrmtkrVKhoElBKU9xhaqPLnd77qAxpjvWCNHXvLx2ONDJGNMBuN3e9jSw2N72GNY0xgBPAbOMNeHad0ATABE5CbgcazLDjkAecHVZ/oJK+RMV7gCUKmeO2Cdjb8a43b7q5fllwOci8i3wrb3tNKwpEzDG/GaXEKpjLfgy1N7+o4jss/cfCHQBFljT1hBHwQRoSgWdJgWlAmd83Hc5F+tkfwHwhIi0w/80xt6OIcBoY8yjpQlUqZLS6iOlAne52+1c9ydEJAJobIyZBjwM1AASgJnY1T8i0h/YY6w58t23nw24Fp+ZClwiInXs52qKSNOg/UZKFaIlBaU8xYm9eLttsjHG1S01RkTmYV1MXVnodZHAZ3bVkACvGmP2i8gI4CMRWQYcpmAK5KeBMSLyJzAD2ARgjFkpIv/CWjEvAmtGzzsBf0uVKlVmtEuqUgHQLqOqstDqI6WUUg4tKSillHJoSUEppZRDk4JSSimHJgWllFIOTQpKKaUcmhSUUko5/h/oOax9nAmBkwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the results as a moving average (to see trends).\n",
    "rolling_episode_rewards_optimistic = pd.DataFrame(episode_rewards_optimistic).rolling(100).mean()\n",
    "plt.plot(rolling_episode_rewards_optimistic)\n",
    "plt.title('Episode History')\n",
    "plt.ylim([0,100])\n",
    "plt.xlabel('Episode')\n",
    "plt.ylabel('Total Episode Reward')\n",
    "plt.legend(['Rolling Average (Window=100)'])\n",
    "plt.show"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Evaluation of the method as a function of 𝜀."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Run:    1 | Epsilon: 0.00 | Average Episode Reward:   80.62 | Percentage Finished: 80.80\n",
      "Run:    2 | Epsilon: 0.05 | Average Episode Reward:   67.36 | Percentage Finished: 78.80\n",
      "Run:    3 | Epsilon: 0.10 | Average Episode Reward:   57.14 | Percentage Finished: 79.80\n",
      "Run:    4 | Epsilon: 0.15 | Average Episode Reward:   43.25 | Percentage Finished: 78.70\n",
      "Run:    5 | Epsilon: 0.20 | Average Episode Reward:   33.27 | Percentage Finished: 78.80\n",
      "Run:    6 | Epsilon: 0.25 | Average Episode Reward:   18.14 | Percentage Finished: 77.90\n",
      "Run:    7 | Epsilon: 0.30 | Average Episode Reward:    5.99 | Percentage Finished: 77.80\n",
      "Run:    8 | Epsilon: 0.35 | Average Episode Reward:  -18.15 | Percentage Finished: 70.90\n",
      "Run:    9 | Epsilon: 0.40 | Average Episode Reward:  -24.09 | Percentage Finished: 75.20\n",
      "Run:   10 | Epsilon: 0.45 | Average Episode Reward:  -48.58 | Percentage Finished: 69.90\n",
      "Run:   11 | Epsilon: 0.50 | Average Episode Reward:  -65.27 | Percentage Finished: 69.60\n",
      "Run:   12 | Epsilon: 0.55 | Average Episode Reward:  -69.29 | Percentage Finished: 73.50\n",
      "Run:   13 | Epsilon: 0.60 | Average Episode Reward: -102.13 | Percentage Finished: 66.70\n",
      "Run:   14 | Epsilon: 0.65 | Average Episode Reward: -113.86 | Percentage Finished: 67.80\n",
      "Run:   15 | Epsilon: 0.70 | Average Episode Reward: -135.65 | Percentage Finished: 65.60\n",
      "Run:   16 | Epsilon: 0.75 | Average Episode Reward: -169.28 | Percentage Finished: 60.60\n",
      "Run:   17 | Epsilon: 0.80 | Average Episode Reward: -193.16 | Percentage Finished: 60.10\n",
      "Run:   18 | Epsilon: 0.85 | Average Episode Reward: -213.40 | Percentage Finished: 58.70\n",
      "Run:   19 | Epsilon: 0.90 | Average Episode Reward: -241.31 | Percentage Finished: 55.70\n",
      "Run:   20 | Epsilon: 0.95 | Average Episode Reward: -273.04 | Percentage Finished: 51.20\n"
     ]
    }
   ],
   "source": [
    "# Initialise lists to hold average episode rewards and percentage maze completions.\n",
    "average_rewards_epsilon = []\n",
    "percentage_finished_epsilon = []\n",
    "\n",
    "# Initialise variables for epsilon, gamma and number of episodes.\n",
    "epsilon_list = np.arange(0.0, 1.00, .05)\n",
    "gamma = 1\n",
    "episodes = list(range(1,1001))\n",
    "\n",
    "# For loop for iteration over changing epsilon.\n",
    "for run, e in enumerate(epsilon_list):\n",
    "    \n",
    "    # Initialise lists to hold episode rewards and maze completions.\n",
    "    episode_rewards = []\n",
    "    episode_finished = []\n",
    "    \n",
    "    # Initialise variables for Q table and N table.\n",
    "    Q = np.zeros((100,4))\n",
    "    N = np.zeros((100,4))\n",
    "\n",
    "    # For loop for each episode.\n",
    "    for episode in episodes:\n",
    "    \n",
    "        # Initialise state, done, and total_episode_reward.\n",
    "        state = env.reset()\n",
    "        done = False\n",
    "        total_episode_reward = 0\n",
    "    \n",
    "        # For loop for step iteration.\n",
    "        for step in range(1000):\n",
    "        \n",
    "            # Get Q and N value at current state.\n",
    "            current_Q = states[state[0], state[1]]\n",
    "            current_N = states[state[0], state[1]]\n",
    "        \n",
    "            # The action is selected randomly between exploition and exploration.\n",
    "        \n",
    "            # Exploitation with 1-epsilon probability.\n",
    "            # This code selects the action with the highest Q value, or random if a tie.\n",
    "            if np.random.uniform(0,1) > e:\n",
    "                action = int(np.random.choice(np.flatnonzero(Q[current_Q] == Q[current_Q].max())))\n",
    "        \n",
    "            # Exploration with epsilon probability.\n",
    "            # This code selects a random action.\n",
    "            else:\n",
    "                action = env.action_space.sample()\n",
    "        \n",
    "            # Get next state, reward and done from Gym model's step() function.\n",
    "            next_state, reward, done, info = env.step(action)\n",
    "        \n",
    "            # Increment N.\n",
    "            N[current_N, action] += 1\n",
    "        \n",
    "            # Increment Q according to the Bellman equation:\n",
    "            # Q(n+1) = Q(n) + (1/n)(reward-Q(n)).\n",
    "            Q[current_Q, action] += (1/N[current_N, action])*(reward - gamma*Q[current_Q, action])\n",
    "        \n",
    "            # Increment total episode reward.\n",
    "            total_episode_reward += reward\n",
    "        \n",
    "            # If we reach the end of the maze, end the episode.\n",
    "            if done:\n",
    "                break\n",
    "            \n",
    "            # Update the state variable.\n",
    "            state = next_state\n",
    "    \n",
    "        # Create a variable for calculating and displaying 'Finished maze' statistics.\n",
    "        if done:\n",
    "            finished = 'Yes'\n",
    "        else:\n",
    "            finished = 'No'\n",
    "        \n",
    "        # Update episode rewards and maze completions lists.\n",
    "        episode_rewards.append(total_episode_reward)\n",
    "        episode_finished.append(finished)\n",
    "        \n",
    "    # Calculate average episode reward and percentage maze completions per episode.\n",
    "    episode_average_reward = np.sum(episode_rewards)/len(episodes)       \n",
    "    episode_finished_percentage = np.count_nonzero(np.array(episode_finished) == 'Yes')*100/len(episodes)\n",
    "    \n",
    "    # Update average episode rewards and percentage maze completions list.\n",
    "    average_rewards_epsilon.append(episode_average_reward)\n",
    "    percentage_finished_epsilon.append(episode_finished_percentage)\n",
    "\n",
    "    # Display end of run results.\n",
    "    print(\n",
    "        f'Run: {run+1:4} | Epsilon: {e:4.2f} | Average Episode Reward: {episode_average_reward:7.2f} | '\n",
    "        f'Percentage Finished: {episode_finished_percentage:5.2f}'\n",
    "    )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<function matplotlib.pyplot.show(close=None, block=None)>"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY0AAAEWCAYAAACaBstRAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8+yak3AAAACXBIWXMAAAsTAAALEwEAmpwYAAAv0ElEQVR4nO3dd3xW9d3/8dcng7ACQQgj7CkiMsMQF1q3FXDbigtbSp1t7/uuWqu1/fVurda7boE6APdAQa1bUQRRAWXLCDsM2RAgQEg+vz+uQxsxCQeSKyfj/Xw8ziPXdc413kd55JNzvsvcHRERkTASog4gIiKVh4qGiIiEpqIhIiKhqWiIiEhoKhoiIhKaioaIiISmoiESMTPbaWbtos4hEoaKhlQ7ZrbCzHKDX9brzWyMmdWN03e5mXU4aN/dZvbsgefuXtfdlx3icwaaWXY8MoocDhUNqa7Od/e6QA+gJ3B7tHHiy8ySos4gVYOKhlRr7r4eeI9Y8SjyL/rgyuT04PHdZvaymY0zsxwzm29mmaXJUPhqxMzONbMFwWevMbP/NrM6wDtARnB1tNPMMswsxcweMLO1wfaAmaUUPg8zu9XM1gNPm9k8Mzu/0Pcmm9kmM+tRmvxSvahoSLVmZi2Ac4Csw3jbIOBFIA14A3ikDCM9CfzC3VOBrsDH7r4ryLg2uJVV193XAncA/YkVvO5AX+D3hT6rKXAU0BoYDowDhhY6fi6wzt1nlWF+qeJUNKS6mmBmOcBqYAPwh8N47xR3f9vd84FniP3CLsnXZrbtwAbcVsJr84AuZlbP3be6+9clvPYK4E/uvsHdNwJ/BK4sdLwA+IO773X3XOBZ4FwzqxccvzLILxKaioZUV0OCv+YHAp2BRofx3vWFHu8Gah6izaCXu6cd2IB7SnjtRcSuAFaa2admdnwJr80AVhZ6vjLYd8BGd99z4ElwdTIVuMjM0ohdvTxXwueL/ICKhlRr7v4pMAb4e7BrF1D7wHEzSwTSyzHPdHcfDDQGJgAvHzhUxMvXErv1dECrYN+/P66I94wldovqEmCau68pbWapXlQ0ROAB4IygQXgxsSuH88wsmVgbQUp5hDCzGmZ2hZnVd/c8YAeQHxz+DmhoZvULveUF4Pdmlm5mjYC7iN2CKskEoBdwC7E2DpHDoqIh1V7QHjAOuNPdtwPXA08Aa4hdeZTn+IgrgRVmtgMYQdBw7e4LiRWJZUHbSAbwZ2AGMAeYC3wd7CtW0LYxHmgLvBavk5Cqy7QIk0j1YmZ3AZ3cfeghXyxyEA34EalGzOwo4Dq+38tKJDTdnhKpJszs58S6GL/j7pOjziOVk25PiYhIaLrSEBGR0Kp8m0ajRo28TZs2UccQEalUZs6cucndfzBGqcoXjTZt2jBjxoyoY4iIVCpmtrKo/bo9JSIioaloiIhIaCoaIiISmoqGiIiEpqIhIiKhqWiIiEhoKhoiIhKaikYxxkxdzrvz1lNQoGlWREQOqPKD+45EfoHzwlerWfRdDu0a1WH4ye24oFdzUpISo44mIhIpXWkUITHB+NfNJ/LwT3pSq0Yit702lxP/NonHP1nKjj15UccTEYlMlZ/lNjMz00szjYi7MzVrM6MmL+WzJZuom5LEFf1ace0JbWlav2YZJhURqTjMbKa7Z/5gv4pGePPWbGfU5GX8a85aEhOMC3o2Z/jJ7ejQOLVMPl9EpKJQ0ShDqzbv5okpy3h5xmr25BVwRpcmjDilHb1bH1Wm3yMiEhUVjTjYvHMvY6etZNy0FWzbnUdm6waMOKU9p3VuTEKCxeU7RUTKg4pGHO3et5+Xpq/mic+Ws2ZbLh0b12X4ye0Y3KM5NZLU10BEKh8VjXKQl1/Av+asY+SnS1m4PocGtZM5r1szhvRoTu/WDTDT1YeIVA4qGuXI3flsySZemZnNBwvWsyevgBYNajGkR3OG9MxQw7mIVHgqGhHZuXc/781bz4RZa5iatYkCh2Mz6jGkR3MG9cigST112xWRikdFowLYkLOHt2avY8KsNczJ3o4ZDGjfkME9mnN216bUq5kcdUQREUBFI+oYP7B0404mzlrLxFlrWLl5NylJCZx+TBMG98hg4NGN1YAuIpFS0aig3J1Zq7cx4Zs1vDVnHZt37aN+rVgD+uV9WtKtRVrUEUWkGlLRqATy8guYkrWJCd+s4f3535Gbl8/JndK56bQO9GmjgYMiUn4qXdEwsxVADpAP7Hf3TDM7CngJaAOsAC51960lfU5lKhqF5ezJ47kvV/HEZ8vYtHMf/doexU2ndeSEDg3VdVdE4q6yFo1Md99UaN+9wBZ3v8fMbgMauPutJX1OZS0aB+Tuy+fF6asY9eky1u/YQ4+Wadx0WgdO69xYxUNE4qaqFI1FwEB3X2dmzYBP3P3okj6nsheNA/buz2f8zDU89kkW2Vtz6dKsHjed1oGzjm2qKUtEpMxVxqKxHNgKODDK3Ueb2TZ3Tyv0mq3u3qCI9w4HhgO0atWq98qVK8spdfzl5RcwcdZaHpuUxbJNu+jQuC43ntqBH3drRlKielyJSNmojEUjw93Xmllj4APgJuCNMEWjsKpypXGw/ALn7bnreOTjLBZ9l0PrhrW5fmB7LujZQt11RaTUiisaFfa3i7uvDX5uAF4H+gLfBbelCH5uiC5htBITjPO7Z/DOLScx+sre1K+VzK3j5zLwvkmMm7aCPXn5UUcUkSqoQhYNM6tjZqkHHgNnAvOAN4Crg5ddDUyMJmHFkZBgnHlsUybecAJjh/UlI60Wd02cz0n3TuKhj5awcvOuqCOKSBVSIW9PmVk7YlcXAEnA8+7+v2bWEHgZaAWsAi5x9y0lfVZVvT1VHHfny+VbeHRSFp8tifUh6N4yjUHdMzi/WzMaa64rEQmh0rVplJXqVjQKW7Mtl7dmr+WN2WuZv3YHZtC/bUMG9cjgnK5NSatdI+qIIlJBqWhUc1kbdvJmUECWb9pFcqJxSqd0zu+ewRldmlC7RlLUEUWkAlHRECB2+2remh28MXsNb85ex/ode6iVnMjpXZowqHsGp3RKV+8rEVHRkB8qKHC+WrGFN2av5Z2569i6O4/6tZI5p2tTBnXPoF+7hiRq4KBItaSiISXKyy9gypJNvDF7Le/PX8+uffm0aVibX5/RifO7ZWjUuUg1o6IhoeXuy+eDb7/jsUlZLFyfwzHN6vHbs45m4NHpmu9KpJqodIP7JDq1aiQyqHsGb998Eg9c1oNde/dz7ZjpXDpqGtNXlNjDWUSqOBUNKVZCgjGkZ3M+/M0p/L8hXVmxeTeXjJzGtU9/xfy126OOJyIR0O0pCS13Xz5jPl/ByE+Xsj03j/O7Z/CbMzrRtlGdqKOJSBlTm4aUme25eYyevJSnpqxgX34Bl2a25JYfdaRpfY02F6kqVDSkzG3I2cOjH2fx/FerSDDj6gFt+OUp7WlQRyPNRSo7FQ2Jm9VbdvOPDxfz+jdrqFsjieEnt2PYiW2pk6JR5iKVlYqGxN3i73L4+3uLeH/BdzSsU4NfnNKOyzJbUb92ctTRROQwqWhIuflm1Vb+/v4ipmZtpmZyAhf0bM7VA9rQuWm9qKOJSEgqGlLu5q/dzrjPVzJh1hr27i+gX9ujuHpAG87s0kRL04pUcCoaEpltu/fx0vTVPPPFSrK35tKsfk2G9m/N5X1a0rBuStTxRKQIKhoSufwC5+OFGxj7+QqmZG2iRmICP+7ejGsGtKFbi7So44lIIcUVDXVvkXKTmGCc0aUJZ3RpQtaGHMZNW8n4mdm89vUaerRM45oBbTjnuKakJCVGHVVEilHslYaZPQwUexni7jfHK1RZ0pVGxZazJ4/xM7MZN20lyzbtolHdFH7atyVX9G9NEy1NKxKZI5mwcAYwE6gJ9AKWBFsPID8OGaUaSq2ZzDUntOXD35zCuGF96d6iPg9PyuKEez7mjtfnsne//qmJVCTF3p5y97EAZnYNcKq75wXPRwLvl0u6IpjZ2cCDQCLwhLvfE1UWKTsJCcbJndI5uVM6qzbv5skpyxg7bSWLv8th1JWZHKVR5iIVQph+jxlAaqHndYN95c7MEoFHgXOALsBPzKxLFFkkflo1rM0fB3fl4Z/0ZE72dgY/OoUl3+VEHUtECFc07gG+MbMxZjYG+Br4S1xTFa8vkOXuy9x9H/AiMDiiLBJn53fP4MXh/cndV8CFj33Op4s3Rh1JpNorsWiYWQKwCOgHvB5sxx+4dRWB5sDqQs+zg33fY2bDzWyGmc3YuFG/aCqznq0aMPHGE2jeoBbDxkxn3LQVUUcSqdZKLBruXgDc7+7r3X1isK0vp2xFKWqt0R/08HL30e6e6e6Z6enp5RBL4ql5Wi1e/eUATj06nbsmzucPE+exP78g6lgi1VKY21Pvm9lFVjEWh84GWhZ63gJYG1EWKUd1U5IYdWUmPz+pLWOnrWTY2Bns2JMXdSyRaidM0fgN8Aqw18x2mFmOme2Ic67iTAc6mllbM6sBXA68EVEWKWeJCcYd53XhnguP4/OsTVz02Oes2rw76lgi1cohi4a7p7p7grvXcPd6wfNIpit19/3AjcB7wLfAy+4+P4osEp3L+7Zi3HV92ZCzlyGPTWX6ii1RRxKpNkLNPWVmDYCOxAb6AeDuk+OYq8xoRHjVtXzTLq4bM53srbn89cLjuKh3i6gjiVQZRzIi/MAbfwZMJvbX/R+Dn3eXdUCRw9W2UR1ev/4EMts04L9emc297y6koKBqT8ApErUwbRq3AH2Ale5+KtATUD9WqRDq105m7LC+/KRvKx77ZCnXP/c1u/ftjzqWSJUVpmjscfc9AGaW4u4LgaPjG0skvOTEBP5yQVd+f94xvLdgPZeOmsb67XuijiVSJYUpGtlmlgZMAD4ws4mom6tUMGbGz05qxxNXZbJ84y4GPzqFyYs3sidPEx6KlKXDWoTJzE4B6gPvBtN4VHhqCK9+vl23g5+NncGabbkkJhidmqTSvUV9urVIo3vL+nRqkkqylpsVKdERr9xnZn8CPgM+d/ddccoXNyoa1VPOnjymLd3MnOztzM7expzs7WzPjQ0GTElK4NiMev8uIt1apNG2YR0SEirC+FWRiqE0RWMYcCJwPJBDrIBMdveJ8Qha1lQ0BMDdWbVlN7NWxwrInOxtzFuzg9zg9lVqzSSOa16f7i3T/n1V0qx+TSrGRAgi5a/Ua4SbWVPgUuC/gQbunnqIt1QIKhpSnP35BWRt3Mmc1f+5Gvl23Q72B912u7dMY9TQ3jStrxUEpfopzZXGE8TWrviO2FXGFODrYHR2haeiIYdjT14+367bwcyVW/nHB4tJrZnMk9dkcmxG/aijiZSrIx7cBzQktkreNmALsKmyFAyRw1UzOZGerRrws5Pa8cqIAZjBJSOn8dG330UdTaRCCDP31AXu3g+4F0gDJplZdryDiUStS0Y9Jt5wAu3T6/LzcTN4aspyDqe3oUhVVOwa4QeY2Y+Bk4CTgQbAx8RuU4lUeY3r1eSlX/TnVy/O4k9vLWDF5l3c9eMuJKnLrlRThywaxNbjngw86O4a1CfVTu0aSYwc2pt73l3I6MnLWLVlNw//pCepNZOjjiZS7sLcnroB+IJYYzhmVsvMKkXPKZGykpBg/O7cY/jfC7ry2ZJNXDJyGmu25UYdS6TchZnl9ufAq8CoYFcLYlOKiFQ7V/RrzdPX9GHN1lyGPDqVOdnboo4kUq7C3Ji9ATgB2AHg7kuAxvEMJVKRndwpnfHXD6BGYgKXjprGu/PWRx1JpNyEKRp7C88zZWZJgLqQSLXWqUkqE244gc5N6/HL52YyevJS9aySaiFM0fjUzH4H1DKzM4itF/5mfGOJVHzpqSm8OLw/53Ztxl/eXsjvXp9HXn5B1LFE4ipM0biN2KJLc4FfAG+7+x1xTSVSSdRMTuThn/Tk+oHteeGrVVz79PR/T4woUhWF6T1V4O7/dPdL3P1iYKWZfRCvQGZ2t5mtMbNZwXZuoWO3m1mWmS0ys7PilUHkcCQkGL89uzP3XtSNL5Zt5uLHP2f1lt1RxxKJi2KLhpmdZmaLzWynmT1rZl3MbAbwV+DxOOf6h7v3CLa3gzxdgMuBY4GzgcfMLDHOOURCu7RPS8Zd15fvduxhyKNTmblyS9SRRMpcSVca9wPDic099SqxsRrPuHtvd3+tPMIdZDDworvvdfflQBbQN4IcIsUa0L4Rr11/AnVSkrh45DR+9/pctuyqFOuViYRSUtFwd/8k+CU9Adjo7g+WU64bzWyOmT1lZg2Cfc2B1YVekx3s+wEzG25mM8xsxsaNG+OdVeR7OjSuy5s3nci1A9ry0vTVDLxvEk9PXa5GcqkSSioaaWZ24YENsIOeHzEz+9DM5hWxDSZ266s90ANYR+yKB6Co1XCK7OPo7qPdPdPdM9PT00sTVeSI1K+VzF3nd+HdW06ie8s0/vjmAs598DOmLNkUdTSRUilp7qlPgfOLee7AEd+icvfTw7zOzP4JvBU8zQZaFjrcAtBcWFKhdWySyrhhfflgwXf8+V/fMvTJLzmzSxN+f14XWjWsHXU8kcMWeuW+8mJmzdx9XfD410A/d7/czI4FnifWjpEBfAR0dPf8kj5PizBJRbEnL58npyzn0UlZ7C9wfn5SW64f2IE6KWHmDRUpX8UtwlQR/7Xea2Y9iF3NrCA2NgR3n29mLwMLgP3ADYcqGCIVSc3kRG44tQMX9WrB395dyKOTljJ+5hpuO6czg3tkaD1yqRQq3JVGWdOVhlRUM1du4e43FjB3zXYyWzfg7kHH0rW5lpWViqE0y72KSBz0bn0UE284gb9ddBzLN+3i/EemcNv4OWzauTfqaCLFCjM1em0zuzNolMbMOgar+YlIKSUkGJf1acWk/xnIdSe05dWZ2Zz690944rNl6qIrFdIhb0+Z2UvATOAqd+9qZrWAae7eoxzylZpuT0llkrVhJ396awGTF2+kfq1k2qXXofVRtWndsA5tGgU/G9ahQe1ktYFIXJWmIby9u19mZj8BcPdc079Wkbjo0LguY6/tw6RFG/hgwQZWbdnF9BVbmTh7LYX/vkutmUSbhnVo3bD2f342iv1Mr5uigiJxE6Zo7AuuLhzAzNoDuukqEidmxmmdm3Ba5yb/3rd3fz6rt+SycvMuVmze/e+fc9ds551568kv+E9FqV0jkdYN6zDw6HT+58yjSUhQAZGyE6Zo/AF4F2hpZs8RW8XvmniGEpHvS0lKpEPjunRoXPcHx/LyC1izNZcVm3excvNuVmzexaL1OTz+yVLc4bZzOkeQWKqqQxYNd//AzL4G+hObyuMWd9dcCCIVRHJiAm0a1aFNozr/3ufu3DFhHiM/XUqLBrUY2r91hAmlKim2aJhZr4N2rQt+tjKzVu7+dfxiiUhpmBl/GnQs67blctfEeWSk1fze7S6RI1Vs7ykzmxQ8rAlkArOJXWl0A7509xPLJWEpqfeUVGe79u7nstHTWLZxFy8NP57jWmjwoIRz2IP73P1Udz8VWAn0CmaN7Q30JLaWhYhUcHVSknjq6j40qF2DYWOnk71VKwpK6YQZEd7Z3eceeOLu84hNWy4ilUDjejV5+to+7MnL1xrmUmphisa3ZvaEmQ00s1OCkeHfxjuYiJSdTk1SGXVlb1Zs3sUvnpnB3v2a61OOTJiicS0wH7gF+BWxWWavjWMmEYmDAe0bce/F3fhi2RZuGz+Xqj5ZqcRHmC63e8zsUeBDYgP8Frm7rm9FKqELerYge0su93+wmBYNavFfZx4ddSSpZA5ZNMxsIDCW2NoWRmyQ39XuPjmuyUQkLm48rQPZW3N5+OMsmqfV4vK+raKOJJVImBHh9wNnuvsiADPrBLwA9I5nMBGJDzPjzxd0Zd2OPdwxYR7N0mpxSqf0qGNJJRGmTSP5QMEAcPfFQHL8IolIvCUnJvDoT3vSqUkq1z87k/lrt0cdSSqJMEVjhpk9GfSeGmhmTxCbKl1EKrHUmsk8fU0f6tVKZtiY6azdlht1JKkEwhSNXxLrPXUzsR5U84ER8QwlIuWjaf3YGI7de/MZNmY6O/aoj4uU7JBFw933uvv/ufuFwHXAR+5eqqnRzewSM5tvZgVmlnnQsdvNLMvMFpnZWYX29zazucGxh7Smh0jZ6Ny0Ho8P7U3Whp1c/+zXWjFQShRmuddPzKyemR0FzAKeNrP/K+X3zgMuBL7XA8vMugCXA8cCZwOPmVlicPhxYDjQMdjOLmUGEQmc2LERf73wOKZkbeL21zSGQ4oX5vZUfXffQeyX/NPB/FOnl+ZL3f3bwo3rhQwGXgyubpYTm+Oqr5k1A+q5+zSP/WseBwwpTQYR+b5LMltyy4868urMbB78aEnUcaSCCtPlNin4pX0pcEec8zQHvij0PDvYlxc8Pnh/kcxsOLGrElq1Uh90kbB+dXpHsrfm8sCHS2hYN4Ur+rbSyn/yPWGuNP4EvAdkuft0M2sHHPLPEDP70MzmFbENLultRezzEvYXyd1HB7PyZqanq/+5SFhmxl8vPI4TOzTizgnzGPj3Txj56VI279QKzxITZhqRV4BXCj1fBlwU4n1HcgsrG2hZ6HkLYG2wv0UR+0WkjNVISuCpa/rw7vz1PPfFSu55ZyH/9/5izjmuKUP7tyazdQPUD6X6Kmnlvt+6+71m9jBF/FXv7jfHIc8bwPNBQ3sGsQbvr9w938xyzKw/8CVwFfBwHL5fRIgVjkHdMxjUPYMl3+Xw3JerGD8zm4mz1nJ0k1SG9m/FkJ7NSa2pcb7VTUkr953v7m+a2dVFHXf3sUf8pWYXEPulnw5sA2a5+1nBsTuAYcB+4Ffu/k6wPxMYA9QC3gFu8hBdPLRyn0jZ2L1vP2/MWsuzX65k3pod1K6RyOAezRnavxXHZmhFwKqmuJX7ii0aRXxAPcDdPaesw8WTioZI2Zu9ehvPfrGSN2avZe/+Anq2SmNov9ac160ZNZMTD/0BUuEdcdEI/sJ/Gkgl1iC9DRjm7pViKhEVDZH42b47j/FfZ/PslytZtnEXabWTubhXC67o35q2jepEHU9KoTRFYw5wg7t/Fjw/EXjM3bvFJWkZU9EQiT93Z9qyzTz3xSrem7+e/QXO6cc05q8XdiM9NSXqeHIEiisaYcZp5BwoGADuPsXMKtUtKhGJLzNjQPtGDGjfiA079vDCV6t57JMsznvoMx7+SU/6tWsYdUQpI2HGaXxlZqMKrRH+GPCJmfUys17xDigilUvjejW55fSOTLjhBOqkJPHTJ77k8U+WUlCgqUmqgjC3pyaVcNjd/bSyjVS2dHtKJDo5e/K4bfxc/jV3HT/q3Jj7L+1OWu0aUceSEErde6qyUtEQiZa7M27aSv78rwU0Tq3Jo1f0okfLtKhjySEUVzSKvT1lZg8UenzLQcfGlGU4Eam6zIyrB7ThlREDALhk5OeMmbpcM+lWUiW1aZxc6PHBA/wqRc8pEak4erRM4183n8jJHdO5+80F3Pj8N+Ro0adKp6SiYcU8FhE5Imm1a/DPqzK57ZzOvDt/PYMemcq363ZEHUsOQ0lFI8HMGphZw0KPjwoWY9KQTxE5IgkJxohT2vP8z/qxa+9+hjw6lZenr446loRUUtGoD8wEZgD1gK+D5zOJjQ4XETli/do15O1bTiKzTQN+O34O//3KbHL35UcdSw6h2MF97t6mHHOISDXUqG4K44b148GPlvDwx0uYm72dx4b2on163aijSTHCDO4TEYmbxATjN2d0Yuy1fdm4cy+DHp7Cm7O1XE5FpaIhIhXCyZ3S+dfNJ9K5WT1ueuEb/vjmfHXLrYBUNESkwmhWvxYvDu/PNQPa8PTUFTz0UVbUkeQgYSYsPDCzbUd3f9rM0oG67r48vtFEpDpKTkzgD+d3YceePP7x4WLaNKrN4B7No44lgUNeaZjZH4BbgduDXcnAs/EMJSLVm5nx1wuPo2/bo/ifV+YwY8WWqCNJIMztqQuAQcAuAHdfi7rcikicpSQlMmpobzLSajL8mZms2rw76khCuKKxL1iL2wHMTMtxiUi5aFCnBk9d04cCd64d8xXbczXtSNTCFI2XzWwUkGZmPwc+BP5Zmi81s0vMbL6ZFQTLyR7Y38bMcs1sVrCNLHSst5nNNbMsM3vIzDS1iUg10C69LiOH9mbVlt1c/9xM8vILoo5UrR2yaLj734FXgfHA0cBd7v5wKb93HnAhMLmIY0vdvUewjSi0/3FgONAx2M4uZQYRqST6t2vIXy/sxtSszdw5YZ664kYoVO8pd/8A+KCsvtTdv4VYY1cYZtYMqOfu04Ln44AhwDtllUlEKraLe7dgxaZdPDIpi3bpdRh+cvuoI1VLYXpP5ZjZjoO21Wb2upm1i0Omtmb2jZl9amYnBfuaA9mFXpMd7Csu83Azm2FmMzZu3BiHiCIShd+c0YnzujXjr+8s5N1566OOUy2FudL4P2At8DyxKdIvB5oCi4CngIFFvcnMPgxed7A73H1iMd+1Dmjl7pvNrDcwwcyOpeip2Yu9PnX30cBoiK3cV9zrRKRySUgw7r+kO2u25vKrl77h5bTj6dYiLepY1UqYhvCz3X2Uu+e4+47gF/K57v4S0KC4N7n76e7etYituIKBu+91983B45nAUqATsSuLFoVe2oJYIRORaqZmciL/vCqThnVSuG7sDNZuy406UrUSpmgUmNmlZpYQbJcWOlamf8WbWbqZJQaP2xFr8F7m7uuAHDPrH/SaugootviISNWWnprC09f2Yc++fIaNmc7OvfujjlRthCkaVwBXAhuA74LHQ82sFnDjkXypmV1gZtnA8cC/zOy94NDJwBwzm02sx9YIdz8wFPSXwBNAFrErEDWCi1RjnZqk8sgVvViyYSc3Pf81+9UVt1xYVe+6lpmZ6TNmzIg6hojEyTNfrOTOCfO4ZkAb7h50bNRxqgwzm+numQfvP2RDuJnVBK4DjgVqHtjv7sPKNKGIyBG4sn9rVmzaxZNTltO2UR2uHtAm6khVWpjbU88Q6wV1FvApsUbonHiGEhE5HL879xhOP6YJf3xzPpMWbog6TpUWpmh0cPc7gV3uPhY4DzguvrFERMJLTDAevLwHxzSrx43Pf82363ZEHanKClM0DswQts3MugL1gTZxSyQicgTqpCTx5NV9qFszievGTGdDzp6oI1VJYYrGaDNrAPweeANYAPwtrqlERI5A0/o1efLqPmzdnce1T6twxEOJRcPMEoAd7r7V3Se7ezt3b+zuo8opn4jIYenavD6PDe3Fso27GPLIVOav3R51pCqlxKLh7gUc4VgMEZGonHp0Y14ZcTwOXPz4NN6br3mqykqY21MfmNl/m1lLMzvqwBb3ZCIipdC1eX0m3nACRzdN5RfPzOTRSVmaUr0MHHJwn5ktL2K3u3s8ZrgtcxrcJ1K97cnL59bxc5g4ay1DemRwz0XdqJmcGHWsCu+IB/e5e9v4RBIRib+ayYk8cFkPOjVJ5b73FrFyy25GXdmbxqk1D/1m+YEw62nUNrPfm9no4HlHM/tx/KOJiJQNM+OGUzswcmgvFq7LUQN5KYRp03ga2AcMCJ5nA3+OWyIRkTg5u2uz7zWQayGnwxemaLR393sJBvm5ey5FL4okIlLhdW1en4k3xhrIRzyrBvLDFaZo7AumQXcAM2sP7I1rKhGROGqcWpMXh/dncI8M7ntvEb9+aRZ78vKjjlUphFnu9W7gXaClmT0HnABcE8dMIiJxd3AD+YrNuxl9lRrID+WQVxru/j5wIbFC8QKQ6e6fxDeWiEj8FW4gX7Q+1kA+b40ayEsSpvfUG8CZwCfu/pa7b4p/LBGR8lO4gfySkdN4d966qCNVWGHaNO4HTgIWmNkrZnZxsDCTiEiV8f0G8q95+KMlFBSogfxgYW5Pferu1wPtgNHApcTWCxcRqVIONJAP6ZHB/R8s5oonvmTtttyoY1UoYa40CHpPXQSMAPoAY0vzpWZ2n5ktNLM5Zva6maUVOna7mWWZ2SIzO6vQ/t5mNjc49pCZqduviJS5msmJ/OOyHtx7UTdmZ2/j7Acm8+bstVHHqjDCtGm8BHwLnAY8Smzcxk2l/N4PgK7u3g1YDNwefFcX4HJi65GfDTxmZgcmiXkcGA50DLazS5lBRKRIZsalfVry9s0n0S69Lje98A2/eWkWOXvyDv3mKi7siPD27j7C3T8GjjezR0vzpe7+vrvvD55+QWzdcYDBwIvuvtfdlwNZQF8zawbUc/dpHhuFMw4YUpoMIiKH0qZRHV4ZcTy3/KgjE2at4ZwHP2PGii1Rx4pUmDaNd4HjzOxvZraC2BQiC8swwzDgneBxc2B1oWPZwb7mweOD9xfJzIab2Qwzm7Fx48YyjCoi1U1yYgK/PqMTr4wYQIIZl46axv3vLyIvvyDqaJEotmiYWSczu8vMvgUeIfaL2tz9VHd/+FAfbGYfmtm8IrbBhV5zB7AfeO7AriI+ykvYXyR3H+3ume6emZ6efqioIiKH1Lt1A96+5SQu6tWChz/O4uLHP2f5pl1Rxyp3JY0IXwh8Bpzv7lkAZvbrsB/s7qeXdNzMrgZ+DPzI/zPxSzbQstDLWgBrg/0titgvIlJu6qYkcd8l3Tm1c2Nuf20u5z74GXed34XL+7SkuvTNKen21EXAemCSmf3TzH5EGU1UaGZnA7cCg9x9d6FDbwCXm1mKmbUl1uD9lbuvA3LMrH/Qa+oqYGJZZBEROVznHteMd391Er1ap3H7a3MZ/sxMtuzaF3WsclFs0XD31939MqAz8Anwa6CJmT1uZmeW8nsfAVKJLSU7y8xGBt85H3gZWEBsvqsb3P3ALGK/BJ4g1ji+lP+0g4iIlLtm9WvxzLB+/P68Y/h00UbOemAynyyq+kPYDrnc6/deHFsb/BLgMnc/LW6pypCWexWReFuwdge/eukbFn+3k2sGtOG2czpX+iVli1vuNdTgvgPcfYu7j6osBUNEpDx0yajHGzeeyLUntGHM5ysY9MgUFqzdEXWsuDisoiEiIkWrmZzIH84/lrHD+rJ1dx4XPDaVyYurXpd/FQ0RkTJ0Sqd03rklNpL8Z2Nn8PHC76KOVKZUNEREylijuim88PN+HN00lV88M7NKrUWuoiEiEgdptWvw7M/60bV5fW54/mvemlM1hpapaIiIxEn9Wsk8c10/erVK4+YXvuH1b7IP/aYKTkVDRCSO6qYkMXZYX/q1bchvXp7NyzNWH/pNFZiKhohInNWukcRT1/ThxA6N+O2rc3juy5VRRzpiKhoiIuWgVo1E/nlVJqd1bswdr89jzNTlUUc6IioaIiLlpGZyIiOH9uasY5tw95sLGD15adSRDpuKhohIOaqRlMAjP+3Fed2a8Ze3F/LIx0uijnRYSpoaXURE4iA5MYEHL+tBjcQE/v7+YvblO78+vWOlmF5dRUNEJAJJiQn8/ZLuJCUYD320hLz8An571tEVvnCoaIiIRCQxwfjbRd2okZTA458sZd/+An5/3jEVunCoaIiIRCghwfjzkK4kJybw5JTl5OUXcPf5x5KQUDELh4qGiEjEzIw/nN+FlKQERk1exr79BfzlguMqZOFQ0RARqQDMjNvO6UyNpAQe/jiLvHznvou7VbjCoaIhIlJBmBn/debRJCUk8I8PF1O/VjJ3/rhitXGoaIiIVDA3/6gD23L38dTU5TSul8KIU9pHHenfIhncZ2b3mdlCM5tjZq+bWVqwv42Z5ZrZrGAbWeg9vc1srpllmdlDVpFKr4hIGTIz7jyvC4O6Z3DPOwt5dWbFmR03qhHhHwBd3b0bsBi4vdCxpe7eI9hGFNr/ODAc6BhsZ5dbWhGRcpaQYPz9ku6c2KERt46fw6SFG6KOBERUNNz9fXffHzz9AmhR0uvNrBlQz92nubsD44Ah8U0pIhKtGkkJjLyyN8c0S+X6577mm1Vbo45UIeaeGga8U+h5WzP7xsw+NbOTgn3NgcLXZ9nBviKZ2XAzm2FmMzZurHoLu4tI9VE3JYmnr+lL43opDBsznawNOyPNE7eiYWYfmtm8IrbBhV5zB7AfeC7YtQ5o5e49gd8Az5tZPaCo9gsv7rvdfbS7Z7p7Znp6etmdlIhIBNJTUxg3rC+JCcbVT33F+u17IssSt6Lh7qe7e9citokAZnY18GPgiuCWE+6+1903B49nAkuBTsSuLArfwmoBVI0Fd0VEQmjdsA5jru3Ltt37uPqpr9iemxdJjqh6T50N3AoMcvfdhfanm1li8LgdsQbvZe6+Dsgxs/5Br6mrgIkRRBcRiUzX5vUZdWUmyzbt5OfjZrAnL7/cM0TVpvEIkAp8cFDX2pOBOWY2G3gVGOHuW4JjvwSeALKIXYG8g4hINXNix0bcf2kPvlq+hVte/Ib8gmLv1MdFJIP73L1DMfvHA+OLOTYD6BrPXCIilcGg7hlsytnLn95awJ0T5/G/Q7qW26hxjQgXEamEhp3Ylg05exn56VIap6bwq9M7lcv3qmiIiFRSt559NBtz9vLAh0tIT03hin6t4/6dKhoiIpWUmXHPRcexZdde7pwwj4Z1Uji7a9O4fmdFGNwnIiJHKDkxgUev6EW3Fmnc/OI3fLlsc1y/T0VDRKSSq10jiaeu6UOLBrX42bgZLFy/I27fpaIhIlIFHFWnBuOG9aV2jUSufuorsrfuPvSbjoCKhohIFdGiQW3GDuvL7n35XPXUV2zdta/Mv0NFQ0SkCunctB5PXt2Hjo3rkpJc9r/i1XtKRKSK6dv2KPq2PSoun60rDRERCU1FQ0REQlPREBGR0FQ0REQkNBUNEREJTUVDRERCU9EQEZHQVDRERCQ0cy/fpQLLm5ltBFYe4dsbAZvKME5lo/PX+ev8q6/W7p5+8M4qXzRKw8xmuHtm1DmiovPX+ev8q+/5F0e3p0REJDQVDRERCU1Fo2Sjow4QMZ1/9abzlx9Qm4aIiISmKw0REQlNRUNEREJT0QDM7GwzW2RmWWZ2WxHHzcweCo7PMbNeUeSMlxDnf0Vw3nPM7HMz6x5Fzng51PkXel0fM8s3s4vLM1+8hTl/MxtoZrPMbL6ZfVreGeMpxL//+mb2ppnNDs7/2ihyVhjuXq03IBFYCrQDagCzgS4HveZc4B3AgP7Al1HnLufzHwA0CB6fU93Ov9DrPgbeBi6OOnc5//9PAxYArYLnjaPOXc7n/zvgb8HjdGALUCPq7FFtutKAvkCWuy9z933Ai8Dgg14zGBjnMV8AaWbWrLyDxskhz9/dP3f3rcHTL4AW5ZwxnsL8/we4CRgPbCjPcOUgzPn/FHjN3VcBuHtV+m8Q5vwdSDUzA+oSKxr7yzdmxaGiAc2B1YWeZwf7Dvc1ldXhntt1xK66qopDnr+ZNQcuAEaWY67yEub/fyeggZl9YmYzzeyqcksXf2HO/xHgGGAtMBe4xd0LyidexZMUdYAKwIrYd3A/5DCvqaxCn5uZnUqsaJwY10TlK8z5PwDc6u75sT82q5Qw558E9AZ+BNQCppnZF+6+ON7hykGY8z8LmAWcBrQHPjCzz9x9R5yzVUgqGrG/LFoWet6C2F8Uh/uayirUuZlZN+AJ4Bx331xO2cpDmPPPBF4MCkYj4Fwz2+/uE8olYXyF/fe/yd13AbvMbDLQHagKRSPM+V8L3OOxRo0sM1sOdAa+Kp+IFYtuT8F0oKOZtTWzGsDlwBsHveYN4KqgF1V/YLu7ryvvoHFyyPM3s1bAa8CVVeSvy8IOef7u3tbd27h7G+BV4PoqUjAg3L//icBJZpZkZrWBfsC35ZwzXsKc/ypiV1mYWRPgaGBZuaasQKr9lYa77zezG4H3iPWkeMrd55vZiOD4SGI9Zs4FsoDdxP7yqBJCnv9dQEPgseCv7f1eRWb/DHn+VVaY83f3b83sXWAOUAA84e7zoktddkL+//9/wBgzm0vsdtat7l5tp0zXNCIiIhKabk+JiEhoKhoiIhKaioaIiISmoiEiIqGpaIiISGgqGiJHIJjtdlahrdjZcUv4jEwzeyh4fI2ZPVL2SUXKVrUfpyFyhHLdvUdpPsDdZwAzyiaOSPnQlYZIGTKzFWb2NzP7Ktg6BPsvMbN5wZoMk4N9A83srSI+o7WZfRSsX/JRMCIfMxsTrOvyuZktq2rrekjloKIhcmRqHXR76rJCx3a4e19is6M+EOy7CzjL3bsDgw7x2Y8Qm4q/G/Ac8FChY82ITRj5Y+CeMjgPkcOi21MiR6ak21MvFPr5j+DxVGJTUbxMbB6vkhwPXBg8fga4t9CxCcG03AuCeZBEypWuNETKnh/82N1HAL8nNqPqLDNreISft7fQ4yo3T7tUfCoaImXvskI/pwGYWXt3/9Ld7wI28f3puA/2ObHZVgGuAKbEK6jI4dLtKZEjU8vMZhV6/q67H+h2m2JmXxL7o+wnwb77zKwjsauDj4itRX1KMZ99M/CUmf0PsJEqNKuyVH6a5VakDJnZCiCzOk+dLVWbbk+JiEhoutIQEZHQdKUhIiKhqWiIiEhoKhoiIhKaioaIiISmoiEiIqH9f0s0LsYklWyGAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the average episode reward against epsilon.\n",
    "plt.plot(epsilon_list,average_rewards_epsilon)\n",
    "plt.title('Run History')\n",
    "plt.xlabel('Epsilon')\n",
    "plt.ylabel('Average Episode Reward')\n",
    "plt.show"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<function matplotlib.pyplot.show(close=None, block=None)>"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEWCAYAAABhffzLAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8+yak3AAAACXBIWXMAAAsTAAALEwEAmpwYAAAzIklEQVR4nO3deXgV5fXA8e/JCiGQAAmQEBIIIAhIIgQEUdS6b+DGz6XuVrRal2qrttXum9ZWa60L7uJSd0HFraggIEpA9k0IBEgCRJYkkEC28/vjTmyE5GYSMvcm957P88xzZ+beO3NGfM6dvPO+5xVVxRhjTPiICHYAxhhjAssSvzHGhBlL/MYYE2Ys8RtjTJixxG+MMWHGEr8xxoQZS/zGtAIR2SMimcGOwxg3LPGbdklENopIhZNwt4rIsyIS79G5VEQGHLDvtyLyQt22qsaral4TxzleRLZ4EaMxzWGJ37RnZ6tqPJANHAn8IrjheEtEooIdgwkNlvhNu6eqW4EP8f0ANHhn7fyFcJKz/lsReVVEnheRMhFZISI5hxJD/b8KROQMEVnpHLtARH4mIp2A94FU56+UPSKSKiKxIvKgiBQ6y4MiElv/OkTkThHZCjwjIstF5Ox6540WkW9FJPtQ4jfhxRK/afdEJA04HVjXjK9NAP4DJALTgYdbMaSngOtUtTMwDPhEVfc6MRY6zULxqloI/AoYg+9HKwsYDdxd71i9gG5ABjAZeB64tN77ZwBFqrq4FeM3Ic4Sv2nP3haRMmAzsB34TTO+O0dVZ6hqDTAVX9L1Z5GI7K5bgLv8fLYKGCIiXVR1l6ou8vPZHwK/V9XtqloM/A64rN77tcBvVHW/qlYALwBniEgX5/3LnPiNcc0Sv2nPznHuqo8HBgNJzfju1nrr5UCHJtrQR6hqYt0C/NXPZ8/HdyeeLyKzRGSsn8+mAvn1tvOdfXWKVXVf3YbzV8Jc4HwRScT3V8SLfo5vzEEs8Zt2T1VnAc8C9zu79gJxde+LSCSQHMB4FqjqRKAH8Dbwat1bDXy8EF8zTp10Z993h2vgO8/ha+6ZBHyhqgWHGrMJL5b4Tah4EDjZeci5Ft8d/JkiEo2vzTw2EEGISIyI/FBEElS1CigFapy3twHdRSSh3ldeBu4WkWQRSQJ+ja85x5+3gRHALfja/I1pFkv8JiQ47ePPA/eoaglwA/AkUIDvL4BA9p+/DNgoIqXA9TgPY1V1Nb5En+c8K0gF/gjkAkuBZcAiZ1+jnLb+N4B+wJteXYQJXWITsRjT/ojIr4HDVPXSJj9szAFsQIgx7YyIdAOu4fu9f4xxzZp6jGlHRORafN1X31fV2cGOx7RP1tRjjDFhxu74jTEmzLSLNv6kpCTt27dvsMMwxph2ZeHChd+q6kFjWNpF4u/bty+5ubnBDsMYY9oVEclvaL819RhjTJixxG+MMWHGEr8xxoQZS/zGGBNmLPEbY0yYscRvjDFhxhK/McaEmZBO/AvzdzFl9nqsLIUxxvxPSCf+t78u4M8zVvOz15ayv7qm6S8YY0wYaBcjd1vq9xOH0j0+hgf/+w35O/by2GUjSYoPyERMxhjTZnl6xy8iPxWRFSKyXEReFpEOItJNRD4WkW+c164enp9bTzqMhy85kmUFJUx8eC6rt5Z6dTpjjGkXPEv8ItIbuBnIUdVhQCRwEXAXMFNVBwIznW1PnTU8lVevG0tVTS3nPzKP/67c5vUpjTGmzfK6jT8K6CgiUUAcUAhMBJ5z3n8OOMfjGADI6pPI9J8cQ2ZyPNdOzeXxWfbQ1xgTnjxL/KpaANwPbAKKgBJV/QjoqapFzmeKgB5exXCgXgkdePW6sZwxLIW/vL+an79uD32NMeHHs4e7Ttv9RKAfsBt4TURcTwwtIpOByQDp6emtFlfHmEj+dfGRDOgRzz9nOg99Lx1J91Z+6LuysJSp8/Mp3F3BxaPTOWVITyIipFXPYYwxLeHZ1IsiMgk4TVWvcbYvB8YAJwLHq2qRiKQAn6nqIH/HysnJUS/q8b+zpJCfvbaE5M6xPHXFKAb16nxIx6usruX95UVM/SKf3PxdxEZF0K1TDEUl+8hM6sSPjs3kvBG96RAd2UpXYIwxjRORhaqac9B+DxP/UcDTwCigAngWyAXSgR2q+lcRuQvopqp3+DuWV4kfYMnm3Vz7fC5791fz0MVHcuLhPZt9jMLdFbz05Sb+s2AT3+6pJKN7HJeNyeCCkWnEx0YxY/lWpsxez/KCUpLiY7ny6AwuHZNBYlyMB1dkjDE+AU/8zkl/B1wIVANfAz8C4oFX8f0AbAImqepOf8fxMvEDbC3Zx4+eX8CKwlJ+cfpgrj02ExH/zTKqytx1O5g6fyMfr9yGAicO7sGlYzIYPzD5oGYdVeWL9Tt4bHYes9cWExcTyYWj+nDNMf1I6xrn2bUZY8JXUBJ/a/E68QNUVNZw+2uLmbFsK5NGpvHHc4cRG3Vwk0zpvireWLiFqfPzySveS9e4aC4clc4Pj0qnTzd3CXxVUSlPzM5j+pJCFDhreAqTx2cyNDWhla/KGBPOLPG7UFurPDjzGx6a+Q2j+nb93kPfVUWlPP9FPm9/XUBFVQ3ZfRK5fGwGZxyR0uI2+8LdFTw9ZwMvf7WJvZU1HDswicnjMzlmQFKTf3EYY0xTLPE3Q/2Hvtcf159piwtYsNH3sHZidiqXjenLEWmtd3deUlHFi1/m88zcjRSX7WdISheuOy6TM49IISqyeT1uVZV9VbWUV1ZTUVVDx+jIVu+xZIxpHyzxN1PdQ9/tZfvJ6B7HpUdlMCknzdMHsvura5j2dSGPz17P+uK99E7syNlZqagq5ZU1VFTVUFFZ811S963XHLRenwiM65/EBSPTOHVoLzrGWI8iY8KFJf4WKC7bz7rteziqX7eA9sGvrVU+Wb2dKbPz+GrjTmKjIoiLiSQuJooO0RHExUTRMSaSjtGRxMVEHrAe9b39BbsqePPrLWzeWUF8bBRnDU/hgpFpjMzoas1JxoQ4S/ztlKoecoKurVW+2riT1xduYcayIsora+iX1InzR/TmvBFppCZ2bKVojTFtiSV+A8De/dW8v3wrry/czPy8nYjAMQN8TUGnDLGmIGNCiSV+c5DNO8t5Y9EWXl+4hS27KugcG8VZWb6moBHp1hRkTHtnid80qrGmIN8D4Z4kdIz57jlCpNUbMqbdsMRvXNm7v5oZy4p4feEWvtxw8IDq2KgIOsZEEhftPFSOiSQuOooOzr64mMjvrWcmx3POkb2DcCXGmMYSf0hPvWiar1NsFJNy+jAppw+bdpSzYONOyqtqqKis9nUXdbqMfn+9mpLySrbW21+/a+mw3gkM6BEf5CszxtRpNPGLyDKg0T8HVHW4JxGZNiO9exzp3VteR2hb6T7G/GUm05cUctvJh7ViZMaYQ+Hvjv8s5/VG53Wq8/pDoNyziEzI6NmlA2P6deedJYX89KSB9rDYmDai0XoAqpqvqvnAOFW9Q1WXOctdwKmBC9G0ZxOyU9nw7V6WF9gk98a0FW4KwXQSkWPqNkTkaKCTdyGZUHL6sF5ERwrTlxQEOxRjjMNN4r8G+LeIbBSRDcAjwNXehmVCRWJcDOMHJvPu0iJqa9t+DzJjwkGTiV9VF6pqFjAcyFbVbFVd5H1oJlRMyE6lqGQfCzb6nW/HGBMgTSZ+EekpIk8Br6hqiYgMEZFrAhCbCREnHd6TDtERTF9SGOxQjDG4a+p5FvgQSHW21wK3ehSPCUGdYqM46fCezFhWRFVNbbDDMSbsuUn8Sar6KlALoKrVQI3/rxjzfROyUtlVXsWcdd8GOxRjwp6bxL9XRLrjDOYSkTFAiadRmZBz3KBkunSI4p3F1txjTLC5KdlwGzAd6C8ic4Fk4AJPozIhJzYqktOG9eK9pUXsq6pp8TzFxphD56ZXzyLgOOBo4DpgqKou9TowE3omZPVmb2UNn6zeHuxQjAlrbmfyHg1kASOAi0Xkcu9CMqFqbP/uJMXHMt2ae4wJqiabekRkKtAfWMz/Huoq8Lx3YZlQFBkhnDU8hZe+2kTpviq6dIgOdkjGhCU3bfw5wBBtD4X7TZt3dlYqz87byEcrtnHByLRgh2NMWHLT1LMc6NXcA4vIIBFZXG8pFZFbReS3IlJQb/8ZzQ/btFcj0hNJ69oxIIO5VJWKSut5bMyBGk38IvKOiEwHkoCVIvKhiEyvW5o6sKqucco7ZAMj8ZVyfst5+4G691R1Ritch2knRISzs1KZu+5bduzZ7+m5npm7kZw/fszWkn2enseY9sZfU8/9rXieE4H1qppvNdnNhKxUHv1sPTOWFXHZ2L6enGPHnv088PFa9lbW8Oy8jdx1+mBPzmNMe+SvHv8sVZ0F5AKfO+tFQAIwr5nnuQh4ud72T0RkqYg8LSJdG/qCiEwWkVwRyS0uLm7m6UxbNrhXZwb2iOedJUWeneOhmd9QXlXDiPREXvwynz37qz07lzHtjZs2/tlABxHpDcwErsJXv8cVEYkBJgCvObsexddLKBvfD8nfG/qeqk5R1RxVzUlOTnZ7OtMOiAgTslL5auNOCndXtPrx1xfv4cUvN3HJ6HTuOWsIZfuqeWXB5lY/jzHtlZvEL6paDpwH/EtVzwWGNuMcpwOLVHUbgKpuU9UaVa0FnsA3RsCEmbOzfDX/3l3a+g95/zJjNR2iI7n1pIEcmd6V0X278fScDVRbgThjAJeJX0TG4ptr9z1nX3PG219MvWYeEUmp9965+HoNmTDTN6kTWWkJrd6754v1O/jvqm3ccEJ/usfHAnDt+EwKdlfw/vKtrXouY9orN4n/VuAXwFuqukJEMoFP3RxcROKAk4E36+2+T0SWichS4ATgp80L2YSKs7NSWV5QSl7xnlY5Xm2t8qcZK+md2JGrx/X7bv+Jg3uQmdSJKbPzsOEoxrir1TNLVSeo6r3Odp6q3uzm4KparqrdVbWk3r7LVPUIVR3uHNe7J3ymTTs7KxURWu2u/62vC1heUModpw36XhG4iAjhmmP7sayghC832Cxgxvjrx/+g8/pO/f77bvvxG9OUnl06cFS/bkxfUnjId+IVlTXc/9EastISOHt46kHvnz8ijW6dYnhidt4hnceYUOCvH/9U57U1+/Mb8z0Tsnrzy7eWsaKwlGG9E1p8nKfm5FFUso9/XnQkEREHjxXpEB3J5WMzePC/37BuexkDenQ+lLCNadf89eNf6LzOamgJXIgmlJ0+rBdREcI7h9Dcs71sH49+tp5Th/ZkdL9ujX7usjEZxEZF8OTnG1p8LmNCgZvJ1seJyMcislZE8kRkg4jY38umVXTtFMP4w5J5Z0khtbUta+554ONv2F9dy12nH+73c93jY7lgZBpvLipge1nbL+OwqqiUW/7ztdUbMq3OTa+ep4B/AMcAo/BV6xzlZVAmvEzISqWwZB8LN+1q9nfXbC3jlQWbuGxsBv2SOjX5+WuO6UdVbS1Tv8hvSagBU11Ty89eW8K0xYV8tNK6oZrW5Sbxl6jq+6q6XVV31C2eR2bCxslDetIhOqJFE7T8ecYq4mOjuPkHA119PjM5npMP78nU+flt+k76+S/yWVFYSmxUBNNs4hrTytwk/k9F5G8iMlZERtQtnkdmwkan2ChOPLwnM5YVNWt07ey1xcxaW8xNPxhI104xrr937fhMdpdX8frCtlnGYWvJPv7x8VrGH5bMlUf3ZfbaYnburQx2WCaEuEn8R+Fr3vkzvro6f8d6+phWNiErlR17K5m73t0fkzW1yp9nrCK9WxyXH53RrHPlZHQlu08iT87ZQE0Lnyt46Q/vrqSyppbfTxjKxOzeVNcq7y2z4S6m9bgZwHVCA8sPAhGcCR/HD0qmc4co1809ry/czOqtZdx52mBio5pTQcRXJG7y+Ezyd5TzcRtrP/9szXbeW1bET04YQN+kThye0pnDesYzfXFBsEMzIcTfAK5LndfbGloCF6IJB7FRkZw2tBcfrdjKvir/be9791dz/0drGZnRlTOOaPbkcACcOrQXfbp1ZEobGtC1r6qGX09bQWZSJ647LhPw/UhNzO7Ngo272LKrPMgRmlDh744/znnt3MhiTKuakJ1K2f5qPluz3e/nHp+dR3HZfn515uG0dGKfyAjhR8dksmjTbhbmt40yDo98uo5NO8v5wznDvvdXzASnkmkgpqs04cFf4u8LoKq/A+ap6u/qLwGJzoSVsZndSYqP8ZvgtpbsY8rs9Zw5PIUR6Q3O4ePapJw0EjpGt4m7/vXFe3hsVh4Ts1MZNyDpe+/16RbHyIyuLer1ZExD/CX+0+qt3+t1IMZERUZw5hEpzFy1nbJ9VQ1+5v6P1lBbC3edduhTKcbFRHHZmAw+WrmNDd/uPeTjtZSqcs/by4mNjuBXZzY8CG1idiqrt5axemtpgKMzochNrx5jAmZCdir7q2v5eOW2g95bUVjCG4u2cOW4vvTpFtfAt5vv8qMziI6I4Ok5wSvjMH1JIfPW7+COUwfRo3OHBj9zxhEpREaI3fWbVuEv8fdwHuTeXm/dHu4aT41I70rvxI4HNfeo+rpvJnaM5sYTBrTa+Xp07sA5R6by2sLNQekrX1JRxR/eXUlWWgKXHNV4t9Sk+FiOHZjEtMUtL21hTB1/if8JfA9x4+ut28Nd4ykR4eysVOZ88+33EvGna7Yzd90ObjlxIAkdo1v1nD86NpN9VbW8MD/wZRzu/3ANO/dW8qdzjyCygaqi9U3MTqVgdwWLWlDawpj6Gi3LbA9wTbBMyErlsVnrmbGsiEvHZFBdU8ufZ6ymX1Inv3fFLXVYz86cMCiZ5+ZtZPL4zO9N4uKlxZt388KX+Vwxtq+rktQnD+lFh+hlTFtcSE7fxquQGtMUa+M3bc7hKZ0Z0CP+u+aelxdsZt32Pdx1+mBiorz5X/ba8Zns2FvJW18HZqBUdU0tv3prGcnxsdx2ymGuvhMfG8XJQ3rx3rIiqmzieHMILPGbNkdEmJCVyoKNO/lmWxkPfryW0f26ccqQnp6dc2xmd4b17sITn+cFpA196nxfEbZ7zhpClw7um64mZqWyc28lc7751sPoTKizxG/apAlZqajClc8sYMfeSu4+hMFabogI1x6bSV7xXj5Z7X8A2aHaVrqPv3+0lmMHJnHW8JRmfXf8YckkdIxmmpVwMIfAzUQst4hIF/F5SkQWicgpgQjOhK++SZ0YnpZAwe4Kzj2yN8PTEj0/5xlHpNA7sSNTPvd2QNfvnSJsf5g4rNk/ZjFREZxxRAofrdxGeWW1RxGaUOfmjv9qVS0FTgGSgauAv3oalTHAhaP60Dk2ip+dOigg54uOjOCqcX35asNOlmze7ck5Zq8t5r2lRdx4vK8IW0uck51KeWVNg2MdjHHDTeKvuyU5A3hGVZfU22eMZy4Znc6Cu0+id2LHgJ2z7sfmCQ/u+vdV1XDPtOX0S+rE9cdntvg4o/p2IyWhgw3mMi3mJvEvFJGP8CX+D0WkM2BdCoznRCRgXSvrdO4QzSVHpTNjWRGbd7ZuNcxHPltP/o5y/jBxWLNLSdcXEeF7+D3LJmgxLeQm8V8D3AWMUtVyIAZfc49fIjJIRBbXW0pF5FYR6eZM3v6N83polbaMaWVXjutLhAhPz229Mg55xXt47LP1TMhK5ZiBSU1/oQl1E7TMsAlaTAu4SfwKDAFudrY7AQ0XFKn/JdU1qpqtqtnASKAceAvfj8hMVR0IzHS2jWkzUhI6MiErlVcWbKakvOFicc2hqtwzbTmxURHcfVbDRdia6/CUzgzsEW/NPaZF3CT+R4CxwMXOdhnw72ae50RgvarmAxOB55z9zwHnNPNYxnjuR8dmUl5Zw4tfHXoZh+lLCpm7bgc/P63xImzN5ZugJZWvNu6kYHdFqxzThA9Xc+6q6o3APgBV3YWvuac5LgJedtZ7qmqRc6wioEdDXxCRySKSKyK5xcXFzTydMYdmSGoXjh2YxBOz8/j1tOVMme0rIbF0y2527q1E1d0gL18RtlUMT0vgh61cbmJidm8Au+s3zdZorZ56qkQkEl+TDyKSTDMe7opIDDAB+EVzAlPVKcAUgJycHCtHaALuztMG84s3l/HWogLK9n+/z3xcTCRpXTuS1jXOea2/HkfXuGhEhL9/tIade/fzzJWjmizC1lx9usUxIj2RaYsL+PHx/Vv12Ca0uUn8D+Frm+8hIn8CLgDubsY5TgcWqWpdp+NtIpKiqkUikgJ4O0zSmBYa1juBd246BvDduW/ZVc6WXRUU7Kpgy66K77ZzN+6kdF/DPwzfbN/D5WMyOCKt6SJsLTExuze/mb6CNVvLGNTLiuYad5pM/Kr6oogsxNdOL8A5qrqqGee4mP818wBMB67ANwjsCmBaM45lTFAkdIwmoWMCQ1MbTuAlFVXOD0K586PgW+/TNY7bPRyAdubwFH7/7kqmLS7gjlaYlcyEB2msrVJE/NZ9VdUmZ6gWkThgM5CpqiXOvu7Aq0A6sAmY1NSxcnJyNDc3t6nTGROWrnj6K9Zt38OcO0/wtJ6RaX9EZKGq5hy4398d/0J87fqCL0nvctYT8SXsfk2d1On33/2AfTvw/fVgjGkFE7NTue3VJSzatIuRGVan3zSt0V49qtpPVTOBD4GzVTVJVbsDZwFvBipAY4x/pwztRYfoCN7+2nr3GHfcdOccpaoz6jZU9X3gOO9CMsY0R3xsFCcd3tMmaDGuuUn834rI3SLSV0QyRORXwA6vAzPGuDcxu7dvgpZ1NkGLaZqbxH8xvnLMbwFv4xtwdbG/LxhjAuu4uglaAjR1pGnf3HTn3AncIiJdgFpV3eN9WMaY5qiboGXa4gLKK6uJi3EzRMeEKzczcB0hIl8Dy4AVIrJQRIZ5H5oxpjkmOhO0/HeVjYk0/rlp6nkcuE1VM1Q1A7gdp5SCMabtGP3dBC3W3GP8c5P4O6nqp3UbqvoZvtLMxpg2pG6Cls/WFLPLJmgxfrhJ/Hkico/Tq6eviNwNtN4MFcaYVjMhO9U3QcvyQ5ugpbqmlmmLC7jrjaVsK93XStGZtsLNE6Crgd/hG7QlwCxczMBljAm8ISldGNAjnmmLC1tUBrq8sppXFmzmqTkb2LLLV+d/zrpveeGao1o8Obxpe9z06tmFM/uWU565k6qWeh2YMab5RISJWan8/eO1FOyucD1RfXHZfp7/YiPPf5FPSUUVo/p25TdnDyW5cyxXP7uACx6bx7NXjWZYb2+qjJrActOr5yUR6SIinYAVwBoR+bn3oRljWqJugpZ3ljRdwiGveA+/eHMZ4+79hIc/XceYzG688eOjee36ozl5SE+y+yTy6nVjiYmM4OIp85mfZ2M3Q4GbNv4hzh3+OcAMfAXbLvMyKGNMy6V3j+PI9ESm+ZmZa9GmXVw3NZcT/zGLNxZt4fwRacy87TgevyyHkRldv/fZAT3ieeOGo+mZ0IHLn/6KD1ds9foSjMfcJP5oEYnGl/inqWoVzmxcxpi2aWJWKquKSlm7rey7fbW1yscrtzHpsXmc98g85uft5CcnDGDunT/gL+cdQWZyfKPHS0noyGvXjWVIShd+/MJCXl2wORCXYTzith//RnxdOGeLSAZgbfzGtGFnDk8lMkKYtriA/dU1vLJgEyc/MItrn8+lcPc+fnP2EObd9QNuP2UQyZ1jXR2za6cYXvzRUYwbkMQdbyzlsVnrPb4K45VGJ2Lx+yWRKFWtbvqTrcMmYjGm+S5/+iuWF5QQGSEUl+1naGoXJo/P5MwjUoiKdHPP17DK6lpuf20J7ywpZPL4TH5x+mCbAKaNavZELCJyqaq+ICK3NfKRf7RadMaYVndhTh9mry3m2IFJPPB/2Ywb0L1VEnRMVAT/vDCbbnHRTJmdx449ldx7/hGH9GNiAstfd866Trs2g7Mx7dCZw1MYN+BkEuNiWv3YERHCbycMpVunWB7471pKKip5+JIRdIiObPVzmdbXoqaeQLOmHmParqnz8/n1tOXkZHTlyStGkdAxOtghGUdjTT1u+vFnisg7IlIsIttFZJqIZHoTpjGmvblsTAb/uvhIFm/ezYWPf8F2K/HQ5rlplHsJeBVIAVKB14CXvQzKGNO+nDU8laevHMWmneVc8NgX5O/YG+yQjB9uEr+o6lRVrXaWF7B+/MaYAxw7MJmXrh1D2b4qzn/0C1YUlgQ7JNMIN4n/UxG5q96cu3cA74lINxHp5nWAxpj2I7tPIq9dP5aYSOGix+fzpZV4aJOafLgrIv5KMKuqet7ebw93jWlfCndXcPnTX7F5ZzkzbjmW/n5GBRvvtPjhrqr287PYQ15jzEFSEzvy0rVHESHCvz9dF+xwzAEaTfxOk07d+qQD3vuzm4OLSKKIvC4iq0VklYiMFZHfikiBiCx2ljNaHr4xpq3q0bkDF49OZ9riQjbvLA92OKYef3f8F9Vb/8UB753m8vj/BD5Q1cFAFrDK2f+AqmY7ywyXxzLGtDOTx2cSIfD4bKvr05b4S/zSyHpD2wd/WaQLMB54CkBVK1V1d3MDNMa0X70SOnDByDRezd1i/fvbEH+JXxtZb2i7IZlAMfCMiHwtIk86k7kA/ERElorI0yLStaEvi8hkEckVkdzi4mIXpzPGtEXXH9ef6ppanvg8L9ihGIe/xJ8lIqUiUgYMd9brto9wcewoYATwqKoeCewF7gIeBfoD2UAR8PeGvqyqU1Q1R1VzkpOT3V+RMaZNyejeiQlZqbz45SZ27a0MdjgGP4lfVSNVtYuqdlbVKGe9bttNMY4twBZV/dLZfh0YoarbVLVGVWuBJ4DRh34Zxpi27IYTBlBeWcMzc/31DjeB4lkdVVXdCmwWkUHOrhOBlSKSUu9j5wLLvYrBGNM2HNazM6cO7cmz8zZStq8q2OGEPa8LaN8EvCgiS/E17fwZuE9Eljn7TgB+6nEMxpg24MYTBlC6r5oX5m8Kdihhz99ELLGquv9QDq6qi4EDR43ZRO3GhKHhaYkcOzCJp+bkcdW4vla7P4j83fF/ASAiUwMUizEmxP3khAF8u6eS/3xld/3B5G8GrhgRuQI4WkTOO/BNVX3Tu7CMMaHoqMzujOrblcdn53HJURnERNl0jcHg77/69cAYIBE4+4DlLM8jM8aEpBtPGEBRyT7e+npLsEMJW43e8avqHGCOiOSq6lMBjMkYE8KOOyyZYb278Ohn67lgZB8iIw59AnjTPG7+zpoqIjc7xdZeF5GbRMQm1TTGtIiIcOPxA9i4o5z3lhUFO5yw5CbxPwKMdF4fwRmN62VQxpjQdurQXgzoEc8jn66jttYm9As0N4l/lKpeoaqfOMtVwCivAzPGhK6ICOGG4/uzemsZM1dvD3Y4YcdN4q8Rkf51GyKSCdR4F5IxJhxMyEolrWtHHv50HU3NBGhal5vE/3N88+5+JiKzgE+A270NyxgT6qIiI7j+uP4s2bybeettbt5AcjP14kxgIHCzswxS1U+9DswYE/ouGJlGj86xPPyJTc8YSK5GT6jqflVdqqpLDrWMgzHG1OkQHcnk8Zl8kbeDhfm7gh1O2LBhc8aYoLrkqHS6xkXbpOwBZInfGBNUcTFRXD2uH5+s3s6KwpJghxMWmkz84nOpiPza2U4XEZs8xRjTai4f25f42Cge+dQmZQ8EtwO4xgIXO9tlwL89i8gYE3YS4qK5bGwGM5YXsb54T7DDCXluEv9RqnojsA9AVXcBMZ5GZYwJO9cc04/YqAge/czu+r3mJvFXiUgkoAAikgzUehqVMSbsJMXHctGodN7+uoAtu8qDHU5Ic5P4HwLeAnqIyJ+AOfimUDTGmFY1eXwmIvD4rLxghxLS3AzgehG4A/gLUASco6qveR2YMSb8pCZ25Lwj03gldzPbS/cFO5yQ5aZXTzdgO/Ay8BKwzcoyG2O88uPj+1NdU8tTczYEO5SQ5aapZxFQDKwFvnHWN4jIIhEZ6WVwxpjw0zepE2cNT+WF+fnsLq8MdjghyU3i/wA4Q1WTVLU7cDrwKnADvq6exhjTqm48YQB7K2t4Zu7GYIcSktwk/hxV/bBuQ1U/Asar6nwg1rPIjDFha1Cvzpw8pCfPzN3A1Pn5LNtSQmW1dSZsLY3OuVvPThG5E/iPs30hsMvp4mn/EsYYT9x+ymFc+fQC7nl7OQAxUREcntKF7LQEhqclktUngcykeCJszt5mk6YmQBCRJOA3wDGA4OvO+TugBEhX1UYrK4lIIvAkMAzfOICrgTXAK0BfYCPwf86gsEbl5ORobm6um+sxxoQQVWXLrgqWbilhyZbdLNm8m2UFJZRX+uaC6hwbxbDeCQzvk0B2WiLD+ySSmtABEfsxABCRhaqac9B+L2e+EZHngM9V9UkRiQHigF8CO1X1ryJyF9BVVe/0dxxL/MaYOjW1yvriPSzZvJslW3azdEsJq4pKqarx5bKk+Biy0hIZnpbIiIxExvVPCtu/Clqc+J2RuncAQ4EOdftV9QdNfK8LsATI1HonEZE1wPGqWiQiKcBnqjrI37Es8Rtj/NlfXcOqojKWbtnN4s2+H4P1xXtQhaw+ifz27CEcmd412GEG3KEk/o/wNc38DLgeuAIobuouXUSygSnASiALWAjcAhSoamK9z+1S1YP+RURkMjAZID09fWR+fr7fOI0xpr6yfVV8sHwr9324huKy/Zw/Io07Tx9Ej84dmv5yiDiUxL9QVUeKyFJVHe7sm6WqxzXxvRxgPjBOVb8UkX8CpcBNbhJ/fXbHb4xpqT37q3n4k3U8NSeP2KhIbvrBAK4a14+YqNCfjqSxxO+qSJvzWiQiZ4rIkUCai+9tAbao6pfO9uvACHwjf1OcoFLwjQo2xhhPxMdGcdfpg/nop8dxVL9u/OX91Zz24Gw+XR2+qcdN4v+jiCQAt+Nr7nkSuLWpL6nqVmCziNS135+Ir9lnOr7mIpzXac2M2Rhjmq1fUieeunIUz141CgSuenYBVz+7gA3f7g12aAHnpqlnnKrObWpfI9/NxvdDEQPkAVfh+7F5FUgHNgGTVHWnv+NYU48xpjVVVtfy3LyN/HPmN+yvruHqY/px0w8GEh/rZmhT+3EobfyLVHVEU/u8ZInfGOOF7WX7+NsHa3ht4RaSO8dy52mDOe/I3iHT/bOxxN/oz5uIjAWOBpJF5LZ6b3UBIls/RGOMCawenTvwt0lZXDomg9++s4KfvbaEF+bn87sJQ8nqkxjs8Dzjr40/BojH9+PQud5SClzgfWjGGBMYWX0SeeP6o/n7pCwKdlcw8d9z+flrS9heFppzArhp6slQ1aB2oremHmNMoNTv/tkhKpLnrxndbgd/HUp3zlgRmSIiH4nIJ3WLBzEaY0zQ1e/+2bVTDNe/sDDk7vzdJP7XgK+Bu4Gf11uMMSZk9UvqxJTLR1JaUc0NLywKqbLQbhJ/tao+qqpfqerCusXzyIwxJsgG9+rC3yYNJzd/F79/d0Www2k1bhL/OyJyg4ikiEi3usXzyIwxpg04a3gq1x2XyQvzN/HKgk3BDqdVuBmtUDfKtn7zjgKZrR+OMca0PXecOpiVhaXc8/YKBvbszIh2+rC3TpN3/Krar4HFkr4xJmxERgj/uvhIeibE8uMQeNjbZOIXkTgRuVtEpjjbA0XkLO9DM8aYtiMxLoYpl+WExMNeN238zwCV+Ebxgq/q5h89i8gYY9qow1NC42Gvm8TfX1XvwynPrKoV+ObeNcaYsBMKD3vdJP5KEemI74EuItIf2O9pVMYY04bdcepgjh2YxD1vr+DrTbuCHU6zuUn8vwE+APqIyIvATHxz8BpjTFiq/7C3PY7sddOr52PgPOBK4GUgR1U/8zYsY4xp29rzw143vXrOxTd69z1VfReoFpFzPI/MGGPauMNTunDvBb6HvX94d2Www3HNVVOPqpbUbajqbnzNP8YYE/YmZKVy3fhMps7P59UFm4MdjituEn9Dnwmt+cmMMeYQ3HGa72Hv3W8vbxcPe90k/lwR+YeI9BeRTBF5ALAibcYY44iMEB66qP087HWT+G/CN4DrFXyTpFcAN3oZlDHGtDddO8Xw+KU5lFRUceOLbfthr9/ELyKRwDRVvUtVc5zll6q6N0DxGWNMuzEktQv3XZDFgo1t+2Gv38SvqjVAuYgkBCgeY4xp1yZkpTK5jT/sdfOQdh+wTEQ+Br6701fVmz2Lyhhj2rE7Th3EysJS7n57OVl9EhnUq3OwQ/oeN2387wH3ALPxPdStW4wxxjQgKjKChy4+kg7REdz7wepgh3OQJu/4VfU5p1ZPuqquac7BRWQjUAbU4BsEliMivwWuBYqdj/1SVWc0K2pjjGnjunWK4frj+3PfB2v4asNORvdrOxMXuhm5ezawGF+9HkQkW0SmN+McJ6hqtqrm1Nv3gLMv25K+MSZUXXV0P3p0juW+D1ajqsEO5ztumnp+C4wGdgOo6mKgn2cRGWNMiOgYE8ktJw0kN38XM1dtD3Y433GT+Kvrl2xwuP3pUuAjEVkoIpPr7f+JiCwVkadFpH1PXmmMMX78X04f+iV14m8frqGmtm3c9btJ/MtF5BIg0pl28V/APJfHH6eqI4DTgRtFZDzwKNAfyAaKgL839EURmSwiuSKSW1xc3NBHjDGmzYuOjOD2Uw5jzbYy3v66INjhAO5H7g7FN/nKS0AJcKubg6tqofO6HXgLGK2q21S1RlVrgSfwNSM19N0pdYPGkpOT3ZzOGGPapDOGpTCsdxf+8fFa9lfXBDucxhO/iHQQkVuB+4BNwFhVHaWqd6tqk4UoRKSTiHSuWwdOwffXQ0q9j50LLD+UCzDGmLYuIkK487TBFOyu4MX5wZ+u0d8d/3NADrAMX1PN/c08dk9gjogsAb4C3lPVD4D7RGSZiCwFTgB+2vywjTGmfTlmQBJH9+/Ow5+uY8/+6qDG4q8f/xBVPQJARJ7Cl7xdU9U8IKuB/Zc1K0JjjAkBIr67/on/nssTs/P46cmHBS0Wf3f8VXUrqhrcnydjjAkBWX0SOX1YL578PI9v9+wPWhz+En+WiJQ6SxkwvG5dREoDFaAxxoSSn506iH3VtTz8ybqgxdBo4lfVSFXt4iydVTWq3nqXQAZpjDGhon9yPJNGpvHil/ls3lkelBjcdOc0xhjTim45aSARIjzw37VBOb8lfmOMCbCUhI5ceXRf3vq6gNVbA99ybonfGGOC4MfH9yc+Nor7P2xW0eNWYYnfGGOCIDEuhuuP689/V21nwcadAT23JX5jjAmSq8f5yjbf+35gyzZb4jfGmCDpGBPJzSf6yjZ/sjpwZZst8RtjTBBdOKoPfbvHcd8HgSvbbInfGGOCyFe2eRBrtpUxbXFgyjZb4jfGmCA784gUhqYGrmyzJX5jjAmyurLNW3ZV8PKX3pdttsRvjDFtwLEDkxib2Z1/feJ92WZL/MYY0waICHeePpgdeyt56vMNnp7LEr8xxrQR2X0SOW1oL6bMXs8OD8s2W+I3xpg25GenDqKiqoZ/f7res3NY4jfGmDZkQI94Jo3swwvz89myy5uyzZb4jTGmjbn15IEg8MDH33hyfEv8xhjTxtSVbX7z6y2s2VrW6sf3N9m6McaYILnh+P6sKiqlqqa21Y9tid8YY9qgxLgYpl5zlCfHtqYeY4wJM5b4jTEmzFjiN8aYMONpG7+IbATKgBqgWlVzRKQb8ArQF9gI/J+q7vIyDmOMMf8TiDv+E1Q1W1VznO27gJmqOhCY6WwbY4wJkGA09UwEnnPWnwPOCUIMxhgTtrxO/Ap8JCILRWSys6+nqhYBOK89GvqiiEwWkVwRyS0uLvY4TGOMCR9e9+Mfp6qFItID+FhEVrv9oqpOAaYA5OTkBG76eWOMCXGeJn5VLXRet4vIW8BoYJuIpKhqkYikAE1OLb9w4cJvRSS/hWEkAd+28LuhwK7frt+uP3xlNLRTVL25mRaRTkCEqpY56x8DvwdOBHao6l9F5C6gm6re4UkQvjhy6z1YDjt2/Xb9dv3he/2N8fKOvyfwlojUneclVf1ARBYAr4rINcAmYJKHMRhjjDmAZ4lfVfOArAb278B312+MMSYIwmHk7pRgBxBkdv3hza7fHMSzNn5jjDFtUzjc8RtjjKnHEr8xxoSZkEn8InKaiKwRkXVON9ED3xcRech5f6mIjAhGnF5xcf0/dK57qYjME5GDHry3Z01df73PjRKRGhG5IJDxec3N9YvI8SKyWERWiMisQMfoJRf//yeIyDsissS5/quCEWeboartfgEigfVAJhADLAGGHPCZM4D3AQHGAF8GO+4AX//RQFdn/fRwu/56n/sEmAFcEOy4A/zvnwisBNKd7R7BjjvA1/9L4F5nPRnYCcQEO/ZgLaFyxz8aWKeqeapaCfwHXzG4+iYCz6vPfCDRGTkcCpq8flWdp/8rfz0fSAtwjF5y8+8PcBPwBi5Gi7czbq7/EuBNVd0EvtH0AY7RS26uX4HO4htYFI8v8VcHNsy2I1QSf29gc73tLc6+5n6mvWrutV2D76+fUNHk9YtIb+Bc4LEAxhUobv79DwO6ishnTtHEywMWnffcXP/DwOFAIbAMuEVVW38W83YiVCZblwb2HdhP1c1n2ivX1yYiJ+BL/Md4GlFgubn+B4E7VbXGGU0eStxcfxQwEt/gyY7AFyIyX1XXeh1cALi5/lOBxcAPgP74ikZ+rqqlHsfWJoVK4t8C9Km3nYbvl725n2mvXF2biAwHngROV98I6lDh5vpzgP84ST8JOENEqlX17YBE6C23//9/q6p7gb0iMhvfyPpQSPxurv8q4K/qa+RfJyIbgMHAV4EJsW0JlaaeBcBAEeknIjHARcD0Az4zHbjc6d0zBihRZ16AENDk9YtIOvAmcFmI3OXV1+T1q2o/Ve2rqn2B14EbQiTpg7v//6cBx4pIlIjEAUcBqwIcp1fcXP8mnFIxItITGATkBTTKNiQk7vhVtVpEfgJ8iO8J/9OqukJErnfefwxfT44zgHVAOb47gJDg8vp/DXQHHnHueqs1RKoWurz+kOXm+lV1lYh8ACwFaoEnVXV58KJuPS7//f8APCsiy/A1Dd2pqmFbrtlKNhhjTJgJlaYeY4wxLlniN8aYMGOJ3xhjwowlfmOMCTOW+I0xJsxY4jdhy6nSubje0mhVTz/HyBGRh5z1K0Xk4daP1JjWFRL9+I1poQpVzT6UA6hqLpDbOuEYExh2x2/MAURko4jcKyJfOcsAZ/8kEVnu1HSf7ew7XkTebeAYGSIy05n/YKYzchoRedaZF2KeiOSF2rwApn2wxG/CWccDmnourPdeqaqOxlfV8UFn36+BU1U1C5jQxLEfxlcGfDjwIvBQvfdS8BXJOwv4aytchzHNYk09Jpz5a+p5ud7rA876XHzD/l/FV/fIn7HAec76VOC+eu+97ZQEXunUjTEmoOyO35iG6YHrqno9cDe+SpCLRaR7C4+3v956yNWINm2fJX5jGnZhvdcvAESkv6p+qaq/Br7l+6WADzQPX5VIgB8Cc7wK1JjmsqYeE846isjietsfqGpdl85YEfkS383Rxc6+v4nIQHx36TPxze16XCPHvhl4WkR+DhQTQtVgTftn1TmNOYCIbARywrlsrwlt1tRjjDFhxu74jTEmzNgdvzHGhBlL/MYYE2Ys8RtjTJixxG+MMWHGEr8xxoSZ/wc27BOHPg5GPAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the percentage of completions against epsilon.\n",
    "plt.plot(epsilon_list,percentage_finished_epsilon)\n",
    "plt.title('Run History')\n",
    "plt.xlabel('Epsilon')\n",
    "plt.ylabel('Percentage of Episodes Finished')\n",
    "plt.show"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Evaluation of the method as a function of 𝛾."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "scrolled": true,
    "tags": []
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Run:    1 | Gamma: 1.00 | Average Episode Reward:   55.17 | Percentage Finished: 78.60\n",
      "Run:    2 | Gamma: 0.95 | Average Episode Reward:   57.47 | Percentage Finished: 79.80\n",
      "Run:    3 | Gamma: 0.90 | Average Episode Reward:   57.19 | Percentage Finished: 79.80\n",
      "Run:    4 | Gamma: 0.85 | Average Episode Reward:   60.05 | Percentage Finished: 81.70\n",
      "Run:    5 | Gamma: 0.80 | Average Episode Reward:   56.86 | Percentage Finished: 79.60\n",
      "Run:    6 | Gamma: 0.75 | Average Episode Reward:   54.12 | Percentage Finished: 77.30\n",
      "Run:    7 | Gamma: 0.70 | Average Episode Reward:   58.00 | Percentage Finished: 80.30\n",
      "Run:    8 | Gamma: 0.65 | Average Episode Reward:   58.22 | Percentage Finished: 80.70\n",
      "Run:    9 | Gamma: 0.60 | Average Episode Reward:   56.09 | Percentage Finished: 79.50\n",
      "Run:   10 | Gamma: 0.55 | Average Episode Reward:   57.43 | Percentage Finished: 80.00\n",
      "Run:   11 | Gamma: 0.50 | Average Episode Reward:   59.35 | Percentage Finished: 81.20\n",
      "Run:   12 | Gamma: 0.45 | Average Episode Reward:   54.66 | Percentage Finished: 77.90\n",
      "Run:   13 | Gamma: 0.40 | Average Episode Reward:   54.15 | Percentage Finished: 77.00\n",
      "Run:   14 | Gamma: 0.35 | Average Episode Reward:   58.96 | Percentage Finished: 81.40\n",
      "Run:   15 | Gamma: 0.30 | Average Episode Reward:   55.38 | Percentage Finished: 78.50\n",
      "Run:   16 | Gamma: 0.25 | Average Episode Reward:   57.79 | Percentage Finished: 79.70\n",
      "Run:   17 | Gamma: 0.20 | Average Episode Reward:   57.63 | Percentage Finished: 80.40\n",
      "Run:   18 | Gamma: 0.15 | Average Episode Reward:   54.77 | Percentage Finished: 77.80\n",
      "Run:   19 | Gamma: 0.10 | Average Episode Reward:   55.88 | Percentage Finished: 79.00\n",
      "Run:   20 | Gamma: 0.05 | Average Episode Reward:   58.56 | Percentage Finished: 80.70\n"
     ]
    }
   ],
   "source": [
    "# Initialise lists to hold average episode rewards and percentage maze completions.\n",
    "average_rewards_gamma = []\n",
    "percentage_finished_gamma = []\n",
    "\n",
    "# Initialise variables for epsilon, gamma and number of episodes.\n",
    "gamma_list = np.arange(1.00, 0.00, -.05)\n",
    "epsilon = 0.1\n",
    "episodes = list(range(1,1001))\n",
    "\n",
    "# For loop for iteration over changing epsilon.\n",
    "for run, g in enumerate(gamma_list):\n",
    "    \n",
    "    # Initialise lists to hold episode rewards and maze completions.\n",
    "    episode_rewards = []\n",
    "    episode_finished = []\n",
    "    \n",
    "    # Initialise variables for Q table and N table.\n",
    "    Q = np.zeros((100,4))\n",
    "    N = np.zeros((100,4))\n",
    "\n",
    "    # For loop for each episode.\n",
    "    for episode in episodes:\n",
    "    \n",
    "        # Initialise state, done, and total_episode_reward.\n",
    "        state = env.reset()\n",
    "        done = False\n",
    "        total_episode_reward = 0\n",
    "    \n",
    "        # For loop for step iteration.\n",
    "        for step in range(1000):\n",
    "        \n",
    "            # Get Q and N value at current state.\n",
    "            current_Q = states[state[0], state[1]]\n",
    "            current_N = states[state[0], state[1]]\n",
    "        \n",
    "            # The action is selected randomly between exploition and exploration.\n",
    "        \n",
    "            # Exploitation with 1-epsilon probability.\n",
    "            # This code selects the action with the highest Q value, or random if a tie.\n",
    "            if np.random.uniform(0,1) > epsilon:\n",
    "                action = int(np.random.choice(np.flatnonzero(Q[current_Q] == Q[current_Q].max())))\n",
    "        \n",
    "            # Exploration with epsilon probability.\n",
    "            # This code selects a random action.\n",
    "            else:\n",
    "                action = env.action_space.sample()\n",
    "        \n",
    "            # Get next state, reward and done from Gym model's step() function.\n",
    "            next_state, reward, done, info = env.step(action)\n",
    "        \n",
    "            # Increment N.\n",
    "            N[current_N, action] += 1\n",
    "        \n",
    "            # Increment Q according to the Bellman equation:\n",
    "            # Q(n+1) = Q(n) + (1/n)(reward-Q(n)).\n",
    "            Q[current_Q, action] += (1/N[current_N, action])*(reward - g*Q[current_Q, action])\n",
    "        \n",
    "            # Increment total episode reward.\n",
    "            total_episode_reward += reward\n",
    "        \n",
    "            # If we reach the end of the maze, end the episode\n",
    "            if done:\n",
    "                break\n",
    "            \n",
    "            # Update the state variable.\n",
    "            state = next_state\n",
    "    \n",
    "        # Create a variable for calculating and displaying 'Finished maze' statistics.\n",
    "        if done:\n",
    "            finished = 'Yes'\n",
    "        else:\n",
    "            finished = 'No'\n",
    "        \n",
    "        # Update episode rewards and maze completions lists.\n",
    "        episode_rewards.append(total_episode_reward)\n",
    "        episode_finished.append(finished)\n",
    "        \n",
    "    # Calculate average episode reward and percentage maze completions per episode.\n",
    "    episode_average_reward = np.sum(episode_rewards)/len(episodes)\n",
    "    episode_finished_percentage = np.count_nonzero(np.array(episode_finished) == 'Yes')*100/len(episodes)\n",
    "    \n",
    "    # Update average episode rewards and percentage maze completions list.\n",
    "    average_rewards_gamma.append(episode_average_reward)\n",
    "    percentage_finished_gamma.append(episode_finished_percentage)\n",
    "\n",
    "    # Display end of run results.\n",
    "    print(\n",
    "        f'Run: {run+1:4} | Gamma: {g:4.2f} | Average Episode Reward: {episode_average_reward:7.2f} | '\n",
    "        f'Percentage Finished: {episode_finished_percentage:5.2f}'\n",
    "    )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<function matplotlib.pyplot.show(close=None, block=None)>"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEWCAYAAABhffzLAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8+yak3AAAACXBIWXMAAAsTAAALEwEAmpwYAABLf0lEQVR4nO2deXhcd3X3P2e0L6PN1mZJXmNFTrzFcUJCQkLC1rAllOWFAoWw5KVNC93hbSnQ5X2hLbTQlhYCJCxlKdAkZQ2kgSQEEhLbseMktuREtuRNI8mSrJFGo2XmvH/ce+WxrGUkzV1G8/s8zzyauXPnzrnS6MzvnuV7RFUxGAwGQ+4Q8tsAg8FgMHiLcfwGg8GQYxjHbzAYDDmGcfwGg8GQYxjHbzAYDDmGcfwGg8GQYxjHbzBkABEZEZGNftthMKSDcfyGrEREjonImO1we0TkyyJS7tJ7qYhcNGPbx0TkP5zHqlquqp0LHOfFInLCDRsNhsVgHL8hm3mNqpYDO4HLgP/jrznuIiL5fttgWBkYx2/IelS1B/gJ1hfArCtr+wrhpfb9j4nIt0XkqyISFZFnRGT3cmxIvSoQkVeKyLP2sU+KyJ+ISBnwY2CNfZUyIiJrRKRIRD4tIqfs26dFpCj1PETkgyLSA9wlIk+LyGtS3rdARPpFZOdy7DfkFsbxG7IeEWkGbgKeW8TLXgt8C6gCvgf8awZN+hLwv1U1DGwFfqaqo7aNp+ywULmqngL+ArgK60trB3Al8OGUYzUANcA64Dbgq8DbUp5/JXBaVfdn0H7DCsc4fkM2c6+IRIHjQC/w0UW89hFV/ZGqJoCvYTnd+dgnIkPODfjQPPtOApeISIWqDqrqvnn2fSvw16raq6p9wF8Bb095Pgl8VFXHVXUM+A/glSJSYT//dtt+gyFtjOM3ZDO32KvqFwNtwOpFvLYn5X4MKF4ghr5LVaucG/CJefZ9PdZKvEtEHhKRq+fZdw3QlfK4y97m0KeqceeBfZXwS+D1IlKFdRXx9XmObzBcgHH8hqxHVR8Cvgx80t40CpQ6z4tIHlDroT1PqOrNQB1wL/Bt56lZdj+FFcZxWGtvmz7cLK/5Cla4543Ao6p6crk2G3IL4/gNK4VPAy+zk5wdWCv4V4lIAVbMvMgLI0SkUETeKiKVqjoJDAMJ++kIsEpEKlNe8k3gwyJSKyKrgY9ghXPm415gF/ABrJi/wbAojOM3rAjs+PhXgb9U1bPA7wJfBE5iXQF4WT//duCYiAwD78NOxqrqYSxH32nnCtYAfwvsAZ4CDgL77G1zYsf6/wvYANzt1kkYVi5iBrEYDNmHiHwEaFXVty24s8EwA9MQYjBkGSJSA7yb86t/DIa0MaEegyGLEJH3YpWv/lhVH/bbHkN2YkI9BoPBkGOYFb/BYDDkGFkR41+9erWuX7/ebzMMBoMhq9i7d2+/ql7Qw5IVjn/9+vXs2bPHbzMMBoMhqxCRrtm2m1CPwWAw5BjG8RsMBkOOYRy/wWAw5BjG8RsMBkOOYRy/wWAw5BjG8RsMBkOOYRy/wWAw5BiuOn4RqRKR74rIYRE5JCJXi0iNiNwvIkfsn9Vu2mAwGHKTiakk33q8m0TSyNLMxO0V/2eA+1S1DWum6SGsWaUPqOpm4AHmn11qMBgMS+JnhyN86O6D/PK5fr9NCRyuOX57GPR1wJcAVHVCVYeAm7FGx2H/vMUtGwwGQ+7yfN8oAB2RqM+WBA83V/wbgT7gLhF5UkS+KCJlQL2qngawf9bN9mIRuU1E9ojInr6+PhfNNBgMK5FO4/jnxE3Hn481F/TfVfUyrPF3aYd1VPUOVd2tqrtraz2bk20wGFYInf0jAHRERny2JHi46fhPACdU9df24+9ifRFERKQRwP7Z66INBoMhRznab634n+sdwcwdOR/XHL+q9gDHReRie9NLgGeB7wHvsLe9A/hvt2wwGAy5ycDoBEOxSTbWljEyPsWps3G/TQoUblf1/D7wdRF5CtgJ/D/gE8DLROQI8DL7scFgMGSMo3aY5xWXNgAmzj8TVx2/qu634/TbVfUWVR1U1TOq+hJV3Wz/HHDTBoPBkHs4FT3Tjr/HOP5UTOeuwWBYcXT2jVKQJ2xdU0FtuMgkeGdgHL/BYFhxHO0fYW1NKfl5IVrryznSa1b8qRjHbzAYVhydfaNsrC0HYHNdmCOREZJGumEa4/gNBsOKIpFUus7E2FhbBkBrfZixyQQnh8Z8tiw4GMdvMBhWFCcHx5hIJNm42nH81srfVPacwzh+g8GwonA6dqdDPfVhwHTwpmIcv8FgWFE4Gj0b7BV/ZUkB9RVFHDEr/mmM4zcYDCuKo/2jVBTns6qscHpba32YDlPZM41x/AaDYUXR2T/ChtpyRGR62+a6MM/1msoeB+P4DQbDiqKzb5RNdpjH4eKGcuKTSY4PxnyyKlgYx28wGFYMsYkpTp+NT5dyOpgE7/kYx28wGFYMjhTzhtXl523fXGdKOlMxjt9gMKwYHMc/c8UfLi5gTWWxqeyxMY7fYDCsGJxSzvWryi54bnN92IR6bIzjNxjmID6Z4OCJs36bYVgER/tHaaoqoaQw74LnWuvLeb5vhISp7DGO32CYi3uePMlrP/sIxwdMJUi20Nk3Mt24NZPN9WHGp5J0m7+ncfwGw1x0D8RQhUefP+O3KYY0UFVblXN2x986Xdlj4vzG8RsMcxAZtua0PtZpHH820D8yQXR8alqcbSZOZY9J8BrHbzDMSe/wOGA5flUTFw46nX1W4nZDbfmsz5cV5dNUVWISvBjHbzDMSc9wHBE4dTbO8QGj5R50pks551jxg5XgNaEe4/gNhjmJDMd54aZVgAn3ZAOd/aMU5odYU1Uy5z6t9WE6+0aZSiQ9tCx4GMdvMMxCbGKKaHyKF25azeryQuP4s4DOvlE2rCojLyRz7rO5PsxEIklXjlf2GMdvMMyCE99vqCjmBRtXmTh/FtDZP3cpp4MzjSvXE7zG8RsMs+BU9NRXFHPVxlUmzh9wJhNJulPm7M7FRdOaPbmd4M138+AicgyIAglgSlV3i8gO4HNAOXAMeKuqDrtph8GwWHqmHX8RDZVFgBXnX7uq1E+zDHNwYnCMqaROj1uci9LCfFpqSnI+wevFiv8GVd2pqrvtx18EPqSq24B7gD/1wAaDYVE4oZ66imI21ZabOH/AmS7lXCDUA9BaF+ZIjq/4/Qj1XAw8bN+/H3i9DzYYDPMSGY5TXBCiojgfETFx/oDjlHJuWiDUA1aCt7N/hMkcruxx2/Er8FMR2Ssit9nbngZea99/I9Ay2wtF5DYR2SMie/r6+lw20+AGyaQSn0z4bcaSiETHaagonh7fZ+L8web5vlGqSwuoKi1ccN/W+nImE0rXmVEPLAsmbjv+a1R1F3ATcLuIXAe8y76/FwgDE7O9UFXvUNXdqrq7trbWZTMNbvCdvce5+uMPMDGVfSuryHCcuori6cdXb6wBTD1/UDnaP7JgfN+h1Uzjctfxq+op+2cvVjz/SlU9rKovV9XLgW8Cz7tpg8E/9h8/y2Bskt5o3G9TFk1kOE59iuN34vyPGscfSDr7RtOK74P1txTJbbE21xy/iJSJSNi5D7wceFpE6uxtIeDDWBU+hhWII2ccsROl2YKqWo4/XDS9zcT5g0s0PklvdHzBUk6HksI81taU5nSC180Vfz3wiIgcAB4Hfqiq9wFvEZEO4DBwCrjLRRsMPuLonvcOZ9eKfzg+RXwyed6KH6w4/+mzcaPnHjCO9Vt/j/k0emayuS6c0yv+Oev4ReRfsJKzs6Kq75/vwKraCeyYZftngM8swkZDFjKZSHJyyEqE9kaza8XvfFHVV57v+FPj/OtmGe1n8IfOfmvlnm6MH6wE74PtvUxMJSnMz70+1vnOeA+wFygGdgFH7NtOrIYsg2FOTg/Fp0fcRbJsxe+EplJDPeDE+Yt4rHPAD7MMc9DZN4oIrFtEc11rfZippE6XgeYac674VfUrACLyTqwmrEn78eeAn3pinSFrSQ2HZNuKvydFriEVEeGqjTXTcX6n1NPgL539ozRXl1CUf+Gc3bnYXO9IN0S5uCHslmmBJZ1rnDVYZZcO5fY2g2FOugaslVRduCgLV/yWvXUVRRc8Z+L8weNo/wgbV6cf5gHr6i0kuSvWlo7j/wTwpIh8WUS+DOwD/p+rVhmynu6BGIV5IbY3V07LH2QLvcNxwsX5lBZeeEF81Uajzx8kVJWjiyjldCguyGPdqrKcreWf1/HbJZftwAuw6vDvAa52wkAGw1wcH4jRXF1CY2VJ1tXxR4atrt3Z2FRbZuL8ASIyPM7oRCItqYaZbK4rp6PXrPgvQFWTwKdUtUdV/9u+9XhkmyGL6ToTo6WmlLpwEYOxScansqceIBKNXxDfd5gZ5zf4i1PRs2GRoR6wErxdZ2JZ9dnMFOmEen4qIq8Xk8kypImq0n0mxrpVpdMOtC+LEryRs/FZ4/sOJs4fHDr77Dm7S1nx15eTSOr0MXKJdBz/HwHfAcZFZFhEoiKSNfr5ZlXmPWfHJomOT7G2ppRa24FmS/duMqn0RsfnXPGDifMHiaP9o5QU5M0ZmpuPc5o9uRfuWdDxq2pYVUOqWqiqFfbjCi+MWy6f+PFhXvZPDy+8oyGjdJ2xVsItNaXUh61/yGzp3h2ITTCV1Atq+FMxcf7g0Nk3wvrVZYTmmbM7Fxtrrfm8uSjdkNYELhGpBjZjNXMBoKqB96jlRXk81ztCND5JuLjAb3NyBicEsm5VKbXllgPNllp+p5SzoXLuFaSp5w8OR/tHubSpckmvLcrPY92qUrPinw0ReQ/W4JSfAH9l//yYu2ZlhrYG68IkF/+wfuI4/pbqUqpLC8kPSdbU8qdO3poPE+f3n4mpJMcHxxal0TOT1rowR3pzb8WfToz/A8AVQJeq3gBcBmTFZJS2RiuGd+i0cfxe0n0mxuryQsqK8gmFxG7iyo4V/1xduzMxcX7/6R4YJZHUJSV2HVrry+k6M5q1A4OWSjqOP66qcQARKVLVw1jjEwNPU1UJ4aJ8DvdkTS56RdA9EGNtzTndlNqK4qyp5XeuTJwQ1VyYOL//ONU4SynldNhcHyap8Hxfbq3603H8J0SkCrgXuF9E/htLTjnwiAhtjWEOmxW/p8x0/PXhoqzp3o0Mj7OqrHBBxUZTz+8/nf1LL+V0cHR6ci3Bm05Vz+tUdUhVPwb8JfAl4BaX7coYbQ0VtPdEzT+nR0xMJTl9doy1KbLF9Vm04u8dnrt5ayYmzu8vR/tGWV1eRMUyCjfWryojPyQ5lwdMJ7n71yLyMhEpU9WHVPV7qjrrnNwg0tYYJjo+Na0Nb3CXk0NjJJXzVvzZ1L1rde3OH+ZxMHF+f+nsH1lWYhegMD/EhtW5p9mTTqjnGPAWYI+IPC4inxKRm901K3M4lT0m3OMNzur3vFBPhVPLH/xwT8/Z+Zu3UnHi/I8+bxy/HxztH11WmMehtT7MkRzT7Ekn1HOnqr4LuAH4D+CN9s+swInhmQSvN3SfseKuqUMxnO7doNfyTyaSnBkdX7CU0+FcnH/AhBI95uzYJP0jE4tW5ZyNzfXldA/EGJsI/hVppkgn1PNFEfkV8O9YDV9vAKrdNixTlBfls7amlEM9ufWN7hfdAzGK8kPnVcVkS/du/8g4qqQd6gEr3NMzHJ/uVjZ4Q2ff4sctzkVrfRjNscqedEI9q4A8YAgYAPpVdcpNozJNW0OYw6fNit8LugcsVc7UFvr6LFnxO70Gi9F9CXKcfyg2wb/+7AjPrcAGJWdkYiZW/K0p07hyhXSrel4A/D1QBfxcRE64bVgmaWus4Gh/7jVp+EHXmRjras6ffZot3buRNJu3UjlXzx88x//dvSf45E87eOk/PsR7vvLEiio97ewbJS8k5+WSlsq6VWUU5ElOJXgX1OoRkVcDLwKuwwrx/Az4hct2ZZQtDVaTxpHICNual6brYVgYVeX4QGx6FeyQLd27841cnIuZcf4g6fbs7RpkTWUxb9zdwtce6+LNdzzG9uZK3vuijdy0tYH8vHQu+IPJ0f5R1taULthvkQ4FeSE2ri7PqTGM6fzWbsIat/h6VW1T1VtV9U6X7coobY1WZc8hk+B1lYHRCUYnErOuwrKhezcyHCcvJKwqS9/xQzDj/KrKvu5BrtxQwx++rJVffvBG/vaWrUTjU/z+N5/k+n94kC89cpSR8ayK2k7zfN9IRsI8Dpvrc2saVzqhntuBx4BLAESkRESyaiz92ppSSgryTEmny3SlqHLOJBu6dyPD49SWF5G3SInfIMb5Tw6NERke5/J1Vh1GSWEeb7tqHQ/80fXc8fbLaaoq4W9+8CxXf/wBPv7jQ/ScDfaXcirJpHLszOiya/hTaa0Pc3xgjNhEdn4RLpZ0qnreC3wX+Ly9qRlLvmFBROSYiBwUkf0issfetlNEHnO2iciVS7Q9bfJCQmtD2JR0uszxWWr4HbKhezcyHKd+HjnmuQhinH9v1yAAu9adX4AXCgkvv7SBb7/vau69/Rqua63lCw93cu3f/Yw/+s/9PHsq+P8jp4fjxCeTbMhADb+Dk+BdiYnw2Ugn1HM7cA0wDKCqR4C6RbzHDaq6U1V324//HvgrVd0JfMR+7DpbGsIcOj28YpJbQaQ7ZQDLTLKhe7d3eHzeASxzEcR6/n1dg5QV5nFx/dwX5ztbqvjsb+3ioT+9gbdfvY77nunhlf/8C97+pV/zUEdfYM5lJtOlnMsQZ5vJ5ulpXMbxO4ynSjSISD6wnE+EAs4Er0o8EnxrawgzGJvMqtmv2UbXQIz6iiKKC/IueC4bund7FqHTM5Ogxfn3dg+yo6UqrQRuS00pH33NpTz6oZfwwd9oo70nyjvufJybPvMLvncgeHqMRzMgzjaTdTWlFOaFcibBm47jf0hE/hwoEZGXYc3f/X6ax1esYe17ReQ2e9sfAP8gIseBTwL/Z5E2L4lzCd7c+MP6wUxVzlSC3r0bn0xwdmxyUc1bqVy9KThx/tjEFIdOR6fj++lSWVrA77x4E4988EY++cYdJFV5/zefDFz4o7NvlLLCPOqWcHU2F/l5ITbWluVMLX86jv9DWINXDgL/G/iRqv5Fmse/RlV3YVUG3S4i1wG/A/yhqrYAf4il9nkBInKbnQPY09e3/LkvbY50g2nkco3uM7FZwzwQ/O7ddCdvzcXG1WXUhoMR5z9w/CyJpF4Q30+XwvwQb7i8mX94ww7g3Ao7KHT2j7KxtjzjpbOt9WET6nFQ1aSqfkFV36iqbwC6ROT+dA6uqqfsn73APcCVwDuAu+1dvmNvm+21d6jqblXdXVtbm87bzUtVaSGNlcUcNit+V4hPJugZjrOuZvbL76B370bsxPNiunZTseL8qwIR59/XbSd2W5anrNJUXQLAicFghK8cOjNcyunQWl/OyaExRrO0xHUxzOn4ReRGEekQkRER+Q8RucSuzPk4lm7PvIhImVP2KSJlwMuBp7Fi+tfbu90IHFnuSaRLm53gNWSeE4OW7PXaVSWzPh/07t2ldO3O5KqNNYGI8+/tGmRzXTmVpUvXqQdYVVZIcUGIk4PBkTSPTyY4OTSW0fi+g5PgzYUZvPN17n4KuA14FCtU8xjwl6r6mTSPXQ/cY1+O5QPfUNX7RGQE+IydJI7b7+EJbY0VPPJcPxNTyYx0/BnO0T1ghQPmivEHvXvXqWNfaowfzq/nX+/CijQdkkmrcesVlzQs+1giQnN16fSXehDoOhNDNTMaPTNpdSp7eqLsbKnK+PGDxHyOX1X1Qfv+vSLStwinj6p2Ajtm2f4IcPmirMwQbQ1hJhNKZ//ItE6/ITM4pZxr5wj1QLC7d3uj4xTmh6gsWfoqOTXO/+Yr12bQuvTp7B9lKDa56MTuXDRVlXBiKDihHqeUc1MGVDlnsramlKL8UE4keOdz/FUi8pspjyX1sarePctrAk3qUJZccPyxiSlGxxPUZrD6YS66B8YoKchjdXnhnPvUh4t8D4PMRWTYmry1nIThzDi/H7o90/H9DDn+5uoSnjoxlJFjZQJnzq4bV1R5IWFTbTkdOR7qeQh4zRyPlXMJ2qxhY62lwneoZ5hbaPLbHFeITyZ4sL2XHzx1mgcO9ZKfJ+z58Espyr+wtj6TdA9YolnzObv6imKeODbgqh1LJTIcX3JiN5WrNtbw/QOn6DoT8yXcs69rkKrSgozJGTRXlzIYm2RkfIryogU1HV2ns2+U+ooi12xprS/n10eD+RnNJHP+9lT1Vi8N8YKCvBAX1YVXnGbP+FSCX3T084OnTnH/sxFGJxLUlBWys6WKRzvP0NHjvipp90CMdavmdzap3btufxEtlt7hcbasWf5VoN9x/r1dg+xaW33ePITl4FT2nBwcm55m5ydH+0cy2rE7k831Ye7df4rh+OSyhrgHnZzLcG5ZIZo9k4kkP2/v5Y+/fYDdf/s/vOere/h5ex+v3r6Gr737Sh7/85fwiddvA+DgybOu2qKq8zZvOQS5ezcyHJ/uNVgOTpz/UR/q+c/GJjnSO8KutVUZO2az4/gDEufv7B/NqEbPTJwE75EVXs/v/7Wbx7Q1hrn7yZMMjk5QXTZ3PDqITCWSPNY5wA+eOsV9z/QwFJskXJzPyy9p4NU7Grn2otUUpLTor60ppaI433XH3xcdJz6ZnFWVM5XU7t25Gr38IBqfZHQisayKHodzcf4znsf59x3PbHwfzjn+IFT2DI5OMBSbzKgq50wcsbYjkcV3PmcTuef4nQRvT3S6zT7IJJLK40cH+OHBU/z4YA9nRicoK8zjpZfU8+rta7iudfWcYRMRYWtTJU+77Pi7B+YWZ0slqN27Tonpcmr4U3Hi/MfOxFwpO5yLfV2D5IWEHc1VGTvm6rIiCvNDgXD8nf3OnF33fqct1aUUF4RWfAdvOhO4SoE/Btaq6ntFZDNwsar+wHXrXKCt0ZZu6BkOvON/4tgAt399H73RcUoK8rhxSx2v2d7Iiy+um1UIbTa2NVVy1y+Pudq70D2PHHMqzoo6aE1cvRlo3kolNc7vqePvHmRLY5iyDCY+QyGhuaokEE1cnX22OJuLMf5QSLiorpwjK3woSzqfkLuAvcDV9uMTWFILWen4a8uLWFVWmBUJ3m8+3k18MsG/vOUyXrKljtLCxf9Db22qZCKRpCMSZWuTOwnerjMxRM6FBebC6d4NmmyDI9eQiVAPnF/P/xaP6vmnEkn2dw/xhsubM37spuqSQMg2dPaPUpAnC37OlktrXZhfPt/v6nv4TTpLwE2q+vfAJICqjgHBGSy6SESEtsbsSPAeiYywvbmK1+xYsySnD9aKH9xN8B4fiNFYUbxgpU5Qu3cjyxRom8nMOL8XtEeijE4kMhrfd2iuLglGqKdvhLU1pa7PCt5cHyYyPM7ZsUlX38dP0vkNTohICbYGv4hsAoL1n7tI2hoqaI9ESSSDOWgCrNb753pH2Fy/vMvadatKCbuc4O0emFuVcyZB7N7tORunvCg/o7XhV22sITI8zjGPGtb2ORO31rrh+Es5MzrB2IS/Q3SO9o+ywcUwj0Nqgnelko7j/yhwH9AiIl8HHgD+zFWrXKatIUx8MknXmWDJzaZyYnCMscnEvBOU0kFE2LrG3QRv10BswYoehyDO3u2NxjMW5nHweg7v3q5B6sJFroRBglDSmUgqx87E2ORiYtehNQemcaUjy3w/8JvAO4FvArtTNHyyki2N5yp7goqjF7J5mY4fYFtzJYdPR5mYSi77WDMZm0jQFx1fMLHrUF9RPB1TDwqR4fGMJXYdvNbn39c9xOXrql0pH22qshz/cR/DPaeGxpiYSrpa0ePQVFVCSUHesjV7eqNxvvHrbiYTmf+/Wy7zyTLvcm7AOuA0lqTyWntb1nJRXTkhCfZQlo5ex/Ev/9I2NcGbaY4PplfK6VAXLmIoYLN3I8sYuTgXXsb5e6NxugdirtWdN1dbf1s/K3uet8XZvAj1hELC5vqlV/ZMTCX5/EPPc+MnH+LP7znI/c9GMmzh8plvxf8p+/ZZ4NfAHcAX7Pv/7L5p7lFckMfG2vJAj2Hs6InSWFmckbZxJ8HrRrjHEV1bSK7BIWjdu6pK7/A4dRkO9QBcvXEVkeFx168s93UNAZlt3EqlLlxEQZ74muB1Y87ufGyuW/w0LlXlgUMRXvHph/n4jw9z5YYaCvNCHDg+5I6Ry2BOx6+qN6jqDUAXsMuehnU5cBnwnFcGukVbwKUbOiIjGQnzgDVIOlzkToI33Rp+h6DN3h2MTTKRSGZErmEmr7i0nryQcO/+kxk/dir7ugcpzAtxaQa0hmYjFBLWVPlb0tnZN0q4OJ9VHnXbt9aX0xcdZyg2kdb+z/WO8M67nuDdX9mDCNx16xXc+c4r2LKmgv3Z5PhTaFPVg84DVX0a2OmaRR6xpbGC4wNjROPBK9lKJJXn+0ZorcvMZW0oJFzaVOHKiv/4QIzyonyq05z2FLTuXaeZrKEy845/VXkR17fW8r39p0i6WEG2t2uQbc2VrgrfNVeXcHLIvxV/Z/+IK3N25yLdBO9wfJK//cGz/ManH2Zf1yAfftUW7vvAddxwcR0AO5utwoqgVRCm4/gPicgXReTFInK9iHwBOOS2YW7jDF8P4tCF7oEY41PJ6Q9fJtjWVMmhnmjGE01dZxaWY04laN2750YuujOz4JbLmjh9Nu6a1O/4VIKDJ866rivTXOXvJK6jfaOuavTMxMmtzeUfEknlW493c8M/PMiXfnmUN1zezM//9MW850Ubz+uQ39FSxehEYjpHERTScfy3As8AHwD+AHjW3pbVtNmVPYcC2MHrfNhaMyiDu7WpkompzCd401HlTCVo3btOrqHOhVAPwMu21FNWmMe9T7oT7nnm1DATiaQr9fupNFWX2GJ83iflYxNTnDob99TxN1WVUFaYN2st/xPHBrj5s4/wobsPsmF1Gd//vWv5xOu3s7r8wsXDdls3KWjhnnTKOeNYCd6PAH8J/Ku9LatZU1lMuDg/kHF+58O2OUOhHnAnwZtMKscHx1ibZg0/BK9711nxu5HcBSgpzOMVWxv40cHTrjjN6catdVUZP3YqTi3/KR/CPcf6rdzCRhfGLc6FiLC5/vwE76mhMd7/zSd54+ce5czIBJ95806+876r55VC2bi6jHBRfqCmmEEajl9EXgwcAf4V+DegQ0Suc9cs9xERtjRUBFKzpz0yYq04MthJun5VGeUZTvBGonEmppKLWvFDsLp3e4bjVJcWuBoff91lTUTHp/jZ4d6MH3tv1yAtNSWuXbE4OCWdfoR7HFVOLwXvwErwHumNEp9M8M8PHOEln3qInzzTw/tvvIgH/vh6bt7ZtGCIMxQStrdUcuC4uwq5iyWdUM+ngJer6vWqeh3wCuCf3DXLGyzNnqhneirpciQSnW4bzxShkHDpmgoOnszcFc65AeuLc/xB6t51o3lrJi/ctJracFHGwz2qyp6uQS53OcwD5yZx+eH4j9qqnN47/jD9IxPc+MkH+cf7O7ihrZb/+aPr+aOXX7wo7aztzVUcOj3sS5hsLtJx/AWq2u48UNUOYEXMJGtrqGBkfCoQAlQOU4kknX2jGU3sOmxrquTQ6eGMJXgXW8rpEKTuXUuuwV3HnxcSbt6xhp+396ZdHpgOJwbH6IuOezIwpD5cRH5IfJFt6OwfZU1lMSWF3o7rdEI4FSUFfOO9L+Df3nr5kgYI7WiuYiqpHApQw2g6jn+PiHzJrup5sYh8EUumOetxZogGSbrh2JkYE4lkxmr4U9nWbCV4n+vNTIVB90CMkJxbDaZLkLp3ra5dd+L7qdxyWROTCeWHB09n7Jj7ujM/cWsu8vNCNFYV+xPq6RvxNL7vcNXGVfzw/dfyg9+/lhduWr3k4+xsqQIIVCNXOo7/d7Cqet6PVdnzDPA+N43yimnHH6BvYiexu1xxttnYmmGJ5u6BGGuqSs4b95gOQeneTSSVvqj7oR6AS9dUcFFdeUbDPfu6BikrzHPlszIbTVXeyzOrqjVn14fB9QCXrqlctgx0Q2UxdeEiDpwITpw/naqecVX9R1X9TeDdwAOqGowA7TIpL8pnbU1poFb8HZERRCw9oUyzwU7wZqqyZ7GlnA5B6d7tHxknqZnT4Z8PEeF1lzXxxLFBjg9kJlyyt3uQHS1VruvTOzRXl3qu19M/MkE0PuWZVINb7Gip4kCAKnvSqep5UEQqRKQG2A/cJSL/mM7BReSYiBwUkf0issfe9p/24/328/uXcwLLpa0hzKEAlXR29EZpqS51JZ4ZCgmXrKnI3Ir/TPpyzKkEpXt3umvXA8cP8NodawD43oFTyz7W6PgUh057OxC8ubqESDTuaYjunEaP96GeTLKzpYrOvtHADHdJZ6lQqarDWNLMd9l6PS9dxHvcoKo7VXU3gKr+L/vxTuC/gLsXa3QmaWus4Fj/aGAy7h09ma/oScVJ8E4tM8E7Mj7FmdGJJSW7gtK9e27IuvsxfrAUTK9cX8Pd+04su5LswIkhEkn1JL7v0FRVgiqcHvLu79Zpd7x62bzlBtub7TBrQMI96Tj+fBFpBN5EBufsilUA+yYsjX/f2NIQJqnWmEO/mZhKcrR/1JXErsPWpgrik0meW2YLuROuWFez+H/IoHTvRjI8ZD0dbr5sDc/3jfLMqeVdZU43brV4ueK35Zk9bOI62j9KYX6INVXuztl1m+1NVQCBCfek4/j/GvgJ8JyqPiEiG7EautJBgZ+KyF4RuW3Gcy8CIqo667FE5DYR2SMie/r6+tJ8u8UzLd0QgHDPsTOjTCXV9RU/LH/l0bXEGn4ITvdu73CckOCZ4iPAq7Y1UpAn3LPMJO++7iE215VTmaY4XiZonq7l966k8/m+UdavKiUvlLVjvgGoLC1g4+qywFT2pJPc/Y6qblfV37Ufd6rq69M8/jWqugu4Cbh9RsfvW5hnta+qd9hS0Ltra2vTfLvFs7amlJKCvEB08E5P3apzb8W/YXU5pYV5y07wHl9iDb9DELp3e4bjrC4v8iw5ClBVWsgNF9fxvQOnlqzYmEwq+7oHPY3vg1WdEhJvm7g6+0fY6MHwFS/Y3lwZ/BW/iPyZ/fNfROSfZ97SObiqnrJ/9gL3AFfax8zHyhn853JPYLnkhYTWgGjzd0RGCLlU0eOQN93BuzzH3z0Qo7KkYMkrziB070aGx12RY16I113WRF90nF8937+k13f2jzIUm3RdmG0mBXkhGitLPKvsmUok6T4TY0OWV/Q47GipIjI8Ts9Z/5sX51vqONLLe7Aatmbe5kVEykQk7NwHXg48bT/9UuCwqp5Yot0ZZUtDmEOnh32XbjgSibJuVRnFBe52KG5tquTZZSZ4u5ZYyukQhO7dyHDcdY2b2bihrY5wcf6Swz3nhNm8dfxgNet5teI/PjjGVFKzPrHrsMNp5ArAqn++CVzft39+RVW/grVivzvl8ULUA4+IyAHgceCHqnqf/dyb8Tmpm0pbQ5jB2CR9PicbOyLRjCpyzsW2pkrik0metzVQlsLxZTr+IHTv9kbHPavoSaW4II9XbWvkJ0/3EJuYWvTr93YNUmXHjL2m2cNJXNMVPVleyulwSWMF+SEJhFJnOnX8u0XkIPAU8LSIHBCRyxd6nZ0L2GHfLlXV/5vy3DtV9XPLMz1znEvw+hfnH59KcOxMzBWNnplsW2YHbyKpnBiMLUqOeSZ+d++OTyUYGJ3wtKInlZt3NjE6kVjSIO593YPsWltNyIeEZ3N1CT3D8YwP9JkNp7Fys4vFDl5SXJBHW2M4EEqd6WS17gR+V1XXq+o64HbgLnfN8pa2AEg3dPaNkkiqJx/yjbXLS/CePjvGZEKXteI/173rT7in1+Ma/pm8YEMNjZXFi5ZwOBub5EjviOeJXYfm6lKSiidx6vaeKE1VJVQUrwhNSMBS6jxwYsjVUZzpkI7jj6rqL5wHqvoI4H8JTAapKi2ksbLYV+mG6albHqz480LCJY1LT/AuVZUzlXPdu/6s+J0vHL9W/KGQcPPOJh4+0k//SPq/g33Hrfj+ZWurXLJsfhxBvuMehHs6ItFpPa2Vws7mKqLxKY6dWXqYNROk4/gfF5HPp8zc/TfgQRHZJSK73DbQK9rsBK9fHImMkBcSzzRJtjZV8uyp4SWVFC63lBP8794917Xrj+MHq7onkVR++FT6ip37ugbJCwk77JF+XuPU8rtd2TOZSPJ838iKc/xBSfCm4/h3Aq3AR4GPAVuAF2INaPmkW4Z5TVtjBc/3jTAx5X7scjY6IlHWryp1dRJUKtuaKhmbXNoQ6K4zMfJDQuMySiH97t71o2t3Jhc3hNnSWLGo6p69XYNsaQxndDrbYmisLEE8qOXv7BtlMqHTYdiVwkV1VpjV7zj/gp8eVb3BC0P8pq0hzGRC6ewfoa2hwvP3P9I74umHfFuKdshiw0vdAzGaqkuW1fjkd/duZHicgjyh2sPO19m4ZecaPv7jwxxNQ3p4KpFk//Eh3nh5s0fWXUhhfoj6sPu6/E5fjRehTy/JCwlbm/xv5JqvgevTKfc/MOO5L7tnkj9ssSt7/OjgjU8mOHbGXY2emWyqLaekIG9Jcf7llnI6+Nm969TwLzQz1W1eu3MNIqSV5G2PRIlNJHyp30+lubrE9Ulc7T1R8kPCphVSypnKzpYqnjk17Ft0AeYP9aTKK7xjxnPbXbDFVzasLqMwL+SLZs9zvSOo4qpGz0zybInmpVT2LLd5y8HP7t3IcNyXrt2ZNFaWcPXGVdy7/+SCDYTTjVsed+zOpNmDJq72nigba8sozPdOTsMrttuT8Np9LCaZ77cqc9xfkRTkhbiortyXFf+RXu8qelLZ1lTJM4tM8J4dm2QoNpkZx+9j965XIxfT4ZbLmug6E2P/AgJee7sGqQsXTSdY/aKpuoTTZ+PLlvaej8M9US72IeTqBU5i3s9wz3yOPyQi1SKyKuV+jT2Qxdupxx7R1uiPZk9HZIT8kLB+lbedmFvtBG/nIhK803LMy2jecvCze7d3eNwXuYbZ+I2tDRTlhxYM9+y1hdn8Dk81V5eSSCoRlxLz0fgkJ4fGVlxi16G5uoRVZYW+KnXO5/grsTR59gAVwD7O6fSsyL/IloYKIsPjDIxOePq+RyL+XNYupYPXqeFfygCWmfjVvTs6PkV0fMrXip5UKooLeOmWer7/1Ok5O2J7o3GOD4z51riVyrQ8c4ZGSM6kw8W500FARHxX6pxPq2e9qm5U1Q2z3DZ6aaRXTA9f93jV3xEZ8TSx67CptozigtCSHH9mkrv+dO+eK+UMRqgHrHDPwOgEvzgy++yJfV1DgD/CbDNpqnJ0+d2J8zuNlCuthj+VHS1VHOkdYWR88VpNmWDlZU6WQVujI93gXZw/NjHF8cEYrS5q8M9Ffl6ISxoXl+DtOhOjpqyQcAba6P3q3nVKSL2atZsO17fWUlVawD1Pzj6Pd1/3IIX5IS5d43/c25mG5dYkro6eKOVF+b7nMtxkR0sVqix7LsZSMY4/hdryIlaVFXq64vejoieVxSZ4jw/EMhLmAf+6d50rjLoAOf7C/BCv3t7I/c/2zLoK3Ns1yLamSs8a/OajuCCPunCRayqdh+25037nMtxkOsHrU5zfOP4URMRO8Hq34u+wZ/36EeoBK8Ebm0hwtD+9BG93hko5wb/u3SCGesCScIhPJvnJ0z3nbR+fSnDwxNlAxPcd3NLlV1XaIyu3osehpqyQlpoSnvJp+Hpajl9ErhWRW+37tSKywV2z/KOtoYL2nuiSx+ItliORKIV5IdZnoEpmKUx38KZxyTmZSHJyaIx1GXL8fnXvRobHKS3Mo9wn2YO52LW2mpaaEu7df351z9Mnh5lIJH2v30+lubrUlVBPb3ScodgkF68QKeb52NFctWAJr1uko8f/UeCDwP+xNxUA/+GmUX7S1hBmfCpJl0fqeR12RY+Xc19Tuai23Erwnlg4vHV6KE4iuTw55pn40b3bMxynvsL/rt2ZiAi37Gzil8/1nxf+Ojdxq8onyy6kubqEU0NjGV8gnUvsruwVP1iO/+TQ2KLUWTNFOt7mdcBrgVGYnqO7YtPt09INHoV7OiIjvuqR5OeF2NJYwdOnFl7xZ7KU08GP7t3eADVvzeTmnU0kFb5/4FySd1/3IGtrSgPTdwBWZc9kQjP+pd1u59dWag1/Ko5Spx8TudJx/BNq9ZIrTM/PXbFcVFdOSLwZyjI6PsXJoTHfErsO22yJ5oWGQ3QNWFdBmWjecvCjezcyPB6YGv6ZXFRXzvbmyulwj6qyp2uQXT7p78+FW/LMh3ui1IWLqC4rzOhxg8jWpgpCAvt9UOpMx/F/W0Q+D1SJyHuB/wG+4K5Z/lFckMfG2nJPxjAe6fU3seuwdU0lI+NTHF0gvNU9EKMwL5RRp+l1966q2nINwXT8ALfsbOLpk8MciUQ5MThGX3Q8UIldsGL8kPla/vaelTd8ZS5KC/NprQ8Hc8Wvqp8Evgv8F3Ax8BFV/Re3DfOTtgZvpBs6evzR6JnJVruDd6Ga4uMDMZprSsjL4KxXr7t3h8emGJ9KUhcOZqgH4DU71pAXEu7df5J93U58P1iO/1wTV+ZKOqcSSc/lyf1mR3MVB44PLSjQl2nSyiiq6v2q+qeq+ieqer/bRvnNlsYKjg+MEY1Puvo+HZEoRfmhjCZLl8Lm+nIK80McXKC0rOtM5ko5Hbzu3u0JwACWhagNF3HNRau598lT7Dk2SFlhXuDkC0oK81hdXpjRyp5jZ2JMTCVzIrHrsKOlisHYJMcH3FU7nUk6VT1RERmecTsuIveIyIqUbnBWHI5miFt09I6wqbY8oyvopVBgJ3jnK+lUVbpdcPxed+861TJBkGSej9ddtoaTQ2Pc8+RJdq6t8q3qaz6aqkszGupxZIpzacW/3S6n9lq3J51P0z8Cfwo0Ac3An2DF+L8F3Omeaf7RZlf2HHJZuuFIgIZJb2uq4Jl5ErxnxyaJjk9l3vF73L073bwVoAqZ2Xj5JQ2UFOQxMj4VqPr9VJqrMtvE1R6JEhIrwZ0rXNwQpig/5HkHbzqO/zdU9fOqGlXVYVW9A3ilqv4nEMxP5DJZU1lMuDjf1Tj/cHyS02fjbA5Io8q2JivBe2yOBG/XmcyJs6XidO+6JfE7E6dLuC6g5ZwOZUX5vOLSeiB48X0HaxLX2ILVYOnS3jPM+lVlFBf4L0vhFQV5IV9GMabj+JMi8iYRCdm3N6U8N+9fXESOichBEdkvIntStv++iLSLyDMi8vdLNd4tRIQtDRWuirUdsaUa/BBnm42tC0g0T6tyZrjD2One9TLUU1lSkBXO5V3XbuCFm1Zxxfoav02ZlebqEiamkhlrQMqlip5UtjdX8vTJYVcH28wkHcf/VuDtQC8Qse+/TURKgN9L4/U3qOpOVd0NICI3ADcD21X1UuCTS7LcZRzNHrey7U7+wO+KHofW+jCF+aE5K3syKcc8Ey+7d4M0eWshtjdX8Y33XhU4aQmHJruW/3gGwj2xiSm6BmI56fh3tlQxNpmYLu/2gnTKOTtV9TWqulpVa+37z6nqmKo+soT3/B3gE6o6bh+/dwnHcJ22hgpGxqdc0xzviEQpKcgLjPRsQV6ILQ3huVf8Z2KsLi+itDDzTsjL7t2eADdvZRtOLX8mKnuORCyV2lxK7Dr4odSZTlVPsYjcLiL/JiJ3Orc0j6/AT0Vkr4jcZm9rBV4kIr8WkYdE5Io53vc2EdkjInv6+mYfTuEm09r8LjVyHYmMWF3CPlf0pLK1qZJnTs6e4LVUOd35kvKye7c34M1b2UQma/nbc0ijZybrVpVSWVLAAQ+VOtMJ9XwNaABeATyEVdmTrje8RlV3ATcBt4vIdUA+VlL4KqxqoW/LLGpZqnqHqu5W1d21tbVpvl3mcOqm3ZJu6IhEA5PYddjWVEl03Lrknkn3QIx1Ls0Edrp345Pudu8mk0pvdDxrQj1Bp6won+rSgoxcFR/uiVJc4H9Pix9Mj2IM0oofuEhV/xIYVdWvAK8CtqVzcFvQzQnn3ANcCZwA7laLx4EksHopxrtJWVE+61aVurLiPxubpDc6HrimnLkSvBNTSU6fHcuoOFsqzgq8z+XKnjOjEySSalb8GaS5ujQjej3tkWFa68O+97T4xc6WKtojUcYmvJEuScfxO+2rQyKyFWsI+/qFXiQiZSISdu4DLweeBu4FbrS3twKFQP9iDfeCtoYwh1xY8Xf0Biux69BaH6Yw78IE78mhMZLqTmIXvOvedWr4g6Ryme00V5dkLNQTtIWQl2xvriKRVJ497U24Jx3Hf4eIVAMfBr4HPAv8XRqvqwceEZEDwOPAD1X1Pqymr40i8jRWE9g71GuhijS5csMqOvtHeSYNyeLF4FT0BC3UU5gfoq0xfIF0g1PRk0lVzlS86t7Nlq7dbKKpyqrlX86/cP/IOP0jEzlZ0eOww+7g9Uqpc17HLyIhYFhVB1X1YVXdqKp1qvr5hQ5sVwPtsG+Xqur/tbdPqOrbVHWrqu5S1Z9l6Fwyzht2NVNamMddvzyW0eN29EQpK8ybTo4Fia1NlTx96ux5/8jddlOXWyt+r7p3nUlfJsafOZqrS4hPJjkzOrHkY3RMSzXkXmLXoa6imMbKYs/i/PM6flVNkl6t/oqksrSA1+9q5nv7T2V0Sk5HZISL6sOBmwAFdoI3PjXdqQvWir8oP0RtuTsO06vu3chwHBFY7dJ55CKZkGd28mitDcG6AvaaHc1Vnkk0pxPquV9E/kREWkSkxrm5bllAeOc165lIJPnGr7szdswjvVFaA6pHsm2WBK8zYN2t0lOvund7o3FWlRVREEDBs2zFaeJaTpy/vSdKTVmhawuLbGFHSxXHzsQYii396ild0vkPeBdwO/AwsNe+7Zn3FSuITbXlXN9ay9ce62Jiavkt1QOjE4GOZ86W4HVDjnkmXnTvWpO3ctu5ZJqmDEziOhyxErtBvAL2EifO/5QH9fzpdO5umOW2IuWY5+LWa9bTFx3nRwdPL/tY5xK7wXT8hfkhLk7p4FVVjg/EXCvldPCie7fnbJwGU8qZUSqKC6gsWXotfzKpgVKp9ZOtzZWIeNPBm07nbqmIfFhE7rAfbxaRV7tuWYC4bnMtG2vLuOuXR5et3XNkWqMnmKEesBO8J60E78DoBKMTCdcqehy86N7tjcapM44/4zRVLb2k8/hgjNhEIielGmZSUVzAptpyT5Q60wn13AVMAC+0H58A/tY1iwJIKCTc+sL1HDhxln3dQ8s6VkdkhHBRfqBXntuaKhmOT9E9EJvu4nU71ON29+5kIkn/yIQJ9biAI8+8FA5PSzUYxw+WUuf+42ddH8WYjuPfpKp/j93IpapjQM4F435zVzPh4nzu+uXRZR2n3ZZqCHI8MzXBe9wjx+92965zXNO1m3ma7UlcS3FW7QGZOx0UdrZU0T8yzumz7l79puP4J2wJZgUQkU2AN1KKAaKsKJ83X9HCj5/u4fTZpa1uVK14ZtA/5K0N5RTkCQdPnqXbLut0O8bvdvfu9OQts+LPOE3VJcQmEgzGFj+jur0nytqaUsoCKj3tNV4pdabj+D8G3Ae0iMjXgQeAP3PTqKDy21evR1X52qNdS3p9/8gEg7HJwCZ2HYry87i4IczTJ8/SNRCjvqLI9cElbnfvRrJgyHq20ryMyp7DPcMmzJNCW2OYgjxxXakznaqenwK/CbwT+CawW1UfdNWqgNJSU8rLLqnnm493LykW7SR2s0GTZFuTNRWo+0yMdTXuqHKm4nb37rmuXeP4M03zEmv545MJjp2JZcX/g1cU5edxSWOF/yt+EfkelsDag6r6A1UNpKCaV9x6zQYGY5Pc++TJRb+2Iwsqehy2NlVydmyS/SeGXA/zgPvdu5HhOPkhoaa00JXj5zLNVUvr3n2+b4REUs2KfwY7Wqo4ePJsxmYZz0Y6oZ5PAS8CnhWR74jIG0QkZ5dNL9hQw5bGCu765bFFJ7M6ekeoLCmgNhz8OPPWNVaCd2Iq6YlGutvdu5HhcerCRYEafLNSqCjJJ1yUv+jKnvZpjR7j+FPZ3lzFyPgUnf3ujWJMJ9TzkKr+LrARuAN4E9b83ZxERLj1mvW0R6I8+vyZRb3WSuwGu6LH4eKGMPm2k3S7ht/Bze5dU8PvHiJC0xLkmdt7ohTmhVi/2v1QYjaxs8V9pc60REvsqp7XA+8DrgC+4ppFWcBrd6xhVVkhdy5CtVNVae+JBj6x61BckDddfeRFqAfc7d41XbvuYunyL27Ff7gnyqa6cqOdNIONq8spL8p3Nc6fToz/P4FDWMNTPotV1//7rlmUBRQX5PFbL1jLA4cjdNmSxQvRGx1nOD4VWHG22XDq+b0ah+dm925kOG5KOV3EmcS1mPBne0/UhHlmIRQStjVVuqrUmW7n7iZVfZ+tnX+1iHzWNYuyhLddtY48Eb7yq/RKO6cTu1n0QX/TFS389tXrWF3uTULUre7dsYkEw/EpE+pxkebqEqLjUwyPTaW1/9nYJD3DcZPYnYMdLVU8e3qY8Sl3OtnTifHfB2wTkb8TkWNYcg2HXbEmi6ivKOZV2xv5zp7jjIwv/GHviFiJmqA3b6Vy+bpq/vrmrZ7lJNzq3nXyBqaU0z2coULH04zzH+6xRpoaxz87O1sqmUwoh05nfuY3zOP4RaRVRD4iIoeAf8XS6BFVvUFV/8UVa7KMW6/ZQHR8iu/uOb7gvkcilua4GQIyN25175rJW+7jDGRJt7KnPWIqeuZju93B61a4Z74V/2HgJcBrVPVa29l7MwI+S9jZUsVla6v4yqNdC9bcdkSibM6i+L4fON27kQwneHucWbtmxe8a55q40nP8h3uiVBQHW6zQTxori6kNF7HfpQTvfI7/9UAP8HMR+YKIvIQcFGdbiFuv2cDR/lEe7Ji7wtXS6BnJqjCPHzgr8t4Md+86xzMxfveoKi2grDAv7ZLO9h5Lgz8bSpv9QETY0VzlWmXPnI5fVe9R1f8FtAEPAn8I1IvIv4vIy12xJgu5aWsDDRXF8w5kP302TnR8Kis6dv3Ere7dyHCc4oIQFcVGCMwtnFr+dPR6VJWOHjN8ZSF2NFfS2T/KcHzx4ncLkU5yd1RVv66qrwaagf3AhzJuSZZSkBfi7Vev4xdH+qe1eGYS9KlbQcGt7l1r5GKxWV26jCPPvBCn7IXQxQ0VHliVvexoqUIVnnZBsG1RnROqOqCqn1fVGzNuSRbzlivXUpQf4q5fHZv1+SNZWNHjF25070aG49P5A4N7NKfZvdtuV/SYxO787Gip4s9f2cZaFzrnTctcBqgpK+SWnU3cve8EQ7GJC57viERZXV5ETZkRCFuI+nBRxhU6I8Nx6iuN43ebpqoShuNTC4YmDpvhK2lRWVLAbddtmq6YyiSuOn4ROSYiB0Vkv4jssbd9TERO2tv2i8gr3bTBK269dj3xySTfeuLC0s6O3hET30+T+opiejMY41dVK9STBcJ42c50SecC4Z72nihrKoupLCnwwizDLHix4r9BVXeq6u6Ubf9kb9upqj/ywAbXaWuo4OqNq/jqr44xlUhOb08mleeyYOpWUMh09250fIqxyYRp3vKAdEs6201i13dMqCeDvOvaDZw6G+cnz0Smt50cGmN0IsFms+JPi0x3754r5TQrfrdpmp7ENXecfzKR5Pm+EZPY9Rm3Hb8CPxWRvSJyW8r23xORp0TkThGpdtkGz7ixrY61NaXnDWQ/0mvimYsh0927ZvKWd6wqK6S4IDTvir+zb5TJhJrErs+47fivUdVdwE3A7SJyHfDvwCZgJ3Aaa9DLBYjIbSKyR0T29PX1uWxmZsgLCe944Xr2dA1y0C7BmtboqTMf9HTIdPduz1nTtesVImKpdM4j2+Bo9JiFkL+46vhV9ZT9sxe4B7hSVSOqmlDVJPAF4Mo5XnuHqu5W1d21tbVumplR3ri7mbLCvOlVf0ckSn1FEZWlJpGVDpnu3nVknk2oxxuaqubX5W/viZIXEjbVmeErfuKa4xeRMhEJO/ex5vY+LSKNKbu9DnjaLRv8oKK4gDfubuH7T52iNxo3Ug2LJNPdu73D44SL8yktNF27XrBQLX97T5SNq8soys/z0CrDTNxc8dcDj4jIAeBx4Ie2xPPf2yWeTwE3YElBrCje8cL1TCWV/3i0i+d6R9hswjxpk+nuXWsAiwnzeEVzdSmDsUlG55Aqb4+Yip4g4NoySFU7gR2zbH+7W+8ZFDasLuOGi+v44iNHGZtMmBr+RZLJ7l0zectbpit7hsYuuNIdGZ/ixOAYb76ixQ/TDCmYck6XuPWa9cQmrFp0o9GzODLZvevo9Bi84Vwt/4Xhnna7Y9eUcvqPcfwuce1Fq6f1900N/+LIVPduMqn0Rk2ox0uap2v5L0zwOo7flHL6j8l4uYSI8OFXX8LDHX1UFJuKnsWQ2r1bXLD0JOBgbILJhBq5Bg9ZXVZEYf7stfztPcOUFeZNj2k0+Idx/C5yfWst17dmTylqUEjt3m2pWbpAlWne8p5QSGieo6TzcE+U1oYwoZCRx/YbE+oxBI5Mde+eq+E3jt9LmqpLODGjiUtVaY9ETZgnIBjHbwgcmeredQbjNBhJZk9pri65QK+nNzrOUGzS9LQEBOP4DYEjE927vzjSxyd/0sGutVU0mhW/pzRXl9I/MsHYxDmF1cPTFT3G8QcB4/gNgWO53buPHx3gvV/dw6a6cu5655UmpuwxzSm1/A7npm6ZUs4gYBy/IXA43btLqeV/6sQQ7/ryE6ypKuFr777SaCT5gFO1k1rL394zQm3YTKELCsbxGwJJbUXxojX523ui/Padj1NdVsA33nMVq8tNGacfOJO4Uit72iPDJrEbIIzjNwSSxXbvHu0f5a1f/DVF+SG+8Z6rTELXR+rCRRTkyXSoJ5FUjkRGuNgkdgODcfyGQLKY7t0TgzHe+oXHUFW+/p6rllX7b1g+oZCwJqWW/9iZUcankiaxGyCM4zcEknRn7/YOx3nbF3/NyPgUX333lVxUZ+QxgkCqPPM5qQaT2A0KxvEbAkk6s3cHRid425d+TW90nC+/60ouXVPplXmGBWiuKp3W6zncE0XEaFYFCeP4DYFkoe7d4fgk77jzcbrOxPjSO65g19oVM7p5RdBUXUJvdJz4ZIL2nmHWrypblu6SIbMYx28IJPN178YmpnjXXU9wuGeYz73tcq7etMpr8wwL4NTynxoao70nahK7AcM4fkMgmat7Nz6Z4Lav7mVf9yCfefNl3NBW54d5hgVwSjqP9I7QNRAzid2AYdQ5DYFktu7dyUSS3/vGkzzyXD+ffOMOXrmtcZ4jGPzEmcT1YHsvqkaDP2iYFb8hkMzs3k0klT/69gH+51CEv7n5Ut5webPPFhrmoz5cRH5I+NnhXsBo9AQN4/gNgcXp3k0mlT+/+yDfP3CKD93UxtuvXu+3aYYFyM8L0VhVTGR4nOKCEOtWlfltkiEF4/gNgcXp3v3rHzzLf+45zvtvvIj3Xb/Jb7MMaeJo9myuC5NnhPIChYnxGwJLfUUxP302QkdkhHdfu4E/fFmr3yYZFoGV4B0wYZ4AYlb8hsDiVPa85coWPvyqLYiYVWM24ZR0msRu8DArfkNgecPlLVSVFvKWK9cap5+FOKEes+IPHsbxGwJLQ2Uxb7tqnd9mGJbIS7fU894XbeCK9TV+m2KYgauhHhE5JiIHRWS/iOyZ8dyfiIiKyGo3bTAYDP5QXVbIX7zqEiPVEEC8WPHfoKr9qRtEpAV4GdDtwfsbDAaDIQW/krv/BPwZoD69v8FgMOQsbjt+BX4qIntF5DYAEXktcFJVD8z3QhG5TUT2iMievr4+l800GAyG3MHtUM81qnpKROqA+0XkMPAXwMsXeqGq3gHcAbB7925zZWAwGAwZwtUVv6qesn/2AvcA1wMbgAMicgxoBvaJSIObdhgMBoPhHK45fhEpE5Gwcx9rlf+Eqtap6npVXQ+cAHapao9bdhgMBoPhfNwM9dQD99iNN/nAN1T1Phffz2AwGAxp4JrjV9VOYMcC+6x36/0NBoPBMDuiGvy8qYj0AV1+2+ETq4H+BfdauZjzN+efy+cPy/sdrFPV2pkbs8Lx5zIiskdVd/tth1+Y8zfnn8vnD+78Dow6p8FgMOQYxvEbDAZDjmEcf/C5w28DfMacf26T6+cPLvwOTIzfYDAYcgyz4jcYDIYcwzh+g8FgyDGM4w8IIvIbItIuIs+JyIdmef6tIvKUffuViMzbHJdtLHT+KftdISIJEXmDl/a5TTrnLyIvtocaPSMiD3lto5uk8fmvFJHvi8gB+/xv9cNOtxCRO0WkV0SenuN5EZF/tn8/T4nIrmW9oaqam883IA94HtgIFAIHgEtm7PNCoNq+fxPwa7/t9vL8U/b7GfAj4A1+2+3x378KeBZYaz+u89tuj8//z4G/s+/XAgNAod+2Z/B3cB2wC3h6judfCfwYEOCq5f7/mxV/MLgSeE5VO1V1AvgWcHPqDqr6K1UdtB8+hqVsulJY8Pxtfh/4L6DXS+M8IJ3z/y3gblXthmnF25VCOuevQFgs8a9yLMc/5a2Z7qGqD2Od01zcDHxVLR4DqkSkcanvZxx/MGgCjqc8PmFvm4t3Y337rxQWPH8RaQJeB3zOQ7u8Ip2/fytQLSIP2oONftsz69wnnfP/V2ALcAo4CHxAVZPemBcIFusj5sWLmbuGhZFZts1aZysiN2A5/mtdtchb0jn/TwMfVNWErfi6kkjn/POBy4GXACXAoyLymKp2uG2cB6Rz/q8A9gM3ApuwBjv9QlWHXbYtKKTtI9LBOP5gcAJoSXncjLWyOQ8R2Q58EbhJVc94ZJsXpHP+u4Fv2U5/NfBKEZlS1Xs9sdBd0jn/E0C/qo4CoyLyMJb67Upw/Omc/63AJ9QKeD8nIkeBNuBxb0z0nbR8RLqYUE8weALYLCIbRKQQeDPwvdQdRGQtcDfw9hWyyktlwfNX1Q16boDPd4HfXSFOH9I4f+C/gReJSL6IlAIvAA55bKdbpHP+3VhXO4hIPXAx0Omplf7yPeC37eqeq4Czqnp6qQczK/4AoKpTIvJ7wE+wKhzuVNVnROR99vOfAz4CrAL+zV71TukKUS1M8/xXLOmcv6oeEpH7gKeAJPBFVZ219C/bSPPv/zfAl0XkIFbY44OqumLkmkXkm8CLgdUicgL4KFAA0+f/I6zKnueAGNYV0NLfzy4VMhgMBkOOYEI9BoPBkGMYx28wGAw5hnH8BoPBkGMYx28wGAw5hnH8BoPBkGMYx2/ISUSkXkS+ISKdtgTCoyLyOr/tMhi8wDh+Q85hC33dCzysqhtV9XKspqGVJHxnMMyJqeM35Bwi8hLgI6p6/SzPrQe+BpTZm35PVX8lIi8G/gqIADuxuqgPAh/A0s65RVWfF5EvA2NYcgLrsBpt3gFcjSWl+077ff4duMJ+7XdV9aOZP1ODYXZM564hF7kU2DfHc73Ay1Q1LiKbgW9i6QSBpY2zBUs+txOre/ZKEfkAlmT0H9j7VWOJib0W+D5wDfAe4AkR2amq+4G/UNUBEckDHhCR7ar6VIbP02CYFRPqMeQ8IvJZe7LTE1ht8l+wpQG+A1ySsusTqnpaVcexBof81N5+EFifst/3bTGxg0BEVQ/aEsLPpOz3JhHZBzyJ9UWU+j4Gg6uYFb8hF3kGeL3zQFVvF5HVwB7gD7HCOTuwFkbxlNeNp9xPpjxOcv7/0vgs+0zvJyIbgD8BrlDVQTs8VLzMczIY0sas+A25yM+AYhH5nZRtpfbPSuC0vUJ/O5ZoWKapAEaBs7bS5E0uvIfBMCdmxW/IOVRVReQW4J9E5M+APixH/EGs2P9/icgbgZ/b2zP9/gdE5EmsK49O4JeZfg+DYT5MVY/BYDDkGCbUYzAYDDmGcfwGg8GQYxjHbzAYDDmGcfwGg8GQYxjHbzAYDDmGcfwGg8GQYxjHbzAYDDnG/wepR2kHOejZaQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the results.\n",
    "plt.plot(gamma_list,average_rewards_gamma)\n",
    "plt.title('Run History')\n",
    "plt.xlabel('Gamma')\n",
    "plt.ylabel('Average Episode Reward')\n",
    "plt.show"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<function matplotlib.pyplot.show(close=None, block=None)>"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEWCAYAAABhffzLAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjQuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8+yak3AAAACXBIWXMAAAsTAAALEwEAmpwYAABLsElEQVR4nO29eXxcd3nv/35G0kgaraPFki1ZXmI7tmU7ju2EJEACJLESWtYWLpSEtaVQdlqW/i4XLm0v7W1LL5e2tJdCgdAECpS1lDghK5AQYjuLLe/xIln7vq+j5/fHOUeWZS1npDlzzmi+79frvDT7PCNpnnnmWT6PqCoGg8FgSB9CfhtgMBgMhuRiHL/BYDCkGcbxGwwGQ5phHL/BYDCkGcbxGwwGQ5phHL/BYDCkGcbxGwwJQEQGRWSj33YYDG4wjt+QkojIeREZsR1uq4h8XUTyPXouFZFNsy77nyLyb855Vc1X1bOLPM7LROSiFzYaDPFgHL8hlXmVquYDu4FrgT/11xxvEZFMv20wrAyM4zekPKraChzA+gCYM7K2vyHcZp/+nyLyHRG5R0QGRKReRPYtx4aZ3wpE5JUicsx+7CYR+RMRyQN+Bqyxv6UMisgaEckWkS+ISLN9fEFEsme+DhH5hIi0Al8TkaMi8qoZz5slIp0isns59hvSC+P4DSmPiFQDdwJn4rjbq4FvA8XAj4F/SKBJXwX+UFULgB3Aw6o6ZNvYbKeF8lW1GfjvwA1YH1rXANcDn5rxWJVACbAOeDdwD3DXjOtfCbSo6rMJtN+wwjGO35DK/FBEBoBGoB34TBz3/aWq/peqxoBvYjndhTgsIr3OAXxygdtOANtFpFBVe1T18AK3fQvwZ6rarqodwGeBu2dcPwV8RlXHVHUE+DfglSJSaF9/t22/weAa4/gNqcxr7aj6ZcBWoCyO+7bOOD0M5CySQ9+jqsXOAfzVArf9HaxI/IKIPCYiNy5w2zXAhRnnL9iXOXSo6qhzxv6W8Cvgd0SkGOtbxL0LPL7BcAXG8RtSHlV9DPg68Lf2RUNAxLleRDKA8iTa87SqvgZYBfwQ+I5z1Rw3b8ZK4zjU2JdNP9wc9/kGVrrnDcCTqtq0XJsN6YVx/IaVwheA2+0i5ymsCP63RCQLK2eenQwjRCQsIm8RkSJVnQD6gZh9dRtQKiJFM+7yLeBTIlIuImXAp7HSOQvxQ2AP8CGsnL/BEBfG8RtWBHZ+/B7gf6hqH/BHwFeAJqxvAMnsn78bOC8i/cB7sIuxqnoCy9GftWsFa4C/AA4CzwNHgMP2ZfNi5/r/A9gAfN+rF2FYuYhZxGIwpB4i8mlgi6reteiNDYZZmIEQgyHFEJES4F1c3v1jMLjGpHoMhhRCRP4Aq331Z6r6uN/2GFITk+oxGAyGNMNE/AaDwZBmpESOv6ysTNevX++3GQaDwZBSHDp0qFNVr5hhSQnHv379eg4ePOi3GQaDwZBSiMiFuS43qR6DwWBIM4zjNxgMhjTDOH6DwWBIM4zjNxgMhjTDOH6DwWBIM4zjNxgMhjTDOH6DwWBIM4zjNxgMK5LxySm+/ZsGYlNGlmY2xvEbDIYVyYPH2vjk94/w+KkOv00JHMbxGwyGFcnxln4Anr/Y57MlwcM4foPBsCJxHP+RJuP4Z2Mcv8FgWJGcaB0A4Khx/FdgHL/BYFhx9A1P0NQ7QmVhDq39o7QPjPptUqAwjt9gMKw4TrRaaZ7f2VsFmKh/NsbxGwyGFYeT3/+dPdWIwJGL/T5bFCyM4zcYDCuOE60DlOSF2VCWx8ayPI409fptUqAwjt9gMKw4jrcOsLWyABFhV3Wx6eyZhXH8BoNhRRGbUk629rO1shCAHVVFtPWP0d5vCrwOxvEbDIYVxYWuIUYnpti2ugCAnVVFgOnnn4lx/AaDYUVxvMXq39+22or4a9cUWgVe4/inMY7f4Bm/OtPJO772GyOSZUgqJ1r7yQgJm1blA5CXnclV5fmmpXMGxvEbPOPnx9t45GQH3UPjfptiSCOOt/SzsSyPnKyM6ct2VhUZzZ4ZGMdv8IzG7hEAuobGfLbEkE4cbxmYTvM47Kwqon3AFHgdjOM3eEZj9zAAXYMm4jckh/5RS6phq13YddhZbQq8MzGO3+AJqkpjj+X4OwdNxG9IDiecwm7l5RH/9tVWgdekeyyM4zd4QtfQOMPjMQA6TcRvSBKORs/sVI8p8F6OcfwGT2iw0zwAXSbiNySJ4y39FEeyqCjMvuK6XVVFJtVjYxy/wRMaL3P8JuI3JIfjLQNsqyxERK64bodd4G0zBV7j+A3e4Dj+DWV5KdvV0zc8wU+fb0HVzCGkApZUw8AVhV2H6QKvyfPP7/hF5IiIPD/fkUwjDalHY/cI5QXZVEdzUzbH/73DF3nffYc52mQkfVOBhu5hRiZiV+T3HbavLiRkJngByFzgut+2f77P/vlN++dbgOErb24wXKKhe5i10VxK88Kc6xzy25wlcdHuSjpQ3zodLRqCi6PBP7ujx8Ep8BrHv0DEr6oXVPUC8GJV/biqHrGPTwJ1yTPRkIo0dA9TUxKhLD87ZXP8Lb1WLvhAfavPlhjccKKln5DA5or8eW+z0xR4AXc5/jwReYlzRkRuAvK8M8mQ6kzEpmjpG6GmJEJpfjYjEzGGxyf9NitumvusyePT7YO80DHoszWGxTjeOsDG8vzLpBpms7O6iA5T4HXl+N8F/KOInBeRc8CXgHd6a5YhlWnuHWFKobokQml+GEjNzp7m3lFu3lIOmKg/FTje0s/WyrkLuw6ORHO6D3It6vhV9ZCqXgPsAnar6m5VPey9aYZUxenht1I9luNPtendsckYnYNj7K2Jsqu6iAP1bX6bZFiA/tEJLvaMzFvYddi+xhR4wYXjF5EKEfkq8O+q2ici20XkXW4eXEQ+IiL1InJURL4lIjki8gb7sikR2bfsV2AIHI44W01JhNI8a5Am1SL+1j4rFbCmOIe62kqea+ylxU79GILHyVZHg3/hiD8SzmTTKjPB6ybV83XgALDGPn8K+PBidxKRKuCDwD5V3QFkAG8CjgKvBx6P31xDKtDQPUxWhlBRmDOd6km1iL+p13LyVcW51NVWAvCAifoDy4mWuaUa5mKHXeBN5/kMN46/TFW/A0wBqOokEHP5+JlArohkAhGgWVWPq+rJJVlrSAkae4apjkbICAll+XbEn2Ka/E5Hz+riXDatyueq8jyT5w8wx1oGKMrNorIwZ9Hb7qxyCrypFYwkEjeOf0hESgEFEJEbgEW/J6lqE/C3QAPQAvSp6gNuDRORd4vIQRE52NHR4fZuhgDQ2D1MdTQXgJysDPKzM1Mu4m+2I/7VRZYjqaut5Klz3fSk2AdYunCi1SrsziXVMJtdRqLZleP/KPBj4CoR+RVwD/CBxe4kIlHgNcAGrDRRnojc5dYwVf2yqu5T1X3l5eVu72YIAE4Pv0NpfjjlcvzNfaOU5oWnWwPv2FFJbEp56ES7z5YZZjNlSzW4SfMAbF9dlPYFXjddPYeBW4CbgD8EalXVjWTDbcA5Ve1Q1Qng+/ZjGFYw/aMT9A5PXO7488Ipp9fT3DvCmuLc6fM7q4pYU5TD/UdNuidoNHQPMzweW7Sw65AbzmDTqnyOXOz11rAA41ak7XrgGmAP8GYReauL+zQAN4hIRKzvX7cCx5dmpiFVcMTZ1l4W8afe9G5L38h0mgdARNhfW8kvTnek5DDaSmY+Df6F2FlVzJGm/rQt8Lpp5/wmVq7+JcB19rFoG6aqPgV8DzgMHLGf68si8joRuQjcCPxURA4s3XxD0JjZyulQlh9OqRy/qtLUc3nED7C/toKxySkeO2lqTkHiWMsAIYEtFe4ifoCdVYV0DqZvgXchkTaHfcB2XcJHo6p+BvjMrIt/YB+GFchcEX9ZfjbdQ+PEppSM0OLFN7/pH51kaDzGmuLLO0SuX19CNJLFgfpW7ty52ifrDLM50dLPhrK8BaUaZuOI7j1/sZfKokqvTAssblI9R4H0+80YlkRD9zCFOZkU5WZNX1aaF2ZKoXc4NdI9zqDW7Ig/MyPEbdsqeOhEO+OTU36YZpiD4639bI0jzQOXCrzpOsi1kB7/T0Tkx0AZcExEDojIj50jeSYaUonGnmFqSiOXXVaaYr38l1o5c6+4rq62koHRSZ4825VsswxzMDA6QWP3CNsW0eiZTW44g82rCtK2s2ehVM/fJs0Kw4qhoXuYq2flWmdO78aTh/WLZnt4q6r4Ssf/ks1lRMIZHKhv5ZYtps3Yby5JNcQX8YM1wfvYqXZU1VX//0piIT3+x1T1MeAg8Av7dAtQBDyRJPsMKcTUlHKxe+Sywi5waXo3RTp7mntHyAwJ5QVXLuzOycrg5Vev4oH6NmJT6dkREiSO244/3lQPOAXecVrTUKLZTY7/cSDH1t55CHgHln6PwXAZ7QNjjMemLivsgpXjB+hKkc6elr5RKgpz5i1E76+toHNwjGcaepJsmWE2J1r6KczJZE3R4lINs9lZXQyk5w5eN45fVHUYS1jt71X1dUCtt2Ylhl+f7eKeJ8/7bUba0DBHRw9ANBImJKTM7t2m3pE50zwOL9+6iqwMCbx2z9hkjPuPtq7obybHW6zC7lJSNem8g9eV4xeRG7F27f7Uvsx935SPPFDfxuf+6zgTMdOBkQwaZ+jwzyQUEkryslNmerelb4TVxfNHkIU5Wbx4UxkH6tsCPQD0jSfO855/O8Qn/uN5plag83ekGrYvIc0D6V3gdeP4Pwz8KfADVa0XkY3AI55alSD2rCtmdGJqegmzwVsauocR4Yr+d3CGuIIf8U9NKa19o1e0cs6mrraShu5hTtg55iBy/9FWcrMy+N6hi3z2J/WB/pBaCo09wwyNxxbdurUQO6uLOJqGEs1utHoeU9VXq+r/ts+fVdUPem/a8tm7LgrA4QsmF5sMGruHWV2YQ3bmlV8ILaG24Ef8nYNjTMR00ZzxbdsqECGw2j3t/aMcbujlvS+7ij946Qa+8eQF/ubAylJDP96y9MKuw86qIjoHx2npS68C77ztnCLyBVX9sIj8BFuSeSaq+mpPLUsAq4tyWV2Uw6GGXt7+Yr+tWfk09gxfkd93KM3L5rme3uQatAScBSyLRfzlBdnsWxflQH0rH7l9SzJMi4sHjllLY+pqK9lSkc/weIwvPfoCedmZvO/lm3y2LjEcb+lHhCvah+NhR9UliebF/uYriYX6+L9p/0zpfv49NVET8SeJhu5hXrp57t72VJFmdnr45xremk1dbSV/8dPjNHRdObTmNwfqW9lQlseWinxEhD9/zQ6Gx2P8zYGT5GZl8M6XbPDbxGVzorWfDaV55IaXXnLcvrqQjJBwtKlvetNaOrBQH/8h++djcx3JM3F57FkXpal3hLY07NVNJqMTMdr6x64o7DqU5WczODbJ6ITb5W3+4Mg1LNTV4+A4iqB19/QNT/DkC13sr62Y7nYJhYS/+d1d1NVW8Gf/eYx/f7rBZyuXz/EW9xr882EVePN5Ps1aOt2oc75YRB4UkVMiclZEzonI2WQYlwj21BQDJs/vNRd7rlTlnElZiuzebeodIRLOoDB3cf3CtSURtq8u5P6AOf6HT7YxOaVXRLCZGSG++OZruWVLOZ/8/hF+9GyTTxYun8GxSRq6h5dV2HXYUZV+BV43XT1fBf6OS7LM++yfKUHtmiLCmSEOm2EbT7mkyjl3pFyalxrTuy29VkeP277wutpKDjf00D4QnG+UB462saogm932gNJMsjMz+Oe79nL9+hI++p3neCBgH1puWY5Uw2x2VRfRNZReBV43jr9PVX+mqu2q2uUcnluWIMKZIXZVFXG4oddvU1Y0jT1zD285OHo9Qe/lb+67Uod/Ie7YUYkqPGgXU/1mZDzGY6c6qKutJDTP5HFuOIOvvv06dlQV8f77nuEXp1Nvv4DTor3V5dathXAKvOmU7nHj+B8Rkb8RkRtFZI9zeG5ZAtmzLsqRi32MTQY7v5zKNHQNk5MVojz/Sn0buKTXE/Re/ube0bjG/7dU5LO+NBKYts7HT3cwMhFbtFCZn53JN95xHRvL8/iDew7y9PnuJFmYGE609lOQk+mqFrMYMwu86YIbx/8irPTO54DP20dKdfrsqYkyHpuivtkMcnlFQ/cwa6OReVMk0xF/gB3/2GSMzsGxuCJ+EaGutpInX+iib2TCQ+vccaC+laLcLF60sWTR2xZHwnzzXS9iTXEu7/za0zyfQjtoj7cMsK1yaVINs8nJsgq86TTB62aA6+VzHK9IhnGJYs+6YsAUeL2ksedKVc6ZRMKZRMIZgS7utvY5rZzxCX7tr61kckp55ES7F2a5ZiI2xUPH27l16yqyMtyt0y4vyObe338RRZEs3vqvv5nOnQcZR6ohEWkeh51VRRxJowLvQotY7rJ/fnSuI3kmLp9VBTlUR3NTrsD7yIl2PvCtZ5gMuNaQqtLYPf/wlkPQp3ed4a140wfXri1mVUG2722dT53tpm9kgrod8fWjry7K5b7fv4HszBBv+cpTnOsc8sjCxHCxZ4TBscmEFHYddlYX0T00TnOaFHgXCgucd3HBPEdKsXddlEMXelLqE/2nR1r4yXPNfO/QRb9NWZDe4QkGxyYXd/x52YHewtXiDG/F6fhDIWF/bQWPnuzwdU7hQH0rOVkhbp5niG4hakoj3Pv7L2JKlbf8y6+5aBfrg8jxVruwm4BWTofpCd40KfAu5PjXA6jqZ4EnVPWzM4+kWJdA9tREaesfS6lP9PN25PV3D55ieHzSZ2vmp2EeVc7ZBF2o7dLKxfi13etqKxmZiPH4KX86ZKamlAeOWVvBljrJumlVAd981/UMjk1y11eeoj2gQ4/TUg0JdPzpVuBdyPHfMeP0//baEK/ZU5N6gm3nOofYtrqQ9oEx/vWX5/w2Z14aFunhdyjNyw50qqe5b5TSvDA5WfE7zhs2llKYk8mBen/aOp+72Etb/9iyZQdq1xTx9XdeT/vAGHd99Sm6A/gN7UTLAOtL84iEFx+yc4tT4H3eOP6VxdbVBeRmZaRMnr9vZIKuoXFeu3sN+7dX8M+PnQ2s05zu4Y8unuPvHhoPrDZ8c298PfwzycoIcdu2Ch460ebL/of761vJDAm3bq1Y9mPtqYnylbft40LXMG/916cYnwxWjelEa39C0zwOO9Nognchx7/KLuT+8YzTKVncBeuNuau6KGUififNs74sj4/fsZWRiRh///AZn62am8buYUrzwuRlLxyBleZnMzml9I/63/Y4F829I0tK8zjsr62kd3iC35xLbk+8qvJAfRs3XlVKUSQrIY9501Vl/PlrdnC0qZ+jzcGJgofGJrnQPZzQwq7DrjQq8C7k+P8Fq4ibP+N0yhZ3wRrkqm/uD7xQGMD5LsvxbyzLY9OqfN64by33PnWBC13B67hocNHRA8HW61HVZUX8ALdsKScnK5T07p7T7YOc6xxif4LVJXfbOleODlMQONk2gGpiC7sOlwq8vQl/7KCxkDrnZxc6kmlkothbE2VySlNiUONsxxAilyQQPnLbZjJDoUAu02jsXriH3yHI07v9o5MMjceWNQmaG87g5s3lPFDfltR01gF7anj/9uWneWbi/C4cHaYg4Eg1eBHxb7MLvKngH5ZL2uT4Aa61I5hDKZDuOd81RFVx7nShcVVhDn/w0g385/MtPNfY669xM5iMTdHUO7JoYReCPb3ryDEvtGvXDXfsqKS1fzSpRcL761vZU1NMReHybJ9NXnYmpXnhQLV2nmgZoCA7k+po4pem5GRlsKWigCNNK3/CP60cf2l+NutLIymR5z/XOcSGsrzLLnv3LVdRmhfmL392PDAFqJa+UWJT6irin1boDKBQW7PLzVuLcevWCjJDkjTtnsbuYeqb+z1bIlIdzQ1Uqud4Sz9bVxckRKphLnZWFXLkYm9g3l9ekVaOH6w8/+GGYP9hVXVOx5+fnckHb93Mr8928+jJYCgqXpJjXtzxRyNZiAQz1eNs3lrjYvPWQhRFsrhhYykP1Lcm5X9s5opFL6guiQQm1aOqnGgdYGtl4tM8DjuriugZnpie4l6puFnE8iERKRSLr4rIYRHZnwzjvGBPTZTOwTEau4P7h+0aGmdgdJL1pXlXXPfm62tYXxrhr352glgA2iKne/gXaeUEaxFINBJM2Ybm3hEyQ0J5wdzqovFQV1vB2c4hzrQPJsCyhTlQ38rVFQWsL7vyfyURVEdzaeodCUQLriPVkEiNntnstHcYrPRBLjcR/ztVtR/YD5QD7wD+ylOrPGR6kCvA/fxOK+eG8ivfzOHMEB+r28rJtgH+47D/Ug6NPcNkhsR1G6Q1vRs8x9/SN0pFYQ4Z82jYx8P+JK1k7Bwc4+nz3XFr88TD2miEiZjSFoBFM14Wdh22VhaQGZIVr83vxvE774RXAl9T1edmXJZyXF1ZQF442INcZx3HP0fED/DKnZVcs7aYv3vglO+tqQ3dVgtkpks1SGt6N3ipnqbekYRouwNUFOZwbU2x5ysZf36sDVXrG4ZXOEXUIOT5T7QOWFINFd5F/DlZGWyuKFjxnT1u3q2HROQBLMd/QEQKgGCN8sVBRkjYXVMc6M6e851DZIZk3s4FEeFP79xKa/8o//orf6UcGruHXRV2HUrzw4EUamvpG1l2R89M6morOdrU72lHzIH6VqqjuWz3MAJ2ajdByPMfb+lnXUlk0UHB5bIrDSZ43Tj+dwGfBK5T1WEgjJXuWRQR+YiI1IvIURH5lojkiEiJvbz9tP0zugz7l8SemignWgcYGgum8Nm5ziFqSiILRtE3bCzl1q2r+KdHX6DHR0fqRo55JmX52YFL9cSmlNa+0WV39MzEKbY+4JF2z8DoBL8608UdtZWedbjApV7+oET8XhZ2HXZUWwXeILxmr3Dj+BXYDnzQPp8HLBoaiUiVfZ99qroDyADehPUh8pCqbgYess8nlT3rosSmlOcCOqE3V0fPXHzizq0MjU3yD4/4I+UwNDZJ19C4qx5+h9K8MAOjk4Fag9k5OMZETONaubgYG8ryuLqiwLM8/yMnOxiPTXma3wcr9bGqINv3iH94fJLzXUOe5vcddtoTvCu5wOvG8X8JuBF4s31+APhHl4+fCeSKSCaWvn8z8BrgG/b13wBe69bYRLFnrfUl45kALmCfmlLOdw256tLYUlHAG/au5ZtPXvDljemIs8WX6rG6ZoKk+pioHv7Z1NVW8PT5bk63JX6r1YH6Vsryw9PNCl4ShF7+k622VIOHHT0OToF3Jef5Xe3cVdX3AaMAqtqDle5ZEFVtwtrN2wC0AH2q+gBQoaot9m1agFVz3V9E3i0iB0XkYEdHYnvWiyJZXFWeF8hBrraBUUYnplxF/AAfuX0LoRD87QPJl3Jo6HLfyukwrdczECTHb/fwJ9jx33XjOkrywrz33sMJTSuOTsR49EQ7t2+vSEgX0mKsLYlMf8j7xfEW68NzWxJSPZcmeNPb8U+ISAZWygcRKcdFcdfO3b8G2ACsAfKcdY5uUNUvq+o+Vd1XXh7/RqHF2LsuyuGG4G3kOtdhd/S4dPyVRTm888Ub+NGzzUn/aup2ActMnIi/M0DTu45cw3KHt2azqiCH//uma3mhY5D//oMjCftfe+KFTobGY54Nbc2mOppLS9+orytAT7T2k++RVMNcrPQdvG4c/xeBH2BJM/8v4JfA51zc7zbgnKp2qOoE8H3gJqBNRFYD2D992VC9pyZKz/BE4PaLnuuKz/EDvOdlVxGNZCVdyuFizwgF2ZkUxyEFXBZAvZ6m3hHywhkU5ia+W+TFm8r4yG1b+OGzzdz3m4aEPOb9R1spyM7kpqvKEvJ4i7E2GiE2pbT4KFd8omWAqysLCCXhGw5YBd7eFVzgXdTxq+q9wMeBv8RK2bxWVb/r4rEbgBtEJCJW28GtwHHgx8Db7Nu8DfjRUgxfLnvXOYNcvX48/byc6xgiOzNEZRyCW4U5WXzgFZv51ZkuHj/d6aF1l9PQPUx1SSSurhIn4g/S9G5L7yiri3M96455/8s3cfOWcj7742PL/lY2GZvi58fbefnWVYQzk6O4Um2n8vxygqrK8dZ+tiUhv++wy5FoXqHpnnn/c+y2yxIRKcGKyr8F3IcVsZcs9sCq+hTwPeAwcMR+ri9jTf3eLiKngdvxaQr4qvJ8CnMyA9fPf77L6uiJN7J5yw01rC3J5a9+diJp4/VWD398X73zwhlkZ4YC1cvf3Lc8Hf7FCIWEL/y33ZTmh3nvvYfoG1n6IpqDF3roHhpPWpoHLq3U9CvP39Q7wsDoZFJaOR2uXuEF3oVChkPAQftnB3AKOG2fPuTmwVX1M6q6VVV3qOrdqjqmql2qequqbrZ/JnddkU0oJOyuifJMwCZ4z3YOzanRsxjZmRn8yf6rOd7Szw+fbfLAsstRVRriHN4Ca/gsaL38zb2jCW3lnIuSvDD/8Ht7aOkd5WPffW7JKbkD9a2EM0O87OrE173mY3VRLiL+RfzThd0ktHI6OAXeldrSudAilg2quhE4ALxKVctUtRT4bax8fcqztybKybYBBgKyCnAyNkVj9/CcGj1ueNWuNeysKuLzSZBy6BgYY2xyKq7hLQdLrycYEf/YZIzOwTFPI36HveuifPLOrTxwrI2v/CL+iWtnxeLNm8s8n16dSTgzxOrCHC761Mt/wtboudqDrVsLsau6iOcvrswCr5v/nutU9T3OGVX9mYj8uYc2JY0964pRhWcbe3np5uRFUPPR1DvCREzn1ehZjFDIknL4va88xT1PnufdN1+VYAsvMb1gfQmOvzQ/m7Z+/0W/AFrtguVydu3Gw7tesoGD53v4q/tPsLummOvWL5o1neZoUz9NvSN86LbNHlo4N9XRiH8Rf2s/NSUR8pP4YQfWKsZvP93IH3/3ObIzM5b0GLlZGXzk9s0U5CRmF3KicPOb7BSRTwH/htXSeRfQ5alVSWL32mJE4PCFYDj+cwuocrrlpk1l3LKlnH94+Axv3LeW4siiIxdLIh455tmU5oU51hyMLUeO7nqiBNoWQ0T46zfs4lV//0vef99hfvrBl06vpFyMA/WthARu2+adKNt8VJfk8uQL/rztT7QMJLWw63Dz5nLWlUb4xRIbJlStqfAN5XncfcO6BFu3PNw4/jcDn8Fq6QR4nEtTvClNQU4WV1cUBEap03H8S8nxz+STd27llV/8BV969AX+v1duS4RpV+DsM1hKX3VpfjZdQ2Ooqqc6M25osYe3VifJ8YPVhfWlt+zhdV96gg9/+1m+8c7rXQ1iHahv5UUbSinJ8+bDfCGqoxFa+5sYn5xKWjcRWFIN57qGeNU1a5L2nA41pREe+9jLl3x/VeXWzz/GA/WtgXP8bto5u1X1Q8AtwEtV9UN+FWS94Noaa5ArCIsmzncOUZCdOd3rvlS2rS7k9ddW8/Unznu2Saihe5jKwpzpncDxUJYfZiKm9I/6L5LnyDUkK9XjULumiM++upZfnunkiw+dXvT2L3QMcrp90FMJ5oVYG81F9dLvK1mcahtENbmF3UQhIuyvreTJF7roGw5GHdHBzQaunSLyDFZLZr2IHBKRHd6blhz21BQzMDrJCx3eb0tajLOdlkZPIqLgj+7fAsDnPZJyaOgejkucbSaXlq7739nT3DdCWX54SR9gy+VN163l9ddW8cWHT/P4qYVlSRyxt/1JbOOciV+9/Ceml68kP9WTCOpqK5icUh4+6Y1K61Jx853t/wEfVdV1qroO+GOsfvwVwaVBLv/TPU4PfyKoKs7lrTes4wfPNNExkHgHezFOOeaZODntIPTyN/eOsjrBUg1uERH+4nU72Lwqnw//+7PT0hFzcaC+jV3VRUnpPpoLv3r5j7f0kxfOWFItKQhcU11MRWE29x/1dilPvLhx/Hmq+ohzRlUfxZJmXhFsKMsjGsnyfZBrbDJGU89IQnenvn5PNarw8+OJjTbGJmO09I/G3cPvUJpn6/V48IEUL829I6xJ4AKWeImEM/nSW/YwOhHj/fc9w8QcejgtfSM819ib1KGt2VTaaym9XCwzF8dbkyvVkGhCIaGutpLHTnUwMh4cKXI3jv+siPwPEVlvH58C/F37lEBExM7z9/pqR2P3MFMKGxPo+LetLmBtSW7CNeGbekZQXVpHD8xQ6PQ54ldVmntHfIv4HTatKuAvX7+TQxd6+Ov7T1xxvbPMxU/Hn5kRYk1xznRRPxmoKsdb+tmagvn9mdTVVjI6McXjpxOrMrwcXC1bx1qy/n2szp4yXG7gShX2rotypn2Q3mH/HNFZW5UzkRG/iFC3vZInznTRn8AhtUY7z1tTujTHH80LRo6/f3SSofFY0lo5F+I1u6u464Ya/uUX5674oD5Q38pV5XlsWpXvk3UW1cWRpEb8zX2jDIxOpmRhdybXbyihKDfLs6U8S8FNV0+Pqn5QVfcA+4BP25r8K4Zra4oBeKax1zcbznctvGB9qdyxo5Lx2BSPnEicCOpyevgBsjJCFEeyfFfodHLqidy1uxz+x29vZ2dVEX/y3eemdx30DI3z1LluX6N9h7UludMf+snAKexuTfLEbqLJyghx67ZV/PxY25ypPD9w09Vzn4gUikgeUA+cFJGPeW9a8rimupiQwDM+5vnPdQ5RkhemKA6JYzfsqYlSlp+d0N2vF7uHCWeGWFXgbvBoLkrzwnT5rMnv1eatpZKdmcGX3rIHAd577yFGJ2I8dKKd2JRyh8crFt1QHY3QMTDmuRyIw6k2q9NuS0VqO36AO2or6R+d5KmzweiEd5Pq2a6q/VgrEv8LqAHu9tKoZJOXncm21YUc8rGzx+2e3XgJhYTbt1fwyMn2hL1hG7qHWRvNXVbBrTQ/23e9nunNWz7n+GeytiTC59+4m/rmfv7sP49x/9FW1hTlTO+B9de25C5eP90+QEVhNkW5wZI7WAo3byknNysjMOkeN44/S0SysBz/j+ylKv5POyWYPTVRnm3oJebTINe5JapyuqGutoLh8Ri/TJBWf8MyWjkdygOg0NncO0JmSChfxjcXL7h9ewV/ePNG7nuqgYdPtLG/ttL3CWeY2cufnDz/6bZBNq9K/WgfLLXPW7aU88Cx1kAMi7rt4z+P1cL5uIisA4IhtJJA9qwrZmg8xikPFmMvxtDYJG39Y2xchkbPQtx0VRkF2ZkJizYalyDHPJvS/HAAcvyjVBblJGVvbbz8Sd3VXLc+ypTCfp+mdWfj1HSSkeefmlLOtA+yucLfgnYiqdtRQVv/GM9e7PXbFFfF3S+qapWqvlItLgBLF7AIKHtrLJVEP/r5ncKuVxF/ODPEK7at4ufH25a9N7VveIL+0cnlO/68bPpGJhif9K/Y1dQ7Eqg0z0yyMkL80117+fPX7uCGDaV+mwPAqoJswhmhpET8Tb0jjEzEVkzED/CKrRVkhiQQ6Z6FNnDdZf/86OwD+GDSLEwSa0tyKcsP+zLBe77TeiN5keN3qKutpGd4gqfPL+/1OR091cucpHRkG3p8bKH1e3hrMcrys7n7hnWBGV4KhYSqaC4Xk9DLf7rd+ua9kiL+otwsbryqlAfq23zX+F8o4ne8UME8x4rCGeR6xodBrnOdVvfC+jLvxtJv2VJOODO07GjDGdlfbsQ/PcTlU54/NqW09Y8mVZVzJVAdzU1KxH/a7ujZ7PPsQqKpq63kXOcQp9v91QZbaAPX/7N/fnauI3kmJo+966Kc6xxK+mDRuU5L6TIS9m7RRF52JjdvLueB+tZlRRvTPfxLFGhzuLR03Z+Iv3NwjImYBqaVM1WojkaSkuM/3T5IeUG2Z/sk/GL/9gpE8F27x00f/0YR+YmIdIhIu4j8SEQ2JsO4ZLOnxhJsS3bUf65z0NNo36GutoLmvtFlLZBu7B4mGsla9kYhR6jNr4h/uoc/yXLMqU51NJfuoXGGxryV1D7dNsCWFZTmcVhVmMOemqjveX43XT33Ad8BVgNrgO8C3/LSKL/YVV1EZkiSnuc/3zXMhjLv/8lv21ZBxjKLS0tZsD4Xl6SZ/Yn4p3v4TcQfF04br5e9/KrK6faV08o5m7raCuqb+2n0aYcxuHP8oqrfVNVJ+3BWMK44crIyqF1TmNTOnr7hCbqHxtmQhIg/mhfmRRtKlvU1s7F7mOoEOP6C7EzCGSE6fZredeQagtrVE1ScjWte5vmbekcYHo/5rk3kFY78xgPH/NPod+P4HxGRT9rKnOtE5OPAT0WkRETcb4pOEa6tifL8xb6kaWqcczR6khDxg/VP90LHEGeWUFyKTSlNvSMJifhFxNde/qbeEfLCGRTmJneBd6oz3cvvYbTqFD5XglTDXKwrzWNrZQEHfMzzu3H8/w34Q+AR4FHgvViKnYeAg55Z5hN710UZmYhxoiU5g1xOR08yIn64NAy0lHRPa/8oEzFNiOMHZ4jLp4i/1+roCcJEbCphbSsLeZrqObNCO3pmsr+2kqcvdPtW43IzwLVhgWPFFXn3JHkj17nOYULCsiUQ3LK6KJdrqot4YAmOv3GZqpyzKc3L9m0LV3PfiMnvLwERsTt7vIv4T7UNUJafPS3fvRK5o7bSWpLkU7pnoQGuj884/YZZ133OS6P8ZE1RDhWF2Ul0/ENURXPJzkzezte6HZU8d7Ev7sXZTitnoiL+svxsX4u7VQEe3goyVi+/dxG/VdhdudE+eLckyS0LRfxvmnH6T2ddd4cHtgQCEWHvumjSCrznO4eSlt93mC4uxflP19htfTtJlH59WX6YjsGxpE8xjk3G6Bwc833zVqqyNhrxLMevuvI0eubCWZL0qzNdDCRwSZJbFnL8Ms/puc6vKPbURLnYM0L7wKinz6OqlhzzEjdZLZWryvPZtCqfA3Fq9Dd2D7OmOJesDDelocUpzQ8zPjnFoMc94bNp7TOtnMuhOppL/+gkfSOJd1gtfaMMjk2yeYUWdmdS5yxJOpn8lYwLvYN1ntNznV9RXGsPch2+0Ovp83QOjjM4NumpRs981NVW8Jvz3XTHkWNPVA+/g7N0PdnpniYzvLUsLvXyJz7qdzp6VnqqBy4tSfIj3bOQ479GRPpFZADYZZ92zu9Mkn2+sKOqkHBGyPM8/7nOxO/ZdcsdtauJTSk/P+4+6m/oHklYYRdmDHEluZffDG8tj7VR74a4Ttuy6Cu1lXMmGfaSpEdPJG5JklsW0urJUNVCVS1Q1Uz7tHM+9VfiLEB2ZgY7qgo57HGe/7zt+DcmOccP1odbVXGu6zz/yLiVF1/qgvW5uCTbkNyIv8WO+CtNxL8knCEuL/L8p9sGKc0LU7KCO3pmUldbwdB4jF+dScySJLckJlm7AtlTE+X5pj5P9eLPdg6RlSG+SAOLWNHG46c7XemuOO17zps+EZT5JNTW3Ddi96Mnr5NqJVEcySI/O9ObiL99YMVO7M5FopckucU4/nnYuy7K+OQU9c1LFzRbjPOdQ9SURMhMULE0Xu7YUcn45BSPnVq8uNSY4FZOYDqqS/YQS3PvqOnoWQZWL3/i5ZlVldNtg2mR5nG4tCSpfdlLkuJhoT7+ZS0iFZGrReTZGUe/iHxYRK4RkSdF5Iit+lm4nOfxikuDXL2ePYdXC9bdct36Ekrywq60exLdww/WP31hTmbSp3eDvoAlFaiORhIe8bf1jzEwNrniWzlnU1dbSffQOAeTqBG2UKj5JICIfHMpD6yqJ1V1t6ruBvYCw8APgK8An1TVnfb5jy3l8b2mojCHquJczwq8U1PK+S5/HX9GSLht2yoeOdG+aEqroXuYSDgj4bnXsvxsOpM4vauqNPeOmIh/mVRHc2nsHk7oDIaz73qlqnLOh7MkKZka/Qs5/rCIvA24SUReP/uI83luBV6w9/VeDTxuX/4g8Dvxm50c9qyLcvB8tycDRi39o4xNTvnS0TOTutpKBsYmeeKFhYtLjd2WOFuitW2SrdfTPzrJ0HiMKtPRsyzWlkQYGo/RO5y4Xv7pVs40i/itJUllPHgseSsZF3L87wFuAIqBV806fjvO53kTlzT8jwKvtk+/AVg71x1E5N0iclBEDnZ0JH/AAeClm8po6x+jvrk/4Y/tdPT4GfEDvHhTGXnhjEWHuRq7hz3REyrNS65sw7Qcs3H8y2K6syeBef4z7QNEI1mUpklHz0zqaitp6h3haFPifc1cLNTO+UtVfS/wcVV9x6zjnW6fQETCWI7+u/ZF7wTeJyKHsHb3zvmuV9Uvq+o+Vd1XXl7u+gUlklu3rSIkS1OyXIyzAXH8OVkZvGzrKh481kpsau5oQ1Vp7BlOaA+/Q1lBOKlCbY4+UaJkJ9IVL3r5T7UNsrmiIC0VUxOxJCke3LSTfFNEPigi37OPD4hIPH38dwKHVbUNQFVPqOp+Vd2L9S3ghSXYnRRK87O5fkOJJ3+M851D5GZlUFHgvwOqq62kc3B83npG19A4w+Mxapa5Z3cuSvOy6RkeT1pHgzO8ZVI9y6O6JLG9/FZHz0BaTOzORTQvzPXrS7g/QI7/S1jF2S/Zxx7gn+J4jjczY1WjiKyyf4aATwH/HMdjJZ262kpOtQ1ytiP+xSULca5ziHWlEUIh/6Obl19dTjgjNO9iiEsL1j2I+PPDqEL3cHKi/ubeETJDMj1DYFgahTlZFOVmJSzibx8Yo390Mq1aOWdTV1vBmfZBXkiwr5kLN47/OlV9m6o+bB/vAK5z8+AiEgFuB74/4+I3i8gp4ATQDHwtXqOTyX5byTJeQbPFON85xMZyf9M8DgU5Wbx4UykHjrXOWVzyooffoTTJQ1zNvSNUFuWQEYAP3FSnOpqbsBz/6TRYvrIYl3yN91G/G8cfE5GrnDMishFwJSyhqsOqWqqqfTMu+7+qusU+PqnJ1uSNk6riXHZWFSX0jzEZm6Khe5j1pcFw/GB9s2nsHuFYy5XFJcfxV3uQ43cKeUlz/H2jZs9uglibwF7+0+1WK+emNOvomcmaYmtJUqKDzLlw4/g/hrV391EReQx4GPhjb80KFnfsqOTZxt5pOd/lcrFnhMkp9b2wO5PbtlfYhewr/+kauocpL8gmN5x4iYPpiD9JQm1meCtxONO7iYjdTrUNUhzJojzNU3D7ayt5rrF3uvvMK9ysXnwI2Ax80D6uVtVHPLUqYNTZe2ofPJaYqP9cQDp6ZlKWn82+9SVzirY5PfzePK8j2+B9xB+bUtr6rV27huWztiTC6MRUQv52Z9qtwm46dvTM5NKSJG+jflciMao6pqrPq+pzqurPdmAf2bSqgI3leQmruAfR8YP1T3eidWB6xsAh0Tr8MynKzSIzJEnR6+kcHGMipqaHP0EkqpdfVadbOdOdTaucJUne5vmNSJtL6mor+fXZbnoT0H1yrnOIgpzMwEnP7t9ufbOZ+U83EZuipW+EtQlU5ZyJiCRterfZLGBJKJcWsiwvLdExOEbfyERaF3ZnUldbwVPnuunxcL7FOH6X3FFbSWxKeeh4+7If63zXEBvL8gL3tXZtSYTaNYWXOf7m3hGm1JtWTodkTe+aBSyJxZmFWG4v/5npjh4T8YMVZMa7JCleFnX8YnGXiHzaPl8jItd7ZlFA2VVdxOqinISke852DPmu0TMfd9RWcrihl/Z+y0l62cPvUJofTopQm5FrSCx52ZmU5oWXHfGfmt66ZSJ+gJ1VRawpyvG0u8ftANeNWINYAAPAP3pmUUAREfZvr+DxUx0Mjy99OfjoRIzmvpHA5fcd6nbYxaVj1j9dY7f1pvYqxw9WYTkZqZ6m3hHywhkU5mR6/lzpQiJ0+U+3D1KYk0l5QXp39DiICPtrK/nF6eX5moVw4/hfpKrvA0YBVLUHCFZyOknU7ahkbHKKx10sLpmPhu5hVINX2HXYvCqfDWV50+mehu5hwhkhKgq9y4uX5oWTkupp6R1lTXFu4FJsqUx1yfJ7+U+3W8tXzN/lEnW1lq957KQ3ApVuHP+EiGQACiAi5UDyVsUEiOvXlxCNZC3rK1hQO3ocrGijgidf6KJveILG7mGqormeTrqWFWQzMhHzLLpxaO4bMa2cCaY6mktTzwhT8wj8Lca0Ro9J81zGdeujRCNZnmn3uHH8X8RamLJKRP4X8Evgc55YE3AyM0Lcuq2Cnx9vW/IuXsfxBzXHD1aef3JKefhkm6XK6WGaBy5N73YOeBv1N/eOUGWGtxLK2miE8dgU7QNLS9V1DY3TMzzBJlPYvYzMjBC3bavgYRdLkpaCmwGue4GPA38JtACvVdXvLnyvlUtdbSUDo5P8+mzXku5/vnOIsvwwhTnxCJwml2uqi6kozOb+o612D7+3UbIjmNbp4fTu6ESMzsFxs3krwSy3l98UdufH8TVPLtHXLISbrp4SoB1LYfM+oC1OWeYVxUs3lxEJZyx5wOJs51CgNHrmIhQS9m+v5JGTHfQOT3iiwz+T0nzv9XocuQ3T0ZNYLvXyL83xn2k3rZzz8ZLNZfzZa2rZvjrxa8ndpHoOAx3AKeC0ffqciBwWkb0Jtyjg5GRl8LKry3ngWNuS8prnfV6w7pY7dlROf8X0sqMHZip0ehfxN/eZ4S0vuNTLv7QC7+m2QQpyMqkoNB09s8nJyuCtN673pNvJjeO/H3ilqpapainWYpXvAH+E1eqZdtTVVtIxMMYzjfEtYh8cm6R9YCzQ+X2H6zeUUJRrfbFLVo7fy01cZnjLG3KyMlhVkL3kiP9Um9Ho8QM3jn+fqh5wzqjqA8DNqvprIC0/pl++dRVZGRJ3d4+jgbMxBRx/VkaIW7etAvA81ZOTlUFBdqanej0ttlxDpYn4E051NHfJEf+Z9kGT5vEBN46/W0Q+ISLr7OPjQI/d4pmWbZ2FOVncdFUZB+rnXlwyH6nQ0TOTD9+6hc+9bidFEe9LOqX5YU8VOpv7RijLD5OTlXhp6XRnbUmEi73xR/xdg2N0DY2bVk4fcOP4fw+oBn4I/AiosS/LAN7omWUBp662kgtdw5xoHXB9HyfiD3px16GmNMLvvagmKc9V6vH0brM9vGVIPNXRXJp7R+Pem3zaKewaVc6k46ads1NVP6Cq16rqblV9v6p2qOq4qp5JhpFB5PbtFYjEtybtXOcQq4tyPFlokup4Pb3b3DvCapPm8YS10QixKaW1P75FRY7jN62cycdNO2e5iPyNiPyXiDzsHMkwLsiUF2Szb100rjz/ua7U6Ojxg9L8bM+2cKmqvXnLRPxe4KzkjDfPf7ptgPzsTCo9lAMxzI2bVM+9WIvRNwCfBc4DT3toU8pQV1vJ8ZZ+Grrc5TfPdQZXldNvyvLDdA+NE1vi6P9C9I9OMjQeM7t2PWKtPeAXb2fP6bZBNpmOHl9w4/hLVfWrwISqPqaq7wRu8NiulMBZk+Ym3dMzNE7v8ERKdPT4QVl+NlNKQhbdzMbIMXvL6qJcRKAxTrE2S5zNpHn8wJVIm/2zRUR+S0SuxSr2pj1rSyJsW13oyvGf60qtwm6yKfVw966zeWu10enxhHBmiNWFOXFF/D1D43QOjplWTp9w4/j/QkSKgD8G/gT4CvBhL41KJe6oreRQQw8di4hUOR09G8qN45+L0jzvpneb7OGtKhPxe0Z1NMLFOHL8lzp6TMTvB24cf4+q9qnqUVV9uaruBbq9NixVqNtRgSo8eGzhIu+5ziFC4v0wVKpS5kT8HkzvtvSOkBmSaTE4Q+KpLolvIYsjzmZaOf3BjeP/e5eXpSVXVxSwrjSyqG72uc4h1pZECGeaNcdz4aVeT3PvCJVFOZ7uFEh3qqMRWvpHXUsIn2kfJC+cYbSTfGLeHXQiciNwE1AuIh+dcVUh1vCWAWtxSV1tJV/71Tn6RyfmlVs+lwKqnH5SnJtFRkg86eVv7hs1HT0eszaai6pVSF/n4v/8dPsAm8zWLd9YKPwMA/lYHw4FM45+4He9Ny11qKutZCKmPHKifc7rVTVlVDn9IhQSSvLCnvTyWz38JrL0knh7+U+1DbJ5lcnv+8W8Eb+qPgY8JiJfV9ULSbQp5bh2bTGrCrI5UN/Ka3ZXXXF9x8AYQ+Mx4/gXoTQv8Xo9sSmlrd/INXiN08vvZiFL7/A4HQNjxvH7yLyOfwbZIvJlYP3M26vqK7wyKtUIhYTbt1fw/cNNjE7ErhACC/qe3aBQlp+dcIXOzsExJmJqdu16TGWhVUNxU+C9JNVgCrt+4abS+F3gGeBTwMdmHIYZ1NVWMjIR4xenO6+4zjh+d5TmJ16vx+nhN7t2vSUzI8Sa4hxXqZ7TbZbj32Qift9wE/FPquo/eW5JinPDxlIKczI5UN/K7dsrLrvuXNcQ4YyQSTcsQmle4hU6nQUsZteu91QXR1xG/ANEwhlmrsJH3ET8PxGRPxKR1SJS4hyeW5ZihDND3Lqtgp8fb7tCnvZcxxA1pRHTTrgIpflhhsZjjIzHEvaYRq4heawtyXUl2+Bo9ITM+8E33Dj+t2Gldp4ADtnHQS+NSlXqaivoHZ7gN+cun287b1Q5XVHu9PInsLOnqXeEvHAGhTluvtwalkN1NELHwBijEwt/cJ9uHzBpHp9xo8e/YY5j42L3E5GrReTZGUe/iHxYRHaLyK/tyw6KyPWJeSn+c/OWcnKyQpdp90xNKee7ho3jd4Gj15PIPL8jx2z6xb3nkkrn/FF/38gEbf1jprDrM270+CMi8im7swcR2Swiv73Y/VT1pL24ZTewFxgGfgD8NfBZ+/JP2+dXBJFwJjdvLudAfRtTtrxwc98I45NTxvG7wJneTWRnT0vfqOnoSRJOL/9Cef4z7bZUg4n4fcVNqudrwDjWFC/AReAv4nyeW4EX7HkAxZr+BSgCmuN8rEBTV1tJa/8ozzf1ATP27Jqp3UUpzfMm4jcdPcnB0aFaKM/vdPSYiN9f3Dj+q1T1r7HlmVV1BIj3e/ObgG/Zpz8M/I2INAJ/C/zpXHcQkXfbqaCDHR0dcT6df9y6bRUZIZlO9ziqnBuNKueiTEszJyjHPzoRo3Nw3HT0JIlVBdmEM0ILRvyn2gbJyQqZjh6fceP4x0UkFytSR0SuAly/M0UkDLwaax4A4L3AR1R1LfAR4Ktz3U9Vv6yq+1R1X3l5udun853iSJgbN5ZOO/6znUNEwhmsKjDKkIsRCWcSCWckLOJv7bNaOU1HT3IIhYSqaO6C8sxOYdd09PiLG8f/GeB+YK2I3As8BHw8jue4Ezisqo5u8duA79unvwusmOKuQ11tBWc7hjjTPsB5W5zNFBfdYQ1xJSbib55u5TSpnmRRHV1YnvlM+yBbzPIV33HT1fMg8Hrg7Vjpmn2q+mgcz/FmLqV5wMrp32KffgVwOo7HSglu326tZLz/aCvnjDhbXJTlZ9OVIE3+JjvXbJQ5k0d1NDJvjr9/dIKWvlE2meUrvuOmq+d1WNO7P1XV/wQmReS1bh5cRCLA7VyK8AH+APi8iDwHfA54d9xWB5zKohx2ry3mP59vobFnxDj+OCjNy150m5lbfn68jWgki6qocfzJojqaS/fQOENjk1dcd8bR6DERv++4SvWoap9zRlV7sdI/i6Kqw6paOuv+v1TVvap6jaq+SFUPxW11CnDHjkpOtA4Qm1LWG8fvmrL8cEIi/qbeER481sabrq8hK8Msv0kWa0ucls4ro/7T01u3TMTvN27eEXPdxoxBLkJdbeX0aRPxu6c0P0z30Pj0HMRSuffXlpL4XTesS4RZBpdUR50hrivz/KfbBsnODE33+xv8w43jPygifyciV4nIRhH5P1iyDYYF2FCWxxY7sjGO3z2lednEppS+kYklP8boRIxvP93I7dsrTNtgkpnu5e+ew/G3Wxo9RrPKf9w4/g9gDXD9O/AdYAR4n5dGrRTefH0NO6uKiEbmXsdouJJp2YZl9PL/5/MtdA+N87Yb1yfIKoNbyvLD5GSF5k31mIndYLBgykZEMoAfqeptSbJnRfGOF2/gHS/e4LcZKUX5tGzDOJtWxX9/VeUbT5xn86p8bryqNMHWGRZDROzOnssj/oHRCZr7RtlsJnYDwYIRv6rGgGERKUqSPYY0Z7l6Pc809nKkqY+33rTezE74hNXLf3nE73T0mIg/GLgp0o4CR0TkQWDIuVBVP+iZVYa0ZbkKnfc8cZ6C7Exef+2Vu48NyWFtNMLhCz2XXeasWzQRfzBw4/h/ah8Gg+dEI2FEWNL0bvvAKD890sJdN6wjL9s0nvlFdTSX/tFJ+kYmKMq16ltn2gcJZ4aoKTEdPUFg0XeHqn7D1uqpUdWTSbDJkMZkhISSSJjOJfTyf/s3jUzElLtNC6evXOrlH6Yo18oSn2ob4Kpy09ETFNxM7r4KeBZLrwd7kcqPPbbLkMYsRa9nIjbFvU9d4OYt5WwsN3lkP7nUy38pz3+6bXC6vdngP27aOf8nlpBaL4CqPguYVhWDZ5TlZ8ed4z9Q30pb/xhvv8lE+34zu5d/aGySpt4RU9gNEG4c/+RMyQWb5Y1VGgwLULoEobZ7nrhATUmEW7YsoQfUkFCKI1nkhTOmI36no2eT0egJDG4c/1ER+T0gw167+PdYi9cNBk8ozQvTGYdQ27Hmfn5zvpu7b1hncsgBQERYWxKZlm1wOnpMqic4uJ3crcVavnIf0Ie1Rctg8ISy/DADY5OMTsRc3f6eJ8+TkxXijfvWemyZwS0ze/lPtw0QzjAdPUFi3q4eEckB3gNsAo4AN6rqlVqrBkOCcYa4uofGF92e1Ts8zg+fbeJ111ZRZKQxAkN1NMKTL3ShqpxuH2RjeR6ZRiU1MCz0l/gGsA/L6d+JtR/XYPCceJauf/fgRUYnpnir0eUJFNXRXIbGY/QOT3C6fcAMbgWMhfr4t6vqTgAR+Srwm+SYZEh3yuz9xIstXY9NKff8+jzXbyhh2+rCZJhmcInTy3+qbYDG7hHesNek4YLEQhH/tC6uSfEYkklZnuX4F4v4Hz3ZTmP3iFHhDCBOL/+jpzoAU9gNGgtF/NeISL99WoBc+7wAqqomxDJ4gqPXs5hQ2zeevEBlYQ77ayuSYZYhDpxlK4+caAdMK2fQmNfxq2pGMg0xGBwi4QxyskILTu++0DHI46c6+OPbt5jVigGkKDeLwpxMTrQOkJUhrC81HT1BwrxjDIFDRCjNW3h695tPXiCcEeJN19ck0TJDPDh5/o1l+aajJ2CYv4YhkJTlzy/UNjg2yX8cushv7VpNuV0INgQPJ8+/yeT3A4dx/IZAYun1zJ3q+cHhiwyMTfLWG40uT5BxNHu2mPx+4DCO3xBILIXOKyN+VeUbT15gV3URu9cWJ98wg2uciH+zifgDh3H8hkBiCbWNoXq5HuCTL3Rxpn2Qt91oVisGnT3rohRHsri2pthvUwyzMGuKDIGkNC/MREzpH5m8TIrh60+cpyQvzG/tWu2jdQY37Kou5tlP7/fbDMMcmIjfEEjK8q+c3r3YM8zPj7fxpuvWkpNluo0NhqViHL8hkMy1dP3epxoAuMusVjQYloVx/IZAUjot22BF/KMTMb79mwb2b69cVLHTYDAsjHH8hkBSVmDLNti9/D95rpme4QnealYrGgzLxjh+QyApiTipnjG7hfM8WyryuXFjqc+WGQypj3H8hkCSmREiGsmic3CMww29HG3q562mhdNgSAjG8RsCS2m+pddzz5PnKcjJ5HXXVvltksGwIjB9/IbAUpoX5mTrAI09w9x9w3ryss2/q8GQCDx7J4nI1cC/z7hoI/Bp4EbgavuyYqBXVXd7ZYchdSnLz+apc90A3G10eQyGhOGZ41fVk8BuABHJAJqAH6jqF5zbiMjngT6vbDCkNmV2L/8tW8rZUJbnszUGw8ohWd+dbwVeUNULzgViVeneCLwiSTYYUoxSe3r37Tet99cQg2GFkSzH/ybgW7MueynQpqqn57qDiLwbeDdATY1ZtpGO/Nau1UzEprhlS7nfphgMKwqZrX6Y8CcQCQPNQK2qts24/J+AM6r6+cUeY9++fXrw4EEPrTQYDIaVh4gcUtV9sy9PRsR/J3B4ltPPBF4P7E3C8xsMBoNhBsno438zV6Z5bgNOqOrFJDy/wWAwGGbgqeMXkQhwO/D9WVfNlfM3GAwGQxLwNNWjqsPAFeIqqvp2L5/XYDAYDPNjJBsMBoMhzTCO32AwGNIM4/gNBoMhzTCO32AwGNIMzwe4EoGIdAAXFr3hyqQM6PTbCB8xr9+8/nR+/bC838E6Vb1i9D0lHH86IyIH55q8SxfM6zevP51fP3jzOzCpHoPBYEgzjOM3GAyGNMM4/uDzZb8N8Bnz+tObdH/94MHvwOT4DQaDIc0wEb/BYDCkGcbxGwwGQ5phHH9AEJE7ROSkiJwRkU/Ocf1bROR5+3hCRK7xw06vWOz1z7jddSISE5HfTaZ9XuPm9YvIy0TkWRGpF5HHkm2jl7j4/y8SkZ+IyHP263+HH3Z6hYj8q4i0i8jRea4XEfmi/ft5XkT2LOsJVdUcPh9ABvACsBEIA88B22fd5iYgap++E3jKb7uT+fpn3O5h4L+A3/Xb7iT//YuBY0CNfX6V33Yn+fX/f8D/tk+XA91A2G/bE/g7uBnYAxyd5/pXAj8DBLhhue9/E/EHg+ux1lCeVdVx4NvAa2beQFWfUNUe++yvgeok2+gli75+mw8A/wG0J9O4JODm9f8e8H1VbQBQ1ZX0O3Dz+hUoEBEB8rEc/2RyzfQOVX0c6zXNx2uAe9Ti10CxiKxe6vMZxx8MqoDGGecv2pfNx7uwPv1XCou+fhGpAl4H/HMS7UoWbv7+W4CoiDwqIodE5K1Js8573Lz+fwC2Ye3vPgJ8SFWnkmNeIIjXRyxIMnbuGhZH5rhszj5bEXk5luN/iacWJRc3r/8LwCdUNWYFfSsKN68/E2tH9a1ALvCkiPxaVU95bVwScPP664BngVcAVwEPisgvVLXfY9uCgmsf4Qbj+IPBRWDtjPPVWJHNZYjILuArwJ2q2pUk25KBm9e/D/i27fTLgFeKyKSq/jApFnqLm9d/EehU1SFgSEQeB64BVoLjd/P63wH8lVoJ7zMicg7YCvwmOSb6jisf4RaT6gkGTwObRWSDiISxdhL/eOYNRKQGa3fx3SskypvJoq9fVTeo6npVXQ98D/ijFeL0wcXrB34EvFREMu1d1i8CjifZTq9w8/obsL7tICIVwNXA2aRa6S8/Bt5qd/fcAPSpastSH8xE/AFAVSdF5P3AAawOh39V1XoReY99/T8Dn8baX/wlO+qd1BWiWujy9a9Y3Lx+VT0uIvcDzwNTwFdUdc7Wv1TD5d//z4Gvi8gRrLTHJ1R1xcg1i8i3gJcBZSJyEfgMkAXTr/+/sDp7zgDDWN+Alv58dquQwWAwGNIEk+oxGAyGNMM4foPBYEgzjOM3GAyGNMM4foPBYEgzjOM3GAyGNMM4fkNaIiIVInKfiJy1JRCeFJHX+W2XwZAMjOM3pB220NcPgcdVdaOq7sUaGlpJwncGw7yYPn5D2iEitwKfVtVb5rhuPfBNIM++6P2q+oSIvAz4LNAG7Maaoj4CfAhLO+e1qvqCiHwdGMGSE1iHNWjzNuBGLCndt9vP80/AdfZ9v6eqn0n8KzUY5sZM7hrSkVrg8DzXtQO3q+qoiGwGvoWlEwSWNs42LPncs1jTs9eLyIewJKM/bN8uiiUm9mrgJ8CLgd8HnhaR3ar6LPDfVbVbRDKAh0Rkl6o+n+DXaTDMiUn1GNIeEflHe7PT01hj8v9iSwN8F9g+46ZPq2qLqo5hLQ55wL78CLB+xu1+YouJHQHaVPWILSFcP+N2bxSRw8AzWB9EM5/HYPAUE/Eb0pF64HecM6r6PhEpAw4CH8FK51yDFRiNzrjf2IzTUzPOT3H5e2lsjttM305ENgB/Alynqj12eihnma/JYHCNifgN6cjDQI6IvHfGZRH7ZxHQYkfod2OJhiWaQmAI6LOVJu/04DkMhnkxEb8h7VBVFZHXAv9HRD4OdGA54k9g5f7/Q0TeADxiX57o539ORJ7B+uZxFvhVop/DYFgI09VjMBgMaYZJ9RgMBkOaYRy/wWAwpBnG8RsMBkOaYRy/wWAwpBnG8RsMBkOaYRy/wWAwpBnG8RsMBkOa8f8DGHkHi/0y3wEAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.plot(gamma_list, percentage_finished_gamma)\n",
    "plt.title('Run History')\n",
    "plt.xlabel('Gamma')\n",
    "plt.ylabel('Percentage of Episodes Finished')\n",
    "plt.show"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.12"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}