Healthcare.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "019d51f2",
   "metadata": {},
   "source": [
    "### Problem Statement\n",
    "\n",
    "Congratulations – you have been hired as Chief Data Scientist of MedCamp – a not for profit organization dedicated in making health conditions for **working professionals** better. MedCamp was started because the founders saw their family suffer due to bad work life balance and neglected health.\n",
    "\n",
    "MedCamp organizes health camps in several cities with low work life balance. They reach out to working people and ask them to register for these health camps. For those who attend, MedCamp **provides them facility to undergo health checks or increase awareness by visiting various stalls (depending on the format of camp).** \n",
    "\n",
    "MedCamp has conducted 65 such events over a period of 4 years and they see a **high drop off between “Registration” and Number of people taking tests at the Camps.** In last 4 years, they have stored data of ~110,000 registrations they have done.\n",
    "\n",
    "One of the huge costs in arranging these camps is the amount of inventory you need to carry. If you carry more than required inventory, you incur unnecessarily high costs. On the other hand, if you carry less than required inventory for conducting these medical checks, people end up having bad experience.\n",
    "\n",
    "**The Process:**\n",
    "\n",
    "* MedCamp employees / volunteers reach out to people and drive registrations.\n",
    "* During the camp, People who “ShowUp” either undergo the medical tests or visit stalls depending on the format of health camp.\n",
    "\n",
    "**Other things to note:**\n",
    "\n",
    "* Since this is a completely voluntary activity for the working professionals, MedCamp usually has little profile information about these people.\n",
    "\n",
    "* For a few camps, there was hardware failure, so some information about date and time of registration is lost.\n",
    "\n",
    "* MedCamp runs 3 formats of these camps. The **first and second format provides people with an instantaneous health score.** The third format provides information about several health issues through various awareness stalls.\n",
    "\n",
    "Favorable outcome:\n",
    "\n",
    "* For the first 2 formats, a favourable outcome is defined as getting a health_score, while in the third format it is defined as visiting at least a stall.\n",
    "\n",
    "* You need to predict the chances (probability) of having a favourable outcome."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "794665e1",
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import pandas as pd\n",
    "import matplotlib.pyplot as plt\n",
    "import seaborn as sns\n",
    "\n",
    "import warnings\n",
    "warnings.filterwarnings(\"ignore\")\n",
    "\n",
    "pd.set_option('display.max_columns', 100)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "c8199280",
   "metadata": {},
   "outputs": [],
   "source": [
    "train = pd.read_csv(\"~/Downloads/Train.csv\")\n",
    "test = pd.read_csv(\"~/Downloads/test_l0Auv8Q.csv\")\n",
    "submission = pd.read_csv(\"~/Downloads/sample_submmission.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "id": "6ca1509f",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import the Additional Files for the Dataset\n",
    "fhc = pd.read_csv(\"~/Downloads/First_Health_Camp_Attended.csv\")\n",
    "shc = pd.read_csv(\"~/Downloads/Second_Health_Camp_Attended.csv\")\n",
    "thc = pd.read_csv(\"~/Downloads/Third_Health_Camp_Attended.csv\")\n",
    "hc = pd.read_csv(\"~/Downloads/Health_Camp_Detail.csv\")\n",
    "pp = pd.read_csv(\"~/Downloads/Patient_Profile.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "id": "d64bd79f",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Patient_ID', 'Health_Camp_ID', 'Donation', 'Health_Score',\n",
       "       'Unnamed: 4'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "fhc.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "id": "6a1458af",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Patient_ID', 'Health_Camp_ID', 'Health Score'], dtype='object')"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "shc.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "id": "efb5761d",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Patient_ID', 'Health_Camp_ID', 'Number_of_stall_visited',\n",
       "       'Last_Stall_Visited_Number'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "thc.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "350dda97",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Patient_ID', 'Online_Follower', 'LinkedIn_Shared', 'Twitter_Shared',\n",
       "       'Facebook_Shared', 'Income', 'Education_Score', 'Age',\n",
       "       'First_Interaction', 'City_Type', 'Employer_Category'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pp.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "id": "489bd531",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Health_Camp_ID', 'Camp_Start_Date', 'Camp_End_Date', 'Category1',\n",
       "       'Category2', 'Category3'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "hc.columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "id": "58b8e386",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Lets combine the train and test\n",
    "combined = pd.concat([train, test], ignore_index = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "id": "9a4a9f33",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "((110527, 8), (75278, 8), (35249, 8))"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combined.shape, train.shape, test.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "id": "b87cef23",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "110527"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "75278+35249"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "id": "7568d3ad",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Lets join patient profile to the combined dataset\n",
    "combined = pd.merge(combined, pp, on = ['Patient_ID'], how = \"left\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "id": "fe05e0f2",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Combine the health camps with the dataset\n",
    "combined = pd.merge(combined, fhc, on = ['Patient_ID', 'Health_Camp_ID'], \n",
    "        how = \"left\")\n",
    "\n",
    "combined = pd.merge(combined, shc, on = ['Patient_ID', 'Health_Camp_ID'], \n",
    "        how = \"left\")\n",
    "\n",
    "combined = pd.merge(combined, thc, on = ['Patient_ID', 'Health_Camp_ID'], \n",
    "        how = \"left\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "id": "b3c3e8f6",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Healthcare detail...\n",
    "combined = pd.merge(combined, hc, on = ['Health_Camp_ID'], \n",
    "        how = \"left\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "id": "401d0f72",
   "metadata": {},
   "outputs": [],
   "source": [
    "del pp, fhc, shc, hc"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "id": "7893b8b3",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Patient_ID</th>\n",
       "      <th>Health_Camp_ID</th>\n",
       "      <th>Registration_Date</th>\n",
       "      <th>Var1</th>\n",
       "      <th>Var2</th>\n",
       "      <th>Var3</th>\n",
       "      <th>Var4</th>\n",
       "      <th>Var5</th>\n",
       "      <th>Online_Follower</th>\n",
       "      <th>LinkedIn_Shared</th>\n",
       "      <th>Twitter_Shared</th>\n",
       "      <th>Facebook_Shared</th>\n",
       "      <th>Income</th>\n",
       "      <th>Education_Score</th>\n",
       "      <th>Age</th>\n",
       "      <th>First_Interaction</th>\n",
       "      <th>City_Type</th>\n",
       "      <th>Employer_Category</th>\n",
       "      <th>Donation</th>\n",
       "      <th>Health_Score</th>\n",
       "      <th>Unnamed: 4</th>\n",
       "      <th>Health Score</th>\n",
       "      <th>Number_of_stall_visited</th>\n",
       "      <th>Last_Stall_Visited_Number</th>\n",
       "      <th>Camp_Start_Date</th>\n",
       "      <th>Camp_End_Date</th>\n",
       "      <th>Category1</th>\n",
       "      <th>Category2</th>\n",
       "      <th>Category3</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>489652</td>\n",
       "      <td>6578</td>\n",
       "      <td>10-Sep-05</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>06-Dec-04</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>16-Aug-05</td>\n",
       "      <td>14-Oct-05</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>507246</td>\n",
       "      <td>6578</td>\n",
       "      <td>18-Aug-05</td>\n",
       "      <td>45</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>75</td>\n",
       "      <td>40</td>\n",
       "      <td>08-Sep-04</td>\n",
       "      <td>C</td>\n",
       "      <td>Others</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>16-Aug-05</td>\n",
       "      <td>14-Oct-05</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>523729</td>\n",
       "      <td>6534</td>\n",
       "      <td>29-Apr-06</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>22-Jun-04</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.402054</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>17-Oct-05</td>\n",
       "      <td>07-Nov-07</td>\n",
       "      <td>Second</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>524931</td>\n",
       "      <td>6535</td>\n",
       "      <td>07-Feb-04</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>07-Feb-04</td>\n",
       "      <td>I</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>01-Feb-04</td>\n",
       "      <td>18-Feb-04</td>\n",
       "      <td>First</td>\n",
       "      <td>E</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>521364</td>\n",
       "      <td>6529</td>\n",
       "      <td>28-Feb-06</td>\n",
       "      <td>15</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>70</td>\n",
       "      <td>40</td>\n",
       "      <td>04-Jul-03</td>\n",
       "      <td>I</td>\n",
       "      <td>Technology</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.845597</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>30-Mar-06</td>\n",
       "      <td>03-Apr-06</td>\n",
       "      <td>Second</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Patient_ID  Health_Camp_ID Registration_Date  Var1  Var2  Var3  Var4  Var5  \\\n",
       "0      489652            6578         10-Sep-05     4     0     0     0     2   \n",
       "1      507246            6578         18-Aug-05    45     5     0     0     7   \n",
       "2      523729            6534         29-Apr-06     0     0     0     0     0   \n",
       "3      524931            6535         07-Feb-04     0     0     0     0     0   \n",
       "4      521364            6529         28-Feb-06    15     1     0     0     7   \n",
       "\n",
       "   Online_Follower  LinkedIn_Shared  Twitter_Shared  Facebook_Shared Income  \\\n",
       "0                0                0               0                0   None   \n",
       "1                0                0               0                0      1   \n",
       "2                0                0               0                0   None   \n",
       "3                0                0               0                0   None   \n",
       "4                0                0               0                1      1   \n",
       "\n",
       "  Education_Score   Age First_Interaction City_Type Employer_Category  \\\n",
       "0            None  None         06-Dec-04       NaN               NaN   \n",
       "1              75    40         08-Sep-04         C            Others   \n",
       "2            None  None         22-Jun-04       NaN               NaN   \n",
       "3            None  None         07-Feb-04         I               NaN   \n",
       "4              70    40         04-Jul-03         I        Technology   \n",
       "\n",
       "   Donation  Health_Score  Unnamed: 4  Health Score  Number_of_stall_visited  \\\n",
       "0       NaN           NaN         NaN           NaN                      2.0   \n",
       "1       NaN           NaN         NaN           NaN                      NaN   \n",
       "2       NaN           NaN         NaN      0.402054                      NaN   \n",
       "3       NaN           NaN         NaN           NaN                      NaN   \n",
       "4       NaN           NaN         NaN      0.845597                      NaN   \n",
       "\n",
       "   Last_Stall_Visited_Number Camp_Start_Date Camp_End_Date Category1  \\\n",
       "0                        1.0       16-Aug-05     14-Oct-05     Third   \n",
       "1                        NaN       16-Aug-05     14-Oct-05     Third   \n",
       "2                        NaN       17-Oct-05     07-Nov-07    Second   \n",
       "3                        NaN       01-Feb-04     18-Feb-04     First   \n",
       "4                        NaN       30-Mar-06     03-Apr-06    Second   \n",
       "\n",
       "  Category2  Category3  \n",
       "0         G          2  \n",
       "1         G          2  \n",
       "2         A          2  \n",
       "3         E          2  \n",
       "4         A          2  "
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Preview the Dataset\n",
    "combined.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "id": "f3916d75",
   "metadata": {},
   "outputs": [],
   "source": [
    "combined[\"Social_Media\"] = combined.Online_Follower+\\\n",
    "combined.LinkedIn_Shared+\\\n",
    "combined.Twitter_Shared+combined.Facebook_Shared"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "id": "1d8a9350",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Registration Date\n",
    "\n",
    "combined[\"Registration_Date\"] = pd.to_datetime(combined.Registration_Date,\n",
    "                                               dayfirst=True)\n",
    "combined[\"First_Interaction\"] = pd.to_datetime(combined.First_Interaction,\n",
    "                                               dayfirst=True)\n",
    "\n",
    "combined[\"Camp_Start_Date\"] = pd.to_datetime(combined.Camp_Start_Date,\n",
    "                                               dayfirst=True)\n",
    "\n",
    "combined[\"Camp_End_Date\"] = pd.to_datetime(combined.Camp_End_Date,\n",
    "                                               dayfirst=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "id": "8f9974c1",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Diff_Int_Days\n",
    "combined[\"Interaction_Days\"] = combined[\"Registration_Date\"]-\\\n",
    "combined[\"First_Interaction\"]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "id": "8239633e",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Remove days from the new variable created above\n",
    "combined[\"Interaction_Days\"]= combined.Interaction_Days.dt.days"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "id": "e235ac22",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Camp Duration\n",
    "combined[\"Camp_Duration\"] = (combined[\"Camp_End_Date\"] - \n",
    "                             combined[\"Camp_Start_Date\"]).dt.days"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "id": "64d9b401",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Camp Start Date - Registration Date\n",
    "combined[\"magic1\"]= np.abs((combined[\"Camp_Start_Date\"] - \n",
    "                             combined[\"Registration_Date\"]).dt.days)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "id": "e5a034a0",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Camp End Date - Registration Date\n",
    "combined[\"magic2\"]= np.abs((combined[\"Camp_End_Date\"] - \n",
    "                             combined[\"Registration_Date\"]).dt.days)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "id": "4842ed5c",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Patient Duration\n",
    "combined[\"Patient_Duration\"] = np.abs((combined[\"Camp_End_Date\"] - \n",
    "                             combined[\"First_Interaction\"]).dt.days)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "id": "df7c65df",
   "metadata": {},
   "outputs": [],
   "source": [
    "# First Interaction >>Registration>>Camp is Org>>\n",
    "# Person Comes>>Health Camp>>health score else stall visit...\n",
    "\n",
    "# First Interaction Date >>Registration Date>>Camp Date\n",
    "# Cap End Date >> Camp Start Date>> Registration Date\n",
    "\n",
    "def dates_between(start, reg, end):\n",
    "    if(end>start>reg):\n",
    "        return 1\n",
    "    else:\n",
    "        return 0"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "id": "455adafe",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Apply the function\n",
    "\n",
    "combined[\"dates_seq\"] = combined.apply(lambda x:dates_between(x[\"Camp_Start_Date\"],\n",
    "                                     x[\"Registration_Date\"],\n",
    "                                     x[\"Camp_End_Date\"]),axis= 1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "id": "0e02ebf1",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Patient_ID</th>\n",
       "      <th>Health_Camp_ID</th>\n",
       "      <th>Registration_Date</th>\n",
       "      <th>Var1</th>\n",
       "      <th>Var2</th>\n",
       "      <th>Var3</th>\n",
       "      <th>Var4</th>\n",
       "      <th>Var5</th>\n",
       "      <th>Online_Follower</th>\n",
       "      <th>LinkedIn_Shared</th>\n",
       "      <th>Twitter_Shared</th>\n",
       "      <th>Facebook_Shared</th>\n",
       "      <th>Income</th>\n",
       "      <th>Education_Score</th>\n",
       "      <th>Age</th>\n",
       "      <th>First_Interaction</th>\n",
       "      <th>City_Type</th>\n",
       "      <th>Employer_Category</th>\n",
       "      <th>Donation</th>\n",
       "      <th>Health_Score</th>\n",
       "      <th>Unnamed: 4</th>\n",
       "      <th>Health Score</th>\n",
       "      <th>Number_of_stall_visited</th>\n",
       "      <th>Last_Stall_Visited_Number</th>\n",
       "      <th>Camp_Start_Date</th>\n",
       "      <th>Camp_End_Date</th>\n",
       "      <th>Category1</th>\n",
       "      <th>Category2</th>\n",
       "      <th>Category3</th>\n",
       "      <th>Social_Media</th>\n",
       "      <th>Interaction_Days</th>\n",
       "      <th>Camp_Duration</th>\n",
       "      <th>magic1</th>\n",
       "      <th>magic2</th>\n",
       "      <th>Patient_Duration</th>\n",
       "      <th>dates_seq</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>489652</td>\n",
       "      <td>6578</td>\n",
       "      <td>2005-09-10</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>2004-12-06</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>2005-08-16</td>\n",
       "      <td>2005-10-14</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>278.0</td>\n",
       "      <td>59</td>\n",
       "      <td>25.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>312</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>507246</td>\n",
       "      <td>6578</td>\n",
       "      <td>2005-08-18</td>\n",
       "      <td>45</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>75</td>\n",
       "      <td>40</td>\n",
       "      <td>2004-09-08</td>\n",
       "      <td>C</td>\n",
       "      <td>Others</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2005-08-16</td>\n",
       "      <td>2005-10-14</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>344.0</td>\n",
       "      <td>59</td>\n",
       "      <td>2.0</td>\n",
       "      <td>57.0</td>\n",
       "      <td>401</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>523729</td>\n",
       "      <td>6534</td>\n",
       "      <td>2006-04-29</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>2004-06-22</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.402054</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2005-10-17</td>\n",
       "      <td>2007-11-07</td>\n",
       "      <td>Second</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>676.0</td>\n",
       "      <td>751</td>\n",
       "      <td>194.0</td>\n",
       "      <td>557.0</td>\n",
       "      <td>1233</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>524931</td>\n",
       "      <td>6535</td>\n",
       "      <td>2004-02-07</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>2004-02-07</td>\n",
       "      <td>I</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2004-02-01</td>\n",
       "      <td>2004-02-18</td>\n",
       "      <td>First</td>\n",
       "      <td>E</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>17</td>\n",
       "      <td>6.0</td>\n",
       "      <td>11.0</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>521364</td>\n",
       "      <td>6529</td>\n",
       "      <td>2006-02-28</td>\n",
       "      <td>15</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>70</td>\n",
       "      <td>40</td>\n",
       "      <td>2003-07-04</td>\n",
       "      <td>I</td>\n",
       "      <td>Technology</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.845597</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2006-03-30</td>\n",
       "      <td>2006-04-03</td>\n",
       "      <td>Second</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>970.0</td>\n",
       "      <td>4</td>\n",
       "      <td>30.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>1004</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Patient_ID  Health_Camp_ID Registration_Date  Var1  Var2  Var3  Var4  Var5  \\\n",
       "0      489652            6578        2005-09-10     4     0     0     0     2   \n",
       "1      507246            6578        2005-08-18    45     5     0     0     7   \n",
       "2      523729            6534        2006-04-29     0     0     0     0     0   \n",
       "3      524931            6535        2004-02-07     0     0     0     0     0   \n",
       "4      521364            6529        2006-02-28    15     1     0     0     7   \n",
       "\n",
       "   Online_Follower  LinkedIn_Shared  Twitter_Shared  Facebook_Shared Income  \\\n",
       "0                0                0               0                0   None   \n",
       "1                0                0               0                0      1   \n",
       "2                0                0               0                0   None   \n",
       "3                0                0               0                0   None   \n",
       "4                0                0               0                1      1   \n",
       "\n",
       "  Education_Score   Age First_Interaction City_Type Employer_Category  \\\n",
       "0            None  None        2004-12-06       NaN               NaN   \n",
       "1              75    40        2004-09-08         C            Others   \n",
       "2            None  None        2004-06-22       NaN               NaN   \n",
       "3            None  None        2004-02-07         I               NaN   \n",
       "4              70    40        2003-07-04         I        Technology   \n",
       "\n",
       "   Donation  Health_Score  Unnamed: 4  Health Score  Number_of_stall_visited  \\\n",
       "0       NaN           NaN         NaN           NaN                      2.0   \n",
       "1       NaN           NaN         NaN           NaN                      NaN   \n",
       "2       NaN           NaN         NaN      0.402054                      NaN   \n",
       "3       NaN           NaN         NaN           NaN                      NaN   \n",
       "4       NaN           NaN         NaN      0.845597                      NaN   \n",
       "\n",
       "   Last_Stall_Visited_Number Camp_Start_Date Camp_End_Date Category1  \\\n",
       "0                        1.0      2005-08-16    2005-10-14     Third   \n",
       "1                        NaN      2005-08-16    2005-10-14     Third   \n",
       "2                        NaN      2005-10-17    2007-11-07    Second   \n",
       "3                        NaN      2004-02-01    2004-02-18     First   \n",
       "4                        NaN      2006-03-30    2006-04-03    Second   \n",
       "\n",
       "  Category2  Category3  Social_Media  Interaction_Days  Camp_Duration  magic1  \\\n",
       "0         G          2             0             278.0             59    25.0   \n",
       "1         G          2             0             344.0             59     2.0   \n",
       "2         A          2             0             676.0            751   194.0   \n",
       "3         E          2             0               0.0             17     6.0   \n",
       "4         A          2             1             970.0              4    30.0   \n",
       "\n",
       "   magic2  Patient_Duration  dates_seq  \n",
       "0    34.0               312          0  \n",
       "1    57.0               401          0  \n",
       "2   557.0              1233          0  \n",
       "3    11.0                11          0  \n",
       "4    34.0              1004          1  "
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combined.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "id": "15c0d77d",
   "metadata": {},
   "outputs": [],
   "source": [
    "combined[\"Registration_Days\"] = combined.Registration_Date.dt.day\n",
    "combined[\"Registration_Month\"] = combined.Registration_Date.dt.month\n",
    "combined[\"Registration_Year\"] = combined.Registration_Date.dt.year"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "id": "6aff38c8",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Camp Start Date and End Date\n",
    "combined[\"Camp_Start_Year\"] = combined.Camp_Start_Date.dt.year\n",
    "combined[\"Camp_End_Year\"] = combined.Camp_End_Date.dt.year\n",
    "combined[\"First_Int_Year\"] = combined.First_Interaction.dt.year"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "id": "2bb2b51c",
   "metadata": {
    "scrolled": true
   },
   "outputs": [],
   "source": [
    "# No of patients per day\n",
    "combined[\"Patients_Per_Day\"]= combined.groupby(\"Registration_Days\")\\\n",
    "[\"Patient_ID\"].transform(\"nunique\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "id": "b1f79520",
   "metadata": {},
   "outputs": [],
   "source": [
    "# No of patients per Month\n",
    "combined[\"Patients_Per_Month\"]= combined.groupby(\"Registration_Month\")\\\n",
    "[\"Patient_ID\"].transform(\"nunique\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "id": "996ae63d",
   "metadata": {},
   "outputs": [],
   "source": [
    "# No of patients per year\n",
    "combined[\"Patients_Per_Year\"]= combined.groupby(\"Registration_Year\")\\\n",
    "[\"Patient_ID\"].transform(\"nunique\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "id": "af51cd54",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Frequency of Patient ID\n",
    "combined[\"Patient_Frequency_Per_Day\"] = combined.groupby(\"Patient_ID\")[\"Registration_Days\"].transform(\"nunique\")\n",
    "combined[\"Patient_Frequency_Per_Month\"]= combined.groupby(\"Patient_ID\")[\"Registration_Month\"].transform(\"nunique\")\n",
    "combined[\"Patient_Frequency_Per_Year\"]= combined.groupby(\"Patient_ID\")[\"Registration_Year\"].transform(\"nunique\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "id": "3de93960",
   "metadata": {},
   "outputs": [],
   "source": [
    "# No Patients in Health Camps\n",
    "combined[\"Patient_Freq_HC\"] = \\\n",
    "combined.groupby(\"Health_Camp_ID\")[\"Patient_ID\"].transform(\"nunique\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "id": "5cff5617",
   "metadata": {},
   "outputs": [],
   "source": [
    "# No of Health Camps\n",
    "combined[\"Health_Camps_Year\"] = combined.groupby(\"Camp_End_Year\")\\\n",
    "[\"Health_Camp_ID\"].transform(\"nunique\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "id": "2ede3908",
   "metadata": {},
   "outputs": [],
   "source": [
    "# if the health_score>0 or health_score>0 or Num of Stall Visited>0\n",
    "# Return 1 else 0\n",
    "\n",
    "def tgt(hs, hs_, stall_visit, stall_no):\n",
    "    if((hs>0) or (hs_>0) or (stall_visit>0) or (stall_no>0)):\n",
    "        return(1)\n",
    "    else:\n",
    "        return(0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "id": "6771ca44",
   "metadata": {},
   "outputs": [],
   "source": [
    "combined[\"Target\"] = combined.apply(lambda x:tgt(x[\"Health_Score\"],\n",
    "                           x[\"Health Score\"],\n",
    "                           x[\"Number_of_stall_visited\"],\n",
    "                           x[\"Last_Stall_Visited_Number\"]), axis = 1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "id": "7759c535",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0    89993\n",
       "1    20534\n",
       "Name: Target, dtype: int64"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Check the Count of Target\n",
    "combined.Target.value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "id": "e8df9134",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Patient_ID</th>\n",
       "      <th>Health_Camp_ID</th>\n",
       "      <th>Registration_Date</th>\n",
       "      <th>Var1</th>\n",
       "      <th>Var2</th>\n",
       "      <th>Var3</th>\n",
       "      <th>Var4</th>\n",
       "      <th>Var5</th>\n",
       "      <th>Online_Follower</th>\n",
       "      <th>LinkedIn_Shared</th>\n",
       "      <th>Twitter_Shared</th>\n",
       "      <th>Facebook_Shared</th>\n",
       "      <th>Income</th>\n",
       "      <th>Education_Score</th>\n",
       "      <th>Age</th>\n",
       "      <th>First_Interaction</th>\n",
       "      <th>City_Type</th>\n",
       "      <th>Employer_Category</th>\n",
       "      <th>Donation</th>\n",
       "      <th>Health_Score</th>\n",
       "      <th>Unnamed: 4</th>\n",
       "      <th>Health Score</th>\n",
       "      <th>Number_of_stall_visited</th>\n",
       "      <th>Last_Stall_Visited_Number</th>\n",
       "      <th>Camp_Start_Date</th>\n",
       "      <th>Camp_End_Date</th>\n",
       "      <th>Category1</th>\n",
       "      <th>Category2</th>\n",
       "      <th>Category3</th>\n",
       "      <th>Social_Media</th>\n",
       "      <th>Interaction_Days</th>\n",
       "      <th>Camp_Duration</th>\n",
       "      <th>magic1</th>\n",
       "      <th>magic2</th>\n",
       "      <th>Patient_Duration</th>\n",
       "      <th>dates_seq</th>\n",
       "      <th>Registration_Days</th>\n",
       "      <th>Registration_Month</th>\n",
       "      <th>Registration_Year</th>\n",
       "      <th>Camp_Start_Year</th>\n",
       "      <th>Camp_End_Year</th>\n",
       "      <th>First_Int_Year</th>\n",
       "      <th>Patients_Per_Day</th>\n",
       "      <th>Patients_Per_Month</th>\n",
       "      <th>Patients_Per_Year</th>\n",
       "      <th>Patient_Frequency_Per_Day</th>\n",
       "      <th>Patient_Frequency_Per_Month</th>\n",
       "      <th>Patient_Frequency_Per_Year</th>\n",
       "      <th>Patient_Freq_HC</th>\n",
       "      <th>Health_Camps_Year</th>\n",
       "      <th>Target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>489652</td>\n",
       "      <td>6578</td>\n",
       "      <td>2005-09-10</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>2004-12-06</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>2005-08-16</td>\n",
       "      <td>2005-10-14</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>278.0</td>\n",
       "      <td>59</td>\n",
       "      <td>25.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>312</td>\n",
       "      <td>0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>2005.0</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2004</td>\n",
       "      <td>2649.0</td>\n",
       "      <td>6585.0</td>\n",
       "      <td>15710.0</td>\n",
       "      <td>9</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>2837</td>\n",
       "      <td>19</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Patient_ID  Health_Camp_ID Registration_Date  Var1  Var2  Var3  Var4  Var5  \\\n",
       "0      489652            6578        2005-09-10     4     0     0     0     2   \n",
       "\n",
       "   Online_Follower  LinkedIn_Shared  Twitter_Shared  Facebook_Shared Income  \\\n",
       "0                0                0               0                0   None   \n",
       "\n",
       "  Education_Score   Age First_Interaction City_Type Employer_Category  \\\n",
       "0            None  None        2004-12-06       NaN               NaN   \n",
       "\n",
       "   Donation  Health_Score  Unnamed: 4  Health Score  Number_of_stall_visited  \\\n",
       "0       NaN           NaN         NaN           NaN                      2.0   \n",
       "\n",
       "   Last_Stall_Visited_Number Camp_Start_Date Camp_End_Date Category1  \\\n",
       "0                        1.0      2005-08-16    2005-10-14     Third   \n",
       "\n",
       "  Category2  Category3  Social_Media  Interaction_Days  Camp_Duration  magic1  \\\n",
       "0         G          2             0             278.0             59    25.0   \n",
       "\n",
       "   magic2  Patient_Duration  dates_seq  Registration_Days  Registration_Month  \\\n",
       "0    34.0               312          0               10.0                 9.0   \n",
       "\n",
       "   Registration_Year  Camp_Start_Year  Camp_End_Year  First_Int_Year  \\\n",
       "0             2005.0             2005           2005            2004   \n",
       "\n",
       "   Patients_Per_Day  Patients_Per_Month  Patients_Per_Year  \\\n",
       "0            2649.0              6585.0            15710.0   \n",
       "\n",
       "   Patient_Frequency_Per_Day  Patient_Frequency_Per_Month  \\\n",
       "0                          9                            7   \n",
       "\n",
       "   Patient_Frequency_Per_Year  Patient_Freq_HC  Health_Camps_Year  Target  \n",
       "0                           3             2837                 19       1  "
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "combined.head(1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "id": "b6e6ee47",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Drop the Columns - patient id, healthcamp id registration date,\n",
    "# Social media columns, All the Dates, Unnamed 4, \n",
    "\n",
    "newdata = combined.drop([\"Patient_ID\",\"Health_Camp_ID\", \n",
    "                         \"Registration_Date\",\n",
    "              \"Online_Follower\", \"LinkedIn_Shared\",\n",
    "              \"Twitter_Shared\", \"Facebook_Shared\",\n",
    "              \"First_Interaction\", \"Unnamed: 4\", \"Camp_Start_Date\",\n",
    "              \"Camp_End_Date\"], axis = 1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "id": "1ddbfe09",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([nan, 'C', 'I', 'D', 'B', 'A', 'E', 'G', 'H', 'F'], dtype=object)"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "newdata.City_Type.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "id": "1698ff27",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0.0003699935082811574\n"
     ]
    }
   ],
   "source": [
    "tbl = pd.crosstab(newdata.Category3, newdata.Target)\n",
    "\n",
    "import scipy.stats as stats\n",
    "teststats, pvalue, df, exp_freq = stats.chi2_contingency(tbl)\n",
    "print(pvalue)\n",
    "\n",
    "# Edu score, Empl Cat and City Cat are related with Target"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "id": "01589bc8",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Var1</th>\n",
       "      <th>Var2</th>\n",
       "      <th>Var3</th>\n",
       "      <th>Var4</th>\n",
       "      <th>Var5</th>\n",
       "      <th>Income</th>\n",
       "      <th>Education_Score</th>\n",
       "      <th>Age</th>\n",
       "      <th>City_Type</th>\n",
       "      <th>Employer_Category</th>\n",
       "      <th>Donation</th>\n",
       "      <th>Health_Score</th>\n",
       "      <th>Health Score</th>\n",
       "      <th>Number_of_stall_visited</th>\n",
       "      <th>Last_Stall_Visited_Number</th>\n",
       "      <th>Category1</th>\n",
       "      <th>Category2</th>\n",
       "      <th>Category3</th>\n",
       "      <th>Social_Media</th>\n",
       "      <th>Interaction_Days</th>\n",
       "      <th>Camp_Duration</th>\n",
       "      <th>magic1</th>\n",
       "      <th>magic2</th>\n",
       "      <th>Patient_Duration</th>\n",
       "      <th>dates_seq</th>\n",
       "      <th>Registration_Days</th>\n",
       "      <th>Registration_Month</th>\n",
       "      <th>Registration_Year</th>\n",
       "      <th>Camp_Start_Year</th>\n",
       "      <th>Camp_End_Year</th>\n",
       "      <th>First_Int_Year</th>\n",
       "      <th>Patients_Per_Day</th>\n",
       "      <th>Patients_Per_Month</th>\n",
       "      <th>Patients_Per_Year</th>\n",
       "      <th>Patient_Frequency_Per_Day</th>\n",
       "      <th>Patient_Frequency_Per_Month</th>\n",
       "      <th>Patient_Frequency_Per_Year</th>\n",
       "      <th>Patient_Freq_HC</th>\n",
       "      <th>Health_Camps_Year</th>\n",
       "      <th>Target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>278.0</td>\n",
       "      <td>59</td>\n",
       "      <td>25.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>312</td>\n",
       "      <td>0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>2005.0</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2004</td>\n",
       "      <td>2649.0</td>\n",
       "      <td>6585.0</td>\n",
       "      <td>15710.0</td>\n",
       "      <td>9</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>2837</td>\n",
       "      <td>19</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>45</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>75</td>\n",
       "      <td>40</td>\n",
       "      <td>C</td>\n",
       "      <td>Others</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Third</td>\n",
       "      <td>G</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>344.0</td>\n",
       "      <td>59</td>\n",
       "      <td>2.0</td>\n",
       "      <td>57.0</td>\n",
       "      <td>401</td>\n",
       "      <td>0</td>\n",
       "      <td>18.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>2005.0</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2004</td>\n",
       "      <td>3620.0</td>\n",
       "      <td>5804.0</td>\n",
       "      <td>15710.0</td>\n",
       "      <td>16</td>\n",
       "      <td>12</td>\n",
       "      <td>4</td>\n",
       "      <td>2837</td>\n",
       "      <td>19</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.402054</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Second</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>676.0</td>\n",
       "      <td>751</td>\n",
       "      <td>194.0</td>\n",
       "      <td>557.0</td>\n",
       "      <td>1233</td>\n",
       "      <td>0</td>\n",
       "      <td>29.0</td>\n",
       "      <td>4.0</td>\n",
       "      <td>2006.0</td>\n",
       "      <td>2005</td>\n",
       "      <td>2007</td>\n",
       "      <td>2004</td>\n",
       "      <td>2518.0</td>\n",
       "      <td>4785.0</td>\n",
       "      <td>19318.0</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "      <td>3597</td>\n",
       "      <td>9</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>None</td>\n",
       "      <td>I</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>E</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>17</td>\n",
       "      <td>6.0</td>\n",
       "      <td>11.0</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>7.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>2004.0</td>\n",
       "      <td>2004</td>\n",
       "      <td>2004</td>\n",
       "      <td>2004</td>\n",
       "      <td>2363.0</td>\n",
       "      <td>5029.0</td>\n",
       "      <td>9646.0</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>3</td>\n",
       "      <td>1882</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>15</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>70</td>\n",
       "      <td>40</td>\n",
       "      <td>I</td>\n",
       "      <td>Technology</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.845597</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Second</td>\n",
       "      <td>A</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>970.0</td>\n",
       "      <td>4</td>\n",
       "      <td>30.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>1004</td>\n",
       "      <td>1</td>\n",
       "      <td>28.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>2006.0</td>\n",
       "      <td>2006</td>\n",
       "      <td>2006</td>\n",
       "      <td>2003</td>\n",
       "      <td>3012.0</td>\n",
       "      <td>5029.0</td>\n",
       "      <td>19318.0</td>\n",
       "      <td>17</td>\n",
       "      <td>9</td>\n",
       "      <td>4</td>\n",
       "      <td>3823</td>\n",
       "      <td>18</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Var1  Var2  Var3  Var4  Var5 Income Education_Score   Age City_Type  \\\n",
       "0     4     0     0     0     2   None            None  None       NaN   \n",
       "1    45     5     0     0     7      1              75    40         C   \n",
       "2     0     0     0     0     0   None            None  None       NaN   \n",
       "3     0     0     0     0     0   None            None  None         I   \n",
       "4    15     1     0     0     7      1              70    40         I   \n",
       "\n",
       "  Employer_Category  Donation  Health_Score  Health Score  \\\n",
       "0               NaN       NaN           NaN           NaN   \n",
       "1            Others       NaN           NaN           NaN   \n",
       "2               NaN       NaN           NaN      0.402054   \n",
       "3               NaN       NaN           NaN           NaN   \n",
       "4        Technology       NaN           NaN      0.845597   \n",
       "\n",
       "   Number_of_stall_visited  Last_Stall_Visited_Number Category1 Category2  \\\n",
       "0                      2.0                        1.0     Third         G   \n",
       "1                      NaN                        NaN     Third         G   \n",
       "2                      NaN                        NaN    Second         A   \n",
       "3                      NaN                        NaN     First         E   \n",
       "4                      NaN                        NaN    Second         A   \n",
       "\n",
       "   Category3  Social_Media  Interaction_Days  Camp_Duration  magic1  magic2  \\\n",
       "0          2             0             278.0             59    25.0    34.0   \n",
       "1          2             0             344.0             59     2.0    57.0   \n",
       "2          2             0             676.0            751   194.0   557.0   \n",
       "3          2             0               0.0             17     6.0    11.0   \n",
       "4          2             1             970.0              4    30.0    34.0   \n",
       "\n",
       "   Patient_Duration  dates_seq  Registration_Days  Registration_Month  \\\n",
       "0               312          0               10.0                 9.0   \n",
       "1               401          0               18.0                 8.0   \n",
       "2              1233          0               29.0                 4.0   \n",
       "3                11          0                7.0                 2.0   \n",
       "4              1004          1               28.0                 2.0   \n",
       "\n",
       "   Registration_Year  Camp_Start_Year  Camp_End_Year  First_Int_Year  \\\n",
       "0             2005.0             2005           2005            2004   \n",
       "1             2005.0             2005           2005            2004   \n",
       "2             2006.0             2005           2007            2004   \n",
       "3             2004.0             2004           2004            2004   \n",
       "4             2006.0             2006           2006            2003   \n",
       "\n",
       "   Patients_Per_Day  Patients_Per_Month  Patients_Per_Year  \\\n",
       "0            2649.0              6585.0            15710.0   \n",
       "1            3620.0              5804.0            15710.0   \n",
       "2            2518.0              4785.0            19318.0   \n",
       "3            2363.0              5029.0             9646.0   \n",
       "4            3012.0              5029.0            19318.0   \n",
       "\n",
       "   Patient_Frequency_Per_Day  Patient_Frequency_Per_Month  \\\n",
       "0                          9                            7   \n",
       "1                         16                           12   \n",
       "2                          5                            4   \n",
       "3                          4                            4   \n",
       "4                         17                            9   \n",
       "\n",
       "   Patient_Frequency_Per_Year  Patient_Freq_HC  Health_Camps_Year  Target  \n",
       "0                           3             2837                 19       1  \n",
       "1                           4             2837                 19       0  \n",
       "2                           2             3597                  9       1  \n",
       "3                           3             1882                 14       0  \n",
       "4                           4             3823                 18       1  "
      ]
     },
     "execution_count": 43,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "newdata.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "id": "236ded69",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<AxesSubplot:xlabel='Category1'>"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAjoAAAHVCAYAAAD4slEKAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8qNh9FAAAACXBIWXMAAA9hAAAPYQGoP6dpAAA380lEQVR4nO3df1xW9f3/8eclv0SSSxEBKfyVyHRoKyxEV1oqaCo12/QzGssytFE6ps50zk/WSkv8VR/zR86llY22j9pqKsOsWeRvjKVGpqWJCWIKF/4aIJ7vH309n11iKghe8uZxv92u223nnNd1nde5unbj6fu8zzkOy7IsAQAAGKiRpxsAAACoKwQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjeXu6AU86d+6cDh8+rKZNm8rhcHi6HQAAcAUsy9KJEycUHh6uRo0uPWbToIPO4cOHFRER4ek2AABADeTn5+umm266ZE2DDjpNmzaV9N0XFRgY6OFuAADAlSgtLVVERIT9d/xSGnTQOX+6KjAwkKADAEA9cyXTTpiMDAAAjEXQAQAAxiLoAAAAYzXoOToAANRXlZWVqqio8HQbdcLHx0deXl618lkEHQAA6hHLslRYWKiSkhJPt1KnmjVrprCwsKu+zx1BBwCAeuR8yAkJCVGTJk2Mu+GtZVk6ffq0ioqKJEmtWrW6qs8j6AAAUE9UVlbaIadFixaebqfO+Pv7S5KKiooUEhJyVaexmIwMAEA9cX5OTpMmTTzcSd07f4xXOw+JoAMAQD1j2umqi6mtYyToAAAAYxF0AACAsQg6AADAWAQdAAAM4nA4LvkaPny4x3pr27at5s6de033yeXlAAAYpKCgwP7fb731lv77v/9be/bssdedv3T7SpWXl8vX17fW+rvWGNEBAMAgYWFh9svpdMrhcNjLPj4+euyxx3TTTTepSZMm6tKli/785z+7vb9379564oknNHbsWAUHB6tfv36SpHfeeUeRkZHy9/fX3XffrWXLlsnhcLjdoXnjxo2666675O/vr4iICI0ZM0anTp2yP/frr7/Wb37zG3t06VpgRKceaDtxtadbuCIHnh/o6RYAAJfw73//WzExMXryyScVGBio1atXKzk5We3bt1dsbKxdt2zZMv3qV7/Sxx9/LMuydODAAf30pz/Vr3/9az366KP65JNPNH78eLfP3rlzpxISEvSHP/xBS5Ys0dGjR/XEE0/oiSee0KuvvqqVK1fqlltu0ciRI5WSknLNjpmgAwBAA3HjjTe6BZTRo0crMzNTf/3rX92CTocOHTRjxgx7eeLEiYqKilJ6erokKSoqSrt27dJzzz1n16SnpyspKUlpaWmSpMjISL300kvq1auXFixYoKCgIHl5ealp06YKCwur4yP9PwQdAAAaiMrKSj3//PN666239M0336isrExlZWUKCAhwq+vWrZvb8p49e3T77be7rbvjjjvclnNycrRv3z4tX77cXmdZls6dO6f9+/erU6dOtXw0V4agAwBAAzFr1izNmTNHc+fOVZcuXRQQEKC0tDSVl5e71V0YfCzLqjKnxrIst+Vz585p1KhRGjNmTJX9tm7dupaOoPoIOgAANBAfffSR7rvvPv3iF7+Q9F042bt372VHW37wgx9ozZo1buu2b9/utnzbbbdp9+7d6tChw/d+jq+vryorK2vYfc1w1RUAAA1Ehw4dtG7dOm3cuFF5eXkaNWqUCgsLL/u+UaNG6fPPP9eTTz6pL774Qn/5y1+0dOlSSf/3TKonn3xSmzZt0uOPP67c3Fzt3btX77zzjkaPHm1/Ttu2bfXhhx/qm2++0bffflsnx3ghgg4AAA3ElClTdNtttykhIUG9e/dWWFiY7r///su+r127dvrf//1frVy5Ul27dtWCBQs0efJkSZKfn58kqWvXrtqwYYP27t2rO++8U7feequmTJmiVq1a2Z/zzDPP6MCBA7r55pvVsmXLOjnGCzmsC0+yNSClpaVyOp1yuVwKDAz0dDvfi8vLAQDSd5eH79+/X+3atVPjxo092stzzz2nhQsXKj8/v04+/1LHWp2/38zRAQAAlzV//nzdfvvtatGihT7++GOlp6friSee8HRbl0XQAQAAl7V37149++yzOn78uFq3bq1x48Zp0qRJnm7rsgg6AADgsubMmaM5c+Z4uo1qYzIyAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxuLwcAAADXOu76Nf0bvjz589Xenq6CgoK9MMf/lBz587VnXfeWcvd/R9GdAAAwDXx1ltvKS0tTZMnT9Ynn3yiO++8UwMGDNDBgwfrbJ8EHQAAcE3Mnj1bI0aM0KOPPqpOnTpp7ty5ioiI0IIFC+psnwQdAABQ58rLy5WTk6P4+Hi39fHx8dq4cWOd7ZegAwAA6ty3336ryspKhYaGuq0PDQ1VYWFhne2XoAMAAK4Zh8PhtmxZVpV1tYmgAwAA6lxwcLC8vLyqjN4UFRVVGeWpTQQdAABQ53x9fRUTE6N169a5rV+3bp169OhRZ/vlPjoAAOCaGDt2rJKTk9WtWzfFxcXplVde0cGDB/XYY4/V2T4JOgAA4JoYNmyYjh07pmeeeUYFBQWKjo7WmjVr1KZNmzrbJ0EHAAAD1PROxddaamqqUlNTr9n+mKMDAACMVa2gM3XqVDkcDrdXWFiYvd2yLE2dOlXh4eHy9/dX7969tXv3brfPKCsr0+jRoxUcHKyAgAAlJibq0KFDbjXFxcVKTk6W0+mU0+lUcnKySkpK3GoOHjyowYMHKyAgQMHBwRozZozKy8urefgAAMBk1R7R+eEPf6iCggL7tXPnTnvbjBkzNHv2bM2bN0/btm1TWFiY+vXrpxMnTtg1aWlpWrVqlTIyMpSdna2TJ09q0KBBqqystGuSkpKUm5urzMxMZWZmKjc3V8nJyfb2yspKDRw4UKdOnVJ2drYyMjK0YsUKjRs3rqbfAwAAMFC15+h4e3u7jeKcZ1mW5s6dq8mTJ2vIkCGSpGXLlik0NFRvvvmmRo0aJZfLpSVLluj1119X3759JUlvvPGGIiIi9N577ykhIUF5eXnKzMzU5s2bFRsbK0lavHix4uLitGfPHkVFRSkrK0ufffaZ8vPzFR4eLkmaNWuWhg8frueee06BgYE1/kIAAIA5qj2is3fvXoWHh6tdu3b6r//6L3311VeSpP3796uwsNDtGRZ+fn7q1auX/QyLnJwcVVRUuNWEh4crOjrartm0aZOcTqcdciSpe/fucjqdbjXR0dF2yJGkhIQElZWVKScn53t7LysrU2lpqdsLAACYq1pBJzY2Vq+99pr+8Y9/aPHixSosLFSPHj107Ngx+06Hl3qGRWFhoXx9fdW8efNL1oSEhFTZd0hIiFvNhftp3ry5fH19L/m8jOnTp9vzfpxOpyIiIqpz+AAAoJ6pVtAZMGCAHnjgAXXp0kV9+/bV6tWrJX13iuq8mjzD4sKai9XXpOZCkyZNksvlsl/5+fmX7AsAANRvV3V5eUBAgLp06aK9e/fa83Yu9QyLsLAwlZeXq7i4+JI1R44cqbKvo0ePutVcuJ/i4mJVVFRc8nkZfn5+CgwMdHsBAABzXVXQKSsrU15enlq1aqV27dopLCzM7RkW5eXl2rBhg/0Mi5iYGPn4+LjVFBQUaNeuXXZNXFycXC6Xtm7datds2bJFLpfLrWbXrl0qKCiwa7KysuTn56eYmJirOSQAAGCQal11NX78eA0ePFitW7dWUVGRnn32WZWWluqhhx6Sw+FQWlqapk2bpsjISEVGRmratGlq0qSJkpKSJElOp1MjRozQuHHj1KJFCwUFBWn8+PH2qTBJ6tSpk/r376+UlBQtWrRIkjRy5EgNGjRIUVFRkqT4+Hh17txZycnJSk9P1/HjxzV+/HilpKQwSgMAAGzVCjqHDh3Sz3/+c3377bdq2bKlunfvrs2bN9vPqJgwYYLOnDmj1NRUFRcXKzY2VllZWWratKn9GXPmzJG3t7eGDh2qM2fOqE+fPlq6dKm8vLzsmuXLl2vMmDH21VmJiYmaN2+evd3Ly0urV69WamqqevbsKX9/fyUlJWnmzJlX9WUAAFBvTXVe4/25qlX+4YcfKj09XTk5OSooKNCqVat0//33101v/8FhWZZV53u5TpWWlsrpdMrlcl3XI0FtJ672dAtXpL48ZwUA6qt///vf2r9/v9q1a6fGjRu7b7zOg87atWv18ccf67bbbtMDDzxw2aBzqWOtzt9vHuoJAADq3IABAzRgwIBrvl8e6gkAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFhcdQUAAOrcyZMntW/fPnt5//79ys3NVVBQkFq3bl1n+yXoAACAOrd9+3bdfffd9vLYsWMlSQ899JCWLl1aZ/sl6AAAYIJq3sDvWuvdu7c8cY9i5ugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AAPWMJyb1Xmu1dYwEHQAA6gkfHx9J0unTpz3cSd07f4znj7mmuLwcAIB6wsvLS82aNVNRUZEkqUmTJnI4HB7uqnZZlqXTp0+rqKhIzZo1k5eX11V9HkEHAIB6JCwsTJLssGOqZs2a2cd6NQg6AADUIw6HQ61atVJISIgqKio83U6d8PHxueqRnPMIOgAA1ENeXl61FgZMxmRkAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADDWVQWd6dOny+FwKC0tzV5nWZamTp2q8PBw+fv7q3fv3tq9e7fb+8rKyjR69GgFBwcrICBAiYmJOnTokFtNcXGxkpOT5XQ65XQ6lZycrJKSEreagwcPavDgwQoICFBwcLDGjBmj8vLyqzkkAABgkBoHnW3btumVV15R165d3dbPmDFDs2fP1rx587Rt2zaFhYWpX79+OnHihF2TlpamVatWKSMjQ9nZ2Tp58qQGDRqkyspKuyYpKUm5ubnKzMxUZmamcnNzlZycbG+vrKzUwIEDderUKWVnZysjI0MrVqzQuHHjanpIAADAMDUKOidPntSDDz6oxYsXq3nz5vZ6y7I0d+5cTZ48WUOGDFF0dLSWLVum06dP680335QkuVwuLVmyRLNmzVLfvn1166236o033tDOnTv13nvvSZLy8vKUmZmpP/7xj4qLi1NcXJwWL16sv//979qzZ48kKSsrS5999pneeOMN3Xrrrerbt69mzZqlxYsXq7S09Gq/FwAAYIAaBZ3HH39cAwcOVN++fd3W79+/X4WFhYqPj7fX+fn5qVevXtq4caMkKScnRxUVFW414eHhio6Otms2bdokp9Op2NhYu6Z79+5yOp1uNdHR0QoPD7drEhISVFZWppycnIv2XVZWptLSUrcXAAAwl3d135CRkaGcnBxt3769yrbCwkJJUmhoqNv60NBQff3113aNr6+v20jQ+Zrz7y8sLFRISEiVzw8JCXGruXA/zZs3l6+vr11zoenTp+vpp5++ksMEAAAGqNaITn5+vn79619r+fLlaty48ffWORwOt2XLsqqsu9CFNRerr0nNf5o0aZJcLpf9ys/Pv2RPAACgfqtW0MnJyVFRUZFiYmLk7e0tb29vbdiwQS+99JK8vb3tEZYLR1SKiorsbWFhYSovL1dxcfEla44cOVJl/0ePHnWruXA/xcXFqqioqDLSc56fn58CAwPdXgAAwFzVCjp9+vTRzp07lZuba7+6deumBx98ULm5uWrfvr3CwsK0bt06+z3l5eXasGGDevToIUmKiYmRj4+PW01BQYF27dpl18TFxcnlcmnr1q12zZYtW+Ryudxqdu3apYKCArsmKytLfn5+iomJqcFXAQAATFOtOTpNmzZVdHS027qAgAC1aNHCXp+WlqZp06YpMjJSkZGRmjZtmpo0aaKkpCRJktPp1IgRIzRu3Di1aNFCQUFBGj9+vLp06WJPbu7UqZP69++vlJQULVq0SJI0cuRIDRo0SFFRUZKk+Ph4de7cWcnJyUpPT9fx48c1fvx4paSkMFIDAAAk1WAy8uVMmDBBZ86cUWpqqoqLixUbG6usrCw1bdrUrpkzZ468vb01dOhQnTlzRn369NHSpUvl5eVl1yxfvlxjxoyxr85KTEzUvHnz7O1eXl5avXq1UlNT1bNnT/n7+yspKUkzZ86s7UMCAAD1lMOyLMvTTXhKaWmpnE6nXC7XdT0K1Hbiak+3cEUOPD/Q0y0AABqA6vz95llXAADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMVa2gs2DBAnXt2lWBgYEKDAxUXFyc1q5da2+3LEtTp05VeHi4/P391bt3b+3evdvtM8rKyjR69GgFBwcrICBAiYmJOnTokFtNcXGxkpOT5XQ65XQ6lZycrJKSEreagwcPavDgwQoICFBwcLDGjBmj8vLyah4+AAAwWbWCzk033aTnn39e27dv1/bt23XPPffovvvus8PMjBkzNHv2bM2bN0/btm1TWFiY+vXrpxMnTtifkZaWplWrVikjI0PZ2dk6efKkBg0apMrKSrsmKSlJubm5yszMVGZmpnJzc5WcnGxvr6ys1MCBA3Xq1CllZ2crIyNDK1as0Lhx4672+wAAAAZxWJZlXc0HBAUFKT09XY888ojCw8OVlpamJ598UtJ3ozehoaF64YUXNGrUKLlcLrVs2VKvv/66hg0bJkk6fPiwIiIitGbNGiUkJCgvL0+dO3fW5s2bFRsbK0navHmz4uLi9PnnnysqKkpr167VoEGDlJ+fr/DwcElSRkaGhg8frqKiIgUGBl6017KyMpWVldnLpaWlioiIkMvl+t73XA/aTlzt6RauyIHnB3q6BQBAA1BaWiqn03lFf79rPEensrJSGRkZOnXqlOLi4rR//34VFhYqPj7ervHz81OvXr20ceNGSVJOTo4qKircasLDwxUdHW3XbNq0SU6n0w45ktS9e3c5nU63mujoaDvkSFJCQoLKysqUk5PzvT1Pnz7dPh3mdDoVERFR08MHAAD1QLWDzs6dO3XDDTfIz89Pjz32mFatWqXOnTursLBQkhQaGupWHxoaam8rLCyUr6+vmjdvfsmakJCQKvsNCQlxq7lwP82bN5evr69dczGTJk2Sy+WyX/n5+dU8egAAUJ94V/cNUVFRys3NVUlJiVasWKGHHnpIGzZssLc7HA63esuyqqy70IU1F6uvSc2F/Pz85Ofnd8leAACAOao9ouPr66sOHTqoW7dumj59um655Ra9+OKLCgsLk6QqIypFRUX26EtYWJjKy8tVXFx8yZojR45U2e/Ro0fdai7cT3FxsSoqKqqM9AAAgIbrqu+jY1mWysrK1K5dO4WFhWndunX2tvLycm3YsEE9evSQJMXExMjHx8etpqCgQLt27bJr4uLi5HK5tHXrVrtmy5YtcrlcbjW7du1SQUGBXZOVlSU/Pz/FxMRc7SEBAABDVOvU1e9+9zsNGDBAEREROnHihDIyMvTPf/5TmZmZcjgcSktL07Rp0xQZGanIyEhNmzZNTZo0UVJSkiTJ6XRqxIgRGjdunFq0aKGgoCCNHz9eXbp0Ud++fSVJnTp1Uv/+/ZWSkqJFixZJkkaOHKlBgwYpKipKkhQfH6/OnTsrOTlZ6enpOn78uMaPH6+UlJTr+uopAABwbVUr6Bw5ckTJyckqKCiQ0+lU165dlZmZqX79+kmSJkyYoDNnzig1NVXFxcWKjY1VVlaWmjZtan/GnDlz5O3traFDh+rMmTPq06ePli5dKi8vL7tm+fLlGjNmjH11VmJioubNm2dv9/Ly0urVq5WamqqePXvK399fSUlJmjlz5lV9GQAAwCxXfR+d+qw61+F7EvfRAQDg/1yT++gAAABc7wg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYq1pBZ/r06br99tvVtGlThYSE6P7779eePXvcaizL0tSpUxUeHi5/f3/17t1bu3fvdqspKyvT6NGjFRwcrICAACUmJurQoUNuNcXFxUpOTpbT6ZTT6VRycrJKSkrcag4ePKjBgwcrICBAwcHBGjNmjMrLy6tzSAAAwGDVCjobNmzQ448/rs2bN2vdunU6e/as4uPjderUKbtmxowZmj17tubNm6dt27YpLCxM/fr104kTJ+yatLQ0rVq1ShkZGcrOztbJkyc1aNAgVVZW2jVJSUnKzc1VZmamMjMzlZubq+TkZHt7ZWWlBg4cqFOnTik7O1sZGRlasWKFxo0bdzXfBwAAMIjDsiyrpm8+evSoQkJCtGHDBt11112yLEvh4eFKS0vTk08+Kem70ZvQ0FC98MILGjVqlFwul1q2bKnXX39dw4YNkyQdPnxYERERWrNmjRISEpSXl6fOnTtr8+bNio2NlSRt3rxZcXFx+vzzzxUVFaW1a9dq0KBBys/PV3h4uCQpIyNDw4cPV1FRkQIDA6v0W1ZWprKyMnu5tLRUERERcrlcF62/XrSduNrTLVyRA88P9HQLAIAGoLS0VE6n84r+fntfzY5cLpckKSgoSJK0f/9+FRYWKj4+3q7x8/NTr169tHHjRo0aNUo5OTmqqKhwqwkPD1d0dLQ2btyohIQEbdq0SU6n0w45ktS9e3c5nU5t3LhRUVFR2rRpk6Kjo+2QI0kJCQkqKytTTk6O7r777ir9Tp8+XU8//fTVHDKA/68+BHDCN4AaT0a2LEtjx47Vj3/8Y0VHR0uSCgsLJUmhoaFutaGhofa2wsJC+fr6qnnz5pesCQkJqbLPkJAQt5oL99O8eXP5+vraNReaNGmSXC6X/crPz6/uYQMAgHqkxiM6TzzxhD799FNlZ2dX2eZwONyWLcuqsu5CF9ZcrL4mNf/Jz89Pfn5+l+wDAACYo0YjOqNHj9Y777yjDz74QDfddJO9PiwsTJKqjKgUFRXZoy9hYWEqLy9XcXHxJWuOHDlSZb9Hjx51q7lwP8XFxaqoqKgy0gMAABqmagUdy7L0xBNPaOXKlXr//ffVrl07t+3t2rVTWFiY1q1bZ68rLy/Xhg0b1KNHD0lSTEyMfHx83GoKCgq0a9cuuyYuLk4ul0tbt261a7Zs2SKXy+VWs2vXLhUUFNg1WVlZ8vPzU0xMTHUOCwAAGKpap64ef/xxvfnmm/rb3/6mpk2b2iMqTqdT/v7+cjgcSktL07Rp0xQZGanIyEhNmzZNTZo0UVJSkl07YsQIjRs3Ti1atFBQUJDGjx+vLl26qG/fvpKkTp06qX///kpJSdGiRYskSSNHjtSgQYMUFRUlSYqPj1fnzp2VnJys9PR0HT9+XOPHj1dKSsp1fQUVAAC4dqoVdBYsWCBJ6t27t9v6V199VcOHD5ckTZgwQWfOnFFqaqqKi4sVGxurrKwsNW3a1K6fM2eOvL29NXToUJ05c0Z9+vTR0qVL5eXlZdcsX75cY8aMsa/OSkxM1Lx58+ztXl5eWr16tVJTU9WzZ0/5+/srKSlJM2fOrNYXAAAAzHVV99Gp76pzHb4n1YfLeCUu5W1o6sPvkt8kYKbq/P3mWVcAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBY3p5uAACA2tB24mpPt3BZB54f6OkWGhxGdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFjVDjoffvihBg8erPDwcDkcDr399ttu2y3L0tSpUxUeHi5/f3/17t1bu3fvdqspKyvT6NGjFRwcrICAACUmJurQoUNuNcXFxUpOTpbT6ZTT6VRycrJKSkrcag4ePKjBgwcrICBAwcHBGjNmjMrLy6t7SAAAwFDVDjqnTp3SLbfconnz5l10+4wZMzR79mzNmzdP27ZtU1hYmPr166cTJ07YNWlpaVq1apUyMjKUnZ2tkydPatCgQaqsrLRrkpKSlJubq8zMTGVmZio3N1fJycn29srKSg0cOFCnTp1Sdna2MjIytGLFCo0bN666hwQAAAzlXd03DBgwQAMGDLjoNsuyNHfuXE2ePFlDhgyRJC1btkyhoaF68803NWrUKLlcLi1ZskSvv/66+vbtK0l64403FBERoffee08JCQnKy8tTZmamNm/erNjYWEnS4sWLFRcXpz179igqKkpZWVn67LPPlJ+fr/DwcEnSrFmzNHz4cD333HMKDAys0RcCAADMUatzdPbv36/CwkLFx8fb6/z8/NSrVy9t3LhRkpSTk6OKigq3mvDwcEVHR9s1mzZtktPptEOOJHXv3l1Op9OtJjo62g45kpSQkKCysjLl5ORctL+ysjKVlpa6vQAAgLlqNegUFhZKkkJDQ93Wh4aG2tsKCwvl6+ur5s2bX7ImJCSkyueHhIS41Vy4n+bNm8vX19euudD06dPtOT9Op1MRERE1OEoAAFBf1MlVVw6Hw23Zsqwq6y50Yc3F6mtS858mTZokl8tlv/Lz8y/ZEwAAqN9qNeiEhYVJUpURlaKiInv0JSwsTOXl5SouLr5kzZEjR6p8/tGjR91qLtxPcXGxKioqqoz0nOfn56fAwEC3FwAAMFetBp127dopLCxM69ats9eVl5drw4YN6tGjhyQpJiZGPj4+bjUFBQXatWuXXRMXFyeXy6WtW7faNVu2bJHL5XKr2bVrlwoKCuyarKws+fn5KSYmpjYPCwAA1FPVvurq5MmT2rdvn728f/9+5ebmKigoSK1bt1ZaWpqmTZumyMhIRUZGatq0aWrSpImSkpIkSU6nUyNGjNC4cePUokULBQUFafz48erSpYt9FVanTp3Uv39/paSkaNGiRZKkkSNHatCgQYqKipIkxcfHq3PnzkpOTlZ6erqOHz+u8ePHKyUlhZEaAAAgqQZBZ/v27br77rvt5bFjx0qSHnroIS1dulQTJkzQmTNnlJqaquLiYsXGxiorK0tNmza13zNnzhx5e3tr6NChOnPmjPr06aOlS5fKy8vLrlm+fLnGjBljX52VmJjodu8eLy8vrV69WqmpqerZs6f8/f2VlJSkmTNnVv9bAAAARnJYlmV5uglPKS0tldPplMvluq5HgdpOXO3pFq7IgecHeroFXEP14XfJb7Jh4TfZcFTn7zfPugIAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGKvaNwwEgHpjqtPTHVzeVJenOwCMxogOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBY3EcHAIBrpT7c20ky6v5OjOgAAABjMaKD2lMf/qVi0L9SAACXx4gOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxF0AEAAMYi6AAAAGMRdAAAgLEIOgAAwFgEHQAAYCyCDgAAMBZBBwAAGIugAwAAjEXQAQAAxiLoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADGIugAAABjEXQAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAMAAIxV74PO/Pnz1a5dOzVu3FgxMTH66KOPPN0SAAC4TtTroPPWW28pLS1NkydP1ieffKI777xTAwYM0MGDBz3dGgAAuA7U66Aze/ZsjRgxQo8++qg6deqkuXPnKiIiQgsWLPB0awAA4Drg7ekGaqq8vFw5OTmaOHGi2/r4+Hht3Ljxou8pKytTWVmZvexyuSRJpaWldddoLThXdtrTLVyRUofl6RYu7zr/b12f1IffJb/JhoXfZC26zn+X5/9uW9blv896G3S+/fZbVVZWKjQ01G19aGioCgsLL/qe6dOn6+mnn66yPiIiok56bGicnm7gSjxfL7pELakX/7X5TTYo9ea/dj35XZ44cUJO56V7rbdB5zyHw+G2bFlWlXXnTZo0SWPHjrWXz507p+PHj6tFixbf+x5cmdLSUkVERCg/P1+BgYGebgfgN4nrDr/J2mNZlk6cOKHw8PDL1tbboBMcHCwvL68qozdFRUVVRnnO8/Pzk5+fn9u6Zs2a1VWLDVJgYCD/B8Z1hd8krjf8JmvH5UZyzqu3k5F9fX0VExOjdevWua1ft26devTo4aGuAADA9aTejuhI0tixY5WcnKxu3bopLi5Or7zyig4ePKjHHnvM060BAIDrQL0OOsOGDdOxY8f0zDPPqKCgQNHR0VqzZo3atGnj6dYaHD8/Pz311FNVTg0CnsJvEtcbfpOe4bCu5NosAACAeqjeztEBAAC4HIIOAAAwFkEHAAAYi6ADAACMRdABAADGqteXlwMAcD155513rrg2MTGxDjvBeVxeDqBeGzJkyBXXrly5sg47AaRGjdxPlDgcDrcnbP/ncxUrKyuvWV8NGaeuUGPt27fXsWPHqqwvKSlR+/btPdARGiKn02m/AgMDtX79em3fvt3enpOTo/Xr11/xc3GAq3Hu3Dn7lZWVpR/96Edau3atSkpK5HK5tGbNGt12223KzMz0dKsNBiM6qLFGjRqpsLBQISEhbuuPHDmi1q1bq6yszEOdoaF68skndfz4cS1cuFBeXl6SvvtXc2pqqgIDA5Wenu7hDtGQREdHa+HChfrxj3/stv6jjz7SyJEjlZeX56HOGhbm6KDa/vMc9D/+8Q+3fylXVlZq/fr1atu2rQc6Q0P3pz/9SdnZ2XbIkSQvLy+NHTtWPXr0IOjgmvryyy8vOpLodDp14MCBa99QA0XQQbXdf//9kr471/zQQw+5bfPx8VHbtm01a9YsD3SGhu7s2bPKy8tTVFSU2/q8vDydO3fOQ12hobr99tuVlpamN954Q61atZIkFRYWaty4cbrjjjs83F3DQdBBtZ3/g9GuXTtt27ZNwcHBHu4I+M7DDz+sRx55RPv27VP37t0lSZs3b9bzzz+vhx9+2MPdoaFZsmSJhgwZojZt2qh169aSpIMHD6pjx456++23PdtcA8IcHdSqkpISNWvWzNNtoIE6d+6cZs6cqRdffFEFBQWSpFatWunXv/61xo0b53ZKC7gWzp07p/fee0+ff/65LMtS586d1bdvX7err1C3CDqosRdeeEFt27bVsGHDJEk/+9nPtGLFCrVq1Upr1qzRLbfc4uEO0ZCVlpZKkgIDAz3cCRqis2fPqnHjxsrNzVV0dLSn22nQuLwcNbZo0SJFRERIktatW6f33ntPmZmZGjBggH772996uDs0dIGBgYQceIy3t7fatGnDvXKuAwQd1FhBQYEddP7+979r6NChio+P14QJE7Rt2zYPd4eG6MiRI0pOTlZ4eLi8vb3l5eXl9gKupd///veaNGmSjh8/7ulWGjQmI6PGmjdvrvz8fEVERCgzM1PPPvusJMmyLP4VA48YPny4Dh48qClTpqhVq1bMg4BHvfTSS9q3b5/Cw8PVpk0bBQQEuG3fsWOHhzprWAg6qLEhQ4YoKSlJkZGROnbsmAYMGCBJys3NVYcOHTzcHRqi7OxsffTRR/rRj37k6VYA+1Yc8CyCDmpszpw5ateunQ4ePKgZM2bohhtukPTdKa3U1FQPd4eGKCIiQlxfgevFU0895ekWIK66Qg1VVFRo5MiRmjJlCs+1wnUjKytLs2bN0qJFi7g7NwBJBB1chWbNmmnHjh0EHVw3mjdvrtOnT+vs2bNq0qSJfHx83LYzKRR1LSgoSF988YWCg4PVvHnzS84T4/d4bXDqCjX2k5/8RG+//bbGjh3r6VYASdLcuXM93QIauDlz5qhp06aS+D1eLxjRQY0999xzmjlzpvr06aOYmJgqVxSMGTPGQ50BAPAdgg5qrF27dt+7zeFw6KuvvrqG3QDfqays1Ntvv628vDw5HA517txZiYmJ3EcHHnHu3Dnt27dPRUVFVR4se9ddd3moq4aFoAPAGPv27dO9996rb775RlFRUbIsS1988YUiIiK0evVq3XzzzZ5uEQ3I5s2blZSUpK+//rrK1YAOh4P7jV0jBB0Axrj33ntlWZaWL1+uoKAgSdKxY8f0i1/8Qo0aNdLq1as93CEakh/96Efq2LGjnn766YvewNLpdHqos4aFoINqGTt2rP7whz8oICDgspOQZ8+efY26Ar4TEBCgzZs3q0uXLm7r//Wvf6lnz546efKkhzpDQxQQEKB//etf3EDVw7jqCtXyySef6PPPP9ett96qTz755HvruPU+PMHPz08nTpyosv7kyZPy9fX1QEdoyGJjY7Vv3z6CjocxooNq8/LyUkFBgUJCQiRJw4YN00svvaTQ0FAPd4aG7pe//KV27NihJUuW6I477pAkbdmyRSkpKYqJidHSpUs92yCM9+mnn9r/+8svv9Tvf/97/fa3v1WXLl2q3Nepa9eu17q9Bomgg2pr1KiRCgsL7aATGBio3NxcbhwIjyspKdFDDz2kd9991/6jcvbsWSUmJmrp0qXMiUCda9SokRwOx/c+iuT8NiYjXzucusJVIyvjetGsWTP97W9/0759+5SXlyfLstS5c2dOHeCa2b9/v6dbwAUIOqg2h8NRZQ4Oc3JwPenQoQPhBh7Rpk0bPfLII3rxxRftOyTDszh1hWpr1KiRBgwYID8/P0nSu+++q3vuuafKnZFXrlzpifbQgP30pz9Vt27dNHHiRLf16enp2rp1q/761796qDM0JBfOY4RnEXRQbQ8//PAV1b366qt13AngrmXLlnr//ferXF6+c+dO9e3bV0eOHPFQZ2hILpzHCM/i1BWqjQCD69X3XUbu4+Oj0tJSD3SEhorT+dePRp5uAABqS3R0tN56660q6zMyMtS5c2cPdISGqmPHjgoKCrrkC9cGIzoAjDFlyhQ98MAD+vLLL3XPPfdIktavX68///nPzM/BNfX0009zO4PrBHN0ABhl9erVmjZtmnJzc+Xv76+uXbvqqaeeUq9evTzdGhoI5uhcXwg6AADUIq66ur4wRweAUUpKSvTHP/5Rv/vd73T8+HFJ0o4dO/TNN994uDM0FIwfXF8Y0QFgjE8//VR9+/aV0+nUgQMHtGfPHrVv315TpkzR119/rddee83TLQK4xhjRAWCMsWPHavjw4dq7d68aN25srx8wYIA+/PBDD3YGwFMIOgCMsW3bNo0aNarK+htvvFGFhYUe6AiApxF0ABijcePGF70x4J49e9SyZUsPdATA0wg6AIxx33336ZlnnlFFRYWk7+5Oe/DgQU2cOFEPPPCAh7sD4AlMRgZgjNLSUt17773avXu3Tpw4ofDwcBUUFCguLk5r166t8uBZAOYj6AAwzvvvv68dO3bo3LlziomJUZ8+fTzdEgAP4dQVgHpvy5YtWrt2rb18zz33qGXLlpo/f75+/vOfa+TIkSorK/NghwA8haADoN6bOnWqPv30U3t5586dSklJUb9+/TRx4kS9++67mj59ugc7BOApnLoCUO+1atVK7777rrp16yZJmjx5sjZs2KDs7GxJ0l//+lc99dRT+uyzzzzZJgAPYEQHQL1XXFys0NBQe3nDhg3q37+/vXz77bcrPz/fE60B8DCCDoB6LzQ0VPv375cklZeXa8eOHYqLi7O3nzhxQj4+Pp5qD4AHEXQA1Hv9+/fXxIkT9dFHH2nSpElq0qSJ7rzzTnv7p59+qptvvtmDHQLwFG9PNwAAV+vZZ5/VkCFD1KtXL91www1atmyZfH197e1/+tOfFB8f78EOAXgKk5EBGMPlcumGG26Ql5eX2/rjx4/rhhtucAs/ABoGgg4AADAWc3QAAICxCDoAAMBYBB0AAGAsgg4AADAWQQcAABiLoAOgThQWFmr06NFq3769/Pz8FBERocGDB2v9+vVX9P6lS5eqWbNmddtkHXjllVfUu3dvBQYGyuFwqKSkxNMtAQ0aQQdArTtw4IBiYmL0/vvva8aMGdq5c6cyMzN199136/HHH/d0ezVSUVFxRXWnT59W//799bvf/a6OOwJwJQg6AGpdamqqHA6Htm7dqp/+9Kfq2LGjfvjDH2rs2LHavHmzJGn27Nnq0qWLAgICFBERodTUVJ08eVKS9M9//lMPP/ywXC6XHA6HHA6Hpk6dKum7Z1lNmDBBN954owICAhQbG6t//vOfbvtfvHixIiIi1KRJE/3kJz/R7Nmzq4wOLViwQDfffLN8fX0VFRWl119/3W27w+HQwoULdd999ykgIEDPPvusOnTooJkzZ7rV7dq1S40aNdKXX34pSUpLS9PEiRPVvXv3Wvo2AVwVCwBq0bFjxyyHw2FNmzbtknVz5syx3n//feurr76y1q9fb0VFRVm/+tWvLMuyrLKyMmvu3LlWYGCgVVBQYBUUFFgnTpywLMuykpKSrB49elgffvihtW/fPis9Pd3y8/OzvvjiC8uyLCs7O9tq1KiRlZ6ebu3Zs8d6+eWXraCgIMvpdNr7XrlypeXj42O9/PLL1p49e6xZs2ZZXl5e1vvvv2/XSLJCQkKsJUuWWF9++aV14MAB67nnnrM6d+7sdhy/+c1vrLvuuqvK8X3wwQeWJKu4uLgmXyOAWkLQAVCrtmzZYkmyVq5cWa33/eUvf7FatGhhL7/66qtu4cSyLGvfvn2Ww+GwvvnmG7f1ffr0sSZNmmRZlmUNGzbMGjhwoNv2Bx980O2zevToYaWkpLjV/OxnP7Puvfdee1mSlZaW5lZz+PBhy8vLy9qyZYtlWZZVXl5utWzZ0lq6dGmV4yHoANcHTl0BqFXW/3+qjMPhuGTdBx98oH79+unGG29U06ZN9ctf/lLHjh3TqVOnvvc9O3bskGVZ6tixo2644Qb7tWHDBvvU0Z49e3THHXe4ve/C5by8PPXs2dNtXc+ePZWXl+e2rlu3bm7LrVq10sCBA/WnP/1JkvT3v/9d//73v/Wzn/3skscKwHMIOgBqVWRkpBwOR5XQ8J++/vpr3XvvvYqOjtaKFSuUk5Ojl19+WdKlJ/2eO3dOXl5eysnJUW5urv3Ky8vTiy++KOm7oHVhyLIu8ki/i9VcuC4gIKDK+x599FFlZGTozJkzevXVVzVs2DA1adLke3sG4FkEHQC1KigoSAkJCXr55ZcvOjpTUlKi7du36+zZs5o1a5a6d++ujh076vDhw251vr6+qqysdFt36623qrKyUkVFRerQoYPbKywsTJL0gx/8QFu3bnV73/bt292WO3XqpOzsbLd1GzduVKdOnS57fPfee68CAgK0YMECrV27Vo888shl3wPAcwg6AGrd/PnzVVlZqTvuuEMrVqzQ3r17lZeXp5deeklxcXG6+eabdfbsWf3P//yPvvrqK73++utauHCh22e0bdtWJ0+e1Pr16/Xtt9/q9OnT6tixox588EH98pe/1MqVK7V//35t27ZNL7zwgtasWSNJGj16tNasWaPZs2dr7969WrRokdauXes2WvPb3/5WS5cu1cKFC7V3717Nnj1bK1eu1Pjx4y97bF5eXho+fLgmTZqkDh06KC4uzm17YWGhcnNztW/fPknSzp07lZubq+PHj1/t1wqgJjw6QwiAsQ4fPmw9/vjjVps2bSxfX1/rxhtvtBITE60PPvjAsizLmj17ttWqVSvL39/fSkhIsF577bUqk3cfe+wxq0WLFpYk66mnnrIs67sJwP/93/9ttW3b1vLx8bHCwsKsn/zkJ9ann35qv++VV16xbrzxRsvf39+6//77rWeffdYKCwtz62/+/PlW+/btLR8fH6tjx47Wa6+95rZdkrVq1aqLHtuXX35pSbJmzJhRZdtTTz1lSaryevXVV6v9HQK4eg7LusjJawAwSEpKij7//HN99NFHtfJ5H3/8sXr37q1Dhw4pNDS0Vj4TQN3w9nQDAFDbZs6cqX79+ikgIEBr167VsmXLNH/+/Kv+3LKyMuXn52vKlCkaOnQoIQeoB5ijA8A4W7duVb9+/dSlSxctXLhQL730kh599NGr/tw///nPioqKksvl0owZM2qhUwB1jVNXAADAWIzoAAAAYxF0AACAsQg6AADAWAQdAABgLIIOAAAwFkEHAAAYi6ADAACMRdABAADG+n9jjWpmWDmLAQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "pd.crosstab(newdata.Category1, newdata.Target).plot(kind = \"bar\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "id": "e2e8d72b",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Apply Frequency on the Cat 1, Cat2, Cat3\n",
    "newdata[\"Category1\"] = pd.factorize(newdata.Category1)[0]\n",
    "newdata[\"Category2\"] = pd.factorize(newdata.Category2)[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "id": "e4646e20",
   "metadata": {},
   "outputs": [],
   "source": [
    "#Drop the Donation Column\n",
    "newdata.drop(\"Donation\", axis = 1, inplace = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "id": "309698c8",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Replace Income, Education and Age by np.nan\n",
    "\n",
    "newdata.replace(to_replace=\"None\", value = np.NaN, inplace = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "id": "0b66e23c",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Drop the additional columns\n",
    "newdata.drop([\"Health_Score\", \"Health Score\", \n",
    "              \"Number_of_stall_visited\", \"Last_Stall_Visited_Number\"], \n",
    "             axis = 1, inplace = True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "id": "cde8fccc",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Var1</th>\n",
       "      <th>Var2</th>\n",
       "      <th>Var3</th>\n",
       "      <th>Var4</th>\n",
       "      <th>Var5</th>\n",
       "      <th>Income</th>\n",
       "      <th>Education_Score</th>\n",
       "      <th>Age</th>\n",
       "      <th>City_Type</th>\n",
       "      <th>Employer_Category</th>\n",
       "      <th>Category1</th>\n",
       "      <th>Category2</th>\n",
       "      <th>Category3</th>\n",
       "      <th>Social_Media</th>\n",
       "      <th>Interaction_Days</th>\n",
       "      <th>Camp_Duration</th>\n",
       "      <th>magic1</th>\n",
       "      <th>magic2</th>\n",
       "      <th>Patient_Duration</th>\n",
       "      <th>dates_seq</th>\n",
       "      <th>Registration_Days</th>\n",
       "      <th>Registration_Month</th>\n",
       "      <th>Registration_Year</th>\n",
       "      <th>Camp_Start_Year</th>\n",
       "      <th>Camp_End_Year</th>\n",
       "      <th>First_Int_Year</th>\n",
       "      <th>Patients_Per_Day</th>\n",
       "      <th>Patients_Per_Month</th>\n",
       "      <th>Patients_Per_Year</th>\n",
       "      <th>Patient_Frequency_Per_Day</th>\n",
       "      <th>Patient_Frequency_Per_Month</th>\n",
       "      <th>Patient_Frequency_Per_Year</th>\n",
       "      <th>Patient_Freq_HC</th>\n",
       "      <th>Health_Camps_Year</th>\n",
       "      <th>Target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>278.0</td>\n",
       "      <td>59</td>\n",
       "      <td>25.0</td>\n",
       "      <td>34.0</td>\n",
       "      <td>312</td>\n",
       "      <td>0</td>\n",
       "      <td>10.0</td>\n",
       "      <td>9.0</td>\n",
       "      <td>2005.0</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2004</td>\n",
       "      <td>2649.0</td>\n",
       "      <td>6585.0</td>\n",
       "      <td>15710.0</td>\n",
       "      <td>9</td>\n",
       "      <td>7</td>\n",
       "      <td>3</td>\n",
       "      <td>2837</td>\n",
       "      <td>19</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>45</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "      <td>1</td>\n",
       "      <td>75</td>\n",
       "      <td>40</td>\n",
       "      <td>C</td>\n",
       "      <td>Others</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>344.0</td>\n",
       "      <td>59</td>\n",
       "      <td>2.0</td>\n",
       "      <td>57.0</td>\n",
       "      <td>401</td>\n",
       "      <td>0</td>\n",
       "      <td>18.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>2005.0</td>\n",
       "      <td>2005</td>\n",
       "      <td>2005</td>\n",
       "      <td>2004</td>\n",
       "      <td>3620.0</td>\n",
       "      <td>5804.0</td>\n",
       "      <td>15710.0</td>\n",
       "      <td>16</td>\n",
       "      <td>12</td>\n",
       "      <td>4</td>\n",
       "      <td>2837</td>\n",
       "      <td>19</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Var1  Var2  Var3  Var4  Var5 Income Education_Score  Age City_Type  \\\n",
       "0     4     0     0     0     2    NaN             NaN  NaN       NaN   \n",
       "1    45     5     0     0     7      1              75   40         C   \n",
       "\n",
       "  Employer_Category  Category1  Category2  Category3  Social_Media  \\\n",
       "0               NaN          0          0          2             0   \n",
       "1            Others          0          0          2             0   \n",
       "\n",
       "   Interaction_Days  Camp_Duration  magic1  magic2  Patient_Duration  \\\n",
       "0             278.0             59    25.0    34.0               312   \n",
       "1             344.0             59     2.0    57.0               401   \n",
       "\n",
       "   dates_seq  Registration_Days  Registration_Month  Registration_Year  \\\n",
       "0          0               10.0                 9.0             2005.0   \n",
       "1          0               18.0                 8.0             2005.0   \n",
       "\n",
       "   Camp_Start_Year  Camp_End_Year  First_Int_Year  Patients_Per_Day  \\\n",
       "0             2005           2005            2004            2649.0   \n",
       "1             2005           2005            2004            3620.0   \n",
       "\n",
       "   Patients_Per_Month  Patients_Per_Year  Patient_Frequency_Per_Day  \\\n",
       "0              6585.0            15710.0                          9   \n",
       "1              5804.0            15710.0                         16   \n",
       "\n",
       "   Patient_Frequency_Per_Month  Patient_Frequency_Per_Year  Patient_Freq_HC  \\\n",
       "0                            7                           3             2837   \n",
       "1                           12                           4             2837   \n",
       "\n",
       "   Health_Camps_Year  Target  \n",
       "0                 19       1  \n",
       "1                 19       0  "
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "newdata.head(2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "id": "c70affd3",
   "metadata": {},
   "outputs": [],
   "source": [
    "newdata[\"Income\"] = pd.factorize(newdata.Income)[0]\n",
    "newdata[\"Education_Score\"] = pd.factorize(newdata.Education_Score)[0]\n",
    "newdata[\"City_Type\"] = pd.factorize(newdata.City_Type)[0]\n",
    "newdata[\"Employer_Category\"] = pd.factorize(newdata.Employer_Category)[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "id": "f2915b60",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count     32602\n",
       "unique       50\n",
       "top          41\n",
       "freq       2568\n",
       "Name: Age, dtype: object"
      ]
     },
     "execution_count": 51,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Tip: Use KBins Discretizer to deal with Numerical Data...\n",
    "newdata.Age.describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "id": "20ae609d",
   "metadata": {},
   "outputs": [],
   "source": [
    "newdata[\"Age\"] = newdata.Age.astype(\"float\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "id": "67bd9c87",
   "metadata": {},
   "outputs": [],
   "source": [
    "newdata[\"Age\"] = pd.factorize(newdata.Age)[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "id": "095b32f6",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Series([], dtype: int64)"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "newdata.isnull().sum()[newdata.isnull().sum()!=0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "id": "958c9f9f",
   "metadata": {},
   "outputs": [],
   "source": [
    "cols = ['Interaction_Days', 'magic1', 'magic2', 'Registration_Days',\n",
    "       'Registration_Month', 'Registration_Year', 'Patients_Per_Day',\n",
    "       'Patients_Per_Month', 'Patients_Per_Year']\n",
    "\n",
    "for i in cols:\n",
    "    newdata.loc[:, i].fillna(newdata.loc[:,i].median(), inplace = True)"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "fc1277ce",
   "metadata": {},
   "source": [
    "### Modelling"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "id": "e7c297cf",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Split the Data in train and test\n",
    "newtrain = newdata.loc[0:train.shape[0]-1, :]\n",
    "newtest = newdata.loc[train.shape[0]:, :]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "id": "7d664044",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Drop the target from train and test\n",
    "X = newtrain.drop(\"Target\", axis = 1)\n",
    "newtest = newtest.drop(\"Target\", axis = 1)\n",
    "y = newtrain.Target"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "id": "91b54992",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import the Libraries\n",
    "from sklearn.linear_model import LogisticRegression\n",
    "from sklearn.tree import DecisionTreeClassifier\n",
    "from sklearn.ensemble import RandomForestClassifier, GradientBoostingClassifier\n",
    "from xgboost import XGBClassifier\n",
    "from lightgbm import LGBMClassifier\n",
    "from catboost import CatBoostClassifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "id": "b41e32bb",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import more libraries...\n",
    "from sklearn.model_selection import cross_val_score, StratifiedKFold\n",
    "\n",
    "def base_models():\n",
    "    models = dict()\n",
    "    models['lg'] = LogisticRegression()\n",
    "    models[\"tree\"] = DecisionTreeClassifier(criterion = \"entropy\")\n",
    "    models['rf'] = RandomForestClassifier(criterion = \"entropy\")\n",
    "    models['gbm'] = GradientBoostingClassifier()\n",
    "    models['xgb'] = XGBClassifier()\n",
    "    models['lgbm'] = LGBMClassifier()\n",
    "    models[\"catboost\"] = CatBoostClassifier()\n",
    "    return models"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "id": "9fd437c5",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Evaluation Function...\n",
    "#from sklearn.metrics import f1_score\n",
    "def eval_score(model):\n",
    "    cv = StratifiedKFold(n_splits = 5, shuffle = True, random_state = 42)\n",
    "    score = cross_val_score(model, X, y, \n",
    "                           scoring = \"roc_auc\", \n",
    "                            cv = cv, error_score=\"raise\",\n",
    "                           n_jobs = -1)\n",
    "    return score"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "id": "83c011ea",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "lg 0.701 (0.004)\n",
      "tree 0.718 (0.018)\n",
      "rf 0.775 (0.082)\n",
      "gbm 0.797 (0.081)\n",
      "xgb 0.814 (0.079)\n",
      "lgbm 0.824 (0.076)\n",
      "catboost 0.832 (0.073)\n"
     ]
    }
   ],
   "source": [
    "# Build the Models....\n",
    "models = base_models()\n",
    "result, names = list(), list()\n",
    "for name, model in models.items():\n",
    "    finalscore = eval_score(model)\n",
    "    result.append(finalscore)\n",
    "    names.append(name)\n",
    "    print('%s %.3f (%.3f)'% (name, np.mean(result), np.std(result)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "id": "378aaf52",
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAkkAAAHfCAYAAABEV0z3AAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8qNh9FAAAACXBIWXMAAA9hAAAPYQGoP6dpAABei0lEQVR4nO3deXxM1/8/8NckkU02iiQISWxJJJQgW6OoT2zVxtagsbQo/Xxau1ZqV4RYiqjUEiWofelGCVVNiKURShIE0SRMRIJJiOz394df5ms6NzET4WaS1/PzuI9H59xzz3nfqU/n7dxzz5EJgiCAiIiIiFToSR0AERERUVXEJImIiIhIBJMkIiIiIhFMkoiIiIhEMEkiIiIiEsEkiYiIiEgEkyQiIiIiEUySiIiIiEQwSSIiIiISwSSJqBrbvHkzZDIZZDIZ/vjjD7XzgiCgefPmkMlk6NKlS6X2LZPJMHfuXK2vu337NmQyGTZv3qxRvdJDT08Pb7zxBnr37o2YmJiKBV2O0NBQNG/eHIaGhpDJZHj06FGl90FEVQuTJKIawNzcHOHh4WrlJ0+exM2bN2Fubi5BVJXj888/R0xMDKKiohAcHIxLly6ha9euiIuLq7Q+Ll68iPHjx6Nr1674/fffERMTo9PfGRFphkkSUQ0QEBCAffv2ITs7W6U8PDwcXl5eaNKkiUSRvbwmTZrA09MTPj4++OSTT7B161bk5+dj7dq1L912bm4uACA+Ph4AMGbMGLz11lvw9PSEvr5+pbRNRFUXkySiGmDIkCEAgB07dijLFAoF9u3bh48//lj0mgcPHuC///0vGjVqBENDQzg6OmLGjBnIz89XqZednY0xY8bgjTfegJmZGXr27Inr16+LtpmUlIShQ4eiQYMGMDIygrOzM7799ttKustnPD09AQD//POPsuzYsWN45513YGFhAVNTU/j4+OD48eMq182dOxcymQwXLlzAwIEDUadOHTRr1gxdunRBYGAgAMDDwwMymQwjR45UXrdp0ya0bdsWxsbGqFu3Lvr164fExESVtkeOHAkzMzNcvnwZfn5+MDc3xzvvvAPg2WPJzz77DN9//z1atWoFExMTdOjQAWfOnIEgCFi6dCkcHBxgZmaGbt264caNGyptR0ZG4v3330fjxo1hbGyM5s2bY+zYscjMzBS9v/j4eAwZMgSWlpawtrbGxx9/DIVCoVK3pKQEoaGhePPNN2FiYgIrKyt4enrip59+Uqm3a9cueHl5oXbt2jAzM0OPHj0qdQSPSGpMkohqAAsLCwwcOBCbNm1Slu3YsQN6enoICAhQq5+Xl4euXbsiIiICkydPxq+//orAwECEhISgf//+ynqCIMDf3x9bt27FlClTcODAAXh6eqJXr15qbSYkJKBjx464cuUKli9fjl9++QV9+vTB+PHjMW/evEq719Ikon79+gCAbdu2wc/PDxYWFtiyZQt2796NunXrokePHmqJEgD0798fzZs3x549e/Ddd99h7dq1mDlzJgDg+++/R0xMDGbNmgUACA4OxqhRo9C6dWvs378fq1atwt9//w0vLy8kJSWptFtQUID33nsP3bp1w48//qhyz7/88gs2btyIxYsXY8eOHcjJyUGfPn0wZcoUnDp1CmvWrMH69euRkJCAAQMGQBAE5bU3b96El5cXwsLCcPToUcyePRtnz57FW2+9hcLCQrX7GzBgAFq2bIl9+/Zh+vTp+OGHHzBp0iSVOiNHjsSECRPQsWNH7Nq1Czt37sR7772H27dvK+ssWrQIQ4YMgYuLC3bv3o2tW7ciJycHvr6+SEhI0OZfGVHVJRBRtfX9998LAITz588LJ06cEAAIV65cEQRBEDp27CiMHDlSEARBaN26tfD2228rr/vuu+8EAMLu3btV2luyZIkAQDh69KggCIJw+PBhAYCwatUqlXoLFy4UAAhz5sxRlvXo0UNo3LixoFAoVOp+9tlngrGxsfDgwQNBEAQhOTlZACB8//335d5bab0lS5YIhYWFQl5enhAbGyt07NhRACD8+uuvwpMnT4S6desKffv2Vbm2uLhYaNu2rdCpUydl2Zw5cwQAwuzZs8v9Hks9fPhQMDExEXr37q1SNyUlRTAyMhKGDh2qLBsxYoQAQNi0aZNa2wAEGxsb4fHjx8qygwcPCgCEN998UygpKVGWr1y5UgAg/P3336LfSUlJiVBYWCj8888/AgDhxx9/VLu/kJAQlWv++9//CsbGxsp+/vzzTwGAMGPGDNE+Su/RwMBA+Pzzz1XKc3JyBBsbG+GDDz4o81oiXcKRJKIa4u2330azZs2wadMmXL58GefPny/zUdvvv/+O2rVrY+DAgSrlpY+ZSkdgTpw4AQD48MMPVeoNHTpU5XNeXh6OHz+Ofv36wdTUFEVFRcqjd+/eyMvLw5kzZyp0X19++SVq1aoFY2NjuLu7IyUlBevWrUPv3r1x+vRpPHjwACNGjFDps6SkBD179sT58+fx5MkTlfYGDBigUb8xMTF4+vSpyqM3ALCzs0O3bt1ER6nKartr166oXbu28rOzszMAoFevXpDJZGrlzz9KzMjIwLhx42BnZwcDAwPUqlULTZs2BQC1x34A8N5776l8btOmDfLy8pCRkQEAOHz4MADgf//7n/iNAzhy5AiKioowfPhwle/V2NgYb7/9tuiblES6yEDqAIjo9ZDJZPjoo4+wevVq5OXloWXLlvD19RWtm5WVBRsbG5UfaABo0KABDAwMkJWVpaxnYGCAN954Q6WejY2NWntFRUUIDQ1FaGioaJ//nkOjqQkTJiAwMBB6enqwsrKCg4ODMu579+4BgFqy97wHDx6oJCi2trYa9Vv6HYjVb9iwISIjI1XKTE1NYWFhIdpW3bp1VT4bGhqWW56Xlwfg2dwhPz8/3L17F7NmzYKbmxtq166NkpISeHp64unTp2p9/fvflZGREQAo696/fx/6+vpq/w6fV/q9duzYUfS8nh7//k3VA5Mkohpk5MiRmD17Nr777jssXLiwzHpvvPEGzp49C0EQVBKljIwMFBUVoV69esp6RUVFyMrKUvnxTU9PV2mvTp060NfXx7Bhw8ocoXBwcKjQPTVu3BgdOnQQPVcaZ2hoqHJC979ZW1urfP53YliW0vuVy+Vq5+7evavsW9t2tXHlyhVcunQJmzdvxogRI5Tl/57crY369eujuLgY6enpZSaMpfe2d+9e5agVUXXEJImoBmnUqBGmTZuGq1evqvyo/ts777yD3bt34+DBg+jXr5+yPCIiQnkeePaYKCQkBNu3b8f48eOV9X744QeV9kxNTZVrF7Vp00Y5IvKq+fj4wMrKCgkJCfjss88qtW0vLy+YmJhg27ZtGDRokLI8LS0Nv//+e7mjV5WlNPEqHQ0qtW7dugq32atXLwQHByMsLAzz588XrdOjRw8YGBjg5s2bGj+eJNJFTJKIapjFixe/sM7w4cPx7bffYsSIEbh9+zbc3NwQHR2NRYsWoXfv3ujevTsAwM/PD507d8YXX3yBJ0+eoEOHDjh16hS2bt2q1uaqVavw1ltvwdfXF59++ins7e2Rk5ODGzdu4Oeff8bvv/9e6fdqZmaG0NBQjBgxAg8ePMDAgQPRoEED3L9/H5cuXcL9+/cRFhZWobatrKwwa9YsfPXVVxg+fDiGDBmCrKwszJs3D8bGxpgzZ04l3406JycnNGvWDNOnT4cgCKhbty5+/vlntUd92vD19cWwYcOwYMEC3Lt3D++++y6MjIwQFxcHU1NTfP7557C3t8f8+fMxY8YM3Lp1Cz179kSdOnVw7949nDt3DrVr167UNxaJpMIkiYjUGBsb48SJE5gxYwaWLl2K+/fvo1GjRpg6darKj7+enh5++uknTJ48GSEhISgoKICPjw8OHToEJycnlTZdXFxw4cIFfP3115g5cyYyMjJgZWWFFi1aoHfv3q/sXgIDA9GkSROEhIRg7NixyMnJQYMGDfDmm2+qTbrWVlBQEBo0aIDVq1dj165dMDExQZcuXbBo0SK0aNGicm6gHLVq1cLPP/+MCRMmYOzYsTAwMED37t1x7Nixl1ogdPPmzWjfvj3Cw8OxefNmmJiYwMXFBV999ZWyTlBQEFxcXLBq1Srs2LED+fn5sLGxQceOHTFu3LjKuD0iyckE4bkFN4iIiIgIABeTJCIiIhLFJImIiIhIBJMkIiIiIhFMkoiIiIhEMEkiIiIiEsElACqopKQEd+/ehbm5+StZSZeIiIgqnyAIyMnJQcOGDV+8hY6k2+sKgvDtt98K9vb2gpGRkdC+fXvhzz//LLf+mjVrBCcnJ8HY2Fho2bKlsGXLFrU6e/fuFZydnQVDQ0PB2dlZ2L9//0v3+2+pqakCAB48ePDgwYOHDh6pqakv/K2XdCRp165dmDhxItauXQsfHx+sW7cOvXr1QkJCguhCaGFhYQgKCsKGDRvQsWNHnDt3DmPGjEGdOnXQt29fAM925g4ICMDXX3+Nfv364cCBA/jggw8QHR0NDw+PCvUrxtzcHACQmppa5qaVREREVLVkZ2fDzs5O+TteHkkXk/Tw8ED79u1VtgVwdnaGv78/goOD1ep7e3vDx8cHS5cuVZZNnDgRf/31F6KjowEAAQEByM7OxuHDh5V1SpfM37FjR4X6BYD8/Hzk5+crP5d+yQqFgkkSERGRjsjOzoalpaVGv9+STdwuKChAbGws/Pz8VMr9/Pxw+vRp0Wvy8/NhbGysUmZiYoJz586hsLAQwLORpH+32aNHD2WbFekXAIKDg2Fpaak87OzsNLtRIiIi0kmSJUmZmZkoLi6GtbW1Srm1tTXS09NFr+nRowc2btyI2NhYCIKAv/76C5s2bUJhYSEyMzMBAOnp6eW2WZF+gWf7FCkUCuWRmpqq9T0TERGR7pD87bZ/vxkmCEKZb4vNmjUL6enp8PT0hCAIsLa2xsiRIxESEgJ9fX2t2tSmXwAwMjKCkZGRRvdEREREuk+ykaR69epBX19fbfQmIyNDbZSnlImJCTZt2oTc3Fzcvn0bKSkpsLe3h7m5OerVqwcAsLGxKbfNivRLRERENY9kSZKhoSHc3d0RGRmpUh4ZGQlvb+9yr61VqxYaN24MfX197Ny5E++++65yrQMvLy+1No8ePaps82X6JSIioppD0sdtkydPxrBhw9ChQwd4eXlh/fr1SElJwbhx4wA8mwd0584dREREAACuX7+Oc+fOwcPDAw8fPsSKFStw5coVbNmyRdnmhAkT0LlzZyxZsgTvv/8+fvzxRxw7dkz59psm/RIRERFJmiQFBAQgKysL8+fPh1wuh6urKw4dOoSmTZsCAORyOVJSUpT1i4uLsXz5cly7dg21atVC165dcfr0adjb2yvreHt7Y+fOnZg5cyZmzZqFZs2aYdeuXco1kjTpl4iIiEjSdZJ0mTbrLBAREVHVoBPrJBERERFVZUySiIiIiEQwSSIiIiISwSSJiIiISASTJCIiIiIRkm9LQkSVLzc3F1evXi23zoWsC9h2dxsCGwai/Rvty63r5OQEU1PTygyRiKjKY5JEpKOSkpKQk5Mjei4xMRGBgYHlXu842xGmjqYIjg7Grfm3yq27bds2ODs7l3ne3NwcLVq0eHHQREQ6hEkSkQ5KSkpCy5YtK3y9masZTB2fjQyZOprCzNUMj688LrP+ixIu4NmK+EyUiKg6YZJEpIMeP7yPdjZ6WLBgARwcHLS6VhAEfHXveyQXpqMEAvQgwztBXlhk/RFkMpnWsSQnJ2PmzJl4/PA+ACZJRFR9MEki0kWZ13FhrBmQuhhI1e7SUybGuGnTQPm5BAJuFsrx8K+J8Hmap3UozgB6jzVD4uMUANwkmoiqDyZJRDroYlouRq0r+/FYWQQARf+rD5QIgN5zo0YlAsYVmsNgXSa0H0t6ZndA6wpeSURUNTFJItJBfft/gGI9Q63fOruccxnLbi9TP6EnA+xMMHHnJriZu2kdj7m5OZpzPhIRVTPc4LaCuMEt6RpBEDDk1yFIyEqAAPX/28sgg8sbLtjRZ0eF5iYREekCbX6/OZJEVA2JrZNUWFKIVEWqaIIEAAIEpCnScC72HGrp1VI5x3WSiKgmYpJEVA1dvXoV7u7uauW16taCvrl+mdcVZRfB86GnWnlsbCzaty9/wUkiouqGSRJRNeTk5ITY2Nhy6zx9+hS3b9+Gvb09TExMXtgeEVFFFBcXIyoqCnK5HLa2tvD19YW+ftl/WatKOCepgjgniYiIqHz79+/HlClTcPv2bWWZvb09li9fjv79+0sSkza/39zgloiIiCrd/v37MXDgQLi5uSEmJgY5OTmIiYmBm5sbBg4ciP3790sd4gtxJKmCOJJEREQkrri4GM2bN4ebmxsOHjwIPb3/G5MpKSmBv78/rly5gqSkpNf+6I0jSURERCSZqKgo3L59G1999ZVKggQAenp6CAoKQnJyMqKioiSKUDNMkoiIiKhSyeVyAICrq6vo+dLy0npVFd9uIyIiAOLra/2btm9Fcn2tmsnW1hYAcOXKFXh6eiLmbgwWn1uM6Z2mw6uhF65cuaJSr6rinKQK4pwkIqpuLly4ILq+VkVxfa2a6/k5SQcOHMCHhz9EfFY8Wr/RGtt7bUe/fv10Yk4Sk6QKYpJERNWNJiNJiYmJCAwMxLZt2+Ds7FxuXY4kVQMFuUiJO44nT56UWSU/Px93795VK09IiMeOHTvRsGsr3Pb7v9k99kdLcPfENQwZMhguLuobYzds2BBGRkaifdWuXRtN2r0DGFb8zxW3JSEiIq2Zmpq+cOQn/nE8mi9sjhK7Eo4S1QApccfR5HDgC+u9KVLW2xyY8kltDGlYCD3BECUyGfQEAbXfLsRfLWpDhp+B1J/VL0x9QUzYhiYefTWK/2UxSSIiqgk0GBF4EUEQ8EPqRhg3MsYPtzbCvdDgpTZDroxRAXq10vJM4L/uMQIDA+Hg4CBaJzf3CW7evCV6Lt3yCeKN7ig/l8hkiDcywv/yvGCjqC16TbNmjjA1VT8nl8uxceNGhPd+A00qcC8VwSSJiKgG0HREoDynTIyRZtMAAJAme4CHf02Ez9O8l4vrNY4KkPYSkm4jLr0EccsiKnS942xHmBSbQKb/f8m0UCzgiFESbn0nnli9iFmd+hW6riKYJBER1QBZsjfgv+4xFixYUOaIQHkEQcDSe99DrzAdJRCgBxmW2rVFHeuPKjSalJycjJkzZ77WUQHSnr+/P4Dy55eVvvH4b7dKbmF3yW61cpm+DKaOppgfMR+Oeo5q58t7c9Lc3BwtWrTQ/AZeEpMkIqIaQDAwRlx6CWza9YBzBeYSnbpzCjfT/m9NmxIIuFkox0OnJvBp5KN1e08vXEBc+lcQDIy1vpZen3r16mH06NEvrOfjo/pnQBAE9NzWE0KJAJmeehItlAiI1ovGzKEzX+qR7avGJImIqAbIzc0F8Ow1f20JgoAlN5dAD3ooQYmyXA96WHJqCeY0m6P1D11iYqLWcUiJa0hpJ68wD2nZadAzE1+zWqYnQ5oiDXmFeTAxLP+7khKTJCKiGqD0B37MmDFaX2vmagb7qfZq5SUoQfLTZHQZ2QWPrzyuUFzm5uYVuu51u3r16gvXkKrtUhu2H9pCvkiOJwnlT5Cv7mtInT19Fkmzk7B131a4ubmpnf/7778xbMAwnHU9iy5durz+ADUkeZK0du1aLF26FHK5HK1bt8bKlSvh6+tbZv3t27cjJCQESUlJsLS0RM+ePbFs2TK88cYbAIAuXbrg5MmTatf17t0bv/76KwBg7ty5mDdvnsp5a2trpKenV+KdERFVHZrMLREjCALm3ZyH209vQ4D6snoyyNB1VtcKjSa97vkl5UlKSkJOTk6Z558+fYpt27aVeV4QBKzPXY+HRg/RfkJ7fGL6Sbnfx9OnT8sd1atK301FyOVyFD4oRJ8OfWBmZqZ23q6DHYoeFnFbkvLs2rULEydOxNq1a+Hj44N169ahV69eSEhIQJMm6lP5oqOjMXz4cHzzzTfo27cv7ty5g3HjxmH06NE4cOAAAGD//v0oKChQXpOVlYW2bdti0KBBKm21bt0ax44dU35+3St+EhG9TprOLfm3guICZN/IFk2QAECAgGwhG25vusFQ3/Blw5REUlISWrZs+VJtPD/a9tDoIT5d8mmFR9dKXb9+XWcTpX9vS/JvurItiaRJ0ooVKzBq1Cjl/3FXrlyJI0eOICwsDMHBwWr1z5w5A3t7e4wfPx4A4ODggLFjxyIkJERZp27duirX7Ny5E6ampmpJkoGBAWxsbCr7loiIdFZZ825mNJ2BnOJnoyylb6U9/5achYEFrly6onadrsy7efzwPtrZ6L3Um39f3fseyc+9+fdOkBcWveSbf48f3gegm0mSr68v7O3tsWjRIhw8eBB6ev83N6mkpATBwcFwcHAo98lRVSBZklRQUIDY2FhMnz5dpdzPzw+nT58Wvcbb2xszZszAoUOH0KtXL2RkZGDv3r3o06dPmf2Eh4dj8ODBqF1bdWGqpKQk5dLnHh4eWLRoERwd1V9FLJWfn4/8/Hzl5+zsbE1uk4hIZ2gy76bU1GFTX1hHZ+bdZF7HhbFmQOriF672LOaUiTFu/v/1o4Dn3vyr4DpSzgB6jzVD4uMUAN7aB1QF6OvrY/ny5Rg4cCD8/f0RFBQEV1dXXLlyBcHBwfjll1+wd+/eKv8UR7IkKTMzE8XFxbC2tlYpL29ukLe3N7Zv346AgADk5eWhqKgI7733HkJDQ0Xrnzt3DleuXEF4eLhKuYeHByIiItCyZUvcu3cPCxYsgLe3N+Lj45Vzm/4tODhYbR4TEVF14uTkhNjY2HLraPsGly64mJaLUesq9mhMAFD0v/pAiQA8/6p7iYBxheYwWJeJir7gvjtAfV8zXdK/f3/s3bsXU6ZMgbf3/yV7Dg4O2Lt3L/r37y9hdJqRbIPbu3fvolGjRjh9+jS8vLyU5QsXLsTWrVtFh3wTEhLQvXt3TJo0CT169IBcLse0adPQsWNHtUQIAMaOHYvTp0/j8uXL5cby5MkTNGvWDF988QUmT54sWkdsJMnOzo4b3BIR6bjMzEwcPHiwQgsm/nb1N1xsfrHMtt+88SZ6OvVUK39RkqnrE7efV1xcjKioKMjlctja2sLX11fSESSd2OC2Xr160NfXVxs1ysjIUBtdKhUcHAwfHx9MmzYNANCmTRvUrl0bvr6+WLBggcoEsNzcXOzcuRPz589/YSy1a9eGm5sbkpKSyqxjZGRU5q7ERESkuyq6YGJRUREWhiyEvqAP0eEiAYg1icX3Ad/DwEDyl8klo6+vX6Vf8y+P+CpPr4GhoSHc3d0RGRmpUh4ZGakyLPe83NxclclfwP+9lfbvAbHdu3cjPz8fgYEv3qsoPz8fiYmJVX6WPRERVR0nok6gxKxEPEECABlQUrsEJ6JOvNa4qPJImtpOnjwZw4YNQ4cOHeDl5YX169cjJSUF48aNAwAEBQXhzp07iIh4trFe3759MWbMGISFhSkft02cOBGdOnVCw4YNVdoODw+Hv7+/6ByjqVOnom/fvmjSpAkyMjKwYMECZGdnY8SIEa/+pomIqFrITM/ErXm3EHMxBiam6o/Ocp/kwutNL2R+mylBdFQZJE2SAgICkJWVhfnz50Mul8PV1RWHDh1C06ZNATxbjColJUVZf+TIkcjJycGaNWswZcoUWFlZoVu3bliyZIlKu9evX0d0dDSOHj0q2m9aWhqGDBmCzMxM1K9fH56enjhz5oyyXyIiohextbVF4YNCFN4phLun+luBMddjUPSwiE8pdJhkE7d1nTYTv4iIqPopLi5G8+bN4ebmJroWkL+/P65cuYKkpKQq/6p7TaLN77dkc5KIiIh0WelaQL/88gv8/f0RExODnJwcxMTEwN/fH7/88guWLVvGBEmH1dzp9kRERC+pOqwFRGXj47YK4uM2IiIqVdXWAqKy6cQ6SURERNWFLq8FRGXjnCQiIiIiEUySiIiIiETwcRsR1Si5ubmie0M+T9tNXMva74uIdBuTJCKqUa5evQp3d/WF/yoqNjYW7du3r7T2iKjqYJJERDWKk5MTYmNjy61zOP4wNqduxki7kejVutcL2yOi6olJEhHVKKampuWO/AiCgLk35sK4kTHOGp3FV+2+gkxW1g6mRFSdMUkiomolKSkJOTk5Fb7+cs5lJD9NBgAkP01GxJ8RcDN3q3B75ubmaNGiRYWvJyLpMEkiomojKSkJLVu2fKk2HGc7wqSpCWT6MgjFAub/Ph+35t96qTavX7/ORIlIBzFJIqJq4/HD+2hno4cFCxbAwcFB6+svPr2JRZk7lZ9l+jKYOprih18W4E2TZlq3l5ycjJkzZ+Lxw/sAmCQR6RomSURUbRg/TsGFsWZA6mIgVbtrBQDzGlpDz9AQJc/NQdITBPx4ZwsG370HbWcmOQPoPdYMiY9TAHi/qDoRVTFMkoio2sgza4L26x5j+/btcNbyrbPTmX8jPm6pWnmJTIZ4IyOc7h8Kn3pttGoz8epVfPjhhwjv3USr64ioamCSRETVxpOCEsSll+DUrcd4alUiWqd0ocjnCYKALcVby217btxWjNAfofamW3kLTibKixGXXgLBwFjzmyCiKoNJEhFVG6UraY8ZM0ar62QGMrRc3hK1LGuVWSf1USqGTx0OoUjQOi5zc3OtryEi6TFJIqJqw9/fH0D5W4WIjSQBQLaQjVzkltm26RumsNhsoVb+oq1LuAQAke6SCYKg/V+LCNnZ2bC0tIRCoYCFhfp/OImIiKjq0eb3W+81xURERESkU5gkEREREYlgkkREREQkgkkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIJklEREREIiRPktauXQsHBwcYGxvD3d0dUVFR5dbfvn072rZtC1NTU9ja2uKjjz5CVlaW8vzmzZshk8nUjry8vJfql4iIiGoWSZOkXbt2YeLEiZgxYwbi4uLg6+uLXr16ISUlRbR+dHQ0hg8fjlGjRiE+Ph579uzB+fPnMXr0aJV6FhYWkMvlKoexsXGF+yUiIqKaRyYIgiBV5x4eHmjfvj3CwsKUZc7OzvD390dwcLBa/WXLliEsLAw3b95UloWGhiIkJASpqakAno0kTZw4EY8ePaq0fgEgPz8f+fn5ys/Z2dmws7ODQqGAhYWFxvdMRERE0snOzoalpaVGv9+SjSQVFBQgNjYWfn5+KuV+fn44ffq06DXe3t5IS0vDoUOHIAgC7t27h71796JPnz4q9R4/foymTZuicePGePfddxEXF/dS/QJAcHAwLC0tlYednZ22t0xEREQ6RLIkKTMzE8XFxbC2tlYpt7a2Rnp6uug13t7e2L59OwICAmBoaAgbGxtYWVkhNDRUWcfJyQmbN2/GTz/9hB07dsDY2Bg+Pj5ISkqqcL8AEBQUBIVCoTxKR66IiIioepJ84rZMJlP5LAiCWlmphIQEjB8/HrNnz0ZsbCx+++03JCcnY9y4cco6np6eCAwMRNu2beHr64vdu3ejZcuWKomUtv0CgJGRESwsLFQOIiIiqr4MpOq4Xr160NfXVxu9ycjIUBvlKRUcHAwfHx9MmzYNANCmTRvUrl0bvr6+WLBgAWxtbdWu0dPTQ8eOHZUjSRXpl4iIiGoeyUaSDA0N4e7ujsjISJXyyMhIeHt7i16Tm5sLPT3VkPX19QE8GwkSIwgCLl68qEygKtIvERER1TySjSQBwOTJkzFs2DB06NABXl5eWL9+PVJSUpSPz4KCgnDnzh1EREQAAPr27YsxY8YgLCwMPXr0gFwux8SJE9GpUyc0bNgQADBv3jx4enqiRYsWyM7OxurVq3Hx4kV8++23GvdLREREJGmSFBAQgKysLMyfPx9yuRyurq44dOgQmjZtCgCQy+UqaxeNHDkSOTk5WLNmDaZMmQIrKyt069YNS5YsUdZ59OgRPvnkE6Snp8PS0hLt2rXDn3/+iU6dOmncLxEREZGk6yTpMm3WWSAiIqKqQSfWSSIiIiKqypgkEREREYlgkkREREQkgkkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIJklEREREIpgkEREREYlgkkREREQkgkkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIJklEREREIpgkEREREYlgkkREREQkgkkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCMmTpLVr18LBwQHGxsZwd3dHVFRUufW3b9+Otm3bwtTUFLa2tvjoo4+QlZWlPL9hwwb4+vqiTp06qFOnDrp3745z586ptDF37lzIZDKVw8bG5pXcHxEREekmSZOkXbt2YeLEiZgxYwbi4uLg6+uLXr16ISUlRbR+dHQ0hg8fjlGjRiE+Ph579uzB+fPnMXr0aGWdP/74A0OGDMGJEycQExODJk2awM/PD3fu3FFpq3Xr1pDL5crj8uXLr/ReiYiISLfIBEEQpOrcw8MD7du3R1hYmLLM2dkZ/v7+CA4OVqu/bNkyhIWF4ebNm8qy0NBQhISEIDU1VbSP4uJi1KlTB2vWrMHw4cMBPBtJOnjwIC5evKhxrPn5+cjPz1d+zs7Ohp2dHRQKBSwsLDRuh4iIiKSTnZ0NS0tLjX6/JRtJKigoQGxsLPz8/FTK/fz8cPr0adFrvL29kZaWhkOHDkEQBNy7dw979+5Fnz59yuwnNzcXhYWFqFu3rkp5UlISGjZsCAcHBwwePBi3bt0qN97g4GBYWloqDzs7Ow3vlIiIiHSRZElSZmYmiouLYW1trVJubW2N9PR00Wu8vb2xfft2BAQEwNDQEDY2NrCyskJoaGiZ/UyfPh2NGjVC9+7dlWUeHh6IiIjAkSNHsGHDBqSnp8Pb21tlbtO/BQUFQaFQKI+yRq6IiIioepB84rZMJlP5LAiCWlmphIQEjB8/HrNnz0ZsbCx+++03JCcnY9y4caL1Q0JCsGPHDuzfvx/GxsbK8l69emHAgAFwc3ND9+7d8euvvwIAtmzZUmacRkZGsLCwUDmIiIio+qpQkhQVFYXAwEB4eXkpJ0Rv3boV0dHRGrdRr1496Ovrq40aZWRkqI0ulQoODoaPjw+mTZuGNm3aoEePHli7di02bdoEuVyuUnfZsmVYtGgRjh49ijZt2pQbS+3ateHm5oakpCSN4yciIqLqTeskad++fejRowdMTEwQFxennMyck5ODRYsWadyOoaEh3N3dERkZqVIeGRkJb29v0Wtyc3Ohp6casr6+PoBnI1Clli5diq+//hq//fYbOnTo8MJY8vPzkZiYCFtbW43jJyIioupN6yRpwYIF+O6777BhwwbUqlVLWe7t7Y0LFy5o1dbkyZOxceNGbNq0CYmJiZg0aRJSUlKUj8+CgoKUb6QBQN++fbF//36EhYXh1q1bOHXqFMaPH49OnTqhYcOGAJ49Yps5cyY2bdoEe3t7pKenIz09HY8fP1a2M3XqVJw8eRLJyck4e/YsBg4ciOzsbIwYMULbr4OIiIiqKQNtL7h27Ro6d+6sVm5hYYFHjx5p1VZAQACysrIwf/58yOVyuLq64tChQ2jatCkAQC6Xq6yZNHLkSOTk5GDNmjWYMmUKrKys0K1bNyxZskRZZ+3atSgoKMDAgQNV+pozZw7mzp0LAEhLS8OQIUOQmZmJ+vXrw9PTE2fOnFH2S0RERKT1OknNmjXDunXr0L17d5ibm+PSpUtwdHREREQEFi9ejISEhFcVa5WizToLREREVDW80nWSxo4diwkTJuDs2bOQyWS4e/cutm/fjqlTp+K///1vhYMmIiIiqkq0ftz2xRdfQKFQoGvXrsjLy0Pnzp1hZGSEqVOn4rPPPnsVMRIRERG9dlo9bisuLkZ0dDTc3NxgbGyMhIQElJSUwMXFBWZmZq8yziqHj9uIiIh0jza/31qNJOnr66NHjx5ITExE3bp1NXq9noiIiEgXaT0nyc3N7YX7nBERERHpOq2TpIULF2Lq1Kn45ZdfIJfLkZ2drXIQERERVQdaLwHw/IrXz++xVrrnWnFxceVFV4VxThIREZHueWVzkgDgxIkTFQ6MiIiISFdonSS9/fbbryIOIiIioipF6yQJAB49eoTw8HAkJiZCJpPBxcUFH3/8MSwtLSs7PiIiIiJJaD1x+6+//kKzZs3wzTff4MGDB8jMzMSKFSvQrFkzrTe4JSIiIqqqtJ647evri+bNm2PDhg0wMHg2EFVUVITRo0fj1q1b+PPPP19JoFUNJ24TERHpHm1+v7VOkkxMTBAXFwcnJyeV8oSEBHTo0AG5ubnaR6yDmCQRERHpnle6wa2FhQVSUlLUylNTU2Fubq5tc0RERERVktZJUkBAAEaNGoVdu3YhNTUVaWlp2LlzJ0aPHo0hQ4a8ihiJiIiIXjut325btmwZZDIZhg8fjqKiIgBArVq18Omnn2Lx4sWVHiARERGRFLSek1QqNzcXN2/ehCAIaN68OUxNTSs7tiqNc5KIiIh0zytdcVuhUKC4uBh169aFm5ubsvzBgwcwMDBgwkBERETVgtZzkgYPHoydO3eqle/evRuDBw+ulKCIiIiIpKZ1knT27Fl07dpVrbxLly44e/ZspQRFREREJDWtk6T8/HzlhO3nFRYW4unTp5USFBEREZHUtE6SOnbsiPXr16uVf/fdd3B3d6+UoIiIiIikpvXE7YULF6J79+64dOkS3nnnHQDA8ePHcf78eRw9erTSAyQiIiKSgtYjST4+PoiJiYGdnR12796Nn3/+Gc2bN8fff/8NX1/fVxEjERER0WtX4XWSajquk0RERKR7Xsk6SSUlJSgpKYGBwf9dcu/ePXz33Xd48uQJ3nvvPbz11lsVj5qIiIioCtE4SRo1ahRq1aqlnLSdk5ODjh07Ii8vD7a2tvjmm2/w448/onfv3q8sWCIiIqLXReM5SadOncLAgQOVnyMiIlBUVISkpCRcunQJkydPxtKlS19JkERERESvm8ZJ0p07d9CiRQvl5+PHj2PAgAGwtLQEAIwYMQLx8fGVHyERERGRBDROkoyNjVUWizxz5gw8PT1Vzj9+/LhyoyMiIiKSiMZJUtu2bbF161YAQFRUFO7du4du3bopz9+8eRMNGzas/AiJiIiIJKBxkjRr1iysXLkSzZo1Q48ePTBy5EjY2toqzx84cAA+Pj5aB7B27Vo4ODjA2NgY7u7uiIqKKrf+9u3b0bZtW5iamsLW1hYfffQRsrKyVOrs27cPLi4uMDIygouLCw4cOPDS/RIREVHNonGS1LVrV8TGxmL8+PH4/vvvsWHDBpXzb775JiZNmqRV57t27cLEiRMxY8YMxMXFwdfXF7169UJKSopo/ejoaAwfPhyjRo1CfHw89uzZg/Pnz2P06NHKOjExMQgICMCwYcNw6dIlDBs2DB988IHK5rva9ktEREQ1j6SLSXp4eKB9+/YICwtTljk7O8Pf3x/BwcFq9ZctW4awsDDcvHlTWRYaGoqQkBCkpqYCAAICApCdnY3Dhw8r6/Ts2RN16tTBjh07KtSvGC4mSUREpHu0+f3WeluSylJQUIDY2Fj4+fmplPv5+eH06dOi13h7eyMtLQ2HDh2CIAi4d+8e9u7diz59+ijrxMTEqLXZo0cPZZsV6RcA8vPzkZ2drXIQERFR9SVZkpSZmYni4mJYW1urlFtbWyM9PV30Gm9vb2zfvh0BAQEwNDSEjY0NrKysEBoaqqyTnp5ebpsV6RcAgoODYWlpqTzs7Oy0ul8iIiLSLZIlSaVkMpnKZ0EQ1MpKJSQkYPz48Zg9ezZiY2Px22+/ITk5GePGjdO6TW36BYCgoCAoFArlUfp4j4iIiKonjbclqWz16tWDvr6+2uhNRkaG2ihPqeDgYPj4+GDatGkAgDZt2qB27drw9fXFggULYGtrCxsbm3LbrEi/AGBkZAQjIyOt75OIiIh0k8YjSQ8fPkRoaKjoXByFQlHmubIYGhrC3d0dkZGRKuWRkZHw9vYWvSY3Nxd6eqoh6+vrA3g2EgQAXl5eam0ePXpU2WZF+iUiIqKaR+Mkac2aNfjzzz9FZ4JbWloiKipKZW6QJiZPnoyNGzdi06ZNSExMxKRJk5CSkqJ8fBYUFIThw4cr6/ft2xf79+9HWFgYbt26hVOnTmH8+PHo1KmTciHLCRMm4OjRo1iyZAmuXr2KJUuW4NixY5g4caLG/RIRERFB0FDbtm2FY8eOlXn+2LFjwptvvqlpc0rffvut0LRpU8HQ0FBo3769cPLkSeW5ESNGCG+//bZK/dWrVwsuLi6CiYmJYGtrK3z44YdCWlqaSp09e/YIrVq1EmrVqiU4OTkJ+/bt06pfTSgUCgGAoFAotLqOiIiIpKPN77fG6ySZm5sjPj4eTZo0ET2fkpICV1fXGvNqPNdJIiIi0j2vZJ0kfX193L17t8zzd+/eVZsvRERERKSrNM5q2rVrh4MHD5Z5/sCBA2jXrl1lxEREREQkOY2XAPjss88wePBgNG7cGJ9++qnyrbLi4mKsXbsW33zzDX744YdXFigRERHR66TV3m0zZsxAcHAwzM3N4ejoCJlMhps3b+Lx48eYNm0aFi9e/CpjrVI4J4mIiEj3aPP7rfUGt+fOncP27dtx48YNCIKAli1bYujQoejUqdNLBa1rmCQRERHpHm1+v7VecbtTp041LiEiIiKimkfrJOn8+fPYsWMHrl+/DplMhpYtW2LIkCHo0KHDq4iPiIiISBJavbP/xRdfwMPDAxs3bkRaWhpSUlKwfv16eHh44Msvv3xVMRIRERG9dhonSVu2bEFoaChWr16NrKwsXLx4EZcuXcKDBw/wzTffYPXq1YiIiHiVsRIRERG9NhpP3O7UqROGDBmCSZMmiZ5fsWIFdu7ciXPnzlVqgFUVJ24TERHpnley4nZ8fDzef//9Ms/7+/sjPj5e8yiJiIiIqjCttiUpKCgo83xhYaFygUkiIiIiXadxkuTu7o7t27eXeX7r1q1o3759pQRFREREJDWNlwCYMmUK/P39kZ+fjylTpsDa2hoAkJ6ejuXLl2PlypU4cODAKwuUiIiI6HXSasXt0NBQTJ06FUVFRbC0tAQAKBQK6OvrIyQkBBMnTnxVcVY5nLhNRESke17ptiRpaWnYs2cPkpKSAAAtW7bEgAEDYGdnV/GIdRCTJCIiIt3zSpOk8uTm5sLU1LSymqvSmCQRERHpnleyBEB58vLysHz5cjg6OlZGc0RERESS0zhJKigowIwZM9CxY0d4e3vj4MGDAIDvv/8ejo6OWLFiBSZMmPCq4iQiIiJ6rTR+u23u3Ln49ttv8Z///AenTp3CoEGD8PHHH+OPP/5AcHAwhg4dilq1ar3KWImIiIheG42TpN27d2Pz5s3o168fLl26hHbt2iE7Oxvx8fEwMNC4GSIiIiKdoPHjttTUVHTs2BEA0LZtWxgaGuLLL79kgkRERETVksZJUmFhIQwNDZWfa9WqpVwriYiIiKi60WoYaPbs2cpX/AsKCrBgwQK1RGnFihWVFx0RERGRRDROkjp37oxr164pP3t7e+PWrVsqdWQyWeVFRkRERCQhjZOkP/744xWGQURERFS1VMpikkRERETVDZMkIiIiIhFMkoiIiIhEMEkiIiIiEsEkiYiIiEiExklSUlIShgwZguzsbLVzCoUCQ4cOVVsSgIiIiEhXaZwkLV26FHZ2drCwsFA7Z2lpCTs7OyxdulTrANauXQsHBwcYGxvD3d0dUVFRZdYdOXIkZDKZ2tG6dWtlnS5duojW6dOnj7LO3Llz1c7b2NhoHTsRERFVXxonSX/++ScGDRpU5vkPPvgAv//+u1ad79q1CxMnTsSMGTMQFxcHX19f9OrVCykpKaL1V61aBblcrjxSU1NRt25dlbj279+vUufKlSvQ19dXi71169Yq9S5fvqxV7ERERFS9abyY5D///IMGDRqUeb5evXpITU3VqvMVK1Zg1KhRGD16NABg5cqVOHLkCMLCwhAcHKxW39LSUmUblIMHD+Lhw4f46KOPlGV169ZVuWbnzp0wNTVVS5IMDAy0Gj3Kz89Hfn6+8rPYY0ciIiKqPjQeSbK0tMTNmzfLPH/jxg3RR3FlKSgoQGxsLPz8/FTK/fz8cPr0aY3aCA8PR/fu3dG0adNy6wwePBi1a9dWKU9KSkLDhg3h4OCAwYMHv3A+VXBwsDJJK328SERERNWXxklS586dERoaWub51atXw9fXV+OOMzMzUVxcDGtra5Vya2trpKenv/B6uVyOw4cPK0ehxJw7dw5XrlxRq+Ph4YGIiAgcOXIEGzZsQHp6Ory9vZGVlVVmW0FBQVAoFMpD21EzIiIi0i0aP24LCgqCl5cXBg4ciC+++AKtWrUCAFy9ehUhISE4cuSIxiNAz/v3priCIGi0Ue7mzZthZWUFf3//MuuEh4fD1dUVnTp1Uinv1auX8p/d3Nzg5eWFZs2aYcuWLZg8ebJoW0ZGRjAyMnphXERERFQ9aJwktWvXDnv37sXHH3+MAwcOqJx74403sHv3brRv317jjuvVqwd9fX21UaOMjAy10aV/EwQBmzZtwrBhw2BoaChaJzc3Fzt37sT8+fNfGEvt2rXh5uaGpKQkjeMnIiKi6k3jJAkA3n33Xfzzzz/47bffcOPGDQiCgJYtW8LPzw+mpqZadWxoaAh3d3dERkaiX79+yvLIyEi8//775V578uRJ3LhxA6NGjSqzzu7du5Gfn4/AwMAXxpKfn4/ExEStHhcSERFR9aZVkgQAJiYmKknNy5g8eTKGDRuGDh06wMvLC+vXr0dKSgrGjRsH4Nkjvjt37iAiIkLluvDwcHh4eMDV1bXMtsPDw+Hv74833nhD7dzUqVPRt29fNGnSBBkZGViwYAGys7MxYsSISrkvIiIi0n0aJ0llPbaytLREq1at4OfnBz097XY5CQgIQFZWFubPnw+5XA5XV1ccOnRI+baaXC5XWzNJoVBg3759WLVqVZntXr9+HdHR0Th69Kjo+bS0NAwZMgSZmZmoX78+PD09cebMmXLfkiMiIqKaRSYIgqBJxXbt2omWP3r0CHfu3EHr1q1x5MiRctdSqk6ys7NhaWkJhUKh1dIHREREJB1tfr81TpLKI5fLMXToUDRr1gwbN2582eZ0ApMkIiIi3aPN77d2z8fKYGtriwULFmi9LQkRERFRVVUpSRIANGrUCBkZGZXVHBEREZGkKi1JunTpEuzt7SurOSIiIiJJafx2W1kbuioUCpw/fx5Tpkwpd4sQIiIiIl2icZJkZWVV5nYhMpkMY8eOxRdffFFpgRERERFJSeMk6cSJE6LlFhYWaNGiBczMzCotKCIiIiKpaZwkvf322y+sc/HiRbz55psvEw8RERFRlfDSE7cVCgXWrl2L9u3bw93dvTJiIiIiIpJchZOk33//HYGBgbC1tUVoaCh69+6Nv/76qzJjIyIiIpKMVhvcpqWlYfPmzdi0aROePHmCDz74AIWFhdi3bx9cXFxeVYxEREREr53GI0m9e/eGi4sLEhISEBoairt37yI0NPRVxkZEREQkGY1Hko4ePYrx48fj008/RYsWLV5lTERERESS03gkKSoqCjk5OejQoQM8PDywZs0a3L9//1XGRkRERCQZjZMkLy8vbNiwAXK5HGPHjsXOnTvRqFEjlJSUIDIyEjk5Oa8yTiIiIqLXSiYIglDRi69du4bw8HBs3boVjx49wn/+8x/89NNPlRlflZWdnQ1LS0soFApYWFhIHQ4RERFpQJvf75daJ6lVq1YICQlBWloaduzY8TJNEREREVUpLzWSVJNxJImIiEj3vLaRJCIiIqLqikkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIJklEREREIpgkEREREYlgkkREREQkQvIkae3atXBwcICxsTHc3d0RFRVVZt2RI0dCJpOpHa1bt1bW2bx5s2idvLy8CvdLRERENY+kSdKuXbswceJEzJgxA3FxcfD19UWvXr2QkpIiWn/VqlWQy+XKIzU1FXXr1sWgQYNU6llYWKjUk8vlMDY2rnC/REREVPPIBEEQpOrcw8MD7du3R1hYmLLM2dkZ/v7+CA4OfuH1Bw8eRP/+/ZGcnIymTZsCeDaSNHHiRDx69OiV9QsA2dnZsLS0hEKhgIWFhUbXEBERkbS0+f2WbCSpoKAAsbGx8PPzUyn38/PD6dOnNWojPDwc3bt3VyZIpR4/foymTZuicePGePfddxEXF/fS/ebn5yM7O1vlICIioupLsiQpMzMTxcXFsLa2Vim3trZGenr6C6+Xy+U4fPgwRo8erVLu5OSEzZs346effsKOHTtgbGwMHx8fJCUlvVS/wcHBsLS0VB52dnaa3ioRERHpIMknbstkMpXPgiColYnZvHkzrKys4O/vr1Lu6emJwMBAtG3bFr6+vti9ezdatmyJ0NDQl+o3KCgICoVCeaSmpr4wRiIiItJdBlJ1XK9ePejr66uN3mRkZKiN8vybIAjYtGkThg0bBkNDw3Lr6unpoWPHjsqRpIr2a2RkBCMjo3L7IiIioupDspEkQ0NDuLu7IzIyUqU8MjIS3t7e5V578uRJ3LhxA6NGjXphP4Ig4OLFi7C1tX3pfomIiKjmkGwkCQAmT56MYcOGoUOHDvDy8sL69euRkpKCcePGAXj2iOvOnTuIiIhQuS48PBweHh5wdXVVa3PevHnw9PREixYtkJ2djdWrV+PixYv49ttvNe6XiIiISNIkKSAgAFlZWZg/fz7kcjlcXV1x6NAh5dtqcrlcbe0ihUKBffv2YdWqVaJtPnr0CJ988gnS09NhaWmJdu3a4c8//0SnTp007peIiIhI0nWSdBnXSSIiItI9OrFOEhEREVFVxiSJiIiISASTJCIiIiIRTJKIiIiIRDBJIiIiIhLBJImIiIhIBJMkIiIiIhFMkoiIiIhEMEkiIiIiEsEkiYiIiEgEkyQiIiIiEZJucEv0snJzc3H16tUyzz99+hS3b9+Gvb09TExMym3LyckJpqamlR0iERHpKCZJpNOuXr0Kd3f3SmkrNjYW7du3r5S2iIhI9zFJoiotKSkJOTk5ZZ5/+vQptm3bVub5mLsxOFJ4BD1q9YBXQ69y+3r69CkuXLhQ5nlzc3O0aNHixUETEVG1wCSJqqykpCS0bNnypdpwnO0IU0dTHL51GN8GfvvSMV2/fp2JEhFRDcEkiaqs0hGkbdu2wdnZWevrL+dcxrLbywAApo6m2PzHZriZu1UolsTERAQGBpY7qkVERNULkySq8pydnbWeKyQIAkJ+DYGeTA8lQgn0ZHo4nHMYwzsPh0wme0WREhFRdcIlAKhaOn33NOKz4lEilAAASoQSxGfF4/Td0xJHRkREuoJJElU7giAgNC4UejLVP956Mj2ExoVCEASJIiMiIl3Cx21UZeXlPEA7Gz38c+YnmDy6rvF1F5/eRHxWvFp56WjSzkOL8KZJM61iSU9ORjsbPciK8rS6joiIdBeTJKqy7sVH48JYMyDjGyBDs2sEAPMaWkNmaAhBZO6RTBDw450tGHz3HrSZmeQMoPdYM6QIWVpcRUREuoxJElVZvv1G4cABwN7eHsbGxqJ1kpOTMXPmTOVnQV+Goun6gJF4CiTIZIgv0EP7jU8gK1Z97LZgwQI4ODiUGU/t2rXRpN07FbgTIiLSRTKBEzQqJDs7G5aWllAoFLCwsJA6nBpLbFuSrIIs5BQ/e1U/Py8fd+V30dC2IYyMjQAAFgYWqFurrlpb3JaEiKj60+b3myNJpNNMTU25lQgREb0SfLuNiIiISASTJCIiIiIRTJKIiIiIRDBJIiIiIhLBJImIiIhIBJMkIiIiIhFMkoiIiIhEMEkiIiIiEiF5krR27Vo4ODjA2NgY7u7uiIqKKrPuyJEjIZPJ1I7WrVsr62zYsAG+vr6oU6cO6tSpg+7du+PcuXMq7cydO1etDRsbm1d2j0RERKR7JE2Sdu3ahYkTJ2LGjBmIi4uDr68vevXqhZSUFNH6q1atglwuVx6pqamoW7cuBg0apKzzxx9/YMiQIThx4gRiYmLQpEkT+Pn54c6dOypttW7dWqWty5cvv9J7JSIiIt0i6d5tHh4eaN++PcLCwpRlzs7O8Pf3R3Bw8AuvP3jwIPr374/k5GQ0bdpUtE5xcTHq1KmDNWvWYPjw4QCejSQdPHgQFy9erHDs3LuNiIhI92jz+y3ZSFJBQQFiY2Ph5+enUu7n54fTp09r1EZ4eDi6d+9eZoIEPNsAtbCwEHXrqm5ompSUhIYNG8LBwQGDBw/GrVu3yu0rPz8f2dnZKgcRERFVX5IlSZmZmSguLoa1tbVKubW1NdLT0194vVwux+HDhzF69Ohy602fPh2NGjVC9+7dlWUeHh6IiIjAkSNHsGHDBqSnp8Pb2xtZWVllthMcHAxLS0vlYWdn98IYiYiISHdJPnFbJpOpfBYEQa1MzObNm2FlZQV/f/8y64SEhGDHjh3Yv38/jI2NleW9evXCgAED4Obmhu7du+PXX38FAGzZsqXMtoKCgqBQKJRHamrqC2MkIiIi3WUgVcf16tWDvr6+2qhRRkaG2ujSvwmCgE2bNmHYsGEwNDQUrbNs2TIsWrQIx44dQ5s2bcptr3bt2nBzc0NSUlKZdYyMjGBkZFRuO0RERFR9SDaSZGhoCHd3d0RGRqqUR0ZGwtvbu9xrT548iRs3bmDUqFGi55cuXYqvv/4av/32Gzp06PDCWPLz85GYmAhbW1vNb4CIiIiqNclGkgBg8uTJGDZsGDp06AAvLy+sX78eKSkpGDduHIBnj7ju3LmDiIgIlevCw8Ph4eEBV1dXtTZDQkIwa9Ys/PDDD7C3t1eOVJmZmcHMzAwAMHXqVPTt2xdNmjRBRkYGFixYgOzsbIwYMeIV3zERERHpCkmTpICAAGRlZWH+/PmQy+VwdXXFoUOHlG+ryeVytTWTFAoF9u3bh1WrVom2uXbtWhQUFGDgwIEq5XPmzMHcuXMBAGlpaRgyZAgyMzNRv359eHp64syZM+W+JUdEREQ1i6TrJOkyrpNERESke3RinSQiIiKiqoxJEhEREZEIJklEREREIpgkEREREYlgkkREREQkgkkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIJklEREREIpgkEREREYlgkkREREQkgkkSERERkQgmSUREREQimCQRERERiWCSRERERCSCSRIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIA6kDICApKQk5OTllnn/69Clu375dKX3Z29vDxMSkzPPm5uZo0aJFpfRFRESky5gkSSwpKQktW7aUOgwV169fZ6JEREQ1HpMkiZWOIG3btg3Ozs6idV7XSFJiYiICAwPLHdUiIiKqKZgkVRHOzs5o3759med9fHxeYzRERETEidvVRMzdGLx/8H3E3I2ROhQiIqJqgSNJEpMV5aGdjR5MHl0H7lYsZxUEAavOBeNWdjJWnQ2GZ6d5kMlkWrdj8ug62tnoQVaUV6E4iIiIqhPJk6S1a9di6dKlkMvlaN26NVauXAlfX1/RuiNHjsSWLVvUyl1cXBAfH6/8vG/fPsyaNQs3b95Es2bNsHDhQvTr16/C/b5Kxo9TcGGsGfDnWODPirVx2sQY8TYNAADx2ck4va0nfJ5qn+g4A7gw1gyJj1MAeFcsGCIiompC0iRp165dmDhxItauXQsfHx+sW7cOvXr1QkJCApo0aaJWf9WqVVi8eLHyc1FREdq2bYtBgwYpy2JiYhAQEICvv/4a/fr1w4EDB/DBBx8gOjoaHh4eFer3Vcoza4L26x5j+/btcHZy0vp6QRAQem4O9LL/QQlKoAc9hLb0gHcFRpMSr17Fhx9+iPDer/c7ICIiqopkgiAIUnXu4eGB9u3bIywsTFnm7OwMf39/BAcHv/D6gwcPon///khOTkbTpk0BAAEBAcjOzsbhw4eV9Xr27Ik6depgx44dFe43Pz8f+fn5ys/Z2dmws7ODQqGAhYWFdjf+nAsXLsDd3R2xsbHlTtwuy6k7pzDu2Di18u+6fwefRtpN9n7ZWIiIiKq67OxsWFpaavT7LdnE7YKCAsTGxsLPz0+l3M/PD6dPn9aojfDwcHTv3l2ZIAHPRpL+3WaPHj2UbVa03+DgYFhaWioPOzs7jWJ8lQRBQGhcKPRkqv8a9WR6CI0LhYT5LxERkc6TLEnKzMxEcXExrK2tVcqtra2Rnp7+wuvlcjkOHz6M0aNHq5Snp6eX22ZF+w0KCoJCoVAeqampL4zxVTt99zTis+JRIpSolJcIJYjPisfpu5olm0RERKRO8onb/543IwiCRnNpNm/eDCsrK/j7+1eoTW37NTIygpGR0Qvjel1KR5FkkEGA+oiRDDKExoXCu6F3hd50IyIiqukkG0mqV68e9PX11UZvMjIy1EZ5/k0QBGzatAnDhg2DoaGhyjkbG5ty23yZfquSwpJCpD9JF02QAECAgPQn6SgsKXzNkREREVUPko0kGRoawt3dHZGRkSqv50dGRuL9998v99qTJ0/ixo0bGDVqlNo5Ly8vREZGYtKkScqyo0ePwtvb+6X7rUoM9Q2x892deJD3oMw6dY3rwlDfsMzzREREVDZJH7dNnjwZw4YNQ4cOHeDl5YX169cjJSUF48Y9e1srKCgId+7cQUREhMp14eHh8PDwgKurq1qbEyZMQOfOnbFkyRK8//77+PHHH3Hs2DFER0dr3O/rlJubC+DZm2Uvo3R/t+f3Zrv7//+nqcTExJeKgYiIqDqRNEkKCAhAVlYW5s+fD7lcDldXVxw6dEj5tppcLkdKSorKNQqFAvv27cOqVatE2/T29sbOnTsxc+ZMzJo1C82aNcOuXbuUayRp0u/rdPXqVQDAmDFjXnvfZTE3N5c6BCIiIslJuk6SLtNmnYXyZGZm4uDBg3BycoKpqWmF20lMTERgYCC2bdsGZ2fnCrdjbm6OFi1aVPh6IiKiqkyb32/J326r6erVq6e2jMG/5ebmKkecXtbLJmNEREQ1BZMkHXD16lW4u7trVDcwMLDc81xNm4iISDNMknSAk5MTYmNjy60jNnG7rLaIiIjoxTgnqYIqa04SERERvT46sXcbERERUVXGJImIiIhIBJMkIiIiIhFMkoiIiIhEMEkiIiIiEsEkiYiIiEgEkyQiIiIiEUySiIiIiEQwSSIiIiISwSSJiIiISASTJCIiIiIRTJKIiIiIRDBJIiIiIhJhIHUAukoQBADPdhMmIiIi3VD6u136O14eJkkVlJOTAwCws7OTOBIiIiLSVk5ODiwtLcutIxM0SaVITUlJCe7evQtzc3PIZDKpw0F2djbs7OyQmpoKCwsLqcOpMvi9lI3fTdn43ZSN303Z+N2UrSp9N4IgICcnBw0bNoSeXvmzjjiSVEF6enpo3Lix1GGosbCwkPwPYFXE76Vs/G7Kxu+mbPxuysbvpmxV5bt50QhSKU7cJiIiIhLBJImIiIhIBJOkasLIyAhz5syBkZGR1KFUKfxeysbvpmz8bsrG76Zs/G7KpqvfDSduExEREYngSBIRERGRCCZJRERERCKYJBERERGJYJJEREREJIJJEhEREZEIJklEREREIpgkUbV148YNHDlyBE+fPgWg2Y7P1VXdunWRmZkJAPj444+VGzSTuMePHyM7O1vlICA1NRVpaWlSh0E6wNHREVlZWWrljx49gqOjowQRVQzXSdJhq1evFi2XyWQwNjZG8+bN0blzZ+jr67/myKSVlZWFgIAA/P7775DJZEhKSoKjoyNGjRoFKysrLF++XOoQXzszMzP8/fffcHR0hL6+PtLT01G/fn2pw6pSkpOT8dlnn+GPP/5AXl6eslwQBMhkMhQXF0sYnXSKioowb948rF69Go8fPwbw7M/T559/jjlz5qBWrVoSR0hVkZ6eHtLT09GgQQOV8nv37qFJkybIz8+XKDLtcINbHfbNN9/g/v37yM3NRZ06dSAIAh49egRTU1OYmZkhIyMDjo6OOHHiBOzs7KQO97WZNGkSDAwMkJKSAmdnZ2V5QEAAJk2aVCOTJC8vL/j7+8Pd3R2CIGD8+PEwMTERrbtp06bXHF3V8OGHHwJ4dv/W1taQyWQSR1Q1fPbZZzhw4ABCQkLg5eUFAIiJicHcuXORmZmJ7777TuIIpZWVlYXZs2fjxIkTyMjIQElJicr5Bw8eSBSZNH766SflPx85ckRlI9ni4mIcP34c9vb2EkRWMRxJ0mE7duzA+vXrsXHjRjRr1gzAs0dMY8eOxSeffAIfHx8MHjwYNjY22Lt3r8TRvj42NjY4cuQI2rZtC3Nzc1y6dAmOjo5ITk6Gm5ub8m/DNcm9e/fwzTff4ObNm9i3bx969uxZ5vYABw4ceM3RVQ1mZmaIjY1Fq1atpA6lSrG0tMTOnTvRq1cvlfLDhw9j8ODBUCgUEkVWNfTq1Qs3b97EqFGjRJPrESNGSBSZNPT0ns3ikclkalMcatWqBXt7eyxfvhzvvvuuFOFpjSNJOmzmzJnYt2+fMkECgObNm2PZsmUYMGAAbt26hZCQEAwYMEDCKF+/J0+ewNTUVK08MzNT5/YNqizW1tZYvHgxCgoKcP78ecyYMQM+Pj5Sh1WldOzYEampqUyS/sXY2Fj0b/729vYwNDR8/QFVMdHR0YiOjkbbtm2lDqVKKB1Jc3BwwPnz51GvXj2JI3o5TJJ0mFwuR1FRkVp5UVER0tPTAQANGzascZN0O3fujIiICHz99dcAnv2NpqSkBEuXLkXXrl0ljk5ahoaGePLkido8AQI2btyIcePG4c6dO3B1dVWba9OmTRuJIpPW//73P3z99df4/vvvlX/JyM/Px8KFC/HZZ59JHJ30nJyclC+H0P9JTk5WK3v06BGsrKxefzAvgUmSDuvatSvGjh2LjRs3ol27dgCAuLg4fPrpp+jWrRsA4PLly3BwcJAyzNdu6dKl6NKlC/766y8UFBTgiy++QHx8PB48eIBTp05JHZ7khg8fjvDwcCxevFjqUKqU+/fv4+bNm/joo4+UZaWPDGraxO3+/furfD527BgaN26sHC25dOkSCgoK8M4770gRXpWydu1aTJ8+HbNnzxZNri0sLCSKTFpLliyBvb09AgICAACDBg3Cvn37YGtri0OHDunMyBuTJB0WHh6OYcOGwd3dXfl/zMLCQnTv3h0bN24E8GyeRU2bqOzi4oK///4ba9euhb6+Pp48eYL+/fvjf//7H2xtbaUOT3IFBQXYuHEjIiMj0aFDB9SuXVvl/IoVKySKTFoff/wx2rVrhx07dtT4idvPT7YFoPbIvia9CPIiVlZWUCgUyr+YlqqJyfXz1q1bh23btgEAIiMjcezYMfz222/YvXs3pk2bhqNHj0ocoWY4cbsauHbtGq5duwZBEODk5MQ5FVSu8h45ymQy/P77768xmqqjdu3auHTpEpo3by51KKRDOnXqBAMDA0yYMEE0uX777bclikxaJiYmuH79Ouzs7DBhwgTk5eVh3bp1uH79Ojw8PPDw4UOpQ9QIR5J0zOTJk8s9f/LkSeU/19QRAQCIiorCunXrcOvWLezZsweNGjXC1q1b4eDggLfeekvq8CR14sQJqUOokrp168YkibR25coVxMXF8S+n/1KnTh2kpqbCzs4Ov/32GxYsWADg2QibLo2uMUnSMXFxcRrVq8mPCvbt24dhw4bhww8/xIULF5SLluXk5GDRokU4dOiQxBFSVdS3b19MmjQJly9fhpubm9rckvfee0+iyKTVrl070f+ePL9o7ciRI2vsSxEdOnTgW5Ei+vfvj6FDh6JFixbIyspSLiFx8eJFnfqLCB+3UbXTrl07TJo0CcOHD1dZJ+nixYvo2bOn8s0/oueVru8ipibPLQkKCkJYWBjc3NzQqVMnCIKAv/76C3///TdGjhyJhIQEHD9+HPv378f7778vdbiv3Z49ezB37lxMmzZNNLmuqW9FFhYWYtWqVUhNTcXIkSOVLxetXLkSZmZmGD16tMQRaoZJElU7pqamSEhIgL29vUqSdOvWLbi4uKhsOUFE5RszZgyaNGmCWbNmqZQvWLAA//zzDzZs2IA5c+bg119/xV9//SVRlNIRS65r6luR1REft1G1Y2trixs3bqgtgBcdHa1TGysSVQW7d+9GbGysWvngwYPh7u6ODRs2YMiQITV2DqTYekD0zM2bN7Fy5UokJiZCJpPB2dkZEydO1Kn/Dpc9vkyko8aOHYsJEybg7NmzkMlkuHv3LrZv346pU6fiv//9r9ThURV2/PhxvPvuu2jWrBmaN2+Od999F8eOHZM6LEkZGxvj9OnTauWnT5+GsbExgGerLNfU1eybNm1a7lFTHTlyBC4uLjh37hzatGkDV1dXnD17Fi4uLoiMjJQ6PI1xJImqnS+++AIKhQJdu3ZFXl4eOnfuDCMjI0ydOpUrBFOZ1qxZg0mTJmHgwIGYMGECAODMmTPo3bs3VqxYUWP/7Hz++ecYN24cYmNj0bFjR8hkMpw7dw4bN27EV199BeDZD2LpnJOa6Nq1awgNDVWOmDg5OeHzzz+v0ZO5p0+fjkmTJqktWjt9+nR8+eWX+M9//iNRZNrhnCSqVoqLixEdHQ03NzcYGxsjISEBJSUlcHFxgZmZmdThURXWqFEjBAUFqSVD3377LRYuXIi7d+9KFJn0tm/fjjVr1uDatWsAgFatWuHzzz/H0KFDAQBPnz5Vvu1W0+zduxdDhgxBhw4d4OXlBeBZcn3+/Hn88MMPGDRokMQRSsPY2BiXL19GixYtVMqvX7+ONm3a6MzcUCZJVO0YGxsjMTGxxm3HQi/H3NwccXFxaq8nJyUloV27dnj8+LFEkUnr2LFj6N69u+i5devWYezYsa85oqrF0dERgYGBmD9/vkr5nDlzsHXrVty6dUuiyKRlZ2eHFStWqCWJu3fvxtSpU5GSkiJRZNrhnCSqdtzc3Grsf5io4t577z0cOHBArfzHH39E3759JYioaujTpw+mTJmCgoICZdn9+/fRt29fBAUFSRhZ1ZCeno7hw4erlQcGBtbo5UbGjBmDTz75BEuWLEFUVBSio6OxePFijB07Fp988onU4WmMc5Ko2lm4cCGmTp2Kr7/+Gu7u7mp7k9XUDSdJ3erVq5X/7OzsjIULF+KPP/5QeWxy6tQpTJkyRaoQJffnn39i2LBhOHbsGH744Qfcvn0bH3/8MVxcXHDp0iWpw5Ncly5dEBUVpTYCGR0dDV9fX4mikt6sWbNgbm6O5cuXK5Pphg0bYu7cuRg/frzE0WmOj9uo2nl+3ZLnVwrmuiX0b5o+kpXJZDV6dPLJkycYN24c9uzZg5KSEixYsADTpk2rsSv7//TTT8p/vnv3LmbPno0PPvgAnp6eAJ4l13v27MG8efMwbtw4qcKsMnJycgA8e6Sta5gkUbWzZcsW2NnZQV9fX6W8pKQEKSkpGDFihESREemmCxcuYOjQoSgqKsLdu3cxePBghIaGqo3S1hTlrc7+PP6l7Nmj2WvXrkEmk6FVq1aoV6+e1CFphUkSVTv6+vqQy+Vo0KCBSnlWVhYaNGhQ4/+jReLK2jz6+T3K3n//fdStW/c1RyatxYsXY86cOfjkk0+wdOlS3Lx5E4GBgcjOzsa2bduUjyaJnvfkyRN8/vnniIiIQElJCYBn/20ePnw4QkNDYWpqKnGEmmGSRNWOnp4e7t27h/r166uU//PPP3BxccGTJ08kioyqsq5du+LChQsoLi5Gq1atIAgCkpKSoK+vDycnJ+XfhqOjo+Hi4iJ1uK+Nra0tNm3apNygFHi2L9dXX32F1atXKzeQJnre2LFjcezYMaxZswY+Pj4Ans3TGj9+PP7zn/8gLCxM4gg1wySJqo3SkYBVq1ZhzJgxKn9TKS4uxtmzZ6Gvr49Tp05JFSJVYStXrkRUVBS+//575eT+7OxsjBo1Cm+99RbGjBmDoUOH4unTpzhy5IjE0b4+mZmZZT4iOXnyJN5+++3XHFHV8vzk/+c9PwLZuXNntcf/1V29evWwd+9edOnSRaX8xIkT+OCDD3D//n1pAtMSkySqNrp27Qrg2X+4vby8YGhoqDxnaGgIe3t7TJ06VW1xMyLg2WKSkZGRaqNE8fHx8PPzw507d3DhwgX4+fkhMzNToiipqnFwcMD9+/eRm5uLOnXqQBAEPHr0CKampjAzM0NGRgYcHR1x4sQJ2NnZSR3ua2NqaorY2Fg4OzurlMfHx6NTp046M6LPdZKo2jhx4gROnDiBESNG4PDhw8rPJ06cwJEjR7Bu3TomSFQmhUKBjIwMtfL79+8jOzsbAGBlZaWyXhDRokWL0LFjRyQlJSErKwsPHjzA9evX4eHhgVWrViElJQU2NjaYNGmS1KG+Vl5eXpgzZ47KytpPnz7FvHnzdGoeG0eSiIgAfPjhh4iJicHy5ctV9iibOnUqvL29sXXrVuzcuRPLli3DX3/9JXW4VEU0a9YM+/btw5tvvqlSHhcXhwEDBuDWrVs4ffo0BgwYALlcLk2QErhy5Qp69uyJvLw8tG3bFjKZDBcvXoSxsTGOHDmC1q1bSx2iRriYJBERnm2xMWnSJAwePBhFRUUAAAMDA4wYMQLffPMNAMDJyQkbN26UMkyqYuRyufLPy/OKioqUK243bNhQuVZQTeHq6oqkpCRs27YNV69ehSAIGDx4MD788EOYmJhIHZ7GOJJERPScx48f49atWxAEAc2aNePGyFSuPn36ID09HRs3bkS7du0APBtFGjNmDGxsbPDLL7/g559/xldffYXLly9LHC1pi0kSERFRBaWnp2PYsGE4fvw4atWqBeDZEgndu3dHREQEbGxscOLECRQWFsLPz0/iaF+va9euITQ0FImJiZDJZHBycsJnn30GJycnqUPTGJMkIiKil3Tt2jVcu3YNgiDAyckJrVq1kjokSe3duxdDhgxBhw4dVPZCPH/+PH744QcMGjRI4gg1wySJiIhIC2Wtzi5mxYoVrzCSqsvR0RGBgYGYP3++SvmcOXOwdetWndkLkUkSERGRFkrXZHsRmUyG33///RVHUzWZmpri77//RvPmzVXKk5KS0LZtW+Tm5koUmXb4dhsREZEWTpw4IXUIVV6XLl0QFRWlliRFR0fD19dXoqi0xySJiIiIXtpPP/2k/Of33nsPX375JWJjY+Hp6Qng2ZykPXv2YN68eVKFqDU+biMiIqKXpqen2SYeMpkMxcXFrziaysEkiYiIiEgE924jIiKiShUREYH8/Hy18oKCAkREREgQUcVwJImIiIgqlb6+PuRyORo0aKBSnpWVhQYNGujM4zaOJBEREVGlEgQBMplMrTwtLQ2WlpYSRFQxfLuNiIiIKkW7du0gk8kgk8nwzjvvwMDg/9KM4uJiJCcno2fPnhJGqB0mSURERFQp/P39AQAXL15Ejx49VDaINjQ0hL29PQYMGCBRdNrjnCQiIiKqVFu2bEFAQACMjY2lDuWlMEkiIiIiEsHHbURERFSpiouL8c0332D37t1ISUlBQUGByvkHDx5IFJl2+HYbERERVap58+ZhxYoV+OCDD6BQKDB58mT0798fenp6mDt3rtThaYyP24iIiKhSNWvWDKtXr0afPn1gbm6OixcvKsvOnDmDH374QeoQNcKRJCIiIqpU6enpcHNzAwCYmZlBoVAAAN599138+uuvUoamFSZJREREVKkaN24MuVwOAGjevDmOHj0KADh//jyMjIykDE0rTJKIiIioUvXr1w/Hjx8HAEyYMAGzZs1CixYtMHz4cHz88ccSR6c5zkkiIiKiV+rs2bM4deoUmjdvjvfee0/qcDTGJImIiIgqVXBwMKytrdVGjTZt2oT79+/jyy+/lCgy7fBxGxEREVWqdevWwcnJSa28devW+O677ySIqGKYJBEREVGlSk9Ph62trVp5/fr1lRO6dQGTJCIiIqpUdnZ2OHXqlFr5qVOn0LBhQwkiqhhuS0JERESVavTo0Zg4cSIKCwvRrVs3AMDx48fxxRdfYMqUKRJHpzlO3CYiIqJKJQgCpk+fjtWrVyv3bTM2NsaXX36J2bNnSxyd5pgkERER0Svx+PFjJCYmwsTEBC1atNCphSQBJklEREREojhxm4iIiEgEkyQiIiIiEUySiIiIiEQwSSIiIiISwSSJiIiISASTJCIiIiIRTJKIiIiIRPw/BV+W+yCgdFoAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.boxplot(result, labels = names, showmeans=True)\n",
    "plt.xticks(rotation = 90)\n",
    "plt.ylabel(\"AUC ROC Score\")\n",
    "plt.title(\"Model Performance\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "id": "9e012621",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Lets start with XGBOOST\n",
    "xgb = XGBClassifier()\n",
    "kfold = StratifiedKFold(n_splits = 5, shuffle = True, random_state = 42)\n",
    "\n",
    "pred_xgb = []\n",
    "for train_index, test_index in kfold.split(X, y):\n",
    "    xtrain = X.iloc[train_index]\n",
    "    ytrain = y.iloc[train_index]\n",
    "    pred_xgb.append(xgb.fit(xtrain, ytrain).predict_proba(newtest))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "id": "30e993cd",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Generate the Predicted Values...\n",
    "submission[\"Outcome\"] = pd.DataFrame(np.array(pred_xgb)[0])[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "id": "f53ae00d",
   "metadata": {},
   "outputs": [],
   "source": [
    "submission.to_csv(\"XGBModel_health.csv\", index = False) # 0.7575"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "id": "ed8ad04c",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Lets start with LGBM\n",
    "lgbm = LGBMClassifier()\n",
    "kfold = StratifiedKFold(n_splits = 5, shuffle = True, random_state = 42)\n",
    "\n",
    "pred_lgbm = []\n",
    "for train_index, test_index in kfold.split(X, y):\n",
    "    xtrain = X.iloc[train_index]\n",
    "    ytrain = y.iloc[train_index]\n",
    "    pred_lgbm.append(lgbm.fit(xtrain, ytrain).predict_proba(newtest))\n",
    "    \n",
    "\n",
    "# Generate the Predicted Values...\n",
    "submission[\"Outcome\"] = pd.DataFrame(np.array(pred_lgbm)[0])[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "id": "3a6de1c5",
   "metadata": {},
   "outputs": [],
   "source": [
    "submission.to_csv(\"LGBMModel_health.csv\", index = False) # 0.7777"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "id": "80faa028",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Learning rate set to 0.059277\n",
      "0:\tlearn: 0.6561714\ttotal: 263ms\tremaining: 4m 22s\n",
      "1:\tlearn: 0.6231708\ttotal: 276ms\tremaining: 2m 17s\n",
      "2:\tlearn: 0.5945105\ttotal: 286ms\tremaining: 1m 35s\n",
      "3:\tlearn: 0.5709654\ttotal: 295ms\tremaining: 1m 13s\n",
      "4:\tlearn: 0.5505144\ttotal: 312ms\tremaining: 1m 2s\n",
      "5:\tlearn: 0.5342755\ttotal: 321ms\tremaining: 53.1s\n",
      "6:\tlearn: 0.5195151\ttotal: 339ms\tremaining: 48.1s\n",
      "7:\tlearn: 0.5052490\ttotal: 347ms\tremaining: 43.1s\n",
      "8:\tlearn: 0.4939886\ttotal: 355ms\tremaining: 39.1s\n",
      "9:\tlearn: 0.4847838\ttotal: 363ms\tremaining: 35.9s\n",
      "10:\tlearn: 0.4764202\ttotal: 371ms\tremaining: 33.3s\n",
      "11:\tlearn: 0.4687268\ttotal: 380ms\tremaining: 31.3s\n",
      "12:\tlearn: 0.4625256\ttotal: 389ms\tremaining: 29.5s\n",
      "13:\tlearn: 0.4567362\ttotal: 398ms\tremaining: 28s\n",
      "14:\tlearn: 0.4506314\ttotal: 407ms\tremaining: 26.7s\n",
      "15:\tlearn: 0.4458441\ttotal: 419ms\tremaining: 25.7s\n",
      "16:\tlearn: 0.4418192\ttotal: 444ms\tremaining: 25.6s\n",
      "17:\tlearn: 0.4384055\ttotal: 452ms\tremaining: 24.6s\n",
      "18:\tlearn: 0.4351618\ttotal: 461ms\tremaining: 23.8s\n",
      "19:\tlearn: 0.4326452\ttotal: 472ms\tremaining: 23.1s\n",
      "20:\tlearn: 0.4302915\ttotal: 482ms\tremaining: 22.4s\n",
      "21:\tlearn: 0.4280215\ttotal: 490ms\tremaining: 21.8s\n",
      "22:\tlearn: 0.4263935\ttotal: 499ms\tremaining: 21.2s\n",
      "23:\tlearn: 0.4251509\ttotal: 508ms\tremaining: 20.7s\n",
      "24:\tlearn: 0.4237340\ttotal: 517ms\tremaining: 20.2s\n",
      "25:\tlearn: 0.4220906\ttotal: 525ms\tremaining: 19.7s\n",
      "26:\tlearn: 0.4206897\ttotal: 534ms\tremaining: 19.2s\n",
      "27:\tlearn: 0.4194888\ttotal: 551ms\tremaining: 19.1s\n",
      "28:\tlearn: 0.4182560\ttotal: 560ms\tremaining: 18.7s\n",
      "29:\tlearn: 0.4174082\ttotal: 567ms\tremaining: 18.3s\n",
      "30:\tlearn: 0.4166308\ttotal: 574ms\tremaining: 18s\n",
      "31:\tlearn: 0.4157586\ttotal: 582ms\tremaining: 17.6s\n",
      "32:\tlearn: 0.4149302\ttotal: 590ms\tremaining: 17.3s\n",
      "33:\tlearn: 0.4139871\ttotal: 605ms\tremaining: 17.2s\n",
      "34:\tlearn: 0.4133361\ttotal: 615ms\tremaining: 17s\n",
      "35:\tlearn: 0.4127490\ttotal: 624ms\tremaining: 16.7s\n",
      "36:\tlearn: 0.4121827\ttotal: 632ms\tremaining: 16.4s\n",
      "37:\tlearn: 0.4113030\ttotal: 639ms\tremaining: 16.2s\n",
      "38:\tlearn: 0.4106954\ttotal: 646ms\tremaining: 15.9s\n",
      "39:\tlearn: 0.4098199\ttotal: 658ms\tremaining: 15.8s\n",
      "40:\tlearn: 0.4093192\ttotal: 675ms\tremaining: 15.8s\n",
      "41:\tlearn: 0.4089090\ttotal: 684ms\tremaining: 15.6s\n",
      "42:\tlearn: 0.4083615\ttotal: 705ms\tremaining: 15.7s\n",
      "43:\tlearn: 0.4078432\ttotal: 714ms\tremaining: 15.5s\n",
      "44:\tlearn: 0.4074100\ttotal: 722ms\tremaining: 15.3s\n",
      "45:\tlearn: 0.4071406\ttotal: 730ms\tremaining: 15.1s\n",
      "46:\tlearn: 0.4066661\ttotal: 737ms\tremaining: 14.9s\n",
      "47:\tlearn: 0.4063631\ttotal: 745ms\tremaining: 14.8s\n",
      "48:\tlearn: 0.4058998\ttotal: 752ms\tremaining: 14.6s\n",
      "49:\tlearn: 0.4056374\ttotal: 759ms\tremaining: 14.4s\n",
      "50:\tlearn: 0.4053375\ttotal: 767ms\tremaining: 14.3s\n",
      "51:\tlearn: 0.4049619\ttotal: 797ms\tremaining: 14.5s\n",
      "52:\tlearn: 0.4046413\ttotal: 807ms\tremaining: 14.4s\n",
      "53:\tlearn: 0.4043262\ttotal: 817ms\tremaining: 14.3s\n",
      "54:\tlearn: 0.4038679\ttotal: 825ms\tremaining: 14.2s\n",
      "55:\tlearn: 0.4036196\ttotal: 833ms\tremaining: 14s\n",
      "56:\tlearn: 0.4033190\ttotal: 840ms\tremaining: 13.9s\n",
      "57:\tlearn: 0.4030439\ttotal: 848ms\tremaining: 13.8s\n",
      "58:\tlearn: 0.4027300\ttotal: 856ms\tremaining: 13.7s\n",
      "59:\tlearn: 0.4023879\ttotal: 866ms\tremaining: 13.6s\n",
      "60:\tlearn: 0.4020431\ttotal: 885ms\tremaining: 13.6s\n",
      "61:\tlearn: 0.4016904\ttotal: 894ms\tremaining: 13.5s\n",
      "62:\tlearn: 0.4013359\ttotal: 910ms\tremaining: 13.5s\n",
      "63:\tlearn: 0.4010828\ttotal: 918ms\tremaining: 13.4s\n",
      "64:\tlearn: 0.4008508\ttotal: 926ms\tremaining: 13.3s\n",
      "65:\tlearn: 0.4005766\ttotal: 935ms\tremaining: 13.2s\n",
      "66:\tlearn: 0.4003982\ttotal: 944ms\tremaining: 13.1s\n",
      "67:\tlearn: 0.4001832\ttotal: 952ms\tremaining: 13s\n",
      "68:\tlearn: 0.3999350\ttotal: 961ms\tremaining: 13s\n",
      "69:\tlearn: 0.3997486\ttotal: 969ms\tremaining: 12.9s\n",
      "70:\tlearn: 0.3995166\ttotal: 976ms\tremaining: 12.8s\n",
      "71:\tlearn: 0.3992757\ttotal: 984ms\tremaining: 12.7s\n",
      "72:\tlearn: 0.3990328\ttotal: 991ms\tremaining: 12.6s\n",
      "73:\tlearn: 0.3989057\ttotal: 998ms\tremaining: 12.5s\n",
      "74:\tlearn: 0.3987264\ttotal: 1s\tremaining: 12.4s\n",
      "75:\tlearn: 0.3984962\ttotal: 1.02s\tremaining: 12.4s\n",
      "76:\tlearn: 0.3983514\ttotal: 1.03s\tremaining: 12.3s\n",
      "77:\tlearn: 0.3982084\ttotal: 1.04s\tremaining: 12.3s\n",
      "78:\tlearn: 0.3980558\ttotal: 1.05s\tremaining: 12.2s\n",
      "79:\tlearn: 0.3978582\ttotal: 1.07s\tremaining: 12.3s\n",
      "80:\tlearn: 0.3976674\ttotal: 1.08s\tremaining: 12.2s\n",
      "81:\tlearn: 0.3974293\ttotal: 1.09s\tremaining: 12.2s\n",
      "82:\tlearn: 0.3973272\ttotal: 1.09s\tremaining: 12.1s\n",
      "83:\tlearn: 0.3971168\ttotal: 1.1s\tremaining: 12s\n",
      "84:\tlearn: 0.3969310\ttotal: 1.11s\tremaining: 11.9s\n",
      "85:\tlearn: 0.3967368\ttotal: 1.12s\tremaining: 11.9s\n",
      "86:\tlearn: 0.3965836\ttotal: 1.12s\tremaining: 11.8s\n",
      "87:\tlearn: 0.3963033\ttotal: 1.14s\tremaining: 11.8s\n",
      "88:\tlearn: 0.3960734\ttotal: 1.16s\tremaining: 11.9s\n",
      "89:\tlearn: 0.3959522\ttotal: 1.17s\tremaining: 11.8s\n",
      "90:\tlearn: 0.3956766\ttotal: 1.18s\tremaining: 11.8s\n",
      "91:\tlearn: 0.3955517\ttotal: 1.18s\tremaining: 11.7s\n",
      "92:\tlearn: 0.3953946\ttotal: 1.19s\tremaining: 11.6s\n",
      "93:\tlearn: 0.3951516\ttotal: 1.2s\tremaining: 11.6s\n",
      "94:\tlearn: 0.3949109\ttotal: 1.21s\tremaining: 11.5s\n",
      "95:\tlearn: 0.3948043\ttotal: 1.21s\tremaining: 11.4s\n",
      "96:\tlearn: 0.3945328\ttotal: 1.22s\tremaining: 11.4s\n",
      "97:\tlearn: 0.3943477\ttotal: 1.23s\tremaining: 11.3s\n",
      "98:\tlearn: 0.3941753\ttotal: 1.25s\tremaining: 11.3s\n",
      "99:\tlearn: 0.3940174\ttotal: 1.27s\tremaining: 11.4s\n",
      "100:\tlearn: 0.3938482\ttotal: 1.27s\tremaining: 11.4s\n",
      "101:\tlearn: 0.3937487\ttotal: 1.28s\tremaining: 11.3s\n",
      "102:\tlearn: 0.3936424\ttotal: 1.29s\tremaining: 11.3s\n",
      "103:\tlearn: 0.3934812\ttotal: 1.3s\tremaining: 11.2s\n",
      "104:\tlearn: 0.3933477\ttotal: 1.31s\tremaining: 11.2s\n",
      "105:\tlearn: 0.3932130\ttotal: 1.32s\tremaining: 11.1s\n",
      "106:\tlearn: 0.3930243\ttotal: 1.33s\tremaining: 11.1s\n",
      "107:\tlearn: 0.3928762\ttotal: 1.34s\tremaining: 11.1s\n",
      "108:\tlearn: 0.3927142\ttotal: 1.35s\tremaining: 11.1s\n",
      "109:\tlearn: 0.3925373\ttotal: 1.36s\tremaining: 11s\n",
      "110:\tlearn: 0.3924352\ttotal: 1.37s\tremaining: 11s\n",
      "111:\tlearn: 0.3923037\ttotal: 1.38s\tremaining: 11s\n",
      "112:\tlearn: 0.3920918\ttotal: 1.39s\tremaining: 10.9s\n",
      "113:\tlearn: 0.3920302\ttotal: 1.4s\tremaining: 10.9s\n",
      "114:\tlearn: 0.3919290\ttotal: 1.41s\tremaining: 10.8s\n",
      "115:\tlearn: 0.3918049\ttotal: 1.43s\tremaining: 10.9s\n",
      "116:\tlearn: 0.3916226\ttotal: 1.43s\tremaining: 10.8s\n",
      "117:\tlearn: 0.3914553\ttotal: 1.44s\tremaining: 10.8s\n",
      "118:\tlearn: 0.3913548\ttotal: 1.45s\tremaining: 10.7s\n",
      "119:\tlearn: 0.3912573\ttotal: 1.46s\tremaining: 10.7s\n",
      "120:\tlearn: 0.3910804\ttotal: 1.47s\tremaining: 10.7s\n",
      "121:\tlearn: 0.3909738\ttotal: 1.48s\tremaining: 10.6s\n",
      "122:\tlearn: 0.3908848\ttotal: 1.49s\tremaining: 10.6s\n",
      "123:\tlearn: 0.3907803\ttotal: 1.51s\tremaining: 10.7s\n",
      "124:\tlearn: 0.3906615\ttotal: 1.52s\tremaining: 10.6s\n",
      "125:\tlearn: 0.3905615\ttotal: 1.53s\tremaining: 10.6s\n",
      "126:\tlearn: 0.3904229\ttotal: 1.54s\tremaining: 10.6s\n",
      "127:\tlearn: 0.3902738\ttotal: 1.55s\tremaining: 10.6s\n",
      "128:\tlearn: 0.3901714\ttotal: 1.56s\tremaining: 10.5s\n",
      "129:\tlearn: 0.3901165\ttotal: 1.57s\tremaining: 10.5s\n",
      "130:\tlearn: 0.3899415\ttotal: 1.57s\tremaining: 10.5s\n",
      "131:\tlearn: 0.3898272\ttotal: 1.58s\tremaining: 10.4s\n",
      "132:\tlearn: 0.3896943\ttotal: 1.59s\tremaining: 10.4s\n",
      "133:\tlearn: 0.3895405\ttotal: 1.61s\tremaining: 10.4s\n",
      "134:\tlearn: 0.3894094\ttotal: 1.63s\tremaining: 10.4s\n",
      "135:\tlearn: 0.3893146\ttotal: 1.64s\tremaining: 10.4s\n",
      "136:\tlearn: 0.3892228\ttotal: 1.65s\tremaining: 10.4s\n",
      "137:\tlearn: 0.3891545\ttotal: 1.66s\tremaining: 10.3s\n",
      "138:\tlearn: 0.3890632\ttotal: 1.66s\tremaining: 10.3s\n",
      "139:\tlearn: 0.3890046\ttotal: 1.67s\tremaining: 10.3s\n",
      "140:\tlearn: 0.3889266\ttotal: 1.68s\tremaining: 10.2s\n",
      "141:\tlearn: 0.3887704\ttotal: 1.69s\tremaining: 10.2s\n",
      "142:\tlearn: 0.3885996\ttotal: 1.7s\tremaining: 10.2s\n",
      "143:\tlearn: 0.3884943\ttotal: 1.71s\tremaining: 10.2s\n",
      "144:\tlearn: 0.3883838\ttotal: 1.72s\tremaining: 10.1s\n",
      "145:\tlearn: 0.3882895\ttotal: 1.73s\tremaining: 10.1s\n",
      "146:\tlearn: 0.3881296\ttotal: 1.74s\tremaining: 10.1s\n",
      "147:\tlearn: 0.3879785\ttotal: 1.75s\tremaining: 10.1s\n",
      "148:\tlearn: 0.3879017\ttotal: 1.75s\tremaining: 10s\n",
      "149:\tlearn: 0.3878251\ttotal: 1.76s\tremaining: 9.99s\n",
      "150:\tlearn: 0.3876949\ttotal: 1.77s\tremaining: 9.95s\n",
      "151:\tlearn: 0.3875515\ttotal: 1.78s\tremaining: 9.95s\n",
      "152:\tlearn: 0.3874678\ttotal: 1.79s\tremaining: 9.93s\n",
      "153:\tlearn: 0.3873414\ttotal: 1.8s\tremaining: 9.9s\n",
      "154:\tlearn: 0.3871178\ttotal: 1.81s\tremaining: 9.86s\n",
      "155:\tlearn: 0.3869955\ttotal: 1.82s\tremaining: 9.83s\n",
      "156:\tlearn: 0.3868870\ttotal: 1.82s\tremaining: 9.8s\n",
      "157:\tlearn: 0.3868089\ttotal: 1.83s\tremaining: 9.78s\n",
      "158:\tlearn: 0.3866188\ttotal: 1.84s\tremaining: 9.74s\n",
      "159:\tlearn: 0.3865113\ttotal: 1.85s\tremaining: 9.74s\n",
      "160:\tlearn: 0.3863613\ttotal: 1.87s\tremaining: 9.73s\n",
      "161:\tlearn: 0.3862469\ttotal: 1.88s\tremaining: 9.74s\n",
      "162:\tlearn: 0.3860945\ttotal: 1.89s\tremaining: 9.71s\n",
      "163:\tlearn: 0.3859270\ttotal: 1.9s\tremaining: 9.68s\n",
      "164:\tlearn: 0.3858053\ttotal: 1.91s\tremaining: 9.65s\n",
      "165:\tlearn: 0.3857111\ttotal: 1.91s\tremaining: 9.61s\n",
      "166:\tlearn: 0.3856181\ttotal: 1.92s\tremaining: 9.58s\n",
      "167:\tlearn: 0.3855027\ttotal: 1.93s\tremaining: 9.54s\n",
      "168:\tlearn: 0.3854100\ttotal: 1.93s\tremaining: 9.51s\n",
      "169:\tlearn: 0.3853017\ttotal: 1.94s\tremaining: 9.48s\n",
      "170:\tlearn: 0.3851966\ttotal: 1.95s\tremaining: 9.44s\n",
      "171:\tlearn: 0.3850795\ttotal: 1.96s\tremaining: 9.42s\n",
      "172:\tlearn: 0.3849494\ttotal: 1.98s\tremaining: 9.46s\n",
      "173:\tlearn: 0.3848280\ttotal: 1.99s\tremaining: 9.43s\n",
      "174:\tlearn: 0.3847428\ttotal: 1.99s\tremaining: 9.4s\n",
      "175:\tlearn: 0.3845956\ttotal: 2s\tremaining: 9.38s\n",
      "176:\tlearn: 0.3844971\ttotal: 2.01s\tremaining: 9.35s\n",
      "177:\tlearn: 0.3843667\ttotal: 2.02s\tremaining: 9.32s\n",
      "178:\tlearn: 0.3842847\ttotal: 2.02s\tremaining: 9.29s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "179:\tlearn: 0.3841723\ttotal: 2.03s\tremaining: 9.27s\n",
      "180:\tlearn: 0.3840502\ttotal: 2.04s\tremaining: 9.25s\n",
      "181:\tlearn: 0.3839719\ttotal: 2.07s\tremaining: 9.29s\n",
      "182:\tlearn: 0.3837740\ttotal: 2.08s\tremaining: 9.28s\n",
      "183:\tlearn: 0.3836852\ttotal: 2.09s\tremaining: 9.26s\n",
      "184:\tlearn: 0.3835801\ttotal: 2.1s\tremaining: 9.26s\n",
      "185:\tlearn: 0.3834480\ttotal: 2.11s\tremaining: 9.23s\n",
      "186:\tlearn: 0.3833642\ttotal: 2.12s\tremaining: 9.21s\n",
      "187:\tlearn: 0.3832822\ttotal: 2.13s\tremaining: 9.18s\n",
      "188:\tlearn: 0.3832010\ttotal: 2.13s\tremaining: 9.15s\n",
      "189:\tlearn: 0.3831208\ttotal: 2.15s\tremaining: 9.17s\n",
      "190:\tlearn: 0.3830102\ttotal: 2.16s\tremaining: 9.14s\n",
      "191:\tlearn: 0.3829006\ttotal: 2.17s\tremaining: 9.11s\n",
      "192:\tlearn: 0.3828329\ttotal: 2.17s\tremaining: 9.09s\n",
      "193:\tlearn: 0.3826708\ttotal: 2.18s\tremaining: 9.06s\n",
      "194:\tlearn: 0.3824970\ttotal: 2.19s\tremaining: 9.03s\n",
      "195:\tlearn: 0.3824082\ttotal: 2.19s\tremaining: 9s\n",
      "196:\tlearn: 0.3822596\ttotal: 2.2s\tremaining: 8.97s\n",
      "197:\tlearn: 0.3821537\ttotal: 2.21s\tremaining: 8.96s\n",
      "198:\tlearn: 0.3819886\ttotal: 2.22s\tremaining: 8.94s\n",
      "199:\tlearn: 0.3818702\ttotal: 2.23s\tremaining: 8.92s\n",
      "200:\tlearn: 0.3817374\ttotal: 2.25s\tremaining: 8.94s\n",
      "201:\tlearn: 0.3815941\ttotal: 2.26s\tremaining: 8.91s\n",
      "202:\tlearn: 0.3814714\ttotal: 2.26s\tremaining: 8.89s\n",
      "203:\tlearn: 0.3813430\ttotal: 2.27s\tremaining: 8.86s\n",
      "204:\tlearn: 0.3812715\ttotal: 2.28s\tremaining: 8.84s\n",
      "205:\tlearn: 0.3811619\ttotal: 2.29s\tremaining: 8.81s\n",
      "206:\tlearn: 0.3810049\ttotal: 2.29s\tremaining: 8.79s\n",
      "207:\tlearn: 0.3808808\ttotal: 2.3s\tremaining: 8.76s\n",
      "208:\tlearn: 0.3807407\ttotal: 2.31s\tremaining: 8.73s\n",
      "209:\tlearn: 0.3806499\ttotal: 2.31s\tremaining: 8.71s\n",
      "210:\tlearn: 0.3804849\ttotal: 2.33s\tremaining: 8.72s\n",
      "211:\tlearn: 0.3803844\ttotal: 2.35s\tremaining: 8.72s\n",
      "212:\tlearn: 0.3802267\ttotal: 2.35s\tremaining: 8.7s\n",
      "213:\tlearn: 0.3800854\ttotal: 2.36s\tremaining: 8.67s\n",
      "214:\tlearn: 0.3799699\ttotal: 2.37s\tremaining: 8.65s\n",
      "215:\tlearn: 0.3798315\ttotal: 2.38s\tremaining: 8.63s\n",
      "216:\tlearn: 0.3797287\ttotal: 2.39s\tremaining: 8.61s\n",
      "217:\tlearn: 0.3796183\ttotal: 2.4s\tremaining: 8.59s\n",
      "218:\tlearn: 0.3795099\ttotal: 2.4s\tremaining: 8.57s\n",
      "219:\tlearn: 0.3794284\ttotal: 2.42s\tremaining: 8.59s\n",
      "220:\tlearn: 0.3793045\ttotal: 2.43s\tremaining: 8.57s\n",
      "221:\tlearn: 0.3792420\ttotal: 2.44s\tremaining: 8.54s\n",
      "222:\tlearn: 0.3790906\ttotal: 2.45s\tremaining: 8.53s\n",
      "223:\tlearn: 0.3789675\ttotal: 2.46s\tremaining: 8.52s\n",
      "224:\tlearn: 0.3788181\ttotal: 2.47s\tremaining: 8.5s\n",
      "225:\tlearn: 0.3787431\ttotal: 2.48s\tremaining: 8.48s\n",
      "226:\tlearn: 0.3786494\ttotal: 2.48s\tremaining: 8.46s\n",
      "227:\tlearn: 0.3785548\ttotal: 2.49s\tremaining: 8.44s\n",
      "228:\tlearn: 0.3784623\ttotal: 2.51s\tremaining: 8.46s\n",
      "229:\tlearn: 0.3783545\ttotal: 2.52s\tremaining: 8.45s\n",
      "230:\tlearn: 0.3782691\ttotal: 2.53s\tremaining: 8.43s\n",
      "231:\tlearn: 0.3781575\ttotal: 2.54s\tremaining: 8.41s\n",
      "232:\tlearn: 0.3780397\ttotal: 2.55s\tremaining: 8.39s\n",
      "233:\tlearn: 0.3779161\ttotal: 2.56s\tremaining: 8.37s\n",
      "234:\tlearn: 0.3778157\ttotal: 2.57s\tremaining: 8.36s\n",
      "235:\tlearn: 0.3776946\ttotal: 2.58s\tremaining: 8.35s\n",
      "236:\tlearn: 0.3775847\ttotal: 2.59s\tremaining: 8.33s\n",
      "237:\tlearn: 0.3774442\ttotal: 2.61s\tremaining: 8.35s\n",
      "238:\tlearn: 0.3773247\ttotal: 2.62s\tremaining: 8.33s\n",
      "239:\tlearn: 0.3772005\ttotal: 2.62s\tremaining: 8.31s\n",
      "240:\tlearn: 0.3771061\ttotal: 2.63s\tremaining: 8.29s\n",
      "241:\tlearn: 0.3768460\ttotal: 2.64s\tremaining: 8.26s\n",
      "242:\tlearn: 0.3767640\ttotal: 2.65s\tremaining: 8.24s\n",
      "243:\tlearn: 0.3766100\ttotal: 2.65s\tremaining: 8.22s\n",
      "244:\tlearn: 0.3765291\ttotal: 2.66s\tremaining: 8.2s\n",
      "245:\tlearn: 0.3764183\ttotal: 2.67s\tremaining: 8.18s\n",
      "246:\tlearn: 0.3762892\ttotal: 2.67s\tremaining: 8.16s\n",
      "247:\tlearn: 0.3761967\ttotal: 2.7s\tremaining: 8.19s\n",
      "248:\tlearn: 0.3761018\ttotal: 2.71s\tremaining: 8.17s\n",
      "249:\tlearn: 0.3760427\ttotal: 2.72s\tremaining: 8.15s\n",
      "250:\tlearn: 0.3759451\ttotal: 2.72s\tremaining: 8.13s\n",
      "251:\tlearn: 0.3757124\ttotal: 2.73s\tremaining: 8.11s\n",
      "252:\tlearn: 0.3756270\ttotal: 2.74s\tremaining: 8.08s\n",
      "253:\tlearn: 0.3754942\ttotal: 2.75s\tremaining: 8.06s\n",
      "254:\tlearn: 0.3753694\ttotal: 2.75s\tremaining: 8.04s\n",
      "255:\tlearn: 0.3752419\ttotal: 2.76s\tremaining: 8.02s\n",
      "256:\tlearn: 0.3751005\ttotal: 2.77s\tremaining: 8s\n",
      "257:\tlearn: 0.3749609\ttotal: 2.79s\tremaining: 8.01s\n",
      "258:\tlearn: 0.3748686\ttotal: 2.79s\tremaining: 7.99s\n",
      "259:\tlearn: 0.3748092\ttotal: 2.8s\tremaining: 7.97s\n",
      "260:\tlearn: 0.3746885\ttotal: 2.81s\tremaining: 7.96s\n",
      "261:\tlearn: 0.3745875\ttotal: 2.82s\tremaining: 7.95s\n",
      "262:\tlearn: 0.3744263\ttotal: 2.83s\tremaining: 7.93s\n",
      "263:\tlearn: 0.3743676\ttotal: 2.84s\tremaining: 7.91s\n",
      "264:\tlearn: 0.3742355\ttotal: 2.84s\tremaining: 7.89s\n",
      "265:\tlearn: 0.3741630\ttotal: 2.85s\tremaining: 7.87s\n",
      "266:\tlearn: 0.3741114\ttotal: 2.86s\tremaining: 7.85s\n",
      "267:\tlearn: 0.3740600\ttotal: 2.88s\tremaining: 7.86s\n",
      "268:\tlearn: 0.3739875\ttotal: 2.89s\tremaining: 7.84s\n",
      "269:\tlearn: 0.3738951\ttotal: 2.89s\tremaining: 7.82s\n",
      "270:\tlearn: 0.3737759\ttotal: 2.9s\tremaining: 7.81s\n",
      "271:\tlearn: 0.3736830\ttotal: 2.91s\tremaining: 7.79s\n",
      "272:\tlearn: 0.3736335\ttotal: 2.92s\tremaining: 7.76s\n",
      "273:\tlearn: 0.3735064\ttotal: 2.93s\tremaining: 7.76s\n",
      "274:\tlearn: 0.3733803\ttotal: 2.94s\tremaining: 7.75s\n",
      "275:\tlearn: 0.3733159\ttotal: 2.95s\tremaining: 7.73s\n",
      "276:\tlearn: 0.3731854\ttotal: 2.96s\tremaining: 7.72s\n",
      "277:\tlearn: 0.3730654\ttotal: 2.97s\tremaining: 7.72s\n",
      "278:\tlearn: 0.3729849\ttotal: 2.98s\tremaining: 7.7s\n",
      "279:\tlearn: 0.3728772\ttotal: 2.99s\tremaining: 7.68s\n",
      "280:\tlearn: 0.3727236\ttotal: 2.99s\tremaining: 7.66s\n",
      "281:\tlearn: 0.3726430\ttotal: 3s\tremaining: 7.64s\n",
      "282:\tlearn: 0.3725606\ttotal: 3.01s\tremaining: 7.62s\n",
      "283:\tlearn: 0.3724425\ttotal: 3.02s\tremaining: 7.6s\n",
      "284:\tlearn: 0.3723619\ttotal: 3.02s\tremaining: 7.58s\n",
      "285:\tlearn: 0.3722764\ttotal: 3.03s\tremaining: 7.57s\n",
      "286:\tlearn: 0.3721935\ttotal: 3.04s\tremaining: 7.54s\n",
      "287:\tlearn: 0.3721057\ttotal: 3.06s\tremaining: 7.58s\n",
      "288:\tlearn: 0.3720258\ttotal: 3.07s\tremaining: 7.56s\n",
      "289:\tlearn: 0.3719516\ttotal: 3.08s\tremaining: 7.55s\n",
      "290:\tlearn: 0.3718799\ttotal: 3.09s\tremaining: 7.53s\n",
      "291:\tlearn: 0.3718018\ttotal: 3.1s\tremaining: 7.51s\n",
      "292:\tlearn: 0.3717013\ttotal: 3.1s\tremaining: 7.49s\n",
      "293:\tlearn: 0.3716119\ttotal: 3.11s\tremaining: 7.48s\n",
      "294:\tlearn: 0.3715340\ttotal: 3.12s\tremaining: 7.46s\n",
      "295:\tlearn: 0.3714699\ttotal: 3.13s\tremaining: 7.44s\n",
      "296:\tlearn: 0.3714090\ttotal: 3.15s\tremaining: 7.45s\n",
      "297:\tlearn: 0.3713021\ttotal: 3.15s\tremaining: 7.43s\n",
      "298:\tlearn: 0.3711935\ttotal: 3.16s\tremaining: 7.42s\n",
      "299:\tlearn: 0.3711350\ttotal: 3.18s\tremaining: 7.42s\n",
      "300:\tlearn: 0.3710402\ttotal: 3.19s\tremaining: 7.4s\n",
      "301:\tlearn: 0.3708948\ttotal: 3.19s\tremaining: 7.38s\n",
      "302:\tlearn: 0.3708088\ttotal: 3.2s\tremaining: 7.36s\n",
      "303:\tlearn: 0.3706819\ttotal: 3.21s\tremaining: 7.35s\n",
      "304:\tlearn: 0.3705906\ttotal: 3.22s\tremaining: 7.33s\n",
      "305:\tlearn: 0.3704662\ttotal: 3.22s\tremaining: 7.31s\n",
      "306:\tlearn: 0.3703634\ttotal: 3.24s\tremaining: 7.32s\n",
      "307:\tlearn: 0.3702489\ttotal: 3.25s\tremaining: 7.3s\n",
      "308:\tlearn: 0.3701614\ttotal: 3.26s\tremaining: 7.28s\n",
      "309:\tlearn: 0.3700192\ttotal: 3.26s\tremaining: 7.26s\n",
      "310:\tlearn: 0.3698925\ttotal: 3.27s\tremaining: 7.25s\n",
      "311:\tlearn: 0.3698061\ttotal: 3.29s\tremaining: 7.25s\n",
      "312:\tlearn: 0.3697375\ttotal: 3.3s\tremaining: 7.24s\n",
      "313:\tlearn: 0.3697101\ttotal: 3.31s\tremaining: 7.22s\n",
      "314:\tlearn: 0.3696404\ttotal: 3.31s\tremaining: 7.2s\n",
      "315:\tlearn: 0.3695668\ttotal: 3.33s\tremaining: 7.21s\n",
      "316:\tlearn: 0.3694450\ttotal: 3.34s\tremaining: 7.2s\n",
      "317:\tlearn: 0.3692941\ttotal: 3.35s\tremaining: 7.18s\n",
      "318:\tlearn: 0.3692129\ttotal: 3.35s\tremaining: 7.16s\n",
      "319:\tlearn: 0.3691170\ttotal: 3.36s\tremaining: 7.15s\n",
      "320:\tlearn: 0.3690467\ttotal: 3.37s\tremaining: 7.13s\n",
      "321:\tlearn: 0.3689185\ttotal: 3.38s\tremaining: 7.12s\n",
      "322:\tlearn: 0.3688538\ttotal: 3.39s\tremaining: 7.1s\n",
      "323:\tlearn: 0.3687577\ttotal: 3.39s\tremaining: 7.08s\n",
      "324:\tlearn: 0.3686585\ttotal: 3.41s\tremaining: 7.08s\n",
      "325:\tlearn: 0.3685458\ttotal: 3.43s\tremaining: 7.09s\n",
      "326:\tlearn: 0.3684536\ttotal: 3.44s\tremaining: 7.07s\n",
      "327:\tlearn: 0.3683614\ttotal: 3.44s\tremaining: 7.05s\n",
      "328:\tlearn: 0.3682717\ttotal: 3.45s\tremaining: 7.04s\n",
      "329:\tlearn: 0.3681649\ttotal: 3.46s\tremaining: 7.02s\n",
      "330:\tlearn: 0.3681051\ttotal: 3.47s\tremaining: 7.01s\n",
      "331:\tlearn: 0.3680309\ttotal: 3.48s\tremaining: 7s\n",
      "332:\tlearn: 0.3680052\ttotal: 3.48s\tremaining: 6.98s\n",
      "333:\tlearn: 0.3678882\ttotal: 3.49s\tremaining: 6.97s\n",
      "334:\tlearn: 0.3678077\ttotal: 3.51s\tremaining: 6.97s\n",
      "335:\tlearn: 0.3677227\ttotal: 3.53s\tremaining: 6.97s\n",
      "336:\tlearn: 0.3676402\ttotal: 3.54s\tremaining: 6.96s\n",
      "337:\tlearn: 0.3675427\ttotal: 3.54s\tremaining: 6.94s\n",
      "338:\tlearn: 0.3674502\ttotal: 3.55s\tremaining: 6.93s\n",
      "339:\tlearn: 0.3673578\ttotal: 3.57s\tremaining: 6.92s\n",
      "340:\tlearn: 0.3672783\ttotal: 3.58s\tremaining: 6.92s\n",
      "341:\tlearn: 0.3671650\ttotal: 3.61s\tremaining: 6.94s\n",
      "342:\tlearn: 0.3670913\ttotal: 3.62s\tremaining: 6.93s\n",
      "343:\tlearn: 0.3669861\ttotal: 3.63s\tremaining: 6.93s\n",
      "344:\tlearn: 0.3668762\ttotal: 3.65s\tremaining: 6.94s\n",
      "345:\tlearn: 0.3667471\ttotal: 3.67s\tremaining: 6.93s\n",
      "346:\tlearn: 0.3666484\ttotal: 3.68s\tremaining: 6.92s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "347:\tlearn: 0.3665631\ttotal: 3.7s\tremaining: 6.94s\n",
      "348:\tlearn: 0.3664341\ttotal: 3.72s\tremaining: 6.93s\n",
      "349:\tlearn: 0.3663317\ttotal: 3.73s\tremaining: 6.92s\n",
      "350:\tlearn: 0.3662615\ttotal: 3.74s\tremaining: 6.91s\n",
      "351:\tlearn: 0.3661700\ttotal: 3.75s\tremaining: 6.9s\n",
      "352:\tlearn: 0.3660794\ttotal: 3.77s\tremaining: 6.9s\n",
      "353:\tlearn: 0.3659965\ttotal: 3.8s\tremaining: 6.93s\n",
      "354:\tlearn: 0.3659441\ttotal: 3.81s\tremaining: 6.92s\n",
      "355:\tlearn: 0.3658340\ttotal: 3.82s\tremaining: 6.91s\n",
      "356:\tlearn: 0.3657978\ttotal: 3.83s\tremaining: 6.9s\n",
      "357:\tlearn: 0.3657406\ttotal: 3.84s\tremaining: 6.89s\n",
      "358:\tlearn: 0.3656263\ttotal: 3.85s\tremaining: 6.88s\n",
      "359:\tlearn: 0.3655233\ttotal: 3.86s\tremaining: 6.87s\n",
      "360:\tlearn: 0.3654541\ttotal: 3.9s\tremaining: 6.9s\n",
      "361:\tlearn: 0.3653519\ttotal: 3.91s\tremaining: 6.89s\n",
      "362:\tlearn: 0.3652602\ttotal: 3.92s\tremaining: 6.88s\n",
      "363:\tlearn: 0.3651824\ttotal: 3.93s\tremaining: 6.88s\n",
      "364:\tlearn: 0.3650622\ttotal: 3.95s\tremaining: 6.87s\n",
      "365:\tlearn: 0.3649930\ttotal: 3.97s\tremaining: 6.87s\n",
      "366:\tlearn: 0.3648749\ttotal: 3.98s\tremaining: 6.87s\n",
      "367:\tlearn: 0.3647704\ttotal: 3.99s\tremaining: 6.86s\n",
      "368:\tlearn: 0.3647051\ttotal: 4.01s\tremaining: 6.85s\n",
      "369:\tlearn: 0.3646240\ttotal: 4.02s\tremaining: 6.84s\n",
      "370:\tlearn: 0.3645135\ttotal: 4.03s\tremaining: 6.83s\n",
      "371:\tlearn: 0.3644339\ttotal: 4.04s\tremaining: 6.81s\n",
      "372:\tlearn: 0.3643456\ttotal: 4.04s\tremaining: 6.8s\n",
      "373:\tlearn: 0.3642228\ttotal: 4.07s\tremaining: 6.81s\n",
      "374:\tlearn: 0.3641290\ttotal: 4.08s\tremaining: 6.79s\n",
      "375:\tlearn: 0.3640659\ttotal: 4.08s\tremaining: 6.78s\n",
      "376:\tlearn: 0.3639560\ttotal: 4.09s\tremaining: 6.77s\n",
      "377:\tlearn: 0.3638732\ttotal: 4.1s\tremaining: 6.75s\n",
      "378:\tlearn: 0.3638169\ttotal: 4.11s\tremaining: 6.74s\n",
      "379:\tlearn: 0.3637284\ttotal: 4.12s\tremaining: 6.72s\n",
      "380:\tlearn: 0.3636319\ttotal: 4.14s\tremaining: 6.72s\n",
      "381:\tlearn: 0.3635492\ttotal: 4.16s\tremaining: 6.73s\n",
      "382:\tlearn: 0.3634501\ttotal: 4.17s\tremaining: 6.71s\n",
      "383:\tlearn: 0.3633954\ttotal: 4.17s\tremaining: 6.7s\n",
      "384:\tlearn: 0.3632898\ttotal: 4.18s\tremaining: 6.68s\n",
      "385:\tlearn: 0.3632065\ttotal: 4.19s\tremaining: 6.67s\n",
      "386:\tlearn: 0.3631074\ttotal: 4.2s\tremaining: 6.65s\n",
      "387:\tlearn: 0.3630292\ttotal: 4.21s\tremaining: 6.63s\n",
      "388:\tlearn: 0.3629012\ttotal: 4.21s\tremaining: 6.62s\n",
      "389:\tlearn: 0.3628283\ttotal: 4.22s\tremaining: 6.6s\n",
      "390:\tlearn: 0.3627090\ttotal: 4.23s\tremaining: 6.59s\n",
      "391:\tlearn: 0.3625997\ttotal: 4.25s\tremaining: 6.6s\n",
      "392:\tlearn: 0.3625083\ttotal: 4.26s\tremaining: 6.58s\n",
      "393:\tlearn: 0.3623940\ttotal: 4.27s\tremaining: 6.57s\n",
      "394:\tlearn: 0.3623030\ttotal: 4.28s\tremaining: 6.55s\n",
      "395:\tlearn: 0.3622140\ttotal: 4.29s\tremaining: 6.54s\n",
      "396:\tlearn: 0.3621203\ttotal: 4.3s\tremaining: 6.53s\n",
      "397:\tlearn: 0.3620652\ttotal: 4.3s\tremaining: 6.51s\n",
      "398:\tlearn: 0.3619955\ttotal: 4.31s\tremaining: 6.49s\n",
      "399:\tlearn: 0.3619140\ttotal: 4.32s\tremaining: 6.48s\n",
      "400:\tlearn: 0.3618619\ttotal: 4.34s\tremaining: 6.48s\n",
      "401:\tlearn: 0.3617764\ttotal: 4.35s\tremaining: 6.47s\n",
      "402:\tlearn: 0.3616798\ttotal: 4.36s\tremaining: 6.45s\n",
      "403:\tlearn: 0.3616580\ttotal: 4.36s\tremaining: 6.43s\n",
      "404:\tlearn: 0.3616137\ttotal: 4.38s\tremaining: 6.43s\n",
      "405:\tlearn: 0.3615335\ttotal: 4.39s\tremaining: 6.42s\n",
      "406:\tlearn: 0.3614611\ttotal: 4.4s\tremaining: 6.41s\n",
      "407:\tlearn: 0.3614136\ttotal: 4.41s\tremaining: 6.39s\n",
      "408:\tlearn: 0.3613377\ttotal: 4.43s\tremaining: 6.4s\n",
      "409:\tlearn: 0.3612516\ttotal: 4.44s\tremaining: 6.38s\n",
      "410:\tlearn: 0.3611676\ttotal: 4.45s\tremaining: 6.37s\n",
      "411:\tlearn: 0.3611000\ttotal: 4.45s\tremaining: 6.36s\n",
      "412:\tlearn: 0.3610223\ttotal: 4.46s\tremaining: 6.34s\n",
      "413:\tlearn: 0.3609929\ttotal: 4.47s\tremaining: 6.33s\n",
      "414:\tlearn: 0.3609212\ttotal: 4.48s\tremaining: 6.31s\n",
      "415:\tlearn: 0.3608971\ttotal: 4.49s\tremaining: 6.3s\n",
      "416:\tlearn: 0.3608001\ttotal: 4.5s\tremaining: 6.29s\n",
      "417:\tlearn: 0.3607352\ttotal: 4.52s\tremaining: 6.29s\n",
      "418:\tlearn: 0.3606562\ttotal: 4.53s\tremaining: 6.28s\n",
      "419:\tlearn: 0.3605642\ttotal: 4.54s\tremaining: 6.27s\n",
      "420:\tlearn: 0.3605070\ttotal: 4.54s\tremaining: 6.25s\n",
      "421:\tlearn: 0.3604261\ttotal: 4.55s\tremaining: 6.24s\n",
      "422:\tlearn: 0.3603272\ttotal: 4.56s\tremaining: 6.22s\n",
      "423:\tlearn: 0.3602485\ttotal: 4.57s\tremaining: 6.21s\n",
      "424:\tlearn: 0.3601899\ttotal: 4.58s\tremaining: 6.19s\n",
      "425:\tlearn: 0.3600985\ttotal: 4.58s\tremaining: 6.18s\n",
      "426:\tlearn: 0.3600112\ttotal: 4.59s\tremaining: 6.16s\n",
      "427:\tlearn: 0.3599568\ttotal: 4.61s\tremaining: 6.16s\n",
      "428:\tlearn: 0.3598577\ttotal: 4.62s\tremaining: 6.16s\n",
      "429:\tlearn: 0.3597729\ttotal: 4.63s\tremaining: 6.14s\n",
      "430:\tlearn: 0.3596850\ttotal: 4.64s\tremaining: 6.13s\n",
      "431:\tlearn: 0.3596182\ttotal: 4.65s\tremaining: 6.11s\n",
      "432:\tlearn: 0.3595425\ttotal: 4.66s\tremaining: 6.1s\n",
      "433:\tlearn: 0.3594567\ttotal: 4.67s\tremaining: 6.08s\n",
      "434:\tlearn: 0.3593668\ttotal: 4.67s\tremaining: 6.07s\n",
      "435:\tlearn: 0.3592971\ttotal: 4.68s\tremaining: 6.06s\n",
      "436:\tlearn: 0.3592311\ttotal: 4.7s\tremaining: 6.06s\n",
      "437:\tlearn: 0.3591622\ttotal: 4.71s\tremaining: 6.05s\n",
      "438:\tlearn: 0.3591211\ttotal: 4.72s\tremaining: 6.04s\n",
      "439:\tlearn: 0.3590415\ttotal: 4.74s\tremaining: 6.04s\n",
      "440:\tlearn: 0.3589814\ttotal: 4.75s\tremaining: 6.03s\n",
      "441:\tlearn: 0.3589061\ttotal: 4.76s\tremaining: 6.01s\n",
      "442:\tlearn: 0.3588411\ttotal: 4.77s\tremaining: 6s\n",
      "443:\tlearn: 0.3587321\ttotal: 4.8s\tremaining: 6.01s\n",
      "444:\tlearn: 0.3586551\ttotal: 4.8s\tremaining: 5.99s\n",
      "445:\tlearn: 0.3585567\ttotal: 4.82s\tremaining: 5.98s\n",
      "446:\tlearn: 0.3585123\ttotal: 4.83s\tremaining: 5.97s\n",
      "447:\tlearn: 0.3584277\ttotal: 4.83s\tremaining: 5.96s\n",
      "448:\tlearn: 0.3583177\ttotal: 4.84s\tremaining: 5.95s\n",
      "449:\tlearn: 0.3582393\ttotal: 4.86s\tremaining: 5.94s\n",
      "450:\tlearn: 0.3582014\ttotal: 4.88s\tremaining: 5.94s\n",
      "451:\tlearn: 0.3581484\ttotal: 4.89s\tremaining: 5.93s\n",
      "452:\tlearn: 0.3580639\ttotal: 4.9s\tremaining: 5.91s\n",
      "453:\tlearn: 0.3579755\ttotal: 4.91s\tremaining: 5.9s\n",
      "454:\tlearn: 0.3579240\ttotal: 4.92s\tremaining: 5.89s\n",
      "455:\tlearn: 0.3577953\ttotal: 4.93s\tremaining: 5.88s\n",
      "456:\tlearn: 0.3577483\ttotal: 4.94s\tremaining: 5.87s\n",
      "457:\tlearn: 0.3576660\ttotal: 4.95s\tremaining: 5.85s\n",
      "458:\tlearn: 0.3575997\ttotal: 4.96s\tremaining: 5.84s\n",
      "459:\tlearn: 0.3575430\ttotal: 4.99s\tremaining: 5.85s\n",
      "460:\tlearn: 0.3574646\ttotal: 5s\tremaining: 5.84s\n",
      "461:\tlearn: 0.3573853\ttotal: 5s\tremaining: 5.83s\n",
      "462:\tlearn: 0.3573179\ttotal: 5.01s\tremaining: 5.81s\n",
      "463:\tlearn: 0.3572175\ttotal: 5.02s\tremaining: 5.8s\n",
      "464:\tlearn: 0.3571484\ttotal: 5.03s\tremaining: 5.78s\n",
      "465:\tlearn: 0.3570599\ttotal: 5.03s\tremaining: 5.77s\n",
      "466:\tlearn: 0.3570096\ttotal: 5.04s\tremaining: 5.75s\n",
      "467:\tlearn: 0.3569099\ttotal: 5.06s\tremaining: 5.75s\n",
      "468:\tlearn: 0.3568314\ttotal: 5.07s\tremaining: 5.74s\n",
      "469:\tlearn: 0.3568149\ttotal: 5.07s\tremaining: 5.72s\n",
      "470:\tlearn: 0.3567360\ttotal: 5.08s\tremaining: 5.71s\n",
      "471:\tlearn: 0.3566228\ttotal: 5.1s\tremaining: 5.7s\n",
      "472:\tlearn: 0.3565559\ttotal: 5.11s\tremaining: 5.69s\n",
      "473:\tlearn: 0.3564730\ttotal: 5.11s\tremaining: 5.67s\n",
      "474:\tlearn: 0.3563918\ttotal: 5.12s\tremaining: 5.66s\n",
      "475:\tlearn: 0.3563283\ttotal: 5.13s\tremaining: 5.65s\n",
      "476:\tlearn: 0.3562576\ttotal: 5.15s\tremaining: 5.65s\n",
      "477:\tlearn: 0.3561614\ttotal: 5.16s\tremaining: 5.64s\n",
      "478:\tlearn: 0.3560887\ttotal: 5.17s\tremaining: 5.63s\n",
      "479:\tlearn: 0.3560001\ttotal: 5.18s\tremaining: 5.61s\n",
      "480:\tlearn: 0.3559377\ttotal: 5.19s\tremaining: 5.6s\n",
      "481:\tlearn: 0.3558721\ttotal: 5.2s\tremaining: 5.58s\n",
      "482:\tlearn: 0.3557703\ttotal: 5.22s\tremaining: 5.58s\n",
      "483:\tlearn: 0.3557129\ttotal: 5.23s\tremaining: 5.57s\n",
      "484:\tlearn: 0.3556671\ttotal: 5.25s\tremaining: 5.57s\n",
      "485:\tlearn: 0.3556239\ttotal: 5.26s\tremaining: 5.56s\n",
      "486:\tlearn: 0.3555561\ttotal: 5.27s\tremaining: 5.55s\n",
      "487:\tlearn: 0.3555235\ttotal: 5.28s\tremaining: 5.54s\n",
      "488:\tlearn: 0.3554401\ttotal: 5.29s\tremaining: 5.52s\n",
      "489:\tlearn: 0.3553670\ttotal: 5.29s\tremaining: 5.51s\n",
      "490:\tlearn: 0.3553087\ttotal: 5.3s\tremaining: 5.5s\n",
      "491:\tlearn: 0.3552302\ttotal: 5.31s\tremaining: 5.48s\n",
      "492:\tlearn: 0.3551173\ttotal: 5.34s\tremaining: 5.49s\n",
      "493:\tlearn: 0.3550940\ttotal: 5.35s\tremaining: 5.48s\n",
      "494:\tlearn: 0.3550635\ttotal: 5.36s\tremaining: 5.47s\n",
      "495:\tlearn: 0.3549699\ttotal: 5.37s\tremaining: 5.45s\n",
      "496:\tlearn: 0.3548981\ttotal: 5.38s\tremaining: 5.44s\n",
      "497:\tlearn: 0.3548116\ttotal: 5.38s\tremaining: 5.43s\n",
      "498:\tlearn: 0.3547478\ttotal: 5.39s\tremaining: 5.42s\n",
      "499:\tlearn: 0.3546878\ttotal: 5.4s\tremaining: 5.4s\n",
      "500:\tlearn: 0.3546084\ttotal: 5.41s\tremaining: 5.39s\n",
      "501:\tlearn: 0.3545332\ttotal: 5.43s\tremaining: 5.38s\n",
      "502:\tlearn: 0.3544424\ttotal: 5.43s\tremaining: 5.37s\n",
      "503:\tlearn: 0.3543838\ttotal: 5.44s\tremaining: 5.36s\n",
      "504:\tlearn: 0.3543078\ttotal: 5.46s\tremaining: 5.35s\n",
      "505:\tlearn: 0.3542232\ttotal: 5.46s\tremaining: 5.33s\n",
      "506:\tlearn: 0.3541761\ttotal: 5.47s\tremaining: 5.32s\n",
      "507:\tlearn: 0.3541069\ttotal: 5.48s\tremaining: 5.31s\n",
      "508:\tlearn: 0.3540210\ttotal: 5.49s\tremaining: 5.29s\n",
      "509:\tlearn: 0.3539636\ttotal: 5.5s\tremaining: 5.28s\n",
      "510:\tlearn: 0.3539037\ttotal: 5.51s\tremaining: 5.28s\n",
      "511:\tlearn: 0.3538687\ttotal: 5.52s\tremaining: 5.26s\n",
      "512:\tlearn: 0.3538186\ttotal: 5.53s\tremaining: 5.25s\n",
      "513:\tlearn: 0.3537521\ttotal: 5.54s\tremaining: 5.23s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514:\tlearn: 0.3537019\ttotal: 5.54s\tremaining: 5.22s\n",
      "515:\tlearn: 0.3536667\ttotal: 5.55s\tremaining: 5.21s\n",
      "516:\tlearn: 0.3536300\ttotal: 5.56s\tremaining: 5.19s\n",
      "517:\tlearn: 0.3535534\ttotal: 5.57s\tremaining: 5.19s\n",
      "518:\tlearn: 0.3534686\ttotal: 5.58s\tremaining: 5.17s\n",
      "519:\tlearn: 0.3534250\ttotal: 5.59s\tremaining: 5.16s\n",
      "520:\tlearn: 0.3533526\ttotal: 5.61s\tremaining: 5.16s\n",
      "521:\tlearn: 0.3533053\ttotal: 5.62s\tremaining: 5.14s\n",
      "522:\tlearn: 0.3532245\ttotal: 5.62s\tremaining: 5.13s\n",
      "523:\tlearn: 0.3531600\ttotal: 5.63s\tremaining: 5.11s\n",
      "524:\tlearn: 0.3530439\ttotal: 5.64s\tremaining: 5.1s\n",
      "525:\tlearn: 0.3529981\ttotal: 5.64s\tremaining: 5.09s\n",
      "526:\tlearn: 0.3529779\ttotal: 5.65s\tremaining: 5.07s\n",
      "527:\tlearn: 0.3529392\ttotal: 5.66s\tremaining: 5.06s\n",
      "528:\tlearn: 0.3528456\ttotal: 5.66s\tremaining: 5.04s\n",
      "529:\tlearn: 0.3528059\ttotal: 5.67s\tremaining: 5.03s\n",
      "530:\tlearn: 0.3527509\ttotal: 5.68s\tremaining: 5.01s\n",
      "531:\tlearn: 0.3526735\ttotal: 5.71s\tremaining: 5.02s\n",
      "532:\tlearn: 0.3526098\ttotal: 5.71s\tremaining: 5.01s\n",
      "533:\tlearn: 0.3525528\ttotal: 5.72s\tremaining: 4.99s\n",
      "534:\tlearn: 0.3524944\ttotal: 5.73s\tremaining: 4.98s\n",
      "535:\tlearn: 0.3524102\ttotal: 5.74s\tremaining: 4.97s\n",
      "536:\tlearn: 0.3523291\ttotal: 5.75s\tremaining: 4.95s\n",
      "537:\tlearn: 0.3522710\ttotal: 5.75s\tremaining: 4.94s\n",
      "538:\tlearn: 0.3522158\ttotal: 5.76s\tremaining: 4.93s\n",
      "539:\tlearn: 0.3521525\ttotal: 5.77s\tremaining: 4.91s\n",
      "540:\tlearn: 0.3520764\ttotal: 5.79s\tremaining: 4.91s\n",
      "541:\tlearn: 0.3520171\ttotal: 5.8s\tremaining: 4.9s\n",
      "542:\tlearn: 0.3519631\ttotal: 5.81s\tremaining: 4.89s\n",
      "543:\tlearn: 0.3519087\ttotal: 5.82s\tremaining: 4.88s\n",
      "544:\tlearn: 0.3518192\ttotal: 5.83s\tremaining: 4.87s\n",
      "545:\tlearn: 0.3517352\ttotal: 5.84s\tremaining: 4.85s\n",
      "546:\tlearn: 0.3516581\ttotal: 5.84s\tremaining: 4.84s\n",
      "547:\tlearn: 0.3515715\ttotal: 5.85s\tremaining: 4.83s\n",
      "548:\tlearn: 0.3514680\ttotal: 5.86s\tremaining: 4.81s\n",
      "549:\tlearn: 0.3513633\ttotal: 5.88s\tremaining: 4.81s\n",
      "550:\tlearn: 0.3512743\ttotal: 5.89s\tremaining: 4.8s\n",
      "551:\tlearn: 0.3512452\ttotal: 5.89s\tremaining: 4.78s\n",
      "552:\tlearn: 0.3511752\ttotal: 5.9s\tremaining: 4.77s\n",
      "553:\tlearn: 0.3510892\ttotal: 5.91s\tremaining: 4.76s\n",
      "554:\tlearn: 0.3509944\ttotal: 5.92s\tremaining: 4.74s\n",
      "555:\tlearn: 0.3509144\ttotal: 5.93s\tremaining: 4.74s\n",
      "556:\tlearn: 0.3508291\ttotal: 5.95s\tremaining: 4.73s\n",
      "557:\tlearn: 0.3507390\ttotal: 5.98s\tremaining: 4.74s\n",
      "558:\tlearn: 0.3506740\ttotal: 5.99s\tremaining: 4.73s\n",
      "559:\tlearn: 0.3506013\ttotal: 6s\tremaining: 4.72s\n",
      "560:\tlearn: 0.3505364\ttotal: 6.01s\tremaining: 4.7s\n",
      "561:\tlearn: 0.3504475\ttotal: 6.02s\tremaining: 4.69s\n",
      "562:\tlearn: 0.3503838\ttotal: 6.03s\tremaining: 4.68s\n",
      "563:\tlearn: 0.3502910\ttotal: 6.03s\tremaining: 4.66s\n",
      "564:\tlearn: 0.3502180\ttotal: 6.04s\tremaining: 4.65s\n",
      "565:\tlearn: 0.3501522\ttotal: 6.07s\tremaining: 4.66s\n",
      "566:\tlearn: 0.3500951\ttotal: 6.08s\tremaining: 4.64s\n",
      "567:\tlearn: 0.3500283\ttotal: 6.09s\tremaining: 4.63s\n",
      "568:\tlearn: 0.3499386\ttotal: 6.1s\tremaining: 4.62s\n",
      "569:\tlearn: 0.3498420\ttotal: 6.11s\tremaining: 4.61s\n",
      "570:\tlearn: 0.3497947\ttotal: 6.11s\tremaining: 4.59s\n",
      "571:\tlearn: 0.3497155\ttotal: 6.12s\tremaining: 4.58s\n",
      "572:\tlearn: 0.3496306\ttotal: 6.13s\tremaining: 4.57s\n",
      "573:\tlearn: 0.3495747\ttotal: 6.14s\tremaining: 4.55s\n",
      "574:\tlearn: 0.3494741\ttotal: 6.15s\tremaining: 4.55s\n",
      "575:\tlearn: 0.3494335\ttotal: 6.16s\tremaining: 4.54s\n",
      "576:\tlearn: 0.3493949\ttotal: 6.18s\tremaining: 4.53s\n",
      "577:\tlearn: 0.3493433\ttotal: 6.18s\tremaining: 4.51s\n",
      "578:\tlearn: 0.3492599\ttotal: 6.19s\tremaining: 4.5s\n",
      "579:\tlearn: 0.3491732\ttotal: 6.2s\tremaining: 4.49s\n",
      "580:\tlearn: 0.3491102\ttotal: 6.21s\tremaining: 4.48s\n",
      "581:\tlearn: 0.3490239\ttotal: 6.22s\tremaining: 4.46s\n",
      "582:\tlearn: 0.3489810\ttotal: 6.22s\tremaining: 4.45s\n",
      "583:\tlearn: 0.3489187\ttotal: 6.23s\tremaining: 4.44s\n",
      "584:\tlearn: 0.3488648\ttotal: 6.24s\tremaining: 4.42s\n",
      "585:\tlearn: 0.3487932\ttotal: 6.25s\tremaining: 4.41s\n",
      "586:\tlearn: 0.3487369\ttotal: 6.25s\tremaining: 4.4s\n",
      "587:\tlearn: 0.3486613\ttotal: 6.26s\tremaining: 4.39s\n",
      "588:\tlearn: 0.3486114\ttotal: 6.27s\tremaining: 4.37s\n",
      "589:\tlearn: 0.3485493\ttotal: 6.27s\tremaining: 4.36s\n",
      "590:\tlearn: 0.3485002\ttotal: 6.28s\tremaining: 4.35s\n",
      "591:\tlearn: 0.3484098\ttotal: 6.29s\tremaining: 4.34s\n",
      "592:\tlearn: 0.3483195\ttotal: 6.3s\tremaining: 4.33s\n",
      "593:\tlearn: 0.3482219\ttotal: 6.31s\tremaining: 4.31s\n",
      "594:\tlearn: 0.3481414\ttotal: 6.32s\tremaining: 4.3s\n",
      "595:\tlearn: 0.3480764\ttotal: 6.33s\tremaining: 4.29s\n",
      "596:\tlearn: 0.3480258\ttotal: 6.34s\tremaining: 4.28s\n",
      "597:\tlearn: 0.3479493\ttotal: 6.35s\tremaining: 4.27s\n",
      "598:\tlearn: 0.3478802\ttotal: 6.36s\tremaining: 4.25s\n",
      "599:\tlearn: 0.3478381\ttotal: 6.36s\tremaining: 4.24s\n",
      "600:\tlearn: 0.3478155\ttotal: 6.37s\tremaining: 4.23s\n",
      "601:\tlearn: 0.3477369\ttotal: 6.38s\tremaining: 4.22s\n",
      "602:\tlearn: 0.3476763\ttotal: 6.39s\tremaining: 4.21s\n",
      "603:\tlearn: 0.3476213\ttotal: 6.4s\tremaining: 4.2s\n",
      "604:\tlearn: 0.3475579\ttotal: 6.42s\tremaining: 4.19s\n",
      "605:\tlearn: 0.3475055\ttotal: 6.43s\tremaining: 4.18s\n",
      "606:\tlearn: 0.3474392\ttotal: 6.45s\tremaining: 4.17s\n",
      "607:\tlearn: 0.3473722\ttotal: 6.45s\tremaining: 4.16s\n",
      "608:\tlearn: 0.3473175\ttotal: 6.46s\tremaining: 4.15s\n",
      "609:\tlearn: 0.3472346\ttotal: 6.47s\tremaining: 4.13s\n",
      "610:\tlearn: 0.3471762\ttotal: 6.48s\tremaining: 4.12s\n",
      "611:\tlearn: 0.3471033\ttotal: 6.48s\tremaining: 4.11s\n",
      "612:\tlearn: 0.3470390\ttotal: 6.49s\tremaining: 4.1s\n",
      "613:\tlearn: 0.3469570\ttotal: 6.51s\tremaining: 4.09s\n",
      "614:\tlearn: 0.3468755\ttotal: 6.51s\tremaining: 4.08s\n",
      "615:\tlearn: 0.3468350\ttotal: 6.53s\tremaining: 4.07s\n",
      "616:\tlearn: 0.3467806\ttotal: 6.54s\tremaining: 4.06s\n",
      "617:\tlearn: 0.3467256\ttotal: 6.54s\tremaining: 4.05s\n",
      "618:\tlearn: 0.3466773\ttotal: 6.55s\tremaining: 4.03s\n",
      "619:\tlearn: 0.3466160\ttotal: 6.56s\tremaining: 4.02s\n",
      "620:\tlearn: 0.3465688\ttotal: 6.57s\tremaining: 4.01s\n",
      "621:\tlearn: 0.3465124\ttotal: 6.58s\tremaining: 4s\n",
      "622:\tlearn: 0.3464286\ttotal: 6.58s\tremaining: 3.98s\n",
      "623:\tlearn: 0.3463368\ttotal: 6.59s\tremaining: 3.97s\n",
      "624:\tlearn: 0.3462736\ttotal: 6.6s\tremaining: 3.96s\n",
      "625:\tlearn: 0.3462093\ttotal: 6.61s\tremaining: 3.95s\n",
      "626:\tlearn: 0.3461359\ttotal: 6.61s\tremaining: 3.93s\n",
      "627:\tlearn: 0.3460497\ttotal: 6.62s\tremaining: 3.92s\n",
      "628:\tlearn: 0.3459941\ttotal: 6.63s\tremaining: 3.91s\n",
      "629:\tlearn: 0.3459360\ttotal: 6.64s\tremaining: 3.9s\n",
      "630:\tlearn: 0.3458708\ttotal: 6.65s\tremaining: 3.89s\n",
      "631:\tlearn: 0.3458217\ttotal: 6.66s\tremaining: 3.88s\n",
      "632:\tlearn: 0.3457653\ttotal: 6.67s\tremaining: 3.87s\n",
      "633:\tlearn: 0.3457184\ttotal: 6.67s\tremaining: 3.85s\n",
      "634:\tlearn: 0.3456574\ttotal: 6.69s\tremaining: 3.85s\n",
      "635:\tlearn: 0.3455821\ttotal: 6.7s\tremaining: 3.83s\n",
      "636:\tlearn: 0.3454972\ttotal: 6.71s\tremaining: 3.82s\n",
      "637:\tlearn: 0.3454435\ttotal: 6.71s\tremaining: 3.81s\n",
      "638:\tlearn: 0.3453848\ttotal: 6.72s\tremaining: 3.8s\n",
      "639:\tlearn: 0.3453072\ttotal: 6.73s\tremaining: 3.78s\n",
      "640:\tlearn: 0.3452404\ttotal: 6.74s\tremaining: 3.77s\n",
      "641:\tlearn: 0.3451663\ttotal: 6.74s\tremaining: 3.76s\n",
      "642:\tlearn: 0.3451025\ttotal: 6.75s\tremaining: 3.75s\n",
      "643:\tlearn: 0.3450564\ttotal: 6.76s\tremaining: 3.74s\n",
      "644:\tlearn: 0.3449833\ttotal: 6.78s\tremaining: 3.73s\n",
      "645:\tlearn: 0.3449271\ttotal: 6.79s\tremaining: 3.72s\n",
      "646:\tlearn: 0.3448762\ttotal: 6.79s\tremaining: 3.71s\n",
      "647:\tlearn: 0.3448261\ttotal: 6.8s\tremaining: 3.69s\n",
      "648:\tlearn: 0.3447639\ttotal: 6.81s\tremaining: 3.68s\n",
      "649:\tlearn: 0.3447185\ttotal: 6.82s\tremaining: 3.67s\n",
      "650:\tlearn: 0.3446564\ttotal: 6.83s\tremaining: 3.66s\n",
      "651:\tlearn: 0.3445937\ttotal: 6.83s\tremaining: 3.65s\n",
      "652:\tlearn: 0.3445366\ttotal: 6.84s\tremaining: 3.63s\n",
      "653:\tlearn: 0.3444576\ttotal: 6.85s\tremaining: 3.62s\n",
      "654:\tlearn: 0.3444122\ttotal: 6.86s\tremaining: 3.61s\n",
      "655:\tlearn: 0.3443414\ttotal: 6.87s\tremaining: 3.6s\n",
      "656:\tlearn: 0.3442503\ttotal: 6.89s\tremaining: 3.6s\n",
      "657:\tlearn: 0.3442067\ttotal: 6.9s\tremaining: 3.58s\n",
      "658:\tlearn: 0.3441343\ttotal: 6.91s\tremaining: 3.57s\n",
      "659:\tlearn: 0.3440763\ttotal: 6.91s\tremaining: 3.56s\n",
      "660:\tlearn: 0.3439810\ttotal: 6.92s\tremaining: 3.55s\n",
      "661:\tlearn: 0.3439221\ttotal: 6.93s\tremaining: 3.54s\n",
      "662:\tlearn: 0.3438866\ttotal: 6.93s\tremaining: 3.52s\n",
      "663:\tlearn: 0.3438224\ttotal: 6.94s\tremaining: 3.51s\n",
      "664:\tlearn: 0.3437728\ttotal: 6.96s\tremaining: 3.51s\n",
      "665:\tlearn: 0.3436908\ttotal: 6.97s\tremaining: 3.49s\n",
      "666:\tlearn: 0.3436508\ttotal: 6.97s\tremaining: 3.48s\n",
      "667:\tlearn: 0.3436018\ttotal: 6.98s\tremaining: 3.47s\n",
      "668:\tlearn: 0.3435490\ttotal: 6.99s\tremaining: 3.46s\n",
      "669:\tlearn: 0.3434670\ttotal: 7s\tremaining: 3.45s\n",
      "670:\tlearn: 0.3434189\ttotal: 7.01s\tremaining: 3.44s\n",
      "671:\tlearn: 0.3433449\ttotal: 7.02s\tremaining: 3.43s\n",
      "672:\tlearn: 0.3432812\ttotal: 7.03s\tremaining: 3.42s\n",
      "673:\tlearn: 0.3432318\ttotal: 7.04s\tremaining: 3.4s\n",
      "674:\tlearn: 0.3431918\ttotal: 7.05s\tremaining: 3.4s\n",
      "675:\tlearn: 0.3431265\ttotal: 7.06s\tremaining: 3.38s\n",
      "676:\tlearn: 0.3430630\ttotal: 7.07s\tremaining: 3.37s\n",
      "677:\tlearn: 0.3430003\ttotal: 7.08s\tremaining: 3.36s\n",
      "678:\tlearn: 0.3429534\ttotal: 7.09s\tremaining: 3.35s\n",
      "679:\tlearn: 0.3429084\ttotal: 7.09s\tremaining: 3.34s\n",
      "680:\tlearn: 0.3428371\ttotal: 7.1s\tremaining: 3.33s\n",
      "681:\tlearn: 0.3427664\ttotal: 7.11s\tremaining: 3.31s\n",
      "682:\tlearn: 0.3427170\ttotal: 7.12s\tremaining: 3.3s\n",
      "683:\tlearn: 0.3426735\ttotal: 7.14s\tremaining: 3.3s\n",
      "684:\tlearn: 0.3425999\ttotal: 7.15s\tremaining: 3.29s\n",
      "685:\tlearn: 0.3425240\ttotal: 7.16s\tremaining: 3.27s\n",
      "686:\tlearn: 0.3424863\ttotal: 7.16s\tremaining: 3.26s\n",
      "687:\tlearn: 0.3424583\ttotal: 7.17s\tremaining: 3.25s\n",
      "688:\tlearn: 0.3424045\ttotal: 7.18s\tremaining: 3.24s\n",
      "689:\tlearn: 0.3423687\ttotal: 7.18s\tremaining: 3.23s\n",
      "690:\tlearn: 0.3423069\ttotal: 7.19s\tremaining: 3.22s\n",
      "691:\tlearn: 0.3422439\ttotal: 7.2s\tremaining: 3.2s\n",
      "692:\tlearn: 0.3421772\ttotal: 7.21s\tremaining: 3.19s\n",
      "693:\tlearn: 0.3421067\ttotal: 7.21s\tremaining: 3.18s\n",
      "694:\tlearn: 0.3420509\ttotal: 7.22s\tremaining: 3.17s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "695:\tlearn: 0.3420131\ttotal: 7.24s\tremaining: 3.16s\n",
      "696:\tlearn: 0.3419512\ttotal: 7.25s\tremaining: 3.15s\n",
      "697:\tlearn: 0.3419241\ttotal: 7.26s\tremaining: 3.14s\n",
      "698:\tlearn: 0.3418973\ttotal: 7.27s\tremaining: 3.13s\n",
      "699:\tlearn: 0.3418261\ttotal: 7.27s\tremaining: 3.12s\n",
      "700:\tlearn: 0.3417517\ttotal: 7.28s\tremaining: 3.11s\n",
      "701:\tlearn: 0.3417236\ttotal: 7.29s\tremaining: 3.09s\n",
      "702:\tlearn: 0.3416849\ttotal: 7.3s\tremaining: 3.08s\n",
      "703:\tlearn: 0.3416362\ttotal: 7.31s\tremaining: 3.07s\n",
      "704:\tlearn: 0.3415797\ttotal: 7.33s\tremaining: 3.07s\n",
      "705:\tlearn: 0.3414947\ttotal: 7.34s\tremaining: 3.06s\n",
      "706:\tlearn: 0.3414241\ttotal: 7.34s\tremaining: 3.04s\n",
      "707:\tlearn: 0.3413722\ttotal: 7.36s\tremaining: 3.03s\n",
      "708:\tlearn: 0.3413503\ttotal: 7.37s\tremaining: 3.02s\n",
      "709:\tlearn: 0.3413155\ttotal: 7.38s\tremaining: 3.01s\n",
      "710:\tlearn: 0.3412609\ttotal: 7.38s\tremaining: 3s\n",
      "711:\tlearn: 0.3411967\ttotal: 7.39s\tremaining: 2.99s\n",
      "712:\tlearn: 0.3411391\ttotal: 7.4s\tremaining: 2.98s\n",
      "713:\tlearn: 0.3410881\ttotal: 7.42s\tremaining: 2.97s\n",
      "714:\tlearn: 0.3410086\ttotal: 7.43s\tremaining: 2.96s\n",
      "715:\tlearn: 0.3409454\ttotal: 7.43s\tremaining: 2.95s\n",
      "716:\tlearn: 0.3408571\ttotal: 7.44s\tremaining: 2.94s\n",
      "717:\tlearn: 0.3407748\ttotal: 7.45s\tremaining: 2.93s\n",
      "718:\tlearn: 0.3406981\ttotal: 7.46s\tremaining: 2.91s\n",
      "719:\tlearn: 0.3406481\ttotal: 7.46s\tremaining: 2.9s\n",
      "720:\tlearn: 0.3405890\ttotal: 7.47s\tremaining: 2.89s\n",
      "721:\tlearn: 0.3404937\ttotal: 7.49s\tremaining: 2.88s\n",
      "722:\tlearn: 0.3404371\ttotal: 7.51s\tremaining: 2.88s\n",
      "723:\tlearn: 0.3403627\ttotal: 7.51s\tremaining: 2.86s\n",
      "724:\tlearn: 0.3403360\ttotal: 7.52s\tremaining: 2.85s\n",
      "725:\tlearn: 0.3402664\ttotal: 7.53s\tremaining: 2.84s\n",
      "726:\tlearn: 0.3401952\ttotal: 7.54s\tremaining: 2.83s\n",
      "727:\tlearn: 0.3401375\ttotal: 7.54s\tremaining: 2.82s\n",
      "728:\tlearn: 0.3400845\ttotal: 7.55s\tremaining: 2.81s\n",
      "729:\tlearn: 0.3400002\ttotal: 7.56s\tremaining: 2.79s\n",
      "730:\tlearn: 0.3399551\ttotal: 7.57s\tremaining: 2.78s\n",
      "731:\tlearn: 0.3399049\ttotal: 7.57s\tremaining: 2.77s\n",
      "732:\tlearn: 0.3398131\ttotal: 7.58s\tremaining: 2.76s\n",
      "733:\tlearn: 0.3397480\ttotal: 7.6s\tremaining: 2.75s\n",
      "734:\tlearn: 0.3397105\ttotal: 7.61s\tremaining: 2.74s\n",
      "735:\tlearn: 0.3396825\ttotal: 7.62s\tremaining: 2.73s\n",
      "736:\tlearn: 0.3396188\ttotal: 7.63s\tremaining: 2.72s\n",
      "737:\tlearn: 0.3395620\ttotal: 7.63s\tremaining: 2.71s\n",
      "738:\tlearn: 0.3394989\ttotal: 7.64s\tremaining: 2.7s\n",
      "739:\tlearn: 0.3394311\ttotal: 7.65s\tremaining: 2.69s\n",
      "740:\tlearn: 0.3393773\ttotal: 7.66s\tremaining: 2.68s\n",
      "741:\tlearn: 0.3393120\ttotal: 7.66s\tremaining: 2.66s\n",
      "742:\tlearn: 0.3392440\ttotal: 7.67s\tremaining: 2.65s\n",
      "743:\tlearn: 0.3391735\ttotal: 7.69s\tremaining: 2.65s\n",
      "744:\tlearn: 0.3391015\ttotal: 7.7s\tremaining: 2.63s\n",
      "745:\tlearn: 0.3390657\ttotal: 7.7s\tremaining: 2.62s\n",
      "746:\tlearn: 0.3390199\ttotal: 7.71s\tremaining: 2.61s\n",
      "747:\tlearn: 0.3389652\ttotal: 7.72s\tremaining: 2.6s\n",
      "748:\tlearn: 0.3389088\ttotal: 7.73s\tremaining: 2.59s\n",
      "749:\tlearn: 0.3388699\ttotal: 7.74s\tremaining: 2.58s\n",
      "750:\tlearn: 0.3388400\ttotal: 7.75s\tremaining: 2.57s\n",
      "751:\tlearn: 0.3387564\ttotal: 7.75s\tremaining: 2.56s\n",
      "752:\tlearn: 0.3387335\ttotal: 7.76s\tremaining: 2.55s\n",
      "753:\tlearn: 0.3386129\ttotal: 7.78s\tremaining: 2.54s\n",
      "754:\tlearn: 0.3385267\ttotal: 7.79s\tremaining: 2.53s\n",
      "755:\tlearn: 0.3384394\ttotal: 7.79s\tremaining: 2.52s\n",
      "756:\tlearn: 0.3383958\ttotal: 7.8s\tremaining: 2.5s\n",
      "757:\tlearn: 0.3383107\ttotal: 7.81s\tremaining: 2.49s\n",
      "758:\tlearn: 0.3382437\ttotal: 7.82s\tremaining: 2.48s\n",
      "759:\tlearn: 0.3381596\ttotal: 7.82s\tremaining: 2.47s\n",
      "760:\tlearn: 0.3380779\ttotal: 7.83s\tremaining: 2.46s\n",
      "761:\tlearn: 0.3380308\ttotal: 7.84s\tremaining: 2.45s\n",
      "762:\tlearn: 0.3379681\ttotal: 7.85s\tremaining: 2.44s\n",
      "763:\tlearn: 0.3379059\ttotal: 7.87s\tremaining: 2.43s\n",
      "764:\tlearn: 0.3378509\ttotal: 7.88s\tremaining: 2.42s\n",
      "765:\tlearn: 0.3377954\ttotal: 7.89s\tremaining: 2.41s\n",
      "766:\tlearn: 0.3377468\ttotal: 7.89s\tremaining: 2.4s\n",
      "767:\tlearn: 0.3377124\ttotal: 7.9s\tremaining: 2.39s\n",
      "768:\tlearn: 0.3376601\ttotal: 7.91s\tremaining: 2.38s\n",
      "769:\tlearn: 0.3375870\ttotal: 7.92s\tremaining: 2.36s\n",
      "770:\tlearn: 0.3375345\ttotal: 7.92s\tremaining: 2.35s\n",
      "771:\tlearn: 0.3374947\ttotal: 7.93s\tremaining: 2.34s\n",
      "772:\tlearn: 0.3374275\ttotal: 7.94s\tremaining: 2.33s\n",
      "773:\tlearn: 0.3373895\ttotal: 7.96s\tremaining: 2.33s\n",
      "774:\tlearn: 0.3373571\ttotal: 7.97s\tremaining: 2.31s\n",
      "775:\tlearn: 0.3372853\ttotal: 7.98s\tremaining: 2.3s\n",
      "776:\tlearn: 0.3372141\ttotal: 7.99s\tremaining: 2.29s\n",
      "777:\tlearn: 0.3371405\ttotal: 7.99s\tremaining: 2.28s\n",
      "778:\tlearn: 0.3370973\ttotal: 8s\tremaining: 2.27s\n",
      "779:\tlearn: 0.3370184\ttotal: 8.01s\tremaining: 2.26s\n",
      "780:\tlearn: 0.3369768\ttotal: 8.02s\tremaining: 2.25s\n",
      "781:\tlearn: 0.3369042\ttotal: 8.02s\tremaining: 2.24s\n",
      "782:\tlearn: 0.3368400\ttotal: 8.03s\tremaining: 2.23s\n",
      "783:\tlearn: 0.3367505\ttotal: 8.05s\tremaining: 2.22s\n",
      "784:\tlearn: 0.3367143\ttotal: 8.05s\tremaining: 2.21s\n",
      "785:\tlearn: 0.3366674\ttotal: 8.06s\tremaining: 2.19s\n",
      "786:\tlearn: 0.3366060\ttotal: 8.07s\tremaining: 2.19s\n",
      "787:\tlearn: 0.3365311\ttotal: 8.09s\tremaining: 2.17s\n",
      "788:\tlearn: 0.3364651\ttotal: 8.09s\tremaining: 2.16s\n",
      "789:\tlearn: 0.3364163\ttotal: 8.1s\tremaining: 2.15s\n",
      "790:\tlearn: 0.3363548\ttotal: 8.11s\tremaining: 2.14s\n",
      "791:\tlearn: 0.3362825\ttotal: 8.12s\tremaining: 2.13s\n",
      "792:\tlearn: 0.3362334\ttotal: 8.13s\tremaining: 2.12s\n",
      "793:\tlearn: 0.3361720\ttotal: 8.14s\tremaining: 2.11s\n",
      "794:\tlearn: 0.3361383\ttotal: 8.15s\tremaining: 2.1s\n",
      "795:\tlearn: 0.3360514\ttotal: 8.16s\tremaining: 2.09s\n",
      "796:\tlearn: 0.3359702\ttotal: 8.16s\tremaining: 2.08s\n",
      "797:\tlearn: 0.3358923\ttotal: 8.17s\tremaining: 2.07s\n",
      "798:\tlearn: 0.3358287\ttotal: 8.18s\tremaining: 2.06s\n",
      "799:\tlearn: 0.3357640\ttotal: 8.18s\tremaining: 2.05s\n",
      "800:\tlearn: 0.3357096\ttotal: 8.2s\tremaining: 2.04s\n",
      "801:\tlearn: 0.3356578\ttotal: 8.21s\tremaining: 2.02s\n",
      "802:\tlearn: 0.3355770\ttotal: 8.21s\tremaining: 2.02s\n",
      "803:\tlearn: 0.3355403\ttotal: 8.23s\tremaining: 2.01s\n",
      "804:\tlearn: 0.3354791\ttotal: 8.24s\tremaining: 2s\n",
      "805:\tlearn: 0.3354187\ttotal: 8.24s\tremaining: 1.98s\n",
      "806:\tlearn: 0.3353567\ttotal: 8.25s\tremaining: 1.97s\n",
      "807:\tlearn: 0.3352974\ttotal: 8.26s\tremaining: 1.96s\n",
      "808:\tlearn: 0.3352228\ttotal: 8.27s\tremaining: 1.95s\n",
      "809:\tlearn: 0.3351767\ttotal: 8.28s\tremaining: 1.94s\n",
      "810:\tlearn: 0.3351398\ttotal: 8.29s\tremaining: 1.93s\n",
      "811:\tlearn: 0.3350609\ttotal: 8.29s\tremaining: 1.92s\n",
      "812:\tlearn: 0.3349964\ttotal: 8.3s\tremaining: 1.91s\n",
      "813:\tlearn: 0.3349195\ttotal: 8.32s\tremaining: 1.9s\n",
      "814:\tlearn: 0.3348925\ttotal: 8.33s\tremaining: 1.89s\n",
      "815:\tlearn: 0.3347816\ttotal: 8.34s\tremaining: 1.88s\n",
      "816:\tlearn: 0.3347405\ttotal: 8.35s\tremaining: 1.87s\n",
      "817:\tlearn: 0.3347035\ttotal: 8.36s\tremaining: 1.86s\n",
      "818:\tlearn: 0.3346396\ttotal: 8.37s\tremaining: 1.85s\n",
      "819:\tlearn: 0.3345843\ttotal: 8.37s\tremaining: 1.84s\n",
      "820:\tlearn: 0.3345326\ttotal: 8.38s\tremaining: 1.83s\n",
      "821:\tlearn: 0.3344620\ttotal: 8.39s\tremaining: 1.82s\n",
      "822:\tlearn: 0.3343999\ttotal: 8.41s\tremaining: 1.81s\n",
      "823:\tlearn: 0.3343533\ttotal: 8.42s\tremaining: 1.8s\n",
      "824:\tlearn: 0.3342961\ttotal: 8.43s\tremaining: 1.79s\n",
      "825:\tlearn: 0.3342420\ttotal: 8.44s\tremaining: 1.78s\n",
      "826:\tlearn: 0.3341884\ttotal: 8.45s\tremaining: 1.77s\n",
      "827:\tlearn: 0.3341182\ttotal: 8.46s\tremaining: 1.76s\n",
      "828:\tlearn: 0.3340546\ttotal: 8.46s\tremaining: 1.75s\n",
      "829:\tlearn: 0.3339991\ttotal: 8.47s\tremaining: 1.73s\n",
      "830:\tlearn: 0.3339156\ttotal: 8.48s\tremaining: 1.72s\n",
      "831:\tlearn: 0.3338907\ttotal: 8.5s\tremaining: 1.72s\n",
      "832:\tlearn: 0.3338291\ttotal: 8.5s\tremaining: 1.7s\n",
      "833:\tlearn: 0.3338022\ttotal: 8.51s\tremaining: 1.69s\n",
      "834:\tlearn: 0.3337447\ttotal: 8.52s\tremaining: 1.68s\n",
      "835:\tlearn: 0.3337053\ttotal: 8.53s\tremaining: 1.67s\n",
      "836:\tlearn: 0.3336284\ttotal: 8.53s\tremaining: 1.66s\n",
      "837:\tlearn: 0.3335705\ttotal: 8.54s\tremaining: 1.65s\n",
      "838:\tlearn: 0.3335203\ttotal: 8.55s\tremaining: 1.64s\n",
      "839:\tlearn: 0.3334557\ttotal: 8.56s\tremaining: 1.63s\n",
      "840:\tlearn: 0.3333977\ttotal: 8.57s\tremaining: 1.62s\n",
      "841:\tlearn: 0.3333437\ttotal: 8.59s\tremaining: 1.61s\n",
      "842:\tlearn: 0.3333124\ttotal: 8.59s\tremaining: 1.6s\n",
      "843:\tlearn: 0.3332495\ttotal: 8.6s\tremaining: 1.59s\n",
      "844:\tlearn: 0.3331844\ttotal: 8.61s\tremaining: 1.58s\n",
      "845:\tlearn: 0.3330975\ttotal: 8.62s\tremaining: 1.57s\n",
      "846:\tlearn: 0.3330401\ttotal: 8.62s\tremaining: 1.56s\n",
      "847:\tlearn: 0.3329845\ttotal: 8.63s\tremaining: 1.55s\n",
      "848:\tlearn: 0.3329185\ttotal: 8.64s\tremaining: 1.54s\n",
      "849:\tlearn: 0.3328849\ttotal: 8.64s\tremaining: 1.52s\n",
      "850:\tlearn: 0.3328312\ttotal: 8.65s\tremaining: 1.51s\n",
      "851:\tlearn: 0.3327915\ttotal: 8.66s\tremaining: 1.5s\n",
      "852:\tlearn: 0.3327286\ttotal: 8.68s\tremaining: 1.5s\n",
      "853:\tlearn: 0.3326906\ttotal: 8.69s\tremaining: 1.49s\n",
      "854:\tlearn: 0.3326682\ttotal: 8.7s\tremaining: 1.48s\n",
      "855:\tlearn: 0.3326086\ttotal: 8.71s\tremaining: 1.47s\n",
      "856:\tlearn: 0.3325761\ttotal: 8.72s\tremaining: 1.45s\n",
      "857:\tlearn: 0.3325399\ttotal: 8.72s\tremaining: 1.44s\n",
      "858:\tlearn: 0.3324957\ttotal: 8.73s\tremaining: 1.43s\n",
      "859:\tlearn: 0.3324510\ttotal: 8.74s\tremaining: 1.42s\n",
      "860:\tlearn: 0.3324031\ttotal: 8.75s\tremaining: 1.41s\n",
      "861:\tlearn: 0.3323051\ttotal: 8.75s\tremaining: 1.4s\n",
      "862:\tlearn: 0.3322556\ttotal: 8.77s\tremaining: 1.39s\n",
      "863:\tlearn: 0.3322024\ttotal: 8.79s\tremaining: 1.38s\n",
      "864:\tlearn: 0.3321446\ttotal: 8.81s\tremaining: 1.37s\n",
      "865:\tlearn: 0.3320760\ttotal: 8.82s\tremaining: 1.36s\n",
      "866:\tlearn: 0.3320261\ttotal: 8.83s\tremaining: 1.35s\n",
      "867:\tlearn: 0.3319589\ttotal: 8.84s\tremaining: 1.34s\n",
      "868:\tlearn: 0.3319095\ttotal: 8.87s\tremaining: 1.34s\n",
      "869:\tlearn: 0.3318634\ttotal: 8.88s\tremaining: 1.33s\n",
      "870:\tlearn: 0.3318241\ttotal: 8.89s\tremaining: 1.32s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "871:\tlearn: 0.3317634\ttotal: 8.9s\tremaining: 1.31s\n",
      "872:\tlearn: 0.3317131\ttotal: 8.92s\tremaining: 1.3s\n",
      "873:\tlearn: 0.3316220\ttotal: 8.94s\tremaining: 1.29s\n",
      "874:\tlearn: 0.3315596\ttotal: 8.96s\tremaining: 1.28s\n",
      "875:\tlearn: 0.3315146\ttotal: 8.97s\tremaining: 1.27s\n",
      "876:\tlearn: 0.3314510\ttotal: 8.98s\tremaining: 1.26s\n",
      "877:\tlearn: 0.3313975\ttotal: 8.99s\tremaining: 1.25s\n",
      "878:\tlearn: 0.3313287\ttotal: 9.01s\tremaining: 1.24s\n",
      "879:\tlearn: 0.3312885\ttotal: 9.02s\tremaining: 1.23s\n",
      "880:\tlearn: 0.3312408\ttotal: 9.03s\tremaining: 1.22s\n",
      "881:\tlearn: 0.3311789\ttotal: 9.06s\tremaining: 1.21s\n",
      "882:\tlearn: 0.3311424\ttotal: 9.07s\tremaining: 1.2s\n",
      "883:\tlearn: 0.3310750\ttotal: 9.08s\tremaining: 1.19s\n",
      "884:\tlearn: 0.3310343\ttotal: 9.09s\tremaining: 1.18s\n",
      "885:\tlearn: 0.3309740\ttotal: 9.1s\tremaining: 1.17s\n",
      "886:\tlearn: 0.3308996\ttotal: 9.12s\tremaining: 1.16s\n",
      "887:\tlearn: 0.3308345\ttotal: 9.13s\tremaining: 1.15s\n",
      "888:\tlearn: 0.3308087\ttotal: 9.14s\tremaining: 1.14s\n",
      "889:\tlearn: 0.3307560\ttotal: 9.15s\tremaining: 1.13s\n",
      "890:\tlearn: 0.3307196\ttotal: 9.17s\tremaining: 1.12s\n",
      "891:\tlearn: 0.3306738\ttotal: 9.18s\tremaining: 1.11s\n",
      "892:\tlearn: 0.3306222\ttotal: 9.19s\tremaining: 1.1s\n",
      "893:\tlearn: 0.3305665\ttotal: 9.2s\tremaining: 1.09s\n",
      "894:\tlearn: 0.3305376\ttotal: 9.21s\tremaining: 1.08s\n",
      "895:\tlearn: 0.3304949\ttotal: 9.23s\tremaining: 1.07s\n",
      "896:\tlearn: 0.3304442\ttotal: 9.23s\tremaining: 1.06s\n",
      "897:\tlearn: 0.3303953\ttotal: 9.24s\tremaining: 1.05s\n",
      "898:\tlearn: 0.3303407\ttotal: 9.25s\tremaining: 1.04s\n",
      "899:\tlearn: 0.3302897\ttotal: 9.26s\tremaining: 1.03s\n",
      "900:\tlearn: 0.3302163\ttotal: 9.26s\tremaining: 1.02s\n",
      "901:\tlearn: 0.3301695\ttotal: 9.28s\tremaining: 1.01s\n",
      "902:\tlearn: 0.3301191\ttotal: 9.28s\tremaining: 997ms\n",
      "903:\tlearn: 0.3300746\ttotal: 9.29s\tremaining: 987ms\n",
      "904:\tlearn: 0.3300161\ttotal: 9.3s\tremaining: 976ms\n",
      "905:\tlearn: 0.3299694\ttotal: 9.32s\tremaining: 967ms\n",
      "906:\tlearn: 0.3299267\ttotal: 9.32s\tremaining: 956ms\n",
      "907:\tlearn: 0.3298632\ttotal: 9.33s\tremaining: 946ms\n",
      "908:\tlearn: 0.3297743\ttotal: 9.34s\tremaining: 935ms\n",
      "909:\tlearn: 0.3297364\ttotal: 9.35s\tremaining: 925ms\n",
      "910:\tlearn: 0.3296860\ttotal: 9.36s\tremaining: 914ms\n",
      "911:\tlearn: 0.3296160\ttotal: 9.36s\tremaining: 904ms\n",
      "912:\tlearn: 0.3295644\ttotal: 9.37s\tremaining: 893ms\n",
      "913:\tlearn: 0.3294919\ttotal: 9.38s\tremaining: 882ms\n",
      "914:\tlearn: 0.3294229\ttotal: 9.38s\tremaining: 872ms\n",
      "915:\tlearn: 0.3293727\ttotal: 9.41s\tremaining: 863ms\n",
      "916:\tlearn: 0.3293269\ttotal: 9.42s\tremaining: 852ms\n",
      "917:\tlearn: 0.3292753\ttotal: 9.43s\tremaining: 842ms\n",
      "918:\tlearn: 0.3292333\ttotal: 9.43s\tremaining: 832ms\n",
      "919:\tlearn: 0.3291716\ttotal: 9.44s\tremaining: 821ms\n",
      "920:\tlearn: 0.3291076\ttotal: 9.45s\tremaining: 811ms\n",
      "921:\tlearn: 0.3290660\ttotal: 9.46s\tremaining: 800ms\n",
      "922:\tlearn: 0.3290081\ttotal: 9.46s\tremaining: 790ms\n",
      "923:\tlearn: 0.3289763\ttotal: 9.47s\tremaining: 779ms\n",
      "924:\tlearn: 0.3289341\ttotal: 9.48s\tremaining: 768ms\n",
      "925:\tlearn: 0.3288490\ttotal: 9.48s\tremaining: 758ms\n",
      "926:\tlearn: 0.3287719\ttotal: 9.5s\tremaining: 748ms\n",
      "927:\tlearn: 0.3287396\ttotal: 9.52s\tremaining: 738ms\n",
      "928:\tlearn: 0.3286991\ttotal: 9.53s\tremaining: 728ms\n",
      "929:\tlearn: 0.3286235\ttotal: 9.53s\tremaining: 718ms\n",
      "930:\tlearn: 0.3285630\ttotal: 9.54s\tremaining: 707ms\n",
      "931:\tlearn: 0.3285038\ttotal: 9.55s\tremaining: 697ms\n",
      "932:\tlearn: 0.3284827\ttotal: 9.56s\tremaining: 686ms\n",
      "933:\tlearn: 0.3284282\ttotal: 9.56s\tremaining: 676ms\n",
      "934:\tlearn: 0.3283385\ttotal: 9.57s\tremaining: 666ms\n",
      "935:\tlearn: 0.3282901\ttotal: 9.58s\tremaining: 655ms\n",
      "936:\tlearn: 0.3282283\ttotal: 9.59s\tremaining: 645ms\n",
      "937:\tlearn: 0.3281538\ttotal: 9.6s\tremaining: 634ms\n",
      "938:\tlearn: 0.3280894\ttotal: 9.6s\tremaining: 624ms\n",
      "939:\tlearn: 0.3280505\ttotal: 9.61s\tremaining: 613ms\n",
      "940:\tlearn: 0.3279813\ttotal: 9.62s\tremaining: 603ms\n",
      "941:\tlearn: 0.3279142\ttotal: 9.63s\tremaining: 593ms\n",
      "942:\tlearn: 0.3278797\ttotal: 9.64s\tremaining: 583ms\n",
      "943:\tlearn: 0.3278361\ttotal: 9.65s\tremaining: 572ms\n",
      "944:\tlearn: 0.3277825\ttotal: 9.65s\tremaining: 562ms\n",
      "945:\tlearn: 0.3277354\ttotal: 9.66s\tremaining: 552ms\n",
      "946:\tlearn: 0.3276695\ttotal: 9.68s\tremaining: 542ms\n",
      "947:\tlearn: 0.3276226\ttotal: 9.69s\tremaining: 531ms\n",
      "948:\tlearn: 0.3275670\ttotal: 9.7s\tremaining: 521ms\n",
      "949:\tlearn: 0.3275294\ttotal: 9.7s\tremaining: 511ms\n",
      "950:\tlearn: 0.3274914\ttotal: 9.71s\tremaining: 500ms\n",
      "951:\tlearn: 0.3274248\ttotal: 9.72s\tremaining: 490ms\n",
      "952:\tlearn: 0.3273793\ttotal: 9.72s\tremaining: 480ms\n",
      "953:\tlearn: 0.3273255\ttotal: 9.73s\tremaining: 469ms\n",
      "954:\tlearn: 0.3272631\ttotal: 9.74s\tremaining: 459ms\n",
      "955:\tlearn: 0.3272045\ttotal: 9.75s\tremaining: 449ms\n",
      "956:\tlearn: 0.3271980\ttotal: 9.77s\tremaining: 439ms\n",
      "957:\tlearn: 0.3271817\ttotal: 9.78s\tremaining: 429ms\n",
      "958:\tlearn: 0.3271260\ttotal: 9.79s\tremaining: 418ms\n",
      "959:\tlearn: 0.3270736\ttotal: 9.79s\tremaining: 408ms\n",
      "960:\tlearn: 0.3270114\ttotal: 9.8s\tremaining: 398ms\n",
      "961:\tlearn: 0.3269544\ttotal: 9.81s\tremaining: 387ms\n",
      "962:\tlearn: 0.3269050\ttotal: 9.82s\tremaining: 377ms\n",
      "963:\tlearn: 0.3268414\ttotal: 9.82s\tremaining: 367ms\n",
      "964:\tlearn: 0.3267813\ttotal: 9.83s\tremaining: 357ms\n",
      "965:\tlearn: 0.3267265\ttotal: 9.84s\tremaining: 346ms\n",
      "966:\tlearn: 0.3266855\ttotal: 9.85s\tremaining: 336ms\n",
      "967:\tlearn: 0.3266329\ttotal: 9.87s\tremaining: 326ms\n",
      "968:\tlearn: 0.3265841\ttotal: 9.88s\tremaining: 316ms\n",
      "969:\tlearn: 0.3265295\ttotal: 9.89s\tremaining: 306ms\n",
      "970:\tlearn: 0.3264816\ttotal: 9.9s\tremaining: 296ms\n",
      "971:\tlearn: 0.3264547\ttotal: 9.9s\tremaining: 285ms\n",
      "972:\tlearn: 0.3263486\ttotal: 9.91s\tremaining: 275ms\n",
      "973:\tlearn: 0.3263109\ttotal: 9.92s\tremaining: 265ms\n",
      "974:\tlearn: 0.3262566\ttotal: 9.93s\tremaining: 255ms\n",
      "975:\tlearn: 0.3262258\ttotal: 9.93s\tremaining: 244ms\n",
      "976:\tlearn: 0.3261535\ttotal: 9.95s\tremaining: 234ms\n",
      "977:\tlearn: 0.3261092\ttotal: 9.96s\tremaining: 224ms\n",
      "978:\tlearn: 0.3260362\ttotal: 9.97s\tremaining: 214ms\n",
      "979:\tlearn: 0.3259814\ttotal: 9.98s\tremaining: 204ms\n",
      "980:\tlearn: 0.3259211\ttotal: 9.99s\tremaining: 193ms\n",
      "981:\tlearn: 0.3258847\ttotal: 10s\tremaining: 183ms\n",
      "982:\tlearn: 0.3258116\ttotal: 10s\tremaining: 173ms\n",
      "983:\tlearn: 0.3257661\ttotal: 10s\tremaining: 163ms\n",
      "984:\tlearn: 0.3257213\ttotal: 10s\tremaining: 153ms\n",
      "985:\tlearn: 0.3256786\ttotal: 10s\tremaining: 142ms\n",
      "986:\tlearn: 0.3256340\ttotal: 10s\tremaining: 132ms\n",
      "987:\tlearn: 0.3255719\ttotal: 10s\tremaining: 122ms\n",
      "988:\tlearn: 0.3255213\ttotal: 10.1s\tremaining: 112ms\n",
      "989:\tlearn: 0.3254442\ttotal: 10.1s\tremaining: 102ms\n",
      "990:\tlearn: 0.3253714\ttotal: 10.1s\tremaining: 91.4ms\n",
      "991:\tlearn: 0.3253183\ttotal: 10.1s\tremaining: 81.2ms\n",
      "992:\tlearn: 0.3252534\ttotal: 10.1s\tremaining: 71.1ms\n",
      "993:\tlearn: 0.3251872\ttotal: 10.1s\tremaining: 60.9ms\n",
      "994:\tlearn: 0.3251376\ttotal: 10.1s\tremaining: 50.7ms\n",
      "995:\tlearn: 0.3250585\ttotal: 10.1s\tremaining: 40.6ms\n",
      "996:\tlearn: 0.3250019\ttotal: 10.1s\tremaining: 30.4ms\n",
      "997:\tlearn: 0.3249399\ttotal: 10.1s\tremaining: 20.3ms\n",
      "998:\tlearn: 0.3249021\ttotal: 10.1s\tremaining: 10.2ms\n",
      "999:\tlearn: 0.3248636\ttotal: 10.2s\tremaining: 0us\n",
      "Learning rate set to 0.059277\n",
      "0:\tlearn: 0.6561297\ttotal: 10.3ms\tremaining: 10.3s\n",
      "1:\tlearn: 0.6228840\ttotal: 19.8ms\tremaining: 9.86s\n",
      "2:\tlearn: 0.5943537\ttotal: 29.2ms\tremaining: 9.7s\n",
      "3:\tlearn: 0.5719479\ttotal: 38ms\tremaining: 9.47s\n",
      "4:\tlearn: 0.5502894\ttotal: 47.3ms\tremaining: 9.42s\n",
      "5:\tlearn: 0.5316815\ttotal: 57ms\tremaining: 9.44s\n",
      "6:\tlearn: 0.5171287\ttotal: 66.2ms\tremaining: 9.4s\n",
      "7:\tlearn: 0.5027633\ttotal: 87.4ms\tremaining: 10.8s\n",
      "8:\tlearn: 0.4914664\ttotal: 96.4ms\tremaining: 10.6s\n",
      "9:\tlearn: 0.4824540\ttotal: 107ms\tremaining: 10.6s\n",
      "10:\tlearn: 0.4740459\ttotal: 121ms\tremaining: 10.9s\n",
      "11:\tlearn: 0.4669546\ttotal: 128ms\tremaining: 10.5s\n",
      "12:\tlearn: 0.4605974\ttotal: 136ms\tremaining: 10.3s\n",
      "13:\tlearn: 0.4549932\ttotal: 143ms\tremaining: 10.1s\n",
      "14:\tlearn: 0.4502834\ttotal: 151ms\tremaining: 9.94s\n",
      "15:\tlearn: 0.4458260\ttotal: 159ms\tremaining: 9.76s\n",
      "16:\tlearn: 0.4417898\ttotal: 177ms\tremaining: 10.2s\n",
      "17:\tlearn: 0.4382655\ttotal: 184ms\tremaining: 10.1s\n",
      "18:\tlearn: 0.4354836\ttotal: 192ms\tremaining: 9.91s\n",
      "19:\tlearn: 0.4329074\ttotal: 201ms\tremaining: 9.83s\n",
      "20:\tlearn: 0.4307010\ttotal: 209ms\tremaining: 9.74s\n",
      "21:\tlearn: 0.4287556\ttotal: 217ms\tremaining: 9.63s\n",
      "22:\tlearn: 0.4266220\ttotal: 224ms\tremaining: 9.52s\n",
      "23:\tlearn: 0.4246443\ttotal: 239ms\tremaining: 9.72s\n",
      "24:\tlearn: 0.4232081\ttotal: 247ms\tremaining: 9.63s\n",
      "25:\tlearn: 0.4217243\ttotal: 259ms\tremaining: 9.71s\n",
      "26:\tlearn: 0.4205020\ttotal: 272ms\tremaining: 9.8s\n",
      "27:\tlearn: 0.4195705\ttotal: 279ms\tremaining: 9.7s\n",
      "28:\tlearn: 0.4186236\ttotal: 286ms\tremaining: 9.57s\n",
      "29:\tlearn: 0.4175104\ttotal: 292ms\tremaining: 9.45s\n",
      "30:\tlearn: 0.4163727\ttotal: 300ms\tremaining: 9.37s\n",
      "31:\tlearn: 0.4154643\ttotal: 307ms\tremaining: 9.3s\n",
      "32:\tlearn: 0.4145590\ttotal: 315ms\tremaining: 9.22s\n",
      "33:\tlearn: 0.4139627\ttotal: 322ms\tremaining: 9.14s\n",
      "34:\tlearn: 0.4129730\ttotal: 329ms\tremaining: 9.07s\n",
      "35:\tlearn: 0.4123259\ttotal: 336ms\tremaining: 9.01s\n",
      "36:\tlearn: 0.4117299\ttotal: 348ms\tremaining: 9.05s\n",
      "37:\tlearn: 0.4109737\ttotal: 364ms\tremaining: 9.22s\n",
      "38:\tlearn: 0.4104376\ttotal: 373ms\tremaining: 9.19s\n",
      "39:\tlearn: 0.4098696\ttotal: 381ms\tremaining: 9.14s\n",
      "40:\tlearn: 0.4093431\ttotal: 389ms\tremaining: 9.09s\n",
      "41:\tlearn: 0.4088651\ttotal: 396ms\tremaining: 9.04s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "42:\tlearn: 0.4083215\ttotal: 405ms\tremaining: 9.01s\n",
      "43:\tlearn: 0.4079656\ttotal: 413ms\tremaining: 8.98s\n",
      "44:\tlearn: 0.4075610\ttotal: 421ms\tremaining: 8.93s\n",
      "45:\tlearn: 0.4071402\ttotal: 428ms\tremaining: 8.88s\n",
      "46:\tlearn: 0.4069031\ttotal: 446ms\tremaining: 9.05s\n",
      "47:\tlearn: 0.4065022\ttotal: 454ms\tremaining: 9s\n",
      "48:\tlearn: 0.4062116\ttotal: 461ms\tremaining: 8.95s\n",
      "49:\tlearn: 0.4057316\ttotal: 476ms\tremaining: 9.05s\n",
      "50:\tlearn: 0.4052928\ttotal: 484ms\tremaining: 9.01s\n",
      "51:\tlearn: 0.4049952\ttotal: 492ms\tremaining: 8.96s\n",
      "52:\tlearn: 0.4046729\ttotal: 499ms\tremaining: 8.92s\n",
      "53:\tlearn: 0.4044064\ttotal: 507ms\tremaining: 8.87s\n",
      "54:\tlearn: 0.4041481\ttotal: 514ms\tremaining: 8.83s\n",
      "55:\tlearn: 0.4038409\ttotal: 522ms\tremaining: 8.8s\n",
      "56:\tlearn: 0.4034900\ttotal: 539ms\tremaining: 8.91s\n",
      "57:\tlearn: 0.4031682\ttotal: 547ms\tremaining: 8.88s\n",
      "58:\tlearn: 0.4028647\ttotal: 555ms\tremaining: 8.85s\n",
      "59:\tlearn: 0.4025925\ttotal: 562ms\tremaining: 8.81s\n",
      "60:\tlearn: 0.4023454\ttotal: 571ms\tremaining: 8.79s\n",
      "61:\tlearn: 0.4020184\ttotal: 580ms\tremaining: 8.78s\n",
      "62:\tlearn: 0.4015640\ttotal: 596ms\tremaining: 8.86s\n",
      "63:\tlearn: 0.4013298\ttotal: 605ms\tremaining: 8.85s\n",
      "64:\tlearn: 0.4010776\ttotal: 625ms\tremaining: 8.99s\n",
      "65:\tlearn: 0.4008581\ttotal: 633ms\tremaining: 8.96s\n",
      "66:\tlearn: 0.4005905\ttotal: 642ms\tremaining: 8.94s\n",
      "67:\tlearn: 0.4004436\ttotal: 649ms\tremaining: 8.89s\n",
      "68:\tlearn: 0.4001858\ttotal: 656ms\tremaining: 8.86s\n",
      "69:\tlearn: 0.4000219\ttotal: 663ms\tremaining: 8.81s\n",
      "70:\tlearn: 0.3998364\ttotal: 671ms\tremaining: 8.78s\n",
      "71:\tlearn: 0.3996254\ttotal: 678ms\tremaining: 8.73s\n",
      "72:\tlearn: 0.3994409\ttotal: 685ms\tremaining: 8.7s\n",
      "73:\tlearn: 0.3991467\ttotal: 692ms\tremaining: 8.66s\n",
      "74:\tlearn: 0.3990091\ttotal: 698ms\tremaining: 8.61s\n",
      "75:\tlearn: 0.3988685\ttotal: 726ms\tremaining: 8.83s\n",
      "76:\tlearn: 0.3986589\ttotal: 735ms\tremaining: 8.81s\n",
      "77:\tlearn: 0.3985464\ttotal: 742ms\tremaining: 8.77s\n",
      "78:\tlearn: 0.3983279\ttotal: 750ms\tremaining: 8.75s\n",
      "79:\tlearn: 0.3981291\ttotal: 758ms\tremaining: 8.72s\n",
      "80:\tlearn: 0.3979393\ttotal: 765ms\tremaining: 8.68s\n",
      "81:\tlearn: 0.3976617\ttotal: 773ms\tremaining: 8.65s\n",
      "82:\tlearn: 0.3974844\ttotal: 780ms\tremaining: 8.62s\n",
      "83:\tlearn: 0.3973336\ttotal: 787ms\tremaining: 8.58s\n",
      "84:\tlearn: 0.3971143\ttotal: 797ms\tremaining: 8.58s\n",
      "85:\tlearn: 0.3969793\ttotal: 812ms\tremaining: 8.63s\n",
      "86:\tlearn: 0.3968558\ttotal: 824ms\tremaining: 8.65s\n",
      "87:\tlearn: 0.3967247\ttotal: 836ms\tremaining: 8.66s\n",
      "88:\tlearn: 0.3964941\ttotal: 844ms\tremaining: 8.63s\n",
      "89:\tlearn: 0.3963184\ttotal: 851ms\tremaining: 8.61s\n",
      "90:\tlearn: 0.3961829\ttotal: 860ms\tremaining: 8.59s\n",
      "91:\tlearn: 0.3960570\ttotal: 868ms\tremaining: 8.56s\n",
      "92:\tlearn: 0.3958651\ttotal: 875ms\tremaining: 8.53s\n",
      "93:\tlearn: 0.3957065\ttotal: 882ms\tremaining: 8.5s\n",
      "94:\tlearn: 0.3955373\ttotal: 901ms\tremaining: 8.58s\n",
      "95:\tlearn: 0.3953571\ttotal: 908ms\tremaining: 8.55s\n",
      "96:\tlearn: 0.3952416\ttotal: 915ms\tremaining: 8.52s\n",
      "97:\tlearn: 0.3951433\ttotal: 922ms\tremaining: 8.49s\n",
      "98:\tlearn: 0.3950167\ttotal: 929ms\tremaining: 8.46s\n",
      "99:\tlearn: 0.3948258\ttotal: 936ms\tremaining: 8.43s\n",
      "100:\tlearn: 0.3945943\ttotal: 950ms\tremaining: 8.46s\n",
      "101:\tlearn: 0.3944578\ttotal: 958ms\tremaining: 8.44s\n",
      "102:\tlearn: 0.3943723\ttotal: 966ms\tremaining: 8.41s\n",
      "103:\tlearn: 0.3941876\ttotal: 973ms\tremaining: 8.38s\n",
      "104:\tlearn: 0.3940655\ttotal: 990ms\tremaining: 8.44s\n",
      "105:\tlearn: 0.3939407\ttotal: 998ms\tremaining: 8.41s\n",
      "106:\tlearn: 0.3938026\ttotal: 1s\tremaining: 8.39s\n",
      "107:\tlearn: 0.3936917\ttotal: 1.01s\tremaining: 8.37s\n",
      "108:\tlearn: 0.3935010\ttotal: 1.02s\tremaining: 8.35s\n",
      "109:\tlearn: 0.3933677\ttotal: 1.03s\tremaining: 8.33s\n",
      "110:\tlearn: 0.3932471\ttotal: 1.04s\tremaining: 8.3s\n",
      "111:\tlearn: 0.3930939\ttotal: 1.04s\tremaining: 8.28s\n",
      "112:\tlearn: 0.3929279\ttotal: 1.05s\tremaining: 8.26s\n",
      "113:\tlearn: 0.3927944\ttotal: 1.06s\tremaining: 8.25s\n",
      "114:\tlearn: 0.3926339\ttotal: 1.09s\tremaining: 8.37s\n",
      "115:\tlearn: 0.3924853\ttotal: 1.09s\tremaining: 8.34s\n",
      "116:\tlearn: 0.3923681\ttotal: 1.1s\tremaining: 8.33s\n",
      "117:\tlearn: 0.3922429\ttotal: 1.11s\tremaining: 8.31s\n",
      "118:\tlearn: 0.3920941\ttotal: 1.12s\tremaining: 8.29s\n",
      "119:\tlearn: 0.3920132\ttotal: 1.13s\tremaining: 8.26s\n",
      "120:\tlearn: 0.3919183\ttotal: 1.13s\tremaining: 8.24s\n",
      "121:\tlearn: 0.3917811\ttotal: 1.14s\tremaining: 8.21s\n",
      "122:\tlearn: 0.3916228\ttotal: 1.15s\tremaining: 8.19s\n",
      "123:\tlearn: 0.3915058\ttotal: 1.16s\tremaining: 8.18s\n",
      "124:\tlearn: 0.3913292\ttotal: 1.17s\tremaining: 8.2s\n",
      "125:\tlearn: 0.3912467\ttotal: 1.18s\tremaining: 8.19s\n",
      "126:\tlearn: 0.3911478\ttotal: 1.2s\tremaining: 8.21s\n",
      "127:\tlearn: 0.3910361\ttotal: 1.2s\tremaining: 8.2s\n",
      "128:\tlearn: 0.3908964\ttotal: 1.21s\tremaining: 8.18s\n",
      "129:\tlearn: 0.3908004\ttotal: 1.22s\tremaining: 8.16s\n",
      "130:\tlearn: 0.3905604\ttotal: 1.23s\tremaining: 8.14s\n",
      "131:\tlearn: 0.3904581\ttotal: 1.23s\tremaining: 8.12s\n",
      "132:\tlearn: 0.3903162\ttotal: 1.24s\tremaining: 8.09s\n",
      "133:\tlearn: 0.3902126\ttotal: 1.26s\tremaining: 8.13s\n",
      "134:\tlearn: 0.3901340\ttotal: 1.27s\tremaining: 8.11s\n",
      "135:\tlearn: 0.3899824\ttotal: 1.27s\tremaining: 8.09s\n",
      "136:\tlearn: 0.3898695\ttotal: 1.28s\tremaining: 8.07s\n",
      "137:\tlearn: 0.3897016\ttotal: 1.29s\tremaining: 8.05s\n",
      "138:\tlearn: 0.3895237\ttotal: 1.29s\tremaining: 8.03s\n",
      "139:\tlearn: 0.3894141\ttotal: 1.31s\tremaining: 8.05s\n",
      "140:\tlearn: 0.3892936\ttotal: 1.32s\tremaining: 8.03s\n",
      "141:\tlearn: 0.3891497\ttotal: 1.33s\tremaining: 8.01s\n",
      "142:\tlearn: 0.3890536\ttotal: 1.33s\tremaining: 7.99s\n",
      "143:\tlearn: 0.3889537\ttotal: 1.35s\tremaining: 8.03s\n",
      "144:\tlearn: 0.3887626\ttotal: 1.36s\tremaining: 8.02s\n",
      "145:\tlearn: 0.3886945\ttotal: 1.37s\tremaining: 8s\n",
      "146:\tlearn: 0.3885877\ttotal: 1.38s\tremaining: 7.98s\n",
      "147:\tlearn: 0.3884320\ttotal: 1.38s\tremaining: 7.96s\n",
      "148:\tlearn: 0.3883196\ttotal: 1.39s\tremaining: 7.94s\n",
      "149:\tlearn: 0.3882641\ttotal: 1.4s\tremaining: 7.92s\n",
      "150:\tlearn: 0.3881322\ttotal: 1.41s\tremaining: 7.9s\n",
      "151:\tlearn: 0.3880073\ttotal: 1.41s\tremaining: 7.88s\n",
      "152:\tlearn: 0.3879296\ttotal: 1.43s\tremaining: 7.9s\n",
      "153:\tlearn: 0.3877993\ttotal: 1.45s\tremaining: 7.96s\n",
      "154:\tlearn: 0.3877348\ttotal: 1.46s\tremaining: 7.94s\n",
      "155:\tlearn: 0.3876429\ttotal: 1.46s\tremaining: 7.92s\n",
      "156:\tlearn: 0.3875752\ttotal: 1.47s\tremaining: 7.9s\n",
      "157:\tlearn: 0.3875012\ttotal: 1.48s\tremaining: 7.88s\n",
      "158:\tlearn: 0.3873875\ttotal: 1.49s\tremaining: 7.86s\n",
      "159:\tlearn: 0.3872708\ttotal: 1.49s\tremaining: 7.84s\n",
      "160:\tlearn: 0.3871450\ttotal: 1.5s\tremaining: 7.82s\n",
      "161:\tlearn: 0.3870690\ttotal: 1.51s\tremaining: 7.79s\n",
      "162:\tlearn: 0.3869548\ttotal: 1.51s\tremaining: 7.77s\n",
      "163:\tlearn: 0.3868450\ttotal: 1.53s\tremaining: 7.82s\n",
      "164:\tlearn: 0.3866649\ttotal: 1.55s\tremaining: 7.86s\n",
      "165:\tlearn: 0.3865734\ttotal: 1.56s\tremaining: 7.85s\n",
      "166:\tlearn: 0.3864435\ttotal: 1.57s\tremaining: 7.84s\n",
      "167:\tlearn: 0.3862824\ttotal: 1.58s\tremaining: 7.84s\n",
      "168:\tlearn: 0.3861305\ttotal: 1.59s\tremaining: 7.82s\n",
      "169:\tlearn: 0.3860667\ttotal: 1.6s\tremaining: 7.81s\n",
      "170:\tlearn: 0.3859497\ttotal: 1.61s\tremaining: 7.81s\n",
      "171:\tlearn: 0.3858806\ttotal: 1.63s\tremaining: 7.83s\n",
      "172:\tlearn: 0.3858089\ttotal: 1.64s\tremaining: 7.82s\n",
      "173:\tlearn: 0.3856241\ttotal: 1.64s\tremaining: 7.8s\n",
      "174:\tlearn: 0.3854587\ttotal: 1.65s\tremaining: 7.79s\n",
      "175:\tlearn: 0.3853689\ttotal: 1.66s\tremaining: 7.78s\n",
      "176:\tlearn: 0.3852832\ttotal: 1.67s\tremaining: 7.78s\n",
      "177:\tlearn: 0.3851631\ttotal: 1.68s\tremaining: 7.76s\n",
      "178:\tlearn: 0.3850717\ttotal: 1.69s\tremaining: 7.75s\n",
      "179:\tlearn: 0.3850196\ttotal: 1.7s\tremaining: 7.73s\n",
      "180:\tlearn: 0.3849238\ttotal: 1.71s\tremaining: 7.75s\n",
      "181:\tlearn: 0.3848432\ttotal: 1.72s\tremaining: 7.73s\n",
      "182:\tlearn: 0.3847093\ttotal: 1.73s\tremaining: 7.72s\n",
      "183:\tlearn: 0.3845774\ttotal: 1.74s\tremaining: 7.7s\n",
      "184:\tlearn: 0.3844517\ttotal: 1.74s\tremaining: 7.68s\n",
      "185:\tlearn: 0.3843619\ttotal: 1.75s\tremaining: 7.66s\n",
      "186:\tlearn: 0.3842283\ttotal: 1.76s\tremaining: 7.64s\n",
      "187:\tlearn: 0.3841511\ttotal: 1.76s\tremaining: 7.62s\n",
      "188:\tlearn: 0.3839947\ttotal: 1.77s\tremaining: 7.6s\n",
      "189:\tlearn: 0.3838535\ttotal: 1.78s\tremaining: 7.59s\n",
      "190:\tlearn: 0.3837120\ttotal: 1.8s\tremaining: 7.61s\n",
      "191:\tlearn: 0.3835228\ttotal: 1.81s\tremaining: 7.61s\n",
      "192:\tlearn: 0.3834444\ttotal: 1.82s\tremaining: 7.6s\n",
      "193:\tlearn: 0.3833283\ttotal: 1.82s\tremaining: 7.58s\n",
      "194:\tlearn: 0.3831602\ttotal: 1.83s\tremaining: 7.57s\n",
      "195:\tlearn: 0.3830194\ttotal: 1.84s\tremaining: 7.55s\n",
      "196:\tlearn: 0.3829160\ttotal: 1.85s\tremaining: 7.53s\n",
      "197:\tlearn: 0.3827936\ttotal: 1.85s\tremaining: 7.51s\n",
      "198:\tlearn: 0.3826564\ttotal: 1.86s\tremaining: 7.5s\n",
      "199:\tlearn: 0.3824905\ttotal: 1.87s\tremaining: 7.48s\n",
      "200:\tlearn: 0.3823107\ttotal: 1.88s\tremaining: 7.47s\n",
      "201:\tlearn: 0.3822034\ttotal: 1.9s\tremaining: 7.52s\n",
      "202:\tlearn: 0.3820790\ttotal: 1.91s\tremaining: 7.52s\n",
      "203:\tlearn: 0.3819530\ttotal: 1.92s\tremaining: 7.51s\n",
      "204:\tlearn: 0.3818329\ttotal: 1.93s\tremaining: 7.5s\n",
      "205:\tlearn: 0.3817110\ttotal: 1.94s\tremaining: 7.49s\n",
      "206:\tlearn: 0.3815829\ttotal: 1.95s\tremaining: 7.47s\n",
      "207:\tlearn: 0.3814659\ttotal: 1.96s\tremaining: 7.46s\n",
      "208:\tlearn: 0.3813805\ttotal: 1.97s\tremaining: 7.44s\n",
      "209:\tlearn: 0.3812928\ttotal: 1.99s\tremaining: 7.48s\n",
      "210:\tlearn: 0.3811896\ttotal: 2s\tremaining: 7.46s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "211:\tlearn: 0.3810831\ttotal: 2s\tremaining: 7.45s\n",
      "212:\tlearn: 0.3809855\ttotal: 2.02s\tremaining: 7.45s\n",
      "213:\tlearn: 0.3808799\ttotal: 2.03s\tremaining: 7.45s\n",
      "214:\tlearn: 0.3807702\ttotal: 2.04s\tremaining: 7.43s\n",
      "215:\tlearn: 0.3806372\ttotal: 2.04s\tremaining: 7.42s\n",
      "216:\tlearn: 0.3804869\ttotal: 2.05s\tremaining: 7.41s\n",
      "217:\tlearn: 0.3803642\ttotal: 2.06s\tremaining: 7.39s\n",
      "218:\tlearn: 0.3800550\ttotal: 2.08s\tremaining: 7.41s\n",
      "219:\tlearn: 0.3799082\ttotal: 2.08s\tremaining: 7.39s\n",
      "220:\tlearn: 0.3797912\ttotal: 2.09s\tremaining: 7.38s\n",
      "221:\tlearn: 0.3797059\ttotal: 2.1s\tremaining: 7.36s\n",
      "222:\tlearn: 0.3796285\ttotal: 2.11s\tremaining: 7.34s\n",
      "223:\tlearn: 0.3795427\ttotal: 2.11s\tremaining: 7.32s\n",
      "224:\tlearn: 0.3792789\ttotal: 2.12s\tremaining: 7.31s\n",
      "225:\tlearn: 0.3790255\ttotal: 2.13s\tremaining: 7.29s\n",
      "226:\tlearn: 0.3789596\ttotal: 2.14s\tremaining: 7.29s\n",
      "227:\tlearn: 0.3788543\ttotal: 2.15s\tremaining: 7.28s\n",
      "228:\tlearn: 0.3787275\ttotal: 2.17s\tremaining: 7.3s\n",
      "229:\tlearn: 0.3786039\ttotal: 2.17s\tremaining: 7.28s\n",
      "230:\tlearn: 0.3784752\ttotal: 2.18s\tremaining: 7.26s\n",
      "231:\tlearn: 0.3784165\ttotal: 2.19s\tremaining: 7.25s\n",
      "232:\tlearn: 0.3783492\ttotal: 2.2s\tremaining: 7.23s\n",
      "233:\tlearn: 0.3782554\ttotal: 2.2s\tremaining: 7.22s\n",
      "234:\tlearn: 0.3781264\ttotal: 2.21s\tremaining: 7.2s\n",
      "235:\tlearn: 0.3780376\ttotal: 2.22s\tremaining: 7.18s\n",
      "236:\tlearn: 0.3779343\ttotal: 2.23s\tremaining: 7.17s\n",
      "237:\tlearn: 0.3778181\ttotal: 2.23s\tremaining: 7.15s\n",
      "238:\tlearn: 0.3777080\ttotal: 2.24s\tremaining: 7.14s\n",
      "239:\tlearn: 0.3776084\ttotal: 2.27s\tremaining: 7.17s\n",
      "240:\tlearn: 0.3774963\ttotal: 2.27s\tremaining: 7.16s\n",
      "241:\tlearn: 0.3773681\ttotal: 2.28s\tremaining: 7.15s\n",
      "242:\tlearn: 0.3772743\ttotal: 2.29s\tremaining: 7.13s\n",
      "243:\tlearn: 0.3771764\ttotal: 2.3s\tremaining: 7.12s\n",
      "244:\tlearn: 0.3770775\ttotal: 2.31s\tremaining: 7.1s\n",
      "245:\tlearn: 0.3769509\ttotal: 2.31s\tremaining: 7.09s\n",
      "246:\tlearn: 0.3768535\ttotal: 2.32s\tremaining: 7.07s\n",
      "247:\tlearn: 0.3766931\ttotal: 2.33s\tremaining: 7.06s\n",
      "248:\tlearn: 0.3765800\ttotal: 2.34s\tremaining: 7.07s\n",
      "249:\tlearn: 0.3763868\ttotal: 2.35s\tremaining: 7.06s\n",
      "250:\tlearn: 0.3762799\ttotal: 2.36s\tremaining: 7.04s\n",
      "251:\tlearn: 0.3761394\ttotal: 2.37s\tremaining: 7.03s\n",
      "252:\tlearn: 0.3760527\ttotal: 2.38s\tremaining: 7.02s\n",
      "253:\tlearn: 0.3759594\ttotal: 2.39s\tremaining: 7.02s\n",
      "254:\tlearn: 0.3758646\ttotal: 2.4s\tremaining: 7s\n",
      "255:\tlearn: 0.3757883\ttotal: 2.41s\tremaining: 6.99s\n",
      "256:\tlearn: 0.3756932\ttotal: 2.41s\tremaining: 6.98s\n",
      "257:\tlearn: 0.3755798\ttotal: 2.42s\tremaining: 6.97s\n",
      "258:\tlearn: 0.3754644\ttotal: 2.44s\tremaining: 6.98s\n",
      "259:\tlearn: 0.3753769\ttotal: 2.45s\tremaining: 6.97s\n",
      "260:\tlearn: 0.3752981\ttotal: 2.46s\tremaining: 6.95s\n",
      "261:\tlearn: 0.3752330\ttotal: 2.46s\tremaining: 6.94s\n",
      "262:\tlearn: 0.3751220\ttotal: 2.47s\tremaining: 6.92s\n",
      "263:\tlearn: 0.3750373\ttotal: 2.48s\tremaining: 6.91s\n",
      "264:\tlearn: 0.3749454\ttotal: 2.49s\tremaining: 6.9s\n",
      "265:\tlearn: 0.3748335\ttotal: 2.5s\tremaining: 6.9s\n",
      "266:\tlearn: 0.3747437\ttotal: 2.51s\tremaining: 6.89s\n",
      "267:\tlearn: 0.3746624\ttotal: 2.53s\tremaining: 6.91s\n",
      "268:\tlearn: 0.3745760\ttotal: 2.54s\tremaining: 6.89s\n",
      "269:\tlearn: 0.3744204\ttotal: 2.54s\tremaining: 6.88s\n",
      "270:\tlearn: 0.3743288\ttotal: 2.55s\tremaining: 6.86s\n",
      "271:\tlearn: 0.3742130\ttotal: 2.56s\tremaining: 6.85s\n",
      "272:\tlearn: 0.3741130\ttotal: 2.56s\tremaining: 6.83s\n",
      "273:\tlearn: 0.3740123\ttotal: 2.57s\tremaining: 6.82s\n",
      "274:\tlearn: 0.3739320\ttotal: 2.58s\tremaining: 6.8s\n",
      "275:\tlearn: 0.3738504\ttotal: 2.59s\tremaining: 6.79s\n",
      "276:\tlearn: 0.3737625\ttotal: 2.6s\tremaining: 6.77s\n",
      "277:\tlearn: 0.3736776\ttotal: 2.6s\tremaining: 6.76s\n",
      "278:\tlearn: 0.3735637\ttotal: 2.63s\tremaining: 6.79s\n",
      "279:\tlearn: 0.3735226\ttotal: 2.64s\tremaining: 6.78s\n",
      "280:\tlearn: 0.3733819\ttotal: 2.64s\tremaining: 6.77s\n",
      "281:\tlearn: 0.3732814\ttotal: 2.65s\tremaining: 6.75s\n",
      "282:\tlearn: 0.3731681\ttotal: 2.66s\tremaining: 6.74s\n",
      "283:\tlearn: 0.3730530\ttotal: 2.67s\tremaining: 6.72s\n",
      "284:\tlearn: 0.3729554\ttotal: 2.67s\tremaining: 6.71s\n",
      "285:\tlearn: 0.3728395\ttotal: 2.68s\tremaining: 6.69s\n",
      "286:\tlearn: 0.3727453\ttotal: 2.69s\tremaining: 6.68s\n",
      "287:\tlearn: 0.3726498\ttotal: 2.7s\tremaining: 6.67s\n",
      "288:\tlearn: 0.3724406\ttotal: 2.71s\tremaining: 6.67s\n",
      "289:\tlearn: 0.3723345\ttotal: 2.72s\tremaining: 6.66s\n",
      "290:\tlearn: 0.3722449\ttotal: 2.73s\tremaining: 6.64s\n",
      "291:\tlearn: 0.3721333\ttotal: 2.74s\tremaining: 6.64s\n",
      "292:\tlearn: 0.3720156\ttotal: 2.75s\tremaining: 6.63s\n",
      "293:\tlearn: 0.3719356\ttotal: 2.75s\tremaining: 6.62s\n",
      "294:\tlearn: 0.3718109\ttotal: 2.76s\tremaining: 6.6s\n",
      "295:\tlearn: 0.3717221\ttotal: 2.77s\tremaining: 6.59s\n",
      "296:\tlearn: 0.3716007\ttotal: 2.78s\tremaining: 6.57s\n",
      "297:\tlearn: 0.3715325\ttotal: 2.79s\tremaining: 6.56s\n",
      "298:\tlearn: 0.3714710\ttotal: 2.8s\tremaining: 6.57s\n",
      "299:\tlearn: 0.3713816\ttotal: 2.81s\tremaining: 6.56s\n",
      "300:\tlearn: 0.3712700\ttotal: 2.82s\tremaining: 6.54s\n",
      "301:\tlearn: 0.3712047\ttotal: 2.83s\tremaining: 6.53s\n",
      "302:\tlearn: 0.3711111\ttotal: 2.83s\tremaining: 6.52s\n",
      "303:\tlearn: 0.3710097\ttotal: 2.84s\tremaining: 6.5s\n",
      "304:\tlearn: 0.3708898\ttotal: 2.85s\tremaining: 6.49s\n",
      "305:\tlearn: 0.3707679\ttotal: 2.86s\tremaining: 6.49s\n",
      "306:\tlearn: 0.3706849\ttotal: 2.87s\tremaining: 6.48s\n",
      "307:\tlearn: 0.3705748\ttotal: 2.89s\tremaining: 6.49s\n",
      "308:\tlearn: 0.3704957\ttotal: 2.9s\tremaining: 6.48s\n",
      "309:\tlearn: 0.3704304\ttotal: 2.9s\tremaining: 6.46s\n",
      "310:\tlearn: 0.3703246\ttotal: 2.91s\tremaining: 6.45s\n",
      "311:\tlearn: 0.3702201\ttotal: 2.92s\tremaining: 6.44s\n",
      "312:\tlearn: 0.3700863\ttotal: 2.93s\tremaining: 6.43s\n",
      "313:\tlearn: 0.3700131\ttotal: 2.94s\tremaining: 6.41s\n",
      "314:\tlearn: 0.3699064\ttotal: 2.94s\tremaining: 6.4s\n",
      "315:\tlearn: 0.3698038\ttotal: 2.95s\tremaining: 6.39s\n",
      "316:\tlearn: 0.3697339\ttotal: 2.96s\tremaining: 6.37s\n",
      "317:\tlearn: 0.3696010\ttotal: 2.96s\tremaining: 6.36s\n",
      "318:\tlearn: 0.3695273\ttotal: 2.99s\tremaining: 6.38s\n",
      "319:\tlearn: 0.3694470\ttotal: 3s\tremaining: 6.37s\n",
      "320:\tlearn: 0.3693850\ttotal: 3.01s\tremaining: 6.36s\n",
      "321:\tlearn: 0.3692787\ttotal: 3.02s\tremaining: 6.35s\n",
      "322:\tlearn: 0.3691835\ttotal: 3.02s\tremaining: 6.34s\n",
      "323:\tlearn: 0.3690944\ttotal: 3.03s\tremaining: 6.33s\n",
      "324:\tlearn: 0.3689929\ttotal: 3.04s\tremaining: 6.31s\n",
      "325:\tlearn: 0.3688767\ttotal: 3.05s\tremaining: 6.3s\n",
      "326:\tlearn: 0.3688474\ttotal: 3.05s\tremaining: 6.28s\n",
      "327:\tlearn: 0.3687412\ttotal: 3.07s\tremaining: 6.29s\n",
      "328:\tlearn: 0.3686833\ttotal: 3.08s\tremaining: 6.28s\n",
      "329:\tlearn: 0.3685648\ttotal: 3.08s\tremaining: 6.26s\n",
      "330:\tlearn: 0.3684580\ttotal: 3.1s\tremaining: 6.27s\n",
      "331:\tlearn: 0.3683450\ttotal: 3.11s\tremaining: 6.25s\n",
      "332:\tlearn: 0.3682592\ttotal: 3.12s\tremaining: 6.24s\n",
      "333:\tlearn: 0.3682008\ttotal: 3.12s\tremaining: 6.23s\n",
      "334:\tlearn: 0.3680790\ttotal: 3.13s\tremaining: 6.22s\n",
      "335:\tlearn: 0.3679758\ttotal: 3.14s\tremaining: 6.21s\n",
      "336:\tlearn: 0.3678488\ttotal: 3.16s\tremaining: 6.21s\n",
      "337:\tlearn: 0.3677599\ttotal: 3.17s\tremaining: 6.2s\n",
      "338:\tlearn: 0.3676713\ttotal: 3.17s\tremaining: 6.19s\n",
      "339:\tlearn: 0.3675760\ttotal: 3.18s\tremaining: 6.18s\n",
      "340:\tlearn: 0.3674390\ttotal: 3.19s\tremaining: 6.17s\n",
      "341:\tlearn: 0.3673601\ttotal: 3.2s\tremaining: 6.15s\n",
      "342:\tlearn: 0.3673108\ttotal: 3.2s\tremaining: 6.14s\n",
      "343:\tlearn: 0.3672076\ttotal: 3.22s\tremaining: 6.14s\n",
      "344:\tlearn: 0.3671154\ttotal: 3.23s\tremaining: 6.13s\n",
      "345:\tlearn: 0.3670487\ttotal: 3.23s\tremaining: 6.12s\n",
      "346:\tlearn: 0.3669466\ttotal: 3.25s\tremaining: 6.12s\n",
      "347:\tlearn: 0.3669101\ttotal: 3.26s\tremaining: 6.11s\n",
      "348:\tlearn: 0.3668367\ttotal: 3.27s\tremaining: 6.1s\n",
      "349:\tlearn: 0.3667480\ttotal: 3.28s\tremaining: 6.08s\n",
      "350:\tlearn: 0.3666620\ttotal: 3.28s\tremaining: 6.07s\n",
      "351:\tlearn: 0.3665946\ttotal: 3.29s\tremaining: 6.06s\n",
      "352:\tlearn: 0.3665172\ttotal: 3.3s\tremaining: 6.04s\n",
      "353:\tlearn: 0.3664135\ttotal: 3.31s\tremaining: 6.03s\n",
      "354:\tlearn: 0.3663296\ttotal: 3.31s\tremaining: 6.02s\n",
      "355:\tlearn: 0.3662220\ttotal: 3.32s\tremaining: 6s\n",
      "356:\tlearn: 0.3661536\ttotal: 3.33s\tremaining: 6s\n",
      "357:\tlearn: 0.3660825\ttotal: 3.35s\tremaining: 6.01s\n",
      "358:\tlearn: 0.3659649\ttotal: 3.36s\tremaining: 6s\n",
      "359:\tlearn: 0.3658957\ttotal: 3.37s\tremaining: 5.99s\n",
      "360:\tlearn: 0.3658259\ttotal: 3.38s\tremaining: 5.98s\n",
      "361:\tlearn: 0.3657294\ttotal: 3.39s\tremaining: 5.98s\n",
      "362:\tlearn: 0.3656218\ttotal: 3.41s\tremaining: 5.98s\n",
      "363:\tlearn: 0.3655490\ttotal: 3.42s\tremaining: 5.98s\n",
      "364:\tlearn: 0.3654516\ttotal: 3.45s\tremaining: 6s\n",
      "365:\tlearn: 0.3653554\ttotal: 3.47s\tremaining: 6.01s\n",
      "366:\tlearn: 0.3652666\ttotal: 3.48s\tremaining: 6s\n",
      "367:\tlearn: 0.3651936\ttotal: 3.49s\tremaining: 6s\n",
      "368:\tlearn: 0.3651181\ttotal: 3.5s\tremaining: 5.99s\n",
      "369:\tlearn: 0.3650144\ttotal: 3.53s\tremaining: 6.01s\n",
      "370:\tlearn: 0.3649517\ttotal: 3.54s\tremaining: 6s\n",
      "371:\tlearn: 0.3648478\ttotal: 3.55s\tremaining: 5.99s\n",
      "372:\tlearn: 0.3647545\ttotal: 3.56s\tremaining: 5.98s\n",
      "373:\tlearn: 0.3646947\ttotal: 3.58s\tremaining: 5.98s\n",
      "374:\tlearn: 0.3646143\ttotal: 3.59s\tremaining: 5.98s\n",
      "375:\tlearn: 0.3645402\ttotal: 3.6s\tremaining: 5.98s\n",
      "376:\tlearn: 0.3644819\ttotal: 3.62s\tremaining: 5.99s\n",
      "377:\tlearn: 0.3644006\ttotal: 3.63s\tremaining: 5.98s\n",
      "378:\tlearn: 0.3643152\ttotal: 3.65s\tremaining: 5.97s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "379:\tlearn: 0.3642228\ttotal: 3.65s\tremaining: 5.96s\n",
      "380:\tlearn: 0.3642129\ttotal: 3.67s\tremaining: 5.96s\n",
      "381:\tlearn: 0.3641370\ttotal: 3.68s\tremaining: 5.95s\n",
      "382:\tlearn: 0.3640380\ttotal: 3.69s\tremaining: 5.95s\n",
      "383:\tlearn: 0.3639627\ttotal: 3.72s\tremaining: 5.97s\n",
      "384:\tlearn: 0.3638738\ttotal: 3.73s\tremaining: 5.97s\n",
      "385:\tlearn: 0.3637838\ttotal: 3.75s\tremaining: 5.96s\n",
      "386:\tlearn: 0.3636826\ttotal: 3.76s\tremaining: 5.95s\n",
      "387:\tlearn: 0.3635869\ttotal: 3.77s\tremaining: 5.94s\n",
      "388:\tlearn: 0.3635260\ttotal: 3.78s\tremaining: 5.93s\n",
      "389:\tlearn: 0.3634681\ttotal: 3.8s\tremaining: 5.95s\n",
      "390:\tlearn: 0.3633853\ttotal: 3.82s\tremaining: 5.95s\n",
      "391:\tlearn: 0.3633221\ttotal: 3.83s\tremaining: 5.94s\n",
      "392:\tlearn: 0.3632564\ttotal: 3.84s\tremaining: 5.93s\n",
      "393:\tlearn: 0.3631822\ttotal: 3.85s\tremaining: 5.92s\n",
      "394:\tlearn: 0.3631200\ttotal: 3.85s\tremaining: 5.91s\n",
      "395:\tlearn: 0.3630325\ttotal: 3.86s\tremaining: 5.89s\n",
      "396:\tlearn: 0.3629736\ttotal: 3.87s\tremaining: 5.88s\n",
      "397:\tlearn: 0.3628326\ttotal: 3.88s\tremaining: 5.87s\n",
      "398:\tlearn: 0.3627455\ttotal: 3.9s\tremaining: 5.87s\n",
      "399:\tlearn: 0.3626928\ttotal: 3.91s\tremaining: 5.86s\n",
      "400:\tlearn: 0.3625899\ttotal: 3.92s\tremaining: 5.85s\n",
      "401:\tlearn: 0.3625733\ttotal: 3.92s\tremaining: 5.84s\n",
      "402:\tlearn: 0.3625018\ttotal: 3.94s\tremaining: 5.84s\n",
      "403:\tlearn: 0.3624065\ttotal: 3.95s\tremaining: 5.83s\n",
      "404:\tlearn: 0.3623011\ttotal: 3.96s\tremaining: 5.82s\n",
      "405:\tlearn: 0.3622374\ttotal: 3.97s\tremaining: 5.81s\n",
      "406:\tlearn: 0.3621709\ttotal: 3.99s\tremaining: 5.81s\n",
      "407:\tlearn: 0.3620568\ttotal: 3.99s\tremaining: 5.8s\n",
      "408:\tlearn: 0.3619330\ttotal: 4s\tremaining: 5.78s\n",
      "409:\tlearn: 0.3618821\ttotal: 4.01s\tremaining: 5.77s\n",
      "410:\tlearn: 0.3618295\ttotal: 4.02s\tremaining: 5.76s\n",
      "411:\tlearn: 0.3617758\ttotal: 4.02s\tremaining: 5.74s\n",
      "412:\tlearn: 0.3617112\ttotal: 4.03s\tremaining: 5.73s\n",
      "413:\tlearn: 0.3616377\ttotal: 4.04s\tremaining: 5.72s\n",
      "414:\tlearn: 0.3615578\ttotal: 4.05s\tremaining: 5.7s\n",
      "415:\tlearn: 0.3614749\ttotal: 4.07s\tremaining: 5.72s\n",
      "416:\tlearn: 0.3613465\ttotal: 4.08s\tremaining: 5.71s\n",
      "417:\tlearn: 0.3612487\ttotal: 4.09s\tremaining: 5.7s\n",
      "418:\tlearn: 0.3611576\ttotal: 4.1s\tremaining: 5.68s\n",
      "419:\tlearn: 0.3611276\ttotal: 4.11s\tremaining: 5.67s\n",
      "420:\tlearn: 0.3610549\ttotal: 4.11s\tremaining: 5.66s\n",
      "421:\tlearn: 0.3609421\ttotal: 4.12s\tremaining: 5.64s\n",
      "422:\tlearn: 0.3608827\ttotal: 4.13s\tremaining: 5.63s\n",
      "423:\tlearn: 0.3608023\ttotal: 4.13s\tremaining: 5.62s\n",
      "424:\tlearn: 0.3606954\ttotal: 4.14s\tremaining: 5.61s\n",
      "425:\tlearn: 0.3606133\ttotal: 4.15s\tremaining: 5.59s\n",
      "426:\tlearn: 0.3605251\ttotal: 4.17s\tremaining: 5.59s\n",
      "427:\tlearn: 0.3604888\ttotal: 4.18s\tremaining: 5.59s\n",
      "428:\tlearn: 0.3604135\ttotal: 4.19s\tremaining: 5.58s\n",
      "429:\tlearn: 0.3603372\ttotal: 4.2s\tremaining: 5.56s\n",
      "430:\tlearn: 0.3602799\ttotal: 4.21s\tremaining: 5.55s\n",
      "431:\tlearn: 0.3601969\ttotal: 4.21s\tremaining: 5.54s\n",
      "432:\tlearn: 0.3601156\ttotal: 4.22s\tremaining: 5.53s\n",
      "433:\tlearn: 0.3600202\ttotal: 4.23s\tremaining: 5.51s\n",
      "434:\tlearn: 0.3599504\ttotal: 4.24s\tremaining: 5.5s\n",
      "435:\tlearn: 0.3598725\ttotal: 4.24s\tremaining: 5.49s\n",
      "436:\tlearn: 0.3597942\ttotal: 4.26s\tremaining: 5.49s\n",
      "437:\tlearn: 0.3597476\ttotal: 4.27s\tremaining: 5.47s\n",
      "438:\tlearn: 0.3597030\ttotal: 4.27s\tremaining: 5.46s\n",
      "439:\tlearn: 0.3596084\ttotal: 4.28s\tremaining: 5.45s\n",
      "440:\tlearn: 0.3595372\ttotal: 4.29s\tremaining: 5.44s\n",
      "441:\tlearn: 0.3594432\ttotal: 4.3s\tremaining: 5.43s\n",
      "442:\tlearn: 0.3593433\ttotal: 4.31s\tremaining: 5.42s\n",
      "443:\tlearn: 0.3592706\ttotal: 4.32s\tremaining: 5.41s\n",
      "444:\tlearn: 0.3591907\ttotal: 4.33s\tremaining: 5.4s\n",
      "445:\tlearn: 0.3590847\ttotal: 4.34s\tremaining: 5.4s\n",
      "446:\tlearn: 0.3589889\ttotal: 4.35s\tremaining: 5.38s\n",
      "447:\tlearn: 0.3589310\ttotal: 4.36s\tremaining: 5.37s\n",
      "448:\tlearn: 0.3588266\ttotal: 4.37s\tremaining: 5.36s\n",
      "449:\tlearn: 0.3587587\ttotal: 4.37s\tremaining: 5.35s\n",
      "450:\tlearn: 0.3586763\ttotal: 4.38s\tremaining: 5.33s\n",
      "451:\tlearn: 0.3585913\ttotal: 4.39s\tremaining: 5.32s\n",
      "452:\tlearn: 0.3585138\ttotal: 4.4s\tremaining: 5.31s\n",
      "453:\tlearn: 0.3584549\ttotal: 4.41s\tremaining: 5.3s\n",
      "454:\tlearn: 0.3583187\ttotal: 4.42s\tremaining: 5.3s\n",
      "455:\tlearn: 0.3582754\ttotal: 4.44s\tremaining: 5.3s\n",
      "456:\tlearn: 0.3581908\ttotal: 4.45s\tremaining: 5.29s\n",
      "457:\tlearn: 0.3580637\ttotal: 4.46s\tremaining: 5.28s\n",
      "458:\tlearn: 0.3580154\ttotal: 4.47s\tremaining: 5.26s\n",
      "459:\tlearn: 0.3579582\ttotal: 4.47s\tremaining: 5.25s\n",
      "460:\tlearn: 0.3579055\ttotal: 4.48s\tremaining: 5.24s\n",
      "461:\tlearn: 0.3578129\ttotal: 4.49s\tremaining: 5.23s\n",
      "462:\tlearn: 0.3577530\ttotal: 4.5s\tremaining: 5.22s\n",
      "463:\tlearn: 0.3576950\ttotal: 4.5s\tremaining: 5.2s\n",
      "464:\tlearn: 0.3576078\ttotal: 4.51s\tremaining: 5.19s\n",
      "465:\tlearn: 0.3575792\ttotal: 4.54s\tremaining: 5.2s\n",
      "466:\tlearn: 0.3574780\ttotal: 4.55s\tremaining: 5.19s\n",
      "467:\tlearn: 0.3574026\ttotal: 4.55s\tremaining: 5.18s\n",
      "468:\tlearn: 0.3573516\ttotal: 4.56s\tremaining: 5.16s\n",
      "469:\tlearn: 0.3572801\ttotal: 4.57s\tremaining: 5.15s\n",
      "470:\tlearn: 0.3572233\ttotal: 4.58s\tremaining: 5.14s\n",
      "471:\tlearn: 0.3571349\ttotal: 4.58s\tremaining: 5.13s\n",
      "472:\tlearn: 0.3570607\ttotal: 4.59s\tremaining: 5.11s\n",
      "473:\tlearn: 0.3569987\ttotal: 4.6s\tremaining: 5.1s\n",
      "474:\tlearn: 0.3568801\ttotal: 4.61s\tremaining: 5.09s\n",
      "475:\tlearn: 0.3568365\ttotal: 4.62s\tremaining: 5.08s\n",
      "476:\tlearn: 0.3567603\ttotal: 4.63s\tremaining: 5.07s\n",
      "477:\tlearn: 0.3567077\ttotal: 4.63s\tremaining: 5.06s\n",
      "478:\tlearn: 0.3566342\ttotal: 4.64s\tremaining: 5.05s\n",
      "479:\tlearn: 0.3565402\ttotal: 4.66s\tremaining: 5.04s\n",
      "480:\tlearn: 0.3564776\ttotal: 4.67s\tremaining: 5.03s\n",
      "481:\tlearn: 0.3563986\ttotal: 4.67s\tremaining: 5.02s\n",
      "482:\tlearn: 0.3563123\ttotal: 4.68s\tremaining: 5.01s\n",
      "483:\tlearn: 0.3562154\ttotal: 4.69s\tremaining: 5s\n",
      "484:\tlearn: 0.3561309\ttotal: 4.7s\tremaining: 4.99s\n",
      "485:\tlearn: 0.3560988\ttotal: 4.71s\tremaining: 4.98s\n",
      "486:\tlearn: 0.3559963\ttotal: 4.72s\tremaining: 4.97s\n",
      "487:\tlearn: 0.3559186\ttotal: 4.73s\tremaining: 4.96s\n",
      "488:\tlearn: 0.3558398\ttotal: 4.73s\tremaining: 4.95s\n",
      "489:\tlearn: 0.3557326\ttotal: 4.74s\tremaining: 4.93s\n",
      "490:\tlearn: 0.3556462\ttotal: 4.75s\tremaining: 4.92s\n",
      "491:\tlearn: 0.3555546\ttotal: 4.75s\tremaining: 4.91s\n",
      "492:\tlearn: 0.3555510\ttotal: 4.76s\tremaining: 4.9s\n",
      "493:\tlearn: 0.3554809\ttotal: 4.78s\tremaining: 4.89s\n",
      "494:\tlearn: 0.3554197\ttotal: 4.79s\tremaining: 4.89s\n",
      "495:\tlearn: 0.3553471\ttotal: 4.8s\tremaining: 4.88s\n",
      "496:\tlearn: 0.3552543\ttotal: 4.8s\tremaining: 4.86s\n",
      "497:\tlearn: 0.3551646\ttotal: 4.81s\tremaining: 4.85s\n",
      "498:\tlearn: 0.3550882\ttotal: 4.82s\tremaining: 4.84s\n",
      "499:\tlearn: 0.3550064\ttotal: 4.83s\tremaining: 4.83s\n",
      "500:\tlearn: 0.3549358\ttotal: 4.83s\tremaining: 4.82s\n",
      "501:\tlearn: 0.3548603\ttotal: 4.84s\tremaining: 4.8s\n",
      "502:\tlearn: 0.3547664\ttotal: 4.85s\tremaining: 4.79s\n",
      "503:\tlearn: 0.3547071\ttotal: 4.86s\tremaining: 4.78s\n",
      "504:\tlearn: 0.3546024\ttotal: 4.87s\tremaining: 4.77s\n",
      "505:\tlearn: 0.3545087\ttotal: 4.89s\tremaining: 4.77s\n",
      "506:\tlearn: 0.3544240\ttotal: 4.9s\tremaining: 4.76s\n",
      "507:\tlearn: 0.3543403\ttotal: 4.91s\tremaining: 4.75s\n",
      "508:\tlearn: 0.3542693\ttotal: 4.92s\tremaining: 4.74s\n",
      "509:\tlearn: 0.3541820\ttotal: 4.92s\tremaining: 4.73s\n",
      "510:\tlearn: 0.3540952\ttotal: 4.93s\tremaining: 4.72s\n",
      "511:\tlearn: 0.3540021\ttotal: 4.94s\tremaining: 4.71s\n",
      "512:\tlearn: 0.3539358\ttotal: 4.95s\tremaining: 4.7s\n",
      "513:\tlearn: 0.3538675\ttotal: 4.95s\tremaining: 4.68s\n",
      "514:\tlearn: 0.3537800\ttotal: 4.97s\tremaining: 4.68s\n",
      "515:\tlearn: 0.3537038\ttotal: 4.98s\tremaining: 4.67s\n",
      "516:\tlearn: 0.3536093\ttotal: 4.99s\tremaining: 4.66s\n",
      "517:\tlearn: 0.3535629\ttotal: 4.99s\tremaining: 4.65s\n",
      "518:\tlearn: 0.3534896\ttotal: 5.01s\tremaining: 4.64s\n",
      "519:\tlearn: 0.3534428\ttotal: 5.02s\tremaining: 4.63s\n",
      "520:\tlearn: 0.3533650\ttotal: 5.02s\tremaining: 4.62s\n",
      "521:\tlearn: 0.3533480\ttotal: 5.03s\tremaining: 4.61s\n",
      "522:\tlearn: 0.3532676\ttotal: 5.04s\tremaining: 4.59s\n",
      "523:\tlearn: 0.3531937\ttotal: 5.05s\tremaining: 4.58s\n",
      "524:\tlearn: 0.3531110\ttotal: 5.05s\tremaining: 4.57s\n",
      "525:\tlearn: 0.3530986\ttotal: 5.06s\tremaining: 4.56s\n",
      "526:\tlearn: 0.3529955\ttotal: 5.07s\tremaining: 4.55s\n",
      "527:\tlearn: 0.3529304\ttotal: 5.08s\tremaining: 4.54s\n",
      "528:\tlearn: 0.3528558\ttotal: 5.08s\tremaining: 4.53s\n",
      "529:\tlearn: 0.3527947\ttotal: 5.09s\tremaining: 4.52s\n",
      "530:\tlearn: 0.3527226\ttotal: 5.1s\tremaining: 4.5s\n",
      "531:\tlearn: 0.3526428\ttotal: 5.11s\tremaining: 4.49s\n",
      "532:\tlearn: 0.3525985\ttotal: 5.12s\tremaining: 4.48s\n",
      "533:\tlearn: 0.3525411\ttotal: 5.13s\tremaining: 4.48s\n",
      "534:\tlearn: 0.3524613\ttotal: 5.14s\tremaining: 4.47s\n",
      "535:\tlearn: 0.3523800\ttotal: 5.16s\tremaining: 4.46s\n",
      "536:\tlearn: 0.3523095\ttotal: 5.16s\tremaining: 4.45s\n",
      "537:\tlearn: 0.3522096\ttotal: 5.17s\tremaining: 4.44s\n",
      "538:\tlearn: 0.3521396\ttotal: 5.18s\tremaining: 4.43s\n",
      "539:\tlearn: 0.3520700\ttotal: 5.19s\tremaining: 4.42s\n",
      "540:\tlearn: 0.3520002\ttotal: 5.19s\tremaining: 4.41s\n",
      "541:\tlearn: 0.3519115\ttotal: 5.2s\tremaining: 4.39s\n",
      "542:\tlearn: 0.3518861\ttotal: 5.21s\tremaining: 4.38s\n",
      "543:\tlearn: 0.3518150\ttotal: 5.21s\tremaining: 4.37s\n",
      "544:\tlearn: 0.3517364\ttotal: 5.22s\tremaining: 4.36s\n",
      "545:\tlearn: 0.3516624\ttotal: 5.23s\tremaining: 4.35s\n",
      "546:\tlearn: 0.3516116\ttotal: 5.25s\tremaining: 4.35s\n",
      "547:\tlearn: 0.3515556\ttotal: 5.26s\tremaining: 4.34s\n",
      "548:\tlearn: 0.3514795\ttotal: 5.27s\tremaining: 4.33s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "549:\tlearn: 0.3513960\ttotal: 5.28s\tremaining: 4.32s\n",
      "550:\tlearn: 0.3513229\ttotal: 5.29s\tremaining: 4.31s\n",
      "551:\tlearn: 0.3512468\ttotal: 5.29s\tremaining: 4.3s\n",
      "552:\tlearn: 0.3511541\ttotal: 5.3s\tremaining: 4.29s\n",
      "553:\tlearn: 0.3510842\ttotal: 5.31s\tremaining: 4.27s\n",
      "554:\tlearn: 0.3510414\ttotal: 5.32s\tremaining: 4.26s\n",
      "555:\tlearn: 0.3509402\ttotal: 5.34s\tremaining: 4.26s\n",
      "556:\tlearn: 0.3508611\ttotal: 5.35s\tremaining: 4.25s\n",
      "557:\tlearn: 0.3507962\ttotal: 5.35s\tremaining: 4.24s\n",
      "558:\tlearn: 0.3507245\ttotal: 5.37s\tremaining: 4.24s\n",
      "559:\tlearn: 0.3506237\ttotal: 5.38s\tremaining: 4.23s\n",
      "560:\tlearn: 0.3505332\ttotal: 5.39s\tremaining: 4.22s\n",
      "561:\tlearn: 0.3504603\ttotal: 5.4s\tremaining: 4.21s\n",
      "562:\tlearn: 0.3504250\ttotal: 5.4s\tremaining: 4.2s\n",
      "563:\tlearn: 0.3503518\ttotal: 5.42s\tremaining: 4.19s\n",
      "564:\tlearn: 0.3502655\ttotal: 5.43s\tremaining: 4.18s\n",
      "565:\tlearn: 0.3501991\ttotal: 5.44s\tremaining: 4.17s\n",
      "566:\tlearn: 0.3501488\ttotal: 5.45s\tremaining: 4.16s\n",
      "567:\tlearn: 0.3500264\ttotal: 5.45s\tremaining: 4.15s\n",
      "568:\tlearn: 0.3499625\ttotal: 5.46s\tremaining: 4.14s\n",
      "569:\tlearn: 0.3499010\ttotal: 5.47s\tremaining: 4.13s\n",
      "570:\tlearn: 0.3498482\ttotal: 5.48s\tremaining: 4.12s\n",
      "571:\tlearn: 0.3498003\ttotal: 5.49s\tremaining: 4.11s\n",
      "572:\tlearn: 0.3497275\ttotal: 5.51s\tremaining: 4.11s\n",
      "573:\tlearn: 0.3496706\ttotal: 5.52s\tremaining: 4.1s\n",
      "574:\tlearn: 0.3495738\ttotal: 5.53s\tremaining: 4.09s\n",
      "575:\tlearn: 0.3495072\ttotal: 5.54s\tremaining: 4.08s\n",
      "576:\tlearn: 0.3494552\ttotal: 5.54s\tremaining: 4.07s\n",
      "577:\tlearn: 0.3493793\ttotal: 5.55s\tremaining: 4.05s\n",
      "578:\tlearn: 0.3493319\ttotal: 5.56s\tremaining: 4.04s\n",
      "579:\tlearn: 0.3492689\ttotal: 5.57s\tremaining: 4.03s\n",
      "580:\tlearn: 0.3492118\ttotal: 5.57s\tremaining: 4.02s\n",
      "581:\tlearn: 0.3491361\ttotal: 5.58s\tremaining: 4.01s\n",
      "582:\tlearn: 0.3490612\ttotal: 5.59s\tremaining: 4s\n",
      "583:\tlearn: 0.3489676\ttotal: 5.61s\tremaining: 4s\n",
      "584:\tlearn: 0.3489226\ttotal: 5.62s\tremaining: 3.99s\n",
      "585:\tlearn: 0.3488514\ttotal: 5.63s\tremaining: 3.98s\n",
      "586:\tlearn: 0.3487805\ttotal: 5.64s\tremaining: 3.96s\n",
      "587:\tlearn: 0.3487170\ttotal: 5.64s\tremaining: 3.96s\n",
      "588:\tlearn: 0.3486367\ttotal: 5.65s\tremaining: 3.94s\n",
      "589:\tlearn: 0.3485350\ttotal: 5.66s\tremaining: 3.93s\n",
      "590:\tlearn: 0.3484704\ttotal: 5.67s\tremaining: 3.92s\n",
      "591:\tlearn: 0.3484109\ttotal: 5.67s\tremaining: 3.91s\n",
      "592:\tlearn: 0.3483577\ttotal: 5.68s\tremaining: 3.9s\n",
      "593:\tlearn: 0.3482842\ttotal: 5.7s\tremaining: 3.9s\n",
      "594:\tlearn: 0.3482321\ttotal: 5.71s\tremaining: 3.89s\n",
      "595:\tlearn: 0.3481432\ttotal: 5.72s\tremaining: 3.88s\n",
      "596:\tlearn: 0.3480426\ttotal: 5.74s\tremaining: 3.87s\n",
      "597:\tlearn: 0.3479332\ttotal: 5.74s\tremaining: 3.86s\n",
      "598:\tlearn: 0.3478744\ttotal: 5.75s\tremaining: 3.85s\n",
      "599:\tlearn: 0.3478269\ttotal: 5.76s\tremaining: 3.84s\n",
      "600:\tlearn: 0.3477650\ttotal: 5.77s\tremaining: 3.83s\n",
      "601:\tlearn: 0.3477008\ttotal: 5.77s\tremaining: 3.82s\n",
      "602:\tlearn: 0.3476323\ttotal: 5.79s\tremaining: 3.81s\n",
      "603:\tlearn: 0.3475807\ttotal: 5.8s\tremaining: 3.8s\n",
      "604:\tlearn: 0.3474814\ttotal: 5.81s\tremaining: 3.79s\n",
      "605:\tlearn: 0.3474175\ttotal: 5.81s\tremaining: 3.78s\n",
      "606:\tlearn: 0.3473419\ttotal: 5.82s\tremaining: 3.77s\n",
      "607:\tlearn: 0.3472711\ttotal: 5.83s\tremaining: 3.76s\n",
      "608:\tlearn: 0.3471806\ttotal: 5.84s\tremaining: 3.75s\n",
      "609:\tlearn: 0.3471158\ttotal: 5.85s\tremaining: 3.74s\n",
      "610:\tlearn: 0.3470689\ttotal: 5.86s\tremaining: 3.73s\n",
      "611:\tlearn: 0.3470465\ttotal: 5.87s\tremaining: 3.72s\n",
      "612:\tlearn: 0.3469915\ttotal: 5.88s\tremaining: 3.71s\n",
      "613:\tlearn: 0.3469487\ttotal: 5.89s\tremaining: 3.7s\n",
      "614:\tlearn: 0.3468612\ttotal: 5.9s\tremaining: 3.69s\n",
      "615:\tlearn: 0.3468226\ttotal: 5.91s\tremaining: 3.69s\n",
      "616:\tlearn: 0.3467458\ttotal: 5.92s\tremaining: 3.67s\n",
      "617:\tlearn: 0.3466821\ttotal: 5.93s\tremaining: 3.67s\n",
      "618:\tlearn: 0.3466341\ttotal: 5.94s\tremaining: 3.65s\n",
      "619:\tlearn: 0.3465870\ttotal: 5.95s\tremaining: 3.64s\n",
      "620:\tlearn: 0.3465810\ttotal: 5.96s\tremaining: 3.64s\n",
      "621:\tlearn: 0.3465032\ttotal: 5.98s\tremaining: 3.63s\n",
      "622:\tlearn: 0.3464608\ttotal: 5.99s\tremaining: 3.62s\n",
      "623:\tlearn: 0.3463944\ttotal: 6s\tremaining: 3.61s\n",
      "624:\tlearn: 0.3463655\ttotal: 6s\tremaining: 3.6s\n",
      "625:\tlearn: 0.3463119\ttotal: 6.01s\tremaining: 3.59s\n",
      "626:\tlearn: 0.3462513\ttotal: 6.02s\tremaining: 3.58s\n",
      "627:\tlearn: 0.3461609\ttotal: 6.02s\tremaining: 3.57s\n",
      "628:\tlearn: 0.3461186\ttotal: 6.03s\tremaining: 3.56s\n",
      "629:\tlearn: 0.3460448\ttotal: 6.04s\tremaining: 3.55s\n",
      "630:\tlearn: 0.3459709\ttotal: 6.05s\tremaining: 3.54s\n",
      "631:\tlearn: 0.3459085\ttotal: 6.06s\tremaining: 3.53s\n",
      "632:\tlearn: 0.3458645\ttotal: 6.07s\tremaining: 3.52s\n",
      "633:\tlearn: 0.3458305\ttotal: 6.08s\tremaining: 3.51s\n",
      "634:\tlearn: 0.3457661\ttotal: 6.09s\tremaining: 3.5s\n",
      "635:\tlearn: 0.3456993\ttotal: 6.1s\tremaining: 3.49s\n",
      "636:\tlearn: 0.3456884\ttotal: 6.11s\tremaining: 3.48s\n",
      "637:\tlearn: 0.3455938\ttotal: 6.11s\tremaining: 3.47s\n",
      "638:\tlearn: 0.3455224\ttotal: 6.12s\tremaining: 3.46s\n",
      "639:\tlearn: 0.3454493\ttotal: 6.13s\tremaining: 3.45s\n",
      "640:\tlearn: 0.3453768\ttotal: 6.15s\tremaining: 3.44s\n",
      "641:\tlearn: 0.3453172\ttotal: 6.16s\tremaining: 3.43s\n",
      "642:\tlearn: 0.3452318\ttotal: 6.16s\tremaining: 3.42s\n",
      "643:\tlearn: 0.3451655\ttotal: 6.17s\tremaining: 3.41s\n",
      "644:\tlearn: 0.3451067\ttotal: 6.18s\tremaining: 3.4s\n",
      "645:\tlearn: 0.3450492\ttotal: 6.18s\tremaining: 3.39s\n",
      "646:\tlearn: 0.3449582\ttotal: 6.19s\tremaining: 3.38s\n",
      "647:\tlearn: 0.3449487\ttotal: 6.21s\tremaining: 3.37s\n",
      "648:\tlearn: 0.3448837\ttotal: 6.21s\tremaining: 3.36s\n",
      "649:\tlearn: 0.3448168\ttotal: 6.22s\tremaining: 3.35s\n",
      "650:\tlearn: 0.3447263\ttotal: 6.24s\tremaining: 3.34s\n",
      "651:\tlearn: 0.3446454\ttotal: 6.25s\tremaining: 3.33s\n",
      "652:\tlearn: 0.3446080\ttotal: 6.25s\tremaining: 3.32s\n",
      "653:\tlearn: 0.3445186\ttotal: 6.26s\tremaining: 3.31s\n",
      "654:\tlearn: 0.3444340\ttotal: 6.27s\tremaining: 3.3s\n",
      "655:\tlearn: 0.3443816\ttotal: 6.28s\tremaining: 3.29s\n",
      "656:\tlearn: 0.3442865\ttotal: 6.28s\tremaining: 3.28s\n",
      "657:\tlearn: 0.3442172\ttotal: 6.29s\tremaining: 3.27s\n",
      "658:\tlearn: 0.3441438\ttotal: 6.3s\tremaining: 3.26s\n",
      "659:\tlearn: 0.3440812\ttotal: 6.31s\tremaining: 3.25s\n",
      "660:\tlearn: 0.3440293\ttotal: 6.34s\tremaining: 3.25s\n",
      "661:\tlearn: 0.3439618\ttotal: 6.35s\tremaining: 3.24s\n",
      "662:\tlearn: 0.3438930\ttotal: 6.36s\tremaining: 3.23s\n",
      "663:\tlearn: 0.3438086\ttotal: 6.37s\tremaining: 3.22s\n",
      "664:\tlearn: 0.3437656\ttotal: 6.38s\tremaining: 3.21s\n",
      "665:\tlearn: 0.3436800\ttotal: 6.38s\tremaining: 3.2s\n",
      "666:\tlearn: 0.3435876\ttotal: 6.39s\tremaining: 3.19s\n",
      "667:\tlearn: 0.3435315\ttotal: 6.4s\tremaining: 3.18s\n",
      "668:\tlearn: 0.3434586\ttotal: 6.41s\tremaining: 3.17s\n",
      "669:\tlearn: 0.3434250\ttotal: 6.42s\tremaining: 3.16s\n",
      "670:\tlearn: 0.3433671\ttotal: 6.43s\tremaining: 3.15s\n",
      "671:\tlearn: 0.3433549\ttotal: 6.45s\tremaining: 3.15s\n",
      "672:\tlearn: 0.3433177\ttotal: 6.45s\tremaining: 3.14s\n",
      "673:\tlearn: 0.3432158\ttotal: 6.46s\tremaining: 3.13s\n",
      "674:\tlearn: 0.3431304\ttotal: 6.47s\tremaining: 3.12s\n",
      "675:\tlearn: 0.3430719\ttotal: 6.48s\tremaining: 3.1s\n",
      "676:\tlearn: 0.3430191\ttotal: 6.49s\tremaining: 3.09s\n",
      "677:\tlearn: 0.3429339\ttotal: 6.49s\tremaining: 3.08s\n",
      "678:\tlearn: 0.3428783\ttotal: 6.51s\tremaining: 3.08s\n",
      "679:\tlearn: 0.3428234\ttotal: 6.52s\tremaining: 3.07s\n",
      "680:\tlearn: 0.3427696\ttotal: 6.53s\tremaining: 3.06s\n",
      "681:\tlearn: 0.3427003\ttotal: 6.54s\tremaining: 3.05s\n",
      "682:\tlearn: 0.3426898\ttotal: 6.54s\tremaining: 3.04s\n",
      "683:\tlearn: 0.3426022\ttotal: 6.55s\tremaining: 3.02s\n",
      "684:\tlearn: 0.3425386\ttotal: 6.56s\tremaining: 3.02s\n",
      "685:\tlearn: 0.3425277\ttotal: 6.57s\tremaining: 3.01s\n",
      "686:\tlearn: 0.3424765\ttotal: 6.58s\tremaining: 3s\n",
      "687:\tlearn: 0.3424031\ttotal: 6.59s\tremaining: 2.99s\n",
      "688:\tlearn: 0.3423482\ttotal: 6.6s\tremaining: 2.98s\n",
      "689:\tlearn: 0.3422655\ttotal: 6.61s\tremaining: 2.97s\n",
      "690:\tlearn: 0.3421707\ttotal: 6.62s\tremaining: 2.96s\n",
      "691:\tlearn: 0.3421059\ttotal: 6.63s\tremaining: 2.95s\n",
      "692:\tlearn: 0.3420393\ttotal: 6.63s\tremaining: 2.94s\n",
      "693:\tlearn: 0.3419596\ttotal: 6.64s\tremaining: 2.93s\n",
      "694:\tlearn: 0.3418952\ttotal: 6.65s\tremaining: 2.92s\n",
      "695:\tlearn: 0.3418486\ttotal: 6.66s\tremaining: 2.91s\n",
      "696:\tlearn: 0.3417927\ttotal: 6.66s\tremaining: 2.9s\n",
      "697:\tlearn: 0.3417373\ttotal: 6.67s\tremaining: 2.89s\n",
      "698:\tlearn: 0.3416530\ttotal: 6.69s\tremaining: 2.88s\n",
      "699:\tlearn: 0.3415725\ttotal: 6.7s\tremaining: 2.87s\n",
      "700:\tlearn: 0.3415262\ttotal: 6.71s\tremaining: 2.86s\n",
      "701:\tlearn: 0.3414807\ttotal: 6.72s\tremaining: 2.85s\n",
      "702:\tlearn: 0.3414238\ttotal: 6.72s\tremaining: 2.84s\n",
      "703:\tlearn: 0.3413646\ttotal: 6.73s\tremaining: 2.83s\n",
      "704:\tlearn: 0.3412863\ttotal: 6.74s\tremaining: 2.82s\n",
      "705:\tlearn: 0.3412167\ttotal: 6.75s\tremaining: 2.81s\n",
      "706:\tlearn: 0.3411526\ttotal: 6.75s\tremaining: 2.8s\n",
      "707:\tlearn: 0.3410842\ttotal: 6.76s\tremaining: 2.79s\n",
      "708:\tlearn: 0.3410440\ttotal: 6.77s\tremaining: 2.78s\n",
      "709:\tlearn: 0.3409722\ttotal: 6.79s\tremaining: 2.77s\n",
      "710:\tlearn: 0.3409116\ttotal: 6.8s\tremaining: 2.76s\n",
      "711:\tlearn: 0.3408584\ttotal: 6.81s\tremaining: 2.75s\n",
      "712:\tlearn: 0.3407788\ttotal: 6.82s\tremaining: 2.74s\n",
      "713:\tlearn: 0.3407480\ttotal: 6.83s\tremaining: 2.73s\n",
      "714:\tlearn: 0.3406881\ttotal: 6.83s\tremaining: 2.72s\n",
      "715:\tlearn: 0.3406216\ttotal: 6.84s\tremaining: 2.71s\n",
      "716:\tlearn: 0.3405972\ttotal: 6.85s\tremaining: 2.7s\n",
      "717:\tlearn: 0.3405322\ttotal: 6.85s\tremaining: 2.69s\n",
      "718:\tlearn: 0.3404552\ttotal: 6.86s\tremaining: 2.68s\n",
      "719:\tlearn: 0.3403979\ttotal: 6.88s\tremaining: 2.67s\n",
      "720:\tlearn: 0.3403159\ttotal: 6.88s\tremaining: 2.66s\n",
      "721:\tlearn: 0.3402622\ttotal: 6.89s\tremaining: 2.65s\n",
      "722:\tlearn: 0.3402298\ttotal: 6.9s\tremaining: 2.64s\n",
      "723:\tlearn: 0.3401662\ttotal: 6.91s\tremaining: 2.63s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "724:\tlearn: 0.3401062\ttotal: 6.92s\tremaining: 2.63s\n",
      "725:\tlearn: 0.3400609\ttotal: 6.93s\tremaining: 2.62s\n",
      "726:\tlearn: 0.3399626\ttotal: 6.94s\tremaining: 2.61s\n",
      "727:\tlearn: 0.3399050\ttotal: 6.95s\tremaining: 2.6s\n",
      "728:\tlearn: 0.3398392\ttotal: 6.97s\tremaining: 2.59s\n",
      "729:\tlearn: 0.3397711\ttotal: 6.97s\tremaining: 2.58s\n",
      "730:\tlearn: 0.3397084\ttotal: 6.98s\tremaining: 2.57s\n",
      "731:\tlearn: 0.3396389\ttotal: 6.99s\tremaining: 2.56s\n",
      "732:\tlearn: 0.3395616\ttotal: 7s\tremaining: 2.55s\n",
      "733:\tlearn: 0.3394892\ttotal: 7.01s\tremaining: 2.54s\n",
      "734:\tlearn: 0.3394403\ttotal: 7.01s\tremaining: 2.53s\n",
      "735:\tlearn: 0.3393733\ttotal: 7.02s\tremaining: 2.52s\n",
      "736:\tlearn: 0.3393426\ttotal: 7.04s\tremaining: 2.51s\n",
      "737:\tlearn: 0.3392942\ttotal: 7.06s\tremaining: 2.5s\n",
      "738:\tlearn: 0.3392656\ttotal: 7.07s\tremaining: 2.5s\n",
      "739:\tlearn: 0.3391932\ttotal: 7.07s\tremaining: 2.48s\n",
      "740:\tlearn: 0.3391377\ttotal: 7.08s\tremaining: 2.48s\n",
      "741:\tlearn: 0.3390449\ttotal: 7.09s\tremaining: 2.46s\n",
      "742:\tlearn: 0.3389877\ttotal: 7.1s\tremaining: 2.45s\n",
      "743:\tlearn: 0.3389491\ttotal: 7.1s\tremaining: 2.44s\n",
      "744:\tlearn: 0.3388859\ttotal: 7.11s\tremaining: 2.43s\n",
      "745:\tlearn: 0.3388434\ttotal: 7.12s\tremaining: 2.42s\n",
      "746:\tlearn: 0.3387705\ttotal: 7.12s\tremaining: 2.41s\n",
      "747:\tlearn: 0.3387092\ttotal: 7.13s\tremaining: 2.4s\n",
      "748:\tlearn: 0.3386178\ttotal: 7.16s\tremaining: 2.4s\n",
      "749:\tlearn: 0.3385709\ttotal: 7.17s\tremaining: 2.39s\n",
      "750:\tlearn: 0.3385199\ttotal: 7.17s\tremaining: 2.38s\n",
      "751:\tlearn: 0.3384528\ttotal: 7.18s\tremaining: 2.37s\n",
      "752:\tlearn: 0.3384144\ttotal: 7.19s\tremaining: 2.36s\n",
      "753:\tlearn: 0.3383524\ttotal: 7.2s\tremaining: 2.35s\n",
      "754:\tlearn: 0.3383260\ttotal: 7.21s\tremaining: 2.34s\n",
      "755:\tlearn: 0.3382681\ttotal: 7.21s\tremaining: 2.33s\n",
      "756:\tlearn: 0.3382160\ttotal: 7.22s\tremaining: 2.32s\n",
      "757:\tlearn: 0.3381665\ttotal: 7.24s\tremaining: 2.31s\n",
      "758:\tlearn: 0.3381058\ttotal: 7.24s\tremaining: 2.3s\n",
      "759:\tlearn: 0.3380429\ttotal: 7.25s\tremaining: 2.29s\n",
      "760:\tlearn: 0.3379746\ttotal: 7.26s\tremaining: 2.28s\n",
      "761:\tlearn: 0.3379057\ttotal: 7.28s\tremaining: 2.27s\n",
      "762:\tlearn: 0.3378624\ttotal: 7.29s\tremaining: 2.26s\n",
      "763:\tlearn: 0.3378255\ttotal: 7.29s\tremaining: 2.25s\n",
      "764:\tlearn: 0.3377669\ttotal: 7.3s\tremaining: 2.24s\n",
      "765:\tlearn: 0.3376993\ttotal: 7.31s\tremaining: 2.23s\n",
      "766:\tlearn: 0.3376403\ttotal: 7.33s\tremaining: 2.23s\n",
      "767:\tlearn: 0.3375832\ttotal: 7.33s\tremaining: 2.21s\n",
      "768:\tlearn: 0.3375223\ttotal: 7.34s\tremaining: 2.21s\n",
      "769:\tlearn: 0.3374902\ttotal: 7.35s\tremaining: 2.19s\n",
      "770:\tlearn: 0.3374337\ttotal: 7.36s\tremaining: 2.19s\n",
      "771:\tlearn: 0.3373792\ttotal: 7.37s\tremaining: 2.17s\n",
      "772:\tlearn: 0.3373382\ttotal: 7.37s\tremaining: 2.17s\n",
      "773:\tlearn: 0.3372852\ttotal: 7.38s\tremaining: 2.15s\n",
      "774:\tlearn: 0.3372268\ttotal: 7.39s\tremaining: 2.15s\n",
      "775:\tlearn: 0.3371310\ttotal: 7.41s\tremaining: 2.14s\n",
      "776:\tlearn: 0.3370665\ttotal: 7.42s\tremaining: 2.13s\n",
      "777:\tlearn: 0.3370166\ttotal: 7.43s\tremaining: 2.12s\n",
      "778:\tlearn: 0.3369834\ttotal: 7.44s\tremaining: 2.11s\n",
      "779:\tlearn: 0.3369184\ttotal: 7.45s\tremaining: 2.1s\n",
      "780:\tlearn: 0.3368579\ttotal: 7.46s\tremaining: 2.09s\n",
      "781:\tlearn: 0.3368044\ttotal: 7.46s\tremaining: 2.08s\n",
      "782:\tlearn: 0.3367456\ttotal: 7.47s\tremaining: 2.07s\n",
      "783:\tlearn: 0.3366910\ttotal: 7.48s\tremaining: 2.06s\n",
      "784:\tlearn: 0.3366557\ttotal: 7.48s\tremaining: 2.05s\n",
      "785:\tlearn: 0.3365796\ttotal: 7.49s\tremaining: 2.04s\n",
      "786:\tlearn: 0.3364985\ttotal: 7.51s\tremaining: 2.03s\n",
      "787:\tlearn: 0.3364578\ttotal: 7.52s\tremaining: 2.02s\n",
      "788:\tlearn: 0.3363825\ttotal: 7.53s\tremaining: 2.01s\n",
      "789:\tlearn: 0.3363295\ttotal: 7.54s\tremaining: 2s\n",
      "790:\tlearn: 0.3362626\ttotal: 7.55s\tremaining: 1.99s\n",
      "791:\tlearn: 0.3362277\ttotal: 7.55s\tremaining: 1.98s\n",
      "792:\tlearn: 0.3361640\ttotal: 7.56s\tremaining: 1.97s\n",
      "793:\tlearn: 0.3361201\ttotal: 7.57s\tremaining: 1.96s\n",
      "794:\tlearn: 0.3360689\ttotal: 7.58s\tremaining: 1.95s\n",
      "795:\tlearn: 0.3360186\ttotal: 7.58s\tremaining: 1.94s\n",
      "796:\tlearn: 0.3359281\ttotal: 7.59s\tremaining: 1.93s\n",
      "797:\tlearn: 0.3358885\ttotal: 7.6s\tremaining: 1.92s\n",
      "798:\tlearn: 0.3358207\ttotal: 7.61s\tremaining: 1.91s\n",
      "799:\tlearn: 0.3357772\ttotal: 7.61s\tremaining: 1.9s\n",
      "800:\tlearn: 0.3356971\ttotal: 7.62s\tremaining: 1.89s\n",
      "801:\tlearn: 0.3356402\ttotal: 7.63s\tremaining: 1.88s\n",
      "802:\tlearn: 0.3355710\ttotal: 7.64s\tremaining: 1.88s\n",
      "803:\tlearn: 0.3355186\ttotal: 7.65s\tremaining: 1.86s\n",
      "804:\tlearn: 0.3354949\ttotal: 7.66s\tremaining: 1.85s\n",
      "805:\tlearn: 0.3354369\ttotal: 7.67s\tremaining: 1.84s\n",
      "806:\tlearn: 0.3353874\ttotal: 7.67s\tremaining: 1.83s\n",
      "807:\tlearn: 0.3353031\ttotal: 7.69s\tremaining: 1.83s\n",
      "808:\tlearn: 0.3352510\ttotal: 7.7s\tremaining: 1.82s\n",
      "809:\tlearn: 0.3351907\ttotal: 7.71s\tremaining: 1.81s\n",
      "810:\tlearn: 0.3351143\ttotal: 7.71s\tremaining: 1.8s\n",
      "811:\tlearn: 0.3350530\ttotal: 7.72s\tremaining: 1.79s\n",
      "812:\tlearn: 0.3349811\ttotal: 7.73s\tremaining: 1.78s\n",
      "813:\tlearn: 0.3349304\ttotal: 7.74s\tremaining: 1.77s\n",
      "814:\tlearn: 0.3348880\ttotal: 7.74s\tremaining: 1.76s\n",
      "815:\tlearn: 0.3348431\ttotal: 7.75s\tremaining: 1.75s\n",
      "816:\tlearn: 0.3347806\ttotal: 7.76s\tremaining: 1.74s\n",
      "817:\tlearn: 0.3347176\ttotal: 7.79s\tremaining: 1.73s\n",
      "818:\tlearn: 0.3346537\ttotal: 7.79s\tremaining: 1.72s\n",
      "819:\tlearn: 0.3346082\ttotal: 7.8s\tremaining: 1.71s\n",
      "820:\tlearn: 0.3345609\ttotal: 7.81s\tremaining: 1.7s\n",
      "821:\tlearn: 0.3345096\ttotal: 7.82s\tremaining: 1.69s\n",
      "822:\tlearn: 0.3344558\ttotal: 7.82s\tremaining: 1.68s\n",
      "823:\tlearn: 0.3344268\ttotal: 7.83s\tremaining: 1.67s\n",
      "824:\tlearn: 0.3343370\ttotal: 7.84s\tremaining: 1.66s\n",
      "825:\tlearn: 0.3342851\ttotal: 7.84s\tremaining: 1.65s\n",
      "826:\tlearn: 0.3342304\ttotal: 7.85s\tremaining: 1.64s\n",
      "827:\tlearn: 0.3341754\ttotal: 7.86s\tremaining: 1.63s\n",
      "828:\tlearn: 0.3341221\ttotal: 7.88s\tremaining: 1.63s\n",
      "829:\tlearn: 0.3340621\ttotal: 7.89s\tremaining: 1.62s\n",
      "830:\tlearn: 0.3340055\ttotal: 7.9s\tremaining: 1.61s\n",
      "831:\tlearn: 0.3339330\ttotal: 7.91s\tremaining: 1.6s\n",
      "832:\tlearn: 0.3339090\ttotal: 7.92s\tremaining: 1.59s\n",
      "833:\tlearn: 0.3338584\ttotal: 7.93s\tremaining: 1.58s\n",
      "834:\tlearn: 0.3338319\ttotal: 7.94s\tremaining: 1.57s\n",
      "835:\tlearn: 0.3337758\ttotal: 7.95s\tremaining: 1.56s\n",
      "836:\tlearn: 0.3337298\ttotal: 7.97s\tremaining: 1.55s\n",
      "837:\tlearn: 0.3336620\ttotal: 7.97s\tremaining: 1.54s\n",
      "838:\tlearn: 0.3335854\ttotal: 7.98s\tremaining: 1.53s\n",
      "839:\tlearn: 0.3335268\ttotal: 7.99s\tremaining: 1.52s\n",
      "840:\tlearn: 0.3334668\ttotal: 8.01s\tremaining: 1.51s\n",
      "841:\tlearn: 0.3334148\ttotal: 8.02s\tremaining: 1.5s\n",
      "842:\tlearn: 0.3333425\ttotal: 8.02s\tremaining: 1.49s\n",
      "843:\tlearn: 0.3332969\ttotal: 8.03s\tremaining: 1.48s\n",
      "844:\tlearn: 0.3332323\ttotal: 8.04s\tremaining: 1.47s\n",
      "845:\tlearn: 0.3331933\ttotal: 8.04s\tremaining: 1.46s\n",
      "846:\tlearn: 0.3331420\ttotal: 8.05s\tremaining: 1.45s\n",
      "847:\tlearn: 0.3330922\ttotal: 8.06s\tremaining: 1.44s\n",
      "848:\tlearn: 0.3330308\ttotal: 8.07s\tremaining: 1.43s\n",
      "849:\tlearn: 0.3329480\ttotal: 8.07s\tremaining: 1.42s\n",
      "850:\tlearn: 0.3328766\ttotal: 8.08s\tremaining: 1.41s\n",
      "851:\tlearn: 0.3327977\ttotal: 8.09s\tremaining: 1.41s\n",
      "852:\tlearn: 0.3327566\ttotal: 8.1s\tremaining: 1.4s\n",
      "853:\tlearn: 0.3327077\ttotal: 8.1s\tremaining: 1.39s\n",
      "854:\tlearn: 0.3326288\ttotal: 8.11s\tremaining: 1.38s\n",
      "855:\tlearn: 0.3325687\ttotal: 8.12s\tremaining: 1.37s\n",
      "856:\tlearn: 0.3325166\ttotal: 8.13s\tremaining: 1.36s\n",
      "857:\tlearn: 0.3324676\ttotal: 8.15s\tremaining: 1.35s\n",
      "858:\tlearn: 0.3323946\ttotal: 8.15s\tremaining: 1.34s\n",
      "859:\tlearn: 0.3323550\ttotal: 8.16s\tremaining: 1.33s\n",
      "860:\tlearn: 0.3322861\ttotal: 8.17s\tremaining: 1.32s\n",
      "861:\tlearn: 0.3322408\ttotal: 8.18s\tremaining: 1.31s\n",
      "862:\tlearn: 0.3321813\ttotal: 8.19s\tremaining: 1.3s\n",
      "863:\tlearn: 0.3321016\ttotal: 8.2s\tremaining: 1.29s\n",
      "864:\tlearn: 0.3320189\ttotal: 8.2s\tremaining: 1.28s\n",
      "865:\tlearn: 0.3319544\ttotal: 8.21s\tremaining: 1.27s\n",
      "866:\tlearn: 0.3318794\ttotal: 8.22s\tremaining: 1.26s\n",
      "867:\tlearn: 0.3318128\ttotal: 8.25s\tremaining: 1.25s\n",
      "868:\tlearn: 0.3317490\ttotal: 8.26s\tremaining: 1.24s\n",
      "869:\tlearn: 0.3316953\ttotal: 8.26s\tremaining: 1.23s\n",
      "870:\tlearn: 0.3316475\ttotal: 8.27s\tremaining: 1.23s\n",
      "871:\tlearn: 0.3315850\ttotal: 8.28s\tremaining: 1.22s\n",
      "872:\tlearn: 0.3315286\ttotal: 8.29s\tremaining: 1.21s\n",
      "873:\tlearn: 0.3314505\ttotal: 8.29s\tremaining: 1.2s\n",
      "874:\tlearn: 0.3314089\ttotal: 8.3s\tremaining: 1.19s\n",
      "875:\tlearn: 0.3313475\ttotal: 8.31s\tremaining: 1.18s\n",
      "876:\tlearn: 0.3313038\ttotal: 8.32s\tremaining: 1.17s\n",
      "877:\tlearn: 0.3312428\ttotal: 8.33s\tremaining: 1.16s\n",
      "878:\tlearn: 0.3311997\ttotal: 8.34s\tremaining: 1.15s\n",
      "879:\tlearn: 0.3311463\ttotal: 8.35s\tremaining: 1.14s\n",
      "880:\tlearn: 0.3310693\ttotal: 8.36s\tremaining: 1.13s\n",
      "881:\tlearn: 0.3310478\ttotal: 8.37s\tremaining: 1.12s\n",
      "882:\tlearn: 0.3310156\ttotal: 8.38s\tremaining: 1.11s\n",
      "883:\tlearn: 0.3309542\ttotal: 8.38s\tremaining: 1.1s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "884:\tlearn: 0.3308830\ttotal: 8.39s\tremaining: 1.09s\n",
      "885:\tlearn: 0.3308313\ttotal: 8.4s\tremaining: 1.08s\n",
      "886:\tlearn: 0.3307772\ttotal: 8.42s\tremaining: 1.07s\n",
      "887:\tlearn: 0.3307291\ttotal: 8.43s\tremaining: 1.06s\n",
      "888:\tlearn: 0.3306619\ttotal: 8.43s\tremaining: 1.05s\n",
      "889:\tlearn: 0.3306064\ttotal: 8.44s\tremaining: 1.04s\n",
      "890:\tlearn: 0.3305646\ttotal: 8.45s\tremaining: 1.03s\n",
      "891:\tlearn: 0.3305135\ttotal: 8.45s\tremaining: 1.02s\n",
      "892:\tlearn: 0.3304593\ttotal: 8.46s\tremaining: 1.01s\n",
      "893:\tlearn: 0.3304102\ttotal: 8.47s\tremaining: 1s\n",
      "894:\tlearn: 0.3303303\ttotal: 8.48s\tremaining: 996ms\n",
      "895:\tlearn: 0.3302569\ttotal: 8.49s\tremaining: 986ms\n",
      "896:\tlearn: 0.3301974\ttotal: 8.5s\tremaining: 976ms\n",
      "897:\tlearn: 0.3301300\ttotal: 8.51s\tremaining: 967ms\n",
      "898:\tlearn: 0.3300796\ttotal: 8.52s\tremaining: 957ms\n",
      "899:\tlearn: 0.3300277\ttotal: 8.52s\tremaining: 947ms\n",
      "900:\tlearn: 0.3299735\ttotal: 8.53s\tremaining: 937ms\n",
      "901:\tlearn: 0.3299072\ttotal: 8.54s\tremaining: 928ms\n",
      "902:\tlearn: 0.3298511\ttotal: 8.55s\tremaining: 918ms\n",
      "903:\tlearn: 0.3298043\ttotal: 8.55s\tremaining: 908ms\n",
      "904:\tlearn: 0.3297414\ttotal: 8.56s\tremaining: 899ms\n",
      "905:\tlearn: 0.3296753\ttotal: 8.57s\tremaining: 889ms\n",
      "906:\tlearn: 0.3296175\ttotal: 8.57s\tremaining: 879ms\n",
      "907:\tlearn: 0.3295841\ttotal: 8.58s\tremaining: 869ms\n",
      "908:\tlearn: 0.3295709\ttotal: 8.61s\tremaining: 862ms\n",
      "909:\tlearn: 0.3295254\ttotal: 8.63s\tremaining: 853ms\n",
      "910:\tlearn: 0.3295185\ttotal: 8.64s\tremaining: 844ms\n",
      "911:\tlearn: 0.3294609\ttotal: 8.65s\tremaining: 834ms\n",
      "912:\tlearn: 0.3293800\ttotal: 8.66s\tremaining: 825ms\n",
      "913:\tlearn: 0.3293526\ttotal: 8.67s\tremaining: 816ms\n",
      "914:\tlearn: 0.3292798\ttotal: 8.69s\tremaining: 808ms\n",
      "915:\tlearn: 0.3292422\ttotal: 8.7s\tremaining: 798ms\n",
      "916:\tlearn: 0.3291741\ttotal: 8.72s\tremaining: 790ms\n",
      "917:\tlearn: 0.3291319\ttotal: 8.73s\tremaining: 780ms\n",
      "918:\tlearn: 0.3291087\ttotal: 8.74s\tremaining: 771ms\n",
      "919:\tlearn: 0.3290380\ttotal: 8.76s\tremaining: 761ms\n",
      "920:\tlearn: 0.3289869\ttotal: 8.77s\tremaining: 752ms\n",
      "921:\tlearn: 0.3289499\ttotal: 8.79s\tremaining: 744ms\n",
      "922:\tlearn: 0.3289203\ttotal: 8.8s\tremaining: 734ms\n",
      "923:\tlearn: 0.3288724\ttotal: 8.81s\tremaining: 725ms\n",
      "924:\tlearn: 0.3288097\ttotal: 8.82s\tremaining: 715ms\n",
      "925:\tlearn: 0.3287878\ttotal: 8.84s\tremaining: 707ms\n",
      "926:\tlearn: 0.3287355\ttotal: 8.86s\tremaining: 697ms\n",
      "927:\tlearn: 0.3286619\ttotal: 8.88s\tremaining: 689ms\n",
      "928:\tlearn: 0.3286158\ttotal: 8.89s\tremaining: 680ms\n",
      "929:\tlearn: 0.3285779\ttotal: 8.9s\tremaining: 670ms\n",
      "930:\tlearn: 0.3285269\ttotal: 8.91s\tremaining: 661ms\n",
      "931:\tlearn: 0.3284789\ttotal: 8.92s\tremaining: 651ms\n",
      "932:\tlearn: 0.3284081\ttotal: 8.93s\tremaining: 642ms\n",
      "933:\tlearn: 0.3283637\ttotal: 8.94s\tremaining: 632ms\n",
      "934:\tlearn: 0.3283238\ttotal: 8.98s\tremaining: 624ms\n",
      "935:\tlearn: 0.3282768\ttotal: 8.99s\tremaining: 615ms\n",
      "936:\tlearn: 0.3281921\ttotal: 9s\tremaining: 605ms\n",
      "937:\tlearn: 0.3281393\ttotal: 9.01s\tremaining: 596ms\n",
      "938:\tlearn: 0.3280860\ttotal: 9.02s\tremaining: 586ms\n",
      "939:\tlearn: 0.3280518\ttotal: 9.03s\tremaining: 576ms\n",
      "940:\tlearn: 0.3279802\ttotal: 9.04s\tremaining: 567ms\n",
      "941:\tlearn: 0.3279425\ttotal: 9.05s\tremaining: 557ms\n",
      "942:\tlearn: 0.3278853\ttotal: 9.06s\tremaining: 547ms\n",
      "943:\tlearn: 0.3278276\ttotal: 9.06s\tremaining: 538ms\n",
      "944:\tlearn: 0.3277668\ttotal: 9.07s\tremaining: 528ms\n",
      "945:\tlearn: 0.3276969\ttotal: 9.09s\tremaining: 519ms\n",
      "946:\tlearn: 0.3276398\ttotal: 9.09s\tremaining: 509ms\n",
      "947:\tlearn: 0.3275553\ttotal: 9.1s\tremaining: 499ms\n",
      "948:\tlearn: 0.3274976\ttotal: 9.11s\tremaining: 490ms\n",
      "949:\tlearn: 0.3274605\ttotal: 9.12s\tremaining: 480ms\n",
      "950:\tlearn: 0.3274201\ttotal: 9.12s\tremaining: 470ms\n",
      "951:\tlearn: 0.3273761\ttotal: 9.13s\tremaining: 460ms\n",
      "952:\tlearn: 0.3272877\ttotal: 9.15s\tremaining: 451ms\n",
      "953:\tlearn: 0.3272508\ttotal: 9.16s\tremaining: 442ms\n",
      "954:\tlearn: 0.3272002\ttotal: 9.16s\tremaining: 432ms\n",
      "955:\tlearn: 0.3271880\ttotal: 9.17s\tremaining: 422ms\n",
      "956:\tlearn: 0.3271094\ttotal: 9.18s\tremaining: 413ms\n",
      "957:\tlearn: 0.3270604\ttotal: 9.19s\tremaining: 403ms\n",
      "958:\tlearn: 0.3270043\ttotal: 9.2s\tremaining: 393ms\n",
      "959:\tlearn: 0.3269255\ttotal: 9.21s\tremaining: 384ms\n",
      "960:\tlearn: 0.3268881\ttotal: 9.22s\tremaining: 374ms\n",
      "961:\tlearn: 0.3268111\ttotal: 9.23s\tremaining: 365ms\n",
      "962:\tlearn: 0.3267738\ttotal: 9.25s\tremaining: 355ms\n",
      "963:\tlearn: 0.3267018\ttotal: 9.25s\tremaining: 346ms\n",
      "964:\tlearn: 0.3266555\ttotal: 9.26s\tremaining: 336ms\n",
      "965:\tlearn: 0.3265985\ttotal: 9.27s\tremaining: 326ms\n",
      "966:\tlearn: 0.3265350\ttotal: 9.28s\tremaining: 317ms\n",
      "967:\tlearn: 0.3264749\ttotal: 9.28s\tremaining: 307ms\n",
      "968:\tlearn: 0.3264185\ttotal: 9.29s\tremaining: 297ms\n",
      "969:\tlearn: 0.3263630\ttotal: 9.3s\tremaining: 288ms\n",
      "970:\tlearn: 0.3262987\ttotal: 9.3s\tremaining: 278ms\n",
      "971:\tlearn: 0.3262679\ttotal: 9.33s\tremaining: 269ms\n",
      "972:\tlearn: 0.3262080\ttotal: 9.34s\tremaining: 259ms\n",
      "973:\tlearn: 0.3261676\ttotal: 9.35s\tremaining: 250ms\n",
      "974:\tlearn: 0.3261523\ttotal: 9.36s\tremaining: 240ms\n",
      "975:\tlearn: 0.3261018\ttotal: 9.36s\tremaining: 230ms\n",
      "976:\tlearn: 0.3260405\ttotal: 9.37s\tremaining: 221ms\n",
      "977:\tlearn: 0.3260171\ttotal: 9.38s\tremaining: 211ms\n",
      "978:\tlearn: 0.3259772\ttotal: 9.38s\tremaining: 201ms\n",
      "979:\tlearn: 0.3259341\ttotal: 9.39s\tremaining: 192ms\n",
      "980:\tlearn: 0.3258981\ttotal: 9.4s\tremaining: 182ms\n",
      "981:\tlearn: 0.3258158\ttotal: 9.41s\tremaining: 172ms\n",
      "982:\tlearn: 0.3257576\ttotal: 9.42s\tremaining: 163ms\n",
      "983:\tlearn: 0.3257037\ttotal: 9.43s\tremaining: 153ms\n",
      "984:\tlearn: 0.3256420\ttotal: 9.45s\tremaining: 144ms\n",
      "985:\tlearn: 0.3255818\ttotal: 9.46s\tremaining: 134ms\n",
      "986:\tlearn: 0.3255331\ttotal: 9.46s\tremaining: 125ms\n",
      "987:\tlearn: 0.3255088\ttotal: 9.47s\tremaining: 115ms\n",
      "988:\tlearn: 0.3254654\ttotal: 9.48s\tremaining: 105ms\n",
      "989:\tlearn: 0.3254282\ttotal: 9.48s\tremaining: 95.8ms\n",
      "990:\tlearn: 0.3253480\ttotal: 9.49s\tremaining: 86.2ms\n",
      "991:\tlearn: 0.3252788\ttotal: 9.51s\tremaining: 76.7ms\n",
      "992:\tlearn: 0.3252272\ttotal: 9.52s\tremaining: 67.1ms\n",
      "993:\tlearn: 0.3251595\ttotal: 9.53s\tremaining: 57.5ms\n",
      "994:\tlearn: 0.3250842\ttotal: 9.53s\tremaining: 47.9ms\n",
      "995:\tlearn: 0.3250366\ttotal: 9.54s\tremaining: 38.3ms\n",
      "996:\tlearn: 0.3249823\ttotal: 9.55s\tremaining: 28.7ms\n",
      "997:\tlearn: 0.3249171\ttotal: 9.56s\tremaining: 19.2ms\n",
      "998:\tlearn: 0.3248689\ttotal: 9.57s\tremaining: 9.58ms\n",
      "999:\tlearn: 0.3248264\ttotal: 9.58s\tremaining: 0us\n",
      "Learning rate set to 0.059277\n",
      "0:\tlearn: 0.6567329\ttotal: 24ms\tremaining: 24s\n",
      "1:\tlearn: 0.6232131\ttotal: 36.5ms\tremaining: 18.2s\n",
      "2:\tlearn: 0.5956078\ttotal: 47.1ms\tremaining: 15.7s\n",
      "3:\tlearn: 0.5721714\ttotal: 57.8ms\tremaining: 14.4s\n",
      "4:\tlearn: 0.5515532\ttotal: 68.2ms\tremaining: 13.6s\n",
      "5:\tlearn: 0.5346394\ttotal: 82.1ms\tremaining: 13.6s\n",
      "6:\tlearn: 0.5184143\ttotal: 107ms\tremaining: 15.1s\n",
      "7:\tlearn: 0.5050164\ttotal: 115ms\tremaining: 14.3s\n",
      "8:\tlearn: 0.4944022\ttotal: 123ms\tremaining: 13.5s\n",
      "9:\tlearn: 0.4858271\ttotal: 130ms\tremaining: 12.9s\n",
      "10:\tlearn: 0.4774017\ttotal: 138ms\tremaining: 12.4s\n",
      "11:\tlearn: 0.4689645\ttotal: 146ms\tremaining: 12s\n",
      "12:\tlearn: 0.4620022\ttotal: 153ms\tremaining: 11.6s\n",
      "13:\tlearn: 0.4559521\ttotal: 160ms\tremaining: 11.3s\n",
      "14:\tlearn: 0.4508149\ttotal: 167ms\tremaining: 11s\n",
      "15:\tlearn: 0.4460504\ttotal: 174ms\tremaining: 10.7s\n",
      "16:\tlearn: 0.4426016\ttotal: 192ms\tremaining: 11.1s\n",
      "17:\tlearn: 0.4392825\ttotal: 209ms\tremaining: 11.4s\n",
      "18:\tlearn: 0.4366792\ttotal: 219ms\tremaining: 11.3s\n",
      "19:\tlearn: 0.4333377\ttotal: 228ms\tremaining: 11.2s\n",
      "20:\tlearn: 0.4307869\ttotal: 238ms\tremaining: 11.1s\n",
      "21:\tlearn: 0.4288929\ttotal: 246ms\tremaining: 10.9s\n",
      "22:\tlearn: 0.4269717\ttotal: 254ms\tremaining: 10.8s\n",
      "23:\tlearn: 0.4249680\ttotal: 261ms\tremaining: 10.6s\n",
      "24:\tlearn: 0.4236530\ttotal: 268ms\tremaining: 10.5s\n",
      "25:\tlearn: 0.4222325\ttotal: 286ms\tremaining: 10.7s\n",
      "26:\tlearn: 0.4208210\ttotal: 293ms\tremaining: 10.6s\n",
      "27:\tlearn: 0.4198170\ttotal: 301ms\tremaining: 10.4s\n",
      "28:\tlearn: 0.4187711\ttotal: 308ms\tremaining: 10.3s\n",
      "29:\tlearn: 0.4178605\ttotal: 318ms\tremaining: 10.3s\n",
      "30:\tlearn: 0.4167037\ttotal: 331ms\tremaining: 10.3s\n",
      "31:\tlearn: 0.4159490\ttotal: 339ms\tremaining: 10.3s\n",
      "32:\tlearn: 0.4150468\ttotal: 347ms\tremaining: 10.2s\n",
      "33:\tlearn: 0.4143900\ttotal: 355ms\tremaining: 10.1s\n",
      "34:\tlearn: 0.4135799\ttotal: 364ms\tremaining: 10s\n",
      "35:\tlearn: 0.4130134\ttotal: 379ms\tremaining: 10.2s\n",
      "36:\tlearn: 0.4122609\ttotal: 387ms\tremaining: 10.1s\n",
      "37:\tlearn: 0.4115871\ttotal: 396ms\tremaining: 10s\n",
      "38:\tlearn: 0.4110947\ttotal: 403ms\tremaining: 9.94s\n",
      "39:\tlearn: 0.4107359\ttotal: 411ms\tremaining: 9.86s\n",
      "40:\tlearn: 0.4101022\ttotal: 418ms\tremaining: 9.78s\n",
      "41:\tlearn: 0.4095614\ttotal: 426ms\tremaining: 9.72s\n",
      "42:\tlearn: 0.4091641\ttotal: 433ms\tremaining: 9.64s\n",
      "43:\tlearn: 0.4087011\ttotal: 448ms\tremaining: 9.74s\n",
      "44:\tlearn: 0.4083597\ttotal: 466ms\tremaining: 9.9s\n",
      "45:\tlearn: 0.4080931\ttotal: 474ms\tremaining: 9.83s\n",
      "46:\tlearn: 0.4077284\ttotal: 482ms\tremaining: 9.77s\n",
      "47:\tlearn: 0.4073945\ttotal: 489ms\tremaining: 9.71s\n",
      "48:\tlearn: 0.4070992\ttotal: 497ms\tremaining: 9.64s\n",
      "49:\tlearn: 0.4068029\ttotal: 504ms\tremaining: 9.58s\n",
      "50:\tlearn: 0.4063908\ttotal: 512ms\tremaining: 9.52s\n",
      "51:\tlearn: 0.4060751\ttotal: 519ms\tremaining: 9.45s\n",
      "52:\tlearn: 0.4057146\ttotal: 526ms\tremaining: 9.4s\n",
      "53:\tlearn: 0.4054054\ttotal: 533ms\tremaining: 9.34s\n",
      "54:\tlearn: 0.4051465\ttotal: 541ms\tremaining: 9.29s\n",
      "55:\tlearn: 0.4049094\ttotal: 562ms\tremaining: 9.47s\n",
      "56:\tlearn: 0.4046572\ttotal: 574ms\tremaining: 9.49s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "57:\tlearn: 0.4044551\ttotal: 582ms\tremaining: 9.45s\n",
      "58:\tlearn: 0.4040979\ttotal: 591ms\tremaining: 9.43s\n",
      "59:\tlearn: 0.4037563\ttotal: 600ms\tremaining: 9.4s\n",
      "60:\tlearn: 0.4034638\ttotal: 608ms\tremaining: 9.36s\n",
      "61:\tlearn: 0.4031344\ttotal: 616ms\tremaining: 9.32s\n",
      "62:\tlearn: 0.4028791\ttotal: 624ms\tremaining: 9.28s\n",
      "63:\tlearn: 0.4025962\ttotal: 631ms\tremaining: 9.23s\n",
      "64:\tlearn: 0.4023950\ttotal: 649ms\tremaining: 9.33s\n",
      "65:\tlearn: 0.4022018\ttotal: 656ms\tremaining: 9.29s\n",
      "66:\tlearn: 0.4020565\ttotal: 664ms\tremaining: 9.24s\n",
      "67:\tlearn: 0.4017724\ttotal: 671ms\tremaining: 9.19s\n",
      "68:\tlearn: 0.4016644\ttotal: 681ms\tremaining: 9.19s\n",
      "69:\tlearn: 0.4013794\ttotal: 693ms\tremaining: 9.2s\n",
      "70:\tlearn: 0.4010688\ttotal: 701ms\tremaining: 9.18s\n",
      "71:\tlearn: 0.4007768\ttotal: 709ms\tremaining: 9.14s\n",
      "72:\tlearn: 0.4005966\ttotal: 717ms\tremaining: 9.1s\n",
      "73:\tlearn: 0.4004506\ttotal: 724ms\tremaining: 9.06s\n",
      "74:\tlearn: 0.4001942\ttotal: 742ms\tremaining: 9.15s\n",
      "75:\tlearn: 0.4000349\ttotal: 749ms\tremaining: 9.11s\n",
      "76:\tlearn: 0.3998274\ttotal: 757ms\tremaining: 9.07s\n",
      "77:\tlearn: 0.3996170\ttotal: 765ms\tremaining: 9.04s\n",
      "78:\tlearn: 0.3993970\ttotal: 772ms\tremaining: 9s\n",
      "79:\tlearn: 0.3991048\ttotal: 780ms\tremaining: 8.97s\n",
      "80:\tlearn: 0.3988789\ttotal: 788ms\tremaining: 8.95s\n",
      "81:\tlearn: 0.3987084\ttotal: 799ms\tremaining: 8.94s\n",
      "82:\tlearn: 0.3985466\ttotal: 811ms\tremaining: 8.96s\n",
      "83:\tlearn: 0.3983706\ttotal: 830ms\tremaining: 9.05s\n",
      "84:\tlearn: 0.3982408\ttotal: 837ms\tremaining: 9.01s\n",
      "85:\tlearn: 0.3980569\ttotal: 845ms\tremaining: 8.98s\n",
      "86:\tlearn: 0.3979260\ttotal: 853ms\tremaining: 8.95s\n",
      "87:\tlearn: 0.3977461\ttotal: 860ms\tremaining: 8.91s\n",
      "88:\tlearn: 0.3976174\ttotal: 867ms\tremaining: 8.87s\n",
      "89:\tlearn: 0.3974491\ttotal: 874ms\tremaining: 8.84s\n",
      "90:\tlearn: 0.3973184\ttotal: 881ms\tremaining: 8.8s\n",
      "91:\tlearn: 0.3972128\ttotal: 887ms\tremaining: 8.76s\n",
      "92:\tlearn: 0.3968832\ttotal: 895ms\tremaining: 8.72s\n",
      "93:\tlearn: 0.3967557\ttotal: 901ms\tremaining: 8.68s\n",
      "94:\tlearn: 0.3965218\ttotal: 920ms\tremaining: 8.77s\n",
      "95:\tlearn: 0.3963459\ttotal: 934ms\tremaining: 8.79s\n",
      "96:\tlearn: 0.3961084\ttotal: 943ms\tremaining: 8.78s\n",
      "97:\tlearn: 0.3960048\ttotal: 952ms\tremaining: 8.76s\n",
      "98:\tlearn: 0.3958662\ttotal: 960ms\tremaining: 8.74s\n",
      "99:\tlearn: 0.3957308\ttotal: 968ms\tremaining: 8.71s\n",
      "100:\tlearn: 0.3956200\ttotal: 976ms\tremaining: 8.69s\n",
      "101:\tlearn: 0.3954775\ttotal: 984ms\tremaining: 8.66s\n",
      "102:\tlearn: 0.3953228\ttotal: 992ms\tremaining: 8.64s\n",
      "103:\tlearn: 0.3952137\ttotal: 1.01s\tremaining: 8.7s\n",
      "104:\tlearn: 0.3950559\ttotal: 1.02s\tremaining: 8.67s\n",
      "105:\tlearn: 0.3948471\ttotal: 1.02s\tremaining: 8.65s\n",
      "106:\tlearn: 0.3947076\ttotal: 1.03s\tremaining: 8.62s\n",
      "107:\tlearn: 0.3945723\ttotal: 1.05s\tremaining: 8.67s\n",
      "108:\tlearn: 0.3943919\ttotal: 1.06s\tremaining: 8.65s\n",
      "109:\tlearn: 0.3942759\ttotal: 1.07s\tremaining: 8.63s\n",
      "110:\tlearn: 0.3941623\ttotal: 1.07s\tremaining: 8.6s\n",
      "111:\tlearn: 0.3940067\ttotal: 1.08s\tremaining: 8.58s\n",
      "112:\tlearn: 0.3938852\ttotal: 1.09s\tremaining: 8.59s\n",
      "113:\tlearn: 0.3937500\ttotal: 1.1s\tremaining: 8.58s\n",
      "114:\tlearn: 0.3936063\ttotal: 1.11s\tremaining: 8.55s\n",
      "115:\tlearn: 0.3934328\ttotal: 1.12s\tremaining: 8.53s\n",
      "116:\tlearn: 0.3932670\ttotal: 1.13s\tremaining: 8.5s\n",
      "117:\tlearn: 0.3930766\ttotal: 1.13s\tremaining: 8.47s\n",
      "118:\tlearn: 0.3929853\ttotal: 1.14s\tremaining: 8.44s\n",
      "119:\tlearn: 0.3928994\ttotal: 1.15s\tremaining: 8.42s\n",
      "120:\tlearn: 0.3928245\ttotal: 1.16s\tremaining: 8.43s\n",
      "121:\tlearn: 0.3927404\ttotal: 1.17s\tremaining: 8.42s\n",
      "122:\tlearn: 0.3925681\ttotal: 1.19s\tremaining: 8.5s\n",
      "123:\tlearn: 0.3925160\ttotal: 1.2s\tremaining: 8.49s\n",
      "124:\tlearn: 0.3924341\ttotal: 1.21s\tremaining: 8.47s\n",
      "125:\tlearn: 0.3922752\ttotal: 1.22s\tremaining: 8.46s\n",
      "126:\tlearn: 0.3921602\ttotal: 1.23s\tremaining: 8.44s\n",
      "127:\tlearn: 0.3920178\ttotal: 1.23s\tremaining: 8.41s\n",
      "128:\tlearn: 0.3918849\ttotal: 1.24s\tremaining: 8.39s\n",
      "129:\tlearn: 0.3916922\ttotal: 1.25s\tremaining: 8.36s\n",
      "130:\tlearn: 0.3915284\ttotal: 1.26s\tremaining: 8.34s\n",
      "131:\tlearn: 0.3913630\ttotal: 1.26s\tremaining: 8.32s\n",
      "132:\tlearn: 0.3912635\ttotal: 1.29s\tremaining: 8.41s\n",
      "133:\tlearn: 0.3911162\ttotal: 1.3s\tremaining: 8.39s\n",
      "134:\tlearn: 0.3909603\ttotal: 1.3s\tremaining: 8.37s\n",
      "135:\tlearn: 0.3908452\ttotal: 1.31s\tremaining: 8.34s\n",
      "136:\tlearn: 0.3906680\ttotal: 1.32s\tremaining: 8.31s\n",
      "137:\tlearn: 0.3905494\ttotal: 1.33s\tremaining: 8.29s\n",
      "138:\tlearn: 0.3905007\ttotal: 1.33s\tremaining: 8.26s\n",
      "139:\tlearn: 0.3904296\ttotal: 1.34s\tremaining: 8.24s\n",
      "140:\tlearn: 0.3902737\ttotal: 1.35s\tremaining: 8.21s\n",
      "141:\tlearn: 0.3901940\ttotal: 1.35s\tremaining: 8.18s\n",
      "142:\tlearn: 0.3900355\ttotal: 1.37s\tremaining: 8.22s\n",
      "143:\tlearn: 0.3899550\ttotal: 1.38s\tremaining: 8.21s\n",
      "144:\tlearn: 0.3897763\ttotal: 1.39s\tremaining: 8.19s\n",
      "145:\tlearn: 0.3896809\ttotal: 1.4s\tremaining: 8.21s\n",
      "146:\tlearn: 0.3895112\ttotal: 1.41s\tremaining: 8.2s\n",
      "147:\tlearn: 0.3894122\ttotal: 1.42s\tremaining: 8.18s\n",
      "148:\tlearn: 0.3893353\ttotal: 1.43s\tremaining: 8.16s\n",
      "149:\tlearn: 0.3892517\ttotal: 1.44s\tremaining: 8.14s\n",
      "150:\tlearn: 0.3891536\ttotal: 1.44s\tremaining: 8.12s\n",
      "151:\tlearn: 0.3890339\ttotal: 1.46s\tremaining: 8.13s\n",
      "152:\tlearn: 0.3889235\ttotal: 1.46s\tremaining: 8.11s\n",
      "153:\tlearn: 0.3887411\ttotal: 1.47s\tremaining: 8.09s\n",
      "154:\tlearn: 0.3886366\ttotal: 1.48s\tremaining: 8.06s\n",
      "155:\tlearn: 0.3885579\ttotal: 1.49s\tremaining: 8.04s\n",
      "156:\tlearn: 0.3884325\ttotal: 1.49s\tremaining: 8.02s\n",
      "157:\tlearn: 0.3881422\ttotal: 1.5s\tremaining: 8s\n",
      "158:\tlearn: 0.3879919\ttotal: 1.51s\tremaining: 7.99s\n",
      "159:\tlearn: 0.3879160\ttotal: 1.52s\tremaining: 7.98s\n",
      "160:\tlearn: 0.3878223\ttotal: 1.53s\tremaining: 7.96s\n",
      "161:\tlearn: 0.3877024\ttotal: 1.54s\tremaining: 7.96s\n",
      "162:\tlearn: 0.3875729\ttotal: 1.55s\tremaining: 7.98s\n",
      "163:\tlearn: 0.3874850\ttotal: 1.56s\tremaining: 7.96s\n",
      "164:\tlearn: 0.3873903\ttotal: 1.57s\tremaining: 7.94s\n",
      "165:\tlearn: 0.3873213\ttotal: 1.58s\tremaining: 7.92s\n",
      "166:\tlearn: 0.3871602\ttotal: 1.59s\tremaining: 7.91s\n",
      "167:\tlearn: 0.3870419\ttotal: 1.59s\tremaining: 7.89s\n",
      "168:\tlearn: 0.3869432\ttotal: 1.6s\tremaining: 7.87s\n",
      "169:\tlearn: 0.3868267\ttotal: 1.61s\tremaining: 7.85s\n",
      "170:\tlearn: 0.3867450\ttotal: 1.61s\tremaining: 7.83s\n",
      "171:\tlearn: 0.3866183\ttotal: 1.62s\tremaining: 7.81s\n",
      "172:\tlearn: 0.3865254\ttotal: 1.65s\tremaining: 7.9s\n",
      "173:\tlearn: 0.3864189\ttotal: 1.66s\tremaining: 7.88s\n",
      "174:\tlearn: 0.3863326\ttotal: 1.67s\tremaining: 7.87s\n",
      "175:\tlearn: 0.3862462\ttotal: 1.68s\tremaining: 7.85s\n",
      "176:\tlearn: 0.3861135\ttotal: 1.68s\tremaining: 7.83s\n",
      "177:\tlearn: 0.3859506\ttotal: 1.69s\tremaining: 7.81s\n",
      "178:\tlearn: 0.3859095\ttotal: 1.7s\tremaining: 7.79s\n",
      "179:\tlearn: 0.3857985\ttotal: 1.71s\tremaining: 7.77s\n",
      "180:\tlearn: 0.3856902\ttotal: 1.71s\tremaining: 7.75s\n",
      "181:\tlearn: 0.3855874\ttotal: 1.72s\tremaining: 7.74s\n",
      "182:\tlearn: 0.3854885\ttotal: 1.74s\tremaining: 7.75s\n",
      "183:\tlearn: 0.3853223\ttotal: 1.75s\tremaining: 7.75s\n",
      "184:\tlearn: 0.3852139\ttotal: 1.76s\tremaining: 7.75s\n",
      "185:\tlearn: 0.3851079\ttotal: 1.76s\tremaining: 7.73s\n",
      "186:\tlearn: 0.3850115\ttotal: 1.77s\tremaining: 7.71s\n",
      "187:\tlearn: 0.3848765\ttotal: 1.78s\tremaining: 7.7s\n",
      "188:\tlearn: 0.3847500\ttotal: 1.79s\tremaining: 7.69s\n",
      "189:\tlearn: 0.3846222\ttotal: 1.8s\tremaining: 7.67s\n",
      "190:\tlearn: 0.3844774\ttotal: 1.81s\tremaining: 7.65s\n",
      "191:\tlearn: 0.3843474\ttotal: 1.82s\tremaining: 7.68s\n",
      "192:\tlearn: 0.3842476\ttotal: 1.83s\tremaining: 7.66s\n",
      "193:\tlearn: 0.3841344\ttotal: 1.84s\tremaining: 7.64s\n",
      "194:\tlearn: 0.3840153\ttotal: 1.85s\tremaining: 7.62s\n",
      "195:\tlearn: 0.3838669\ttotal: 1.85s\tremaining: 7.61s\n",
      "196:\tlearn: 0.3837223\ttotal: 1.86s\tremaining: 7.59s\n",
      "197:\tlearn: 0.3835689\ttotal: 1.87s\tremaining: 7.59s\n",
      "198:\tlearn: 0.3834599\ttotal: 1.88s\tremaining: 7.58s\n",
      "199:\tlearn: 0.3833477\ttotal: 1.89s\tremaining: 7.56s\n",
      "200:\tlearn: 0.3832642\ttotal: 1.9s\tremaining: 7.54s\n",
      "201:\tlearn: 0.3831565\ttotal: 1.92s\tremaining: 7.57s\n",
      "202:\tlearn: 0.3830344\ttotal: 1.92s\tremaining: 7.55s\n",
      "203:\tlearn: 0.3829736\ttotal: 1.93s\tremaining: 7.53s\n",
      "204:\tlearn: 0.3827976\ttotal: 1.94s\tremaining: 7.51s\n",
      "205:\tlearn: 0.3827152\ttotal: 1.95s\tremaining: 7.5s\n",
      "206:\tlearn: 0.3826031\ttotal: 1.95s\tremaining: 7.48s\n",
      "207:\tlearn: 0.3825012\ttotal: 1.96s\tremaining: 7.46s\n",
      "208:\tlearn: 0.3823630\ttotal: 1.97s\tremaining: 7.45s\n",
      "209:\tlearn: 0.3822454\ttotal: 1.98s\tremaining: 7.45s\n",
      "210:\tlearn: 0.3821029\ttotal: 2.01s\tremaining: 7.51s\n",
      "211:\tlearn: 0.3820077\ttotal: 2.02s\tremaining: 7.5s\n",
      "212:\tlearn: 0.3818685\ttotal: 2.03s\tremaining: 7.49s\n",
      "213:\tlearn: 0.3817885\ttotal: 2.04s\tremaining: 7.48s\n",
      "214:\tlearn: 0.3816596\ttotal: 2.04s\tremaining: 7.46s\n",
      "215:\tlearn: 0.3815019\ttotal: 2.05s\tremaining: 7.45s\n",
      "216:\tlearn: 0.3814303\ttotal: 2.06s\tremaining: 7.43s\n",
      "217:\tlearn: 0.3813143\ttotal: 2.07s\tremaining: 7.42s\n",
      "218:\tlearn: 0.3812212\ttotal: 2.07s\tremaining: 7.4s\n",
      "219:\tlearn: 0.3810817\ttotal: 2.08s\tremaining: 7.39s\n",
      "220:\tlearn: 0.3809097\ttotal: 2.1s\tremaining: 7.4s\n",
      "221:\tlearn: 0.3807870\ttotal: 2.12s\tremaining: 7.42s\n",
      "222:\tlearn: 0.3806624\ttotal: 2.13s\tremaining: 7.41s\n",
      "223:\tlearn: 0.3805300\ttotal: 2.13s\tremaining: 7.4s\n",
      "224:\tlearn: 0.3803918\ttotal: 2.14s\tremaining: 7.38s\n",
      "225:\tlearn: 0.3803087\ttotal: 2.15s\tremaining: 7.37s\n",
      "226:\tlearn: 0.3800632\ttotal: 2.16s\tremaining: 7.35s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "227:\tlearn: 0.3800176\ttotal: 2.17s\tremaining: 7.33s\n",
      "228:\tlearn: 0.3799278\ttotal: 2.18s\tremaining: 7.34s\n",
      "229:\tlearn: 0.3798378\ttotal: 2.19s\tremaining: 7.34s\n",
      "230:\tlearn: 0.3797534\ttotal: 2.2s\tremaining: 7.32s\n",
      "231:\tlearn: 0.3796597\ttotal: 2.21s\tremaining: 7.31s\n",
      "232:\tlearn: 0.3795840\ttotal: 2.21s\tremaining: 7.29s\n",
      "233:\tlearn: 0.3794935\ttotal: 2.22s\tremaining: 7.27s\n",
      "234:\tlearn: 0.3794104\ttotal: 2.24s\tremaining: 7.28s\n",
      "235:\tlearn: 0.3792294\ttotal: 2.25s\tremaining: 7.27s\n",
      "236:\tlearn: 0.3790900\ttotal: 2.25s\tremaining: 7.25s\n",
      "237:\tlearn: 0.3789877\ttotal: 2.26s\tremaining: 7.24s\n",
      "238:\tlearn: 0.3788685\ttotal: 2.28s\tremaining: 7.25s\n",
      "239:\tlearn: 0.3787831\ttotal: 2.28s\tremaining: 7.23s\n",
      "240:\tlearn: 0.3786796\ttotal: 2.29s\tremaining: 7.22s\n",
      "241:\tlearn: 0.3785797\ttotal: 2.3s\tremaining: 7.2s\n",
      "242:\tlearn: 0.3784269\ttotal: 2.31s\tremaining: 7.18s\n",
      "243:\tlearn: 0.3782953\ttotal: 2.31s\tremaining: 7.16s\n",
      "244:\tlearn: 0.3782464\ttotal: 2.32s\tremaining: 7.15s\n",
      "245:\tlearn: 0.3781504\ttotal: 2.33s\tremaining: 7.13s\n",
      "246:\tlearn: 0.3779830\ttotal: 2.33s\tremaining: 7.12s\n",
      "247:\tlearn: 0.3778688\ttotal: 2.34s\tremaining: 7.1s\n",
      "248:\tlearn: 0.3777683\ttotal: 2.35s\tremaining: 7.1s\n",
      "249:\tlearn: 0.3777285\ttotal: 2.37s\tremaining: 7.12s\n",
      "250:\tlearn: 0.3776930\ttotal: 2.38s\tremaining: 7.11s\n",
      "251:\tlearn: 0.3775939\ttotal: 2.39s\tremaining: 7.09s\n",
      "252:\tlearn: 0.3775286\ttotal: 2.4s\tremaining: 7.08s\n",
      "253:\tlearn: 0.3774129\ttotal: 2.4s\tremaining: 7.06s\n",
      "254:\tlearn: 0.3772646\ttotal: 2.41s\tremaining: 7.05s\n",
      "255:\tlearn: 0.3771598\ttotal: 2.42s\tremaining: 7.03s\n",
      "256:\tlearn: 0.3770567\ttotal: 2.42s\tremaining: 7.01s\n",
      "257:\tlearn: 0.3769394\ttotal: 2.43s\tremaining: 7s\n",
      "258:\tlearn: 0.3768927\ttotal: 2.44s\tremaining: 6.98s\n",
      "259:\tlearn: 0.3767945\ttotal: 2.46s\tremaining: 6.99s\n",
      "260:\tlearn: 0.3766709\ttotal: 2.47s\tremaining: 6.99s\n",
      "261:\tlearn: 0.3765678\ttotal: 2.48s\tremaining: 6.98s\n",
      "262:\tlearn: 0.3764931\ttotal: 2.49s\tremaining: 6.97s\n",
      "263:\tlearn: 0.3763771\ttotal: 2.49s\tremaining: 6.95s\n",
      "264:\tlearn: 0.3762931\ttotal: 2.5s\tremaining: 6.94s\n",
      "265:\tlearn: 0.3761555\ttotal: 2.51s\tremaining: 6.92s\n",
      "266:\tlearn: 0.3760512\ttotal: 2.52s\tremaining: 6.91s\n",
      "267:\tlearn: 0.3759675\ttotal: 2.52s\tremaining: 6.89s\n",
      "268:\tlearn: 0.3758672\ttotal: 2.53s\tremaining: 6.87s\n",
      "269:\tlearn: 0.3758270\ttotal: 2.54s\tremaining: 6.87s\n",
      "270:\tlearn: 0.3757313\ttotal: 2.55s\tremaining: 6.87s\n",
      "271:\tlearn: 0.3756108\ttotal: 2.56s\tremaining: 6.86s\n",
      "272:\tlearn: 0.3754959\ttotal: 2.57s\tremaining: 6.84s\n",
      "273:\tlearn: 0.3753520\ttotal: 2.58s\tremaining: 6.83s\n",
      "274:\tlearn: 0.3752637\ttotal: 2.59s\tremaining: 6.83s\n",
      "275:\tlearn: 0.3751195\ttotal: 2.6s\tremaining: 6.82s\n",
      "276:\tlearn: 0.3750392\ttotal: 2.61s\tremaining: 6.81s\n",
      "277:\tlearn: 0.3748161\ttotal: 2.62s\tremaining: 6.8s\n",
      "278:\tlearn: 0.3747461\ttotal: 2.62s\tremaining: 6.78s\n",
      "279:\tlearn: 0.3746372\ttotal: 2.64s\tremaining: 6.8s\n",
      "280:\tlearn: 0.3745254\ttotal: 2.65s\tremaining: 6.78s\n",
      "281:\tlearn: 0.3744310\ttotal: 2.66s\tremaining: 6.77s\n",
      "282:\tlearn: 0.3743341\ttotal: 2.67s\tremaining: 6.75s\n",
      "283:\tlearn: 0.3742982\ttotal: 2.67s\tremaining: 6.74s\n",
      "284:\tlearn: 0.3741665\ttotal: 2.68s\tremaining: 6.72s\n",
      "285:\tlearn: 0.3740469\ttotal: 2.69s\tremaining: 6.71s\n",
      "286:\tlearn: 0.3739384\ttotal: 2.69s\tremaining: 6.7s\n",
      "287:\tlearn: 0.3738798\ttotal: 2.71s\tremaining: 6.69s\n",
      "288:\tlearn: 0.3737320\ttotal: 2.73s\tremaining: 6.71s\n",
      "289:\tlearn: 0.3736615\ttotal: 2.74s\tremaining: 6.7s\n",
      "290:\tlearn: 0.3735717\ttotal: 2.74s\tremaining: 6.69s\n",
      "291:\tlearn: 0.3735276\ttotal: 2.75s\tremaining: 6.67s\n",
      "292:\tlearn: 0.3734269\ttotal: 2.76s\tremaining: 6.66s\n",
      "293:\tlearn: 0.3733640\ttotal: 2.77s\tremaining: 6.64s\n",
      "294:\tlearn: 0.3732647\ttotal: 2.77s\tremaining: 6.63s\n",
      "295:\tlearn: 0.3731573\ttotal: 2.78s\tremaining: 6.61s\n",
      "296:\tlearn: 0.3730778\ttotal: 2.79s\tremaining: 6.6s\n",
      "297:\tlearn: 0.3729869\ttotal: 2.79s\tremaining: 6.58s\n",
      "298:\tlearn: 0.3728751\ttotal: 2.8s\tremaining: 6.57s\n",
      "299:\tlearn: 0.3728455\ttotal: 2.82s\tremaining: 6.59s\n",
      "300:\tlearn: 0.3727377\ttotal: 2.84s\tremaining: 6.59s\n",
      "301:\tlearn: 0.3726383\ttotal: 2.84s\tremaining: 6.57s\n",
      "302:\tlearn: 0.3725682\ttotal: 2.85s\tremaining: 6.56s\n",
      "303:\tlearn: 0.3724714\ttotal: 2.86s\tremaining: 6.55s\n",
      "304:\tlearn: 0.3723913\ttotal: 2.87s\tremaining: 6.53s\n",
      "305:\tlearn: 0.3723200\ttotal: 2.87s\tremaining: 6.52s\n",
      "306:\tlearn: 0.3721952\ttotal: 2.88s\tremaining: 6.5s\n",
      "307:\tlearn: 0.3721165\ttotal: 2.89s\tremaining: 6.49s\n",
      "308:\tlearn: 0.3720458\ttotal: 2.9s\tremaining: 6.47s\n",
      "309:\tlearn: 0.3720004\ttotal: 2.91s\tremaining: 6.48s\n",
      "310:\tlearn: 0.3718969\ttotal: 2.92s\tremaining: 6.47s\n",
      "311:\tlearn: 0.3718124\ttotal: 2.93s\tremaining: 6.46s\n",
      "312:\tlearn: 0.3716838\ttotal: 2.93s\tremaining: 6.44s\n",
      "313:\tlearn: 0.3715945\ttotal: 2.95s\tremaining: 6.44s\n",
      "314:\tlearn: 0.3715350\ttotal: 2.96s\tremaining: 6.43s\n",
      "315:\tlearn: 0.3714682\ttotal: 2.96s\tremaining: 6.42s\n",
      "316:\tlearn: 0.3714098\ttotal: 2.97s\tremaining: 6.4s\n",
      "317:\tlearn: 0.3713199\ttotal: 2.98s\tremaining: 6.39s\n",
      "318:\tlearn: 0.3712331\ttotal: 2.98s\tremaining: 6.37s\n",
      "319:\tlearn: 0.3711532\ttotal: 3.01s\tremaining: 6.39s\n",
      "320:\tlearn: 0.3710533\ttotal: 3.01s\tremaining: 6.38s\n",
      "321:\tlearn: 0.3709728\ttotal: 3.02s\tremaining: 6.36s\n",
      "322:\tlearn: 0.3708903\ttotal: 3.03s\tremaining: 6.35s\n",
      "323:\tlearn: 0.3707843\ttotal: 3.04s\tremaining: 6.34s\n",
      "324:\tlearn: 0.3706656\ttotal: 3.04s\tremaining: 6.32s\n",
      "325:\tlearn: 0.3705940\ttotal: 3.05s\tremaining: 6.31s\n",
      "326:\tlearn: 0.3705311\ttotal: 3.06s\tremaining: 6.31s\n",
      "327:\tlearn: 0.3704605\ttotal: 3.08s\tremaining: 6.3s\n",
      "328:\tlearn: 0.3703690\ttotal: 3.1s\tremaining: 6.32s\n",
      "329:\tlearn: 0.3702300\ttotal: 3.11s\tremaining: 6.31s\n",
      "330:\tlearn: 0.3701225\ttotal: 3.12s\tremaining: 6.3s\n",
      "331:\tlearn: 0.3700112\ttotal: 3.12s\tremaining: 6.29s\n",
      "332:\tlearn: 0.3699273\ttotal: 3.13s\tremaining: 6.27s\n",
      "333:\tlearn: 0.3698463\ttotal: 3.14s\tremaining: 6.26s\n",
      "334:\tlearn: 0.3697911\ttotal: 3.15s\tremaining: 6.25s\n",
      "335:\tlearn: 0.3697196\ttotal: 3.15s\tremaining: 6.24s\n",
      "336:\tlearn: 0.3696560\ttotal: 3.16s\tremaining: 6.22s\n",
      "337:\tlearn: 0.3695771\ttotal: 3.17s\tremaining: 6.21s\n",
      "338:\tlearn: 0.3694892\ttotal: 3.19s\tremaining: 6.23s\n",
      "339:\tlearn: 0.3693908\ttotal: 3.2s\tremaining: 6.21s\n",
      "340:\tlearn: 0.3693199\ttotal: 3.21s\tremaining: 6.2s\n",
      "341:\tlearn: 0.3692359\ttotal: 3.22s\tremaining: 6.19s\n",
      "342:\tlearn: 0.3691628\ttotal: 3.23s\tremaining: 6.18s\n",
      "343:\tlearn: 0.3691397\ttotal: 3.23s\tremaining: 6.17s\n",
      "344:\tlearn: 0.3690508\ttotal: 3.24s\tremaining: 6.15s\n",
      "345:\tlearn: 0.3689657\ttotal: 3.25s\tremaining: 6.14s\n",
      "346:\tlearn: 0.3689043\ttotal: 3.26s\tremaining: 6.13s\n",
      "347:\tlearn: 0.3688154\ttotal: 3.27s\tremaining: 6.13s\n",
      "348:\tlearn: 0.3687363\ttotal: 3.28s\tremaining: 6.12s\n",
      "349:\tlearn: 0.3686514\ttotal: 3.29s\tremaining: 6.11s\n",
      "350:\tlearn: 0.3685557\ttotal: 3.3s\tremaining: 6.1s\n",
      "351:\tlearn: 0.3684464\ttotal: 3.31s\tremaining: 6.1s\n",
      "352:\tlearn: 0.3684166\ttotal: 3.32s\tremaining: 6.08s\n",
      "353:\tlearn: 0.3683134\ttotal: 3.33s\tremaining: 6.07s\n",
      "354:\tlearn: 0.3682117\ttotal: 3.33s\tremaining: 6.06s\n",
      "355:\tlearn: 0.3680944\ttotal: 3.34s\tremaining: 6.05s\n",
      "356:\tlearn: 0.3679959\ttotal: 3.35s\tremaining: 6.04s\n",
      "357:\tlearn: 0.3679167\ttotal: 3.37s\tremaining: 6.04s\n",
      "358:\tlearn: 0.3678452\ttotal: 3.38s\tremaining: 6.03s\n",
      "359:\tlearn: 0.3677607\ttotal: 3.38s\tremaining: 6.02s\n",
      "360:\tlearn: 0.3676990\ttotal: 3.39s\tremaining: 6.01s\n",
      "361:\tlearn: 0.3676363\ttotal: 3.4s\tremaining: 5.99s\n",
      "362:\tlearn: 0.3675450\ttotal: 3.41s\tremaining: 5.98s\n",
      "363:\tlearn: 0.3674749\ttotal: 3.41s\tremaining: 5.96s\n",
      "364:\tlearn: 0.3673932\ttotal: 3.42s\tremaining: 5.96s\n",
      "365:\tlearn: 0.3672764\ttotal: 3.44s\tremaining: 5.95s\n",
      "366:\tlearn: 0.3671915\ttotal: 3.46s\tremaining: 5.96s\n",
      "367:\tlearn: 0.3671429\ttotal: 3.46s\tremaining: 5.95s\n",
      "368:\tlearn: 0.3670454\ttotal: 3.47s\tremaining: 5.93s\n",
      "369:\tlearn: 0.3670031\ttotal: 3.48s\tremaining: 5.92s\n",
      "370:\tlearn: 0.3669354\ttotal: 3.48s\tremaining: 5.91s\n",
      "371:\tlearn: 0.3668638\ttotal: 3.49s\tremaining: 5.9s\n",
      "372:\tlearn: 0.3667944\ttotal: 3.5s\tremaining: 5.88s\n",
      "373:\tlearn: 0.3666982\ttotal: 3.51s\tremaining: 5.87s\n",
      "374:\tlearn: 0.3665988\ttotal: 3.52s\tremaining: 5.86s\n",
      "375:\tlearn: 0.3665632\ttotal: 3.52s\tremaining: 5.85s\n",
      "376:\tlearn: 0.3664742\ttotal: 3.53s\tremaining: 5.84s\n",
      "377:\tlearn: 0.3663785\ttotal: 3.56s\tremaining: 5.86s\n",
      "378:\tlearn: 0.3663535\ttotal: 3.57s\tremaining: 5.84s\n",
      "379:\tlearn: 0.3663163\ttotal: 3.57s\tremaining: 5.83s\n",
      "380:\tlearn: 0.3662936\ttotal: 3.58s\tremaining: 5.82s\n",
      "381:\tlearn: 0.3661993\ttotal: 3.59s\tremaining: 5.81s\n",
      "382:\tlearn: 0.3660933\ttotal: 3.6s\tremaining: 5.8s\n",
      "383:\tlearn: 0.3659615\ttotal: 3.6s\tremaining: 5.78s\n",
      "384:\tlearn: 0.3658949\ttotal: 3.61s\tremaining: 5.77s\n",
      "385:\tlearn: 0.3658115\ttotal: 3.62s\tremaining: 5.76s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "386:\tlearn: 0.3657537\ttotal: 3.64s\tremaining: 5.76s\n",
      "387:\tlearn: 0.3656566\ttotal: 3.65s\tremaining: 5.75s\n",
      "388:\tlearn: 0.3655531\ttotal: 3.65s\tremaining: 5.74s\n",
      "389:\tlearn: 0.3654650\ttotal: 3.67s\tremaining: 5.73s\n",
      "390:\tlearn: 0.3653573\ttotal: 3.68s\tremaining: 5.73s\n",
      "391:\tlearn: 0.3652329\ttotal: 3.69s\tremaining: 5.72s\n",
      "392:\tlearn: 0.3651494\ttotal: 3.69s\tremaining: 5.7s\n",
      "393:\tlearn: 0.3650767\ttotal: 3.7s\tremaining: 5.69s\n",
      "394:\tlearn: 0.3649478\ttotal: 3.71s\tremaining: 5.68s\n",
      "395:\tlearn: 0.3648560\ttotal: 3.72s\tremaining: 5.68s\n",
      "396:\tlearn: 0.3647572\ttotal: 3.73s\tremaining: 5.67s\n",
      "397:\tlearn: 0.3646695\ttotal: 3.74s\tremaining: 5.66s\n",
      "398:\tlearn: 0.3646527\ttotal: 3.75s\tremaining: 5.64s\n",
      "399:\tlearn: 0.3645527\ttotal: 3.75s\tremaining: 5.63s\n",
      "400:\tlearn: 0.3644927\ttotal: 3.76s\tremaining: 5.62s\n",
      "401:\tlearn: 0.3643965\ttotal: 3.77s\tremaining: 5.61s\n",
      "402:\tlearn: 0.3643117\ttotal: 3.77s\tremaining: 5.59s\n",
      "403:\tlearn: 0.3642248\ttotal: 3.79s\tremaining: 5.58s\n",
      "404:\tlearn: 0.3641529\ttotal: 3.79s\tremaining: 5.58s\n",
      "405:\tlearn: 0.3640489\ttotal: 3.8s\tremaining: 5.56s\n",
      "406:\tlearn: 0.3639601\ttotal: 3.81s\tremaining: 5.55s\n",
      "407:\tlearn: 0.3638767\ttotal: 3.82s\tremaining: 5.54s\n",
      "408:\tlearn: 0.3637864\ttotal: 3.83s\tremaining: 5.53s\n",
      "409:\tlearn: 0.3636420\ttotal: 3.83s\tremaining: 5.52s\n",
      "410:\tlearn: 0.3635727\ttotal: 3.84s\tremaining: 5.5s\n",
      "411:\tlearn: 0.3635220\ttotal: 3.85s\tremaining: 5.5s\n",
      "412:\tlearn: 0.3634599\ttotal: 3.86s\tremaining: 5.49s\n",
      "413:\tlearn: 0.3633784\ttotal: 3.87s\tremaining: 5.48s\n",
      "414:\tlearn: 0.3633239\ttotal: 3.89s\tremaining: 5.48s\n",
      "415:\tlearn: 0.3632611\ttotal: 3.9s\tremaining: 5.47s\n",
      "416:\tlearn: 0.3631420\ttotal: 3.92s\tremaining: 5.49s\n",
      "417:\tlearn: 0.3630572\ttotal: 3.94s\tremaining: 5.48s\n",
      "418:\tlearn: 0.3629709\ttotal: 3.95s\tremaining: 5.47s\n",
      "419:\tlearn: 0.3628667\ttotal: 3.96s\tremaining: 5.47s\n",
      "420:\tlearn: 0.3627857\ttotal: 3.97s\tremaining: 5.46s\n",
      "421:\tlearn: 0.3627262\ttotal: 3.98s\tremaining: 5.46s\n",
      "422:\tlearn: 0.3626594\ttotal: 4.01s\tremaining: 5.47s\n",
      "423:\tlearn: 0.3625606\ttotal: 4.02s\tremaining: 5.46s\n",
      "424:\tlearn: 0.3624839\ttotal: 4.05s\tremaining: 5.47s\n",
      "425:\tlearn: 0.3623812\ttotal: 4.06s\tremaining: 5.47s\n",
      "426:\tlearn: 0.3622970\ttotal: 4.07s\tremaining: 5.46s\n",
      "427:\tlearn: 0.3622108\ttotal: 4.1s\tremaining: 5.48s\n",
      "428:\tlearn: 0.3621647\ttotal: 4.11s\tremaining: 5.47s\n",
      "429:\tlearn: 0.3620793\ttotal: 4.12s\tremaining: 5.46s\n",
      "430:\tlearn: 0.3619986\ttotal: 4.13s\tremaining: 5.45s\n",
      "431:\tlearn: 0.3619111\ttotal: 4.14s\tremaining: 5.45s\n",
      "432:\tlearn: 0.3618229\ttotal: 4.16s\tremaining: 5.45s\n",
      "433:\tlearn: 0.3617424\ttotal: 4.17s\tremaining: 5.44s\n",
      "434:\tlearn: 0.3616528\ttotal: 4.18s\tremaining: 5.43s\n",
      "435:\tlearn: 0.3615531\ttotal: 4.19s\tremaining: 5.42s\n",
      "436:\tlearn: 0.3614677\ttotal: 4.2s\tremaining: 5.42s\n",
      "437:\tlearn: 0.3613976\ttotal: 4.21s\tremaining: 5.41s\n",
      "438:\tlearn: 0.3613140\ttotal: 4.22s\tremaining: 5.4s\n",
      "439:\tlearn: 0.3612579\ttotal: 4.23s\tremaining: 5.39s\n",
      "440:\tlearn: 0.3612029\ttotal: 4.24s\tremaining: 5.38s\n",
      "441:\tlearn: 0.3611291\ttotal: 4.26s\tremaining: 5.37s\n",
      "442:\tlearn: 0.3610532\ttotal: 4.29s\tremaining: 5.39s\n",
      "443:\tlearn: 0.3609728\ttotal: 4.3s\tremaining: 5.38s\n",
      "444:\tlearn: 0.3609047\ttotal: 4.3s\tremaining: 5.37s\n",
      "445:\tlearn: 0.3608255\ttotal: 4.31s\tremaining: 5.36s\n",
      "446:\tlearn: 0.3607498\ttotal: 4.32s\tremaining: 5.34s\n",
      "447:\tlearn: 0.3606507\ttotal: 4.33s\tremaining: 5.33s\n",
      "448:\tlearn: 0.3605473\ttotal: 4.34s\tremaining: 5.32s\n",
      "449:\tlearn: 0.3604991\ttotal: 4.34s\tremaining: 5.31s\n",
      "450:\tlearn: 0.3604435\ttotal: 4.35s\tremaining: 5.29s\n",
      "451:\tlearn: 0.3603787\ttotal: 4.37s\tremaining: 5.29s\n",
      "452:\tlearn: 0.3602846\ttotal: 4.38s\tremaining: 5.28s\n",
      "453:\tlearn: 0.3602074\ttotal: 4.38s\tremaining: 5.27s\n",
      "454:\tlearn: 0.3601197\ttotal: 4.4s\tremaining: 5.27s\n",
      "455:\tlearn: 0.3599414\ttotal: 4.4s\tremaining: 5.25s\n",
      "456:\tlearn: 0.3598789\ttotal: 4.41s\tremaining: 5.24s\n",
      "457:\tlearn: 0.3598479\ttotal: 4.42s\tremaining: 5.23s\n",
      "458:\tlearn: 0.3597956\ttotal: 4.42s\tremaining: 5.22s\n",
      "459:\tlearn: 0.3597138\ttotal: 4.43s\tremaining: 5.2s\n",
      "460:\tlearn: 0.3596224\ttotal: 4.44s\tremaining: 5.19s\n",
      "461:\tlearn: 0.3595525\ttotal: 4.46s\tremaining: 5.19s\n",
      "462:\tlearn: 0.3595107\ttotal: 4.46s\tremaining: 5.18s\n",
      "463:\tlearn: 0.3594240\ttotal: 4.47s\tremaining: 5.17s\n",
      "464:\tlearn: 0.3593742\ttotal: 4.48s\tremaining: 5.15s\n",
      "465:\tlearn: 0.3593184\ttotal: 4.49s\tremaining: 5.14s\n",
      "466:\tlearn: 0.3592348\ttotal: 4.49s\tremaining: 5.13s\n",
      "467:\tlearn: 0.3591534\ttotal: 4.5s\tremaining: 5.12s\n",
      "468:\tlearn: 0.3590617\ttotal: 4.52s\tremaining: 5.11s\n",
      "469:\tlearn: 0.3590063\ttotal: 4.52s\tremaining: 5.1s\n",
      "470:\tlearn: 0.3589318\ttotal: 4.53s\tremaining: 5.09s\n",
      "471:\tlearn: 0.3588654\ttotal: 4.55s\tremaining: 5.09s\n",
      "472:\tlearn: 0.3587990\ttotal: 4.56s\tremaining: 5.08s\n",
      "473:\tlearn: 0.3587046\ttotal: 4.57s\tremaining: 5.07s\n",
      "474:\tlearn: 0.3586296\ttotal: 4.57s\tremaining: 5.05s\n",
      "475:\tlearn: 0.3585613\ttotal: 4.58s\tremaining: 5.04s\n",
      "476:\tlearn: 0.3584758\ttotal: 4.59s\tremaining: 5.03s\n",
      "477:\tlearn: 0.3584127\ttotal: 4.59s\tremaining: 5.02s\n",
      "478:\tlearn: 0.3583579\ttotal: 4.6s\tremaining: 5s\n",
      "479:\tlearn: 0.3582903\ttotal: 4.61s\tremaining: 4.99s\n",
      "480:\tlearn: 0.3582095\ttotal: 4.62s\tremaining: 4.98s\n",
      "481:\tlearn: 0.3581834\ttotal: 4.62s\tremaining: 4.97s\n",
      "482:\tlearn: 0.3581130\ttotal: 4.65s\tremaining: 4.98s\n",
      "483:\tlearn: 0.3580461\ttotal: 4.66s\tremaining: 4.97s\n",
      "484:\tlearn: 0.3579757\ttotal: 4.67s\tremaining: 4.96s\n",
      "485:\tlearn: 0.3579405\ttotal: 4.68s\tremaining: 4.95s\n",
      "486:\tlearn: 0.3578662\ttotal: 4.68s\tremaining: 4.94s\n",
      "487:\tlearn: 0.3578052\ttotal: 4.69s\tremaining: 4.92s\n",
      "488:\tlearn: 0.3577311\ttotal: 4.7s\tremaining: 4.91s\n",
      "489:\tlearn: 0.3577068\ttotal: 4.71s\tremaining: 4.9s\n",
      "490:\tlearn: 0.3576503\ttotal: 4.71s\tremaining: 4.89s\n",
      "491:\tlearn: 0.3575734\ttotal: 4.73s\tremaining: 4.89s\n",
      "492:\tlearn: 0.3575028\ttotal: 4.74s\tremaining: 4.88s\n",
      "493:\tlearn: 0.3574296\ttotal: 4.76s\tremaining: 4.87s\n",
      "494:\tlearn: 0.3573641\ttotal: 4.76s\tremaining: 4.86s\n",
      "495:\tlearn: 0.3572961\ttotal: 4.77s\tremaining: 4.85s\n",
      "496:\tlearn: 0.3572255\ttotal: 4.78s\tremaining: 4.84s\n",
      "497:\tlearn: 0.3571396\ttotal: 4.79s\tremaining: 4.83s\n",
      "498:\tlearn: 0.3570509\ttotal: 4.79s\tremaining: 4.81s\n",
      "499:\tlearn: 0.3569843\ttotal: 4.8s\tremaining: 4.8s\n",
      "500:\tlearn: 0.3569054\ttotal: 4.83s\tremaining: 4.81s\n",
      "501:\tlearn: 0.3568132\ttotal: 4.83s\tremaining: 4.8s\n",
      "502:\tlearn: 0.3567658\ttotal: 4.84s\tremaining: 4.79s\n",
      "503:\tlearn: 0.3566845\ttotal: 4.85s\tremaining: 4.77s\n",
      "504:\tlearn: 0.3566242\ttotal: 4.86s\tremaining: 4.76s\n",
      "505:\tlearn: 0.3565660\ttotal: 4.87s\tremaining: 4.75s\n",
      "506:\tlearn: 0.3564922\ttotal: 4.88s\tremaining: 4.75s\n",
      "507:\tlearn: 0.3564053\ttotal: 4.89s\tremaining: 4.74s\n",
      "508:\tlearn: 0.3563671\ttotal: 4.9s\tremaining: 4.72s\n",
      "509:\tlearn: 0.3563034\ttotal: 4.92s\tremaining: 4.72s\n",
      "510:\tlearn: 0.3562227\ttotal: 4.92s\tremaining: 4.71s\n",
      "511:\tlearn: 0.3561191\ttotal: 4.93s\tremaining: 4.7s\n",
      "512:\tlearn: 0.3560595\ttotal: 4.94s\tremaining: 4.69s\n",
      "513:\tlearn: 0.3560280\ttotal: 4.95s\tremaining: 4.67s\n",
      "514:\tlearn: 0.3559457\ttotal: 4.95s\tremaining: 4.66s\n",
      "515:\tlearn: 0.3558650\ttotal: 4.96s\tremaining: 4.65s\n",
      "516:\tlearn: 0.3558192\ttotal: 4.96s\tremaining: 4.64s\n",
      "517:\tlearn: 0.3557312\ttotal: 4.97s\tremaining: 4.63s\n",
      "518:\tlearn: 0.3556798\ttotal: 4.98s\tremaining: 4.62s\n",
      "519:\tlearn: 0.3556203\ttotal: 5.01s\tremaining: 4.62s\n",
      "520:\tlearn: 0.3555509\ttotal: 5.02s\tremaining: 4.61s\n",
      "521:\tlearn: 0.3554436\ttotal: 5.03s\tremaining: 4.6s\n",
      "522:\tlearn: 0.3553655\ttotal: 5.03s\tremaining: 4.59s\n",
      "523:\tlearn: 0.3552696\ttotal: 5.04s\tremaining: 4.58s\n",
      "524:\tlearn: 0.3551762\ttotal: 5.05s\tremaining: 4.57s\n",
      "525:\tlearn: 0.3550984\ttotal: 5.06s\tremaining: 4.56s\n",
      "526:\tlearn: 0.3550017\ttotal: 5.06s\tremaining: 4.54s\n",
      "527:\tlearn: 0.3549138\ttotal: 5.07s\tremaining: 4.54s\n",
      "528:\tlearn: 0.3548760\ttotal: 5.11s\tremaining: 4.55s\n",
      "529:\tlearn: 0.3548430\ttotal: 5.12s\tremaining: 4.54s\n",
      "530:\tlearn: 0.3548017\ttotal: 5.13s\tremaining: 4.53s\n",
      "531:\tlearn: 0.3547049\ttotal: 5.14s\tremaining: 4.52s\n",
      "532:\tlearn: 0.3546617\ttotal: 5.15s\tremaining: 4.51s\n",
      "533:\tlearn: 0.3545985\ttotal: 5.16s\tremaining: 4.5s\n",
      "534:\tlearn: 0.3545365\ttotal: 5.16s\tremaining: 4.49s\n",
      "535:\tlearn: 0.3544510\ttotal: 5.17s\tremaining: 4.48s\n",
      "536:\tlearn: 0.3543799\ttotal: 5.19s\tremaining: 4.47s\n",
      "537:\tlearn: 0.3542962\ttotal: 5.2s\tremaining: 4.46s\n",
      "538:\tlearn: 0.3542308\ttotal: 5.2s\tremaining: 4.45s\n",
      "539:\tlearn: 0.3541722\ttotal: 5.21s\tremaining: 4.44s\n",
      "540:\tlearn: 0.3540949\ttotal: 5.22s\tremaining: 4.43s\n",
      "541:\tlearn: 0.3540163\ttotal: 5.23s\tremaining: 4.42s\n",
      "542:\tlearn: 0.3539712\ttotal: 5.24s\tremaining: 4.41s\n",
      "543:\tlearn: 0.3538874\ttotal: 5.25s\tremaining: 4.4s\n",
      "544:\tlearn: 0.3538210\ttotal: 5.25s\tremaining: 4.39s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "545:\tlearn: 0.3537661\ttotal: 5.26s\tremaining: 4.38s\n",
      "546:\tlearn: 0.3537399\ttotal: 5.28s\tremaining: 4.37s\n",
      "547:\tlearn: 0.3536429\ttotal: 5.29s\tremaining: 4.36s\n",
      "548:\tlearn: 0.3535551\ttotal: 5.3s\tremaining: 4.35s\n",
      "549:\tlearn: 0.3534859\ttotal: 5.3s\tremaining: 4.34s\n",
      "550:\tlearn: 0.3534324\ttotal: 5.31s\tremaining: 4.33s\n",
      "551:\tlearn: 0.3533856\ttotal: 5.32s\tremaining: 4.32s\n",
      "552:\tlearn: 0.3532665\ttotal: 5.33s\tremaining: 4.3s\n",
      "553:\tlearn: 0.3532049\ttotal: 5.33s\tremaining: 4.29s\n",
      "554:\tlearn: 0.3531449\ttotal: 5.34s\tremaining: 4.28s\n",
      "555:\tlearn: 0.3531088\ttotal: 5.36s\tremaining: 4.28s\n",
      "556:\tlearn: 0.3530193\ttotal: 5.37s\tremaining: 4.27s\n",
      "557:\tlearn: 0.3529692\ttotal: 5.38s\tremaining: 4.26s\n",
      "558:\tlearn: 0.3529147\ttotal: 5.39s\tremaining: 4.25s\n",
      "559:\tlearn: 0.3528547\ttotal: 5.4s\tremaining: 4.24s\n",
      "560:\tlearn: 0.3527798\ttotal: 5.4s\tremaining: 4.23s\n",
      "561:\tlearn: 0.3526802\ttotal: 5.41s\tremaining: 4.22s\n",
      "562:\tlearn: 0.3526154\ttotal: 5.42s\tremaining: 4.21s\n",
      "563:\tlearn: 0.3525674\ttotal: 5.42s\tremaining: 4.19s\n",
      "564:\tlearn: 0.3525211\ttotal: 5.43s\tremaining: 4.18s\n",
      "565:\tlearn: 0.3524756\ttotal: 5.44s\tremaining: 4.17s\n",
      "566:\tlearn: 0.3524109\ttotal: 5.46s\tremaining: 4.17s\n",
      "567:\tlearn: 0.3523428\ttotal: 5.47s\tremaining: 4.16s\n",
      "568:\tlearn: 0.3522845\ttotal: 5.48s\tremaining: 4.15s\n",
      "569:\tlearn: 0.3522283\ttotal: 5.49s\tremaining: 4.14s\n",
      "570:\tlearn: 0.3521611\ttotal: 5.5s\tremaining: 4.13s\n",
      "571:\tlearn: 0.3520761\ttotal: 5.5s\tremaining: 4.12s\n",
      "572:\tlearn: 0.3520373\ttotal: 5.51s\tremaining: 4.11s\n",
      "573:\tlearn: 0.3519592\ttotal: 5.52s\tremaining: 4.09s\n",
      "574:\tlearn: 0.3518566\ttotal: 5.52s\tremaining: 4.08s\n",
      "575:\tlearn: 0.3517572\ttotal: 5.53s\tremaining: 4.07s\n",
      "576:\tlearn: 0.3517374\ttotal: 5.55s\tremaining: 4.07s\n",
      "577:\tlearn: 0.3516788\ttotal: 5.56s\tremaining: 4.06s\n",
      "578:\tlearn: 0.3516350\ttotal: 5.56s\tremaining: 4.04s\n",
      "579:\tlearn: 0.3515711\ttotal: 5.57s\tremaining: 4.03s\n",
      "580:\tlearn: 0.3515131\ttotal: 5.58s\tremaining: 4.02s\n",
      "581:\tlearn: 0.3514458\ttotal: 5.59s\tremaining: 4.01s\n",
      "582:\tlearn: 0.3513781\ttotal: 5.6s\tremaining: 4.01s\n",
      "583:\tlearn: 0.3513156\ttotal: 5.61s\tremaining: 4s\n",
      "584:\tlearn: 0.3512498\ttotal: 5.62s\tremaining: 3.98s\n",
      "585:\tlearn: 0.3511801\ttotal: 5.63s\tremaining: 3.98s\n",
      "586:\tlearn: 0.3511324\ttotal: 5.64s\tremaining: 3.97s\n",
      "587:\tlearn: 0.3511077\ttotal: 5.65s\tremaining: 3.96s\n",
      "588:\tlearn: 0.3510478\ttotal: 5.66s\tremaining: 3.95s\n",
      "589:\tlearn: 0.3510024\ttotal: 5.66s\tremaining: 3.94s\n",
      "590:\tlearn: 0.3509623\ttotal: 5.67s\tremaining: 3.92s\n",
      "591:\tlearn: 0.3508640\ttotal: 5.68s\tremaining: 3.91s\n",
      "592:\tlearn: 0.3507825\ttotal: 5.68s\tremaining: 3.9s\n",
      "593:\tlearn: 0.3507081\ttotal: 5.69s\tremaining: 3.89s\n",
      "594:\tlearn: 0.3506404\ttotal: 5.7s\tremaining: 3.88s\n",
      "595:\tlearn: 0.3505837\ttotal: 5.72s\tremaining: 3.88s\n",
      "596:\tlearn: 0.3505520\ttotal: 5.73s\tremaining: 3.87s\n",
      "597:\tlearn: 0.3504840\ttotal: 5.74s\tremaining: 3.86s\n",
      "598:\tlearn: 0.3504311\ttotal: 5.75s\tremaining: 3.85s\n",
      "599:\tlearn: 0.3503109\ttotal: 5.75s\tremaining: 3.84s\n",
      "600:\tlearn: 0.3502724\ttotal: 5.76s\tremaining: 3.83s\n",
      "601:\tlearn: 0.3502136\ttotal: 5.77s\tremaining: 3.81s\n",
      "602:\tlearn: 0.3501586\ttotal: 5.78s\tremaining: 3.8s\n",
      "603:\tlearn: 0.3500889\ttotal: 5.78s\tremaining: 3.79s\n",
      "604:\tlearn: 0.3499939\ttotal: 5.79s\tremaining: 3.78s\n",
      "605:\tlearn: 0.3499575\ttotal: 5.8s\tremaining: 3.77s\n",
      "606:\tlearn: 0.3498870\ttotal: 5.8s\tremaining: 3.76s\n",
      "607:\tlearn: 0.3498355\ttotal: 5.82s\tremaining: 3.75s\n",
      "608:\tlearn: 0.3497919\ttotal: 5.83s\tremaining: 3.75s\n",
      "609:\tlearn: 0.3497105\ttotal: 5.84s\tremaining: 3.73s\n",
      "610:\tlearn: 0.3496329\ttotal: 5.85s\tremaining: 3.72s\n",
      "611:\tlearn: 0.3495384\ttotal: 5.86s\tremaining: 3.71s\n",
      "612:\tlearn: 0.3493952\ttotal: 5.86s\tremaining: 3.7s\n",
      "613:\tlearn: 0.3493214\ttotal: 5.87s\tremaining: 3.69s\n",
      "614:\tlearn: 0.3492482\ttotal: 5.88s\tremaining: 3.68s\n",
      "615:\tlearn: 0.3491740\ttotal: 5.89s\tremaining: 3.67s\n",
      "616:\tlearn: 0.3490930\ttotal: 5.9s\tremaining: 3.66s\n",
      "617:\tlearn: 0.3490125\ttotal: 5.91s\tremaining: 3.65s\n",
      "618:\tlearn: 0.3489435\ttotal: 5.92s\tremaining: 3.64s\n",
      "619:\tlearn: 0.3488661\ttotal: 5.92s\tremaining: 3.63s\n",
      "620:\tlearn: 0.3487835\ttotal: 5.93s\tremaining: 3.62s\n",
      "621:\tlearn: 0.3487026\ttotal: 5.95s\tremaining: 3.62s\n",
      "622:\tlearn: 0.3486479\ttotal: 5.96s\tremaining: 3.6s\n",
      "623:\tlearn: 0.3486056\ttotal: 5.96s\tremaining: 3.59s\n",
      "624:\tlearn: 0.3485193\ttotal: 5.97s\tremaining: 3.58s\n",
      "625:\tlearn: 0.3484172\ttotal: 5.99s\tremaining: 3.58s\n",
      "626:\tlearn: 0.3483551\ttotal: 6s\tremaining: 3.57s\n",
      "627:\tlearn: 0.3482929\ttotal: 6.01s\tremaining: 3.56s\n",
      "628:\tlearn: 0.3481976\ttotal: 6.03s\tremaining: 3.55s\n",
      "629:\tlearn: 0.3481418\ttotal: 6.03s\tremaining: 3.54s\n",
      "630:\tlearn: 0.3480732\ttotal: 6.04s\tremaining: 3.53s\n",
      "631:\tlearn: 0.3479924\ttotal: 6.05s\tremaining: 3.52s\n",
      "632:\tlearn: 0.3479197\ttotal: 6.06s\tremaining: 3.51s\n",
      "633:\tlearn: 0.3478596\ttotal: 6.07s\tremaining: 3.5s\n",
      "634:\tlearn: 0.3478058\ttotal: 6.09s\tremaining: 3.5s\n",
      "635:\tlearn: 0.3477220\ttotal: 6.1s\tremaining: 3.49s\n",
      "636:\tlearn: 0.3476346\ttotal: 6.11s\tremaining: 3.48s\n",
      "637:\tlearn: 0.3475319\ttotal: 6.12s\tremaining: 3.47s\n",
      "638:\tlearn: 0.3474624\ttotal: 6.12s\tremaining: 3.46s\n",
      "639:\tlearn: 0.3473651\ttotal: 6.13s\tremaining: 3.45s\n",
      "640:\tlearn: 0.3472914\ttotal: 6.14s\tremaining: 3.44s\n",
      "641:\tlearn: 0.3472151\ttotal: 6.14s\tremaining: 3.43s\n",
      "642:\tlearn: 0.3471463\ttotal: 6.15s\tremaining: 3.42s\n",
      "643:\tlearn: 0.3470977\ttotal: 6.16s\tremaining: 3.4s\n",
      "644:\tlearn: 0.3470551\ttotal: 6.17s\tremaining: 3.4s\n",
      "645:\tlearn: 0.3469910\ttotal: 6.19s\tremaining: 3.39s\n",
      "646:\tlearn: 0.3469392\ttotal: 6.2s\tremaining: 3.38s\n",
      "647:\tlearn: 0.3468960\ttotal: 6.2s\tremaining: 3.37s\n",
      "648:\tlearn: 0.3468392\ttotal: 6.21s\tremaining: 3.36s\n",
      "649:\tlearn: 0.3467681\ttotal: 6.22s\tremaining: 3.35s\n",
      "650:\tlearn: 0.3467230\ttotal: 6.23s\tremaining: 3.34s\n",
      "651:\tlearn: 0.3466719\ttotal: 6.23s\tremaining: 3.33s\n",
      "652:\tlearn: 0.3466023\ttotal: 6.24s\tremaining: 3.31s\n",
      "653:\tlearn: 0.3465572\ttotal: 6.25s\tremaining: 3.31s\n",
      "654:\tlearn: 0.3464750\ttotal: 6.25s\tremaining: 3.29s\n",
      "655:\tlearn: 0.3463721\ttotal: 6.27s\tremaining: 3.29s\n",
      "656:\tlearn: 0.3463288\ttotal: 6.28s\tremaining: 3.28s\n",
      "657:\tlearn: 0.3462578\ttotal: 6.29s\tremaining: 3.27s\n",
      "658:\tlearn: 0.3461921\ttotal: 6.29s\tremaining: 3.26s\n",
      "659:\tlearn: 0.3461633\ttotal: 6.31s\tremaining: 3.25s\n",
      "660:\tlearn: 0.3461122\ttotal: 6.32s\tremaining: 3.24s\n",
      "661:\tlearn: 0.3460426\ttotal: 6.32s\tremaining: 3.23s\n",
      "662:\tlearn: 0.3460061\ttotal: 6.33s\tremaining: 3.22s\n",
      "663:\tlearn: 0.3459628\ttotal: 6.34s\tremaining: 3.21s\n",
      "664:\tlearn: 0.3459031\ttotal: 6.35s\tremaining: 3.2s\n",
      "665:\tlearn: 0.3458552\ttotal: 6.37s\tremaining: 3.19s\n",
      "666:\tlearn: 0.3457709\ttotal: 6.38s\tremaining: 3.18s\n",
      "667:\tlearn: 0.3456812\ttotal: 6.38s\tremaining: 3.17s\n",
      "668:\tlearn: 0.3456114\ttotal: 6.39s\tremaining: 3.16s\n",
      "669:\tlearn: 0.3455452\ttotal: 6.4s\tremaining: 3.15s\n",
      "670:\tlearn: 0.3454782\ttotal: 6.41s\tremaining: 3.14s\n",
      "671:\tlearn: 0.3454160\ttotal: 6.41s\tremaining: 3.13s\n",
      "672:\tlearn: 0.3453424\ttotal: 6.43s\tremaining: 3.12s\n",
      "673:\tlearn: 0.3452995\ttotal: 6.44s\tremaining: 3.11s\n",
      "674:\tlearn: 0.3452481\ttotal: 6.45s\tremaining: 3.11s\n",
      "675:\tlearn: 0.3452073\ttotal: 6.46s\tremaining: 3.1s\n",
      "676:\tlearn: 0.3451319\ttotal: 6.47s\tremaining: 3.09s\n",
      "677:\tlearn: 0.3450838\ttotal: 6.48s\tremaining: 3.08s\n",
      "678:\tlearn: 0.3450196\ttotal: 6.48s\tremaining: 3.06s\n",
      "679:\tlearn: 0.3449805\ttotal: 6.49s\tremaining: 3.06s\n",
      "680:\tlearn: 0.3449103\ttotal: 6.5s\tremaining: 3.04s\n",
      "681:\tlearn: 0.3448579\ttotal: 6.51s\tremaining: 3.03s\n",
      "682:\tlearn: 0.3447970\ttotal: 6.51s\tremaining: 3.02s\n",
      "683:\tlearn: 0.3447246\ttotal: 6.52s\tremaining: 3.01s\n",
      "684:\tlearn: 0.3446655\ttotal: 6.54s\tremaining: 3.01s\n",
      "685:\tlearn: 0.3445978\ttotal: 6.55s\tremaining: 3s\n",
      "686:\tlearn: 0.3445191\ttotal: 6.56s\tremaining: 2.99s\n",
      "687:\tlearn: 0.3444467\ttotal: 6.57s\tremaining: 2.98s\n",
      "688:\tlearn: 0.3443993\ttotal: 6.58s\tremaining: 2.97s\n",
      "689:\tlearn: 0.3443246\ttotal: 6.58s\tremaining: 2.96s\n",
      "690:\tlearn: 0.3442405\ttotal: 6.59s\tremaining: 2.95s\n",
      "691:\tlearn: 0.3442043\ttotal: 6.6s\tremaining: 2.94s\n",
      "692:\tlearn: 0.3441491\ttotal: 6.61s\tremaining: 2.93s\n",
      "693:\tlearn: 0.3440965\ttotal: 6.61s\tremaining: 2.92s\n",
      "694:\tlearn: 0.3440065\ttotal: 6.63s\tremaining: 2.91s\n",
      "695:\tlearn: 0.3439412\ttotal: 6.64s\tremaining: 2.9s\n",
      "696:\tlearn: 0.3438753\ttotal: 6.64s\tremaining: 2.89s\n",
      "697:\tlearn: 0.3438277\ttotal: 6.65s\tremaining: 2.88s\n",
      "698:\tlearn: 0.3437570\ttotal: 6.67s\tremaining: 2.87s\n",
      "699:\tlearn: 0.3436945\ttotal: 6.67s\tremaining: 2.86s\n",
      "700:\tlearn: 0.3436154\ttotal: 6.68s\tremaining: 2.85s\n",
      "701:\tlearn: 0.3435623\ttotal: 6.69s\tremaining: 2.84s\n",
      "702:\tlearn: 0.3434988\ttotal: 6.7s\tremaining: 2.83s\n",
      "703:\tlearn: 0.3434184\ttotal: 6.71s\tremaining: 2.82s\n",
      "704:\tlearn: 0.3433949\ttotal: 6.71s\tremaining: 2.81s\n",
      "705:\tlearn: 0.3433599\ttotal: 6.72s\tremaining: 2.8s\n",
      "706:\tlearn: 0.3432830\ttotal: 6.73s\tremaining: 2.79s\n",
      "707:\tlearn: 0.3432023\ttotal: 6.74s\tremaining: 2.78s\n",
      "708:\tlearn: 0.3431375\ttotal: 6.74s\tremaining: 2.77s\n",
      "709:\tlearn: 0.3430837\ttotal: 6.75s\tremaining: 2.76s\n",
      "710:\tlearn: 0.3430142\ttotal: 6.76s\tremaining: 2.75s\n",
      "711:\tlearn: 0.3429548\ttotal: 6.76s\tremaining: 2.74s\n",
      "712:\tlearn: 0.3428788\ttotal: 6.77s\tremaining: 2.73s\n",
      "713:\tlearn: 0.3428056\ttotal: 6.79s\tremaining: 2.72s\n",
      "714:\tlearn: 0.3427283\ttotal: 6.79s\tremaining: 2.71s\n",
      "715:\tlearn: 0.3426732\ttotal: 6.81s\tremaining: 2.7s\n",
      "716:\tlearn: 0.3426093\ttotal: 6.82s\tremaining: 2.69s\n",
      "717:\tlearn: 0.3425606\ttotal: 6.83s\tremaining: 2.68s\n",
      "718:\tlearn: 0.3425176\ttotal: 6.83s\tremaining: 2.67s\n",
      "719:\tlearn: 0.3424815\ttotal: 6.84s\tremaining: 2.66s\n",
      "720:\tlearn: 0.3424339\ttotal: 6.85s\tremaining: 2.65s\n",
      "721:\tlearn: 0.3423800\ttotal: 6.86s\tremaining: 2.64s\n",
      "722:\tlearn: 0.3423029\ttotal: 6.86s\tremaining: 2.63s\n",
      "723:\tlearn: 0.3422460\ttotal: 6.87s\tremaining: 2.62s\n",
      "724:\tlearn: 0.3421790\ttotal: 6.88s\tremaining: 2.61s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "725:\tlearn: 0.3420935\ttotal: 6.88s\tremaining: 2.6s\n",
      "726:\tlearn: 0.3420123\ttotal: 6.91s\tremaining: 2.6s\n",
      "727:\tlearn: 0.3419320\ttotal: 6.92s\tremaining: 2.59s\n",
      "728:\tlearn: 0.3418665\ttotal: 6.93s\tremaining: 2.58s\n",
      "729:\tlearn: 0.3418179\ttotal: 6.94s\tremaining: 2.57s\n",
      "730:\tlearn: 0.3417546\ttotal: 6.95s\tremaining: 2.56s\n",
      "731:\tlearn: 0.3416918\ttotal: 6.96s\tremaining: 2.55s\n",
      "732:\tlearn: 0.3416534\ttotal: 6.96s\tremaining: 2.54s\n",
      "733:\tlearn: 0.3415729\ttotal: 6.97s\tremaining: 2.53s\n",
      "734:\tlearn: 0.3415442\ttotal: 6.98s\tremaining: 2.52s\n",
      "735:\tlearn: 0.3414913\ttotal: 6.99s\tremaining: 2.51s\n",
      "736:\tlearn: 0.3414234\ttotal: 7s\tremaining: 2.5s\n",
      "737:\tlearn: 0.3413584\ttotal: 7.01s\tremaining: 2.49s\n",
      "738:\tlearn: 0.3412965\ttotal: 7.02s\tremaining: 2.48s\n",
      "739:\tlearn: 0.3412415\ttotal: 7.03s\tremaining: 2.47s\n",
      "740:\tlearn: 0.3411974\ttotal: 7.04s\tremaining: 2.46s\n",
      "741:\tlearn: 0.3411347\ttotal: 7.05s\tremaining: 2.45s\n",
      "742:\tlearn: 0.3410588\ttotal: 7.05s\tremaining: 2.44s\n",
      "743:\tlearn: 0.3409752\ttotal: 7.06s\tremaining: 2.43s\n",
      "744:\tlearn: 0.3408827\ttotal: 7.07s\tremaining: 2.42s\n",
      "745:\tlearn: 0.3408183\ttotal: 7.09s\tremaining: 2.41s\n",
      "746:\tlearn: 0.3407789\ttotal: 7.09s\tremaining: 2.4s\n",
      "747:\tlearn: 0.3407213\ttotal: 7.1s\tremaining: 2.39s\n",
      "748:\tlearn: 0.3406849\ttotal: 7.11s\tremaining: 2.38s\n",
      "749:\tlearn: 0.3406165\ttotal: 7.12s\tremaining: 2.37s\n",
      "750:\tlearn: 0.3405473\ttotal: 7.13s\tremaining: 2.36s\n",
      "751:\tlearn: 0.3404565\ttotal: 7.14s\tremaining: 2.35s\n",
      "752:\tlearn: 0.3404215\ttotal: 7.15s\tremaining: 2.35s\n",
      "753:\tlearn: 0.3403717\ttotal: 7.16s\tremaining: 2.33s\n",
      "754:\tlearn: 0.3402509\ttotal: 7.17s\tremaining: 2.33s\n",
      "755:\tlearn: 0.3401517\ttotal: 7.17s\tremaining: 2.31s\n",
      "756:\tlearn: 0.3401013\ttotal: 7.18s\tremaining: 2.31s\n",
      "757:\tlearn: 0.3400332\ttotal: 7.19s\tremaining: 2.29s\n",
      "758:\tlearn: 0.3399428\ttotal: 7.2s\tremaining: 2.28s\n",
      "759:\tlearn: 0.3398796\ttotal: 7.2s\tremaining: 2.27s\n",
      "760:\tlearn: 0.3398141\ttotal: 7.21s\tremaining: 2.26s\n",
      "761:\tlearn: 0.3397454\ttotal: 7.22s\tremaining: 2.25s\n",
      "762:\tlearn: 0.3396485\ttotal: 7.22s\tremaining: 2.24s\n",
      "763:\tlearn: 0.3395746\ttotal: 7.23s\tremaining: 2.23s\n",
      "764:\tlearn: 0.3395182\ttotal: 7.24s\tremaining: 2.22s\n",
      "765:\tlearn: 0.3394289\ttotal: 7.25s\tremaining: 2.21s\n",
      "766:\tlearn: 0.3393653\ttotal: 7.27s\tremaining: 2.21s\n",
      "767:\tlearn: 0.3393111\ttotal: 7.28s\tremaining: 2.2s\n",
      "768:\tlearn: 0.3392270\ttotal: 7.29s\tremaining: 2.19s\n",
      "769:\tlearn: 0.3391241\ttotal: 7.3s\tremaining: 2.18s\n",
      "770:\tlearn: 0.3390374\ttotal: 7.3s\tremaining: 2.17s\n",
      "771:\tlearn: 0.3389812\ttotal: 7.31s\tremaining: 2.16s\n",
      "772:\tlearn: 0.3388629\ttotal: 7.32s\tremaining: 2.15s\n",
      "773:\tlearn: 0.3387868\ttotal: 7.33s\tremaining: 2.14s\n",
      "774:\tlearn: 0.3387513\ttotal: 7.33s\tremaining: 2.13s\n",
      "775:\tlearn: 0.3387041\ttotal: 7.34s\tremaining: 2.12s\n",
      "776:\tlearn: 0.3386503\ttotal: 7.36s\tremaining: 2.11s\n",
      "777:\tlearn: 0.3385984\ttotal: 7.37s\tremaining: 2.1s\n",
      "778:\tlearn: 0.3385216\ttotal: 7.38s\tremaining: 2.09s\n",
      "779:\tlearn: 0.3384598\ttotal: 7.39s\tremaining: 2.08s\n",
      "780:\tlearn: 0.3383963\ttotal: 7.4s\tremaining: 2.07s\n",
      "781:\tlearn: 0.3383437\ttotal: 7.41s\tremaining: 2.06s\n",
      "782:\tlearn: 0.3382816\ttotal: 7.41s\tremaining: 2.05s\n",
      "783:\tlearn: 0.3382568\ttotal: 7.42s\tremaining: 2.04s\n",
      "784:\tlearn: 0.3381899\ttotal: 7.43s\tremaining: 2.03s\n",
      "785:\tlearn: 0.3381344\ttotal: 7.45s\tremaining: 2.03s\n",
      "786:\tlearn: 0.3380873\ttotal: 7.45s\tremaining: 2.02s\n",
      "787:\tlearn: 0.3380395\ttotal: 7.46s\tremaining: 2.01s\n",
      "788:\tlearn: 0.3379790\ttotal: 7.47s\tremaining: 2s\n",
      "789:\tlearn: 0.3379045\ttotal: 7.48s\tremaining: 1.99s\n",
      "790:\tlearn: 0.3378536\ttotal: 7.48s\tremaining: 1.98s\n",
      "791:\tlearn: 0.3377842\ttotal: 7.49s\tremaining: 1.97s\n",
      "792:\tlearn: 0.3377279\ttotal: 7.5s\tremaining: 1.96s\n",
      "793:\tlearn: 0.3376593\ttotal: 7.51s\tremaining: 1.95s\n",
      "794:\tlearn: 0.3375752\ttotal: 7.52s\tremaining: 1.94s\n",
      "795:\tlearn: 0.3375246\ttotal: 7.54s\tremaining: 1.93s\n",
      "796:\tlearn: 0.3374527\ttotal: 7.55s\tremaining: 1.92s\n",
      "797:\tlearn: 0.3373697\ttotal: 7.56s\tremaining: 1.91s\n",
      "798:\tlearn: 0.3373121\ttotal: 7.56s\tremaining: 1.9s\n",
      "799:\tlearn: 0.3372769\ttotal: 7.57s\tremaining: 1.89s\n",
      "800:\tlearn: 0.3372261\ttotal: 7.58s\tremaining: 1.88s\n",
      "801:\tlearn: 0.3371646\ttotal: 7.58s\tremaining: 1.87s\n",
      "802:\tlearn: 0.3371182\ttotal: 7.59s\tremaining: 1.86s\n",
      "803:\tlearn: 0.3370550\ttotal: 7.6s\tremaining: 1.85s\n",
      "804:\tlearn: 0.3369884\ttotal: 7.61s\tremaining: 1.84s\n",
      "805:\tlearn: 0.3369523\ttotal: 7.62s\tremaining: 1.83s\n",
      "806:\tlearn: 0.3368955\ttotal: 7.63s\tremaining: 1.82s\n",
      "807:\tlearn: 0.3368414\ttotal: 7.64s\tremaining: 1.81s\n",
      "808:\tlearn: 0.3367513\ttotal: 7.65s\tremaining: 1.8s\n",
      "809:\tlearn: 0.3366962\ttotal: 7.66s\tremaining: 1.79s\n",
      "810:\tlearn: 0.3366143\ttotal: 7.66s\tremaining: 1.78s\n",
      "811:\tlearn: 0.3365621\ttotal: 7.67s\tremaining: 1.78s\n",
      "812:\tlearn: 0.3364748\ttotal: 7.68s\tremaining: 1.77s\n",
      "813:\tlearn: 0.3364020\ttotal: 7.69s\tremaining: 1.76s\n",
      "814:\tlearn: 0.3363517\ttotal: 7.69s\tremaining: 1.75s\n",
      "815:\tlearn: 0.3362937\ttotal: 7.7s\tremaining: 1.74s\n",
      "816:\tlearn: 0.3362536\ttotal: 7.72s\tremaining: 1.73s\n",
      "817:\tlearn: 0.3361972\ttotal: 7.73s\tremaining: 1.72s\n",
      "818:\tlearn: 0.3361007\ttotal: 7.74s\tremaining: 1.71s\n",
      "819:\tlearn: 0.3360401\ttotal: 7.75s\tremaining: 1.7s\n",
      "820:\tlearn: 0.3359777\ttotal: 7.76s\tremaining: 1.69s\n",
      "821:\tlearn: 0.3359218\ttotal: 7.77s\tremaining: 1.68s\n",
      "822:\tlearn: 0.3358478\ttotal: 7.77s\tremaining: 1.67s\n",
      "823:\tlearn: 0.3357710\ttotal: 7.78s\tremaining: 1.66s\n",
      "824:\tlearn: 0.3357076\ttotal: 7.79s\tremaining: 1.65s\n",
      "825:\tlearn: 0.3356603\ttotal: 7.8s\tremaining: 1.64s\n",
      "826:\tlearn: 0.3356119\ttotal: 7.81s\tremaining: 1.63s\n",
      "827:\tlearn: 0.3355514\ttotal: 7.82s\tremaining: 1.62s\n",
      "828:\tlearn: 0.3354829\ttotal: 7.83s\tremaining: 1.61s\n",
      "829:\tlearn: 0.3354580\ttotal: 7.83s\tremaining: 1.6s\n",
      "830:\tlearn: 0.3353784\ttotal: 7.84s\tremaining: 1.59s\n",
      "831:\tlearn: 0.3353370\ttotal: 7.85s\tremaining: 1.59s\n",
      "832:\tlearn: 0.3352696\ttotal: 7.87s\tremaining: 1.58s\n",
      "833:\tlearn: 0.3351854\ttotal: 7.88s\tremaining: 1.57s\n",
      "834:\tlearn: 0.3351237\ttotal: 7.88s\tremaining: 1.56s\n",
      "835:\tlearn: 0.3350578\ttotal: 7.9s\tremaining: 1.55s\n",
      "836:\tlearn: 0.3350152\ttotal: 7.91s\tremaining: 1.54s\n",
      "837:\tlearn: 0.3349430\ttotal: 7.92s\tremaining: 1.53s\n",
      "838:\tlearn: 0.3348800\ttotal: 7.93s\tremaining: 1.52s\n",
      "839:\tlearn: 0.3348161\ttotal: 7.94s\tremaining: 1.51s\n",
      "840:\tlearn: 0.3347267\ttotal: 7.94s\tremaining: 1.5s\n",
      "841:\tlearn: 0.3346561\ttotal: 7.95s\tremaining: 1.49s\n",
      "842:\tlearn: 0.3346308\ttotal: 7.96s\tremaining: 1.48s\n",
      "843:\tlearn: 0.3345643\ttotal: 7.97s\tremaining: 1.47s\n",
      "844:\tlearn: 0.3344833\ttotal: 8s\tremaining: 1.47s\n",
      "845:\tlearn: 0.3344370\ttotal: 8s\tremaining: 1.46s\n",
      "846:\tlearn: 0.3343665\ttotal: 8.01s\tremaining: 1.45s\n",
      "847:\tlearn: 0.3343317\ttotal: 8.02s\tremaining: 1.44s\n",
      "848:\tlearn: 0.3342477\ttotal: 8.03s\tremaining: 1.43s\n",
      "849:\tlearn: 0.3341825\ttotal: 8.04s\tremaining: 1.42s\n",
      "850:\tlearn: 0.3341291\ttotal: 8.04s\tremaining: 1.41s\n",
      "851:\tlearn: 0.3341048\ttotal: 8.05s\tremaining: 1.4s\n",
      "852:\tlearn: 0.3340718\ttotal: 8.06s\tremaining: 1.39s\n",
      "853:\tlearn: 0.3339906\ttotal: 8.06s\tremaining: 1.38s\n",
      "854:\tlearn: 0.3339583\ttotal: 8.08s\tremaining: 1.37s\n",
      "855:\tlearn: 0.3339110\ttotal: 8.09s\tremaining: 1.36s\n",
      "856:\tlearn: 0.3338724\ttotal: 8.1s\tremaining: 1.35s\n",
      "857:\tlearn: 0.3338246\ttotal: 8.11s\tremaining: 1.34s\n",
      "858:\tlearn: 0.3337784\ttotal: 8.12s\tremaining: 1.33s\n",
      "859:\tlearn: 0.3336891\ttotal: 8.13s\tremaining: 1.32s\n",
      "860:\tlearn: 0.3336272\ttotal: 8.14s\tremaining: 1.31s\n",
      "861:\tlearn: 0.3335781\ttotal: 8.14s\tremaining: 1.3s\n",
      "862:\tlearn: 0.3335339\ttotal: 8.15s\tremaining: 1.29s\n",
      "863:\tlearn: 0.3334785\ttotal: 8.16s\tremaining: 1.28s\n",
      "864:\tlearn: 0.3334317\ttotal: 8.17s\tremaining: 1.27s\n",
      "865:\tlearn: 0.3333845\ttotal: 8.18s\tremaining: 1.26s\n",
      "866:\tlearn: 0.3333304\ttotal: 8.18s\tremaining: 1.25s\n",
      "867:\tlearn: 0.3332813\ttotal: 8.19s\tremaining: 1.25s\n",
      "868:\tlearn: 0.3332195\ttotal: 8.2s\tremaining: 1.24s\n",
      "869:\tlearn: 0.3331611\ttotal: 8.2s\tremaining: 1.23s\n",
      "870:\tlearn: 0.3330876\ttotal: 8.22s\tremaining: 1.22s\n",
      "871:\tlearn: 0.3330231\ttotal: 8.23s\tremaining: 1.21s\n",
      "872:\tlearn: 0.3329939\ttotal: 8.23s\tremaining: 1.2s\n",
      "873:\tlearn: 0.3329401\ttotal: 8.24s\tremaining: 1.19s\n",
      "874:\tlearn: 0.3329029\ttotal: 8.25s\tremaining: 1.18s\n",
      "875:\tlearn: 0.3328589\ttotal: 8.27s\tremaining: 1.17s\n",
      "876:\tlearn: 0.3327946\ttotal: 8.27s\tremaining: 1.16s\n",
      "877:\tlearn: 0.3327642\ttotal: 8.28s\tremaining: 1.15s\n",
      "878:\tlearn: 0.3327139\ttotal: 8.29s\tremaining: 1.14s\n",
      "879:\tlearn: 0.3326806\ttotal: 8.29s\tremaining: 1.13s\n",
      "880:\tlearn: 0.3326162\ttotal: 8.3s\tremaining: 1.12s\n",
      "881:\tlearn: 0.3325496\ttotal: 8.31s\tremaining: 1.11s\n",
      "882:\tlearn: 0.3324777\ttotal: 8.32s\tremaining: 1.1s\n",
      "883:\tlearn: 0.3324312\ttotal: 8.32s\tremaining: 1.09s\n",
      "884:\tlearn: 0.3324003\ttotal: 8.35s\tremaining: 1.08s\n",
      "885:\tlearn: 0.3323590\ttotal: 8.36s\tremaining: 1.07s\n",
      "886:\tlearn: 0.3323044\ttotal: 8.37s\tremaining: 1.06s\n",
      "887:\tlearn: 0.3322725\ttotal: 8.37s\tremaining: 1.06s\n",
      "888:\tlearn: 0.3322165\ttotal: 8.38s\tremaining: 1.05s\n",
      "889:\tlearn: 0.3321610\ttotal: 8.39s\tremaining: 1.04s\n",
      "890:\tlearn: 0.3321247\ttotal: 8.39s\tremaining: 1.03s\n",
      "891:\tlearn: 0.3320491\ttotal: 8.4s\tremaining: 1.02s\n",
      "892:\tlearn: 0.3320107\ttotal: 8.41s\tremaining: 1.01s\n",
      "893:\tlearn: 0.3319165\ttotal: 8.41s\tremaining: 998ms\n",
      "894:\tlearn: 0.3318613\ttotal: 8.42s\tremaining: 988ms\n",
      "895:\tlearn: 0.3318163\ttotal: 8.43s\tremaining: 979ms\n",
      "896:\tlearn: 0.3317717\ttotal: 8.45s\tremaining: 970ms\n",
      "897:\tlearn: 0.3316932\ttotal: 8.46s\tremaining: 961ms\n",
      "898:\tlearn: 0.3316317\ttotal: 8.47s\tremaining: 951ms\n",
      "899:\tlearn: 0.3315618\ttotal: 8.47s\tremaining: 942ms\n",
      "900:\tlearn: 0.3315207\ttotal: 8.48s\tremaining: 932ms\n",
      "901:\tlearn: 0.3314842\ttotal: 8.49s\tremaining: 922ms\n",
      "902:\tlearn: 0.3314178\ttotal: 8.5s\tremaining: 913ms\n",
      "903:\tlearn: 0.3313778\ttotal: 8.5s\tremaining: 903ms\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "904:\tlearn: 0.3313238\ttotal: 8.51s\tremaining: 894ms\n",
      "905:\tlearn: 0.3312750\ttotal: 8.53s\tremaining: 885ms\n",
      "906:\tlearn: 0.3312218\ttotal: 8.54s\tremaining: 876ms\n",
      "907:\tlearn: 0.3311778\ttotal: 8.54s\tremaining: 866ms\n",
      "908:\tlearn: 0.3311068\ttotal: 8.55s\tremaining: 856ms\n",
      "909:\tlearn: 0.3310665\ttotal: 8.56s\tremaining: 847ms\n",
      "910:\tlearn: 0.3310072\ttotal: 8.57s\tremaining: 837ms\n",
      "911:\tlearn: 0.3309672\ttotal: 8.58s\tremaining: 828ms\n",
      "912:\tlearn: 0.3309080\ttotal: 8.59s\tremaining: 818ms\n",
      "913:\tlearn: 0.3308676\ttotal: 8.6s\tremaining: 809ms\n",
      "914:\tlearn: 0.3308202\ttotal: 8.6s\tremaining: 799ms\n",
      "915:\tlearn: 0.3307760\ttotal: 8.62s\tremaining: 791ms\n",
      "916:\tlearn: 0.3307333\ttotal: 8.63s\tremaining: 781ms\n",
      "917:\tlearn: 0.3306622\ttotal: 8.64s\tremaining: 772ms\n",
      "918:\tlearn: 0.3306124\ttotal: 8.64s\tremaining: 762ms\n",
      "919:\tlearn: 0.3305518\ttotal: 8.65s\tremaining: 752ms\n",
      "920:\tlearn: 0.3304988\ttotal: 8.66s\tremaining: 743ms\n",
      "921:\tlearn: 0.3304238\ttotal: 8.67s\tremaining: 733ms\n",
      "922:\tlearn: 0.3303889\ttotal: 8.68s\tremaining: 724ms\n",
      "923:\tlearn: 0.3303127\ttotal: 8.68s\tremaining: 714ms\n",
      "924:\tlearn: 0.3302719\ttotal: 8.71s\tremaining: 706ms\n",
      "925:\tlearn: 0.3302180\ttotal: 8.72s\tremaining: 697ms\n",
      "926:\tlearn: 0.3301535\ttotal: 8.73s\tremaining: 688ms\n",
      "927:\tlearn: 0.3300824\ttotal: 8.74s\tremaining: 678ms\n",
      "928:\tlearn: 0.3300125\ttotal: 8.75s\tremaining: 669ms\n",
      "929:\tlearn: 0.3299589\ttotal: 8.76s\tremaining: 659ms\n",
      "930:\tlearn: 0.3298804\ttotal: 8.76s\tremaining: 649ms\n",
      "931:\tlearn: 0.3298324\ttotal: 8.77s\tremaining: 640ms\n",
      "932:\tlearn: 0.3297573\ttotal: 8.78s\tremaining: 630ms\n",
      "933:\tlearn: 0.3297214\ttotal: 8.78s\tremaining: 621ms\n",
      "934:\tlearn: 0.3296692\ttotal: 8.8s\tremaining: 612ms\n",
      "935:\tlearn: 0.3296142\ttotal: 8.82s\tremaining: 603ms\n",
      "936:\tlearn: 0.3295388\ttotal: 8.83s\tremaining: 594ms\n",
      "937:\tlearn: 0.3294916\ttotal: 8.84s\tremaining: 584ms\n",
      "938:\tlearn: 0.3294294\ttotal: 8.85s\tremaining: 575ms\n",
      "939:\tlearn: 0.3293853\ttotal: 8.85s\tremaining: 565ms\n",
      "940:\tlearn: 0.3293065\ttotal: 8.86s\tremaining: 556ms\n",
      "941:\tlearn: 0.3292699\ttotal: 8.87s\tremaining: 546ms\n",
      "942:\tlearn: 0.3292494\ttotal: 8.88s\tremaining: 536ms\n",
      "943:\tlearn: 0.3291869\ttotal: 8.89s\tremaining: 527ms\n",
      "944:\tlearn: 0.3291419\ttotal: 8.9s\tremaining: 518ms\n",
      "945:\tlearn: 0.3290855\ttotal: 8.91s\tremaining: 508ms\n",
      "946:\tlearn: 0.3290204\ttotal: 8.91s\tremaining: 499ms\n",
      "947:\tlearn: 0.3289451\ttotal: 8.93s\tremaining: 490ms\n",
      "948:\tlearn: 0.3288827\ttotal: 8.94s\tremaining: 480ms\n",
      "949:\tlearn: 0.3288463\ttotal: 8.95s\tremaining: 471ms\n",
      "950:\tlearn: 0.3288239\ttotal: 8.95s\tremaining: 461ms\n",
      "951:\tlearn: 0.3287784\ttotal: 8.96s\tremaining: 452ms\n",
      "952:\tlearn: 0.3287420\ttotal: 8.97s\tremaining: 442ms\n",
      "953:\tlearn: 0.3286971\ttotal: 8.98s\tremaining: 433ms\n",
      "954:\tlearn: 0.3286338\ttotal: 8.99s\tremaining: 424ms\n",
      "955:\tlearn: 0.3285900\ttotal: 9s\tremaining: 414ms\n",
      "956:\tlearn: 0.3285283\ttotal: 9.01s\tremaining: 405ms\n",
      "957:\tlearn: 0.3284982\ttotal: 9.02s\tremaining: 395ms\n",
      "958:\tlearn: 0.3284535\ttotal: 9.02s\tremaining: 386ms\n",
      "959:\tlearn: 0.3284080\ttotal: 9.03s\tremaining: 376ms\n",
      "960:\tlearn: 0.3283684\ttotal: 9.04s\tremaining: 367ms\n",
      "961:\tlearn: 0.3283089\ttotal: 9.05s\tremaining: 358ms\n",
      "962:\tlearn: 0.3282808\ttotal: 9.07s\tremaining: 349ms\n",
      "963:\tlearn: 0.3282219\ttotal: 9.09s\tremaining: 340ms\n",
      "964:\tlearn: 0.3281726\ttotal: 9.11s\tremaining: 330ms\n",
      "965:\tlearn: 0.3281354\ttotal: 9.12s\tremaining: 321ms\n",
      "966:\tlearn: 0.3280700\ttotal: 9.13s\tremaining: 311ms\n",
      "967:\tlearn: 0.3280406\ttotal: 9.14s\tremaining: 302ms\n",
      "968:\tlearn: 0.3280003\ttotal: 9.15s\tremaining: 293ms\n",
      "969:\tlearn: 0.3279392\ttotal: 9.19s\tremaining: 284ms\n",
      "970:\tlearn: 0.3278781\ttotal: 9.2s\tremaining: 275ms\n",
      "971:\tlearn: 0.3278141\ttotal: 9.21s\tremaining: 265ms\n",
      "972:\tlearn: 0.3277617\ttotal: 9.22s\tremaining: 256ms\n",
      "973:\tlearn: 0.3276905\ttotal: 9.23s\tremaining: 246ms\n",
      "974:\tlearn: 0.3276369\ttotal: 9.24s\tremaining: 237ms\n",
      "975:\tlearn: 0.3276053\ttotal: 9.27s\tremaining: 228ms\n",
      "976:\tlearn: 0.3275443\ttotal: 9.28s\tremaining: 218ms\n",
      "977:\tlearn: 0.3274969\ttotal: 9.3s\tremaining: 209ms\n",
      "978:\tlearn: 0.3274354\ttotal: 9.31s\tremaining: 200ms\n",
      "979:\tlearn: 0.3273850\ttotal: 9.32s\tremaining: 190ms\n",
      "980:\tlearn: 0.3273399\ttotal: 9.33s\tremaining: 181ms\n",
      "981:\tlearn: 0.3272882\ttotal: 9.36s\tremaining: 172ms\n",
      "982:\tlearn: 0.3272277\ttotal: 9.37s\tremaining: 162ms\n",
      "983:\tlearn: 0.3271716\ttotal: 9.38s\tremaining: 153ms\n",
      "984:\tlearn: 0.3271356\ttotal: 9.39s\tremaining: 143ms\n",
      "985:\tlearn: 0.3270682\ttotal: 9.4s\tremaining: 133ms\n",
      "986:\tlearn: 0.3270079\ttotal: 9.42s\tremaining: 124ms\n",
      "987:\tlearn: 0.3269695\ttotal: 9.45s\tremaining: 115ms\n",
      "988:\tlearn: 0.3269183\ttotal: 9.46s\tremaining: 105ms\n",
      "989:\tlearn: 0.3268765\ttotal: 9.47s\tremaining: 95.7ms\n",
      "990:\tlearn: 0.3268477\ttotal: 9.48s\tremaining: 86.1ms\n",
      "991:\tlearn: 0.3268009\ttotal: 9.49s\tremaining: 76.5ms\n",
      "992:\tlearn: 0.3267602\ttotal: 9.5s\tremaining: 67ms\n",
      "993:\tlearn: 0.3267346\ttotal: 9.51s\tremaining: 57.4ms\n",
      "994:\tlearn: 0.3266950\ttotal: 9.51s\tremaining: 47.8ms\n",
      "995:\tlearn: 0.3266538\ttotal: 9.52s\tremaining: 38.2ms\n",
      "996:\tlearn: 0.3266167\ttotal: 9.54s\tremaining: 28.7ms\n",
      "997:\tlearn: 0.3265779\ttotal: 9.55s\tremaining: 19.1ms\n",
      "998:\tlearn: 0.3264961\ttotal: 9.56s\tremaining: 9.57ms\n",
      "999:\tlearn: 0.3264266\ttotal: 9.57s\tremaining: 0us\n",
      "Learning rate set to 0.059278\n",
      "0:\tlearn: 0.6563640\ttotal: 11.5ms\tremaining: 11.5s\n",
      "1:\tlearn: 0.6233741\ttotal: 22.2ms\tremaining: 11.1s\n",
      "2:\tlearn: 0.5948007\ttotal: 33.7ms\tremaining: 11.2s\n",
      "3:\tlearn: 0.5714275\ttotal: 45.8ms\tremaining: 11.4s\n",
      "4:\tlearn: 0.5510496\ttotal: 59.4ms\tremaining: 11.8s\n",
      "5:\tlearn: 0.5337036\ttotal: 76.4ms\tremaining: 12.7s\n",
      "6:\tlearn: 0.5189449\ttotal: 88.7ms\tremaining: 12.6s\n",
      "7:\tlearn: 0.5063119\ttotal: 101ms\tremaining: 12.5s\n",
      "8:\tlearn: 0.4944741\ttotal: 110ms\tremaining: 12.1s\n",
      "9:\tlearn: 0.4842378\ttotal: 118ms\tremaining: 11.7s\n",
      "10:\tlearn: 0.4747616\ttotal: 125ms\tremaining: 11.3s\n",
      "11:\tlearn: 0.4679983\ttotal: 132ms\tremaining: 10.9s\n",
      "12:\tlearn: 0.4617819\ttotal: 139ms\tremaining: 10.6s\n",
      "13:\tlearn: 0.4561531\ttotal: 158ms\tremaining: 11.1s\n",
      "14:\tlearn: 0.4506486\ttotal: 166ms\tremaining: 10.9s\n",
      "15:\tlearn: 0.4463817\ttotal: 173ms\tremaining: 10.7s\n",
      "16:\tlearn: 0.4423852\ttotal: 181ms\tremaining: 10.5s\n",
      "17:\tlearn: 0.4384129\ttotal: 189ms\tremaining: 10.3s\n",
      "18:\tlearn: 0.4351819\ttotal: 198ms\tremaining: 10.2s\n",
      "19:\tlearn: 0.4325687\ttotal: 208ms\tremaining: 10.2s\n",
      "20:\tlearn: 0.4308507\ttotal: 218ms\tremaining: 10.2s\n",
      "21:\tlearn: 0.4279929\ttotal: 228ms\tremaining: 10.1s\n",
      "22:\tlearn: 0.4260347\ttotal: 238ms\tremaining: 10.1s\n",
      "23:\tlearn: 0.4245753\ttotal: 252ms\tremaining: 10.3s\n",
      "24:\tlearn: 0.4228709\ttotal: 261ms\tremaining: 10.2s\n",
      "25:\tlearn: 0.4214084\ttotal: 269ms\tremaining: 10.1s\n",
      "26:\tlearn: 0.4203198\ttotal: 276ms\tremaining: 9.93s\n",
      "27:\tlearn: 0.4195050\ttotal: 283ms\tremaining: 9.82s\n",
      "28:\tlearn: 0.4182681\ttotal: 290ms\tremaining: 9.71s\n",
      "29:\tlearn: 0.4173692\ttotal: 298ms\tremaining: 9.62s\n",
      "30:\tlearn: 0.4164548\ttotal: 305ms\tremaining: 9.52s\n",
      "31:\tlearn: 0.4156929\ttotal: 312ms\tremaining: 9.43s\n",
      "32:\tlearn: 0.4149417\ttotal: 319ms\tremaining: 9.34s\n",
      "33:\tlearn: 0.4141953\ttotal: 347ms\tremaining: 9.87s\n",
      "34:\tlearn: 0.4135424\ttotal: 356ms\tremaining: 9.82s\n",
      "35:\tlearn: 0.4129127\ttotal: 364ms\tremaining: 9.75s\n",
      "36:\tlearn: 0.4122435\ttotal: 372ms\tremaining: 9.68s\n",
      "37:\tlearn: 0.4117354\ttotal: 379ms\tremaining: 9.6s\n",
      "38:\tlearn: 0.4112374\ttotal: 386ms\tremaining: 9.52s\n",
      "39:\tlearn: 0.4107560\ttotal: 394ms\tremaining: 9.45s\n",
      "40:\tlearn: 0.4103689\ttotal: 402ms\tremaining: 9.4s\n",
      "41:\tlearn: 0.4099664\ttotal: 410ms\tremaining: 9.36s\n",
      "42:\tlearn: 0.4094310\ttotal: 427ms\tremaining: 9.51s\n",
      "43:\tlearn: 0.4089850\ttotal: 436ms\tremaining: 9.47s\n",
      "44:\tlearn: 0.4085005\ttotal: 447ms\tremaining: 9.48s\n",
      "45:\tlearn: 0.4079698\ttotal: 459ms\tremaining: 9.52s\n",
      "46:\tlearn: 0.4074557\ttotal: 467ms\tremaining: 9.46s\n",
      "47:\tlearn: 0.4071302\ttotal: 474ms\tremaining: 9.41s\n",
      "48:\tlearn: 0.4068212\ttotal: 482ms\tremaining: 9.35s\n",
      "49:\tlearn: 0.4064434\ttotal: 489ms\tremaining: 9.3s\n",
      "50:\tlearn: 0.4062166\ttotal: 497ms\tremaining: 9.25s\n",
      "51:\tlearn: 0.4058043\ttotal: 504ms\tremaining: 9.2s\n",
      "52:\tlearn: 0.4055680\ttotal: 522ms\tremaining: 9.34s\n",
      "53:\tlearn: 0.4052029\ttotal: 530ms\tremaining: 9.29s\n",
      "54:\tlearn: 0.4048873\ttotal: 538ms\tremaining: 9.24s\n",
      "55:\tlearn: 0.4045833\ttotal: 545ms\tremaining: 9.19s\n",
      "56:\tlearn: 0.4042516\ttotal: 552ms\tremaining: 9.14s\n",
      "57:\tlearn: 0.4039620\ttotal: 560ms\tremaining: 9.09s\n",
      "58:\tlearn: 0.4036550\ttotal: 573ms\tremaining: 9.13s\n",
      "59:\tlearn: 0.4033205\ttotal: 581ms\tremaining: 9.1s\n",
      "60:\tlearn: 0.4030109\ttotal: 589ms\tremaining: 9.06s\n",
      "61:\tlearn: 0.4027161\ttotal: 596ms\tremaining: 9.02s\n",
      "62:\tlearn: 0.4024619\ttotal: 618ms\tremaining: 9.19s\n",
      "63:\tlearn: 0.4021308\ttotal: 626ms\tremaining: 9.16s\n",
      "64:\tlearn: 0.4019591\ttotal: 634ms\tremaining: 9.12s\n",
      "65:\tlearn: 0.4017046\ttotal: 642ms\tremaining: 9.08s\n",
      "66:\tlearn: 0.4015431\ttotal: 649ms\tremaining: 9.04s\n",
      "67:\tlearn: 0.4012832\ttotal: 657ms\tremaining: 9s\n",
      "68:\tlearn: 0.4010003\ttotal: 664ms\tremaining: 8.96s\n",
      "69:\tlearn: 0.4007542\ttotal: 672ms\tremaining: 8.93s\n",
      "70:\tlearn: 0.4005777\ttotal: 679ms\tremaining: 8.88s\n",
      "71:\tlearn: 0.4001798\ttotal: 706ms\tremaining: 9.1s\n",
      "72:\tlearn: 0.4000009\ttotal: 714ms\tremaining: 9.06s\n",
      "73:\tlearn: 0.3997640\ttotal: 722ms\tremaining: 9.03s\n",
      "74:\tlearn: 0.3995678\ttotal: 729ms\tremaining: 8.99s\n",
      "75:\tlearn: 0.3993852\ttotal: 738ms\tremaining: 8.97s\n",
      "76:\tlearn: 0.3991909\ttotal: 745ms\tremaining: 8.93s\n",
      "77:\tlearn: 0.3990171\ttotal: 753ms\tremaining: 8.9s\n",
      "78:\tlearn: 0.3988694\ttotal: 760ms\tremaining: 8.86s\n",
      "79:\tlearn: 0.3986322\ttotal: 768ms\tremaining: 8.83s\n",
      "80:\tlearn: 0.3984425\ttotal: 775ms\tremaining: 8.79s\n",
      "81:\tlearn: 0.3982784\ttotal: 793ms\tremaining: 8.87s\n",
      "82:\tlearn: 0.3980449\ttotal: 801ms\tremaining: 8.85s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "83:\tlearn: 0.3979131\ttotal: 817ms\tremaining: 8.91s\n",
      "84:\tlearn: 0.3976863\ttotal: 826ms\tremaining: 8.89s\n",
      "85:\tlearn: 0.3975066\ttotal: 836ms\tremaining: 8.88s\n",
      "86:\tlearn: 0.3973893\ttotal: 844ms\tremaining: 8.86s\n",
      "87:\tlearn: 0.3972340\ttotal: 852ms\tremaining: 8.83s\n",
      "88:\tlearn: 0.3971208\ttotal: 859ms\tremaining: 8.8s\n",
      "89:\tlearn: 0.3968803\ttotal: 867ms\tremaining: 8.77s\n",
      "90:\tlearn: 0.3967809\ttotal: 886ms\tremaining: 8.85s\n",
      "91:\tlearn: 0.3965973\ttotal: 894ms\tremaining: 8.83s\n",
      "92:\tlearn: 0.3964181\ttotal: 903ms\tremaining: 8.81s\n",
      "93:\tlearn: 0.3962398\ttotal: 911ms\tremaining: 8.78s\n",
      "94:\tlearn: 0.3960726\ttotal: 919ms\tremaining: 8.76s\n",
      "95:\tlearn: 0.3959724\ttotal: 934ms\tremaining: 8.79s\n",
      "96:\tlearn: 0.3957788\ttotal: 943ms\tremaining: 8.77s\n",
      "97:\tlearn: 0.3956561\ttotal: 950ms\tremaining: 8.75s\n",
      "98:\tlearn: 0.3954571\ttotal: 958ms\tremaining: 8.72s\n",
      "99:\tlearn: 0.3952751\ttotal: 976ms\tremaining: 8.79s\n",
      "100:\tlearn: 0.3950747\ttotal: 984ms\tremaining: 8.76s\n",
      "101:\tlearn: 0.3949380\ttotal: 992ms\tremaining: 8.73s\n",
      "102:\tlearn: 0.3947487\ttotal: 999ms\tremaining: 8.7s\n",
      "103:\tlearn: 0.3945496\ttotal: 1.01s\tremaining: 8.68s\n",
      "104:\tlearn: 0.3943822\ttotal: 1.01s\tremaining: 8.65s\n",
      "105:\tlearn: 0.3942650\ttotal: 1.02s\tremaining: 8.62s\n",
      "106:\tlearn: 0.3940795\ttotal: 1.03s\tremaining: 8.6s\n",
      "107:\tlearn: 0.3939158\ttotal: 1.04s\tremaining: 8.58s\n",
      "108:\tlearn: 0.3937860\ttotal: 1.06s\tremaining: 8.68s\n",
      "109:\tlearn: 0.3936262\ttotal: 1.07s\tremaining: 8.68s\n",
      "110:\tlearn: 0.3934010\ttotal: 1.08s\tremaining: 8.65s\n",
      "111:\tlearn: 0.3932227\ttotal: 1.09s\tremaining: 8.63s\n",
      "112:\tlearn: 0.3930431\ttotal: 1.09s\tremaining: 8.6s\n",
      "113:\tlearn: 0.3929406\ttotal: 1.1s\tremaining: 8.57s\n",
      "114:\tlearn: 0.3927972\ttotal: 1.11s\tremaining: 8.54s\n",
      "115:\tlearn: 0.3926948\ttotal: 1.12s\tremaining: 8.51s\n",
      "116:\tlearn: 0.3926057\ttotal: 1.12s\tremaining: 8.48s\n",
      "117:\tlearn: 0.3925242\ttotal: 1.13s\tremaining: 8.45s\n",
      "118:\tlearn: 0.3923761\ttotal: 1.14s\tremaining: 8.42s\n",
      "119:\tlearn: 0.3922453\ttotal: 1.15s\tremaining: 8.46s\n",
      "120:\tlearn: 0.3921176\ttotal: 1.16s\tremaining: 8.45s\n",
      "121:\tlearn: 0.3920070\ttotal: 1.17s\tremaining: 8.45s\n",
      "122:\tlearn: 0.3918754\ttotal: 1.18s\tremaining: 8.43s\n",
      "123:\tlearn: 0.3917698\ttotal: 1.19s\tremaining: 8.41s\n",
      "124:\tlearn: 0.3916890\ttotal: 1.2s\tremaining: 8.38s\n",
      "125:\tlearn: 0.3915376\ttotal: 1.2s\tremaining: 8.35s\n",
      "126:\tlearn: 0.3914096\ttotal: 1.21s\tremaining: 8.33s\n",
      "127:\tlearn: 0.3912975\ttotal: 1.22s\tremaining: 8.31s\n",
      "128:\tlearn: 0.3911823\ttotal: 1.23s\tremaining: 8.29s\n",
      "129:\tlearn: 0.3910944\ttotal: 1.25s\tremaining: 8.34s\n",
      "130:\tlearn: 0.3908926\ttotal: 1.25s\tremaining: 8.32s\n",
      "131:\tlearn: 0.3908118\ttotal: 1.26s\tremaining: 8.3s\n",
      "132:\tlearn: 0.3906379\ttotal: 1.27s\tremaining: 8.28s\n",
      "133:\tlearn: 0.3905483\ttotal: 1.28s\tremaining: 8.26s\n",
      "134:\tlearn: 0.3903845\ttotal: 1.29s\tremaining: 8.29s\n",
      "135:\tlearn: 0.3902900\ttotal: 1.3s\tremaining: 8.27s\n",
      "136:\tlearn: 0.3901919\ttotal: 1.31s\tremaining: 8.24s\n",
      "137:\tlearn: 0.3900477\ttotal: 1.32s\tremaining: 8.22s\n",
      "138:\tlearn: 0.3899479\ttotal: 1.32s\tremaining: 8.2s\n",
      "139:\tlearn: 0.3898706\ttotal: 1.34s\tremaining: 8.24s\n",
      "140:\tlearn: 0.3897621\ttotal: 1.35s\tremaining: 8.21s\n",
      "141:\tlearn: 0.3896242\ttotal: 1.35s\tremaining: 8.19s\n",
      "142:\tlearn: 0.3894917\ttotal: 1.36s\tremaining: 8.17s\n",
      "143:\tlearn: 0.3893780\ttotal: 1.37s\tremaining: 8.15s\n",
      "144:\tlearn: 0.3892601\ttotal: 1.38s\tremaining: 8.12s\n",
      "145:\tlearn: 0.3891560\ttotal: 1.38s\tremaining: 8.1s\n",
      "146:\tlearn: 0.3890449\ttotal: 1.39s\tremaining: 8.07s\n",
      "147:\tlearn: 0.3889232\ttotal: 1.4s\tremaining: 8.05s\n",
      "148:\tlearn: 0.3888602\ttotal: 1.41s\tremaining: 8.07s\n",
      "149:\tlearn: 0.3887728\ttotal: 1.43s\tremaining: 8.12s\n",
      "150:\tlearn: 0.3886204\ttotal: 1.44s\tremaining: 8.11s\n",
      "151:\tlearn: 0.3885258\ttotal: 1.45s\tremaining: 8.09s\n",
      "152:\tlearn: 0.3883596\ttotal: 1.46s\tremaining: 8.07s\n",
      "153:\tlearn: 0.3882462\ttotal: 1.47s\tremaining: 8.05s\n",
      "154:\tlearn: 0.3881365\ttotal: 1.47s\tremaining: 8.03s\n",
      "155:\tlearn: 0.3880397\ttotal: 1.48s\tremaining: 8.01s\n",
      "156:\tlearn: 0.3879309\ttotal: 1.49s\tremaining: 7.99s\n",
      "157:\tlearn: 0.3878134\ttotal: 1.49s\tremaining: 7.96s\n",
      "158:\tlearn: 0.3876845\ttotal: 1.5s\tremaining: 7.94s\n",
      "159:\tlearn: 0.3875797\ttotal: 1.52s\tremaining: 7.99s\n",
      "160:\tlearn: 0.3874932\ttotal: 1.53s\tremaining: 8s\n",
      "161:\tlearn: 0.3873910\ttotal: 1.54s\tremaining: 7.98s\n",
      "162:\tlearn: 0.3872778\ttotal: 1.55s\tremaining: 7.96s\n",
      "163:\tlearn: 0.3871602\ttotal: 1.56s\tremaining: 7.94s\n",
      "164:\tlearn: 0.3870519\ttotal: 1.56s\tremaining: 7.92s\n",
      "165:\tlearn: 0.3869563\ttotal: 1.57s\tremaining: 7.9s\n",
      "166:\tlearn: 0.3868442\ttotal: 1.58s\tremaining: 7.88s\n",
      "167:\tlearn: 0.3864808\ttotal: 1.59s\tremaining: 7.86s\n",
      "168:\tlearn: 0.3863805\ttotal: 1.6s\tremaining: 7.86s\n",
      "169:\tlearn: 0.3862267\ttotal: 1.61s\tremaining: 7.87s\n",
      "170:\tlearn: 0.3860667\ttotal: 1.62s\tremaining: 7.86s\n",
      "171:\tlearn: 0.3859648\ttotal: 1.63s\tremaining: 7.84s\n",
      "172:\tlearn: 0.3859025\ttotal: 1.64s\tremaining: 7.82s\n",
      "173:\tlearn: 0.3857311\ttotal: 1.65s\tremaining: 7.84s\n",
      "174:\tlearn: 0.3856301\ttotal: 1.66s\tremaining: 7.82s\n",
      "175:\tlearn: 0.3855032\ttotal: 1.67s\tremaining: 7.81s\n",
      "176:\tlearn: 0.3853865\ttotal: 1.67s\tremaining: 7.79s\n",
      "177:\tlearn: 0.3852397\ttotal: 1.68s\tremaining: 7.77s\n",
      "178:\tlearn: 0.3851485\ttotal: 1.7s\tremaining: 7.8s\n",
      "179:\tlearn: 0.3850233\ttotal: 1.71s\tremaining: 7.78s\n",
      "180:\tlearn: 0.3848501\ttotal: 1.72s\tremaining: 7.76s\n",
      "181:\tlearn: 0.3847148\ttotal: 1.72s\tremaining: 7.75s\n",
      "182:\tlearn: 0.3845811\ttotal: 1.73s\tremaining: 7.73s\n",
      "183:\tlearn: 0.3844515\ttotal: 1.74s\tremaining: 7.71s\n",
      "184:\tlearn: 0.3843083\ttotal: 1.75s\tremaining: 7.7s\n",
      "185:\tlearn: 0.3841834\ttotal: 1.75s\tremaining: 7.68s\n",
      "186:\tlearn: 0.3840097\ttotal: 1.77s\tremaining: 7.71s\n",
      "187:\tlearn: 0.3838712\ttotal: 1.79s\tremaining: 7.75s\n",
      "188:\tlearn: 0.3838146\ttotal: 1.8s\tremaining: 7.73s\n",
      "189:\tlearn: 0.3837375\ttotal: 1.81s\tremaining: 7.72s\n",
      "190:\tlearn: 0.3835986\ttotal: 1.82s\tremaining: 7.71s\n",
      "191:\tlearn: 0.3834784\ttotal: 1.83s\tremaining: 7.7s\n",
      "192:\tlearn: 0.3833902\ttotal: 1.84s\tremaining: 7.68s\n",
      "193:\tlearn: 0.3832759\ttotal: 1.84s\tremaining: 7.66s\n",
      "194:\tlearn: 0.3831594\ttotal: 1.85s\tremaining: 7.65s\n",
      "195:\tlearn: 0.3830918\ttotal: 1.86s\tremaining: 7.63s\n",
      "196:\tlearn: 0.3830048\ttotal: 1.87s\tremaining: 7.61s\n",
      "197:\tlearn: 0.3828734\ttotal: 1.89s\tremaining: 7.66s\n",
      "198:\tlearn: 0.3827889\ttotal: 1.9s\tremaining: 7.64s\n",
      "199:\tlearn: 0.3826781\ttotal: 1.91s\tremaining: 7.63s\n",
      "200:\tlearn: 0.3825837\ttotal: 1.91s\tremaining: 7.61s\n",
      "201:\tlearn: 0.3824858\ttotal: 1.92s\tremaining: 7.59s\n",
      "202:\tlearn: 0.3823126\ttotal: 1.93s\tremaining: 7.57s\n",
      "203:\tlearn: 0.3822206\ttotal: 1.94s\tremaining: 7.56s\n",
      "204:\tlearn: 0.3821290\ttotal: 1.94s\tremaining: 7.54s\n",
      "205:\tlearn: 0.3820324\ttotal: 1.95s\tremaining: 7.52s\n",
      "206:\tlearn: 0.3818744\ttotal: 1.97s\tremaining: 7.54s\n",
      "207:\tlearn: 0.3817620\ttotal: 1.98s\tremaining: 7.53s\n",
      "208:\tlearn: 0.3816804\ttotal: 1.98s\tremaining: 7.51s\n",
      "209:\tlearn: 0.3815840\ttotal: 1.99s\tremaining: 7.49s\n",
      "210:\tlearn: 0.3814765\ttotal: 2s\tremaining: 7.47s\n",
      "211:\tlearn: 0.3813720\ttotal: 2.01s\tremaining: 7.48s\n",
      "212:\tlearn: 0.3812233\ttotal: 2.02s\tremaining: 7.46s\n",
      "213:\tlearn: 0.3809334\ttotal: 2.03s\tremaining: 7.45s\n",
      "214:\tlearn: 0.3808009\ttotal: 2.04s\tremaining: 7.44s\n",
      "215:\tlearn: 0.3806499\ttotal: 2.05s\tremaining: 7.43s\n",
      "216:\tlearn: 0.3805282\ttotal: 2.07s\tremaining: 7.46s\n",
      "217:\tlearn: 0.3804017\ttotal: 2.08s\tremaining: 7.45s\n",
      "218:\tlearn: 0.3803182\ttotal: 2.08s\tremaining: 7.43s\n",
      "219:\tlearn: 0.3801803\ttotal: 2.09s\tremaining: 7.42s\n",
      "220:\tlearn: 0.3800325\ttotal: 2.1s\tremaining: 7.41s\n",
      "221:\tlearn: 0.3798834\ttotal: 2.11s\tremaining: 7.39s\n",
      "222:\tlearn: 0.3798098\ttotal: 2.12s\tremaining: 7.37s\n",
      "223:\tlearn: 0.3797037\ttotal: 2.13s\tremaining: 7.38s\n",
      "224:\tlearn: 0.3795538\ttotal: 2.15s\tremaining: 7.41s\n",
      "225:\tlearn: 0.3794843\ttotal: 2.16s\tremaining: 7.39s\n",
      "226:\tlearn: 0.3793657\ttotal: 2.17s\tremaining: 7.38s\n",
      "227:\tlearn: 0.3792348\ttotal: 2.17s\tremaining: 7.37s\n",
      "228:\tlearn: 0.3791278\ttotal: 2.18s\tremaining: 7.35s\n",
      "229:\tlearn: 0.3789693\ttotal: 2.19s\tremaining: 7.34s\n",
      "230:\tlearn: 0.3788519\ttotal: 2.2s\tremaining: 7.33s\n",
      "231:\tlearn: 0.3787482\ttotal: 2.21s\tremaining: 7.31s\n",
      "232:\tlearn: 0.3786014\ttotal: 2.22s\tremaining: 7.29s\n",
      "233:\tlearn: 0.3784910\ttotal: 2.23s\tremaining: 7.28s\n",
      "234:\tlearn: 0.3784194\ttotal: 2.25s\tremaining: 7.32s\n",
      "235:\tlearn: 0.3783048\ttotal: 2.26s\tremaining: 7.32s\n",
      "236:\tlearn: 0.3782115\ttotal: 2.27s\tremaining: 7.31s\n",
      "237:\tlearn: 0.3781133\ttotal: 2.28s\tremaining: 7.3s\n",
      "238:\tlearn: 0.3779751\ttotal: 2.29s\tremaining: 7.28s\n",
      "239:\tlearn: 0.3778669\ttotal: 2.29s\tremaining: 7.27s\n",
      "240:\tlearn: 0.3777637\ttotal: 2.3s\tremaining: 7.25s\n",
      "241:\tlearn: 0.3777101\ttotal: 2.31s\tremaining: 7.23s\n",
      "242:\tlearn: 0.3775972\ttotal: 2.32s\tremaining: 7.21s\n",
      "243:\tlearn: 0.3774904\ttotal: 2.33s\tremaining: 7.23s\n",
      "244:\tlearn: 0.3773415\ttotal: 2.34s\tremaining: 7.22s\n",
      "245:\tlearn: 0.3772269\ttotal: 2.35s\tremaining: 7.2s\n",
      "246:\tlearn: 0.3771184\ttotal: 2.36s\tremaining: 7.19s\n",
      "247:\tlearn: 0.3770375\ttotal: 2.37s\tremaining: 7.19s\n",
      "248:\tlearn: 0.3769097\ttotal: 2.38s\tremaining: 7.18s\n",
      "249:\tlearn: 0.3767892\ttotal: 2.39s\tremaining: 7.16s\n",
      "250:\tlearn: 0.3766652\ttotal: 2.39s\tremaining: 7.14s\n",
      "251:\tlearn: 0.3764320\ttotal: 2.4s\tremaining: 7.13s\n",
      "252:\tlearn: 0.3763117\ttotal: 2.41s\tremaining: 7.11s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "253:\tlearn: 0.3762365\ttotal: 2.43s\tremaining: 7.14s\n",
      "254:\tlearn: 0.3760429\ttotal: 2.44s\tremaining: 7.13s\n",
      "255:\tlearn: 0.3759258\ttotal: 2.45s\tremaining: 7.11s\n",
      "256:\tlearn: 0.3757394\ttotal: 2.45s\tremaining: 7.1s\n",
      "257:\tlearn: 0.3755893\ttotal: 2.46s\tremaining: 7.08s\n",
      "258:\tlearn: 0.3754884\ttotal: 2.47s\tremaining: 7.07s\n",
      "259:\tlearn: 0.3753966\ttotal: 2.48s\tremaining: 7.06s\n",
      "260:\tlearn: 0.3752585\ttotal: 2.49s\tremaining: 7.06s\n",
      "261:\tlearn: 0.3751448\ttotal: 2.5s\tremaining: 7.04s\n",
      "262:\tlearn: 0.3750359\ttotal: 2.52s\tremaining: 7.06s\n",
      "263:\tlearn: 0.3749616\ttotal: 2.52s\tremaining: 7.04s\n",
      "264:\tlearn: 0.3748494\ttotal: 2.53s\tremaining: 7.03s\n",
      "265:\tlearn: 0.3747731\ttotal: 2.54s\tremaining: 7.01s\n",
      "266:\tlearn: 0.3747107\ttotal: 2.55s\tremaining: 6.99s\n",
      "267:\tlearn: 0.3745844\ttotal: 2.56s\tremaining: 6.98s\n",
      "268:\tlearn: 0.3745147\ttotal: 2.56s\tremaining: 6.96s\n",
      "269:\tlearn: 0.3743636\ttotal: 2.57s\tremaining: 6.95s\n",
      "270:\tlearn: 0.3742980\ttotal: 2.58s\tremaining: 6.93s\n",
      "271:\tlearn: 0.3741843\ttotal: 2.58s\tremaining: 6.92s\n",
      "272:\tlearn: 0.3741189\ttotal: 2.59s\tremaining: 6.9s\n",
      "273:\tlearn: 0.3740385\ttotal: 2.61s\tremaining: 6.93s\n",
      "274:\tlearn: 0.3739548\ttotal: 2.62s\tremaining: 6.91s\n",
      "275:\tlearn: 0.3738729\ttotal: 2.63s\tremaining: 6.9s\n",
      "276:\tlearn: 0.3737830\ttotal: 2.64s\tremaining: 6.88s\n",
      "277:\tlearn: 0.3736799\ttotal: 2.65s\tremaining: 6.88s\n",
      "278:\tlearn: 0.3735445\ttotal: 2.66s\tremaining: 6.86s\n",
      "279:\tlearn: 0.3734520\ttotal: 2.67s\tremaining: 6.85s\n",
      "280:\tlearn: 0.3733872\ttotal: 2.67s\tremaining: 6.84s\n",
      "281:\tlearn: 0.3732714\ttotal: 2.68s\tremaining: 6.83s\n",
      "282:\tlearn: 0.3731763\ttotal: 2.7s\tremaining: 6.84s\n",
      "283:\tlearn: 0.3731186\ttotal: 2.71s\tremaining: 6.82s\n",
      "284:\tlearn: 0.3729922\ttotal: 2.71s\tremaining: 6.81s\n",
      "285:\tlearn: 0.3729381\ttotal: 2.73s\tremaining: 6.81s\n",
      "286:\tlearn: 0.3728356\ttotal: 2.74s\tremaining: 6.8s\n",
      "287:\tlearn: 0.3727383\ttotal: 2.75s\tremaining: 6.79s\n",
      "288:\tlearn: 0.3726283\ttotal: 2.76s\tremaining: 6.78s\n",
      "289:\tlearn: 0.3725114\ttotal: 2.77s\tremaining: 6.77s\n",
      "290:\tlearn: 0.3724096\ttotal: 2.78s\tremaining: 6.77s\n",
      "291:\tlearn: 0.3722829\ttotal: 2.79s\tremaining: 6.77s\n",
      "292:\tlearn: 0.3721900\ttotal: 2.8s\tremaining: 6.76s\n",
      "293:\tlearn: 0.3721145\ttotal: 2.81s\tremaining: 6.74s\n",
      "294:\tlearn: 0.3719622\ttotal: 2.82s\tremaining: 6.73s\n",
      "295:\tlearn: 0.3718936\ttotal: 2.82s\tremaining: 6.71s\n",
      "296:\tlearn: 0.3717654\ttotal: 2.83s\tremaining: 6.7s\n",
      "297:\tlearn: 0.3716982\ttotal: 2.84s\tremaining: 6.7s\n",
      "298:\tlearn: 0.3716286\ttotal: 2.85s\tremaining: 6.69s\n",
      "299:\tlearn: 0.3715070\ttotal: 2.87s\tremaining: 6.69s\n",
      "300:\tlearn: 0.3713923\ttotal: 2.88s\tremaining: 6.7s\n",
      "301:\tlearn: 0.3713216\ttotal: 2.89s\tremaining: 6.68s\n",
      "302:\tlearn: 0.3712059\ttotal: 2.9s\tremaining: 6.67s\n",
      "303:\tlearn: 0.3710962\ttotal: 2.91s\tremaining: 6.66s\n",
      "304:\tlearn: 0.3709842\ttotal: 2.91s\tremaining: 6.64s\n",
      "305:\tlearn: 0.3709148\ttotal: 2.92s\tremaining: 6.63s\n",
      "306:\tlearn: 0.3707738\ttotal: 2.93s\tremaining: 6.61s\n",
      "307:\tlearn: 0.3706895\ttotal: 2.94s\tremaining: 6.6s\n",
      "308:\tlearn: 0.3706396\ttotal: 2.94s\tremaining: 6.58s\n",
      "309:\tlearn: 0.3705202\ttotal: 2.95s\tremaining: 6.57s\n",
      "310:\tlearn: 0.3704285\ttotal: 2.97s\tremaining: 6.58s\n",
      "311:\tlearn: 0.3703518\ttotal: 2.98s\tremaining: 6.57s\n",
      "312:\tlearn: 0.3702332\ttotal: 2.99s\tremaining: 6.55s\n",
      "313:\tlearn: 0.3701465\ttotal: 2.99s\tremaining: 6.54s\n",
      "314:\tlearn: 0.3701096\ttotal: 3s\tremaining: 6.53s\n",
      "315:\tlearn: 0.3699974\ttotal: 3.01s\tremaining: 6.51s\n",
      "316:\tlearn: 0.3699121\ttotal: 3.02s\tremaining: 6.5s\n",
      "317:\tlearn: 0.3698354\ttotal: 3.02s\tremaining: 6.49s\n",
      "318:\tlearn: 0.3697249\ttotal: 3.03s\tremaining: 6.47s\n",
      "319:\tlearn: 0.3696155\ttotal: 3.04s\tremaining: 6.46s\n",
      "320:\tlearn: 0.3695712\ttotal: 3.06s\tremaining: 6.47s\n",
      "321:\tlearn: 0.3694729\ttotal: 3.07s\tremaining: 6.46s\n",
      "322:\tlearn: 0.3694116\ttotal: 3.08s\tremaining: 6.45s\n",
      "323:\tlearn: 0.3692806\ttotal: 3.09s\tremaining: 6.45s\n",
      "324:\tlearn: 0.3691288\ttotal: 3.1s\tremaining: 6.44s\n",
      "325:\tlearn: 0.3690356\ttotal: 3.11s\tremaining: 6.42s\n",
      "326:\tlearn: 0.3689080\ttotal: 3.11s\tremaining: 6.41s\n",
      "327:\tlearn: 0.3688379\ttotal: 3.12s\tremaining: 6.4s\n",
      "328:\tlearn: 0.3687146\ttotal: 3.13s\tremaining: 6.38s\n",
      "329:\tlearn: 0.3685986\ttotal: 3.15s\tremaining: 6.39s\n",
      "330:\tlearn: 0.3685081\ttotal: 3.15s\tremaining: 6.38s\n",
      "331:\tlearn: 0.3684108\ttotal: 3.16s\tremaining: 6.36s\n",
      "332:\tlearn: 0.3683200\ttotal: 3.17s\tremaining: 6.35s\n",
      "333:\tlearn: 0.3682424\ttotal: 3.18s\tremaining: 6.34s\n",
      "334:\tlearn: 0.3681795\ttotal: 3.18s\tremaining: 6.32s\n",
      "335:\tlearn: 0.3680803\ttotal: 3.19s\tremaining: 6.31s\n",
      "336:\tlearn: 0.3680273\ttotal: 3.2s\tremaining: 6.3s\n",
      "337:\tlearn: 0.3679370\ttotal: 3.21s\tremaining: 6.29s\n",
      "338:\tlearn: 0.3678581\ttotal: 3.22s\tremaining: 6.28s\n",
      "339:\tlearn: 0.3677503\ttotal: 3.24s\tremaining: 6.29s\n",
      "340:\tlearn: 0.3676535\ttotal: 3.25s\tremaining: 6.27s\n",
      "341:\tlearn: 0.3675940\ttotal: 3.25s\tremaining: 6.26s\n",
      "342:\tlearn: 0.3674738\ttotal: 3.26s\tremaining: 6.25s\n",
      "343:\tlearn: 0.3673532\ttotal: 3.27s\tremaining: 6.24s\n",
      "344:\tlearn: 0.3672749\ttotal: 3.28s\tremaining: 6.22s\n",
      "345:\tlearn: 0.3671739\ttotal: 3.29s\tremaining: 6.21s\n",
      "346:\tlearn: 0.3670771\ttotal: 3.29s\tremaining: 6.2s\n",
      "347:\tlearn: 0.3670103\ttotal: 3.3s\tremaining: 6.18s\n",
      "348:\tlearn: 0.3669118\ttotal: 3.31s\tremaining: 6.17s\n",
      "349:\tlearn: 0.3667934\ttotal: 3.32s\tremaining: 6.17s\n",
      "350:\tlearn: 0.3667009\ttotal: 3.33s\tremaining: 6.16s\n",
      "351:\tlearn: 0.3666092\ttotal: 3.34s\tremaining: 6.15s\n",
      "352:\tlearn: 0.3664860\ttotal: 3.35s\tremaining: 6.14s\n",
      "353:\tlearn: 0.3663641\ttotal: 3.35s\tremaining: 6.12s\n",
      "354:\tlearn: 0.3662197\ttotal: 3.36s\tremaining: 6.11s\n",
      "355:\tlearn: 0.3661477\ttotal: 3.37s\tremaining: 6.1s\n",
      "356:\tlearn: 0.3660599\ttotal: 3.38s\tremaining: 6.08s\n",
      "357:\tlearn: 0.3659544\ttotal: 3.38s\tremaining: 6.07s\n",
      "358:\tlearn: 0.3658523\ttotal: 3.39s\tremaining: 6.06s\n",
      "359:\tlearn: 0.3657532\ttotal: 3.4s\tremaining: 6.04s\n",
      "360:\tlearn: 0.3656501\ttotal: 3.42s\tremaining: 6.04s\n",
      "361:\tlearn: 0.3655133\ttotal: 3.42s\tremaining: 6.03s\n",
      "362:\tlearn: 0.3654067\ttotal: 3.43s\tremaining: 6.02s\n",
      "363:\tlearn: 0.3652943\ttotal: 3.46s\tremaining: 6.04s\n",
      "364:\tlearn: 0.3652324\ttotal: 3.46s\tremaining: 6.03s\n",
      "365:\tlearn: 0.3651217\ttotal: 3.47s\tremaining: 6.02s\n",
      "366:\tlearn: 0.3650857\ttotal: 3.48s\tremaining: 6.01s\n",
      "367:\tlearn: 0.3649780\ttotal: 3.49s\tremaining: 6s\n",
      "368:\tlearn: 0.3649345\ttotal: 3.51s\tremaining: 6s\n",
      "369:\tlearn: 0.3647985\ttotal: 3.52s\tremaining: 5.99s\n",
      "370:\tlearn: 0.3647320\ttotal: 3.53s\tremaining: 5.98s\n",
      "371:\tlearn: 0.3646460\ttotal: 3.53s\tremaining: 5.96s\n",
      "372:\tlearn: 0.3646062\ttotal: 3.54s\tremaining: 5.95s\n",
      "373:\tlearn: 0.3645511\ttotal: 3.55s\tremaining: 5.94s\n",
      "374:\tlearn: 0.3644741\ttotal: 3.56s\tremaining: 5.94s\n",
      "375:\tlearn: 0.3643881\ttotal: 3.57s\tremaining: 5.92s\n",
      "376:\tlearn: 0.3642766\ttotal: 3.58s\tremaining: 5.91s\n",
      "377:\tlearn: 0.3641898\ttotal: 3.58s\tremaining: 5.9s\n",
      "378:\tlearn: 0.3641006\ttotal: 3.6s\tremaining: 5.9s\n",
      "379:\tlearn: 0.3640000\ttotal: 3.61s\tremaining: 5.89s\n",
      "380:\tlearn: 0.3639415\ttotal: 3.62s\tremaining: 5.88s\n",
      "381:\tlearn: 0.3638398\ttotal: 3.63s\tremaining: 5.87s\n",
      "382:\tlearn: 0.3637661\ttotal: 3.63s\tremaining: 5.85s\n",
      "383:\tlearn: 0.3637131\ttotal: 3.64s\tremaining: 5.84s\n",
      "384:\tlearn: 0.3636443\ttotal: 3.65s\tremaining: 5.83s\n",
      "385:\tlearn: 0.3635619\ttotal: 3.65s\tremaining: 5.81s\n",
      "386:\tlearn: 0.3634670\ttotal: 3.66s\tremaining: 5.8s\n",
      "387:\tlearn: 0.3633335\ttotal: 3.67s\tremaining: 5.79s\n",
      "388:\tlearn: 0.3632439\ttotal: 3.7s\tremaining: 5.81s\n",
      "389:\tlearn: 0.3631793\ttotal: 3.71s\tremaining: 5.8s\n",
      "390:\tlearn: 0.3630664\ttotal: 3.71s\tremaining: 5.79s\n",
      "391:\tlearn: 0.3630281\ttotal: 3.72s\tremaining: 5.77s\n",
      "392:\tlearn: 0.3629601\ttotal: 3.73s\tremaining: 5.76s\n",
      "393:\tlearn: 0.3628715\ttotal: 3.74s\tremaining: 5.75s\n",
      "394:\tlearn: 0.3627894\ttotal: 3.75s\tremaining: 5.74s\n",
      "395:\tlearn: 0.3627139\ttotal: 3.75s\tremaining: 5.72s\n",
      "396:\tlearn: 0.3626446\ttotal: 3.76s\tremaining: 5.71s\n",
      "397:\tlearn: 0.3625513\ttotal: 3.77s\tremaining: 5.71s\n",
      "398:\tlearn: 0.3624928\ttotal: 3.78s\tremaining: 5.7s\n",
      "399:\tlearn: 0.3624354\ttotal: 3.8s\tremaining: 5.7s\n",
      "400:\tlearn: 0.3623784\ttotal: 3.81s\tremaining: 5.69s\n",
      "401:\tlearn: 0.3622761\ttotal: 3.81s\tremaining: 5.68s\n",
      "402:\tlearn: 0.3621712\ttotal: 3.82s\tremaining: 5.66s\n",
      "403:\tlearn: 0.3620813\ttotal: 3.83s\tremaining: 5.65s\n",
      "404:\tlearn: 0.3619908\ttotal: 3.84s\tremaining: 5.64s\n",
      "405:\tlearn: 0.3619149\ttotal: 3.85s\tremaining: 5.63s\n",
      "406:\tlearn: 0.3618401\ttotal: 3.85s\tremaining: 5.61s\n",
      "407:\tlearn: 0.3617673\ttotal: 3.87s\tremaining: 5.62s\n",
      "408:\tlearn: 0.3616612\ttotal: 3.88s\tremaining: 5.6s\n",
      "409:\tlearn: 0.3615582\ttotal: 3.88s\tremaining: 5.59s\n",
      "410:\tlearn: 0.3614772\ttotal: 3.89s\tremaining: 5.58s\n",
      "411:\tlearn: 0.3614184\ttotal: 3.9s\tremaining: 5.57s\n",
      "412:\tlearn: 0.3613533\ttotal: 3.92s\tremaining: 5.56s\n",
      "413:\tlearn: 0.3612578\ttotal: 3.93s\tremaining: 5.56s\n",
      "414:\tlearn: 0.3611846\ttotal: 3.93s\tremaining: 5.54s\n",
      "415:\tlearn: 0.3610598\ttotal: 3.94s\tremaining: 5.53s\n",
      "416:\tlearn: 0.3609596\ttotal: 3.96s\tremaining: 5.53s\n",
      "417:\tlearn: 0.3608529\ttotal: 3.97s\tremaining: 5.53s\n",
      "418:\tlearn: 0.3608158\ttotal: 3.98s\tremaining: 5.51s\n",
      "419:\tlearn: 0.3607347\ttotal: 3.98s\tremaining: 5.5s\n",
      "420:\tlearn: 0.3606619\ttotal: 3.99s\tremaining: 5.49s\n",
      "421:\tlearn: 0.3605430\ttotal: 4s\tremaining: 5.47s\n",
      "422:\tlearn: 0.3604689\ttotal: 4s\tremaining: 5.46s\n",
      "423:\tlearn: 0.3603864\ttotal: 4.01s\tremaining: 5.45s\n",
      "424:\tlearn: 0.3603362\ttotal: 4.02s\tremaining: 5.44s\n",
      "425:\tlearn: 0.3602756\ttotal: 4.03s\tremaining: 5.42s\n",
      "426:\tlearn: 0.3602349\ttotal: 4.05s\tremaining: 5.43s\n",
      "427:\tlearn: 0.3601775\ttotal: 4.06s\tremaining: 5.43s\n",
      "428:\tlearn: 0.3601217\ttotal: 4.07s\tremaining: 5.42s\n",
      "429:\tlearn: 0.3600414\ttotal: 4.08s\tremaining: 5.41s\n",
      "430:\tlearn: 0.3599857\ttotal: 4.09s\tremaining: 5.4s\n",
      "431:\tlearn: 0.3599035\ttotal: 4.09s\tremaining: 5.38s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "432:\tlearn: 0.3598380\ttotal: 4.1s\tremaining: 5.37s\n",
      "433:\tlearn: 0.3597582\ttotal: 4.11s\tremaining: 5.36s\n",
      "434:\tlearn: 0.3596827\ttotal: 4.12s\tremaining: 5.35s\n",
      "435:\tlearn: 0.3596178\ttotal: 4.13s\tremaining: 5.34s\n",
      "436:\tlearn: 0.3595440\ttotal: 4.15s\tremaining: 5.35s\n",
      "437:\tlearn: 0.3594628\ttotal: 4.16s\tremaining: 5.34s\n",
      "438:\tlearn: 0.3594025\ttotal: 4.17s\tremaining: 5.33s\n",
      "439:\tlearn: 0.3593544\ttotal: 4.18s\tremaining: 5.32s\n",
      "440:\tlearn: 0.3592657\ttotal: 4.18s\tremaining: 5.3s\n",
      "441:\tlearn: 0.3591971\ttotal: 4.19s\tremaining: 5.29s\n",
      "442:\tlearn: 0.3591326\ttotal: 4.2s\tremaining: 5.28s\n",
      "443:\tlearn: 0.3590950\ttotal: 4.21s\tremaining: 5.27s\n",
      "444:\tlearn: 0.3590331\ttotal: 4.21s\tremaining: 5.26s\n",
      "445:\tlearn: 0.3589624\ttotal: 4.23s\tremaining: 5.26s\n",
      "446:\tlearn: 0.3588855\ttotal: 4.24s\tremaining: 5.24s\n",
      "447:\tlearn: 0.3587920\ttotal: 4.25s\tremaining: 5.23s\n",
      "448:\tlearn: 0.3587324\ttotal: 4.25s\tremaining: 5.22s\n",
      "449:\tlearn: 0.3586517\ttotal: 4.26s\tremaining: 5.21s\n",
      "450:\tlearn: 0.3586050\ttotal: 4.28s\tremaining: 5.21s\n",
      "451:\tlearn: 0.3585384\ttotal: 4.29s\tremaining: 5.2s\n",
      "452:\tlearn: 0.3584265\ttotal: 4.29s\tremaining: 5.18s\n",
      "453:\tlearn: 0.3583500\ttotal: 4.3s\tremaining: 5.17s\n",
      "454:\tlearn: 0.3582803\ttotal: 4.31s\tremaining: 5.17s\n",
      "455:\tlearn: 0.3582214\ttotal: 4.33s\tremaining: 5.17s\n",
      "456:\tlearn: 0.3581480\ttotal: 4.34s\tremaining: 5.16s\n",
      "457:\tlearn: 0.3580482\ttotal: 4.35s\tremaining: 5.15s\n",
      "458:\tlearn: 0.3579793\ttotal: 4.36s\tremaining: 5.14s\n",
      "459:\tlearn: 0.3579146\ttotal: 4.37s\tremaining: 5.13s\n",
      "460:\tlearn: 0.3578150\ttotal: 4.4s\tremaining: 5.14s\n",
      "461:\tlearn: 0.3577369\ttotal: 4.42s\tremaining: 5.15s\n",
      "462:\tlearn: 0.3576318\ttotal: 4.43s\tremaining: 5.14s\n",
      "463:\tlearn: 0.3575338\ttotal: 4.45s\tremaining: 5.13s\n",
      "464:\tlearn: 0.3574405\ttotal: 4.46s\tremaining: 5.13s\n",
      "465:\tlearn: 0.3573630\ttotal: 4.47s\tremaining: 5.12s\n",
      "466:\tlearn: 0.3572974\ttotal: 4.48s\tremaining: 5.11s\n",
      "467:\tlearn: 0.3572040\ttotal: 4.49s\tremaining: 5.1s\n",
      "468:\tlearn: 0.3571500\ttotal: 4.51s\tremaining: 5.11s\n",
      "469:\tlearn: 0.3570876\ttotal: 4.53s\tremaining: 5.11s\n",
      "470:\tlearn: 0.3570137\ttotal: 4.54s\tremaining: 5.1s\n",
      "471:\tlearn: 0.3569409\ttotal: 4.55s\tremaining: 5.09s\n",
      "472:\tlearn: 0.3568437\ttotal: 4.57s\tremaining: 5.09s\n",
      "473:\tlearn: 0.3567592\ttotal: 4.58s\tremaining: 5.08s\n",
      "474:\tlearn: 0.3567079\ttotal: 4.6s\tremaining: 5.08s\n",
      "475:\tlearn: 0.3566257\ttotal: 4.61s\tremaining: 5.08s\n",
      "476:\tlearn: 0.3565679\ttotal: 4.62s\tremaining: 5.07s\n",
      "477:\tlearn: 0.3564753\ttotal: 4.64s\tremaining: 5.07s\n",
      "478:\tlearn: 0.3564373\ttotal: 4.66s\tremaining: 5.06s\n",
      "479:\tlearn: 0.3563266\ttotal: 4.67s\tremaining: 5.06s\n",
      "480:\tlearn: 0.3562328\ttotal: 4.69s\tremaining: 5.06s\n",
      "481:\tlearn: 0.3561462\ttotal: 4.7s\tremaining: 5.05s\n",
      "482:\tlearn: 0.3560671\ttotal: 4.72s\tremaining: 5.05s\n",
      "483:\tlearn: 0.3559950\ttotal: 4.73s\tremaining: 5.04s\n",
      "484:\tlearn: 0.3559058\ttotal: 4.74s\tremaining: 5.03s\n",
      "485:\tlearn: 0.3558300\ttotal: 4.75s\tremaining: 5.02s\n",
      "486:\tlearn: 0.3557480\ttotal: 4.77s\tremaining: 5.02s\n",
      "487:\tlearn: 0.3556617\ttotal: 4.79s\tremaining: 5.03s\n",
      "488:\tlearn: 0.3555862\ttotal: 4.8s\tremaining: 5.01s\n",
      "489:\tlearn: 0.3555121\ttotal: 4.81s\tremaining: 5s\n",
      "490:\tlearn: 0.3554530\ttotal: 4.82s\tremaining: 4.99s\n",
      "491:\tlearn: 0.3553740\ttotal: 4.82s\tremaining: 4.98s\n",
      "492:\tlearn: 0.3552911\ttotal: 4.83s\tremaining: 4.97s\n",
      "493:\tlearn: 0.3552598\ttotal: 4.84s\tremaining: 4.96s\n",
      "494:\tlearn: 0.3551631\ttotal: 4.84s\tremaining: 4.94s\n",
      "495:\tlearn: 0.3550885\ttotal: 4.85s\tremaining: 4.93s\n",
      "496:\tlearn: 0.3550409\ttotal: 4.86s\tremaining: 4.92s\n",
      "497:\tlearn: 0.3549628\ttotal: 4.88s\tremaining: 4.92s\n",
      "498:\tlearn: 0.3548898\ttotal: 4.89s\tremaining: 4.91s\n",
      "499:\tlearn: 0.3548045\ttotal: 4.9s\tremaining: 4.9s\n",
      "500:\tlearn: 0.3547078\ttotal: 4.91s\tremaining: 4.89s\n",
      "501:\tlearn: 0.3546339\ttotal: 4.92s\tremaining: 4.88s\n",
      "502:\tlearn: 0.3545466\ttotal: 4.92s\tremaining: 4.87s\n",
      "503:\tlearn: 0.3545002\ttotal: 4.93s\tremaining: 4.85s\n",
      "504:\tlearn: 0.3543758\ttotal: 4.94s\tremaining: 4.84s\n",
      "505:\tlearn: 0.3543318\ttotal: 4.95s\tremaining: 4.83s\n",
      "506:\tlearn: 0.3542448\ttotal: 4.97s\tremaining: 4.83s\n",
      "507:\tlearn: 0.3541381\ttotal: 4.97s\tremaining: 4.82s\n",
      "508:\tlearn: 0.3540556\ttotal: 4.98s\tremaining: 4.8s\n",
      "509:\tlearn: 0.3539850\ttotal: 4.99s\tremaining: 4.79s\n",
      "510:\tlearn: 0.3538700\ttotal: 5s\tremaining: 4.79s\n",
      "511:\tlearn: 0.3537683\ttotal: 5.01s\tremaining: 4.78s\n",
      "512:\tlearn: 0.3536186\ttotal: 5.02s\tremaining: 4.77s\n",
      "513:\tlearn: 0.3535246\ttotal: 5.03s\tremaining: 4.75s\n",
      "514:\tlearn: 0.3534844\ttotal: 5.04s\tremaining: 4.74s\n",
      "515:\tlearn: 0.3533920\ttotal: 5.05s\tremaining: 4.73s\n",
      "516:\tlearn: 0.3533010\ttotal: 5.06s\tremaining: 4.73s\n",
      "517:\tlearn: 0.3532252\ttotal: 5.07s\tremaining: 4.72s\n",
      "518:\tlearn: 0.3531302\ttotal: 5.08s\tremaining: 4.7s\n",
      "519:\tlearn: 0.3530567\ttotal: 5.08s\tremaining: 4.69s\n",
      "520:\tlearn: 0.3530087\ttotal: 5.09s\tremaining: 4.68s\n",
      "521:\tlearn: 0.3529245\ttotal: 5.1s\tremaining: 4.67s\n",
      "522:\tlearn: 0.3528642\ttotal: 5.1s\tremaining: 4.66s\n",
      "523:\tlearn: 0.3528121\ttotal: 5.11s\tremaining: 4.64s\n",
      "524:\tlearn: 0.3527852\ttotal: 5.13s\tremaining: 4.64s\n",
      "525:\tlearn: 0.3527097\ttotal: 5.14s\tremaining: 4.63s\n",
      "526:\tlearn: 0.3526161\ttotal: 5.15s\tremaining: 4.62s\n",
      "527:\tlearn: 0.3525471\ttotal: 5.16s\tremaining: 4.61s\n",
      "528:\tlearn: 0.3524966\ttotal: 5.17s\tremaining: 4.6s\n",
      "529:\tlearn: 0.3524317\ttotal: 5.17s\tremaining: 4.59s\n",
      "530:\tlearn: 0.3523469\ttotal: 5.18s\tremaining: 4.58s\n",
      "531:\tlearn: 0.3522548\ttotal: 5.19s\tremaining: 4.57s\n",
      "532:\tlearn: 0.3521966\ttotal: 5.2s\tremaining: 4.55s\n",
      "533:\tlearn: 0.3521027\ttotal: 5.2s\tremaining: 4.54s\n",
      "534:\tlearn: 0.3520013\ttotal: 5.21s\tremaining: 4.53s\n",
      "535:\tlearn: 0.3519386\ttotal: 5.22s\tremaining: 4.52s\n",
      "536:\tlearn: 0.3518364\ttotal: 5.24s\tremaining: 4.51s\n",
      "537:\tlearn: 0.3518085\ttotal: 5.25s\tremaining: 4.51s\n",
      "538:\tlearn: 0.3517183\ttotal: 5.26s\tremaining: 4.5s\n",
      "539:\tlearn: 0.3516859\ttotal: 5.26s\tremaining: 4.48s\n",
      "540:\tlearn: 0.3515753\ttotal: 5.27s\tremaining: 4.47s\n",
      "541:\tlearn: 0.3515057\ttotal: 5.28s\tremaining: 4.46s\n",
      "542:\tlearn: 0.3514411\ttotal: 5.29s\tremaining: 4.45s\n",
      "543:\tlearn: 0.3513843\ttotal: 5.29s\tremaining: 4.44s\n",
      "544:\tlearn: 0.3513126\ttotal: 5.3s\tremaining: 4.43s\n",
      "545:\tlearn: 0.3512338\ttotal: 5.31s\tremaining: 4.42s\n",
      "546:\tlearn: 0.3511329\ttotal: 5.33s\tremaining: 4.41s\n",
      "547:\tlearn: 0.3510923\ttotal: 5.34s\tremaining: 4.4s\n",
      "548:\tlearn: 0.3510443\ttotal: 5.34s\tremaining: 4.39s\n",
      "549:\tlearn: 0.3509532\ttotal: 5.35s\tremaining: 4.38s\n",
      "550:\tlearn: 0.3508879\ttotal: 5.37s\tremaining: 4.37s\n",
      "551:\tlearn: 0.3508387\ttotal: 5.38s\tremaining: 4.36s\n",
      "552:\tlearn: 0.3507807\ttotal: 5.38s\tremaining: 4.35s\n",
      "553:\tlearn: 0.3507182\ttotal: 5.39s\tremaining: 4.34s\n",
      "554:\tlearn: 0.3506414\ttotal: 5.4s\tremaining: 4.33s\n",
      "555:\tlearn: 0.3505740\ttotal: 5.41s\tremaining: 4.32s\n",
      "556:\tlearn: 0.3505098\ttotal: 5.42s\tremaining: 4.31s\n",
      "557:\tlearn: 0.3504263\ttotal: 5.43s\tremaining: 4.3s\n",
      "558:\tlearn: 0.3503501\ttotal: 5.44s\tremaining: 4.29s\n",
      "559:\tlearn: 0.3502879\ttotal: 5.45s\tremaining: 4.28s\n",
      "560:\tlearn: 0.3502074\ttotal: 5.45s\tremaining: 4.27s\n",
      "561:\tlearn: 0.3501114\ttotal: 5.46s\tremaining: 4.25s\n",
      "562:\tlearn: 0.3500503\ttotal: 5.47s\tremaining: 4.24s\n",
      "563:\tlearn: 0.3499797\ttotal: 5.48s\tremaining: 4.24s\n",
      "564:\tlearn: 0.3499295\ttotal: 5.49s\tremaining: 4.22s\n",
      "565:\tlearn: 0.3498391\ttotal: 5.51s\tremaining: 4.22s\n",
      "566:\tlearn: 0.3497575\ttotal: 5.51s\tremaining: 4.21s\n",
      "567:\tlearn: 0.3497061\ttotal: 5.52s\tremaining: 4.2s\n",
      "568:\tlearn: 0.3496277\ttotal: 5.53s\tremaining: 4.19s\n",
      "569:\tlearn: 0.3495845\ttotal: 5.54s\tremaining: 4.18s\n",
      "570:\tlearn: 0.3495310\ttotal: 5.55s\tremaining: 4.17s\n",
      "571:\tlearn: 0.3494028\ttotal: 5.55s\tremaining: 4.16s\n",
      "572:\tlearn: 0.3493386\ttotal: 5.56s\tremaining: 4.14s\n",
      "573:\tlearn: 0.3493032\ttotal: 5.57s\tremaining: 4.13s\n",
      "574:\tlearn: 0.3492106\ttotal: 5.58s\tremaining: 4.12s\n",
      "575:\tlearn: 0.3491445\ttotal: 5.59s\tremaining: 4.11s\n",
      "576:\tlearn: 0.3490513\ttotal: 5.61s\tremaining: 4.11s\n",
      "577:\tlearn: 0.3489768\ttotal: 5.62s\tremaining: 4.1s\n",
      "578:\tlearn: 0.3489022\ttotal: 5.63s\tremaining: 4.09s\n",
      "579:\tlearn: 0.3488218\ttotal: 5.64s\tremaining: 4.08s\n",
      "580:\tlearn: 0.3487614\ttotal: 5.64s\tremaining: 4.07s\n",
      "581:\tlearn: 0.3486822\ttotal: 5.65s\tremaining: 4.06s\n",
      "582:\tlearn: 0.3486407\ttotal: 5.66s\tremaining: 4.05s\n",
      "583:\tlearn: 0.3485589\ttotal: 5.67s\tremaining: 4.04s\n",
      "584:\tlearn: 0.3484867\ttotal: 5.68s\tremaining: 4.03s\n",
      "585:\tlearn: 0.3484556\ttotal: 5.69s\tremaining: 4.02s\n",
      "586:\tlearn: 0.3483692\ttotal: 5.7s\tremaining: 4.01s\n",
      "587:\tlearn: 0.3482850\ttotal: 5.71s\tremaining: 4s\n",
      "588:\tlearn: 0.3482087\ttotal: 5.73s\tremaining: 4s\n",
      "589:\tlearn: 0.3481396\ttotal: 5.74s\tremaining: 3.98s\n",
      "590:\tlearn: 0.3480564\ttotal: 5.74s\tremaining: 3.97s\n",
      "591:\tlearn: 0.3479897\ttotal: 5.75s\tremaining: 3.96s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "592:\tlearn: 0.3479215\ttotal: 5.76s\tremaining: 3.95s\n",
      "593:\tlearn: 0.3478297\ttotal: 5.77s\tremaining: 3.94s\n",
      "594:\tlearn: 0.3477398\ttotal: 5.79s\tremaining: 3.94s\n",
      "595:\tlearn: 0.3476826\ttotal: 5.79s\tremaining: 3.93s\n",
      "596:\tlearn: 0.3476141\ttotal: 5.8s\tremaining: 3.92s\n",
      "597:\tlearn: 0.3475494\ttotal: 5.81s\tremaining: 3.91s\n",
      "598:\tlearn: 0.3474823\ttotal: 5.82s\tremaining: 3.9s\n",
      "599:\tlearn: 0.3474051\ttotal: 5.83s\tremaining: 3.88s\n",
      "600:\tlearn: 0.3473408\ttotal: 5.84s\tremaining: 3.88s\n",
      "601:\tlearn: 0.3472817\ttotal: 5.85s\tremaining: 3.87s\n",
      "602:\tlearn: 0.3472170\ttotal: 5.86s\tremaining: 3.86s\n",
      "603:\tlearn: 0.3471478\ttotal: 5.87s\tremaining: 3.85s\n",
      "604:\tlearn: 0.3470738\ttotal: 5.88s\tremaining: 3.84s\n",
      "605:\tlearn: 0.3470020\ttotal: 5.89s\tremaining: 3.83s\n",
      "606:\tlearn: 0.3469467\ttotal: 5.9s\tremaining: 3.82s\n",
      "607:\tlearn: 0.3468784\ttotal: 5.91s\tremaining: 3.81s\n",
      "608:\tlearn: 0.3468264\ttotal: 5.92s\tremaining: 3.8s\n",
      "609:\tlearn: 0.3467939\ttotal: 5.93s\tremaining: 3.79s\n",
      "610:\tlearn: 0.3467377\ttotal: 5.93s\tremaining: 3.78s\n",
      "611:\tlearn: 0.3466973\ttotal: 5.94s\tremaining: 3.77s\n",
      "612:\tlearn: 0.3466397\ttotal: 5.95s\tremaining: 3.76s\n",
      "613:\tlearn: 0.3465943\ttotal: 5.97s\tremaining: 3.75s\n",
      "614:\tlearn: 0.3465509\ttotal: 5.98s\tremaining: 3.74s\n",
      "615:\tlearn: 0.3465061\ttotal: 5.99s\tremaining: 3.73s\n",
      "616:\tlearn: 0.3464654\ttotal: 6s\tremaining: 3.72s\n",
      "617:\tlearn: 0.3463796\ttotal: 6s\tremaining: 3.71s\n",
      "618:\tlearn: 0.3463089\ttotal: 6.01s\tremaining: 3.7s\n",
      "619:\tlearn: 0.3462290\ttotal: 6.02s\tremaining: 3.69s\n",
      "620:\tlearn: 0.3461619\ttotal: 6.03s\tremaining: 3.68s\n",
      "621:\tlearn: 0.3461226\ttotal: 6.04s\tremaining: 3.67s\n",
      "622:\tlearn: 0.3460559\ttotal: 6.05s\tremaining: 3.66s\n",
      "623:\tlearn: 0.3459756\ttotal: 6.06s\tremaining: 3.65s\n",
      "624:\tlearn: 0.3459027\ttotal: 6.08s\tremaining: 3.65s\n",
      "625:\tlearn: 0.3458240\ttotal: 6.09s\tremaining: 3.64s\n",
      "626:\tlearn: 0.3457192\ttotal: 6.1s\tremaining: 3.63s\n",
      "627:\tlearn: 0.3456387\ttotal: 6.11s\tremaining: 3.62s\n",
      "628:\tlearn: 0.3455212\ttotal: 6.12s\tremaining: 3.61s\n",
      "629:\tlearn: 0.3454770\ttotal: 6.12s\tremaining: 3.6s\n",
      "630:\tlearn: 0.3453692\ttotal: 6.13s\tremaining: 3.59s\n",
      "631:\tlearn: 0.3453289\ttotal: 6.15s\tremaining: 3.58s\n",
      "632:\tlearn: 0.3452812\ttotal: 6.16s\tremaining: 3.57s\n",
      "633:\tlearn: 0.3452277\ttotal: 6.16s\tremaining: 3.56s\n",
      "634:\tlearn: 0.3451813\ttotal: 6.17s\tremaining: 3.55s\n",
      "635:\tlearn: 0.3450949\ttotal: 6.18s\tremaining: 3.54s\n",
      "636:\tlearn: 0.3450250\ttotal: 6.19s\tremaining: 3.52s\n",
      "637:\tlearn: 0.3449685\ttotal: 6.2s\tremaining: 3.52s\n",
      "638:\tlearn: 0.3449168\ttotal: 6.21s\tremaining: 3.51s\n",
      "639:\tlearn: 0.3448459\ttotal: 6.21s\tremaining: 3.5s\n",
      "640:\tlearn: 0.3447591\ttotal: 6.23s\tremaining: 3.49s\n",
      "641:\tlearn: 0.3446811\ttotal: 6.24s\tremaining: 3.48s\n",
      "642:\tlearn: 0.3446094\ttotal: 6.25s\tremaining: 3.47s\n",
      "643:\tlearn: 0.3445374\ttotal: 6.26s\tremaining: 3.46s\n",
      "644:\tlearn: 0.3445027\ttotal: 6.26s\tremaining: 3.45s\n",
      "645:\tlearn: 0.3444467\ttotal: 6.27s\tremaining: 3.44s\n",
      "646:\tlearn: 0.3443662\ttotal: 6.28s\tremaining: 3.42s\n",
      "647:\tlearn: 0.3442808\ttotal: 6.29s\tremaining: 3.41s\n",
      "648:\tlearn: 0.3442123\ttotal: 6.29s\tremaining: 3.4s\n",
      "649:\tlearn: 0.3441778\ttotal: 6.3s\tremaining: 3.39s\n",
      "650:\tlearn: 0.3441068\ttotal: 6.31s\tremaining: 3.38s\n",
      "651:\tlearn: 0.3440728\ttotal: 6.33s\tremaining: 3.38s\n",
      "652:\tlearn: 0.3440239\ttotal: 6.33s\tremaining: 3.37s\n",
      "653:\tlearn: 0.3439733\ttotal: 6.34s\tremaining: 3.35s\n",
      "654:\tlearn: 0.3439004\ttotal: 6.35s\tremaining: 3.34s\n",
      "655:\tlearn: 0.3438344\ttotal: 6.36s\tremaining: 3.33s\n",
      "656:\tlearn: 0.3437867\ttotal: 6.37s\tremaining: 3.32s\n",
      "657:\tlearn: 0.3437056\ttotal: 6.37s\tremaining: 3.31s\n",
      "658:\tlearn: 0.3436372\ttotal: 6.38s\tremaining: 3.3s\n",
      "659:\tlearn: 0.3435843\ttotal: 6.39s\tremaining: 3.29s\n",
      "660:\tlearn: 0.3435047\ttotal: 6.4s\tremaining: 3.28s\n",
      "661:\tlearn: 0.3434317\ttotal: 6.42s\tremaining: 3.27s\n",
      "662:\tlearn: 0.3433453\ttotal: 6.42s\tremaining: 3.27s\n",
      "663:\tlearn: 0.3432829\ttotal: 6.44s\tremaining: 3.26s\n",
      "664:\tlearn: 0.3432247\ttotal: 6.45s\tremaining: 3.25s\n",
      "665:\tlearn: 0.3431735\ttotal: 6.46s\tremaining: 3.24s\n",
      "666:\tlearn: 0.3431176\ttotal: 6.46s\tremaining: 3.23s\n",
      "667:\tlearn: 0.3430901\ttotal: 6.47s\tremaining: 3.21s\n",
      "668:\tlearn: 0.3430180\ttotal: 6.48s\tremaining: 3.21s\n",
      "669:\tlearn: 0.3429225\ttotal: 6.49s\tremaining: 3.19s\n",
      "670:\tlearn: 0.3428430\ttotal: 6.5s\tremaining: 3.19s\n",
      "671:\tlearn: 0.3427589\ttotal: 6.51s\tremaining: 3.18s\n",
      "672:\tlearn: 0.3427034\ttotal: 6.52s\tremaining: 3.17s\n",
      "673:\tlearn: 0.3426319\ttotal: 6.53s\tremaining: 3.16s\n",
      "674:\tlearn: 0.3425782\ttotal: 6.54s\tremaining: 3.15s\n",
      "675:\tlearn: 0.3424860\ttotal: 6.55s\tremaining: 3.14s\n",
      "676:\tlearn: 0.3424293\ttotal: 6.57s\tremaining: 3.13s\n",
      "677:\tlearn: 0.3423695\ttotal: 6.58s\tremaining: 3.12s\n",
      "678:\tlearn: 0.3423436\ttotal: 6.59s\tremaining: 3.11s\n",
      "679:\tlearn: 0.3422762\ttotal: 6.6s\tremaining: 3.11s\n",
      "680:\tlearn: 0.3422131\ttotal: 6.61s\tremaining: 3.1s\n",
      "681:\tlearn: 0.3421406\ttotal: 6.62s\tremaining: 3.09s\n",
      "682:\tlearn: 0.3420901\ttotal: 6.63s\tremaining: 3.08s\n",
      "683:\tlearn: 0.3420336\ttotal: 6.64s\tremaining: 3.07s\n",
      "684:\tlearn: 0.3419768\ttotal: 6.64s\tremaining: 3.06s\n",
      "685:\tlearn: 0.3419170\ttotal: 6.65s\tremaining: 3.04s\n",
      "686:\tlearn: 0.3418528\ttotal: 6.66s\tremaining: 3.03s\n",
      "687:\tlearn: 0.3417889\ttotal: 6.69s\tremaining: 3.03s\n",
      "688:\tlearn: 0.3417382\ttotal: 6.7s\tremaining: 3.02s\n",
      "689:\tlearn: 0.3416736\ttotal: 6.7s\tremaining: 3.01s\n",
      "690:\tlearn: 0.3415901\ttotal: 6.71s\tremaining: 3s\n",
      "691:\tlearn: 0.3415158\ttotal: 6.72s\tremaining: 2.99s\n",
      "692:\tlearn: 0.3414728\ttotal: 6.73s\tremaining: 2.98s\n",
      "693:\tlearn: 0.3413963\ttotal: 6.73s\tremaining: 2.97s\n",
      "694:\tlearn: 0.3413180\ttotal: 6.74s\tremaining: 2.96s\n",
      "695:\tlearn: 0.3412532\ttotal: 6.75s\tremaining: 2.95s\n",
      "696:\tlearn: 0.3411945\ttotal: 6.75s\tremaining: 2.94s\n",
      "697:\tlearn: 0.3411329\ttotal: 6.76s\tremaining: 2.93s\n",
      "698:\tlearn: 0.3410932\ttotal: 6.77s\tremaining: 2.92s\n",
      "699:\tlearn: 0.3410134\ttotal: 6.78s\tremaining: 2.9s\n",
      "700:\tlearn: 0.3409361\ttotal: 6.79s\tremaining: 2.89s\n",
      "701:\tlearn: 0.3408480\ttotal: 6.8s\tremaining: 2.88s\n",
      "702:\tlearn: 0.3407747\ttotal: 6.81s\tremaining: 2.88s\n",
      "703:\tlearn: 0.3406943\ttotal: 6.82s\tremaining: 2.87s\n",
      "704:\tlearn: 0.3406140\ttotal: 6.83s\tremaining: 2.85s\n",
      "705:\tlearn: 0.3405313\ttotal: 6.83s\tremaining: 2.85s\n",
      "706:\tlearn: 0.3404622\ttotal: 6.84s\tremaining: 2.83s\n",
      "707:\tlearn: 0.3403996\ttotal: 6.85s\tremaining: 2.82s\n",
      "708:\tlearn: 0.3403726\ttotal: 6.87s\tremaining: 2.82s\n",
      "709:\tlearn: 0.3402835\ttotal: 6.87s\tremaining: 2.81s\n",
      "710:\tlearn: 0.3401912\ttotal: 6.88s\tremaining: 2.8s\n",
      "711:\tlearn: 0.3401184\ttotal: 6.89s\tremaining: 2.79s\n",
      "712:\tlearn: 0.3400638\ttotal: 6.9s\tremaining: 2.78s\n",
      "713:\tlearn: 0.3399751\ttotal: 6.91s\tremaining: 2.77s\n",
      "714:\tlearn: 0.3399162\ttotal: 6.92s\tremaining: 2.76s\n",
      "715:\tlearn: 0.3398762\ttotal: 6.93s\tremaining: 2.75s\n",
      "716:\tlearn: 0.3398445\ttotal: 6.94s\tremaining: 2.74s\n",
      "717:\tlearn: 0.3397746\ttotal: 6.96s\tremaining: 2.73s\n",
      "718:\tlearn: 0.3396959\ttotal: 6.97s\tremaining: 2.72s\n",
      "719:\tlearn: 0.3396482\ttotal: 6.97s\tremaining: 2.71s\n",
      "720:\tlearn: 0.3395783\ttotal: 6.98s\tremaining: 2.7s\n",
      "721:\tlearn: 0.3395325\ttotal: 6.99s\tremaining: 2.69s\n",
      "722:\tlearn: 0.3394555\ttotal: 7s\tremaining: 2.68s\n",
      "723:\tlearn: 0.3393929\ttotal: 7.01s\tremaining: 2.67s\n",
      "724:\tlearn: 0.3393373\ttotal: 7.02s\tremaining: 2.66s\n",
      "725:\tlearn: 0.3393007\ttotal: 7.04s\tremaining: 2.65s\n",
      "726:\tlearn: 0.3392563\ttotal: 7.05s\tremaining: 2.65s\n",
      "727:\tlearn: 0.3391759\ttotal: 7.06s\tremaining: 2.64s\n",
      "728:\tlearn: 0.3391347\ttotal: 7.07s\tremaining: 2.63s\n",
      "729:\tlearn: 0.3390619\ttotal: 7.08s\tremaining: 2.62s\n",
      "730:\tlearn: 0.3390077\ttotal: 7.08s\tremaining: 2.61s\n",
      "731:\tlearn: 0.3389785\ttotal: 7.09s\tremaining: 2.6s\n",
      "732:\tlearn: 0.3389080\ttotal: 7.1s\tremaining: 2.59s\n",
      "733:\tlearn: 0.3388245\ttotal: 7.11s\tremaining: 2.58s\n",
      "734:\tlearn: 0.3387187\ttotal: 7.11s\tremaining: 2.56s\n",
      "735:\tlearn: 0.3386471\ttotal: 7.12s\tremaining: 2.56s\n",
      "736:\tlearn: 0.3385792\ttotal: 7.14s\tremaining: 2.55s\n",
      "737:\tlearn: 0.3385021\ttotal: 7.16s\tremaining: 2.54s\n",
      "738:\tlearn: 0.3384414\ttotal: 7.16s\tremaining: 2.53s\n",
      "739:\tlearn: 0.3383976\ttotal: 7.17s\tremaining: 2.52s\n",
      "740:\tlearn: 0.3383500\ttotal: 7.18s\tremaining: 2.51s\n",
      "741:\tlearn: 0.3382908\ttotal: 7.19s\tremaining: 2.5s\n",
      "742:\tlearn: 0.3382180\ttotal: 7.2s\tremaining: 2.49s\n",
      "743:\tlearn: 0.3381674\ttotal: 7.2s\tremaining: 2.48s\n",
      "744:\tlearn: 0.3381110\ttotal: 7.21s\tremaining: 2.47s\n",
      "745:\tlearn: 0.3380594\ttotal: 7.23s\tremaining: 2.46s\n",
      "746:\tlearn: 0.3379988\ttotal: 7.24s\tremaining: 2.45s\n",
      "747:\tlearn: 0.3379032\ttotal: 7.25s\tremaining: 2.44s\n",
      "748:\tlearn: 0.3378505\ttotal: 7.25s\tremaining: 2.43s\n",
      "749:\tlearn: 0.3377823\ttotal: 7.26s\tremaining: 2.42s\n",
      "750:\tlearn: 0.3377193\ttotal: 7.28s\tremaining: 2.41s\n",
      "751:\tlearn: 0.3376469\ttotal: 7.28s\tremaining: 2.4s\n",
      "752:\tlearn: 0.3375944\ttotal: 7.29s\tremaining: 2.39s\n",
      "753:\tlearn: 0.3375173\ttotal: 7.3s\tremaining: 2.38s\n",
      "754:\tlearn: 0.3374423\ttotal: 7.31s\tremaining: 2.37s\n",
      "755:\tlearn: 0.3373731\ttotal: 7.31s\tremaining: 2.36s\n",
      "756:\tlearn: 0.3373166\ttotal: 7.32s\tremaining: 2.35s\n",
      "757:\tlearn: 0.3372505\ttotal: 7.33s\tremaining: 2.34s\n",
      "758:\tlearn: 0.3372078\ttotal: 7.34s\tremaining: 2.33s\n",
      "759:\tlearn: 0.3371348\ttotal: 7.34s\tremaining: 2.32s\n",
      "760:\tlearn: 0.3370624\ttotal: 7.35s\tremaining: 2.31s\n",
      "761:\tlearn: 0.3370007\ttotal: 7.36s\tremaining: 2.3s\n",
      "762:\tlearn: 0.3369142\ttotal: 7.37s\tremaining: 2.29s\n",
      "763:\tlearn: 0.3368987\ttotal: 7.37s\tremaining: 2.28s\n",
      "764:\tlearn: 0.3368430\ttotal: 7.38s\tremaining: 2.27s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "765:\tlearn: 0.3367927\ttotal: 7.4s\tremaining: 2.26s\n",
      "766:\tlearn: 0.3366911\ttotal: 7.41s\tremaining: 2.25s\n",
      "767:\tlearn: 0.3366321\ttotal: 7.42s\tremaining: 2.24s\n",
      "768:\tlearn: 0.3365635\ttotal: 7.43s\tremaining: 2.23s\n",
      "769:\tlearn: 0.3365114\ttotal: 7.44s\tremaining: 2.22s\n",
      "770:\tlearn: 0.3364665\ttotal: 7.44s\tremaining: 2.21s\n",
      "771:\tlearn: 0.3364045\ttotal: 7.45s\tremaining: 2.2s\n",
      "772:\tlearn: 0.3363457\ttotal: 7.46s\tremaining: 2.19s\n",
      "773:\tlearn: 0.3362921\ttotal: 7.46s\tremaining: 2.18s\n",
      "774:\tlearn: 0.3362503\ttotal: 7.47s\tremaining: 2.17s\n",
      "775:\tlearn: 0.3361935\ttotal: 7.48s\tremaining: 2.16s\n",
      "776:\tlearn: 0.3361393\ttotal: 7.5s\tremaining: 2.15s\n",
      "777:\tlearn: 0.3360741\ttotal: 7.51s\tremaining: 2.14s\n",
      "778:\tlearn: 0.3360021\ttotal: 7.52s\tremaining: 2.13s\n",
      "779:\tlearn: 0.3359533\ttotal: 7.53s\tremaining: 2.12s\n",
      "780:\tlearn: 0.3359201\ttotal: 7.54s\tremaining: 2.11s\n",
      "781:\tlearn: 0.3358411\ttotal: 7.55s\tremaining: 2.1s\n",
      "782:\tlearn: 0.3357602\ttotal: 7.56s\tremaining: 2.09s\n",
      "783:\tlearn: 0.3357118\ttotal: 7.56s\tremaining: 2.08s\n",
      "784:\tlearn: 0.3356465\ttotal: 7.57s\tremaining: 2.07s\n",
      "785:\tlearn: 0.3355883\ttotal: 7.59s\tremaining: 2.07s\n",
      "786:\tlearn: 0.3355288\ttotal: 7.6s\tremaining: 2.06s\n",
      "787:\tlearn: 0.3354743\ttotal: 7.61s\tremaining: 2.05s\n",
      "788:\tlearn: 0.3354043\ttotal: 7.61s\tremaining: 2.04s\n",
      "789:\tlearn: 0.3353437\ttotal: 7.63s\tremaining: 2.03s\n",
      "790:\tlearn: 0.3352699\ttotal: 7.64s\tremaining: 2.02s\n",
      "791:\tlearn: 0.3352137\ttotal: 7.64s\tremaining: 2.01s\n",
      "792:\tlearn: 0.3351570\ttotal: 7.65s\tremaining: 2s\n",
      "793:\tlearn: 0.3350994\ttotal: 7.66s\tremaining: 1.99s\n",
      "794:\tlearn: 0.3350354\ttotal: 7.68s\tremaining: 1.98s\n",
      "795:\tlearn: 0.3349764\ttotal: 7.69s\tremaining: 1.97s\n",
      "796:\tlearn: 0.3349006\ttotal: 7.69s\tremaining: 1.96s\n",
      "797:\tlearn: 0.3348180\ttotal: 7.7s\tremaining: 1.95s\n",
      "798:\tlearn: 0.3347883\ttotal: 7.71s\tremaining: 1.94s\n",
      "799:\tlearn: 0.3347446\ttotal: 7.71s\tremaining: 1.93s\n",
      "800:\tlearn: 0.3346691\ttotal: 7.72s\tremaining: 1.92s\n",
      "801:\tlearn: 0.3346193\ttotal: 7.73s\tremaining: 1.91s\n",
      "802:\tlearn: 0.3345563\ttotal: 7.74s\tremaining: 1.9s\n",
      "803:\tlearn: 0.3344892\ttotal: 7.75s\tremaining: 1.89s\n",
      "804:\tlearn: 0.3344066\ttotal: 7.77s\tremaining: 1.88s\n",
      "805:\tlearn: 0.3343660\ttotal: 7.78s\tremaining: 1.87s\n",
      "806:\tlearn: 0.3343243\ttotal: 7.78s\tremaining: 1.86s\n",
      "807:\tlearn: 0.3342808\ttotal: 7.79s\tremaining: 1.85s\n",
      "808:\tlearn: 0.3342062\ttotal: 7.8s\tremaining: 1.84s\n",
      "809:\tlearn: 0.3341795\ttotal: 7.81s\tremaining: 1.83s\n",
      "810:\tlearn: 0.3341336\ttotal: 7.81s\tremaining: 1.82s\n",
      "811:\tlearn: 0.3340571\ttotal: 7.82s\tremaining: 1.81s\n",
      "812:\tlearn: 0.3339791\ttotal: 7.83s\tremaining: 1.8s\n",
      "813:\tlearn: 0.3339194\ttotal: 7.84s\tremaining: 1.79s\n",
      "814:\tlearn: 0.3338091\ttotal: 7.84s\tremaining: 1.78s\n",
      "815:\tlearn: 0.3337684\ttotal: 7.87s\tremaining: 1.77s\n",
      "816:\tlearn: 0.3337099\ttotal: 7.88s\tremaining: 1.76s\n",
      "817:\tlearn: 0.3336698\ttotal: 7.88s\tremaining: 1.75s\n",
      "818:\tlearn: 0.3335872\ttotal: 7.89s\tremaining: 1.74s\n",
      "819:\tlearn: 0.3334969\ttotal: 7.9s\tremaining: 1.73s\n",
      "820:\tlearn: 0.3334485\ttotal: 7.91s\tremaining: 1.72s\n",
      "821:\tlearn: 0.3333791\ttotal: 7.91s\tremaining: 1.71s\n",
      "822:\tlearn: 0.3333402\ttotal: 7.92s\tremaining: 1.7s\n",
      "823:\tlearn: 0.3332828\ttotal: 7.93s\tremaining: 1.69s\n",
      "824:\tlearn: 0.3332210\ttotal: 7.94s\tremaining: 1.68s\n",
      "825:\tlearn: 0.3331567\ttotal: 7.95s\tremaining: 1.68s\n",
      "826:\tlearn: 0.3331026\ttotal: 7.96s\tremaining: 1.67s\n",
      "827:\tlearn: 0.3330256\ttotal: 7.97s\tremaining: 1.66s\n",
      "828:\tlearn: 0.3329475\ttotal: 7.98s\tremaining: 1.65s\n",
      "829:\tlearn: 0.3328953\ttotal: 8.01s\tremaining: 1.64s\n",
      "830:\tlearn: 0.3328256\ttotal: 8.02s\tremaining: 1.63s\n",
      "831:\tlearn: 0.3327756\ttotal: 8.03s\tremaining: 1.62s\n",
      "832:\tlearn: 0.3327421\ttotal: 8.05s\tremaining: 1.61s\n",
      "833:\tlearn: 0.3326760\ttotal: 8.06s\tremaining: 1.6s\n",
      "834:\tlearn: 0.3326232\ttotal: 8.07s\tremaining: 1.59s\n",
      "835:\tlearn: 0.3325658\ttotal: 8.08s\tremaining: 1.58s\n",
      "836:\tlearn: 0.3324909\ttotal: 8.09s\tremaining: 1.57s\n",
      "837:\tlearn: 0.3324353\ttotal: 8.09s\tremaining: 1.56s\n",
      "838:\tlearn: 0.3323788\ttotal: 8.11s\tremaining: 1.56s\n",
      "839:\tlearn: 0.3323234\ttotal: 8.12s\tremaining: 1.55s\n",
      "840:\tlearn: 0.3322698\ttotal: 8.14s\tremaining: 1.54s\n",
      "841:\tlearn: 0.3321998\ttotal: 8.14s\tremaining: 1.53s\n",
      "842:\tlearn: 0.3321576\ttotal: 8.15s\tremaining: 1.52s\n",
      "843:\tlearn: 0.3321138\ttotal: 8.16s\tremaining: 1.51s\n",
      "844:\tlearn: 0.3320607\ttotal: 8.17s\tremaining: 1.5s\n",
      "845:\tlearn: 0.3320421\ttotal: 8.17s\tremaining: 1.49s\n",
      "846:\tlearn: 0.3319605\ttotal: 8.18s\tremaining: 1.48s\n",
      "847:\tlearn: 0.3318736\ttotal: 8.19s\tremaining: 1.47s\n",
      "848:\tlearn: 0.3318299\ttotal: 8.2s\tremaining: 1.46s\n",
      "849:\tlearn: 0.3317890\ttotal: 8.2s\tremaining: 1.45s\n",
      "850:\tlearn: 0.3317413\ttotal: 8.21s\tremaining: 1.44s\n",
      "851:\tlearn: 0.3316705\ttotal: 8.23s\tremaining: 1.43s\n",
      "852:\tlearn: 0.3316218\ttotal: 8.24s\tremaining: 1.42s\n",
      "853:\tlearn: 0.3315399\ttotal: 8.25s\tremaining: 1.41s\n",
      "854:\tlearn: 0.3314820\ttotal: 8.26s\tremaining: 1.4s\n",
      "855:\tlearn: 0.3313946\ttotal: 8.27s\tremaining: 1.39s\n",
      "856:\tlearn: 0.3313515\ttotal: 8.27s\tremaining: 1.38s\n",
      "857:\tlearn: 0.3313045\ttotal: 8.28s\tremaining: 1.37s\n",
      "858:\tlearn: 0.3312380\ttotal: 8.29s\tremaining: 1.36s\n",
      "859:\tlearn: 0.3311822\ttotal: 8.29s\tremaining: 1.35s\n",
      "860:\tlearn: 0.3311234\ttotal: 8.31s\tremaining: 1.34s\n",
      "861:\tlearn: 0.3310447\ttotal: 8.32s\tremaining: 1.33s\n",
      "862:\tlearn: 0.3310074\ttotal: 8.33s\tremaining: 1.32s\n",
      "863:\tlearn: 0.3309417\ttotal: 8.34s\tremaining: 1.31s\n",
      "864:\tlearn: 0.3309008\ttotal: 8.35s\tremaining: 1.3s\n",
      "865:\tlearn: 0.3308596\ttotal: 8.36s\tremaining: 1.29s\n",
      "866:\tlearn: 0.3307956\ttotal: 8.37s\tremaining: 1.28s\n",
      "867:\tlearn: 0.3307637\ttotal: 8.37s\tremaining: 1.27s\n",
      "868:\tlearn: 0.3307159\ttotal: 8.38s\tremaining: 1.26s\n",
      "869:\tlearn: 0.3306519\ttotal: 8.39s\tremaining: 1.25s\n",
      "870:\tlearn: 0.3306100\ttotal: 8.4s\tremaining: 1.24s\n",
      "871:\tlearn: 0.3305223\ttotal: 8.41s\tremaining: 1.24s\n",
      "872:\tlearn: 0.3304594\ttotal: 8.42s\tremaining: 1.23s\n",
      "873:\tlearn: 0.3303749\ttotal: 8.43s\tremaining: 1.22s\n",
      "874:\tlearn: 0.3303371\ttotal: 8.44s\tremaining: 1.21s\n",
      "875:\tlearn: 0.3302743\ttotal: 8.45s\tremaining: 1.2s\n",
      "876:\tlearn: 0.3302033\ttotal: 8.45s\tremaining: 1.19s\n",
      "877:\tlearn: 0.3301101\ttotal: 8.47s\tremaining: 1.18s\n",
      "878:\tlearn: 0.3300512\ttotal: 8.48s\tremaining: 1.17s\n",
      "879:\tlearn: 0.3299802\ttotal: 8.5s\tremaining: 1.16s\n",
      "880:\tlearn: 0.3299469\ttotal: 8.5s\tremaining: 1.15s\n",
      "881:\tlearn: 0.3298801\ttotal: 8.51s\tremaining: 1.14s\n",
      "882:\tlearn: 0.3298289\ttotal: 8.52s\tremaining: 1.13s\n",
      "883:\tlearn: 0.3297804\ttotal: 8.53s\tremaining: 1.12s\n",
      "884:\tlearn: 0.3297247\ttotal: 8.54s\tremaining: 1.11s\n",
      "885:\tlearn: 0.3296428\ttotal: 8.54s\tremaining: 1.1s\n",
      "886:\tlearn: 0.3295825\ttotal: 8.55s\tremaining: 1.09s\n",
      "887:\tlearn: 0.3295248\ttotal: 8.56s\tremaining: 1.08s\n",
      "888:\tlearn: 0.3294493\ttotal: 8.57s\tremaining: 1.07s\n",
      "889:\tlearn: 0.3294010\ttotal: 8.59s\tremaining: 1.06s\n",
      "890:\tlearn: 0.3293447\ttotal: 8.6s\tremaining: 1.05s\n",
      "891:\tlearn: 0.3293179\ttotal: 8.61s\tremaining: 1.04s\n",
      "892:\tlearn: 0.3292789\ttotal: 8.61s\tremaining: 1.03s\n",
      "893:\tlearn: 0.3292138\ttotal: 8.62s\tremaining: 1.02s\n",
      "894:\tlearn: 0.3291373\ttotal: 8.63s\tremaining: 1.01s\n",
      "895:\tlearn: 0.3290872\ttotal: 8.64s\tremaining: 1s\n",
      "896:\tlearn: 0.3290360\ttotal: 8.64s\tremaining: 993ms\n",
      "897:\tlearn: 0.3289856\ttotal: 8.65s\tremaining: 983ms\n",
      "898:\tlearn: 0.3289279\ttotal: 8.66s\tremaining: 973ms\n",
      "899:\tlearn: 0.3288731\ttotal: 8.68s\tremaining: 964ms\n",
      "900:\tlearn: 0.3288249\ttotal: 8.68s\tremaining: 954ms\n",
      "901:\tlearn: 0.3287513\ttotal: 8.69s\tremaining: 944ms\n",
      "902:\tlearn: 0.3286890\ttotal: 8.7s\tremaining: 935ms\n",
      "903:\tlearn: 0.3286520\ttotal: 8.71s\tremaining: 925ms\n",
      "904:\tlearn: 0.3285733\ttotal: 8.72s\tremaining: 915ms\n",
      "905:\tlearn: 0.3285031\ttotal: 8.73s\tremaining: 906ms\n",
      "906:\tlearn: 0.3284427\ttotal: 8.73s\tremaining: 896ms\n",
      "907:\tlearn: 0.3283674\ttotal: 8.74s\tremaining: 886ms\n",
      "908:\tlearn: 0.3282742\ttotal: 8.76s\tremaining: 877ms\n",
      "909:\tlearn: 0.3282164\ttotal: 8.77s\tremaining: 867ms\n",
      "910:\tlearn: 0.3281462\ttotal: 8.78s\tremaining: 857ms\n",
      "911:\tlearn: 0.3280747\ttotal: 8.78s\tremaining: 848ms\n",
      "912:\tlearn: 0.3280040\ttotal: 8.79s\tremaining: 838ms\n",
      "913:\tlearn: 0.3279502\ttotal: 8.8s\tremaining: 828ms\n",
      "914:\tlearn: 0.3279263\ttotal: 8.8s\tremaining: 818ms\n",
      "915:\tlearn: 0.3278699\ttotal: 8.81s\tremaining: 808ms\n",
      "916:\tlearn: 0.3278197\ttotal: 8.82s\tremaining: 799ms\n",
      "917:\tlearn: 0.3277557\ttotal: 8.83s\tremaining: 789ms\n",
      "918:\tlearn: 0.3276678\ttotal: 8.85s\tremaining: 780ms\n",
      "919:\tlearn: 0.3276176\ttotal: 8.86s\tremaining: 771ms\n",
      "920:\tlearn: 0.3275466\ttotal: 8.87s\tremaining: 761ms\n",
      "921:\tlearn: 0.3274865\ttotal: 8.88s\tremaining: 751ms\n",
      "922:\tlearn: 0.3274164\ttotal: 8.88s\tremaining: 741ms\n",
      "923:\tlearn: 0.3273784\ttotal: 8.89s\tremaining: 731ms\n",
      "924:\tlearn: 0.3273286\ttotal: 8.9s\tremaining: 722ms\n",
      "925:\tlearn: 0.3272691\ttotal: 8.91s\tremaining: 712ms\n",
      "926:\tlearn: 0.3272309\ttotal: 8.91s\tremaining: 702ms\n",
      "927:\tlearn: 0.3272059\ttotal: 8.92s\tremaining: 692ms\n",
      "928:\tlearn: 0.3271415\ttotal: 8.94s\tremaining: 683ms\n",
      "929:\tlearn: 0.3270866\ttotal: 8.95s\tremaining: 674ms\n",
      "930:\tlearn: 0.3270201\ttotal: 8.96s\tremaining: 664ms\n",
      "931:\tlearn: 0.3269590\ttotal: 8.97s\tremaining: 654ms\n",
      "932:\tlearn: 0.3269230\ttotal: 8.97s\tremaining: 645ms\n",
      "933:\tlearn: 0.3268780\ttotal: 8.98s\tremaining: 635ms\n",
      "934:\tlearn: 0.3268067\ttotal: 8.99s\tremaining: 625ms\n",
      "935:\tlearn: 0.3267284\ttotal: 9s\tremaining: 615ms\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "936:\tlearn: 0.3266558\ttotal: 9.01s\tremaining: 606ms\n",
      "937:\tlearn: 0.3266178\ttotal: 9.01s\tremaining: 596ms\n",
      "938:\tlearn: 0.3265806\ttotal: 9.04s\tremaining: 587ms\n",
      "939:\tlearn: 0.3265138\ttotal: 9.06s\tremaining: 578ms\n",
      "940:\tlearn: 0.3264486\ttotal: 9.07s\tremaining: 568ms\n",
      "941:\tlearn: 0.3263976\ttotal: 9.07s\tremaining: 559ms\n",
      "942:\tlearn: 0.3263447\ttotal: 9.08s\tremaining: 549ms\n",
      "943:\tlearn: 0.3262999\ttotal: 9.09s\tremaining: 539ms\n",
      "944:\tlearn: 0.3262241\ttotal: 9.1s\tremaining: 529ms\n",
      "945:\tlearn: 0.3261565\ttotal: 9.11s\tremaining: 520ms\n",
      "946:\tlearn: 0.3261301\ttotal: 9.12s\tremaining: 510ms\n",
      "947:\tlearn: 0.3260880\ttotal: 9.13s\tremaining: 501ms\n",
      "948:\tlearn: 0.3260452\ttotal: 9.14s\tremaining: 491ms\n",
      "949:\tlearn: 0.3259954\ttotal: 9.14s\tremaining: 481ms\n",
      "950:\tlearn: 0.3259684\ttotal: 9.15s\tremaining: 472ms\n",
      "951:\tlearn: 0.3259258\ttotal: 9.16s\tremaining: 462ms\n",
      "952:\tlearn: 0.3258801\ttotal: 9.17s\tremaining: 452ms\n",
      "953:\tlearn: 0.3258055\ttotal: 9.18s\tremaining: 443ms\n",
      "954:\tlearn: 0.3257593\ttotal: 9.19s\tremaining: 433ms\n",
      "955:\tlearn: 0.3256912\ttotal: 9.19s\tremaining: 423ms\n",
      "956:\tlearn: 0.3256389\ttotal: 9.21s\tremaining: 414ms\n",
      "957:\tlearn: 0.3255848\ttotal: 9.22s\tremaining: 404ms\n",
      "958:\tlearn: 0.3255330\ttotal: 9.23s\tremaining: 395ms\n",
      "959:\tlearn: 0.3254647\ttotal: 9.24s\tremaining: 385ms\n",
      "960:\tlearn: 0.3253921\ttotal: 9.24s\tremaining: 375ms\n",
      "961:\tlearn: 0.3253456\ttotal: 9.25s\tremaining: 365ms\n",
      "962:\tlearn: 0.3252713\ttotal: 9.26s\tremaining: 356ms\n",
      "963:\tlearn: 0.3252309\ttotal: 9.27s\tremaining: 346ms\n",
      "964:\tlearn: 0.3251809\ttotal: 9.27s\tremaining: 336ms\n",
      "965:\tlearn: 0.3251389\ttotal: 9.28s\tremaining: 327ms\n",
      "966:\tlearn: 0.3251236\ttotal: 9.31s\tremaining: 318ms\n",
      "967:\tlearn: 0.3250632\ttotal: 9.32s\tremaining: 308ms\n",
      "968:\tlearn: 0.3250078\ttotal: 9.33s\tremaining: 298ms\n",
      "969:\tlearn: 0.3249437\ttotal: 9.33s\tremaining: 289ms\n",
      "970:\tlearn: 0.3248855\ttotal: 9.34s\tremaining: 279ms\n",
      "971:\tlearn: 0.3248278\ttotal: 9.35s\tremaining: 269ms\n",
      "972:\tlearn: 0.3247883\ttotal: 9.36s\tremaining: 260ms\n",
      "973:\tlearn: 0.3247385\ttotal: 9.36s\tremaining: 250ms\n",
      "974:\tlearn: 0.3246879\ttotal: 9.37s\tremaining: 240ms\n",
      "975:\tlearn: 0.3246206\ttotal: 9.38s\tremaining: 231ms\n",
      "976:\tlearn: 0.3245951\ttotal: 9.39s\tremaining: 221ms\n",
      "977:\tlearn: 0.3245835\ttotal: 9.4s\tremaining: 212ms\n",
      "978:\tlearn: 0.3245435\ttotal: 9.42s\tremaining: 202ms\n",
      "979:\tlearn: 0.3244847\ttotal: 9.43s\tremaining: 192ms\n",
      "980:\tlearn: 0.3244054\ttotal: 9.43s\tremaining: 183ms\n",
      "981:\tlearn: 0.3243413\ttotal: 9.44s\tremaining: 173ms\n",
      "982:\tlearn: 0.3243048\ttotal: 9.45s\tremaining: 163ms\n",
      "983:\tlearn: 0.3242741\ttotal: 9.46s\tremaining: 154ms\n",
      "984:\tlearn: 0.3241874\ttotal: 9.47s\tremaining: 144ms\n",
      "985:\tlearn: 0.3241536\ttotal: 9.48s\tremaining: 135ms\n",
      "986:\tlearn: 0.3240987\ttotal: 9.49s\tremaining: 125ms\n",
      "987:\tlearn: 0.3240287\ttotal: 9.5s\tremaining: 115ms\n",
      "988:\tlearn: 0.3239721\ttotal: 9.51s\tremaining: 106ms\n",
      "989:\tlearn: 0.3239550\ttotal: 9.52s\tremaining: 96.1ms\n",
      "990:\tlearn: 0.3239043\ttotal: 9.54s\tremaining: 86.6ms\n",
      "991:\tlearn: 0.3238671\ttotal: 9.54s\tremaining: 77ms\n",
      "992:\tlearn: 0.3238267\ttotal: 9.56s\tremaining: 67.4ms\n",
      "993:\tlearn: 0.3237790\ttotal: 9.58s\tremaining: 57.8ms\n",
      "994:\tlearn: 0.3237478\ttotal: 9.59s\tremaining: 48.2ms\n",
      "995:\tlearn: 0.3237000\ttotal: 9.6s\tremaining: 38.6ms\n",
      "996:\tlearn: 0.3236437\ttotal: 9.62s\tremaining: 28.9ms\n",
      "997:\tlearn: 0.3235551\ttotal: 9.63s\tremaining: 19.3ms\n",
      "998:\tlearn: 0.3234932\ttotal: 9.64s\tremaining: 9.65ms\n",
      "999:\tlearn: 0.3234340\ttotal: 9.68s\tremaining: 0us\n",
      "Learning rate set to 0.059278\n",
      "0:\tlearn: 0.6562347\ttotal: 13.5ms\tremaining: 13.5s\n",
      "1:\tlearn: 0.6230225\ttotal: 25.6ms\tremaining: 12.8s\n",
      "2:\tlearn: 0.5944036\ttotal: 50ms\tremaining: 16.6s\n",
      "3:\tlearn: 0.5707223\ttotal: 60.1ms\tremaining: 15s\n",
      "4:\tlearn: 0.5501725\ttotal: 69.3ms\tremaining: 13.8s\n",
      "5:\tlearn: 0.5317614\ttotal: 77.6ms\tremaining: 12.9s\n",
      "6:\tlearn: 0.5157495\ttotal: 85.2ms\tremaining: 12.1s\n",
      "7:\tlearn: 0.5020094\ttotal: 92.4ms\tremaining: 11.5s\n",
      "8:\tlearn: 0.4911742\ttotal: 99.5ms\tremaining: 11s\n",
      "9:\tlearn: 0.4816701\ttotal: 107ms\tremaining: 10.6s\n",
      "10:\tlearn: 0.4728261\ttotal: 131ms\tremaining: 11.8s\n",
      "11:\tlearn: 0.4650580\ttotal: 146ms\tremaining: 12s\n",
      "12:\tlearn: 0.4588385\ttotal: 155ms\tremaining: 11.8s\n",
      "13:\tlearn: 0.4535654\ttotal: 164ms\tremaining: 11.6s\n",
      "14:\tlearn: 0.4485679\ttotal: 174ms\tremaining: 11.4s\n",
      "15:\tlearn: 0.4444219\ttotal: 182ms\tremaining: 11.2s\n",
      "16:\tlearn: 0.4406588\ttotal: 192ms\tremaining: 11.1s\n",
      "17:\tlearn: 0.4369099\ttotal: 200ms\tremaining: 10.9s\n",
      "18:\tlearn: 0.4336500\ttotal: 208ms\tremaining: 10.7s\n",
      "19:\tlearn: 0.4306736\ttotal: 226ms\tremaining: 11.1s\n",
      "20:\tlearn: 0.4278125\ttotal: 241ms\tremaining: 11.2s\n",
      "21:\tlearn: 0.4255001\ttotal: 249ms\tremaining: 11.1s\n",
      "22:\tlearn: 0.4238543\ttotal: 257ms\tremaining: 10.9s\n",
      "23:\tlearn: 0.4221859\ttotal: 265ms\tremaining: 10.8s\n",
      "24:\tlearn: 0.4204676\ttotal: 272ms\tremaining: 10.6s\n",
      "25:\tlearn: 0.4193768\ttotal: 280ms\tremaining: 10.5s\n",
      "26:\tlearn: 0.4183445\ttotal: 287ms\tremaining: 10.3s\n",
      "27:\tlearn: 0.4171908\ttotal: 295ms\tremaining: 10.2s\n",
      "28:\tlearn: 0.4160441\ttotal: 308ms\tremaining: 10.3s\n",
      "29:\tlearn: 0.4153559\ttotal: 315ms\tremaining: 10.2s\n",
      "30:\tlearn: 0.4142779\ttotal: 323ms\tremaining: 10.1s\n",
      "31:\tlearn: 0.4137650\ttotal: 330ms\tremaining: 9.98s\n",
      "32:\tlearn: 0.4127191\ttotal: 337ms\tremaining: 9.88s\n",
      "33:\tlearn: 0.4120732\ttotal: 344ms\tremaining: 9.77s\n",
      "34:\tlearn: 0.4114276\ttotal: 356ms\tremaining: 9.81s\n",
      "35:\tlearn: 0.4108879\ttotal: 364ms\tremaining: 9.73s\n",
      "36:\tlearn: 0.4103086\ttotal: 371ms\tremaining: 9.65s\n",
      "37:\tlearn: 0.4096962\ttotal: 378ms\tremaining: 9.57s\n",
      "38:\tlearn: 0.4091916\ttotal: 386ms\tremaining: 9.5s\n",
      "39:\tlearn: 0.4085485\ttotal: 404ms\tremaining: 9.7s\n",
      "40:\tlearn: 0.4079975\ttotal: 411ms\tremaining: 9.62s\n",
      "41:\tlearn: 0.4074087\ttotal: 420ms\tremaining: 9.58s\n",
      "42:\tlearn: 0.4068981\ttotal: 428ms\tremaining: 9.53s\n",
      "43:\tlearn: 0.4065485\ttotal: 436ms\tremaining: 9.47s\n",
      "44:\tlearn: 0.4062163\ttotal: 443ms\tremaining: 9.39s\n",
      "45:\tlearn: 0.4058284\ttotal: 452ms\tremaining: 9.37s\n",
      "46:\tlearn: 0.4054037\ttotal: 459ms\tremaining: 9.31s\n",
      "47:\tlearn: 0.4051352\ttotal: 472ms\tremaining: 9.37s\n",
      "48:\tlearn: 0.4047828\ttotal: 494ms\tremaining: 9.58s\n",
      "49:\tlearn: 0.4044195\ttotal: 503ms\tremaining: 9.55s\n",
      "50:\tlearn: 0.4040403\ttotal: 512ms\tremaining: 9.53s\n",
      "51:\tlearn: 0.4036984\ttotal: 522ms\tremaining: 9.51s\n",
      "52:\tlearn: 0.4034464\ttotal: 530ms\tremaining: 9.48s\n",
      "53:\tlearn: 0.4032254\ttotal: 538ms\tremaining: 9.43s\n",
      "54:\tlearn: 0.4029247\ttotal: 547ms\tremaining: 9.39s\n",
      "55:\tlearn: 0.4026808\ttotal: 554ms\tremaining: 9.34s\n",
      "56:\tlearn: 0.4024760\ttotal: 561ms\tremaining: 9.29s\n",
      "57:\tlearn: 0.4021964\ttotal: 571ms\tremaining: 9.27s\n",
      "58:\tlearn: 0.4019189\ttotal: 593ms\tremaining: 9.46s\n",
      "59:\tlearn: 0.4016775\ttotal: 603ms\tremaining: 9.44s\n",
      "60:\tlearn: 0.4013675\ttotal: 613ms\tremaining: 9.44s\n",
      "61:\tlearn: 0.4010684\ttotal: 623ms\tremaining: 9.42s\n",
      "62:\tlearn: 0.4007416\ttotal: 630ms\tremaining: 9.37s\n",
      "63:\tlearn: 0.4005014\ttotal: 638ms\tremaining: 9.33s\n",
      "64:\tlearn: 0.4003151\ttotal: 645ms\tremaining: 9.28s\n",
      "65:\tlearn: 0.4000760\ttotal: 653ms\tremaining: 9.24s\n",
      "66:\tlearn: 0.3997622\ttotal: 668ms\tremaining: 9.29s\n",
      "67:\tlearn: 0.3995229\ttotal: 676ms\tremaining: 9.26s\n",
      "68:\tlearn: 0.3992738\ttotal: 683ms\tremaining: 9.22s\n",
      "69:\tlearn: 0.3990853\ttotal: 690ms\tremaining: 9.17s\n",
      "70:\tlearn: 0.3989413\ttotal: 697ms\tremaining: 9.12s\n",
      "71:\tlearn: 0.3987328\ttotal: 712ms\tremaining: 9.18s\n",
      "72:\tlearn: 0.3985870\ttotal: 720ms\tremaining: 9.14s\n",
      "73:\tlearn: 0.3983531\ttotal: 727ms\tremaining: 9.1s\n",
      "74:\tlearn: 0.3981040\ttotal: 734ms\tremaining: 9.06s\n",
      "75:\tlearn: 0.3978859\ttotal: 742ms\tremaining: 9.02s\n",
      "76:\tlearn: 0.3977039\ttotal: 758ms\tremaining: 9.09s\n",
      "77:\tlearn: 0.3975347\ttotal: 766ms\tremaining: 9.05s\n",
      "78:\tlearn: 0.3973337\ttotal: 773ms\tremaining: 9.02s\n",
      "79:\tlearn: 0.3971996\ttotal: 781ms\tremaining: 8.98s\n",
      "80:\tlearn: 0.3970722\ttotal: 788ms\tremaining: 8.94s\n",
      "81:\tlearn: 0.3969157\ttotal: 795ms\tremaining: 8.9s\n",
      "82:\tlearn: 0.3968076\ttotal: 801ms\tremaining: 8.85s\n",
      "83:\tlearn: 0.3966450\ttotal: 808ms\tremaining: 8.81s\n",
      "84:\tlearn: 0.3964730\ttotal: 815ms\tremaining: 8.77s\n",
      "85:\tlearn: 0.3963277\ttotal: 830ms\tremaining: 8.82s\n",
      "86:\tlearn: 0.3961872\ttotal: 839ms\tremaining: 8.81s\n",
      "87:\tlearn: 0.3960356\ttotal: 856ms\tremaining: 8.87s\n",
      "88:\tlearn: 0.3957514\ttotal: 865ms\tremaining: 8.85s\n",
      "89:\tlearn: 0.3955857\ttotal: 872ms\tremaining: 8.82s\n",
      "90:\tlearn: 0.3952883\ttotal: 880ms\tremaining: 8.79s\n",
      "91:\tlearn: 0.3950943\ttotal: 888ms\tremaining: 8.76s\n",
      "92:\tlearn: 0.3949654\ttotal: 895ms\tremaining: 8.72s\n",
      "93:\tlearn: 0.3947870\ttotal: 902ms\tremaining: 8.69s\n",
      "94:\tlearn: 0.3946256\ttotal: 909ms\tremaining: 8.66s\n",
      "95:\tlearn: 0.3944493\ttotal: 916ms\tremaining: 8.62s\n",
      "96:\tlearn: 0.3943234\ttotal: 923ms\tremaining: 8.59s\n",
      "97:\tlearn: 0.3941363\ttotal: 935ms\tremaining: 8.6s\n",
      "98:\tlearn: 0.3940162\ttotal: 954ms\tremaining: 8.68s\n",
      "99:\tlearn: 0.3938651\ttotal: 962ms\tremaining: 8.65s\n",
      "100:\tlearn: 0.3937440\ttotal: 969ms\tremaining: 8.63s\n",
      "101:\tlearn: 0.3936309\ttotal: 976ms\tremaining: 8.6s\n",
      "102:\tlearn: 0.3934660\ttotal: 984ms\tremaining: 8.57s\n",
      "103:\tlearn: 0.3933318\ttotal: 992ms\tremaining: 8.54s\n",
      "104:\tlearn: 0.3931837\ttotal: 999ms\tremaining: 8.51s\n",
      "105:\tlearn: 0.3930233\ttotal: 1.01s\tremaining: 8.49s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "106:\tlearn: 0.3929512\ttotal: 1.01s\tremaining: 8.46s\n",
      "107:\tlearn: 0.3927783\ttotal: 1.03s\tremaining: 8.55s\n",
      "108:\tlearn: 0.3925405\ttotal: 1.04s\tremaining: 8.52s\n",
      "109:\tlearn: 0.3923505\ttotal: 1.05s\tremaining: 8.5s\n",
      "110:\tlearn: 0.3921462\ttotal: 1.06s\tremaining: 8.5s\n",
      "111:\tlearn: 0.3919085\ttotal: 1.07s\tremaining: 8.52s\n",
      "112:\tlearn: 0.3917441\ttotal: 1.08s\tremaining: 8.49s\n",
      "113:\tlearn: 0.3916071\ttotal: 1.09s\tremaining: 8.47s\n",
      "114:\tlearn: 0.3915212\ttotal: 1.1s\tremaining: 8.44s\n",
      "115:\tlearn: 0.3913989\ttotal: 1.1s\tremaining: 8.41s\n",
      "116:\tlearn: 0.3913128\ttotal: 1.12s\tremaining: 8.43s\n",
      "117:\tlearn: 0.3912355\ttotal: 1.13s\tremaining: 8.43s\n",
      "118:\tlearn: 0.3911114\ttotal: 1.14s\tremaining: 8.4s\n",
      "119:\tlearn: 0.3909296\ttotal: 1.14s\tremaining: 8.38s\n",
      "120:\tlearn: 0.3907803\ttotal: 1.15s\tremaining: 8.35s\n",
      "121:\tlearn: 0.3906597\ttotal: 1.16s\tremaining: 8.33s\n",
      "122:\tlearn: 0.3904778\ttotal: 1.16s\tremaining: 8.3s\n",
      "123:\tlearn: 0.3903564\ttotal: 1.17s\tremaining: 8.28s\n",
      "124:\tlearn: 0.3901664\ttotal: 1.18s\tremaining: 8.27s\n",
      "125:\tlearn: 0.3900972\ttotal: 1.19s\tremaining: 8.26s\n",
      "126:\tlearn: 0.3900126\ttotal: 1.2s\tremaining: 8.24s\n",
      "127:\tlearn: 0.3898599\ttotal: 1.22s\tremaining: 8.3s\n",
      "128:\tlearn: 0.3897399\ttotal: 1.23s\tremaining: 8.29s\n",
      "129:\tlearn: 0.3896461\ttotal: 1.23s\tremaining: 8.26s\n",
      "130:\tlearn: 0.3895135\ttotal: 1.24s\tremaining: 8.24s\n",
      "131:\tlearn: 0.3894098\ttotal: 1.25s\tremaining: 8.22s\n",
      "132:\tlearn: 0.3893466\ttotal: 1.26s\tremaining: 8.19s\n",
      "133:\tlearn: 0.3892119\ttotal: 1.26s\tremaining: 8.17s\n",
      "134:\tlearn: 0.3891133\ttotal: 1.27s\tremaining: 8.14s\n",
      "135:\tlearn: 0.3890248\ttotal: 1.28s\tremaining: 8.12s\n",
      "136:\tlearn: 0.3889293\ttotal: 1.28s\tremaining: 8.09s\n",
      "137:\tlearn: 0.3887825\ttotal: 1.29s\tremaining: 8.08s\n",
      "138:\tlearn: 0.3887086\ttotal: 1.31s\tremaining: 8.15s\n",
      "139:\tlearn: 0.3885991\ttotal: 1.32s\tremaining: 8.13s\n",
      "140:\tlearn: 0.3884898\ttotal: 1.33s\tremaining: 8.11s\n",
      "141:\tlearn: 0.3883605\ttotal: 1.34s\tremaining: 8.09s\n",
      "142:\tlearn: 0.3882129\ttotal: 1.34s\tremaining: 8.07s\n",
      "143:\tlearn: 0.3880902\ttotal: 1.35s\tremaining: 8.04s\n",
      "144:\tlearn: 0.3879888\ttotal: 1.36s\tremaining: 8.02s\n",
      "145:\tlearn: 0.3878893\ttotal: 1.37s\tremaining: 8s\n",
      "146:\tlearn: 0.3877958\ttotal: 1.37s\tremaining: 7.97s\n",
      "147:\tlearn: 0.3877076\ttotal: 1.38s\tremaining: 7.97s\n",
      "148:\tlearn: 0.3876526\ttotal: 1.4s\tremaining: 7.98s\n",
      "149:\tlearn: 0.3875436\ttotal: 1.4s\tremaining: 7.96s\n",
      "150:\tlearn: 0.3874131\ttotal: 1.41s\tremaining: 7.94s\n",
      "151:\tlearn: 0.3872600\ttotal: 1.43s\tremaining: 7.96s\n",
      "152:\tlearn: 0.3871059\ttotal: 1.44s\tremaining: 7.95s\n",
      "153:\tlearn: 0.3869236\ttotal: 1.44s\tremaining: 7.93s\n",
      "154:\tlearn: 0.3865838\ttotal: 1.45s\tremaining: 7.92s\n",
      "155:\tlearn: 0.3864620\ttotal: 1.46s\tremaining: 7.89s\n",
      "156:\tlearn: 0.3863675\ttotal: 1.47s\tremaining: 7.88s\n",
      "157:\tlearn: 0.3862930\ttotal: 1.49s\tremaining: 7.92s\n",
      "158:\tlearn: 0.3861112\ttotal: 1.49s\tremaining: 7.91s\n",
      "159:\tlearn: 0.3859857\ttotal: 1.5s\tremaining: 7.89s\n",
      "160:\tlearn: 0.3858967\ttotal: 1.51s\tremaining: 7.87s\n",
      "161:\tlearn: 0.3857851\ttotal: 1.52s\tremaining: 7.85s\n",
      "162:\tlearn: 0.3856177\ttotal: 1.52s\tremaining: 7.83s\n",
      "163:\tlearn: 0.3854627\ttotal: 1.53s\tremaining: 7.82s\n",
      "164:\tlearn: 0.3853181\ttotal: 1.55s\tremaining: 7.83s\n",
      "165:\tlearn: 0.3852046\ttotal: 1.55s\tremaining: 7.81s\n",
      "166:\tlearn: 0.3850949\ttotal: 1.57s\tremaining: 7.84s\n",
      "167:\tlearn: 0.3849939\ttotal: 1.58s\tremaining: 7.83s\n",
      "168:\tlearn: 0.3849355\ttotal: 1.59s\tremaining: 7.81s\n",
      "169:\tlearn: 0.3847923\ttotal: 1.59s\tremaining: 7.79s\n",
      "170:\tlearn: 0.3846510\ttotal: 1.6s\tremaining: 7.77s\n",
      "171:\tlearn: 0.3845566\ttotal: 1.61s\tremaining: 7.75s\n",
      "172:\tlearn: 0.3844463\ttotal: 1.62s\tremaining: 7.73s\n",
      "173:\tlearn: 0.3843155\ttotal: 1.62s\tremaining: 7.71s\n",
      "174:\tlearn: 0.3841745\ttotal: 1.63s\tremaining: 7.69s\n",
      "175:\tlearn: 0.3840755\ttotal: 1.64s\tremaining: 7.68s\n",
      "176:\tlearn: 0.3839911\ttotal: 1.65s\tremaining: 7.66s\n",
      "177:\tlearn: 0.3838346\ttotal: 1.67s\tremaining: 7.73s\n",
      "178:\tlearn: 0.3837255\ttotal: 1.68s\tremaining: 7.71s\n",
      "179:\tlearn: 0.3836644\ttotal: 1.69s\tremaining: 7.7s\n",
      "180:\tlearn: 0.3835500\ttotal: 1.7s\tremaining: 7.68s\n",
      "181:\tlearn: 0.3832635\ttotal: 1.7s\tremaining: 7.66s\n",
      "182:\tlearn: 0.3831311\ttotal: 1.71s\tremaining: 7.64s\n",
      "183:\tlearn: 0.3830050\ttotal: 1.72s\tremaining: 7.63s\n",
      "184:\tlearn: 0.3829321\ttotal: 1.73s\tremaining: 7.61s\n",
      "185:\tlearn: 0.3827976\ttotal: 1.73s\tremaining: 7.59s\n",
      "186:\tlearn: 0.3826920\ttotal: 1.74s\tremaining: 7.57s\n",
      "187:\tlearn: 0.3826124\ttotal: 1.76s\tremaining: 7.59s\n",
      "188:\tlearn: 0.3824492\ttotal: 1.77s\tremaining: 7.58s\n",
      "189:\tlearn: 0.3823145\ttotal: 1.77s\tremaining: 7.57s\n",
      "190:\tlearn: 0.3822002\ttotal: 1.79s\tremaining: 7.57s\n",
      "191:\tlearn: 0.3820029\ttotal: 1.79s\tremaining: 7.55s\n",
      "192:\tlearn: 0.3819131\ttotal: 1.8s\tremaining: 7.53s\n",
      "193:\tlearn: 0.3817986\ttotal: 1.81s\tremaining: 7.51s\n",
      "194:\tlearn: 0.3816844\ttotal: 1.81s\tremaining: 7.49s\n",
      "195:\tlearn: 0.3815790\ttotal: 1.82s\tremaining: 7.48s\n",
      "196:\tlearn: 0.3814505\ttotal: 1.83s\tremaining: 7.47s\n",
      "197:\tlearn: 0.3812907\ttotal: 1.85s\tremaining: 7.49s\n",
      "198:\tlearn: 0.3811663\ttotal: 1.86s\tremaining: 7.48s\n",
      "199:\tlearn: 0.3810930\ttotal: 1.86s\tremaining: 7.46s\n",
      "200:\tlearn: 0.3809637\ttotal: 1.87s\tremaining: 7.45s\n",
      "201:\tlearn: 0.3808052\ttotal: 1.88s\tremaining: 7.43s\n",
      "202:\tlearn: 0.3807127\ttotal: 1.89s\tremaining: 7.41s\n",
      "203:\tlearn: 0.3805491\ttotal: 1.9s\tremaining: 7.43s\n",
      "204:\tlearn: 0.3805023\ttotal: 1.91s\tremaining: 7.41s\n",
      "205:\tlearn: 0.3804069\ttotal: 1.92s\tremaining: 7.39s\n",
      "206:\tlearn: 0.3802669\ttotal: 1.94s\tremaining: 7.42s\n",
      "207:\tlearn: 0.3801703\ttotal: 1.94s\tremaining: 7.4s\n",
      "208:\tlearn: 0.3801073\ttotal: 1.95s\tremaining: 7.38s\n",
      "209:\tlearn: 0.3800276\ttotal: 1.96s\tremaining: 7.37s\n",
      "210:\tlearn: 0.3798940\ttotal: 1.97s\tremaining: 7.35s\n",
      "211:\tlearn: 0.3797785\ttotal: 1.97s\tremaining: 7.33s\n",
      "212:\tlearn: 0.3795160\ttotal: 1.98s\tremaining: 7.32s\n",
      "213:\tlearn: 0.3793948\ttotal: 1.99s\tremaining: 7.3s\n",
      "214:\tlearn: 0.3792712\ttotal: 1.99s\tremaining: 7.28s\n",
      "215:\tlearn: 0.3791295\ttotal: 2s\tremaining: 7.26s\n",
      "216:\tlearn: 0.3790150\ttotal: 2.01s\tremaining: 7.25s\n",
      "217:\tlearn: 0.3789119\ttotal: 2.04s\tremaining: 7.3s\n",
      "218:\tlearn: 0.3788055\ttotal: 2.04s\tremaining: 7.29s\n",
      "219:\tlearn: 0.3786714\ttotal: 2.05s\tremaining: 7.28s\n",
      "220:\tlearn: 0.3785754\ttotal: 2.06s\tremaining: 7.26s\n",
      "221:\tlearn: 0.3784909\ttotal: 2.07s\tremaining: 7.25s\n",
      "222:\tlearn: 0.3784225\ttotal: 2.08s\tremaining: 7.23s\n",
      "223:\tlearn: 0.3783043\ttotal: 2.08s\tremaining: 7.22s\n",
      "224:\tlearn: 0.3781882\ttotal: 2.09s\tremaining: 7.2s\n",
      "225:\tlearn: 0.3779827\ttotal: 2.1s\tremaining: 7.19s\n",
      "226:\tlearn: 0.3779006\ttotal: 2.11s\tremaining: 7.18s\n",
      "227:\tlearn: 0.3778090\ttotal: 2.12s\tremaining: 7.17s\n",
      "228:\tlearn: 0.3776988\ttotal: 2.13s\tremaining: 7.16s\n",
      "229:\tlearn: 0.3775259\ttotal: 2.14s\tremaining: 7.17s\n",
      "230:\tlearn: 0.3774538\ttotal: 2.15s\tremaining: 7.16s\n",
      "231:\tlearn: 0.3773350\ttotal: 2.16s\tremaining: 7.15s\n",
      "232:\tlearn: 0.3772421\ttotal: 2.17s\tremaining: 7.14s\n",
      "233:\tlearn: 0.3770558\ttotal: 2.18s\tremaining: 7.13s\n",
      "234:\tlearn: 0.3768351\ttotal: 2.19s\tremaining: 7.11s\n",
      "235:\tlearn: 0.3767542\ttotal: 2.19s\tremaining: 7.1s\n",
      "236:\tlearn: 0.3766252\ttotal: 2.21s\tremaining: 7.12s\n",
      "237:\tlearn: 0.3765257\ttotal: 2.22s\tremaining: 7.1s\n",
      "238:\tlearn: 0.3763910\ttotal: 2.22s\tremaining: 7.08s\n",
      "239:\tlearn: 0.3763132\ttotal: 2.23s\tremaining: 7.07s\n",
      "240:\tlearn: 0.3762160\ttotal: 2.24s\tremaining: 7.06s\n",
      "241:\tlearn: 0.3760980\ttotal: 2.25s\tremaining: 7.05s\n",
      "242:\tlearn: 0.3759770\ttotal: 2.26s\tremaining: 7.05s\n",
      "243:\tlearn: 0.3758942\ttotal: 2.27s\tremaining: 7.04s\n",
      "244:\tlearn: 0.3758093\ttotal: 2.28s\tremaining: 7.02s\n",
      "245:\tlearn: 0.3757118\ttotal: 2.29s\tremaining: 7.02s\n",
      "246:\tlearn: 0.3755925\ttotal: 2.3s\tremaining: 7.02s\n",
      "247:\tlearn: 0.3754606\ttotal: 2.31s\tremaining: 7s\n",
      "248:\tlearn: 0.3753126\ttotal: 2.32s\tremaining: 6.99s\n",
      "249:\tlearn: 0.3752161\ttotal: 2.32s\tremaining: 6.97s\n",
      "250:\tlearn: 0.3750815\ttotal: 2.33s\tremaining: 6.96s\n",
      "251:\tlearn: 0.3750014\ttotal: 2.34s\tremaining: 6.94s\n",
      "252:\tlearn: 0.3749167\ttotal: 2.35s\tremaining: 6.92s\n",
      "253:\tlearn: 0.3747833\ttotal: 2.35s\tremaining: 6.91s\n",
      "254:\tlearn: 0.3746757\ttotal: 2.36s\tremaining: 6.89s\n",
      "255:\tlearn: 0.3745911\ttotal: 2.37s\tremaining: 6.88s\n",
      "256:\tlearn: 0.3745083\ttotal: 2.39s\tremaining: 6.91s\n",
      "257:\tlearn: 0.3743867\ttotal: 2.4s\tremaining: 6.89s\n",
      "258:\tlearn: 0.3742759\ttotal: 2.4s\tremaining: 6.88s\n",
      "259:\tlearn: 0.3741667\ttotal: 2.41s\tremaining: 6.86s\n",
      "260:\tlearn: 0.3740912\ttotal: 2.42s\tremaining: 6.85s\n",
      "261:\tlearn: 0.3739958\ttotal: 2.43s\tremaining: 6.84s\n",
      "262:\tlearn: 0.3738550\ttotal: 2.44s\tremaining: 6.83s\n",
      "263:\tlearn: 0.3737506\ttotal: 2.44s\tremaining: 6.82s\n",
      "264:\tlearn: 0.3735952\ttotal: 2.45s\tremaining: 6.8s\n",
      "265:\tlearn: 0.3734971\ttotal: 2.46s\tremaining: 6.79s\n",
      "266:\tlearn: 0.3733418\ttotal: 2.47s\tremaining: 6.78s\n",
      "267:\tlearn: 0.3732269\ttotal: 2.48s\tremaining: 6.76s\n",
      "268:\tlearn: 0.3731499\ttotal: 2.48s\tremaining: 6.75s\n",
      "269:\tlearn: 0.3730355\ttotal: 2.5s\tremaining: 6.75s\n",
      "270:\tlearn: 0.3729164\ttotal: 2.51s\tremaining: 6.74s\n",
      "271:\tlearn: 0.3727978\ttotal: 2.51s\tremaining: 6.73s\n",
      "272:\tlearn: 0.3726783\ttotal: 2.52s\tremaining: 6.71s\n",
      "273:\tlearn: 0.3725786\ttotal: 2.53s\tremaining: 6.7s\n",
      "274:\tlearn: 0.3724511\ttotal: 2.54s\tremaining: 6.69s\n",
      "275:\tlearn: 0.3723382\ttotal: 2.54s\tremaining: 6.68s\n",
      "276:\tlearn: 0.3722471\ttotal: 2.55s\tremaining: 6.66s\n",
      "277:\tlearn: 0.3721239\ttotal: 2.57s\tremaining: 6.68s\n",
      "278:\tlearn: 0.3720120\ttotal: 2.58s\tremaining: 6.66s\n",
      "279:\tlearn: 0.3718724\ttotal: 2.59s\tremaining: 6.65s\n",
      "280:\tlearn: 0.3717839\ttotal: 2.59s\tremaining: 6.64s\n",
      "281:\tlearn: 0.3716914\ttotal: 2.6s\tremaining: 6.62s\n",
      "282:\tlearn: 0.3716186\ttotal: 2.61s\tremaining: 6.62s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "283:\tlearn: 0.3714983\ttotal: 2.62s\tremaining: 6.61s\n",
      "284:\tlearn: 0.3714174\ttotal: 2.63s\tremaining: 6.6s\n",
      "285:\tlearn: 0.3713079\ttotal: 2.64s\tremaining: 6.59s\n",
      "286:\tlearn: 0.3711974\ttotal: 2.66s\tremaining: 6.6s\n",
      "287:\tlearn: 0.3710857\ttotal: 2.66s\tremaining: 6.59s\n",
      "288:\tlearn: 0.3709745\ttotal: 2.67s\tremaining: 6.58s\n",
      "289:\tlearn: 0.3709223\ttotal: 2.68s\tremaining: 6.56s\n",
      "290:\tlearn: 0.3708001\ttotal: 2.69s\tremaining: 6.55s\n",
      "291:\tlearn: 0.3707257\ttotal: 2.69s\tremaining: 6.53s\n",
      "292:\tlearn: 0.3706710\ttotal: 2.7s\tremaining: 6.52s\n",
      "293:\tlearn: 0.3705865\ttotal: 2.71s\tremaining: 6.5s\n",
      "294:\tlearn: 0.3704657\ttotal: 2.71s\tremaining: 6.49s\n",
      "295:\tlearn: 0.3703425\ttotal: 2.72s\tremaining: 6.47s\n",
      "296:\tlearn: 0.3702232\ttotal: 2.74s\tremaining: 6.48s\n",
      "297:\tlearn: 0.3701190\ttotal: 2.75s\tremaining: 6.49s\n",
      "298:\tlearn: 0.3700043\ttotal: 2.76s\tremaining: 6.48s\n",
      "299:\tlearn: 0.3698767\ttotal: 2.77s\tremaining: 6.46s\n",
      "300:\tlearn: 0.3698162\ttotal: 2.78s\tremaining: 6.45s\n",
      "301:\tlearn: 0.3697532\ttotal: 2.79s\tremaining: 6.44s\n",
      "302:\tlearn: 0.3696672\ttotal: 2.79s\tremaining: 6.42s\n",
      "303:\tlearn: 0.3695982\ttotal: 2.8s\tremaining: 6.41s\n",
      "304:\tlearn: 0.3694744\ttotal: 2.81s\tremaining: 6.4s\n",
      "305:\tlearn: 0.3693386\ttotal: 2.81s\tremaining: 6.38s\n",
      "306:\tlearn: 0.3692392\ttotal: 2.82s\tremaining: 6.37s\n",
      "307:\tlearn: 0.3691612\ttotal: 2.85s\tremaining: 6.39s\n",
      "308:\tlearn: 0.3690737\ttotal: 2.86s\tremaining: 6.4s\n",
      "309:\tlearn: 0.3689674\ttotal: 2.87s\tremaining: 6.39s\n",
      "310:\tlearn: 0.3689077\ttotal: 2.88s\tremaining: 6.38s\n",
      "311:\tlearn: 0.3688212\ttotal: 2.89s\tremaining: 6.37s\n",
      "312:\tlearn: 0.3687591\ttotal: 2.9s\tremaining: 6.36s\n",
      "313:\tlearn: 0.3686545\ttotal: 2.91s\tremaining: 6.35s\n",
      "314:\tlearn: 0.3685042\ttotal: 2.92s\tremaining: 6.34s\n",
      "315:\tlearn: 0.3684452\ttotal: 2.93s\tremaining: 6.35s\n",
      "316:\tlearn: 0.3683609\ttotal: 2.94s\tremaining: 6.34s\n",
      "317:\tlearn: 0.3682789\ttotal: 2.95s\tremaining: 6.33s\n",
      "318:\tlearn: 0.3682218\ttotal: 2.96s\tremaining: 6.32s\n",
      "319:\tlearn: 0.3681332\ttotal: 2.98s\tremaining: 6.33s\n",
      "320:\tlearn: 0.3680051\ttotal: 2.99s\tremaining: 6.32s\n",
      "321:\tlearn: 0.3679019\ttotal: 2.99s\tremaining: 6.3s\n",
      "322:\tlearn: 0.3678387\ttotal: 3s\tremaining: 6.29s\n",
      "323:\tlearn: 0.3677534\ttotal: 3.02s\tremaining: 6.31s\n",
      "324:\tlearn: 0.3676479\ttotal: 3.03s\tremaining: 6.29s\n",
      "325:\tlearn: 0.3675162\ttotal: 3.04s\tremaining: 6.29s\n",
      "326:\tlearn: 0.3674727\ttotal: 3.05s\tremaining: 6.27s\n",
      "327:\tlearn: 0.3673897\ttotal: 3.06s\tremaining: 6.26s\n",
      "328:\tlearn: 0.3672895\ttotal: 3.06s\tremaining: 6.25s\n",
      "329:\tlearn: 0.3672342\ttotal: 3.07s\tremaining: 6.24s\n",
      "330:\tlearn: 0.3671144\ttotal: 3.08s\tremaining: 6.23s\n",
      "331:\tlearn: 0.3669996\ttotal: 3.11s\tremaining: 6.26s\n",
      "332:\tlearn: 0.3669269\ttotal: 3.12s\tremaining: 6.25s\n",
      "333:\tlearn: 0.3668484\ttotal: 3.13s\tremaining: 6.24s\n",
      "334:\tlearn: 0.3668040\ttotal: 3.14s\tremaining: 6.23s\n",
      "335:\tlearn: 0.3667101\ttotal: 3.15s\tremaining: 6.22s\n",
      "336:\tlearn: 0.3665878\ttotal: 3.16s\tremaining: 6.21s\n",
      "337:\tlearn: 0.3664965\ttotal: 3.17s\tremaining: 6.21s\n",
      "338:\tlearn: 0.3663894\ttotal: 3.18s\tremaining: 6.19s\n",
      "339:\tlearn: 0.3663146\ttotal: 3.19s\tremaining: 6.18s\n",
      "340:\tlearn: 0.3662145\ttotal: 3.22s\tremaining: 6.22s\n",
      "341:\tlearn: 0.3661364\ttotal: 3.23s\tremaining: 6.21s\n",
      "342:\tlearn: 0.3660928\ttotal: 3.25s\tremaining: 6.22s\n",
      "343:\tlearn: 0.3660151\ttotal: 3.26s\tremaining: 6.22s\n",
      "344:\tlearn: 0.3658910\ttotal: 3.27s\tremaining: 6.21s\n",
      "345:\tlearn: 0.3658070\ttotal: 3.29s\tremaining: 6.22s\n",
      "346:\tlearn: 0.3657276\ttotal: 3.3s\tremaining: 6.21s\n",
      "347:\tlearn: 0.3656526\ttotal: 3.31s\tremaining: 6.2s\n",
      "348:\tlearn: 0.3655906\ttotal: 3.32s\tremaining: 6.19s\n",
      "349:\tlearn: 0.3655009\ttotal: 3.33s\tremaining: 6.19s\n",
      "350:\tlearn: 0.3653781\ttotal: 3.34s\tremaining: 6.18s\n",
      "351:\tlearn: 0.3652770\ttotal: 3.35s\tremaining: 6.17s\n",
      "352:\tlearn: 0.3651967\ttotal: 3.36s\tremaining: 6.16s\n",
      "353:\tlearn: 0.3651182\ttotal: 3.37s\tremaining: 6.15s\n",
      "354:\tlearn: 0.3650685\ttotal: 3.39s\tremaining: 6.16s\n",
      "355:\tlearn: 0.3649539\ttotal: 3.4s\tremaining: 6.15s\n",
      "356:\tlearn: 0.3648309\ttotal: 3.41s\tremaining: 6.14s\n",
      "357:\tlearn: 0.3647598\ttotal: 3.42s\tremaining: 6.13s\n",
      "358:\tlearn: 0.3646375\ttotal: 3.43s\tremaining: 6.12s\n",
      "359:\tlearn: 0.3645564\ttotal: 3.44s\tremaining: 6.11s\n",
      "360:\tlearn: 0.3644260\ttotal: 3.46s\tremaining: 6.12s\n",
      "361:\tlearn: 0.3643543\ttotal: 3.48s\tremaining: 6.13s\n",
      "362:\tlearn: 0.3642887\ttotal: 3.49s\tremaining: 6.12s\n",
      "363:\tlearn: 0.3641699\ttotal: 3.5s\tremaining: 6.11s\n",
      "364:\tlearn: 0.3640876\ttotal: 3.51s\tremaining: 6.1s\n",
      "365:\tlearn: 0.3639561\ttotal: 3.52s\tremaining: 6.09s\n",
      "366:\tlearn: 0.3638835\ttotal: 3.52s\tremaining: 6.08s\n",
      "367:\tlearn: 0.3638181\ttotal: 3.53s\tremaining: 6.07s\n",
      "368:\tlearn: 0.3637393\ttotal: 3.54s\tremaining: 6.05s\n",
      "369:\tlearn: 0.3636695\ttotal: 3.55s\tremaining: 6.05s\n",
      "370:\tlearn: 0.3635912\ttotal: 3.58s\tremaining: 6.07s\n",
      "371:\tlearn: 0.3635002\ttotal: 3.59s\tremaining: 6.06s\n",
      "372:\tlearn: 0.3634101\ttotal: 3.6s\tremaining: 6.05s\n",
      "373:\tlearn: 0.3633144\ttotal: 3.61s\tremaining: 6.04s\n",
      "374:\tlearn: 0.3632014\ttotal: 3.62s\tremaining: 6.03s\n",
      "375:\tlearn: 0.3631539\ttotal: 3.63s\tremaining: 6.02s\n",
      "376:\tlearn: 0.3630737\ttotal: 3.63s\tremaining: 6s\n",
      "377:\tlearn: 0.3629925\ttotal: 3.64s\tremaining: 6s\n",
      "378:\tlearn: 0.3629367\ttotal: 3.66s\tremaining: 6s\n",
      "379:\tlearn: 0.3628442\ttotal: 3.67s\tremaining: 5.98s\n",
      "380:\tlearn: 0.3627589\ttotal: 3.67s\tremaining: 5.97s\n",
      "381:\tlearn: 0.3626903\ttotal: 3.69s\tremaining: 5.96s\n",
      "382:\tlearn: 0.3626062\ttotal: 3.7s\tremaining: 5.96s\n",
      "383:\tlearn: 0.3625119\ttotal: 3.71s\tremaining: 5.95s\n",
      "384:\tlearn: 0.3624178\ttotal: 3.71s\tremaining: 5.93s\n",
      "385:\tlearn: 0.3623287\ttotal: 3.72s\tremaining: 5.92s\n",
      "386:\tlearn: 0.3622740\ttotal: 3.73s\tremaining: 5.91s\n",
      "387:\tlearn: 0.3621765\ttotal: 3.75s\tremaining: 5.91s\n",
      "388:\tlearn: 0.3620382\ttotal: 3.76s\tremaining: 5.9s\n",
      "389:\tlearn: 0.3619176\ttotal: 3.77s\tremaining: 5.89s\n",
      "390:\tlearn: 0.3618200\ttotal: 3.77s\tremaining: 5.88s\n",
      "391:\tlearn: 0.3617910\ttotal: 3.78s\tremaining: 5.86s\n",
      "392:\tlearn: 0.3616926\ttotal: 3.79s\tremaining: 5.85s\n",
      "393:\tlearn: 0.3616106\ttotal: 3.79s\tremaining: 5.84s\n",
      "394:\tlearn: 0.3615011\ttotal: 3.81s\tremaining: 5.83s\n",
      "395:\tlearn: 0.3613922\ttotal: 3.82s\tremaining: 5.82s\n",
      "396:\tlearn: 0.3612989\ttotal: 3.83s\tremaining: 5.83s\n",
      "397:\tlearn: 0.3611863\ttotal: 3.85s\tremaining: 5.82s\n",
      "398:\tlearn: 0.3610911\ttotal: 3.86s\tremaining: 5.82s\n",
      "399:\tlearn: 0.3609960\ttotal: 3.87s\tremaining: 5.81s\n",
      "400:\tlearn: 0.3609226\ttotal: 3.88s\tremaining: 5.8s\n",
      "401:\tlearn: 0.3608201\ttotal: 3.89s\tremaining: 5.79s\n",
      "402:\tlearn: 0.3607343\ttotal: 3.9s\tremaining: 5.78s\n",
      "403:\tlearn: 0.3606380\ttotal: 3.91s\tremaining: 5.77s\n",
      "404:\tlearn: 0.3605790\ttotal: 3.94s\tremaining: 5.79s\n",
      "405:\tlearn: 0.3605133\ttotal: 3.95s\tremaining: 5.78s\n",
      "406:\tlearn: 0.3604560\ttotal: 3.96s\tremaining: 5.77s\n",
      "407:\tlearn: 0.3603235\ttotal: 3.97s\tremaining: 5.76s\n",
      "408:\tlearn: 0.3602403\ttotal: 3.98s\tremaining: 5.75s\n",
      "409:\tlearn: 0.3601701\ttotal: 3.98s\tremaining: 5.73s\n",
      "410:\tlearn: 0.3600845\ttotal: 3.99s\tremaining: 5.72s\n",
      "411:\tlearn: 0.3599836\ttotal: 4s\tremaining: 5.71s\n",
      "412:\tlearn: 0.3598896\ttotal: 4.02s\tremaining: 5.72s\n",
      "413:\tlearn: 0.3597778\ttotal: 4.03s\tremaining: 5.71s\n",
      "414:\tlearn: 0.3596731\ttotal: 4.04s\tremaining: 5.69s\n",
      "415:\tlearn: 0.3595853\ttotal: 4.06s\tremaining: 5.7s\n",
      "416:\tlearn: 0.3595493\ttotal: 4.07s\tremaining: 5.69s\n",
      "417:\tlearn: 0.3594877\ttotal: 4.08s\tremaining: 5.68s\n",
      "418:\tlearn: 0.3594028\ttotal: 4.09s\tremaining: 5.67s\n",
      "419:\tlearn: 0.3593398\ttotal: 4.11s\tremaining: 5.68s\n",
      "420:\tlearn: 0.3592345\ttotal: 4.13s\tremaining: 5.67s\n",
      "421:\tlearn: 0.3591637\ttotal: 4.13s\tremaining: 5.66s\n",
      "422:\tlearn: 0.3590936\ttotal: 4.14s\tremaining: 5.66s\n",
      "423:\tlearn: 0.3589957\ttotal: 4.16s\tremaining: 5.64s\n",
      "424:\tlearn: 0.3589412\ttotal: 4.17s\tremaining: 5.64s\n",
      "425:\tlearn: 0.3588679\ttotal: 4.18s\tremaining: 5.63s\n",
      "426:\tlearn: 0.3587741\ttotal: 4.2s\tremaining: 5.64s\n",
      "427:\tlearn: 0.3587254\ttotal: 4.21s\tremaining: 5.63s\n",
      "428:\tlearn: 0.3586329\ttotal: 4.22s\tremaining: 5.62s\n",
      "429:\tlearn: 0.3585791\ttotal: 4.23s\tremaining: 5.61s\n",
      "430:\tlearn: 0.3584930\ttotal: 4.24s\tremaining: 5.6s\n",
      "431:\tlearn: 0.3584092\ttotal: 4.25s\tremaining: 5.59s\n",
      "432:\tlearn: 0.3583468\ttotal: 4.26s\tremaining: 5.58s\n",
      "433:\tlearn: 0.3582771\ttotal: 4.27s\tremaining: 5.57s\n",
      "434:\tlearn: 0.3582151\ttotal: 4.3s\tremaining: 5.59s\n",
      "435:\tlearn: 0.3581530\ttotal: 4.32s\tremaining: 5.58s\n",
      "436:\tlearn: 0.3580681\ttotal: 4.33s\tremaining: 5.57s\n",
      "437:\tlearn: 0.3579976\ttotal: 4.34s\tremaining: 5.57s\n",
      "438:\tlearn: 0.3579362\ttotal: 4.35s\tremaining: 5.55s\n",
      "439:\tlearn: 0.3578541\ttotal: 4.36s\tremaining: 5.54s\n",
      "440:\tlearn: 0.3577812\ttotal: 4.37s\tremaining: 5.54s\n",
      "441:\tlearn: 0.3577524\ttotal: 4.39s\tremaining: 5.54s\n",
      "442:\tlearn: 0.3576594\ttotal: 4.4s\tremaining: 5.53s\n",
      "443:\tlearn: 0.3575901\ttotal: 4.42s\tremaining: 5.53s\n",
      "444:\tlearn: 0.3574952\ttotal: 4.43s\tremaining: 5.52s\n",
      "445:\tlearn: 0.3574101\ttotal: 4.44s\tremaining: 5.51s\n",
      "446:\tlearn: 0.3573162\ttotal: 4.45s\tremaining: 5.5s\n",
      "447:\tlearn: 0.3572456\ttotal: 4.45s\tremaining: 5.49s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "448:\tlearn: 0.3572227\ttotal: 4.47s\tremaining: 5.49s\n",
      "449:\tlearn: 0.3571602\ttotal: 4.49s\tremaining: 5.48s\n",
      "450:\tlearn: 0.3570725\ttotal: 4.5s\tremaining: 5.47s\n",
      "451:\tlearn: 0.3569848\ttotal: 4.5s\tremaining: 5.46s\n",
      "452:\tlearn: 0.3569002\ttotal: 4.51s\tremaining: 5.45s\n",
      "453:\tlearn: 0.3568376\ttotal: 4.52s\tremaining: 5.43s\n",
      "454:\tlearn: 0.3567500\ttotal: 4.53s\tremaining: 5.43s\n",
      "455:\tlearn: 0.3566674\ttotal: 4.54s\tremaining: 5.42s\n",
      "456:\tlearn: 0.3565890\ttotal: 4.55s\tremaining: 5.41s\n",
      "457:\tlearn: 0.3564991\ttotal: 4.58s\tremaining: 5.42s\n",
      "458:\tlearn: 0.3564097\ttotal: 4.59s\tremaining: 5.41s\n",
      "459:\tlearn: 0.3563227\ttotal: 4.6s\tremaining: 5.4s\n",
      "460:\tlearn: 0.3562306\ttotal: 4.61s\tremaining: 5.39s\n",
      "461:\tlearn: 0.3561315\ttotal: 4.62s\tremaining: 5.38s\n",
      "462:\tlearn: 0.3560857\ttotal: 4.63s\tremaining: 5.37s\n",
      "463:\tlearn: 0.3560037\ttotal: 4.64s\tremaining: 5.36s\n",
      "464:\tlearn: 0.3559321\ttotal: 4.67s\tremaining: 5.37s\n",
      "465:\tlearn: 0.3558574\ttotal: 4.68s\tremaining: 5.36s\n",
      "466:\tlearn: 0.3557619\ttotal: 4.69s\tremaining: 5.35s\n",
      "467:\tlearn: 0.3557090\ttotal: 4.7s\tremaining: 5.34s\n",
      "468:\tlearn: 0.3556341\ttotal: 4.71s\tremaining: 5.33s\n",
      "469:\tlearn: 0.3555269\ttotal: 4.72s\tremaining: 5.32s\n",
      "470:\tlearn: 0.3554563\ttotal: 4.72s\tremaining: 5.31s\n",
      "471:\tlearn: 0.3553601\ttotal: 4.73s\tremaining: 5.3s\n",
      "472:\tlearn: 0.3552358\ttotal: 4.75s\tremaining: 5.3s\n",
      "473:\tlearn: 0.3551884\ttotal: 4.76s\tremaining: 5.29s\n",
      "474:\tlearn: 0.3550994\ttotal: 4.78s\tremaining: 5.29s\n",
      "475:\tlearn: 0.3550152\ttotal: 4.79s\tremaining: 5.28s\n",
      "476:\tlearn: 0.3549488\ttotal: 4.8s\tremaining: 5.26s\n",
      "477:\tlearn: 0.3548950\ttotal: 4.81s\tremaining: 5.25s\n",
      "478:\tlearn: 0.3548262\ttotal: 4.82s\tremaining: 5.24s\n",
      "479:\tlearn: 0.3547279\ttotal: 4.84s\tremaining: 5.24s\n",
      "480:\tlearn: 0.3546456\ttotal: 4.85s\tremaining: 5.23s\n",
      "481:\tlearn: 0.3545810\ttotal: 4.86s\tremaining: 5.23s\n",
      "482:\tlearn: 0.3544974\ttotal: 4.88s\tremaining: 5.22s\n",
      "483:\tlearn: 0.3543762\ttotal: 4.9s\tremaining: 5.23s\n",
      "484:\tlearn: 0.3542708\ttotal: 4.93s\tremaining: 5.24s\n",
      "485:\tlearn: 0.3541880\ttotal: 4.95s\tremaining: 5.23s\n",
      "486:\tlearn: 0.3540901\ttotal: 4.96s\tremaining: 5.23s\n",
      "487:\tlearn: 0.3539983\ttotal: 4.98s\tremaining: 5.22s\n",
      "488:\tlearn: 0.3539396\ttotal: 4.99s\tremaining: 5.22s\n",
      "489:\tlearn: 0.3538927\ttotal: 5.02s\tremaining: 5.23s\n",
      "490:\tlearn: 0.3538222\ttotal: 5.05s\tremaining: 5.23s\n",
      "491:\tlearn: 0.3537530\ttotal: 5.06s\tremaining: 5.23s\n",
      "492:\tlearn: 0.3537051\ttotal: 5.08s\tremaining: 5.22s\n",
      "493:\tlearn: 0.3536508\ttotal: 5.09s\tremaining: 5.22s\n",
      "494:\tlearn: 0.3535827\ttotal: 5.11s\tremaining: 5.21s\n",
      "495:\tlearn: 0.3534947\ttotal: 5.12s\tremaining: 5.21s\n",
      "496:\tlearn: 0.3533851\ttotal: 5.15s\tremaining: 5.21s\n",
      "497:\tlearn: 0.3532895\ttotal: 5.16s\tremaining: 5.21s\n",
      "498:\tlearn: 0.3532440\ttotal: 5.19s\tremaining: 5.21s\n",
      "499:\tlearn: 0.3531602\ttotal: 5.22s\tremaining: 5.22s\n",
      "500:\tlearn: 0.3531006\ttotal: 5.23s\tremaining: 5.21s\n",
      "501:\tlearn: 0.3530267\ttotal: 5.24s\tremaining: 5.2s\n",
      "502:\tlearn: 0.3529437\ttotal: 5.26s\tremaining: 5.2s\n",
      "503:\tlearn: 0.3528621\ttotal: 5.28s\tremaining: 5.19s\n",
      "504:\tlearn: 0.3527832\ttotal: 5.31s\tremaining: 5.2s\n",
      "505:\tlearn: 0.3527104\ttotal: 5.32s\tremaining: 5.19s\n",
      "506:\tlearn: 0.3526277\ttotal: 5.33s\tremaining: 5.18s\n",
      "507:\tlearn: 0.3525609\ttotal: 5.34s\tremaining: 5.17s\n",
      "508:\tlearn: 0.3524856\ttotal: 5.35s\tremaining: 5.16s\n",
      "509:\tlearn: 0.3523959\ttotal: 5.36s\tremaining: 5.15s\n",
      "510:\tlearn: 0.3523539\ttotal: 5.38s\tremaining: 5.15s\n",
      "511:\tlearn: 0.3522826\ttotal: 5.4s\tremaining: 5.15s\n",
      "512:\tlearn: 0.3522145\ttotal: 5.41s\tremaining: 5.13s\n",
      "513:\tlearn: 0.3521139\ttotal: 5.42s\tremaining: 5.13s\n",
      "514:\tlearn: 0.3520284\ttotal: 5.43s\tremaining: 5.12s\n",
      "515:\tlearn: 0.3519540\ttotal: 5.44s\tremaining: 5.11s\n",
      "516:\tlearn: 0.3519217\ttotal: 5.46s\tremaining: 5.1s\n",
      "517:\tlearn: 0.3518949\ttotal: 5.47s\tremaining: 5.09s\n",
      "518:\tlearn: 0.3518107\ttotal: 5.48s\tremaining: 5.08s\n",
      "519:\tlearn: 0.3517335\ttotal: 5.49s\tremaining: 5.06s\n",
      "520:\tlearn: 0.3516402\ttotal: 5.5s\tremaining: 5.06s\n",
      "521:\tlearn: 0.3515700\ttotal: 5.51s\tremaining: 5.05s\n",
      "522:\tlearn: 0.3514813\ttotal: 5.52s\tremaining: 5.04s\n",
      "523:\tlearn: 0.3514039\ttotal: 5.53s\tremaining: 5.03s\n",
      "524:\tlearn: 0.3513333\ttotal: 5.54s\tremaining: 5.01s\n",
      "525:\tlearn: 0.3512430\ttotal: 5.55s\tremaining: 5s\n",
      "526:\tlearn: 0.3511632\ttotal: 5.56s\tremaining: 4.99s\n",
      "527:\tlearn: 0.3511155\ttotal: 5.58s\tremaining: 4.99s\n",
      "528:\tlearn: 0.3510758\ttotal: 5.59s\tremaining: 4.97s\n",
      "529:\tlearn: 0.3509920\ttotal: 5.6s\tremaining: 4.96s\n",
      "530:\tlearn: 0.3509129\ttotal: 5.61s\tremaining: 4.95s\n",
      "531:\tlearn: 0.3508481\ttotal: 5.62s\tremaining: 4.95s\n",
      "532:\tlearn: 0.3507598\ttotal: 5.63s\tremaining: 4.93s\n",
      "533:\tlearn: 0.3506992\ttotal: 5.64s\tremaining: 4.92s\n",
      "534:\tlearn: 0.3506384\ttotal: 5.65s\tremaining: 4.91s\n",
      "535:\tlearn: 0.3505617\ttotal: 5.67s\tremaining: 4.91s\n",
      "536:\tlearn: 0.3504768\ttotal: 5.67s\tremaining: 4.89s\n",
      "537:\tlearn: 0.3504011\ttotal: 5.68s\tremaining: 4.88s\n",
      "538:\tlearn: 0.3503138\ttotal: 5.69s\tremaining: 4.87s\n",
      "539:\tlearn: 0.3502550\ttotal: 5.7s\tremaining: 4.86s\n",
      "540:\tlearn: 0.3501881\ttotal: 5.71s\tremaining: 4.84s\n",
      "541:\tlearn: 0.3501118\ttotal: 5.72s\tremaining: 4.83s\n",
      "542:\tlearn: 0.3500224\ttotal: 5.72s\tremaining: 4.82s\n",
      "543:\tlearn: 0.3499510\ttotal: 5.75s\tremaining: 4.82s\n",
      "544:\tlearn: 0.3498843\ttotal: 5.76s\tremaining: 4.81s\n",
      "545:\tlearn: 0.3498030\ttotal: 5.77s\tremaining: 4.8s\n",
      "546:\tlearn: 0.3497313\ttotal: 5.78s\tremaining: 4.79s\n",
      "547:\tlearn: 0.3496600\ttotal: 5.79s\tremaining: 4.78s\n",
      "548:\tlearn: 0.3496010\ttotal: 5.8s\tremaining: 4.76s\n",
      "549:\tlearn: 0.3495371\ttotal: 5.8s\tremaining: 4.75s\n",
      "550:\tlearn: 0.3494323\ttotal: 5.81s\tremaining: 4.74s\n",
      "551:\tlearn: 0.3493456\ttotal: 5.82s\tremaining: 4.72s\n",
      "552:\tlearn: 0.3492591\ttotal: 5.83s\tremaining: 4.71s\n",
      "553:\tlearn: 0.3492308\ttotal: 5.84s\tremaining: 4.71s\n",
      "554:\tlearn: 0.3491745\ttotal: 5.86s\tremaining: 4.7s\n",
      "555:\tlearn: 0.3490849\ttotal: 5.87s\tremaining: 4.69s\n",
      "556:\tlearn: 0.3490166\ttotal: 5.88s\tremaining: 4.67s\n",
      "557:\tlearn: 0.3489470\ttotal: 5.89s\tremaining: 4.66s\n",
      "558:\tlearn: 0.3488671\ttotal: 5.89s\tremaining: 4.65s\n",
      "559:\tlearn: 0.3488124\ttotal: 5.9s\tremaining: 4.64s\n",
      "560:\tlearn: 0.3487293\ttotal: 5.91s\tremaining: 4.62s\n",
      "561:\tlearn: 0.3486665\ttotal: 5.92s\tremaining: 4.61s\n",
      "562:\tlearn: 0.3486111\ttotal: 5.93s\tremaining: 4.6s\n",
      "563:\tlearn: 0.3485373\ttotal: 5.93s\tremaining: 4.59s\n",
      "564:\tlearn: 0.3484171\ttotal: 5.94s\tremaining: 4.57s\n",
      "565:\tlearn: 0.3483324\ttotal: 5.95s\tremaining: 4.56s\n",
      "566:\tlearn: 0.3482676\ttotal: 5.96s\tremaining: 4.55s\n",
      "567:\tlearn: 0.3481854\ttotal: 5.96s\tremaining: 4.54s\n",
      "568:\tlearn: 0.3480939\ttotal: 5.98s\tremaining: 4.53s\n",
      "569:\tlearn: 0.3480082\ttotal: 5.99s\tremaining: 4.51s\n",
      "570:\tlearn: 0.3479372\ttotal: 5.99s\tremaining: 4.5s\n",
      "571:\tlearn: 0.3478684\ttotal: 6s\tremaining: 4.49s\n",
      "572:\tlearn: 0.3477553\ttotal: 6.01s\tremaining: 4.48s\n",
      "573:\tlearn: 0.3476761\ttotal: 6.02s\tremaining: 4.47s\n",
      "574:\tlearn: 0.3476109\ttotal: 6.03s\tremaining: 4.46s\n",
      "575:\tlearn: 0.3475413\ttotal: 6.04s\tremaining: 4.45s\n",
      "576:\tlearn: 0.3474740\ttotal: 6.05s\tremaining: 4.43s\n",
      "577:\tlearn: 0.3473877\ttotal: 6.05s\tremaining: 4.42s\n",
      "578:\tlearn: 0.3473262\ttotal: 6.06s\tremaining: 4.41s\n",
      "579:\tlearn: 0.3472765\ttotal: 6.07s\tremaining: 4.39s\n",
      "580:\tlearn: 0.3471650\ttotal: 6.08s\tremaining: 4.38s\n",
      "581:\tlearn: 0.3471091\ttotal: 6.08s\tremaining: 4.37s\n",
      "582:\tlearn: 0.3470827\ttotal: 6.1s\tremaining: 4.37s\n",
      "583:\tlearn: 0.3470053\ttotal: 6.13s\tremaining: 4.37s\n",
      "584:\tlearn: 0.3469603\ttotal: 6.14s\tremaining: 4.36s\n",
      "585:\tlearn: 0.3468986\ttotal: 6.15s\tremaining: 4.35s\n",
      "586:\tlearn: 0.3468643\ttotal: 6.16s\tremaining: 4.34s\n",
      "587:\tlearn: 0.3468131\ttotal: 6.17s\tremaining: 4.33s\n",
      "588:\tlearn: 0.3467426\ttotal: 6.18s\tremaining: 4.32s\n",
      "589:\tlearn: 0.3467025\ttotal: 6.19s\tremaining: 4.3s\n",
      "590:\tlearn: 0.3466458\ttotal: 6.22s\tremaining: 4.3s\n",
      "591:\tlearn: 0.3465798\ttotal: 6.23s\tremaining: 4.29s\n",
      "592:\tlearn: 0.3465369\ttotal: 6.24s\tremaining: 4.28s\n",
      "593:\tlearn: 0.3464591\ttotal: 6.25s\tremaining: 4.27s\n",
      "594:\tlearn: 0.3463927\ttotal: 6.26s\tremaining: 4.26s\n",
      "595:\tlearn: 0.3463612\ttotal: 6.27s\tremaining: 4.25s\n",
      "596:\tlearn: 0.3463112\ttotal: 6.28s\tremaining: 4.24s\n",
      "597:\tlearn: 0.3462813\ttotal: 6.29s\tremaining: 4.23s\n",
      "598:\tlearn: 0.3461928\ttotal: 6.31s\tremaining: 4.22s\n",
      "599:\tlearn: 0.3461382\ttotal: 6.32s\tremaining: 4.21s\n",
      "600:\tlearn: 0.3460722\ttotal: 6.33s\tremaining: 4.2s\n",
      "601:\tlearn: 0.3459957\ttotal: 6.34s\tremaining: 4.19s\n",
      "602:\tlearn: 0.3459167\ttotal: 6.35s\tremaining: 4.18s\n",
      "603:\tlearn: 0.3458871\ttotal: 6.36s\tremaining: 4.17s\n",
      "604:\tlearn: 0.3457930\ttotal: 6.37s\tremaining: 4.16s\n",
      "605:\tlearn: 0.3457496\ttotal: 6.38s\tremaining: 4.15s\n",
      "606:\tlearn: 0.3456635\ttotal: 6.39s\tremaining: 4.14s\n",
      "607:\tlearn: 0.3456113\ttotal: 6.4s\tremaining: 4.13s\n",
      "608:\tlearn: 0.3455420\ttotal: 6.41s\tremaining: 4.12s\n",
      "609:\tlearn: 0.3454602\ttotal: 6.42s\tremaining: 4.1s\n",
      "610:\tlearn: 0.3453967\ttotal: 6.42s\tremaining: 4.09s\n",
      "611:\tlearn: 0.3453504\ttotal: 6.43s\tremaining: 4.08s\n",
      "612:\tlearn: 0.3452798\ttotal: 6.44s\tremaining: 4.07s\n",
      "613:\tlearn: 0.3451962\ttotal: 6.45s\tremaining: 4.06s\n",
      "614:\tlearn: 0.3451299\ttotal: 6.46s\tremaining: 4.05s\n",
      "615:\tlearn: 0.3450500\ttotal: 6.47s\tremaining: 4.04s\n",
      "616:\tlearn: 0.3449987\ttotal: 6.48s\tremaining: 4.02s\n",
      "617:\tlearn: 0.3449388\ttotal: 6.49s\tremaining: 4.01s\n",
      "618:\tlearn: 0.3448686\ttotal: 6.5s\tremaining: 4s\n",
      "619:\tlearn: 0.3447820\ttotal: 6.5s\tremaining: 3.99s\n",
      "620:\tlearn: 0.3447221\ttotal: 6.51s\tremaining: 3.98s\n",
      "621:\tlearn: 0.3446443\ttotal: 6.52s\tremaining: 3.96s\n",
      "622:\tlearn: 0.3445698\ttotal: 6.53s\tremaining: 3.95s\n",
      "623:\tlearn: 0.3445260\ttotal: 6.54s\tremaining: 3.94s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "624:\tlearn: 0.3444487\ttotal: 6.54s\tremaining: 3.93s\n",
      "625:\tlearn: 0.3443751\ttotal: 6.55s\tremaining: 3.92s\n",
      "626:\tlearn: 0.3443478\ttotal: 6.58s\tremaining: 3.92s\n",
      "627:\tlearn: 0.3442631\ttotal: 6.59s\tremaining: 3.91s\n",
      "628:\tlearn: 0.3441900\ttotal: 6.6s\tremaining: 3.9s\n",
      "629:\tlearn: 0.3441216\ttotal: 6.61s\tremaining: 3.88s\n",
      "630:\tlearn: 0.3440408\ttotal: 6.62s\tremaining: 3.87s\n",
      "631:\tlearn: 0.3439553\ttotal: 6.63s\tremaining: 3.86s\n",
      "632:\tlearn: 0.3438926\ttotal: 6.64s\tremaining: 3.85s\n",
      "633:\tlearn: 0.3438687\ttotal: 6.64s\tremaining: 3.84s\n",
      "634:\tlearn: 0.3437976\ttotal: 6.66s\tremaining: 3.83s\n",
      "635:\tlearn: 0.3437466\ttotal: 6.67s\tremaining: 3.82s\n",
      "636:\tlearn: 0.3436825\ttotal: 6.68s\tremaining: 3.81s\n",
      "637:\tlearn: 0.3436088\ttotal: 6.69s\tremaining: 3.8s\n",
      "638:\tlearn: 0.3435831\ttotal: 6.7s\tremaining: 3.79s\n",
      "639:\tlearn: 0.3434853\ttotal: 6.71s\tremaining: 3.77s\n",
      "640:\tlearn: 0.3434402\ttotal: 6.72s\tremaining: 3.76s\n",
      "641:\tlearn: 0.3433555\ttotal: 6.73s\tremaining: 3.75s\n",
      "642:\tlearn: 0.3433076\ttotal: 6.74s\tremaining: 3.74s\n",
      "643:\tlearn: 0.3432625\ttotal: 6.75s\tremaining: 3.73s\n",
      "644:\tlearn: 0.3432033\ttotal: 6.76s\tremaining: 3.72s\n",
      "645:\tlearn: 0.3431629\ttotal: 6.77s\tremaining: 3.71s\n",
      "646:\tlearn: 0.3431222\ttotal: 6.77s\tremaining: 3.7s\n",
      "647:\tlearn: 0.3430756\ttotal: 6.78s\tremaining: 3.68s\n",
      "648:\tlearn: 0.3430511\ttotal: 6.79s\tremaining: 3.67s\n",
      "649:\tlearn: 0.3429931\ttotal: 6.79s\tremaining: 3.66s\n",
      "650:\tlearn: 0.3429370\ttotal: 6.8s\tremaining: 3.65s\n",
      "651:\tlearn: 0.3428750\ttotal: 6.82s\tremaining: 3.64s\n",
      "652:\tlearn: 0.3428267\ttotal: 6.83s\tremaining: 3.63s\n",
      "653:\tlearn: 0.3427674\ttotal: 6.84s\tremaining: 3.62s\n",
      "654:\tlearn: 0.3427157\ttotal: 6.85s\tremaining: 3.61s\n",
      "655:\tlearn: 0.3426492\ttotal: 6.86s\tremaining: 3.6s\n",
      "656:\tlearn: 0.3425849\ttotal: 6.87s\tremaining: 3.58s\n",
      "657:\tlearn: 0.3425252\ttotal: 6.87s\tremaining: 3.57s\n",
      "658:\tlearn: 0.3424349\ttotal: 6.88s\tremaining: 3.56s\n",
      "659:\tlearn: 0.3423753\ttotal: 6.89s\tremaining: 3.55s\n",
      "660:\tlearn: 0.3422688\ttotal: 6.89s\tremaining: 3.54s\n",
      "661:\tlearn: 0.3421945\ttotal: 6.9s\tremaining: 3.52s\n",
      "662:\tlearn: 0.3421051\ttotal: 6.91s\tremaining: 3.51s\n",
      "663:\tlearn: 0.3420167\ttotal: 6.92s\tremaining: 3.5s\n",
      "664:\tlearn: 0.3419565\ttotal: 6.94s\tremaining: 3.5s\n",
      "665:\tlearn: 0.3418668\ttotal: 6.95s\tremaining: 3.48s\n",
      "666:\tlearn: 0.3418113\ttotal: 6.96s\tremaining: 3.47s\n",
      "667:\tlearn: 0.3417476\ttotal: 6.97s\tremaining: 3.46s\n",
      "668:\tlearn: 0.3416495\ttotal: 6.97s\tremaining: 3.45s\n",
      "669:\tlearn: 0.3415973\ttotal: 6.98s\tremaining: 3.44s\n",
      "670:\tlearn: 0.3415166\ttotal: 6.99s\tremaining: 3.43s\n",
      "671:\tlearn: 0.3414514\ttotal: 7s\tremaining: 3.42s\n",
      "672:\tlearn: 0.3414002\ttotal: 7s\tremaining: 3.4s\n",
      "673:\tlearn: 0.3413383\ttotal: 7.01s\tremaining: 3.39s\n",
      "674:\tlearn: 0.3412587\ttotal: 7.03s\tremaining: 3.38s\n",
      "675:\tlearn: 0.3411869\ttotal: 7.04s\tremaining: 3.37s\n",
      "676:\tlearn: 0.3411294\ttotal: 7.05s\tremaining: 3.36s\n",
      "677:\tlearn: 0.3410753\ttotal: 7.06s\tremaining: 3.35s\n",
      "678:\tlearn: 0.3410189\ttotal: 7.07s\tremaining: 3.34s\n",
      "679:\tlearn: 0.3409781\ttotal: 7.07s\tremaining: 3.33s\n",
      "680:\tlearn: 0.3409182\ttotal: 7.08s\tremaining: 3.32s\n",
      "681:\tlearn: 0.3408390\ttotal: 7.09s\tremaining: 3.31s\n",
      "682:\tlearn: 0.3407787\ttotal: 7.1s\tremaining: 3.29s\n",
      "683:\tlearn: 0.3407430\ttotal: 7.11s\tremaining: 3.28s\n",
      "684:\tlearn: 0.3406713\ttotal: 7.12s\tremaining: 3.27s\n",
      "685:\tlearn: 0.3405938\ttotal: 7.13s\tremaining: 3.26s\n",
      "686:\tlearn: 0.3405052\ttotal: 7.14s\tremaining: 3.25s\n",
      "687:\tlearn: 0.3404361\ttotal: 7.14s\tremaining: 3.24s\n",
      "688:\tlearn: 0.3403784\ttotal: 7.15s\tremaining: 3.23s\n",
      "689:\tlearn: 0.3403326\ttotal: 7.16s\tremaining: 3.22s\n",
      "690:\tlearn: 0.3402772\ttotal: 7.17s\tremaining: 3.21s\n",
      "691:\tlearn: 0.3402230\ttotal: 7.18s\tremaining: 3.2s\n",
      "692:\tlearn: 0.3401553\ttotal: 7.19s\tremaining: 3.19s\n",
      "693:\tlearn: 0.3401412\ttotal: 7.21s\tremaining: 3.18s\n",
      "694:\tlearn: 0.3400706\ttotal: 7.22s\tremaining: 3.17s\n",
      "695:\tlearn: 0.3400103\ttotal: 7.23s\tremaining: 3.16s\n",
      "696:\tlearn: 0.3399383\ttotal: 7.24s\tremaining: 3.15s\n",
      "697:\tlearn: 0.3398643\ttotal: 7.24s\tremaining: 3.13s\n",
      "698:\tlearn: 0.3397993\ttotal: 7.25s\tremaining: 3.12s\n",
      "699:\tlearn: 0.3397161\ttotal: 7.26s\tremaining: 3.11s\n",
      "700:\tlearn: 0.3396701\ttotal: 7.26s\tremaining: 3.1s\n",
      "701:\tlearn: 0.3396233\ttotal: 7.27s\tremaining: 3.09s\n",
      "702:\tlearn: 0.3395785\ttotal: 7.28s\tremaining: 3.07s\n",
      "703:\tlearn: 0.3395140\ttotal: 7.3s\tremaining: 3.07s\n",
      "704:\tlearn: 0.3394417\ttotal: 7.31s\tremaining: 3.06s\n",
      "705:\tlearn: 0.3393907\ttotal: 7.32s\tremaining: 3.05s\n",
      "706:\tlearn: 0.3393181\ttotal: 7.33s\tremaining: 3.04s\n",
      "707:\tlearn: 0.3392554\ttotal: 7.34s\tremaining: 3.02s\n",
      "708:\tlearn: 0.3392049\ttotal: 7.34s\tremaining: 3.01s\n",
      "709:\tlearn: 0.3391561\ttotal: 7.35s\tremaining: 3s\n",
      "710:\tlearn: 0.3390810\ttotal: 7.36s\tremaining: 2.99s\n",
      "711:\tlearn: 0.3390427\ttotal: 7.37s\tremaining: 2.98s\n",
      "712:\tlearn: 0.3389664\ttotal: 7.39s\tremaining: 2.98s\n",
      "713:\tlearn: 0.3389270\ttotal: 7.4s\tremaining: 2.96s\n",
      "714:\tlearn: 0.3388499\ttotal: 7.42s\tremaining: 2.96s\n",
      "715:\tlearn: 0.3387768\ttotal: 7.43s\tremaining: 2.94s\n",
      "716:\tlearn: 0.3387110\ttotal: 7.44s\tremaining: 2.94s\n",
      "717:\tlearn: 0.3386534\ttotal: 7.45s\tremaining: 2.92s\n",
      "718:\tlearn: 0.3385837\ttotal: 7.46s\tremaining: 2.91s\n",
      "719:\tlearn: 0.3385135\ttotal: 7.47s\tremaining: 2.9s\n",
      "720:\tlearn: 0.3384471\ttotal: 7.49s\tremaining: 2.9s\n",
      "721:\tlearn: 0.3383814\ttotal: 7.5s\tremaining: 2.89s\n",
      "722:\tlearn: 0.3383025\ttotal: 7.5s\tremaining: 2.88s\n",
      "723:\tlearn: 0.3382220\ttotal: 7.51s\tremaining: 2.86s\n",
      "724:\tlearn: 0.3381497\ttotal: 7.52s\tremaining: 2.85s\n",
      "725:\tlearn: 0.3380805\ttotal: 7.54s\tremaining: 2.84s\n",
      "726:\tlearn: 0.3380220\ttotal: 7.54s\tremaining: 2.83s\n",
      "727:\tlearn: 0.3379630\ttotal: 7.55s\tremaining: 2.82s\n",
      "728:\tlearn: 0.3378974\ttotal: 7.57s\tremaining: 2.81s\n",
      "729:\tlearn: 0.3378355\ttotal: 7.58s\tremaining: 2.8s\n",
      "730:\tlearn: 0.3378262\ttotal: 7.59s\tremaining: 2.79s\n",
      "731:\tlearn: 0.3377930\ttotal: 7.6s\tremaining: 2.78s\n",
      "732:\tlearn: 0.3377301\ttotal: 7.61s\tremaining: 2.77s\n",
      "733:\tlearn: 0.3376579\ttotal: 7.62s\tremaining: 2.76s\n",
      "734:\tlearn: 0.3376347\ttotal: 7.62s\tremaining: 2.75s\n",
      "735:\tlearn: 0.3375736\ttotal: 7.63s\tremaining: 2.74s\n",
      "736:\tlearn: 0.3375342\ttotal: 7.64s\tremaining: 2.73s\n",
      "737:\tlearn: 0.3374632\ttotal: 7.67s\tremaining: 2.72s\n",
      "738:\tlearn: 0.3374027\ttotal: 7.68s\tremaining: 2.71s\n",
      "739:\tlearn: 0.3373535\ttotal: 7.69s\tremaining: 2.7s\n",
      "740:\tlearn: 0.3372928\ttotal: 7.7s\tremaining: 2.69s\n",
      "741:\tlearn: 0.3372322\ttotal: 7.71s\tremaining: 2.68s\n",
      "742:\tlearn: 0.3371690\ttotal: 7.71s\tremaining: 2.67s\n",
      "743:\tlearn: 0.3371186\ttotal: 7.72s\tremaining: 2.66s\n",
      "744:\tlearn: 0.3370613\ttotal: 7.73s\tremaining: 2.65s\n",
      "745:\tlearn: 0.3370020\ttotal: 7.74s\tremaining: 2.63s\n",
      "746:\tlearn: 0.3369268\ttotal: 7.76s\tremaining: 2.63s\n",
      "747:\tlearn: 0.3368451\ttotal: 7.78s\tremaining: 2.62s\n",
      "748:\tlearn: 0.3367859\ttotal: 7.79s\tremaining: 2.61s\n",
      "749:\tlearn: 0.3366895\ttotal: 7.8s\tremaining: 2.6s\n",
      "750:\tlearn: 0.3366428\ttotal: 7.81s\tremaining: 2.59s\n",
      "751:\tlearn: 0.3365745\ttotal: 7.81s\tremaining: 2.58s\n",
      "752:\tlearn: 0.3365181\ttotal: 7.82s\tremaining: 2.57s\n",
      "753:\tlearn: 0.3364741\ttotal: 7.83s\tremaining: 2.56s\n",
      "754:\tlearn: 0.3364224\ttotal: 7.85s\tremaining: 2.55s\n",
      "755:\tlearn: 0.3363732\ttotal: 7.86s\tremaining: 2.54s\n",
      "756:\tlearn: 0.3363104\ttotal: 7.86s\tremaining: 2.52s\n",
      "757:\tlearn: 0.3362379\ttotal: 7.87s\tremaining: 2.51s\n",
      "758:\tlearn: 0.3361996\ttotal: 7.88s\tremaining: 2.5s\n",
      "759:\tlearn: 0.3361111\ttotal: 7.89s\tremaining: 2.49s\n",
      "760:\tlearn: 0.3360595\ttotal: 7.9s\tremaining: 2.48s\n",
      "761:\tlearn: 0.3360193\ttotal: 7.91s\tremaining: 2.47s\n",
      "762:\tlearn: 0.3359575\ttotal: 7.92s\tremaining: 2.46s\n",
      "763:\tlearn: 0.3358942\ttotal: 7.93s\tremaining: 2.45s\n",
      "764:\tlearn: 0.3358187\ttotal: 7.94s\tremaining: 2.44s\n",
      "765:\tlearn: 0.3357587\ttotal: 7.95s\tremaining: 2.43s\n",
      "766:\tlearn: 0.3356986\ttotal: 7.96s\tremaining: 2.42s\n",
      "767:\tlearn: 0.3356276\ttotal: 7.96s\tremaining: 2.4s\n",
      "768:\tlearn: 0.3355462\ttotal: 7.97s\tremaining: 2.39s\n",
      "769:\tlearn: 0.3354745\ttotal: 7.98s\tremaining: 2.38s\n",
      "770:\tlearn: 0.3354138\ttotal: 7.99s\tremaining: 2.37s\n",
      "771:\tlearn: 0.3353365\ttotal: 7.99s\tremaining: 2.36s\n",
      "772:\tlearn: 0.3352555\ttotal: 8.01s\tremaining: 2.35s\n",
      "773:\tlearn: 0.3351626\ttotal: 8.03s\tremaining: 2.34s\n",
      "774:\tlearn: 0.3350958\ttotal: 8.04s\tremaining: 2.33s\n",
      "775:\tlearn: 0.3350605\ttotal: 8.04s\tremaining: 2.32s\n",
      "776:\tlearn: 0.3350196\ttotal: 8.05s\tremaining: 2.31s\n",
      "777:\tlearn: 0.3349637\ttotal: 8.06s\tremaining: 2.3s\n",
      "778:\tlearn: 0.3349239\ttotal: 8.06s\tremaining: 2.29s\n",
      "779:\tlearn: 0.3348408\ttotal: 8.07s\tremaining: 2.28s\n",
      "780:\tlearn: 0.3347912\ttotal: 8.08s\tremaining: 2.27s\n",
      "781:\tlearn: 0.3347437\ttotal: 8.09s\tremaining: 2.25s\n",
      "782:\tlearn: 0.3347106\ttotal: 8.09s\tremaining: 2.24s\n",
      "783:\tlearn: 0.3346557\ttotal: 8.1s\tremaining: 2.23s\n",
      "784:\tlearn: 0.3346403\ttotal: 8.12s\tremaining: 2.22s\n",
      "785:\tlearn: 0.3345624\ttotal: 8.13s\tremaining: 2.21s\n",
      "786:\tlearn: 0.3345024\ttotal: 8.14s\tremaining: 2.2s\n",
      "787:\tlearn: 0.3344348\ttotal: 8.15s\tremaining: 2.19s\n",
      "788:\tlearn: 0.3343840\ttotal: 8.16s\tremaining: 2.18s\n",
      "789:\tlearn: 0.3343504\ttotal: 8.17s\tremaining: 2.17s\n",
      "790:\tlearn: 0.3342966\ttotal: 8.18s\tremaining: 2.16s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "791:\tlearn: 0.3342298\ttotal: 8.19s\tremaining: 2.15s\n",
      "792:\tlearn: 0.3341902\ttotal: 8.21s\tremaining: 2.14s\n",
      "793:\tlearn: 0.3341142\ttotal: 8.22s\tremaining: 2.13s\n",
      "794:\tlearn: 0.3340614\ttotal: 8.23s\tremaining: 2.12s\n",
      "795:\tlearn: 0.3339968\ttotal: 8.24s\tremaining: 2.11s\n",
      "796:\tlearn: 0.3339219\ttotal: 8.26s\tremaining: 2.1s\n",
      "797:\tlearn: 0.3338543\ttotal: 8.27s\tremaining: 2.09s\n",
      "798:\tlearn: 0.3338133\ttotal: 8.28s\tremaining: 2.08s\n",
      "799:\tlearn: 0.3337415\ttotal: 8.3s\tremaining: 2.08s\n",
      "800:\tlearn: 0.3336904\ttotal: 8.31s\tremaining: 2.06s\n",
      "801:\tlearn: 0.3336135\ttotal: 8.32s\tremaining: 2.05s\n",
      "802:\tlearn: 0.3335607\ttotal: 8.33s\tremaining: 2.04s\n",
      "803:\tlearn: 0.3335325\ttotal: 8.34s\tremaining: 2.03s\n",
      "804:\tlearn: 0.3334705\ttotal: 8.35s\tremaining: 2.02s\n",
      "805:\tlearn: 0.3334074\ttotal: 8.36s\tremaining: 2.01s\n",
      "806:\tlearn: 0.3333437\ttotal: 8.37s\tremaining: 2s\n",
      "807:\tlearn: 0.3332798\ttotal: 8.4s\tremaining: 2s\n",
      "808:\tlearn: 0.3332239\ttotal: 8.4s\tremaining: 1.98s\n",
      "809:\tlearn: 0.3331533\ttotal: 8.41s\tremaining: 1.97s\n",
      "810:\tlearn: 0.3331010\ttotal: 8.42s\tremaining: 1.96s\n",
      "811:\tlearn: 0.3330199\ttotal: 8.43s\tremaining: 1.95s\n",
      "812:\tlearn: 0.3329850\ttotal: 8.44s\tremaining: 1.94s\n",
      "813:\tlearn: 0.3329352\ttotal: 8.45s\tremaining: 1.93s\n",
      "814:\tlearn: 0.3328803\ttotal: 8.46s\tremaining: 1.92s\n",
      "815:\tlearn: 0.3328258\ttotal: 8.46s\tremaining: 1.91s\n",
      "816:\tlearn: 0.3327686\ttotal: 8.48s\tremaining: 1.9s\n",
      "817:\tlearn: 0.3327272\ttotal: 8.5s\tremaining: 1.89s\n",
      "818:\tlearn: 0.3326546\ttotal: 8.51s\tremaining: 1.88s\n",
      "819:\tlearn: 0.3326125\ttotal: 8.51s\tremaining: 1.87s\n",
      "820:\tlearn: 0.3325544\ttotal: 8.52s\tremaining: 1.86s\n",
      "821:\tlearn: 0.3324999\ttotal: 8.53s\tremaining: 1.85s\n",
      "822:\tlearn: 0.3324361\ttotal: 8.54s\tremaining: 1.84s\n",
      "823:\tlearn: 0.3323901\ttotal: 8.54s\tremaining: 1.82s\n",
      "824:\tlearn: 0.3323210\ttotal: 8.55s\tremaining: 1.81s\n",
      "825:\tlearn: 0.3322664\ttotal: 8.57s\tremaining: 1.8s\n",
      "826:\tlearn: 0.3322157\ttotal: 8.58s\tremaining: 1.79s\n",
      "827:\tlearn: 0.3321911\ttotal: 8.59s\tremaining: 1.78s\n",
      "828:\tlearn: 0.3321389\ttotal: 8.59s\tremaining: 1.77s\n",
      "829:\tlearn: 0.3320877\ttotal: 8.6s\tremaining: 1.76s\n",
      "830:\tlearn: 0.3320399\ttotal: 8.62s\tremaining: 1.75s\n",
      "831:\tlearn: 0.3319870\ttotal: 8.63s\tremaining: 1.74s\n",
      "832:\tlearn: 0.3319158\ttotal: 8.63s\tremaining: 1.73s\n",
      "833:\tlearn: 0.3318641\ttotal: 8.64s\tremaining: 1.72s\n",
      "834:\tlearn: 0.3317818\ttotal: 8.66s\tremaining: 1.71s\n",
      "835:\tlearn: 0.3317307\ttotal: 8.67s\tremaining: 1.7s\n",
      "836:\tlearn: 0.3316865\ttotal: 8.68s\tremaining: 1.69s\n",
      "837:\tlearn: 0.3316454\ttotal: 8.68s\tremaining: 1.68s\n",
      "838:\tlearn: 0.3315661\ttotal: 8.69s\tremaining: 1.67s\n",
      "839:\tlearn: 0.3315067\ttotal: 8.7s\tremaining: 1.66s\n",
      "840:\tlearn: 0.3314255\ttotal: 8.71s\tremaining: 1.65s\n",
      "841:\tlearn: 0.3313896\ttotal: 8.71s\tremaining: 1.64s\n",
      "842:\tlearn: 0.3313353\ttotal: 8.72s\tremaining: 1.62s\n",
      "843:\tlearn: 0.3312615\ttotal: 8.75s\tremaining: 1.62s\n",
      "844:\tlearn: 0.3312229\ttotal: 8.76s\tremaining: 1.61s\n",
      "845:\tlearn: 0.3311280\ttotal: 8.77s\tremaining: 1.6s\n",
      "846:\tlearn: 0.3310795\ttotal: 8.78s\tremaining: 1.58s\n",
      "847:\tlearn: 0.3310145\ttotal: 8.78s\tremaining: 1.57s\n",
      "848:\tlearn: 0.3309530\ttotal: 8.79s\tremaining: 1.56s\n",
      "849:\tlearn: 0.3308875\ttotal: 8.8s\tremaining: 1.55s\n",
      "850:\tlearn: 0.3308255\ttotal: 8.81s\tremaining: 1.54s\n",
      "851:\tlearn: 0.3307690\ttotal: 8.81s\tremaining: 1.53s\n",
      "852:\tlearn: 0.3307086\ttotal: 8.82s\tremaining: 1.52s\n",
      "853:\tlearn: 0.3306586\ttotal: 8.84s\tremaining: 1.51s\n",
      "854:\tlearn: 0.3306038\ttotal: 8.86s\tremaining: 1.5s\n",
      "855:\tlearn: 0.3305597\ttotal: 8.86s\tremaining: 1.49s\n",
      "856:\tlearn: 0.3305156\ttotal: 8.87s\tremaining: 1.48s\n",
      "857:\tlearn: 0.3304360\ttotal: 8.88s\tremaining: 1.47s\n",
      "858:\tlearn: 0.3303596\ttotal: 8.89s\tremaining: 1.46s\n",
      "859:\tlearn: 0.3302913\ttotal: 8.9s\tremaining: 1.45s\n",
      "860:\tlearn: 0.3302358\ttotal: 8.9s\tremaining: 1.44s\n",
      "861:\tlearn: 0.3301885\ttotal: 8.91s\tremaining: 1.43s\n",
      "862:\tlearn: 0.3301250\ttotal: 8.92s\tremaining: 1.42s\n",
      "863:\tlearn: 0.3300893\ttotal: 8.94s\tremaining: 1.41s\n",
      "864:\tlearn: 0.3300332\ttotal: 8.94s\tremaining: 1.4s\n",
      "865:\tlearn: 0.3299679\ttotal: 8.95s\tremaining: 1.39s\n",
      "866:\tlearn: 0.3298888\ttotal: 8.96s\tremaining: 1.37s\n",
      "867:\tlearn: 0.3298300\ttotal: 8.97s\tremaining: 1.36s\n",
      "868:\tlearn: 0.3297828\ttotal: 8.98s\tremaining: 1.35s\n",
      "869:\tlearn: 0.3297058\ttotal: 8.99s\tremaining: 1.34s\n",
      "870:\tlearn: 0.3296442\ttotal: 9s\tremaining: 1.33s\n",
      "871:\tlearn: 0.3296004\ttotal: 9.01s\tremaining: 1.32s\n",
      "872:\tlearn: 0.3295393\ttotal: 9.03s\tremaining: 1.31s\n",
      "873:\tlearn: 0.3294731\ttotal: 9.04s\tremaining: 1.3s\n",
      "874:\tlearn: 0.3294340\ttotal: 9.04s\tremaining: 1.29s\n",
      "875:\tlearn: 0.3293927\ttotal: 9.05s\tremaining: 1.28s\n",
      "876:\tlearn: 0.3293441\ttotal: 9.06s\tremaining: 1.27s\n",
      "877:\tlearn: 0.3292918\ttotal: 9.07s\tremaining: 1.26s\n",
      "878:\tlearn: 0.3292336\ttotal: 9.07s\tremaining: 1.25s\n",
      "879:\tlearn: 0.3291810\ttotal: 9.09s\tremaining: 1.24s\n",
      "880:\tlearn: 0.3291194\ttotal: 9.1s\tremaining: 1.23s\n",
      "881:\tlearn: 0.3290494\ttotal: 9.11s\tremaining: 1.22s\n",
      "882:\tlearn: 0.3289981\ttotal: 9.12s\tremaining: 1.21s\n",
      "883:\tlearn: 0.3289365\ttotal: 9.13s\tremaining: 1.2s\n",
      "884:\tlearn: 0.3288655\ttotal: 9.14s\tremaining: 1.19s\n",
      "885:\tlearn: 0.3288430\ttotal: 9.15s\tremaining: 1.18s\n",
      "886:\tlearn: 0.3288014\ttotal: 9.15s\tremaining: 1.17s\n",
      "887:\tlearn: 0.3287482\ttotal: 9.16s\tremaining: 1.16s\n",
      "888:\tlearn: 0.3287244\ttotal: 9.17s\tremaining: 1.14s\n",
      "889:\tlearn: 0.3286666\ttotal: 9.17s\tremaining: 1.13s\n",
      "890:\tlearn: 0.3286159\ttotal: 9.18s\tremaining: 1.12s\n",
      "891:\tlearn: 0.3285431\ttotal: 9.19s\tremaining: 1.11s\n",
      "892:\tlearn: 0.3284874\ttotal: 9.21s\tremaining: 1.1s\n",
      "893:\tlearn: 0.3284461\ttotal: 9.22s\tremaining: 1.09s\n",
      "894:\tlearn: 0.3284044\ttotal: 9.23s\tremaining: 1.08s\n",
      "895:\tlearn: 0.3283436\ttotal: 9.24s\tremaining: 1.07s\n",
      "896:\tlearn: 0.3283190\ttotal: 9.25s\tremaining: 1.06s\n",
      "897:\tlearn: 0.3282459\ttotal: 9.26s\tremaining: 1.05s\n",
      "898:\tlearn: 0.3281766\ttotal: 9.26s\tremaining: 1.04s\n",
      "899:\tlearn: 0.3281227\ttotal: 9.27s\tremaining: 1.03s\n",
      "900:\tlearn: 0.3280567\ttotal: 9.28s\tremaining: 1.02s\n",
      "901:\tlearn: 0.3280036\ttotal: 9.3s\tremaining: 1.01s\n",
      "902:\tlearn: 0.3279418\ttotal: 9.3s\tremaining: 1000ms\n",
      "903:\tlearn: 0.3278745\ttotal: 9.31s\tremaining: 989ms\n",
      "904:\tlearn: 0.3278400\ttotal: 9.32s\tremaining: 978ms\n",
      "905:\tlearn: 0.3277854\ttotal: 9.33s\tremaining: 968ms\n",
      "906:\tlearn: 0.3277309\ttotal: 9.34s\tremaining: 958ms\n",
      "907:\tlearn: 0.3276709\ttotal: 9.35s\tremaining: 947ms\n",
      "908:\tlearn: 0.3276070\ttotal: 9.36s\tremaining: 937ms\n",
      "909:\tlearn: 0.3275552\ttotal: 9.36s\tremaining: 926ms\n",
      "910:\tlearn: 0.3275127\ttotal: 9.37s\tremaining: 915ms\n",
      "911:\tlearn: 0.3274781\ttotal: 9.39s\tremaining: 906ms\n",
      "912:\tlearn: 0.3274273\ttotal: 9.39s\tremaining: 895ms\n",
      "913:\tlearn: 0.3273584\ttotal: 9.4s\tremaining: 885ms\n",
      "914:\tlearn: 0.3273191\ttotal: 9.41s\tremaining: 874ms\n",
      "915:\tlearn: 0.3272723\ttotal: 9.42s\tremaining: 864ms\n",
      "916:\tlearn: 0.3272096\ttotal: 9.43s\tremaining: 853ms\n",
      "917:\tlearn: 0.3271657\ttotal: 9.43s\tremaining: 843ms\n",
      "918:\tlearn: 0.3270998\ttotal: 9.45s\tremaining: 833ms\n",
      "919:\tlearn: 0.3270337\ttotal: 9.46s\tremaining: 822ms\n",
      "920:\tlearn: 0.3269990\ttotal: 9.47s\tremaining: 812ms\n",
      "921:\tlearn: 0.3269350\ttotal: 9.48s\tremaining: 802ms\n",
      "922:\tlearn: 0.3268708\ttotal: 9.49s\tremaining: 792ms\n",
      "923:\tlearn: 0.3268116\ttotal: 9.5s\tremaining: 781ms\n",
      "924:\tlearn: 0.3267543\ttotal: 9.51s\tremaining: 771ms\n",
      "925:\tlearn: 0.3266882\ttotal: 9.52s\tremaining: 760ms\n",
      "926:\tlearn: 0.3266477\ttotal: 9.52s\tremaining: 750ms\n",
      "927:\tlearn: 0.3265990\ttotal: 9.53s\tremaining: 739ms\n",
      "928:\tlearn: 0.3265458\ttotal: 9.54s\tremaining: 729ms\n",
      "929:\tlearn: 0.3265007\ttotal: 9.54s\tremaining: 718ms\n",
      "930:\tlearn: 0.3264137\ttotal: 9.55s\tremaining: 708ms\n",
      "931:\tlearn: 0.3263635\ttotal: 9.57s\tremaining: 698ms\n",
      "932:\tlearn: 0.3263143\ttotal: 9.58s\tremaining: 688ms\n",
      "933:\tlearn: 0.3262649\ttotal: 9.59s\tremaining: 678ms\n",
      "934:\tlearn: 0.3262094\ttotal: 9.6s\tremaining: 667ms\n",
      "935:\tlearn: 0.3261605\ttotal: 9.6s\tremaining: 657ms\n",
      "936:\tlearn: 0.3261205\ttotal: 9.61s\tremaining: 646ms\n",
      "937:\tlearn: 0.3260611\ttotal: 9.62s\tremaining: 636ms\n",
      "938:\tlearn: 0.3259786\ttotal: 9.63s\tremaining: 626ms\n",
      "939:\tlearn: 0.3259099\ttotal: 9.64s\tremaining: 615ms\n",
      "940:\tlearn: 0.3258497\ttotal: 9.64s\tremaining: 605ms\n",
      "941:\tlearn: 0.3258083\ttotal: 9.66s\tremaining: 595ms\n",
      "942:\tlearn: 0.3257425\ttotal: 9.67s\tremaining: 585ms\n",
      "943:\tlearn: 0.3257054\ttotal: 9.68s\tremaining: 574ms\n",
      "944:\tlearn: 0.3256751\ttotal: 9.69s\tremaining: 564ms\n",
      "945:\tlearn: 0.3256169\ttotal: 9.7s\tremaining: 554ms\n",
      "946:\tlearn: 0.3255724\ttotal: 9.71s\tremaining: 543ms\n",
      "947:\tlearn: 0.3255369\ttotal: 9.72s\tremaining: 533ms\n",
      "948:\tlearn: 0.3254853\ttotal: 9.72s\tremaining: 523ms\n",
      "949:\tlearn: 0.3254298\ttotal: 9.73s\tremaining: 512ms\n",
      "950:\tlearn: 0.3253656\ttotal: 9.75s\tremaining: 502ms\n",
      "951:\tlearn: 0.3253067\ttotal: 9.76s\tremaining: 492ms\n",
      "952:\tlearn: 0.3252694\ttotal: 9.76s\tremaining: 482ms\n",
      "953:\tlearn: 0.3252099\ttotal: 9.77s\tremaining: 471ms\n",
      "954:\tlearn: 0.3251914\ttotal: 9.78s\tremaining: 461ms\n",
      "955:\tlearn: 0.3251474\ttotal: 9.79s\tremaining: 450ms\n",
      "956:\tlearn: 0.3250918\ttotal: 9.79s\tremaining: 440ms\n",
      "957:\tlearn: 0.3250126\ttotal: 9.8s\tremaining: 430ms\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "958:\tlearn: 0.3249640\ttotal: 9.81s\tremaining: 420ms\n",
      "959:\tlearn: 0.3249001\ttotal: 9.82s\tremaining: 409ms\n",
      "960:\tlearn: 0.3248350\ttotal: 9.84s\tremaining: 400ms\n",
      "961:\tlearn: 0.3247859\ttotal: 9.85s\tremaining: 389ms\n",
      "962:\tlearn: 0.3247117\ttotal: 9.86s\tremaining: 379ms\n",
      "963:\tlearn: 0.3246675\ttotal: 9.87s\tremaining: 368ms\n",
      "964:\tlearn: 0.3246370\ttotal: 9.87s\tremaining: 358ms\n",
      "965:\tlearn: 0.3245917\ttotal: 9.88s\tremaining: 348ms\n",
      "966:\tlearn: 0.3245499\ttotal: 9.89s\tremaining: 337ms\n",
      "967:\tlearn: 0.3244993\ttotal: 9.89s\tremaining: 327ms\n",
      "968:\tlearn: 0.3244392\ttotal: 9.9s\tremaining: 317ms\n",
      "969:\tlearn: 0.3243793\ttotal: 9.91s\tremaining: 307ms\n",
      "970:\tlearn: 0.3243304\ttotal: 9.92s\tremaining: 296ms\n",
      "971:\tlearn: 0.3242695\ttotal: 9.94s\tremaining: 286ms\n",
      "972:\tlearn: 0.3242177\ttotal: 9.95s\tremaining: 276ms\n",
      "973:\tlearn: 0.3241778\ttotal: 9.95s\tremaining: 266ms\n",
      "974:\tlearn: 0.3241353\ttotal: 9.96s\tremaining: 255ms\n",
      "975:\tlearn: 0.3240889\ttotal: 9.97s\tremaining: 245ms\n",
      "976:\tlearn: 0.3240533\ttotal: 9.97s\tremaining: 235ms\n",
      "977:\tlearn: 0.3239881\ttotal: 9.98s\tremaining: 225ms\n",
      "978:\tlearn: 0.3239304\ttotal: 9.99s\tremaining: 214ms\n",
      "979:\tlearn: 0.3238314\ttotal: 10s\tremaining: 204ms\n",
      "980:\tlearn: 0.3237805\ttotal: 10s\tremaining: 194ms\n",
      "981:\tlearn: 0.3237239\ttotal: 10s\tremaining: 184ms\n",
      "982:\tlearn: 0.3236709\ttotal: 10s\tremaining: 173ms\n",
      "983:\tlearn: 0.3236354\ttotal: 10s\tremaining: 163ms\n",
      "984:\tlearn: 0.3235701\ttotal: 10.1s\tremaining: 153ms\n",
      "985:\tlearn: 0.3235158\ttotal: 10.1s\tremaining: 143ms\n",
      "986:\tlearn: 0.3234679\ttotal: 10.1s\tremaining: 133ms\n",
      "987:\tlearn: 0.3234347\ttotal: 10.1s\tremaining: 122ms\n",
      "988:\tlearn: 0.3233916\ttotal: 10.1s\tremaining: 112ms\n",
      "989:\tlearn: 0.3233194\ttotal: 10.1s\tremaining: 102ms\n",
      "990:\tlearn: 0.3232544\ttotal: 10.1s\tremaining: 91.9ms\n",
      "991:\tlearn: 0.3232101\ttotal: 10.1s\tremaining: 81.7ms\n",
      "992:\tlearn: 0.3231552\ttotal: 10.1s\tremaining: 71.5ms\n",
      "993:\tlearn: 0.3231058\ttotal: 10.2s\tremaining: 61.4ms\n",
      "994:\tlearn: 0.3230400\ttotal: 10.2s\tremaining: 51.1ms\n",
      "995:\tlearn: 0.3230212\ttotal: 10.2s\tremaining: 41ms\n",
      "996:\tlearn: 0.3229829\ttotal: 10.2s\tremaining: 30.7ms\n",
      "997:\tlearn: 0.3229445\ttotal: 10.2s\tremaining: 20.5ms\n",
      "998:\tlearn: 0.3228951\ttotal: 10.2s\tremaining: 10.3ms\n",
      "999:\tlearn: 0.3228605\ttotal: 10.3s\tremaining: 0us\n"
     ]
    }
   ],
   "source": [
    "# Lets start with CATBOOST\n",
    "cboost = CatBoostClassifier()\n",
    "kfold = StratifiedKFold(n_splits = 5, shuffle = True, random_state = 42)\n",
    "\n",
    "pred_lgbm = []\n",
    "for train_index, test_index in kfold.split(X, y):\n",
    "    xtrain = X.iloc[train_index]\n",
    "    ytrain = y.iloc[train_index]\n",
    "    pred_lgbm.append(cboost.fit(xtrain, ytrain).predict_proba(newtest))\n",
    "    \n",
    "\n",
    "# Generate the Predicted Values...\n",
    "submission[\"Outcome\"] = pd.DataFrame(np.array(pred_lgbm)[0])[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "id": "8a6b3ed9",
   "metadata": {},
   "outputs": [],
   "source": [
    "submission.to_csv(\"CATBOOST_health.csv\", index = False) # 0.75"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "id": "1a0d466d",
   "metadata": {},
   "outputs": [],
   "source": [
    "# Stacking Model\n",
    "base = [('xgb', XGBClassifier())]\n",
    "cv = StratifiedKFold(n_splits = 5, shuffle = True, random_state = 42)\n",
    "from sklearn.ensemble import StackingClassifier\n",
    "stack = StackingClassifier(estimators=base, \n",
    "                           final_estimator=LGBMClassifier(), \n",
    "                           cv = cv)\n",
    "\n",
    "pred_lgbm = []\n",
    "for train_index, test_index in kfold.split(X, y):\n",
    "    xtrain = X.iloc[train_index]\n",
    "    ytrain = y.iloc[train_index]\n",
    "    pred_lgbm.append(stack.fit(xtrain, ytrain).predict_proba(newtest))\n",
    "    \n",
    "# Generate the Predicted Values...\n",
    "submission[\"Outcome\"] = pd.DataFrame(np.array(pred_lgbm)[0])[1]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "id": "e182ca6e",
   "metadata": {},
   "outputs": [],
   "source": [
    "submission.to_csv(\"STACK_health.csv\", index = False) # 0.75"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "f1f0e8b4",
   "metadata": {},
   "source": [
    "### Suggestion:\n",
    "\n",
    "One can now do parameter tuning of LGBM Classifier model to gain the edge in the performance"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "61e46228",
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.13"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}