rating_model_fastai.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "%reload_ext autoreload\n",
    "%autoreload 2\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Plan B: AWD_LSTM Transfer Learning with FastAI"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "from pathlib import Path\n",
    "\n",
    "from fastai import *\n",
    "from fastai.basic_data import *\n",
    "from fastai.text import *\n",
    "from torch import *\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Preparing the data\n",
    "\n",
    "Use panda to conveniently import three `TSV` data files as `DataFrame`s."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "path =  Path('data')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "training_df = pd.read_table(path / 'training_set.ss')\n",
    "test_df = pd.read_table(path / 'test_set.ss')\n",
    "validation_df = pd.read_table(path / 'validation_set.ss')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`review_content` would be the only feature column, `rating` would be our target column"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>user_id</th>\n",
       "      <th>product_id</th>\n",
       "      <th>rating</th>\n",
       "      <th>review_content</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>ur0116181/</td>\n",
       "      <td>\\tt0430357</td>\n",
       "      <td>6</td>\n",
       "      <td>i 'm a huge fan of michael mann -lrb- i even l...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ur0116181/</td>\n",
       "      <td>\\tt0141941</td>\n",
       "      <td>10</td>\n",
       "      <td>this film is unavoidably being compared to dir...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>ur0550732/</td>\n",
       "      <td>\\tt0829459</td>\n",
       "      <td>9</td>\n",
       "      <td>we start all of our reviews with the following...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>ur0550732/</td>\n",
       "      <td>\\tt0964517</td>\n",
       "      <td>10</td>\n",
       "      <td>my wife and i see over 100 movies a year , hav...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>ur0550732/</td>\n",
       "      <td>\\tt0266543</td>\n",
       "      <td>10</td>\n",
       "      <td>we see over 75 movies a year and have not rate...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>ur0550732/</td>\n",
       "      <td>\\tt0183649</td>\n",
       "      <td>8</td>\n",
       "      <td>we absolutely think that colin is simply a ter...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0165854</td>\n",
       "      <td>6</td>\n",
       "      <td>watching this film i feel like apologising to ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0140352</td>\n",
       "      <td>8</td>\n",
       "      <td>russell crowe is fast gaining a great reputati...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0245674</td>\n",
       "      <td>7</td>\n",
       "      <td>i was expecting the usual teen slasher type ho...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0118636</td>\n",
       "      <td>6</td>\n",
       "      <td>apt pupil had the potential to be a great movi...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0098084</td>\n",
       "      <td>6</td>\n",
       "      <td>i found it really hard to come up with a mark ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0122143</td>\n",
       "      <td>7</td>\n",
       "      <td>at the start of this film the first thing we s...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0068646</td>\n",
       "      <td>8</td>\n",
       "      <td>there is not a lot that can be said about the ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0128278</td>\n",
       "      <td>8</td>\n",
       "      <td>anthony hopkins and cuba gooding jnr star in a...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0241303</td>\n",
       "      <td>9</td>\n",
       "      <td>having watched chocolat i so wanted to have a ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>ur0365713/</td>\n",
       "      <td>\\tt0120601</td>\n",
       "      <td>6</td>\n",
       "      <td>if you have n't seen being john malkovich and ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0102768</td>\n",
       "      <td>8</td>\n",
       "      <td>henry -lrb- harrison ford -rrb- is a terrific ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0097737</td>\n",
       "      <td>3</td>\n",
       "      <td>steven -lrb- peter weller -rrb- is one of the ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt1046163</td>\n",
       "      <td>3</td>\n",
       "      <td>tank -lrb- dane cook -rrb- has a job as a `` '...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt1152836</td>\n",
       "      <td>8</td>\n",
       "      <td>john dillinger -lrb- johnny depp -rrb- is very...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0962736</td>\n",
       "      <td>8</td>\n",
       "      <td>princess victoria -lrb- emily blunt -rrb- is i...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0955308</td>\n",
       "      <td>8</td>\n",
       "      <td>robin longstride -lrb- russell crowe -rrb- and...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0053172</td>\n",
       "      <td>10</td>\n",
       "      <td>jan morrow -lrb- doris day -rrb- , an interior...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt1358168</td>\n",
       "      <td>8</td>\n",
       "      <td>a young man sits in an apartment , listening t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0113481</td>\n",
       "      <td>6</td>\n",
       "      <td>johnny -lrb- keanu reeves -rrb- lives in 2021 ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0458352</td>\n",
       "      <td>7</td>\n",
       "      <td>miranda -lrb- meryl streep -rrb- is at the hel...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt1090687</td>\n",
       "      <td>9</td>\n",
       "      <td>steve lopez -lrb- robert , jr. -rrb- is an ace...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt1389137</td>\n",
       "      <td>7</td>\n",
       "      <td>benjamin -lrb- matt damon -rrb- has recently b...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt0821640</td>\n",
       "      <td>7</td>\n",
       "      <td>connor mead -lrb- matthew mcconaughey -rrb- is...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>ur2444068/</td>\n",
       "      <td>\\tt1667353</td>\n",
       "      <td>8</td>\n",
       "      <td>once upon a time , as you probably have heard ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2064</th>\n",
       "      <td>ur0812631/</td>\n",
       "      <td>\\tt0259711</td>\n",
       "      <td>5</td>\n",
       "      <td>this remake of open your eyes is mostly a poin...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2065</th>\n",
       "      <td>ur0812631/</td>\n",
       "      <td>\\tt0201708</td>\n",
       "      <td>8</td>\n",
       "      <td>kiki 's delivery service is not an epic like o...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2066</th>\n",
       "      <td>ur0812631/</td>\n",
       "      <td>\\tt0230697</td>\n",
       "      <td>7</td>\n",
       "      <td>this film is the film that started the whole a...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2067</th>\n",
       "      <td>ur37581915/</td>\n",
       "      <td>\\tt0110265</td>\n",
       "      <td>7</td>\n",
       "      <td>killing zoe i liked it ... but it was a film o...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2068</th>\n",
       "      <td>ur37581915/</td>\n",
       "      <td>\\tt0821640</td>\n",
       "      <td>5</td>\n",
       "      <td>ghosts of girlfriends past i am not a huge rom...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2069</th>\n",
       "      <td>ur37581915/</td>\n",
       "      <td>\\tt1656190</td>\n",
       "      <td>6</td>\n",
       "      <td>safe . &lt;sssss&gt; i watched this movie with a fri...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2070</th>\n",
       "      <td>ur37581915/</td>\n",
       "      <td>\\tt1160368</td>\n",
       "      <td>6</td>\n",
       "      <td>12 rounds this was a good action thriller . &lt;s...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2071</th>\n",
       "      <td>ur37581915/</td>\n",
       "      <td>\\tt0068646</td>\n",
       "      <td>7</td>\n",
       "      <td>the godfather a long time ago i started to wat...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2072</th>\n",
       "      <td>ur6499406/</td>\n",
       "      <td>\\tt1937396</td>\n",
       "      <td>5</td>\n",
       "      <td>there is nothing to beat the aardmans ' animat...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2073</th>\n",
       "      <td>ur6499406/</td>\n",
       "      <td>\\tt1568346</td>\n",
       "      <td>9</td>\n",
       "      <td>having waited before committing to try out thi...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2074</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0116421</td>\n",
       "      <td>5</td>\n",
       "      <td>steven seagal certainly knows how to fight , a...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2075</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0256525</td>\n",
       "      <td>5</td>\n",
       "      <td>`` the curse of the jade scorpion '' offers a ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2076</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0068612</td>\n",
       "      <td>6</td>\n",
       "      <td>provocative cartoon feature that was probably ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2077</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0093075</td>\n",
       "      <td>5</td>\n",
       "      <td>`` the gate '' is an ok little horror film . &lt;...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2078</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0107953</td>\n",
       "      <td>4</td>\n",
       "      <td>`` return of the living dead 3 '' is a sickeni...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2079</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0076590</td>\n",
       "      <td>7</td>\n",
       "      <td>david cronenberg is perhaps a director incapab...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2080</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0086320</td>\n",
       "      <td>5</td>\n",
       "      <td>the characters are idiotic , the acting is pre...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2081</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0119099</td>\n",
       "      <td>6</td>\n",
       "      <td>`` fallen '' is an annoyingly derivative pictu...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2082</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0058329</td>\n",
       "      <td>5</td>\n",
       "      <td>some people consider `` marnie '' to be hitchc...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2083</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0066995</td>\n",
       "      <td>4</td>\n",
       "      <td>`` diamonds are forever '' is my personal cand...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2084</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0108162</td>\n",
       "      <td>6</td>\n",
       "      <td>`` sliver '' was not nearly as bad as most rev...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2085</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0083550</td>\n",
       "      <td>3</td>\n",
       "      <td>extraordinarily stupid -lrb- why does n't the ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2086</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0092857</td>\n",
       "      <td>5</td>\n",
       "      <td>can a single man wipe out all the drug lords a...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2087</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0075462</td>\n",
       "      <td>4</td>\n",
       "      <td>this film had the potential to be a chilling h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2088</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0076630</td>\n",
       "      <td>7</td>\n",
       "      <td>the predicament of five doctors targeted by an...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2089</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0029811</td>\n",
       "      <td>6</td>\n",
       "      <td>`` young and innocent '' is a passable but une...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2090</th>\n",
       "      <td>ur0386241/</td>\n",
       "      <td>\\tt0115964</td>\n",
       "      <td>4</td>\n",
       "      <td>it 's certainly a well-shot film , and the cin...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2091</th>\n",
       "      <td>ur0194347/</td>\n",
       "      <td>\\tt0084777</td>\n",
       "      <td>6</td>\n",
       "      <td>this has everything you 'd expect in an argent...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2092</th>\n",
       "      <td>ur0194347/</td>\n",
       "      <td>\\tt0165710</td>\n",
       "      <td>4</td>\n",
       "      <td>detroit rock city -lrb- 1999 -rrb- * * four ki...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2093</th>\n",
       "      <td>ur0194347/</td>\n",
       "      <td>\\tt0186151</td>\n",
       "      <td>6</td>\n",
       "      <td>frequency * * 1/2 the further behind you leave...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>2094 rows × 4 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "          user_id  product_id  rating  \\\n",
       "0      ur0116181/  \\tt0430357       6   \n",
       "1      ur0116181/  \\tt0141941      10   \n",
       "2      ur0550732/  \\tt0829459       9   \n",
       "3      ur0550732/  \\tt0964517      10   \n",
       "4      ur0550732/  \\tt0266543      10   \n",
       "5      ur0550732/  \\tt0183649       8   \n",
       "6      ur0365713/  \\tt0165854       6   \n",
       "7      ur0365713/  \\tt0140352       8   \n",
       "8      ur0365713/  \\tt0245674       7   \n",
       "9      ur0365713/  \\tt0118636       6   \n",
       "10     ur0365713/  \\tt0098084       6   \n",
       "11     ur0365713/  \\tt0122143       7   \n",
       "12     ur0365713/  \\tt0068646       8   \n",
       "13     ur0365713/  \\tt0128278       8   \n",
       "14     ur0365713/  \\tt0241303       9   \n",
       "15     ur0365713/  \\tt0120601       6   \n",
       "16     ur2444068/  \\tt0102768       8   \n",
       "17     ur2444068/  \\tt0097737       3   \n",
       "18     ur2444068/  \\tt1046163       3   \n",
       "19     ur2444068/  \\tt1152836       8   \n",
       "20     ur2444068/  \\tt0962736       8   \n",
       "21     ur2444068/  \\tt0955308       8   \n",
       "22     ur2444068/  \\tt0053172      10   \n",
       "23     ur2444068/  \\tt1358168       8   \n",
       "24     ur2444068/  \\tt0113481       6   \n",
       "25     ur2444068/  \\tt0458352       7   \n",
       "26     ur2444068/  \\tt1090687       9   \n",
       "27     ur2444068/  \\tt1389137       7   \n",
       "28     ur2444068/  \\tt0821640       7   \n",
       "29     ur2444068/  \\tt1667353       8   \n",
       "...           ...         ...     ...   \n",
       "2064   ur0812631/  \\tt0259711       5   \n",
       "2065   ur0812631/  \\tt0201708       8   \n",
       "2066   ur0812631/  \\tt0230697       7   \n",
       "2067  ur37581915/  \\tt0110265       7   \n",
       "2068  ur37581915/  \\tt0821640       5   \n",
       "2069  ur37581915/  \\tt1656190       6   \n",
       "2070  ur37581915/  \\tt1160368       6   \n",
       "2071  ur37581915/  \\tt0068646       7   \n",
       "2072   ur6499406/  \\tt1937396       5   \n",
       "2073   ur6499406/  \\tt1568346       9   \n",
       "2074   ur0386241/  \\tt0116421       5   \n",
       "2075   ur0386241/  \\tt0256525       5   \n",
       "2076   ur0386241/  \\tt0068612       6   \n",
       "2077   ur0386241/  \\tt0093075       5   \n",
       "2078   ur0386241/  \\tt0107953       4   \n",
       "2079   ur0386241/  \\tt0076590       7   \n",
       "2080   ur0386241/  \\tt0086320       5   \n",
       "2081   ur0386241/  \\tt0119099       6   \n",
       "2082   ur0386241/  \\tt0058329       5   \n",
       "2083   ur0386241/  \\tt0066995       4   \n",
       "2084   ur0386241/  \\tt0108162       6   \n",
       "2085   ur0386241/  \\tt0083550       3   \n",
       "2086   ur0386241/  \\tt0092857       5   \n",
       "2087   ur0386241/  \\tt0075462       4   \n",
       "2088   ur0386241/  \\tt0076630       7   \n",
       "2089   ur0386241/  \\tt0029811       6   \n",
       "2090   ur0386241/  \\tt0115964       4   \n",
       "2091   ur0194347/  \\tt0084777       6   \n",
       "2092   ur0194347/  \\tt0165710       4   \n",
       "2093   ur0194347/  \\tt0186151       6   \n",
       "\n",
       "                                         review_content  \n",
       "0     i 'm a huge fan of michael mann -lrb- i even l...  \n",
       "1     this film is unavoidably being compared to dir...  \n",
       "2     we start all of our reviews with the following...  \n",
       "3     my wife and i see over 100 movies a year , hav...  \n",
       "4     we see over 75 movies a year and have not rate...  \n",
       "5     we absolutely think that colin is simply a ter...  \n",
       "6     watching this film i feel like apologising to ...  \n",
       "7     russell crowe is fast gaining a great reputati...  \n",
       "8     i was expecting the usual teen slasher type ho...  \n",
       "9     apt pupil had the potential to be a great movi...  \n",
       "10    i found it really hard to come up with a mark ...  \n",
       "11    at the start of this film the first thing we s...  \n",
       "12    there is not a lot that can be said about the ...  \n",
       "13    anthony hopkins and cuba gooding jnr star in a...  \n",
       "14    having watched chocolat i so wanted to have a ...  \n",
       "15    if you have n't seen being john malkovich and ...  \n",
       "16    henry -lrb- harrison ford -rrb- is a terrific ...  \n",
       "17    steven -lrb- peter weller -rrb- is one of the ...  \n",
       "18    tank -lrb- dane cook -rrb- has a job as a `` '...  \n",
       "19    john dillinger -lrb- johnny depp -rrb- is very...  \n",
       "20    princess victoria -lrb- emily blunt -rrb- is i...  \n",
       "21    robin longstride -lrb- russell crowe -rrb- and...  \n",
       "22    jan morrow -lrb- doris day -rrb- , an interior...  \n",
       "23    a young man sits in an apartment , listening t...  \n",
       "24    johnny -lrb- keanu reeves -rrb- lives in 2021 ...  \n",
       "25    miranda -lrb- meryl streep -rrb- is at the hel...  \n",
       "26    steve lopez -lrb- robert , jr. -rrb- is an ace...  \n",
       "27    benjamin -lrb- matt damon -rrb- has recently b...  \n",
       "28    connor mead -lrb- matthew mcconaughey -rrb- is...  \n",
       "29    once upon a time , as you probably have heard ...  \n",
       "...                                                 ...  \n",
       "2064  this remake of open your eyes is mostly a poin...  \n",
       "2065  kiki 's delivery service is not an epic like o...  \n",
       "2066  this film is the film that started the whole a...  \n",
       "2067  killing zoe i liked it ... but it was a film o...  \n",
       "2068  ghosts of girlfriends past i am not a huge rom...  \n",
       "2069  safe . <sssss> i watched this movie with a fri...  \n",
       "2070  12 rounds this was a good action thriller . <s...  \n",
       "2071  the godfather a long time ago i started to wat...  \n",
       "2072  there is nothing to beat the aardmans ' animat...  \n",
       "2073  having waited before committing to try out thi...  \n",
       "2074  steven seagal certainly knows how to fight , a...  \n",
       "2075  `` the curse of the jade scorpion '' offers a ...  \n",
       "2076  provocative cartoon feature that was probably ...  \n",
       "2077  `` the gate '' is an ok little horror film . <...  \n",
       "2078  `` return of the living dead 3 '' is a sickeni...  \n",
       "2079  david cronenberg is perhaps a director incapab...  \n",
       "2080  the characters are idiotic , the acting is pre...  \n",
       "2081  `` fallen '' is an annoyingly derivative pictu...  \n",
       "2082  some people consider `` marnie '' to be hitchc...  \n",
       "2083  `` diamonds are forever '' is my personal cand...  \n",
       "2084  `` sliver '' was not nearly as bad as most rev...  \n",
       "2085  extraordinarily stupid -lrb- why does n't the ...  \n",
       "2086  can a single man wipe out all the drug lords a...  \n",
       "2087  this film had the potential to be a chilling h...  \n",
       "2088  the predicament of five doctors targeted by an...  \n",
       "2089  `` young and innocent '' is a passable but une...  \n",
       "2090  it 's certainly a well-shot film , and the cin...  \n",
       "2091  this has everything you 'd expect in an argent...  \n",
       "2092  detroit rock city -lrb- 1999 -rrb- * * four ki...  \n",
       "2093  frequency * * 1/2 the further behind you leave...  \n",
       "\n",
       "[2094 rows x 4 columns]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "validation_df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Tokenization && Numericalization\n",
    "\n",
    "In fastai, `TextDataBunch` helps us to tokenize words and clean some parts of our texts like HTML code for instance.\n",
    "\n",
    "Also, once we have extracted tokens from our texts, DataBunch also helps to convert tokens to integers by creating a list of all the words used. By default,it only keeps the ones that appear at least twice with a maximum vocabulary size of 60,000 (by default) and replace the ones that don't make the cut by the unknown token `UNK`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Language model data\n",
    "data_lm = TextLMDataBunch.from_df(path, training_df, valid_df=validation_df, test_df=test_df, text_cols=['review_content'], label_cols=['rating'])\n",
    "# Classifier model data\n",
    "data_clas = TextClasDataBunch.from_df(path, train_df=training_df, valid_df=validation_df, test_df=test_df, vocab=data_lm.train_ds.vocab, text_cols=['review_content'], label_cols=['rating'], bs=32)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "data_lm.save('data_lm_export.pkl')\n",
    "data_clas.save('data_clas_export.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "data_lm = load_data(path, 'data_lm_export.pkl')\n",
    "data_clas = load_data(path, 'data_clas_export.pkl', bs=16)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Language model\n",
    "\n",
    "Language model is trained to guess what the next word is, its input being all the previous words. It has a recurrent structure and a hidden state that is updated each time it sees a new word. This hidden state thus contains information about the sentence up to that point.\n",
    "\n",
    "We are going to use that 'knowledge' of the English language to build our classifier\n",
    "\n",
    "We use pretrained `AWD_LSTM` model as a starting point. `AWD-LSTM` has been dominating the state-of-the-art language modeling. All the top research papers on word-level models incorporate `AWD-LSTM`s. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### LSTM\n",
    "\n",
    "A normal LSTM cell's mathematical formulation looks like this:\n",
    "\n",
    "$$i_t  = σ(W^ix_t + U^ih_{t-1})$$\n",
    "$$f_t = σ(W^fx_t  + U^fh_{t-1})$$\n",
    "$$o_t = σ(W^ox_t  + U^oh_{t-1})$$\n",
    "$$c'_t = tanh(W^cx_t  + U^ch_{t-1})$$\n",
    "$$c_t = i_t ⊙ c'_t + f_t ⊙ c'_{t-1}$$\n",
    "$$ht = o_t ⊙ tanh(c_t)$$\n",
    "\n",
    "where, $W^i$, $W^f$, $W^o$, $W^c$, $U^i$, $U^f$, $U^o$, $U^c$ are weight matrices, $x_t$ is the vector input to timestep $t$, $h_t$ is the current exposed hidden state, ct is the memory cell state, and $⊙$ is element-wise multiplication.\n",
    "\n",
    "### AWD_LSTM: ASGD Weight-dropped LSTM \n",
    "\n",
    "The recurrent connections of an RNN have been prone to overfitting. Dropouts have been massively successful in feed-forward and convolutional neural networks to prevent overfitting. But applying dropouts similarly to an RNN's hidden state is ineffective as it disrupts the RNN's ability to retain long-term dependencies.\n",
    "\n",
    "To counter this problem, AWD_LSTM uses DropConnect. We know that in Dropout, a randomly selected subset of activations is set to zero within each layer. In DropConnect, instead of activations, a randomly selected subset of weights within the network is set to zero. Each unit thus receives input from a random subset of units in the previous layer.\n",
    "\n",
    "![drop_connect](./images/drop_connect.jpg)\n",
    "\n",
    "DropConnect is applied on the hidden to hidden weight matrices ($U^i$, $U^f$, $U^o$, $U^c$) instead of the hidden or memory states. Since this dropout operation is performed once, before the forward and backward pass the impact on training speed is minimal and any standard optimized black box RNN implementation can be used. By performing dropout on the hidden-to-hidden weight matrices, overfitting can be prevented on the recurrent connections of the LSTM.\n",
    "\n",
    "[Details](https://yashuseth.blog/2018/09/12/awd-lstm-explanation-understanding-language-model/)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Train"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "learn = language_model_learner(data_lm, AWD_LSTM, drop_mult=0.5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: left;\">\n",
       "      <th>epoch</th>\n",
       "      <th>train_loss</th>\n",
       "      <th>valid_loss</th>\n",
       "      <th>accuracy</th>\n",
       "      <th>time</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>3.753421</td>\n",
       "      <td>3.642199</td>\n",
       "      <td>0.386658</td>\n",
       "      <td>14:48</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "learn.fit_one_cycle(1, 1e-2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Fine-tuning\n",
    "\n",
    "I would say `1e-2` or `1e-3` here as learning rate are like rule of numbs than magic numbers, which work most of the time.  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# We unfreeze the entire model weights and start training 1 epoch\n",
    "learn.unfreeze()\n",
    "learn.fit_one_cycle(1, 1e-3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "learn.save_encoder('ft_enc') # 191.318M"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'find although a true classic film for me for sense of'"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Have fun testing\n",
    "learn.predict('find', n_words=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Text Classifier\n",
    "\n",
    "So now we got a language model, then we need to build a classifier which will take in text and tell us the rating it guesses.\n",
    "For this specific task, fastai equips us with `text_classifier_learner`. Again, we start with pretrained `AWD_LSTM` network."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [],
   "source": [
    "learn = text_classifier_learner(data_clas, AWD_LSTM, drop_mult=0.5)\n",
    "# Load the language model we just trained as encoder\n",
    "learn.load_encoder('ft_enc')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>text</th>\n",
       "      <th>target</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>xxbos the day after tomorrow is one of those movies that comes along occasionally that operates on such a massive scale that it 's sure to be a success even if for no other reason than because it takes place in such a massive setting . &lt; xxrep 5 s &gt; i think that a large part of the appeal of disaster movies comes from the possibility of seeing somewhere</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>xxbos this is yet another summer blockbuster gone hollywood awry by being a bloated , self - indulging `` more is better '' behemoth . &lt; xxrep 5 s &gt; the series is based on my favorite disney amusement park ride of the same name . &lt; xxrep 5 s &gt; by this point i was surprised that the end product has been this tolerable , considering the sword of</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>xxbos `` talladega nights : the ballad of ricky bobby '' is about a man named ricky bobby -lrb- will ferrell -rrb- who as a boy always dreamed of being a race car driver and living life in the fast lane . &lt; xxrep 5 s &gt; so one day , ricky bobby got the chance of a lifetime as he was able to race in a nascar tournament .</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>xxbos what is with hollywood and the concept of love in the mitts of great disasters ? &lt; xxrep 5 s &gt; there can be no greater example of this obsession than the highest grossing film of all time , titanic . &lt; xxrep 5 s &gt; though the oscar darling can be blamed for the most recent trend , it is not the first to start this . &lt;</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>xxbos director walter stuck faithfully to ernesto guevara and alberto granado 's book recounting their 1952 adventure traveling through thousands of miles of south america , much of their adventure taking them through magnificent wilderness and provincial small towns . &lt; xxrep 5 s &gt; guevara -lrb- gael garcia bernal -rrb- was about a semester away from receiving his medical degree . &lt; xxrep 5 s &gt; his jovial companion</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# See how the dataset looks\n",
    "data_clas.show_batch()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: left;\">\n",
       "      <th>epoch</th>\n",
       "      <th>train_loss</th>\n",
       "      <th>valid_loss</th>\n",
       "      <th>accuracy</th>\n",
       "      <th>time</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>1.791870</td>\n",
       "      <td>1.714865</td>\n",
       "      <td>0.316141</td>\n",
       "      <td>08:02</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "learn.fit_one_cycle(1, 1e-2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Save intermediate model to enable resuming training from stages\n",
    "learn.save('stage-1-model.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "RNNLearner(data=TextClasDataBunch;\n",
       "\n",
       "Train: LabelList (16839 items)\n",
       "x: TextList\n",
       "xxbos sometimes popular opinion really sucks about a film elevating a rotten movie to cult status and if you do n't like it then you obviously do n't get it . < xxrep 5 s > this movie is one of them . < xxrep 5 s > the much discussed camera moves did not make me sick , but the whiny idiotic characters did . < xxrep 5 s > the suspense was minimal . < xxrep 5 s > i do n't care if it was really low budget . < xxrep 5 s > i ' m not going to grade a film on degree of difficulty . < xxrep 5 s > i ' m sure that `` titanic '' was a very tough experience for the production crew . < xxrep 5 s > i do n't care ! < xxrep 5 s > it was a great movie because it had a great story and great characters and was really well put together . < xxrep 5 s > this movie did n't have any of those things . < xxrep 5 s > it telegraphed the last shot in the first 15 minutes . < xxrep 5 s > this is one of those rare films that made me angry that i wasted my time with it .,xxbos this is an amazing piece of work and it probably tops `` the insider '' , `` the sixth sense '' , `` edtv '' and `` bringing out the dead '' as my favorite film of the year . < xxrep 5 s > alan ball 's screenplay is one the modern wonders of the world and sam mendes 's direction matches it -lrb- i can see why he bested michael mann as the l.a . film critics director of the year -rrb- . < xxrep 5 s > where did these guys come from ? < xxrep 5 s > this story of an american family and the tiny slice of the world they live in is xxunk before us with the precision and fascination of a geneticist unravelling a strand of dna through an xxunk microscope . < xxrep 5 s > this is not to suggest that the film is cold -lrb- far from it -rrb- . < xxrep 5 s > it just felt like i was watching the characters lives from beneath their skins . < xxrep 5 s > rarely have i felt like i knew an entire cast so well . < xxrep 5 s > this will be a hard movie to reward at oscar time because every single performance hit exactly the right key -lrb- `` l.a . confidential '' had the same problem -rrb- , but obviously kevin spacey and annette benning should lead actor noms . < xxrep 5 s > spacey has played laconic many times before -lrb- i ca n't think of a film where he has n't been this way before -rrb- , but not with the dry wit and comic timing he displays here . < xxrep 5 s > even when he blows up it is dry . < xxrep 5 s > benning has her best role since `` the grifters '' and makes the most it . < xxrep 5 s > she is a stepford wife with real ambition . < xxrep 5 s > they are a married couple who long ago gave up on the american dream but are too comfortable to give up the amercian facade and this is ball 's key contempt . < xxrep 5 s > it is a very unique view . < xxrep 5 s > while the adults know that they are screwed up the kids still fight to have hope . < xxrep 5 s > it is their rebellion . < xxrep 5 s > thora xxunk is outstanding as the lone child of spacey and benning who is getting killed by her parents ' cynicism . < xxrep 5 s > the most frightening performance is given by wes bentley as the next door neighbor kid who is constantly peeping and taping other people 's lives , but also finding beauty amid the ugliness and chaos in some of the film 's most moving scenes -lrb- a lot people will not get the significance and meaning of the paper bag , but those who do understand the film completely -- i thought is was awesome -rrb- . < xxrep 5 s > i think he is acting as the xxunk . < xxrep 5 s > finally mena suvari is a revelation as the smart - ass and all - knowing teenage friend who reveals a heartbreaking vulnerability . < xxrep 5 s > this film is very dark but like `` bringing out the dead '' there is a redemptive quality leaves you with hope at the end . < xxrep 5 s > i was floored by this . < xxrep 5 s > it is also a very funny film . < xxrep 5 s > american beauty may be the best film of a very good year .,xxbos this movie does not belong in a cinema . < xxrep 5 s > it belongs in a museum of modern art running in a continuous loop . < xxrep 5 s > -lrb- at least `` melancholia '' has a plot . < xxrep 5 s > -rrb- terrence malick 's ruminations on the difficulty of balancing nature & grace is beautiful bore . < xxrep 5 s > there are images in this film that are as breathtaking as any i ' ve ever seen in cinema . < xxrep 5 s > the 19 minute sequence that depicts `` creation '' is easily worthy of favorable comparison to `` 2001 '' 's `` voyage beyond infinity '' sequence . < xxrep 5 s > i was practically floating out of my chair while watching -- experiencing -- it . < xxrep 5 s > it also features a couple of brief dinosaur scenes which surpass any in `` jurassic park '' in terms of sheer realization & beauty . < xxrep 5 s > this portion of the film was definitely worth the effort put into creating it . < xxrep 5 s > but there are 2 other hours of this film which occasionally stir emotions & do n't really connect to anything except malick 's own cosmic navel gazing . < xxrep 5 s > i love `` 2001 '' , `` walkabout ' , `` '' & `` brazil '' . < xxrep 5 s > `` the tree of life '' shares these films uniqueness & sense of wonder but did n't connect with me on a deeper level like them . < xxrep 5 s > call me a low brow , but i 'll take `` caption america : the first avenger '' over this film any day .,xxbos the first nominees for next year 's oscars in the best picture , best actress , best supporting actor , best director , best original or adapted screenplay and best costume design categories have already been secured with the arrival of `` erin brockovich '' . < xxrep 5 s > julia roberts is spectacular in the title role of a hard working single mother who stumbles on one of the biggest corporate wrongs in u.s . history . < xxrep 5 s > she would ' ve stole every scene if it was n't for her co - star albert finney who matches her for every . < xxrep 5 s > he plays her reluctant and somewhat befuddled employer who finally joins her fight . < xxrep 5 s > although her box office says otherwise i ' ve always thought roberts was way overrated as a movie star . < xxrep 5 s > now i ' m a believer . < xxrep 5 s > she is smart , sassy , foul - mouthed , fiery , sensitive , funny and , of course , very sexy . < xxrep 5 s > it is one of best performances i ' ve ever seen by an actress in a lead role and for some reason it reminds me of susan sarandon 's annie savoy from `` bull durham '' in that both outstanding roles combined real intelligence with real sex appeal . < xxrep 5 s > -lrb- of course annie savoy is purely fictional whereas erin brockovich is not . < xxrep 5 s > -rrb- i sense that her character may appeal more to men than women -lrb- her costume designer obviously had a lot fun working on this film -rrb- . < xxrep 5 s > the reviews i ' ve read have been excellent , but this movie exceeds them largely because the rest of the actors are great as well . < xxrep 5 s > finney 's work is more nuanced than roberts ' because it has to be and he provides the perfect foil for her volcanic emotions . < xxrep 5 s > aaron eckhardt deserves mention too as roberts ' good guy biker boyfriend . < xxrep 5 s > these performances are made possible by a superb script from susannah grant . < xxrep 5 s > her fact - based tale of a small -lrb- hick -rrb- town poisoned by a giant utility has `` rocky '' - like xxunk in it and they feel all earned . < xxrep 5 s > the fascinating tale is matched by dialogue that is often fast and furious and very funny and it is in a story that really tugs at your heart strings . < xxrep 5 s > director steven soderbergh equals the effort that he put forth with the vastly underrated `` out of sight '' . < xxrep 5 s > this is an `` adult '' movie in the very best sense of that term . < xxrep 5 s > `` erin brockovich '' is definitely a big hollywood movie with all he fun and rewards that come with it . < xxrep 5 s > it also proves that smart entertainment can deal with big issues and make time fly . < xxrep 5 s > it is the first best picture nominee for next year .,xxbos my expectations for writer / director m. night shyamalan 's next movie after `` the sixth sense '' were extremely high and `` unbreakable '' did not let me down . < xxrep 5 s > in fact , in some respects , it is a better and more self assured movie than the former . < xxrep 5 s > like `` 6th '' , `` un '' is a movie that the less you know about it going in the better it is and i 'll be damned if i ' m gon na give anything away here . < xxrep 5 s > however i will say that bruce willis and samuel l. jackson -lrb- has this guy ever given a bad performance ? < xxrep 5 s > -rrb- are outstanding as the leads . < xxrep 5 s > there is not a wasted role in the movie . < xxrep 5 s > shyamalan has concocted another fantastic tale set against urban reality . < xxrep 5 s > the spirit of rod serling lives in him . < xxrep 5 s > his direction and writing are a xxunk blend of moods and spiritualism that resonates deep within your emotions . < xxrep 5 s > he is aided greatly by james newton howard 's brilliant score and eduardo xxunk 's daring cinematography . < xxrep 5 s > this movie takes more chances than `` 6th '' . < xxrep 5 s > you either buy it or you do n't . < xxrep 5 s > it has a dream logic that never sacrifices narrative thrust . < xxrep 5 s > `` un '' does n't benefit from `` 6th '' 's shock value , but i think is a more accomplished piece overall . < xxrep 5 s > it and `` erin brokovich are clearly this year 's 2 best movies .\n",
       "y: CategoryList\n",
       "1,10,5,10,10\n",
       "Path: data;\n",
       "\n",
       "Valid: LabelList (2094 items)\n",
       "x: TextList\n",
       "xxbos i ' m a huge fan of michael mann -lrb- i even liked the keep a lot -rrb- . < xxrep 5 s > nobody , even martin scorsese , does lawmen and the lawless better . < xxrep 5 s > thief , heat and collateral are all classics -lrb- heat is as good as the 1st 2 godfathers -rrb- . < xxrep 5 s > cut to the chase . < xxrep 5 s > miami vice is a disappointment . < xxrep 5 s > i ' m glad it xxunk from the -lrb- excellent -rrb- tv show . < xxrep 5 s > as a feature film it is flat and not involving . < xxrep 5 s > colin farrell can not hold the screen as a leading man . < xxrep 5 s > jamie foxx is handcuffed in a thankless role . < xxrep 5 s > the villains are dull . < xxrep 5 s > the action set pieces are few and seem like limp ripoffs of his other films . < xxrep 5 s > there is no synergy here . < xxrep 5 s > michael mann is all synergy . < xxrep 5 s > the music is uninspired . < xxrep 5 s > the editing is as confusing as the plot . < xxrep 5 s > dion beebe 's groundbreaking high def work in collateral does n't work very well for this film . < xxrep 5 s > there is not a single memorable moment in this film and coming from mann that is a shock . < xxrep 5 s > i ' m rating this film against mann 's other films because i ca n't do so otherwise -lrb- like spielberg , cameron , howard , nolan , greengrass , eastwood and any other a - lister -rrb- . < xxrep 5 s > so why do i give it a 6 / 10 ?,xxbos this film is unavoidably being compared to director alan j. pakula 's `` all the president 's men '' and for good reason , because michael mann 's new film is every bit as good . < xxrep 5 s > -lrb- anybody is the tv news biz - like me - knows that newspaper and tv news are very different animals . < xxrep 5 s > -rrb- `` the insider '' is a very mature film . < xxrep 5 s > it takes its sweet time letting the events unfold . < xxrep 5 s > however mann and his team use very cinematic trick in the book to hold our attention and the editing is impeccable . < xxrep 5 s > but first and foremost the film features 2 virtuoso performances : one by a master we ' ve grown accustomed to and one by a guy who may have joined his league . < xxrep 5 s > of course i ' m talking about al pacino and russell crowe . < xxrep 5 s > pacino adds another mammoth blast in his hall of fame collection of home run performances . < xxrep 5 s > his portrayal of 60 minutes producer gives him a lot of room to use all his skills as an actor and he never ever looks like an actor acting . < xxrep 5 s > he vents anger and frustration better than any actor i ' ve ever seen and he is given the chance to do so here . < xxrep 5 s > now on to the `` new '' guy . < xxrep 5 s > anybody who has seen russell crowe before -lrb- especially in his oscar - worthy effort in `` l.a . confidential '' -rrb- is not surprised that he can more than hold his own against pacino , but then again acting is not a sporting event and there is room for a lot of winners in a movie like this . < xxrep 5 s > crowe 's role as `` the guy '' who blows the whistle on the tobacco industry is a fascinating study of a man imploding . < xxrep 5 s > not since pacino 's work in `` the godfather ii '' have i ' ve seen it done so well . < xxrep 5 s > like every other thing mann has done the supporting actors are great too , but the standout here is christopher plummer 's mike wallace who has to reluctantly sell out to the corporate bottom line . < xxrep 5 s > the story about a guy who wants to go public about a major public health crime but is abandoned by a major network is complex and difficult stuff , but mann and co - scripter eric roth do a magnificent job at keeping it clear and interesting . < xxrep 5 s > it is riveting and important entertainment . < xxrep 5 s > like the phrase `` tv journalism '' , `` important entertainment '' may seem like a contradiction of terms , but not with this movie which is one the best films of the year .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > angelina jolie and dan xxunk and the entire cast take us through what happened in the search for danny pearl that we did not see or hear about in the press as they frantically tried to find him before he was so brutally killed . < xxrep 5 s > a very poignant love story with a horrific ending . < xxrep 5 s > kudos to marianne pearl and angelina jolie and brad pitt who produced the movie .,xxbos my wife and i see over 100 movies a year , having been in the business and now retired . < xxrep 5 s > we do not read any reviews by anyone . < xxrep 5 s > we try to tell our friends that a critic is one person , he or she is not us . < xxrep 5 s > critics are also a dying breed as newspapers disappear . < xxrep 5 s > therefore , our critique is not biased and based on actually seeing the movie in a theatre . < xxrep 5 s > many critics see the movies 5 at a time in a viewing a real atmosphere to gauge audience reaction . < xxrep 5 s > how can you review a movie without the real deal ? < xxrep 5 s > a great movie with all three stars giving academy award performances amy adams , mark wahlberg and christian bale . < xxrep 5 s > one of the best fight films we have ever seen . < xxrep 5 s > amy adams does her usual fabulous job in still another type of roll . < xxrep 5 s > wahlberg has become a terrific actor and director and christan bale steals the movie with his great acting . < xxrep 5 s > do n't miss it .,xxbos we see over 75 movies a year and have not rated one a perfect 10 for over 3 years . < xxrep 5 s > this is the perfect movie . < xxrep 5 s > pixar is amazing . < xxrep 5 s > everything about this movie from the storyline to the characters to the unbelievable graphics are spectacular . < xxrep 5 s > hats off to pixar may they strike a new deal with disney and keep them coming . < xxrep 5 s > never expected them to top toy story , then toy story ii and now this is even better . < xxrep 5 s > wow !\n",
       "y: CategoryList\n",
       "6,10,9,10,10\n",
       "Path: data;\n",
       "\n",
       "Test: LabelList (2278 items)\n",
       "x: TextList\n",
       "xxbos edward norton is right & wrong . < xxrep 5 s > this movie could have used more of him in it -lrb- when the dvd comes out i hope they include `` his cut '' if it exist -rrb- , but he is wrong for not promoting this movie . < xxrep 5 s > this re - boot is a blast to watch . < xxrep 5 s > i actually liked much of ang lee 's version but only in fits & starts . < xxrep 5 s > this hulk is a much smoother machine that never drags . < xxrep 5 s > the fx are spectacular & sometimes inspired -- every part of the production is great . < xxrep 5 s > the battle scenes are ferocious . < xxrep 5 s > i never tired of watching mean green do his thing , but i guess that s the point . < xxrep 5 s > the movie makers knew when to cut the action . < xxrep 5 s > however -- like iron man -- the acting is way above average for this sort of escapism , but , come to think of it , all 3 xxunk & x - men + batman begins -lrb- & returns -rrb- also featured really fine & often great acting . < xxrep 5 s > and this hulk could ' ve used more of it . < xxrep 5 s > norton is 1 of the top 5 actors currently working . < xxrep 5 s > there are moments in this movie when his talent really pays off and they are all too brief . < xxrep 5 s > william hurt makes a fine foe . < xxrep 5 s > and , so help me movie gods , liv tyler gives a memorable performance although she is mostly stuck saying the name `` bruce '' . < xxrep 5 s > overall this movie rocks . < xxrep 5 s > and i thought all movies released xxunk july 18th were just until the dark knight arrives . < xxrep 5 s > thank you tony stark , indy & bruce banner for proving me wrong .,xxbos it is no surprise that gary ross -- the writer of big and dave -- once again brings a very smart comedy to the big screen , but what is surprising is the level of directorial xxunk that he brings to a very complex undertaking . < xxrep 5 s > pleasantville is a wonderful laugh - out - loud satire that deals with issues such as racism , fascism , artistic freedom , individuality , sexual mores , 90 's amorality , group control and some other things i probably missed . < xxrep 5 s > but ross wraps his messages in ambiguity and , most importantly , entertainment . < xxrep 5 s > any movie that uses don knotts effectively has really got its wits about it . < xxrep 5 s > the performances from every single actor -- including extras -- are kubrickian in their perfection and often hilarious . < xxrep 5 s > tobey maguire , reese witherspoon and joan allen are standouts in this standout cast . < xxrep 5 s > maguire is very good at showing the thought processes going on inside his head behind his eyes . < xxrep 5 s > witherspoon 's vixen is devious without being mean . < xxrep 5 s > and allen , like she did in face / off , brings a heart and soul that is key to the amazing things going on around her and to her . < xxrep 5 s > this movie tops there 's something about mary on the laugh meter and furthermore the way allen 's scene in the bathtub pays off is as outrageous as ... mary 's hair gel scene . < xxrep 5 s > the first hour of this movie is as funny as anything i ' ve ever seen . < xxrep 5 s > i have n't even mentioned the `` look '' of this film yet . < xxrep 5 s > it is fantastic . < xxrep 5 s > the seamless blend of color and black - and - white ceases to become an issue very early on . < xxrep 5 s > you accept this parallel universe for what it is and that is the highest compliment you can pay to the effects crew . < xxrep 5 s > fortunately ross does n't miss any opportunity to use it for laughs and social comment . < xxrep 5 s > some people have criticized the movie for waffling on the themes it speaks to , but i feel that any ambiguity that ross built into the script was simply meant to avoid any preaching and let the audience make up its own mind about what the movie means . < xxrep 5 s > my only real criticism of pleasantville is that it may be a bit too ambitious for its own good , but i 'd much rather have a movie that tries too hard than too little . < xxrep 5 s > next to saving private ryan this is my favorite film this year so far .,xxbos there are a handful of truly excellent movies that i only want to experience once and this is one of them . < xxrep 5 s > michael cimino 's sweeping portrait of men drafted into war to commit atrocities against other men is harrowing . < xxrep 5 s > the survivors suffer more than the dead . < xxrep 5 s > i know a lot of knee - jerk liberals read a lot of jingoistic patriotism into cimino 's script especially when the movie ended with singing of the star spangled banner -lrb- or another `` patriotic '' song -rrb- , but i saw it as a ironic , if not sardonic , touch . < xxrep 5 s > this film could have been set in any war . < xxrep 5 s > i did n't see it as being specifically about vietnam and thus the hotly debated use of russian roulette throughout the movie was an extremely effective metaphor rather than an historical fact or fiction . < xxrep 5 s > -lrb- i could care less whether it actually was used as a torture technique or not -- all i know is that is moved me to the depths of my soul . < xxrep 5 s > -rrb- i was moved to tears by it . < xxrep 5 s > and of course the acting was brilliant . < xxrep 5 s > deniro gives one of best performances ever -lrb- and that is saying a lot -rrb- and he is matched by an excellent supporting cast . < xxrep 5 s > but as powerful as deniro is who can ever forget christopher walken 's shattering performance in his oscar winning role ? < xxrep 5 s > the effect that man 's capacity for inhumanity had on him and everybody else was as tough to to watch as anything in movie history . < xxrep 5 s > his death was real shocker -lrb- in a very bad sense -rrb- and i do n't even like remembering it as i write this . < xxrep 5 s > the xxunk is easily one of the top 20 films i ' ve ever seen and is probably a top 10 pick . < xxrep 5 s > its oscars were richly deserved .,xxbos 2005 has started off with a big big bang for my wife and i. million dollar baby is a sure fire xxunk award nominee in several categories and how can you possibly choose who and what should win . < xxrep 5 s > everything about this movie from the writing , directing , acting and even the music by clint eastwood is brilliant . < xxrep 5 s > hillary swank is once again one of our best actresses . < xxrep 5 s > . < xxrep 5 s > do n't know why she does n't make more movies and do some as a `` real lady '' which she certainly is . < xxrep 5 s > her portrayal as a white trash girl from the sticks who wants to be a boxing champion is very believable and she is perfect in the role . < xxrep 5 s > the chemistry between her and the fabulous clint eastwood who i believe is past 70 years old is wonderful . < xxrep 5 s > clint is simply great in anything that he does , from those old spaghetti westerns , to dirty harry to the comedies , acting , directing , singing , you name it and he can do it as good as anyone else . < xxrep 5 s > he is a fall back to the greats of hollywood . < xxrep 5 s > what can you say about morgan freeman . < xxrep 5 s > i can listen to his voice for hours and be satisfied . < xxrep 5 s > he is mesmerizing with his tones . < xxrep 5 s > as an actor , he too is so versatile and fantastic that he has not gotten the appreciation that he should be getting . < xxrep 5 s > he is one of the finest actors in hollywood who just goes along making movie after movie and each one is of the top caliber . < xxrep 5 s > he is great as the go between with clint eastwood and hillary swank in this movie and he does it with such ease . < xxrep 5 s > i would love to see him finally get the recognition he deserves by not only getting nominated but actually winning the academy award which he so richly deserves .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > a very enjoyable movie that teenage girls will love as well as their moms . < xxrep 5 s > dads might go along for the ride but it is definitely a chick flick . < xxrep 5 s > meryl streep is simply fantastic in her mean mean role as the `` super bitch '' of the fashion magazine business . < xxrep 5 s > stanley tucci is his usual wonderful self as the `` gay '' assistant . < xxrep 5 s > anne hathaway continues to grow as an actress .\n",
       "y: EmptyLabelList\n",
       ",,,,\n",
       "Path: data, model=SequentialRNN(\n",
       "  (0): MultiBatchEncoder(\n",
       "    (module): AWD_LSTM(\n",
       "      (encoder): Embedding(43863, 400, padding_idx=1)\n",
       "      (encoder_dp): EmbeddingDropout(\n",
       "        (emb): Embedding(43863, 400, padding_idx=1)\n",
       "      )\n",
       "      (rnns): ModuleList(\n",
       "        (0): WeightDropout(\n",
       "          (module): LSTM(400, 1150, batch_first=True)\n",
       "        )\n",
       "        (1): WeightDropout(\n",
       "          (module): LSTM(1150, 1150, batch_first=True)\n",
       "        )\n",
       "        (2): WeightDropout(\n",
       "          (module): LSTM(1150, 400, batch_first=True)\n",
       "        )\n",
       "      )\n",
       "      (input_dp): RNNDropout()\n",
       "      (hidden_dps): ModuleList(\n",
       "        (0): RNNDropout()\n",
       "        (1): RNNDropout()\n",
       "        (2): RNNDropout()\n",
       "      )\n",
       "    )\n",
       "  )\n",
       "  (1): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       "), opt_func=functools.partial(<class 'torch.optim.adam.Adam'>, betas=(0.9, 0.99)), loss_func=FlattenedLoss of CrossEntropyLoss(), metrics=[<function accuracy at 0x7f536c2e99d8>], true_wd=True, bn_wd=True, wd=0.01, train_bn=True, path=PosixPath('data'), model_dir='models', callback_fns=[functools.partial(<class 'fastai.basic_train.Recorder'>, add_time=True)], callbacks=[RNNTrainer\n",
       "learn: RNNLearner(data=TextClasDataBunch;\n",
       "\n",
       "Train: LabelList (16839 items)\n",
       "x: TextList\n",
       "xxbos sometimes popular opinion really sucks about a film elevating a rotten movie to cult status and if you do n't like it then you obviously do n't get it . < xxrep 5 s > this movie is one of them . < xxrep 5 s > the much discussed camera moves did not make me sick , but the whiny idiotic characters did . < xxrep 5 s > the suspense was minimal . < xxrep 5 s > i do n't care if it was really low budget . < xxrep 5 s > i ' m not going to grade a film on degree of difficulty . < xxrep 5 s > i ' m sure that `` titanic '' was a very tough experience for the production crew . < xxrep 5 s > i do n't care ! < xxrep 5 s > it was a great movie because it had a great story and great characters and was really well put together . < xxrep 5 s > this movie did n't have any of those things . < xxrep 5 s > it telegraphed the last shot in the first 15 minutes . < xxrep 5 s > this is one of those rare films that made me angry that i wasted my time with it .,xxbos this is an amazing piece of work and it probably tops `` the insider '' , `` the sixth sense '' , `` edtv '' and `` bringing out the dead '' as my favorite film of the year . < xxrep 5 s > alan ball 's screenplay is one the modern wonders of the world and sam mendes 's direction matches it -lrb- i can see why he bested michael mann as the l.a . film critics director of the year -rrb- . < xxrep 5 s > where did these guys come from ? < xxrep 5 s > this story of an american family and the tiny slice of the world they live in is xxunk before us with the precision and fascination of a geneticist unravelling a strand of dna through an xxunk microscope . < xxrep 5 s > this is not to suggest that the film is cold -lrb- far from it -rrb- . < xxrep 5 s > it just felt like i was watching the characters lives from beneath their skins . < xxrep 5 s > rarely have i felt like i knew an entire cast so well . < xxrep 5 s > this will be a hard movie to reward at oscar time because every single performance hit exactly the right key -lrb- `` l.a . confidential '' had the same problem -rrb- , but obviously kevin spacey and annette benning should lead actor noms . < xxrep 5 s > spacey has played laconic many times before -lrb- i ca n't think of a film where he has n't been this way before -rrb- , but not with the dry wit and comic timing he displays here . < xxrep 5 s > even when he blows up it is dry . < xxrep 5 s > benning has her best role since `` the grifters '' and makes the most it . < xxrep 5 s > she is a stepford wife with real ambition . < xxrep 5 s > they are a married couple who long ago gave up on the american dream but are too comfortable to give up the amercian facade and this is ball 's key contempt . < xxrep 5 s > it is a very unique view . < xxrep 5 s > while the adults know that they are screwed up the kids still fight to have hope . < xxrep 5 s > it is their rebellion . < xxrep 5 s > thora xxunk is outstanding as the lone child of spacey and benning who is getting killed by her parents ' cynicism . < xxrep 5 s > the most frightening performance is given by wes bentley as the next door neighbor kid who is constantly peeping and taping other people 's lives , but also finding beauty amid the ugliness and chaos in some of the film 's most moving scenes -lrb- a lot people will not get the significance and meaning of the paper bag , but those who do understand the film completely -- i thought is was awesome -rrb- . < xxrep 5 s > i think he is acting as the xxunk . < xxrep 5 s > finally mena suvari is a revelation as the smart - ass and all - knowing teenage friend who reveals a heartbreaking vulnerability . < xxrep 5 s > this film is very dark but like `` bringing out the dead '' there is a redemptive quality leaves you with hope at the end . < xxrep 5 s > i was floored by this . < xxrep 5 s > it is also a very funny film . < xxrep 5 s > american beauty may be the best film of a very good year .,xxbos this movie does not belong in a cinema . < xxrep 5 s > it belongs in a museum of modern art running in a continuous loop . < xxrep 5 s > -lrb- at least `` melancholia '' has a plot . < xxrep 5 s > -rrb- terrence malick 's ruminations on the difficulty of balancing nature & grace is beautiful bore . < xxrep 5 s > there are images in this film that are as breathtaking as any i ' ve ever seen in cinema . < xxrep 5 s > the 19 minute sequence that depicts `` creation '' is easily worthy of favorable comparison to `` 2001 '' 's `` voyage beyond infinity '' sequence . < xxrep 5 s > i was practically floating out of my chair while watching -- experiencing -- it . < xxrep 5 s > it also features a couple of brief dinosaur scenes which surpass any in `` jurassic park '' in terms of sheer realization & beauty . < xxrep 5 s > this portion of the film was definitely worth the effort put into creating it . < xxrep 5 s > but there are 2 other hours of this film which occasionally stir emotions & do n't really connect to anything except malick 's own cosmic navel gazing . < xxrep 5 s > i love `` 2001 '' , `` walkabout ' , `` '' & `` brazil '' . < xxrep 5 s > `` the tree of life '' shares these films uniqueness & sense of wonder but did n't connect with me on a deeper level like them . < xxrep 5 s > call me a low brow , but i 'll take `` caption america : the first avenger '' over this film any day .,xxbos the first nominees for next year 's oscars in the best picture , best actress , best supporting actor , best director , best original or adapted screenplay and best costume design categories have already been secured with the arrival of `` erin brockovich '' . < xxrep 5 s > julia roberts is spectacular in the title role of a hard working single mother who stumbles on one of the biggest corporate wrongs in u.s . history . < xxrep 5 s > she would ' ve stole every scene if it was n't for her co - star albert finney who matches her for every . < xxrep 5 s > he plays her reluctant and somewhat befuddled employer who finally joins her fight . < xxrep 5 s > although her box office says otherwise i ' ve always thought roberts was way overrated as a movie star . < xxrep 5 s > now i ' m a believer . < xxrep 5 s > she is smart , sassy , foul - mouthed , fiery , sensitive , funny and , of course , very sexy . < xxrep 5 s > it is one of best performances i ' ve ever seen by an actress in a lead role and for some reason it reminds me of susan sarandon 's annie savoy from `` bull durham '' in that both outstanding roles combined real intelligence with real sex appeal . < xxrep 5 s > -lrb- of course annie savoy is purely fictional whereas erin brockovich is not . < xxrep 5 s > -rrb- i sense that her character may appeal more to men than women -lrb- her costume designer obviously had a lot fun working on this film -rrb- . < xxrep 5 s > the reviews i ' ve read have been excellent , but this movie exceeds them largely because the rest of the actors are great as well . < xxrep 5 s > finney 's work is more nuanced than roberts ' because it has to be and he provides the perfect foil for her volcanic emotions . < xxrep 5 s > aaron eckhardt deserves mention too as roberts ' good guy biker boyfriend . < xxrep 5 s > these performances are made possible by a superb script from susannah grant . < xxrep 5 s > her fact - based tale of a small -lrb- hick -rrb- town poisoned by a giant utility has `` rocky '' - like xxunk in it and they feel all earned . < xxrep 5 s > the fascinating tale is matched by dialogue that is often fast and furious and very funny and it is in a story that really tugs at your heart strings . < xxrep 5 s > director steven soderbergh equals the effort that he put forth with the vastly underrated `` out of sight '' . < xxrep 5 s > this is an `` adult '' movie in the very best sense of that term . < xxrep 5 s > `` erin brockovich '' is definitely a big hollywood movie with all he fun and rewards that come with it . < xxrep 5 s > it also proves that smart entertainment can deal with big issues and make time fly . < xxrep 5 s > it is the first best picture nominee for next year .,xxbos my expectations for writer / director m. night shyamalan 's next movie after `` the sixth sense '' were extremely high and `` unbreakable '' did not let me down . < xxrep 5 s > in fact , in some respects , it is a better and more self assured movie than the former . < xxrep 5 s > like `` 6th '' , `` un '' is a movie that the less you know about it going in the better it is and i 'll be damned if i ' m gon na give anything away here . < xxrep 5 s > however i will say that bruce willis and samuel l. jackson -lrb- has this guy ever given a bad performance ? < xxrep 5 s > -rrb- are outstanding as the leads . < xxrep 5 s > there is not a wasted role in the movie . < xxrep 5 s > shyamalan has concocted another fantastic tale set against urban reality . < xxrep 5 s > the spirit of rod serling lives in him . < xxrep 5 s > his direction and writing are a xxunk blend of moods and spiritualism that resonates deep within your emotions . < xxrep 5 s > he is aided greatly by james newton howard 's brilliant score and eduardo xxunk 's daring cinematography . < xxrep 5 s > this movie takes more chances than `` 6th '' . < xxrep 5 s > you either buy it or you do n't . < xxrep 5 s > it has a dream logic that never sacrifices narrative thrust . < xxrep 5 s > `` un '' does n't benefit from `` 6th '' 's shock value , but i think is a more accomplished piece overall . < xxrep 5 s > it and `` erin brokovich are clearly this year 's 2 best movies .\n",
       "y: CategoryList\n",
       "1,10,5,10,10\n",
       "Path: data;\n",
       "\n",
       "Valid: LabelList (2094 items)\n",
       "x: TextList\n",
       "xxbos i ' m a huge fan of michael mann -lrb- i even liked the keep a lot -rrb- . < xxrep 5 s > nobody , even martin scorsese , does lawmen and the lawless better . < xxrep 5 s > thief , heat and collateral are all classics -lrb- heat is as good as the 1st 2 godfathers -rrb- . < xxrep 5 s > cut to the chase . < xxrep 5 s > miami vice is a disappointment . < xxrep 5 s > i ' m glad it xxunk from the -lrb- excellent -rrb- tv show . < xxrep 5 s > as a feature film it is flat and not involving . < xxrep 5 s > colin farrell can not hold the screen as a leading man . < xxrep 5 s > jamie foxx is handcuffed in a thankless role . < xxrep 5 s > the villains are dull . < xxrep 5 s > the action set pieces are few and seem like limp ripoffs of his other films . < xxrep 5 s > there is no synergy here . < xxrep 5 s > michael mann is all synergy . < xxrep 5 s > the music is uninspired . < xxrep 5 s > the editing is as confusing as the plot . < xxrep 5 s > dion beebe 's groundbreaking high def work in collateral does n't work very well for this film . < xxrep 5 s > there is not a single memorable moment in this film and coming from mann that is a shock . < xxrep 5 s > i ' m rating this film against mann 's other films because i ca n't do so otherwise -lrb- like spielberg , cameron , howard , nolan , greengrass , eastwood and any other a - lister -rrb- . < xxrep 5 s > so why do i give it a 6 / 10 ?,xxbos this film is unavoidably being compared to director alan j. pakula 's `` all the president 's men '' and for good reason , because michael mann 's new film is every bit as good . < xxrep 5 s > -lrb- anybody is the tv news biz - like me - knows that newspaper and tv news are very different animals . < xxrep 5 s > -rrb- `` the insider '' is a very mature film . < xxrep 5 s > it takes its sweet time letting the events unfold . < xxrep 5 s > however mann and his team use very cinematic trick in the book to hold our attention and the editing is impeccable . < xxrep 5 s > but first and foremost the film features 2 virtuoso performances : one by a master we ' ve grown accustomed to and one by a guy who may have joined his league . < xxrep 5 s > of course i ' m talking about al pacino and russell crowe . < xxrep 5 s > pacino adds another mammoth blast in his hall of fame collection of home run performances . < xxrep 5 s > his portrayal of 60 minutes producer gives him a lot of room to use all his skills as an actor and he never ever looks like an actor acting . < xxrep 5 s > he vents anger and frustration better than any actor i ' ve ever seen and he is given the chance to do so here . < xxrep 5 s > now on to the `` new '' guy . < xxrep 5 s > anybody who has seen russell crowe before -lrb- especially in his oscar - worthy effort in `` l.a . confidential '' -rrb- is not surprised that he can more than hold his own against pacino , but then again acting is not a sporting event and there is room for a lot of winners in a movie like this . < xxrep 5 s > crowe 's role as `` the guy '' who blows the whistle on the tobacco industry is a fascinating study of a man imploding . < xxrep 5 s > not since pacino 's work in `` the godfather ii '' have i ' ve seen it done so well . < xxrep 5 s > like every other thing mann has done the supporting actors are great too , but the standout here is christopher plummer 's mike wallace who has to reluctantly sell out to the corporate bottom line . < xxrep 5 s > the story about a guy who wants to go public about a major public health crime but is abandoned by a major network is complex and difficult stuff , but mann and co - scripter eric roth do a magnificent job at keeping it clear and interesting . < xxrep 5 s > it is riveting and important entertainment . < xxrep 5 s > like the phrase `` tv journalism '' , `` important entertainment '' may seem like a contradiction of terms , but not with this movie which is one the best films of the year .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > angelina jolie and dan xxunk and the entire cast take us through what happened in the search for danny pearl that we did not see or hear about in the press as they frantically tried to find him before he was so brutally killed . < xxrep 5 s > a very poignant love story with a horrific ending . < xxrep 5 s > kudos to marianne pearl and angelina jolie and brad pitt who produced the movie .,xxbos my wife and i see over 100 movies a year , having been in the business and now retired . < xxrep 5 s > we do not read any reviews by anyone . < xxrep 5 s > we try to tell our friends that a critic is one person , he or she is not us . < xxrep 5 s > critics are also a dying breed as newspapers disappear . < xxrep 5 s > therefore , our critique is not biased and based on actually seeing the movie in a theatre . < xxrep 5 s > many critics see the movies 5 at a time in a viewing a real atmosphere to gauge audience reaction . < xxrep 5 s > how can you review a movie without the real deal ? < xxrep 5 s > a great movie with all three stars giving academy award performances amy adams , mark wahlberg and christian bale . < xxrep 5 s > one of the best fight films we have ever seen . < xxrep 5 s > amy adams does her usual fabulous job in still another type of roll . < xxrep 5 s > wahlberg has become a terrific actor and director and christan bale steals the movie with his great acting . < xxrep 5 s > do n't miss it .,xxbos we see over 75 movies a year and have not rated one a perfect 10 for over 3 years . < xxrep 5 s > this is the perfect movie . < xxrep 5 s > pixar is amazing . < xxrep 5 s > everything about this movie from the storyline to the characters to the unbelievable graphics are spectacular . < xxrep 5 s > hats off to pixar may they strike a new deal with disney and keep them coming . < xxrep 5 s > never expected them to top toy story , then toy story ii and now this is even better . < xxrep 5 s > wow !\n",
       "y: CategoryList\n",
       "6,10,9,10,10\n",
       "Path: data;\n",
       "\n",
       "Test: LabelList (2278 items)\n",
       "x: TextList\n",
       "xxbos edward norton is right & wrong . < xxrep 5 s > this movie could have used more of him in it -lrb- when the dvd comes out i hope they include `` his cut '' if it exist -rrb- , but he is wrong for not promoting this movie . < xxrep 5 s > this re - boot is a blast to watch . < xxrep 5 s > i actually liked much of ang lee 's version but only in fits & starts . < xxrep 5 s > this hulk is a much smoother machine that never drags . < xxrep 5 s > the fx are spectacular & sometimes inspired -- every part of the production is great . < xxrep 5 s > the battle scenes are ferocious . < xxrep 5 s > i never tired of watching mean green do his thing , but i guess that s the point . < xxrep 5 s > the movie makers knew when to cut the action . < xxrep 5 s > however -- like iron man -- the acting is way above average for this sort of escapism , but , come to think of it , all 3 xxunk & x - men + batman begins -lrb- & returns -rrb- also featured really fine & often great acting . < xxrep 5 s > and this hulk could ' ve used more of it . < xxrep 5 s > norton is 1 of the top 5 actors currently working . < xxrep 5 s > there are moments in this movie when his talent really pays off and they are all too brief . < xxrep 5 s > william hurt makes a fine foe . < xxrep 5 s > and , so help me movie gods , liv tyler gives a memorable performance although she is mostly stuck saying the name `` bruce '' . < xxrep 5 s > overall this movie rocks . < xxrep 5 s > and i thought all movies released xxunk july 18th were just until the dark knight arrives . < xxrep 5 s > thank you tony stark , indy & bruce banner for proving me wrong .,xxbos it is no surprise that gary ross -- the writer of big and dave -- once again brings a very smart comedy to the big screen , but what is surprising is the level of directorial xxunk that he brings to a very complex undertaking . < xxrep 5 s > pleasantville is a wonderful laugh - out - loud satire that deals with issues such as racism , fascism , artistic freedom , individuality , sexual mores , 90 's amorality , group control and some other things i probably missed . < xxrep 5 s > but ross wraps his messages in ambiguity and , most importantly , entertainment . < xxrep 5 s > any movie that uses don knotts effectively has really got its wits about it . < xxrep 5 s > the performances from every single actor -- including extras -- are kubrickian in their perfection and often hilarious . < xxrep 5 s > tobey maguire , reese witherspoon and joan allen are standouts in this standout cast . < xxrep 5 s > maguire is very good at showing the thought processes going on inside his head behind his eyes . < xxrep 5 s > witherspoon 's vixen is devious without being mean . < xxrep 5 s > and allen , like she did in face / off , brings a heart and soul that is key to the amazing things going on around her and to her . < xxrep 5 s > this movie tops there 's something about mary on the laugh meter and furthermore the way allen 's scene in the bathtub pays off is as outrageous as ... mary 's hair gel scene . < xxrep 5 s > the first hour of this movie is as funny as anything i ' ve ever seen . < xxrep 5 s > i have n't even mentioned the `` look '' of this film yet . < xxrep 5 s > it is fantastic . < xxrep 5 s > the seamless blend of color and black - and - white ceases to become an issue very early on . < xxrep 5 s > you accept this parallel universe for what it is and that is the highest compliment you can pay to the effects crew . < xxrep 5 s > fortunately ross does n't miss any opportunity to use it for laughs and social comment . < xxrep 5 s > some people have criticized the movie for waffling on the themes it speaks to , but i feel that any ambiguity that ross built into the script was simply meant to avoid any preaching and let the audience make up its own mind about what the movie means . < xxrep 5 s > my only real criticism of pleasantville is that it may be a bit too ambitious for its own good , but i 'd much rather have a movie that tries too hard than too little . < xxrep 5 s > next to saving private ryan this is my favorite film this year so far .,xxbos there are a handful of truly excellent movies that i only want to experience once and this is one of them . < xxrep 5 s > michael cimino 's sweeping portrait of men drafted into war to commit atrocities against other men is harrowing . < xxrep 5 s > the survivors suffer more than the dead . < xxrep 5 s > i know a lot of knee - jerk liberals read a lot of jingoistic patriotism into cimino 's script especially when the movie ended with singing of the star spangled banner -lrb- or another `` patriotic '' song -rrb- , but i saw it as a ironic , if not sardonic , touch . < xxrep 5 s > this film could have been set in any war . < xxrep 5 s > i did n't see it as being specifically about vietnam and thus the hotly debated use of russian roulette throughout the movie was an extremely effective metaphor rather than an historical fact or fiction . < xxrep 5 s > -lrb- i could care less whether it actually was used as a torture technique or not -- all i know is that is moved me to the depths of my soul . < xxrep 5 s > -rrb- i was moved to tears by it . < xxrep 5 s > and of course the acting was brilliant . < xxrep 5 s > deniro gives one of best performances ever -lrb- and that is saying a lot -rrb- and he is matched by an excellent supporting cast . < xxrep 5 s > but as powerful as deniro is who can ever forget christopher walken 's shattering performance in his oscar winning role ? < xxrep 5 s > the effect that man 's capacity for inhumanity had on him and everybody else was as tough to to watch as anything in movie history . < xxrep 5 s > his death was real shocker -lrb- in a very bad sense -rrb- and i do n't even like remembering it as i write this . < xxrep 5 s > the xxunk is easily one of the top 20 films i ' ve ever seen and is probably a top 10 pick . < xxrep 5 s > its oscars were richly deserved .,xxbos 2005 has started off with a big big bang for my wife and i. million dollar baby is a sure fire xxunk award nominee in several categories and how can you possibly choose who and what should win . < xxrep 5 s > everything about this movie from the writing , directing , acting and even the music by clint eastwood is brilliant . < xxrep 5 s > hillary swank is once again one of our best actresses . < xxrep 5 s > . < xxrep 5 s > do n't know why she does n't make more movies and do some as a `` real lady '' which she certainly is . < xxrep 5 s > her portrayal as a white trash girl from the sticks who wants to be a boxing champion is very believable and she is perfect in the role . < xxrep 5 s > the chemistry between her and the fabulous clint eastwood who i believe is past 70 years old is wonderful . < xxrep 5 s > clint is simply great in anything that he does , from those old spaghetti westerns , to dirty harry to the comedies , acting , directing , singing , you name it and he can do it as good as anyone else . < xxrep 5 s > he is a fall back to the greats of hollywood . < xxrep 5 s > what can you say about morgan freeman . < xxrep 5 s > i can listen to his voice for hours and be satisfied . < xxrep 5 s > he is mesmerizing with his tones . < xxrep 5 s > as an actor , he too is so versatile and fantastic that he has not gotten the appreciation that he should be getting . < xxrep 5 s > he is one of the finest actors in hollywood who just goes along making movie after movie and each one is of the top caliber . < xxrep 5 s > he is great as the go between with clint eastwood and hillary swank in this movie and he does it with such ease . < xxrep 5 s > i would love to see him finally get the recognition he deserves by not only getting nominated but actually winning the academy award which he so richly deserves .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > a very enjoyable movie that teenage girls will love as well as their moms . < xxrep 5 s > dads might go along for the ride but it is definitely a chick flick . < xxrep 5 s > meryl streep is simply fantastic in her mean mean role as the `` super bitch '' of the fashion magazine business . < xxrep 5 s > stanley tucci is his usual wonderful self as the `` gay '' assistant . < xxrep 5 s > anne hathaway continues to grow as an actress .\n",
       "y: EmptyLabelList\n",
       ",,,,\n",
       "Path: data, model=SequentialRNN(\n",
       "  (0): MultiBatchEncoder(\n",
       "    (module): AWD_LSTM(\n",
       "      (encoder): Embedding(43863, 400, padding_idx=1)\n",
       "      (encoder_dp): EmbeddingDropout(\n",
       "        (emb): Embedding(43863, 400, padding_idx=1)\n",
       "      )\n",
       "      (rnns): ModuleList(\n",
       "        (0): WeightDropout(\n",
       "          (module): LSTM(400, 1150, batch_first=True)\n",
       "        )\n",
       "        (1): WeightDropout(\n",
       "          (module): LSTM(1150, 1150, batch_first=True)\n",
       "        )\n",
       "        (2): WeightDropout(\n",
       "          (module): LSTM(1150, 400, batch_first=True)\n",
       "        )\n",
       "      )\n",
       "      (input_dp): RNNDropout()\n",
       "      (hidden_dps): ModuleList(\n",
       "        (0): RNNDropout()\n",
       "        (1): RNNDropout()\n",
       "        (2): RNNDropout()\n",
       "      )\n",
       "    )\n",
       "  )\n",
       "  (1): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       "), opt_func=functools.partial(<class 'torch.optim.adam.Adam'>, betas=(0.9, 0.99)), loss_func=FlattenedLoss of CrossEntropyLoss(), metrics=[<function accuracy at 0x7f536c2e99d8>], true_wd=True, bn_wd=True, wd=0.01, train_bn=True, path=PosixPath('data'), model_dir='models', callback_fns=[functools.partial(<class 'fastai.basic_train.Recorder'>, add_time=True)], callbacks=[...], layer_groups=[Sequential(\n",
       "  (0): Embedding(43863, 400, padding_idx=1)\n",
       "  (1): EmbeddingDropout(\n",
       "    (emb): Embedding(43863, 400, padding_idx=1)\n",
       "  )\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(400, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 400, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       ")], add_time=True)\n",
       "alpha: 2.0\n",
       "beta: 1.0], layer_groups=[Sequential(\n",
       "  (0): Embedding(43863, 400, padding_idx=1)\n",
       "  (1): EmbeddingDropout(\n",
       "    (emb): Embedding(43863, 400, padding_idx=1)\n",
       "  )\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(400, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 400, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       ")], add_time=True)"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "learn.load('stage-1-model.pkl')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Fine-tuning"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: left;\">\n",
       "      <th>epoch</th>\n",
       "      <th>train_loss</th>\n",
       "      <th>valid_loss</th>\n",
       "      <th>accuracy</th>\n",
       "      <th>time</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>1.612746</td>\n",
       "      <td>1.554340</td>\n",
       "      <td>0.380611</td>\n",
       "      <td>09:15</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "learn.freeze_to(-2)\n",
    "# Slice up the learning rates to apply different rates to different layers of the network - the deeper the larger.\n",
    "learn.fit_one_cycle(1, slice(5e-3/2., 5e-3))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "learn.save('stage-2-model.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "RNNLearner(data=TextClasDataBunch;\n",
       "\n",
       "Train: LabelList (16839 items)\n",
       "x: TextList\n",
       "xxbos sometimes popular opinion really sucks about a film elevating a rotten movie to cult status and if you do n't like it then you obviously do n't get it . < xxrep 5 s > this movie is one of them . < xxrep 5 s > the much discussed camera moves did not make me sick , but the whiny idiotic characters did . < xxrep 5 s > the suspense was minimal . < xxrep 5 s > i do n't care if it was really low budget . < xxrep 5 s > i ' m not going to grade a film on degree of difficulty . < xxrep 5 s > i ' m sure that `` titanic '' was a very tough experience for the production crew . < xxrep 5 s > i do n't care ! < xxrep 5 s > it was a great movie because it had a great story and great characters and was really well put together . < xxrep 5 s > this movie did n't have any of those things . < xxrep 5 s > it telegraphed the last shot in the first 15 minutes . < xxrep 5 s > this is one of those rare films that made me angry that i wasted my time with it .,xxbos this is an amazing piece of work and it probably tops `` the insider '' , `` the sixth sense '' , `` edtv '' and `` bringing out the dead '' as my favorite film of the year . < xxrep 5 s > alan ball 's screenplay is one the modern wonders of the world and sam mendes 's direction matches it -lrb- i can see why he bested michael mann as the l.a . film critics director of the year -rrb- . < xxrep 5 s > where did these guys come from ? < xxrep 5 s > this story of an american family and the tiny slice of the world they live in is xxunk before us with the precision and fascination of a geneticist unravelling a strand of dna through an xxunk microscope . < xxrep 5 s > this is not to suggest that the film is cold -lrb- far from it -rrb- . < xxrep 5 s > it just felt like i was watching the characters lives from beneath their skins . < xxrep 5 s > rarely have i felt like i knew an entire cast so well . < xxrep 5 s > this will be a hard movie to reward at oscar time because every single performance hit exactly the right key -lrb- `` l.a . confidential '' had the same problem -rrb- , but obviously kevin spacey and annette benning should lead actor noms . < xxrep 5 s > spacey has played laconic many times before -lrb- i ca n't think of a film where he has n't been this way before -rrb- , but not with the dry wit and comic timing he displays here . < xxrep 5 s > even when he blows up it is dry . < xxrep 5 s > benning has her best role since `` the grifters '' and makes the most it . < xxrep 5 s > she is a stepford wife with real ambition . < xxrep 5 s > they are a married couple who long ago gave up on the american dream but are too comfortable to give up the amercian facade and this is ball 's key contempt . < xxrep 5 s > it is a very unique view . < xxrep 5 s > while the adults know that they are screwed up the kids still fight to have hope . < xxrep 5 s > it is their rebellion . < xxrep 5 s > thora xxunk is outstanding as the lone child of spacey and benning who is getting killed by her parents ' cynicism . < xxrep 5 s > the most frightening performance is given by wes bentley as the next door neighbor kid who is constantly peeping and taping other people 's lives , but also finding beauty amid the ugliness and chaos in some of the film 's most moving scenes -lrb- a lot people will not get the significance and meaning of the paper bag , but those who do understand the film completely -- i thought is was awesome -rrb- . < xxrep 5 s > i think he is acting as the xxunk . < xxrep 5 s > finally mena suvari is a revelation as the smart - ass and all - knowing teenage friend who reveals a heartbreaking vulnerability . < xxrep 5 s > this film is very dark but like `` bringing out the dead '' there is a redemptive quality leaves you with hope at the end . < xxrep 5 s > i was floored by this . < xxrep 5 s > it is also a very funny film . < xxrep 5 s > american beauty may be the best film of a very good year .,xxbos this movie does not belong in a cinema . < xxrep 5 s > it belongs in a museum of modern art running in a continuous loop . < xxrep 5 s > -lrb- at least `` melancholia '' has a plot . < xxrep 5 s > -rrb- terrence malick 's ruminations on the difficulty of balancing nature & grace is beautiful bore . < xxrep 5 s > there are images in this film that are as breathtaking as any i ' ve ever seen in cinema . < xxrep 5 s > the 19 minute sequence that depicts `` creation '' is easily worthy of favorable comparison to `` 2001 '' 's `` voyage beyond infinity '' sequence . < xxrep 5 s > i was practically floating out of my chair while watching -- experiencing -- it . < xxrep 5 s > it also features a couple of brief dinosaur scenes which surpass any in `` jurassic park '' in terms of sheer realization & beauty . < xxrep 5 s > this portion of the film was definitely worth the effort put into creating it . < xxrep 5 s > but there are 2 other hours of this film which occasionally stir emotions & do n't really connect to anything except malick 's own cosmic navel gazing . < xxrep 5 s > i love `` 2001 '' , `` walkabout ' , `` '' & `` brazil '' . < xxrep 5 s > `` the tree of life '' shares these films uniqueness & sense of wonder but did n't connect with me on a deeper level like them . < xxrep 5 s > call me a low brow , but i 'll take `` caption america : the first avenger '' over this film any day .,xxbos the first nominees for next year 's oscars in the best picture , best actress , best supporting actor , best director , best original or adapted screenplay and best costume design categories have already been secured with the arrival of `` erin brockovich '' . < xxrep 5 s > julia roberts is spectacular in the title role of a hard working single mother who stumbles on one of the biggest corporate wrongs in u.s . history . < xxrep 5 s > she would ' ve stole every scene if it was n't for her co - star albert finney who matches her for every . < xxrep 5 s > he plays her reluctant and somewhat befuddled employer who finally joins her fight . < xxrep 5 s > although her box office says otherwise i ' ve always thought roberts was way overrated as a movie star . < xxrep 5 s > now i ' m a believer . < xxrep 5 s > she is smart , sassy , foul - mouthed , fiery , sensitive , funny and , of course , very sexy . < xxrep 5 s > it is one of best performances i ' ve ever seen by an actress in a lead role and for some reason it reminds me of susan sarandon 's annie savoy from `` bull durham '' in that both outstanding roles combined real intelligence with real sex appeal . < xxrep 5 s > -lrb- of course annie savoy is purely fictional whereas erin brockovich is not . < xxrep 5 s > -rrb- i sense that her character may appeal more to men than women -lrb- her costume designer obviously had a lot fun working on this film -rrb- . < xxrep 5 s > the reviews i ' ve read have been excellent , but this movie exceeds them largely because the rest of the actors are great as well . < xxrep 5 s > finney 's work is more nuanced than roberts ' because it has to be and he provides the perfect foil for her volcanic emotions . < xxrep 5 s > aaron eckhardt deserves mention too as roberts ' good guy biker boyfriend . < xxrep 5 s > these performances are made possible by a superb script from susannah grant . < xxrep 5 s > her fact - based tale of a small -lrb- hick -rrb- town poisoned by a giant utility has `` rocky '' - like xxunk in it and they feel all earned . < xxrep 5 s > the fascinating tale is matched by dialogue that is often fast and furious and very funny and it is in a story that really tugs at your heart strings . < xxrep 5 s > director steven soderbergh equals the effort that he put forth with the vastly underrated `` out of sight '' . < xxrep 5 s > this is an `` adult '' movie in the very best sense of that term . < xxrep 5 s > `` erin brockovich '' is definitely a big hollywood movie with all he fun and rewards that come with it . < xxrep 5 s > it also proves that smart entertainment can deal with big issues and make time fly . < xxrep 5 s > it is the first best picture nominee for next year .,xxbos my expectations for writer / director m. night shyamalan 's next movie after `` the sixth sense '' were extremely high and `` unbreakable '' did not let me down . < xxrep 5 s > in fact , in some respects , it is a better and more self assured movie than the former . < xxrep 5 s > like `` 6th '' , `` un '' is a movie that the less you know about it going in the better it is and i 'll be damned if i ' m gon na give anything away here . < xxrep 5 s > however i will say that bruce willis and samuel l. jackson -lrb- has this guy ever given a bad performance ? < xxrep 5 s > -rrb- are outstanding as the leads . < xxrep 5 s > there is not a wasted role in the movie . < xxrep 5 s > shyamalan has concocted another fantastic tale set against urban reality . < xxrep 5 s > the spirit of rod serling lives in him . < xxrep 5 s > his direction and writing are a xxunk blend of moods and spiritualism that resonates deep within your emotions . < xxrep 5 s > he is aided greatly by james newton howard 's brilliant score and eduardo xxunk 's daring cinematography . < xxrep 5 s > this movie takes more chances than `` 6th '' . < xxrep 5 s > you either buy it or you do n't . < xxrep 5 s > it has a dream logic that never sacrifices narrative thrust . < xxrep 5 s > `` un '' does n't benefit from `` 6th '' 's shock value , but i think is a more accomplished piece overall . < xxrep 5 s > it and `` erin brokovich are clearly this year 's 2 best movies .\n",
       "y: CategoryList\n",
       "1,10,5,10,10\n",
       "Path: data;\n",
       "\n",
       "Valid: LabelList (2094 items)\n",
       "x: TextList\n",
       "xxbos i ' m a huge fan of michael mann -lrb- i even liked the keep a lot -rrb- . < xxrep 5 s > nobody , even martin scorsese , does lawmen and the lawless better . < xxrep 5 s > thief , heat and collateral are all classics -lrb- heat is as good as the 1st 2 godfathers -rrb- . < xxrep 5 s > cut to the chase . < xxrep 5 s > miami vice is a disappointment . < xxrep 5 s > i ' m glad it xxunk from the -lrb- excellent -rrb- tv show . < xxrep 5 s > as a feature film it is flat and not involving . < xxrep 5 s > colin farrell can not hold the screen as a leading man . < xxrep 5 s > jamie foxx is handcuffed in a thankless role . < xxrep 5 s > the villains are dull . < xxrep 5 s > the action set pieces are few and seem like limp ripoffs of his other films . < xxrep 5 s > there is no synergy here . < xxrep 5 s > michael mann is all synergy . < xxrep 5 s > the music is uninspired . < xxrep 5 s > the editing is as confusing as the plot . < xxrep 5 s > dion beebe 's groundbreaking high def work in collateral does n't work very well for this film . < xxrep 5 s > there is not a single memorable moment in this film and coming from mann that is a shock . < xxrep 5 s > i ' m rating this film against mann 's other films because i ca n't do so otherwise -lrb- like spielberg , cameron , howard , nolan , greengrass , eastwood and any other a - lister -rrb- . < xxrep 5 s > so why do i give it a 6 / 10 ?,xxbos this film is unavoidably being compared to director alan j. pakula 's `` all the president 's men '' and for good reason , because michael mann 's new film is every bit as good . < xxrep 5 s > -lrb- anybody is the tv news biz - like me - knows that newspaper and tv news are very different animals . < xxrep 5 s > -rrb- `` the insider '' is a very mature film . < xxrep 5 s > it takes its sweet time letting the events unfold . < xxrep 5 s > however mann and his team use very cinematic trick in the book to hold our attention and the editing is impeccable . < xxrep 5 s > but first and foremost the film features 2 virtuoso performances : one by a master we ' ve grown accustomed to and one by a guy who may have joined his league . < xxrep 5 s > of course i ' m talking about al pacino and russell crowe . < xxrep 5 s > pacino adds another mammoth blast in his hall of fame collection of home run performances . < xxrep 5 s > his portrayal of 60 minutes producer gives him a lot of room to use all his skills as an actor and he never ever looks like an actor acting . < xxrep 5 s > he vents anger and frustration better than any actor i ' ve ever seen and he is given the chance to do so here . < xxrep 5 s > now on to the `` new '' guy . < xxrep 5 s > anybody who has seen russell crowe before -lrb- especially in his oscar - worthy effort in `` l.a . confidential '' -rrb- is not surprised that he can more than hold his own against pacino , but then again acting is not a sporting event and there is room for a lot of winners in a movie like this . < xxrep 5 s > crowe 's role as `` the guy '' who blows the whistle on the tobacco industry is a fascinating study of a man imploding . < xxrep 5 s > not since pacino 's work in `` the godfather ii '' have i ' ve seen it done so well . < xxrep 5 s > like every other thing mann has done the supporting actors are great too , but the standout here is christopher plummer 's mike wallace who has to reluctantly sell out to the corporate bottom line . < xxrep 5 s > the story about a guy who wants to go public about a major public health crime but is abandoned by a major network is complex and difficult stuff , but mann and co - scripter eric roth do a magnificent job at keeping it clear and interesting . < xxrep 5 s > it is riveting and important entertainment . < xxrep 5 s > like the phrase `` tv journalism '' , `` important entertainment '' may seem like a contradiction of terms , but not with this movie which is one the best films of the year .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > angelina jolie and dan xxunk and the entire cast take us through what happened in the search for danny pearl that we did not see or hear about in the press as they frantically tried to find him before he was so brutally killed . < xxrep 5 s > a very poignant love story with a horrific ending . < xxrep 5 s > kudos to marianne pearl and angelina jolie and brad pitt who produced the movie .,xxbos my wife and i see over 100 movies a year , having been in the business and now retired . < xxrep 5 s > we do not read any reviews by anyone . < xxrep 5 s > we try to tell our friends that a critic is one person , he or she is not us . < xxrep 5 s > critics are also a dying breed as newspapers disappear . < xxrep 5 s > therefore , our critique is not biased and based on actually seeing the movie in a theatre . < xxrep 5 s > many critics see the movies 5 at a time in a viewing a real atmosphere to gauge audience reaction . < xxrep 5 s > how can you review a movie without the real deal ? < xxrep 5 s > a great movie with all three stars giving academy award performances amy adams , mark wahlberg and christian bale . < xxrep 5 s > one of the best fight films we have ever seen . < xxrep 5 s > amy adams does her usual fabulous job in still another type of roll . < xxrep 5 s > wahlberg has become a terrific actor and director and christan bale steals the movie with his great acting . < xxrep 5 s > do n't miss it .,xxbos we see over 75 movies a year and have not rated one a perfect 10 for over 3 years . < xxrep 5 s > this is the perfect movie . < xxrep 5 s > pixar is amazing . < xxrep 5 s > everything about this movie from the storyline to the characters to the unbelievable graphics are spectacular . < xxrep 5 s > hats off to pixar may they strike a new deal with disney and keep them coming . < xxrep 5 s > never expected them to top toy story , then toy story ii and now this is even better . < xxrep 5 s > wow !\n",
       "y: CategoryList\n",
       "6,10,9,10,10\n",
       "Path: data;\n",
       "\n",
       "Test: LabelList (2278 items)\n",
       "x: TextList\n",
       "xxbos edward norton is right & wrong . < xxrep 5 s > this movie could have used more of him in it -lrb- when the dvd comes out i hope they include `` his cut '' if it exist -rrb- , but he is wrong for not promoting this movie . < xxrep 5 s > this re - boot is a blast to watch . < xxrep 5 s > i actually liked much of ang lee 's version but only in fits & starts . < xxrep 5 s > this hulk is a much smoother machine that never drags . < xxrep 5 s > the fx are spectacular & sometimes inspired -- every part of the production is great . < xxrep 5 s > the battle scenes are ferocious . < xxrep 5 s > i never tired of watching mean green do his thing , but i guess that s the point . < xxrep 5 s > the movie makers knew when to cut the action . < xxrep 5 s > however -- like iron man -- the acting is way above average for this sort of escapism , but , come to think of it , all 3 xxunk & x - men + batman begins -lrb- & returns -rrb- also featured really fine & often great acting . < xxrep 5 s > and this hulk could ' ve used more of it . < xxrep 5 s > norton is 1 of the top 5 actors currently working . < xxrep 5 s > there are moments in this movie when his talent really pays off and they are all too brief . < xxrep 5 s > william hurt makes a fine foe . < xxrep 5 s > and , so help me movie gods , liv tyler gives a memorable performance although she is mostly stuck saying the name `` bruce '' . < xxrep 5 s > overall this movie rocks . < xxrep 5 s > and i thought all movies released xxunk july 18th were just until the dark knight arrives . < xxrep 5 s > thank you tony stark , indy & bruce banner for proving me wrong .,xxbos it is no surprise that gary ross -- the writer of big and dave -- once again brings a very smart comedy to the big screen , but what is surprising is the level of directorial xxunk that he brings to a very complex undertaking . < xxrep 5 s > pleasantville is a wonderful laugh - out - loud satire that deals with issues such as racism , fascism , artistic freedom , individuality , sexual mores , 90 's amorality , group control and some other things i probably missed . < xxrep 5 s > but ross wraps his messages in ambiguity and , most importantly , entertainment . < xxrep 5 s > any movie that uses don knotts effectively has really got its wits about it . < xxrep 5 s > the performances from every single actor -- including extras -- are kubrickian in their perfection and often hilarious . < xxrep 5 s > tobey maguire , reese witherspoon and joan allen are standouts in this standout cast . < xxrep 5 s > maguire is very good at showing the thought processes going on inside his head behind his eyes . < xxrep 5 s > witherspoon 's vixen is devious without being mean . < xxrep 5 s > and allen , like she did in face / off , brings a heart and soul that is key to the amazing things going on around her and to her . < xxrep 5 s > this movie tops there 's something about mary on the laugh meter and furthermore the way allen 's scene in the bathtub pays off is as outrageous as ... mary 's hair gel scene . < xxrep 5 s > the first hour of this movie is as funny as anything i ' ve ever seen . < xxrep 5 s > i have n't even mentioned the `` look '' of this film yet . < xxrep 5 s > it is fantastic . < xxrep 5 s > the seamless blend of color and black - and - white ceases to become an issue very early on . < xxrep 5 s > you accept this parallel universe for what it is and that is the highest compliment you can pay to the effects crew . < xxrep 5 s > fortunately ross does n't miss any opportunity to use it for laughs and social comment . < xxrep 5 s > some people have criticized the movie for waffling on the themes it speaks to , but i feel that any ambiguity that ross built into the script was simply meant to avoid any preaching and let the audience make up its own mind about what the movie means . < xxrep 5 s > my only real criticism of pleasantville is that it may be a bit too ambitious for its own good , but i 'd much rather have a movie that tries too hard than too little . < xxrep 5 s > next to saving private ryan this is my favorite film this year so far .,xxbos there are a handful of truly excellent movies that i only want to experience once and this is one of them . < xxrep 5 s > michael cimino 's sweeping portrait of men drafted into war to commit atrocities against other men is harrowing . < xxrep 5 s > the survivors suffer more than the dead . < xxrep 5 s > i know a lot of knee - jerk liberals read a lot of jingoistic patriotism into cimino 's script especially when the movie ended with singing of the star spangled banner -lrb- or another `` patriotic '' song -rrb- , but i saw it as a ironic , if not sardonic , touch . < xxrep 5 s > this film could have been set in any war . < xxrep 5 s > i did n't see it as being specifically about vietnam and thus the hotly debated use of russian roulette throughout the movie was an extremely effective metaphor rather than an historical fact or fiction . < xxrep 5 s > -lrb- i could care less whether it actually was used as a torture technique or not -- all i know is that is moved me to the depths of my soul . < xxrep 5 s > -rrb- i was moved to tears by it . < xxrep 5 s > and of course the acting was brilliant . < xxrep 5 s > deniro gives one of best performances ever -lrb- and that is saying a lot -rrb- and he is matched by an excellent supporting cast . < xxrep 5 s > but as powerful as deniro is who can ever forget christopher walken 's shattering performance in his oscar winning role ? < xxrep 5 s > the effect that man 's capacity for inhumanity had on him and everybody else was as tough to to watch as anything in movie history . < xxrep 5 s > his death was real shocker -lrb- in a very bad sense -rrb- and i do n't even like remembering it as i write this . < xxrep 5 s > the xxunk is easily one of the top 20 films i ' ve ever seen and is probably a top 10 pick . < xxrep 5 s > its oscars were richly deserved .,xxbos 2005 has started off with a big big bang for my wife and i. million dollar baby is a sure fire xxunk award nominee in several categories and how can you possibly choose who and what should win . < xxrep 5 s > everything about this movie from the writing , directing , acting and even the music by clint eastwood is brilliant . < xxrep 5 s > hillary swank is once again one of our best actresses . < xxrep 5 s > . < xxrep 5 s > do n't know why she does n't make more movies and do some as a `` real lady '' which she certainly is . < xxrep 5 s > her portrayal as a white trash girl from the sticks who wants to be a boxing champion is very believable and she is perfect in the role . < xxrep 5 s > the chemistry between her and the fabulous clint eastwood who i believe is past 70 years old is wonderful . < xxrep 5 s > clint is simply great in anything that he does , from those old spaghetti westerns , to dirty harry to the comedies , acting , directing , singing , you name it and he can do it as good as anyone else . < xxrep 5 s > he is a fall back to the greats of hollywood . < xxrep 5 s > what can you say about morgan freeman . < xxrep 5 s > i can listen to his voice for hours and be satisfied . < xxrep 5 s > he is mesmerizing with his tones . < xxrep 5 s > as an actor , he too is so versatile and fantastic that he has not gotten the appreciation that he should be getting . < xxrep 5 s > he is one of the finest actors in hollywood who just goes along making movie after movie and each one is of the top caliber . < xxrep 5 s > he is great as the go between with clint eastwood and hillary swank in this movie and he does it with such ease . < xxrep 5 s > i would love to see him finally get the recognition he deserves by not only getting nominated but actually winning the academy award which he so richly deserves .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > a very enjoyable movie that teenage girls will love as well as their moms . < xxrep 5 s > dads might go along for the ride but it is definitely a chick flick . < xxrep 5 s > meryl streep is simply fantastic in her mean mean role as the `` super bitch '' of the fashion magazine business . < xxrep 5 s > stanley tucci is his usual wonderful self as the `` gay '' assistant . < xxrep 5 s > anne hathaway continues to grow as an actress .\n",
       "y: EmptyLabelList\n",
       ",,,,\n",
       "Path: data, model=SequentialRNN(\n",
       "  (0): MultiBatchEncoder(\n",
       "    (module): AWD_LSTM(\n",
       "      (encoder): Embedding(43863, 400, padding_idx=1)\n",
       "      (encoder_dp): EmbeddingDropout(\n",
       "        (emb): Embedding(43863, 400, padding_idx=1)\n",
       "      )\n",
       "      (rnns): ModuleList(\n",
       "        (0): WeightDropout(\n",
       "          (module): LSTM(400, 1150, batch_first=True)\n",
       "        )\n",
       "        (1): WeightDropout(\n",
       "          (module): LSTM(1150, 1150, batch_first=True)\n",
       "        )\n",
       "        (2): WeightDropout(\n",
       "          (module): LSTM(1150, 400, batch_first=True)\n",
       "        )\n",
       "      )\n",
       "      (input_dp): RNNDropout()\n",
       "      (hidden_dps): ModuleList(\n",
       "        (0): RNNDropout()\n",
       "        (1): RNNDropout()\n",
       "        (2): RNNDropout()\n",
       "      )\n",
       "    )\n",
       "  )\n",
       "  (1): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       "), opt_func=functools.partial(<class 'torch.optim.adam.Adam'>, betas=(0.9, 0.99)), loss_func=FlattenedLoss of CrossEntropyLoss(), metrics=[<function accuracy at 0x7f536c2e99d8>], true_wd=True, bn_wd=True, wd=0.01, train_bn=True, path=PosixPath('data'), model_dir='models', callback_fns=[functools.partial(<class 'fastai.basic_train.Recorder'>, add_time=True)], callbacks=[RNNTrainer\n",
       "learn: RNNLearner(data=TextClasDataBunch;\n",
       "\n",
       "Train: LabelList (16839 items)\n",
       "x: TextList\n",
       "xxbos sometimes popular opinion really sucks about a film elevating a rotten movie to cult status and if you do n't like it then you obviously do n't get it . < xxrep 5 s > this movie is one of them . < xxrep 5 s > the much discussed camera moves did not make me sick , but the whiny idiotic characters did . < xxrep 5 s > the suspense was minimal . < xxrep 5 s > i do n't care if it was really low budget . < xxrep 5 s > i ' m not going to grade a film on degree of difficulty . < xxrep 5 s > i ' m sure that `` titanic '' was a very tough experience for the production crew . < xxrep 5 s > i do n't care ! < xxrep 5 s > it was a great movie because it had a great story and great characters and was really well put together . < xxrep 5 s > this movie did n't have any of those things . < xxrep 5 s > it telegraphed the last shot in the first 15 minutes . < xxrep 5 s > this is one of those rare films that made me angry that i wasted my time with it .,xxbos this is an amazing piece of work and it probably tops `` the insider '' , `` the sixth sense '' , `` edtv '' and `` bringing out the dead '' as my favorite film of the year . < xxrep 5 s > alan ball 's screenplay is one the modern wonders of the world and sam mendes 's direction matches it -lrb- i can see why he bested michael mann as the l.a . film critics director of the year -rrb- . < xxrep 5 s > where did these guys come from ? < xxrep 5 s > this story of an american family and the tiny slice of the world they live in is xxunk before us with the precision and fascination of a geneticist unravelling a strand of dna through an xxunk microscope . < xxrep 5 s > this is not to suggest that the film is cold -lrb- far from it -rrb- . < xxrep 5 s > it just felt like i was watching the characters lives from beneath their skins . < xxrep 5 s > rarely have i felt like i knew an entire cast so well . < xxrep 5 s > this will be a hard movie to reward at oscar time because every single performance hit exactly the right key -lrb- `` l.a . confidential '' had the same problem -rrb- , but obviously kevin spacey and annette benning should lead actor noms . < xxrep 5 s > spacey has played laconic many times before -lrb- i ca n't think of a film where he has n't been this way before -rrb- , but not with the dry wit and comic timing he displays here . < xxrep 5 s > even when he blows up it is dry . < xxrep 5 s > benning has her best role since `` the grifters '' and makes the most it . < xxrep 5 s > she is a stepford wife with real ambition . < xxrep 5 s > they are a married couple who long ago gave up on the american dream but are too comfortable to give up the amercian facade and this is ball 's key contempt . < xxrep 5 s > it is a very unique view . < xxrep 5 s > while the adults know that they are screwed up the kids still fight to have hope . < xxrep 5 s > it is their rebellion . < xxrep 5 s > thora xxunk is outstanding as the lone child of spacey and benning who is getting killed by her parents ' cynicism . < xxrep 5 s > the most frightening performance is given by wes bentley as the next door neighbor kid who is constantly peeping and taping other people 's lives , but also finding beauty amid the ugliness and chaos in some of the film 's most moving scenes -lrb- a lot people will not get the significance and meaning of the paper bag , but those who do understand the film completely -- i thought is was awesome -rrb- . < xxrep 5 s > i think he is acting as the xxunk . < xxrep 5 s > finally mena suvari is a revelation as the smart - ass and all - knowing teenage friend who reveals a heartbreaking vulnerability . < xxrep 5 s > this film is very dark but like `` bringing out the dead '' there is a redemptive quality leaves you with hope at the end . < xxrep 5 s > i was floored by this . < xxrep 5 s > it is also a very funny film . < xxrep 5 s > american beauty may be the best film of a very good year .,xxbos this movie does not belong in a cinema . < xxrep 5 s > it belongs in a museum of modern art running in a continuous loop . < xxrep 5 s > -lrb- at least `` melancholia '' has a plot . < xxrep 5 s > -rrb- terrence malick 's ruminations on the difficulty of balancing nature & grace is beautiful bore . < xxrep 5 s > there are images in this film that are as breathtaking as any i ' ve ever seen in cinema . < xxrep 5 s > the 19 minute sequence that depicts `` creation '' is easily worthy of favorable comparison to `` 2001 '' 's `` voyage beyond infinity '' sequence . < xxrep 5 s > i was practically floating out of my chair while watching -- experiencing -- it . < xxrep 5 s > it also features a couple of brief dinosaur scenes which surpass any in `` jurassic park '' in terms of sheer realization & beauty . < xxrep 5 s > this portion of the film was definitely worth the effort put into creating it . < xxrep 5 s > but there are 2 other hours of this film which occasionally stir emotions & do n't really connect to anything except malick 's own cosmic navel gazing . < xxrep 5 s > i love `` 2001 '' , `` walkabout ' , `` '' & `` brazil '' . < xxrep 5 s > `` the tree of life '' shares these films uniqueness & sense of wonder but did n't connect with me on a deeper level like them . < xxrep 5 s > call me a low brow , but i 'll take `` caption america : the first avenger '' over this film any day .,xxbos the first nominees for next year 's oscars in the best picture , best actress , best supporting actor , best director , best original or adapted screenplay and best costume design categories have already been secured with the arrival of `` erin brockovich '' . < xxrep 5 s > julia roberts is spectacular in the title role of a hard working single mother who stumbles on one of the biggest corporate wrongs in u.s . history . < xxrep 5 s > she would ' ve stole every scene if it was n't for her co - star albert finney who matches her for every . < xxrep 5 s > he plays her reluctant and somewhat befuddled employer who finally joins her fight . < xxrep 5 s > although her box office says otherwise i ' ve always thought roberts was way overrated as a movie star . < xxrep 5 s > now i ' m a believer . < xxrep 5 s > she is smart , sassy , foul - mouthed , fiery , sensitive , funny and , of course , very sexy . < xxrep 5 s > it is one of best performances i ' ve ever seen by an actress in a lead role and for some reason it reminds me of susan sarandon 's annie savoy from `` bull durham '' in that both outstanding roles combined real intelligence with real sex appeal . < xxrep 5 s > -lrb- of course annie savoy is purely fictional whereas erin brockovich is not . < xxrep 5 s > -rrb- i sense that her character may appeal more to men than women -lrb- her costume designer obviously had a lot fun working on this film -rrb- . < xxrep 5 s > the reviews i ' ve read have been excellent , but this movie exceeds them largely because the rest of the actors are great as well . < xxrep 5 s > finney 's work is more nuanced than roberts ' because it has to be and he provides the perfect foil for her volcanic emotions . < xxrep 5 s > aaron eckhardt deserves mention too as roberts ' good guy biker boyfriend . < xxrep 5 s > these performances are made possible by a superb script from susannah grant . < xxrep 5 s > her fact - based tale of a small -lrb- hick -rrb- town poisoned by a giant utility has `` rocky '' - like xxunk in it and they feel all earned . < xxrep 5 s > the fascinating tale is matched by dialogue that is often fast and furious and very funny and it is in a story that really tugs at your heart strings . < xxrep 5 s > director steven soderbergh equals the effort that he put forth with the vastly underrated `` out of sight '' . < xxrep 5 s > this is an `` adult '' movie in the very best sense of that term . < xxrep 5 s > `` erin brockovich '' is definitely a big hollywood movie with all he fun and rewards that come with it . < xxrep 5 s > it also proves that smart entertainment can deal with big issues and make time fly . < xxrep 5 s > it is the first best picture nominee for next year .,xxbos my expectations for writer / director m. night shyamalan 's next movie after `` the sixth sense '' were extremely high and `` unbreakable '' did not let me down . < xxrep 5 s > in fact , in some respects , it is a better and more self assured movie than the former . < xxrep 5 s > like `` 6th '' , `` un '' is a movie that the less you know about it going in the better it is and i 'll be damned if i ' m gon na give anything away here . < xxrep 5 s > however i will say that bruce willis and samuel l. jackson -lrb- has this guy ever given a bad performance ? < xxrep 5 s > -rrb- are outstanding as the leads . < xxrep 5 s > there is not a wasted role in the movie . < xxrep 5 s > shyamalan has concocted another fantastic tale set against urban reality . < xxrep 5 s > the spirit of rod serling lives in him . < xxrep 5 s > his direction and writing are a xxunk blend of moods and spiritualism that resonates deep within your emotions . < xxrep 5 s > he is aided greatly by james newton howard 's brilliant score and eduardo xxunk 's daring cinematography . < xxrep 5 s > this movie takes more chances than `` 6th '' . < xxrep 5 s > you either buy it or you do n't . < xxrep 5 s > it has a dream logic that never sacrifices narrative thrust . < xxrep 5 s > `` un '' does n't benefit from `` 6th '' 's shock value , but i think is a more accomplished piece overall . < xxrep 5 s > it and `` erin brokovich are clearly this year 's 2 best movies .\n",
       "y: CategoryList\n",
       "1,10,5,10,10\n",
       "Path: data;\n",
       "\n",
       "Valid: LabelList (2094 items)\n",
       "x: TextList\n",
       "xxbos i ' m a huge fan of michael mann -lrb- i even liked the keep a lot -rrb- . < xxrep 5 s > nobody , even martin scorsese , does lawmen and the lawless better . < xxrep 5 s > thief , heat and collateral are all classics -lrb- heat is as good as the 1st 2 godfathers -rrb- . < xxrep 5 s > cut to the chase . < xxrep 5 s > miami vice is a disappointment . < xxrep 5 s > i ' m glad it xxunk from the -lrb- excellent -rrb- tv show . < xxrep 5 s > as a feature film it is flat and not involving . < xxrep 5 s > colin farrell can not hold the screen as a leading man . < xxrep 5 s > jamie foxx is handcuffed in a thankless role . < xxrep 5 s > the villains are dull . < xxrep 5 s > the action set pieces are few and seem like limp ripoffs of his other films . < xxrep 5 s > there is no synergy here . < xxrep 5 s > michael mann is all synergy . < xxrep 5 s > the music is uninspired . < xxrep 5 s > the editing is as confusing as the plot . < xxrep 5 s > dion beebe 's groundbreaking high def work in collateral does n't work very well for this film . < xxrep 5 s > there is not a single memorable moment in this film and coming from mann that is a shock . < xxrep 5 s > i ' m rating this film against mann 's other films because i ca n't do so otherwise -lrb- like spielberg , cameron , howard , nolan , greengrass , eastwood and any other a - lister -rrb- . < xxrep 5 s > so why do i give it a 6 / 10 ?,xxbos this film is unavoidably being compared to director alan j. pakula 's `` all the president 's men '' and for good reason , because michael mann 's new film is every bit as good . < xxrep 5 s > -lrb- anybody is the tv news biz - like me - knows that newspaper and tv news are very different animals . < xxrep 5 s > -rrb- `` the insider '' is a very mature film . < xxrep 5 s > it takes its sweet time letting the events unfold . < xxrep 5 s > however mann and his team use very cinematic trick in the book to hold our attention and the editing is impeccable . < xxrep 5 s > but first and foremost the film features 2 virtuoso performances : one by a master we ' ve grown accustomed to and one by a guy who may have joined his league . < xxrep 5 s > of course i ' m talking about al pacino and russell crowe . < xxrep 5 s > pacino adds another mammoth blast in his hall of fame collection of home run performances . < xxrep 5 s > his portrayal of 60 minutes producer gives him a lot of room to use all his skills as an actor and he never ever looks like an actor acting . < xxrep 5 s > he vents anger and frustration better than any actor i ' ve ever seen and he is given the chance to do so here . < xxrep 5 s > now on to the `` new '' guy . < xxrep 5 s > anybody who has seen russell crowe before -lrb- especially in his oscar - worthy effort in `` l.a . confidential '' -rrb- is not surprised that he can more than hold his own against pacino , but then again acting is not a sporting event and there is room for a lot of winners in a movie like this . < xxrep 5 s > crowe 's role as `` the guy '' who blows the whistle on the tobacco industry is a fascinating study of a man imploding . < xxrep 5 s > not since pacino 's work in `` the godfather ii '' have i ' ve seen it done so well . < xxrep 5 s > like every other thing mann has done the supporting actors are great too , but the standout here is christopher plummer 's mike wallace who has to reluctantly sell out to the corporate bottom line . < xxrep 5 s > the story about a guy who wants to go public about a major public health crime but is abandoned by a major network is complex and difficult stuff , but mann and co - scripter eric roth do a magnificent job at keeping it clear and interesting . < xxrep 5 s > it is riveting and important entertainment . < xxrep 5 s > like the phrase `` tv journalism '' , `` important entertainment '' may seem like a contradiction of terms , but not with this movie which is one the best films of the year .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > angelina jolie and dan xxunk and the entire cast take us through what happened in the search for danny pearl that we did not see or hear about in the press as they frantically tried to find him before he was so brutally killed . < xxrep 5 s > a very poignant love story with a horrific ending . < xxrep 5 s > kudos to marianne pearl and angelina jolie and brad pitt who produced the movie .,xxbos my wife and i see over 100 movies a year , having been in the business and now retired . < xxrep 5 s > we do not read any reviews by anyone . < xxrep 5 s > we try to tell our friends that a critic is one person , he or she is not us . < xxrep 5 s > critics are also a dying breed as newspapers disappear . < xxrep 5 s > therefore , our critique is not biased and based on actually seeing the movie in a theatre . < xxrep 5 s > many critics see the movies 5 at a time in a viewing a real atmosphere to gauge audience reaction . < xxrep 5 s > how can you review a movie without the real deal ? < xxrep 5 s > a great movie with all three stars giving academy award performances amy adams , mark wahlberg and christian bale . < xxrep 5 s > one of the best fight films we have ever seen . < xxrep 5 s > amy adams does her usual fabulous job in still another type of roll . < xxrep 5 s > wahlberg has become a terrific actor and director and christan bale steals the movie with his great acting . < xxrep 5 s > do n't miss it .,xxbos we see over 75 movies a year and have not rated one a perfect 10 for over 3 years . < xxrep 5 s > this is the perfect movie . < xxrep 5 s > pixar is amazing . < xxrep 5 s > everything about this movie from the storyline to the characters to the unbelievable graphics are spectacular . < xxrep 5 s > hats off to pixar may they strike a new deal with disney and keep them coming . < xxrep 5 s > never expected them to top toy story , then toy story ii and now this is even better . < xxrep 5 s > wow !\n",
       "y: CategoryList\n",
       "6,10,9,10,10\n",
       "Path: data;\n",
       "\n",
       "Test: LabelList (2278 items)\n",
       "x: TextList\n",
       "xxbos edward norton is right & wrong . < xxrep 5 s > this movie could have used more of him in it -lrb- when the dvd comes out i hope they include `` his cut '' if it exist -rrb- , but he is wrong for not promoting this movie . < xxrep 5 s > this re - boot is a blast to watch . < xxrep 5 s > i actually liked much of ang lee 's version but only in fits & starts . < xxrep 5 s > this hulk is a much smoother machine that never drags . < xxrep 5 s > the fx are spectacular & sometimes inspired -- every part of the production is great . < xxrep 5 s > the battle scenes are ferocious . < xxrep 5 s > i never tired of watching mean green do his thing , but i guess that s the point . < xxrep 5 s > the movie makers knew when to cut the action . < xxrep 5 s > however -- like iron man -- the acting is way above average for this sort of escapism , but , come to think of it , all 3 xxunk & x - men + batman begins -lrb- & returns -rrb- also featured really fine & often great acting . < xxrep 5 s > and this hulk could ' ve used more of it . < xxrep 5 s > norton is 1 of the top 5 actors currently working . < xxrep 5 s > there are moments in this movie when his talent really pays off and they are all too brief . < xxrep 5 s > william hurt makes a fine foe . < xxrep 5 s > and , so help me movie gods , liv tyler gives a memorable performance although she is mostly stuck saying the name `` bruce '' . < xxrep 5 s > overall this movie rocks . < xxrep 5 s > and i thought all movies released xxunk july 18th were just until the dark knight arrives . < xxrep 5 s > thank you tony stark , indy & bruce banner for proving me wrong .,xxbos it is no surprise that gary ross -- the writer of big and dave -- once again brings a very smart comedy to the big screen , but what is surprising is the level of directorial xxunk that he brings to a very complex undertaking . < xxrep 5 s > pleasantville is a wonderful laugh - out - loud satire that deals with issues such as racism , fascism , artistic freedom , individuality , sexual mores , 90 's amorality , group control and some other things i probably missed . < xxrep 5 s > but ross wraps his messages in ambiguity and , most importantly , entertainment . < xxrep 5 s > any movie that uses don knotts effectively has really got its wits about it . < xxrep 5 s > the performances from every single actor -- including extras -- are kubrickian in their perfection and often hilarious . < xxrep 5 s > tobey maguire , reese witherspoon and joan allen are standouts in this standout cast . < xxrep 5 s > maguire is very good at showing the thought processes going on inside his head behind his eyes . < xxrep 5 s > witherspoon 's vixen is devious without being mean . < xxrep 5 s > and allen , like she did in face / off , brings a heart and soul that is key to the amazing things going on around her and to her . < xxrep 5 s > this movie tops there 's something about mary on the laugh meter and furthermore the way allen 's scene in the bathtub pays off is as outrageous as ... mary 's hair gel scene . < xxrep 5 s > the first hour of this movie is as funny as anything i ' ve ever seen . < xxrep 5 s > i have n't even mentioned the `` look '' of this film yet . < xxrep 5 s > it is fantastic . < xxrep 5 s > the seamless blend of color and black - and - white ceases to become an issue very early on . < xxrep 5 s > you accept this parallel universe for what it is and that is the highest compliment you can pay to the effects crew . < xxrep 5 s > fortunately ross does n't miss any opportunity to use it for laughs and social comment . < xxrep 5 s > some people have criticized the movie for waffling on the themes it speaks to , but i feel that any ambiguity that ross built into the script was simply meant to avoid any preaching and let the audience make up its own mind about what the movie means . < xxrep 5 s > my only real criticism of pleasantville is that it may be a bit too ambitious for its own good , but i 'd much rather have a movie that tries too hard than too little . < xxrep 5 s > next to saving private ryan this is my favorite film this year so far .,xxbos there are a handful of truly excellent movies that i only want to experience once and this is one of them . < xxrep 5 s > michael cimino 's sweeping portrait of men drafted into war to commit atrocities against other men is harrowing . < xxrep 5 s > the survivors suffer more than the dead . < xxrep 5 s > i know a lot of knee - jerk liberals read a lot of jingoistic patriotism into cimino 's script especially when the movie ended with singing of the star spangled banner -lrb- or another `` patriotic '' song -rrb- , but i saw it as a ironic , if not sardonic , touch . < xxrep 5 s > this film could have been set in any war . < xxrep 5 s > i did n't see it as being specifically about vietnam and thus the hotly debated use of russian roulette throughout the movie was an extremely effective metaphor rather than an historical fact or fiction . < xxrep 5 s > -lrb- i could care less whether it actually was used as a torture technique or not -- all i know is that is moved me to the depths of my soul . < xxrep 5 s > -rrb- i was moved to tears by it . < xxrep 5 s > and of course the acting was brilliant . < xxrep 5 s > deniro gives one of best performances ever -lrb- and that is saying a lot -rrb- and he is matched by an excellent supporting cast . < xxrep 5 s > but as powerful as deniro is who can ever forget christopher walken 's shattering performance in his oscar winning role ? < xxrep 5 s > the effect that man 's capacity for inhumanity had on him and everybody else was as tough to to watch as anything in movie history . < xxrep 5 s > his death was real shocker -lrb- in a very bad sense -rrb- and i do n't even like remembering it as i write this . < xxrep 5 s > the xxunk is easily one of the top 20 films i ' ve ever seen and is probably a top 10 pick . < xxrep 5 s > its oscars were richly deserved .,xxbos 2005 has started off with a big big bang for my wife and i. million dollar baby is a sure fire xxunk award nominee in several categories and how can you possibly choose who and what should win . < xxrep 5 s > everything about this movie from the writing , directing , acting and even the music by clint eastwood is brilliant . < xxrep 5 s > hillary swank is once again one of our best actresses . < xxrep 5 s > . < xxrep 5 s > do n't know why she does n't make more movies and do some as a `` real lady '' which she certainly is . < xxrep 5 s > her portrayal as a white trash girl from the sticks who wants to be a boxing champion is very believable and she is perfect in the role . < xxrep 5 s > the chemistry between her and the fabulous clint eastwood who i believe is past 70 years old is wonderful . < xxrep 5 s > clint is simply great in anything that he does , from those old spaghetti westerns , to dirty harry to the comedies , acting , directing , singing , you name it and he can do it as good as anyone else . < xxrep 5 s > he is a fall back to the greats of hollywood . < xxrep 5 s > what can you say about morgan freeman . < xxrep 5 s > i can listen to his voice for hours and be satisfied . < xxrep 5 s > he is mesmerizing with his tones . < xxrep 5 s > as an actor , he too is so versatile and fantastic that he has not gotten the appreciation that he should be getting . < xxrep 5 s > he is one of the finest actors in hollywood who just goes along making movie after movie and each one is of the top caliber . < xxrep 5 s > he is great as the go between with clint eastwood and hillary swank in this movie and he does it with such ease . < xxrep 5 s > i would love to see him finally get the recognition he deserves by not only getting nominated but actually winning the academy award which he so richly deserves .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > a very enjoyable movie that teenage girls will love as well as their moms . < xxrep 5 s > dads might go along for the ride but it is definitely a chick flick . < xxrep 5 s > meryl streep is simply fantastic in her mean mean role as the `` super bitch '' of the fashion magazine business . < xxrep 5 s > stanley tucci is his usual wonderful self as the `` gay '' assistant . < xxrep 5 s > anne hathaway continues to grow as an actress .\n",
       "y: EmptyLabelList\n",
       ",,,,\n",
       "Path: data, model=SequentialRNN(\n",
       "  (0): MultiBatchEncoder(\n",
       "    (module): AWD_LSTM(\n",
       "      (encoder): Embedding(43863, 400, padding_idx=1)\n",
       "      (encoder_dp): EmbeddingDropout(\n",
       "        (emb): Embedding(43863, 400, padding_idx=1)\n",
       "      )\n",
       "      (rnns): ModuleList(\n",
       "        (0): WeightDropout(\n",
       "          (module): LSTM(400, 1150, batch_first=True)\n",
       "        )\n",
       "        (1): WeightDropout(\n",
       "          (module): LSTM(1150, 1150, batch_first=True)\n",
       "        )\n",
       "        (2): WeightDropout(\n",
       "          (module): LSTM(1150, 400, batch_first=True)\n",
       "        )\n",
       "      )\n",
       "      (input_dp): RNNDropout()\n",
       "      (hidden_dps): ModuleList(\n",
       "        (0): RNNDropout()\n",
       "        (1): RNNDropout()\n",
       "        (2): RNNDropout()\n",
       "      )\n",
       "    )\n",
       "  )\n",
       "  (1): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       "), opt_func=functools.partial(<class 'torch.optim.adam.Adam'>, betas=(0.9, 0.99)), loss_func=FlattenedLoss of CrossEntropyLoss(), metrics=[<function accuracy at 0x7f536c2e99d8>], true_wd=True, bn_wd=True, wd=0.01, train_bn=True, path=PosixPath('data'), model_dir='models', callback_fns=[functools.partial(<class 'fastai.basic_train.Recorder'>, add_time=True)], callbacks=[...], layer_groups=[Sequential(\n",
       "  (0): Embedding(43863, 400, padding_idx=1)\n",
       "  (1): EmbeddingDropout(\n",
       "    (emb): Embedding(43863, 400, padding_idx=1)\n",
       "  )\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(400, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 400, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       ")], add_time=True)\n",
       "alpha: 2.0\n",
       "beta: 1.0], layer_groups=[Sequential(\n",
       "  (0): Embedding(43863, 400, padding_idx=1)\n",
       "  (1): EmbeddingDropout(\n",
       "    (emb): Embedding(43863, 400, padding_idx=1)\n",
       "  )\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(400, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 400, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       ")], add_time=True)"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "learn.load('stage-2-model.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: left;\">\n",
       "      <th>epoch</th>\n",
       "      <th>train_loss</th>\n",
       "      <th>valid_loss</th>\n",
       "      <th>accuracy</th>\n",
       "      <th>time</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>0</td>\n",
       "      <td>1.518762</td>\n",
       "      <td>1.490982</td>\n",
       "      <td>0.403534</td>\n",
       "      <td>18:04</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "learn.unfreeze()\n",
    "learn.fit_one_cycle(1, slice(2e-3/100, 2e-3))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Save our final model\n",
    "learn.save('final-model.pkl') # 487.053M"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "RNNLearner(data=TextClasDataBunch;\n",
       "\n",
       "Train: LabelList (16839 items)\n",
       "x: TextList\n",
       "xxbos sometimes popular opinion really sucks about a film elevating a rotten movie to cult status and if you do n't like it then you obviously do n't get it . < xxrep 5 s > this movie is one of them . < xxrep 5 s > the much discussed camera moves did not make me sick , but the whiny idiotic characters did . < xxrep 5 s > the suspense was minimal . < xxrep 5 s > i do n't care if it was really low budget . < xxrep 5 s > i ' m not going to grade a film on degree of difficulty . < xxrep 5 s > i ' m sure that `` titanic '' was a very tough experience for the production crew . < xxrep 5 s > i do n't care ! < xxrep 5 s > it was a great movie because it had a great story and great characters and was really well put together . < xxrep 5 s > this movie did n't have any of those things . < xxrep 5 s > it telegraphed the last shot in the first 15 minutes . < xxrep 5 s > this is one of those rare films that made me angry that i wasted my time with it .,xxbos this is an amazing piece of work and it probably tops `` the insider '' , `` the sixth sense '' , `` edtv '' and `` bringing out the dead '' as my favorite film of the year . < xxrep 5 s > alan ball 's screenplay is one the modern wonders of the world and sam mendes 's direction matches it -lrb- i can see why he bested michael mann as the l.a . film critics director of the year -rrb- . < xxrep 5 s > where did these guys come from ? < xxrep 5 s > this story of an american family and the tiny slice of the world they live in is xxunk before us with the precision and fascination of a geneticist unravelling a strand of dna through an xxunk microscope . < xxrep 5 s > this is not to suggest that the film is cold -lrb- far from it -rrb- . < xxrep 5 s > it just felt like i was watching the characters lives from beneath their skins . < xxrep 5 s > rarely have i felt like i knew an entire cast so well . < xxrep 5 s > this will be a hard movie to reward at oscar time because every single performance hit exactly the right key -lrb- `` l.a . confidential '' had the same problem -rrb- , but obviously kevin spacey and annette benning should lead actor noms . < xxrep 5 s > spacey has played laconic many times before -lrb- i ca n't think of a film where he has n't been this way before -rrb- , but not with the dry wit and comic timing he displays here . < xxrep 5 s > even when he blows up it is dry . < xxrep 5 s > benning has her best role since `` the grifters '' and makes the most it . < xxrep 5 s > she is a stepford wife with real ambition . < xxrep 5 s > they are a married couple who long ago gave up on the american dream but are too comfortable to give up the amercian facade and this is ball 's key contempt . < xxrep 5 s > it is a very unique view . < xxrep 5 s > while the adults know that they are screwed up the kids still fight to have hope . < xxrep 5 s > it is their rebellion . < xxrep 5 s > thora xxunk is outstanding as the lone child of spacey and benning who is getting killed by her parents ' cynicism . < xxrep 5 s > the most frightening performance is given by wes bentley as the next door neighbor kid who is constantly peeping and taping other people 's lives , but also finding beauty amid the ugliness and chaos in some of the film 's most moving scenes -lrb- a lot people will not get the significance and meaning of the paper bag , but those who do understand the film completely -- i thought is was awesome -rrb- . < xxrep 5 s > i think he is acting as the xxunk . < xxrep 5 s > finally mena suvari is a revelation as the smart - ass and all - knowing teenage friend who reveals a heartbreaking vulnerability . < xxrep 5 s > this film is very dark but like `` bringing out the dead '' there is a redemptive quality leaves you with hope at the end . < xxrep 5 s > i was floored by this . < xxrep 5 s > it is also a very funny film . < xxrep 5 s > american beauty may be the best film of a very good year .,xxbos this movie does not belong in a cinema . < xxrep 5 s > it belongs in a museum of modern art running in a continuous loop . < xxrep 5 s > -lrb- at least `` melancholia '' has a plot . < xxrep 5 s > -rrb- terrence malick 's ruminations on the difficulty of balancing nature & grace is beautiful bore . < xxrep 5 s > there are images in this film that are as breathtaking as any i ' ve ever seen in cinema . < xxrep 5 s > the 19 minute sequence that depicts `` creation '' is easily worthy of favorable comparison to `` 2001 '' 's `` voyage beyond infinity '' sequence . < xxrep 5 s > i was practically floating out of my chair while watching -- experiencing -- it . < xxrep 5 s > it also features a couple of brief dinosaur scenes which surpass any in `` jurassic park '' in terms of sheer realization & beauty . < xxrep 5 s > this portion of the film was definitely worth the effort put into creating it . < xxrep 5 s > but there are 2 other hours of this film which occasionally stir emotions & do n't really connect to anything except malick 's own cosmic navel gazing . < xxrep 5 s > i love `` 2001 '' , `` walkabout ' , `` '' & `` brazil '' . < xxrep 5 s > `` the tree of life '' shares these films uniqueness & sense of wonder but did n't connect with me on a deeper level like them . < xxrep 5 s > call me a low brow , but i 'll take `` caption america : the first avenger '' over this film any day .,xxbos the first nominees for next year 's oscars in the best picture , best actress , best supporting actor , best director , best original or adapted screenplay and best costume design categories have already been secured with the arrival of `` erin brockovich '' . < xxrep 5 s > julia roberts is spectacular in the title role of a hard working single mother who stumbles on one of the biggest corporate wrongs in u.s . history . < xxrep 5 s > she would ' ve stole every scene if it was n't for her co - star albert finney who matches her for every . < xxrep 5 s > he plays her reluctant and somewhat befuddled employer who finally joins her fight . < xxrep 5 s > although her box office says otherwise i ' ve always thought roberts was way overrated as a movie star . < xxrep 5 s > now i ' m a believer . < xxrep 5 s > she is smart , sassy , foul - mouthed , fiery , sensitive , funny and , of course , very sexy . < xxrep 5 s > it is one of best performances i ' ve ever seen by an actress in a lead role and for some reason it reminds me of susan sarandon 's annie savoy from `` bull durham '' in that both outstanding roles combined real intelligence with real sex appeal . < xxrep 5 s > -lrb- of course annie savoy is purely fictional whereas erin brockovich is not . < xxrep 5 s > -rrb- i sense that her character may appeal more to men than women -lrb- her costume designer obviously had a lot fun working on this film -rrb- . < xxrep 5 s > the reviews i ' ve read have been excellent , but this movie exceeds them largely because the rest of the actors are great as well . < xxrep 5 s > finney 's work is more nuanced than roberts ' because it has to be and he provides the perfect foil for her volcanic emotions . < xxrep 5 s > aaron eckhardt deserves mention too as roberts ' good guy biker boyfriend . < xxrep 5 s > these performances are made possible by a superb script from susannah grant . < xxrep 5 s > her fact - based tale of a small -lrb- hick -rrb- town poisoned by a giant utility has `` rocky '' - like xxunk in it and they feel all earned . < xxrep 5 s > the fascinating tale is matched by dialogue that is often fast and furious and very funny and it is in a story that really tugs at your heart strings . < xxrep 5 s > director steven soderbergh equals the effort that he put forth with the vastly underrated `` out of sight '' . < xxrep 5 s > this is an `` adult '' movie in the very best sense of that term . < xxrep 5 s > `` erin brockovich '' is definitely a big hollywood movie with all he fun and rewards that come with it . < xxrep 5 s > it also proves that smart entertainment can deal with big issues and make time fly . < xxrep 5 s > it is the first best picture nominee for next year .,xxbos my expectations for writer / director m. night shyamalan 's next movie after `` the sixth sense '' were extremely high and `` unbreakable '' did not let me down . < xxrep 5 s > in fact , in some respects , it is a better and more self assured movie than the former . < xxrep 5 s > like `` 6th '' , `` un '' is a movie that the less you know about it going in the better it is and i 'll be damned if i ' m gon na give anything away here . < xxrep 5 s > however i will say that bruce willis and samuel l. jackson -lrb- has this guy ever given a bad performance ? < xxrep 5 s > -rrb- are outstanding as the leads . < xxrep 5 s > there is not a wasted role in the movie . < xxrep 5 s > shyamalan has concocted another fantastic tale set against urban reality . < xxrep 5 s > the spirit of rod serling lives in him . < xxrep 5 s > his direction and writing are a xxunk blend of moods and spiritualism that resonates deep within your emotions . < xxrep 5 s > he is aided greatly by james newton howard 's brilliant score and eduardo xxunk 's daring cinematography . < xxrep 5 s > this movie takes more chances than `` 6th '' . < xxrep 5 s > you either buy it or you do n't . < xxrep 5 s > it has a dream logic that never sacrifices narrative thrust . < xxrep 5 s > `` un '' does n't benefit from `` 6th '' 's shock value , but i think is a more accomplished piece overall . < xxrep 5 s > it and `` erin brokovich are clearly this year 's 2 best movies .\n",
       "y: CategoryList\n",
       "1,10,5,10,10\n",
       "Path: data;\n",
       "\n",
       "Valid: LabelList (2094 items)\n",
       "x: TextList\n",
       "xxbos i ' m a huge fan of michael mann -lrb- i even liked the keep a lot -rrb- . < xxrep 5 s > nobody , even martin scorsese , does lawmen and the lawless better . < xxrep 5 s > thief , heat and collateral are all classics -lrb- heat is as good as the 1st 2 godfathers -rrb- . < xxrep 5 s > cut to the chase . < xxrep 5 s > miami vice is a disappointment . < xxrep 5 s > i ' m glad it xxunk from the -lrb- excellent -rrb- tv show . < xxrep 5 s > as a feature film it is flat and not involving . < xxrep 5 s > colin farrell can not hold the screen as a leading man . < xxrep 5 s > jamie foxx is handcuffed in a thankless role . < xxrep 5 s > the villains are dull . < xxrep 5 s > the action set pieces are few and seem like limp ripoffs of his other films . < xxrep 5 s > there is no synergy here . < xxrep 5 s > michael mann is all synergy . < xxrep 5 s > the music is uninspired . < xxrep 5 s > the editing is as confusing as the plot . < xxrep 5 s > dion beebe 's groundbreaking high def work in collateral does n't work very well for this film . < xxrep 5 s > there is not a single memorable moment in this film and coming from mann that is a shock . < xxrep 5 s > i ' m rating this film against mann 's other films because i ca n't do so otherwise -lrb- like spielberg , cameron , howard , nolan , greengrass , eastwood and any other a - lister -rrb- . < xxrep 5 s > so why do i give it a 6 / 10 ?,xxbos this film is unavoidably being compared to director alan j. pakula 's `` all the president 's men '' and for good reason , because michael mann 's new film is every bit as good . < xxrep 5 s > -lrb- anybody is the tv news biz - like me - knows that newspaper and tv news are very different animals . < xxrep 5 s > -rrb- `` the insider '' is a very mature film . < xxrep 5 s > it takes its sweet time letting the events unfold . < xxrep 5 s > however mann and his team use very cinematic trick in the book to hold our attention and the editing is impeccable . < xxrep 5 s > but first and foremost the film features 2 virtuoso performances : one by a master we ' ve grown accustomed to and one by a guy who may have joined his league . < xxrep 5 s > of course i ' m talking about al pacino and russell crowe . < xxrep 5 s > pacino adds another mammoth blast in his hall of fame collection of home run performances . < xxrep 5 s > his portrayal of 60 minutes producer gives him a lot of room to use all his skills as an actor and he never ever looks like an actor acting . < xxrep 5 s > he vents anger and frustration better than any actor i ' ve ever seen and he is given the chance to do so here . < xxrep 5 s > now on to the `` new '' guy . < xxrep 5 s > anybody who has seen russell crowe before -lrb- especially in his oscar - worthy effort in `` l.a . confidential '' -rrb- is not surprised that he can more than hold his own against pacino , but then again acting is not a sporting event and there is room for a lot of winners in a movie like this . < xxrep 5 s > crowe 's role as `` the guy '' who blows the whistle on the tobacco industry is a fascinating study of a man imploding . < xxrep 5 s > not since pacino 's work in `` the godfather ii '' have i ' ve seen it done so well . < xxrep 5 s > like every other thing mann has done the supporting actors are great too , but the standout here is christopher plummer 's mike wallace who has to reluctantly sell out to the corporate bottom line . < xxrep 5 s > the story about a guy who wants to go public about a major public health crime but is abandoned by a major network is complex and difficult stuff , but mann and co - scripter eric roth do a magnificent job at keeping it clear and interesting . < xxrep 5 s > it is riveting and important entertainment . < xxrep 5 s > like the phrase `` tv journalism '' , `` important entertainment '' may seem like a contradiction of terms , but not with this movie which is one the best films of the year .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > angelina jolie and dan xxunk and the entire cast take us through what happened in the search for danny pearl that we did not see or hear about in the press as they frantically tried to find him before he was so brutally killed . < xxrep 5 s > a very poignant love story with a horrific ending . < xxrep 5 s > kudos to marianne pearl and angelina jolie and brad pitt who produced the movie .,xxbos my wife and i see over 100 movies a year , having been in the business and now retired . < xxrep 5 s > we do not read any reviews by anyone . < xxrep 5 s > we try to tell our friends that a critic is one person , he or she is not us . < xxrep 5 s > critics are also a dying breed as newspapers disappear . < xxrep 5 s > therefore , our critique is not biased and based on actually seeing the movie in a theatre . < xxrep 5 s > many critics see the movies 5 at a time in a viewing a real atmosphere to gauge audience reaction . < xxrep 5 s > how can you review a movie without the real deal ? < xxrep 5 s > a great movie with all three stars giving academy award performances amy adams , mark wahlberg and christian bale . < xxrep 5 s > one of the best fight films we have ever seen . < xxrep 5 s > amy adams does her usual fabulous job in still another type of roll . < xxrep 5 s > wahlberg has become a terrific actor and director and christan bale steals the movie with his great acting . < xxrep 5 s > do n't miss it .,xxbos we see over 75 movies a year and have not rated one a perfect 10 for over 3 years . < xxrep 5 s > this is the perfect movie . < xxrep 5 s > pixar is amazing . < xxrep 5 s > everything about this movie from the storyline to the characters to the unbelievable graphics are spectacular . < xxrep 5 s > hats off to pixar may they strike a new deal with disney and keep them coming . < xxrep 5 s > never expected them to top toy story , then toy story ii and now this is even better . < xxrep 5 s > wow !\n",
       "y: CategoryList\n",
       "6,10,9,10,10\n",
       "Path: data;\n",
       "\n",
       "Test: LabelList (2278 items)\n",
       "x: TextList\n",
       "xxbos edward norton is right & wrong . < xxrep 5 s > this movie could have used more of him in it -lrb- when the dvd comes out i hope they include `` his cut '' if it exist -rrb- , but he is wrong for not promoting this movie . < xxrep 5 s > this re - boot is a blast to watch . < xxrep 5 s > i actually liked much of ang lee 's version but only in fits & starts . < xxrep 5 s > this hulk is a much smoother machine that never drags . < xxrep 5 s > the fx are spectacular & sometimes inspired -- every part of the production is great . < xxrep 5 s > the battle scenes are ferocious . < xxrep 5 s > i never tired of watching mean green do his thing , but i guess that s the point . < xxrep 5 s > the movie makers knew when to cut the action . < xxrep 5 s > however -- like iron man -- the acting is way above average for this sort of escapism , but , come to think of it , all 3 xxunk & x - men + batman begins -lrb- & returns -rrb- also featured really fine & often great acting . < xxrep 5 s > and this hulk could ' ve used more of it . < xxrep 5 s > norton is 1 of the top 5 actors currently working . < xxrep 5 s > there are moments in this movie when his talent really pays off and they are all too brief . < xxrep 5 s > william hurt makes a fine foe . < xxrep 5 s > and , so help me movie gods , liv tyler gives a memorable performance although she is mostly stuck saying the name `` bruce '' . < xxrep 5 s > overall this movie rocks . < xxrep 5 s > and i thought all movies released xxunk july 18th were just until the dark knight arrives . < xxrep 5 s > thank you tony stark , indy & bruce banner for proving me wrong .,xxbos it is no surprise that gary ross -- the writer of big and dave -- once again brings a very smart comedy to the big screen , but what is surprising is the level of directorial xxunk that he brings to a very complex undertaking . < xxrep 5 s > pleasantville is a wonderful laugh - out - loud satire that deals with issues such as racism , fascism , artistic freedom , individuality , sexual mores , 90 's amorality , group control and some other things i probably missed . < xxrep 5 s > but ross wraps his messages in ambiguity and , most importantly , entertainment . < xxrep 5 s > any movie that uses don knotts effectively has really got its wits about it . < xxrep 5 s > the performances from every single actor -- including extras -- are kubrickian in their perfection and often hilarious . < xxrep 5 s > tobey maguire , reese witherspoon and joan allen are standouts in this standout cast . < xxrep 5 s > maguire is very good at showing the thought processes going on inside his head behind his eyes . < xxrep 5 s > witherspoon 's vixen is devious without being mean . < xxrep 5 s > and allen , like she did in face / off , brings a heart and soul that is key to the amazing things going on around her and to her . < xxrep 5 s > this movie tops there 's something about mary on the laugh meter and furthermore the way allen 's scene in the bathtub pays off is as outrageous as ... mary 's hair gel scene . < xxrep 5 s > the first hour of this movie is as funny as anything i ' ve ever seen . < xxrep 5 s > i have n't even mentioned the `` look '' of this film yet . < xxrep 5 s > it is fantastic . < xxrep 5 s > the seamless blend of color and black - and - white ceases to become an issue very early on . < xxrep 5 s > you accept this parallel universe for what it is and that is the highest compliment you can pay to the effects crew . < xxrep 5 s > fortunately ross does n't miss any opportunity to use it for laughs and social comment . < xxrep 5 s > some people have criticized the movie for waffling on the themes it speaks to , but i feel that any ambiguity that ross built into the script was simply meant to avoid any preaching and let the audience make up its own mind about what the movie means . < xxrep 5 s > my only real criticism of pleasantville is that it may be a bit too ambitious for its own good , but i 'd much rather have a movie that tries too hard than too little . < xxrep 5 s > next to saving private ryan this is my favorite film this year so far .,xxbos there are a handful of truly excellent movies that i only want to experience once and this is one of them . < xxrep 5 s > michael cimino 's sweeping portrait of men drafted into war to commit atrocities against other men is harrowing . < xxrep 5 s > the survivors suffer more than the dead . < xxrep 5 s > i know a lot of knee - jerk liberals read a lot of jingoistic patriotism into cimino 's script especially when the movie ended with singing of the star spangled banner -lrb- or another `` patriotic '' song -rrb- , but i saw it as a ironic , if not sardonic , touch . < xxrep 5 s > this film could have been set in any war . < xxrep 5 s > i did n't see it as being specifically about vietnam and thus the hotly debated use of russian roulette throughout the movie was an extremely effective metaphor rather than an historical fact or fiction . < xxrep 5 s > -lrb- i could care less whether it actually was used as a torture technique or not -- all i know is that is moved me to the depths of my soul . < xxrep 5 s > -rrb- i was moved to tears by it . < xxrep 5 s > and of course the acting was brilliant . < xxrep 5 s > deniro gives one of best performances ever -lrb- and that is saying a lot -rrb- and he is matched by an excellent supporting cast . < xxrep 5 s > but as powerful as deniro is who can ever forget christopher walken 's shattering performance in his oscar winning role ? < xxrep 5 s > the effect that man 's capacity for inhumanity had on him and everybody else was as tough to to watch as anything in movie history . < xxrep 5 s > his death was real shocker -lrb- in a very bad sense -rrb- and i do n't even like remembering it as i write this . < xxrep 5 s > the xxunk is easily one of the top 20 films i ' ve ever seen and is probably a top 10 pick . < xxrep 5 s > its oscars were richly deserved .,xxbos 2005 has started off with a big big bang for my wife and i. million dollar baby is a sure fire xxunk award nominee in several categories and how can you possibly choose who and what should win . < xxrep 5 s > everything about this movie from the writing , directing , acting and even the music by clint eastwood is brilliant . < xxrep 5 s > hillary swank is once again one of our best actresses . < xxrep 5 s > . < xxrep 5 s > do n't know why she does n't make more movies and do some as a `` real lady '' which she certainly is . < xxrep 5 s > her portrayal as a white trash girl from the sticks who wants to be a boxing champion is very believable and she is perfect in the role . < xxrep 5 s > the chemistry between her and the fabulous clint eastwood who i believe is past 70 years old is wonderful . < xxrep 5 s > clint is simply great in anything that he does , from those old spaghetti westerns , to dirty harry to the comedies , acting , directing , singing , you name it and he can do it as good as anyone else . < xxrep 5 s > he is a fall back to the greats of hollywood . < xxrep 5 s > what can you say about morgan freeman . < xxrep 5 s > i can listen to his voice for hours and be satisfied . < xxrep 5 s > he is mesmerizing with his tones . < xxrep 5 s > as an actor , he too is so versatile and fantastic that he has not gotten the appreciation that he should be getting . < xxrep 5 s > he is one of the finest actors in hollywood who just goes along making movie after movie and each one is of the top caliber . < xxrep 5 s > he is great as the go between with clint eastwood and hillary swank in this movie and he does it with such ease . < xxrep 5 s > i would love to see him finally get the recognition he deserves by not only getting nominated but actually winning the academy award which he so richly deserves .,xxbos we start all of our reviews with the following information . < xxrep 5 s > my wife and i have seen nearly 100 movies per year for the past 15 years . < xxrep 5 s > recently , we were honored by receiving lifetime movie passes to any movie any time at no cost ! < xxrep 5 s > so we can see whatever we want whenever we want . < xxrep 5 s > the point of this is that critics count for zero . < xxrep 5 s > your local critics or the national critics like ebert are really no different than you or me . < xxrep 5 s > the only difference is that they get to write about the movie and are forced to see hundreds of movies whether they want to or not.therefore , it is our belief that if you get your monies worth for two hours of enjoyment that is good enough for us ! < xxrep 5 s > we never ever listen or read the critics . < xxrep 5 s > we only care about our friends and those who we know like the same things as us . < xxrep 5 s > well enough about that . < xxrep 5 s > a very enjoyable movie that teenage girls will love as well as their moms . < xxrep 5 s > dads might go along for the ride but it is definitely a chick flick . < xxrep 5 s > meryl streep is simply fantastic in her mean mean role as the `` super bitch '' of the fashion magazine business . < xxrep 5 s > stanley tucci is his usual wonderful self as the `` gay '' assistant . < xxrep 5 s > anne hathaway continues to grow as an actress .\n",
       "y: EmptyLabelList\n",
       ",,,,\n",
       "Path: data, model=SequentialRNN(\n",
       "  (0): MultiBatchEncoder(\n",
       "    (module): AWD_LSTM(\n",
       "      (encoder): Embedding(43863, 400, padding_idx=1)\n",
       "      (encoder_dp): EmbeddingDropout(\n",
       "        (emb): Embedding(43863, 400, padding_idx=1)\n",
       "      )\n",
       "      (rnns): ModuleList(\n",
       "        (0): WeightDropout(\n",
       "          (module): LSTM(400, 1150, batch_first=True)\n",
       "        )\n",
       "        (1): WeightDropout(\n",
       "          (module): LSTM(1150, 1150, batch_first=True)\n",
       "        )\n",
       "        (2): WeightDropout(\n",
       "          (module): LSTM(1150, 400, batch_first=True)\n",
       "        )\n",
       "      )\n",
       "      (input_dp): RNNDropout()\n",
       "      (hidden_dps): ModuleList(\n",
       "        (0): RNNDropout()\n",
       "        (1): RNNDropout()\n",
       "        (2): RNNDropout()\n",
       "      )\n",
       "    )\n",
       "  )\n",
       "  (1): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       "), opt_func=functools.partial(<class 'torch.optim.adam.Adam'>, betas=(0.9, 0.99)), loss_func=FlattenedLoss of CrossEntropyLoss(), metrics=[<function accuracy at 0x000001BA011ADA60>], true_wd=True, bn_wd=True, wd=0.01, train_bn=True, path=WindowsPath('data'), model_dir='models', callback_fns=[functools.partial(<class 'fastai.basic_train.Recorder'>, add_time=True)], callbacks=[RNNTrainer\n",
       "learn: ...\n",
       "alpha: 2.0\n",
       "beta: 1.0], layer_groups=[Sequential(\n",
       "  (0): Embedding(43863, 400, padding_idx=1)\n",
       "  (1): EmbeddingDropout(\n",
       "    (emb): Embedding(43863, 400, padding_idx=1)\n",
       "  )\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(400, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 1150, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): WeightDropout(\n",
       "    (module): LSTM(1150, 400, batch_first=True)\n",
       "  )\n",
       "  (1): RNNDropout()\n",
       "), Sequential(\n",
       "  (0): PoolingLinearClassifier(\n",
       "    (layers): Sequential(\n",
       "      (0): BatchNorm1d(1200, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (1): Dropout(p=0.2)\n",
       "      (2): Linear(in_features=1200, out_features=50, bias=True)\n",
       "      (3): ReLU(inplace)\n",
       "      (4): BatchNorm1d(50, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)\n",
       "      (5): Dropout(p=0.1)\n",
       "      (6): Linear(in_features=50, out_features=10, bias=True)\n",
       "    )\n",
       "  )\n",
       ")], add_time=True)"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "learn.load('final-model.pkl')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "D:\\Dev\\Tools\\Anaconda\\Anaconda3\\lib\\site-packages\\fastai\\torch_core.py:83: UserWarning: Tensor is int32: upgrading to int64; for better performance use int64 input\n",
      "  warn('Tensor is int32: upgrading to int64; for better performance use int64 input')\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "(Category 5,\n",
       " tensor(4),\n",
       " tensor([0.1114, 0.0561, 0.1459, 0.0720, 0.2170, 0.1737, 0.1432, 0.0546, 0.0199,\n",
       "         0.0063]))"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "learn.predict(\"This was a okay movie!\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Predict Helper Function"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "def predict(text):\n",
    "    return learn.predict(text)[1].item() + 1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "D:\\Dev\\Tools\\Anaconda\\Anaconda3\\lib\\site-packages\\fastai\\torch_core.py:83: UserWarning: Tensor is int32: upgrading to int64; for better performance use int64 input\n",
      "  warn('Tensor is int32: upgrading to int64; for better performance use int64 input')\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "10"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "predict(\"This is a find so good movie amazing best top of the list!\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Calculate RMSE on Validation Set"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0 finished\n",
      "10 finished\n",
      "20 finished\n",
      "30 finished\n",
      "40 finished\n",
      "50 finished\n",
      "60 finished\n",
      "70 finished\n",
      "80 finished\n",
      "90 finished\n",
      "100 finished\n",
      "110 finished\n",
      "120 finished\n",
      "130 finished\n",
      "140 finished\n",
      "150 finished\n",
      "160 finished\n",
      "170 finished\n",
      "180 finished\n",
      "190 finished\n",
      "200 finished\n",
      "210 finished\n",
      "220 finished\n",
      "230 finished\n",
      "240 finished\n",
      "250 finished\n",
      "260 finished\n",
      "270 finished\n",
      "280 finished\n",
      "290 finished\n",
      "300 finished\n",
      "310 finished\n",
      "320 finished\n",
      "330 finished\n",
      "340 finished\n",
      "350 finished\n",
      "360 finished\n",
      "370 finished\n",
      "380 finished\n",
      "390 finished\n",
      "400 finished\n",
      "410 finished\n",
      "420 finished\n",
      "430 finished\n",
      "440 finished\n",
      "450 finished\n",
      "460 finished\n",
      "470 finished\n",
      "480 finished\n",
      "490 finished\n",
      "500 finished\n",
      "510 finished\n",
      "520 finished\n",
      "530 finished\n",
      "540 finished\n",
      "550 finished\n",
      "560 finished\n",
      "570 finished\n",
      "580 finished\n",
      "590 finished\n",
      "600 finished\n",
      "610 finished\n",
      "620 finished\n",
      "630 finished\n",
      "640 finished\n",
      "650 finished\n",
      "660 finished\n",
      "670 finished\n",
      "680 finished\n",
      "690 finished\n",
      "700 finished\n",
      "710 finished\n",
      "720 finished\n",
      "730 finished\n",
      "740 finished\n",
      "750 finished\n",
      "760 finished\n",
      "770 finished\n",
      "780 finished\n",
      "790 finished\n",
      "800 finished\n",
      "810 finished\n",
      "820 finished\n",
      "830 finished\n",
      "840 finished\n",
      "850 finished\n",
      "860 finished\n",
      "870 finished\n",
      "880 finished\n",
      "890 finished\n",
      "900 finished\n",
      "910 finished\n",
      "920 finished\n",
      "930 finished\n",
      "940 finished\n",
      "950 finished\n",
      "960 finished\n",
      "970 finished\n",
      "980 finished\n",
      "990 finished\n",
      "1000 finished\n",
      "1010 finished\n",
      "1020 finished\n",
      "1030 finished\n",
      "1040 finished\n",
      "1050 finished\n",
      "1060 finished\n",
      "1070 finished\n",
      "1080 finished\n",
      "1090 finished\n",
      "1100 finished\n",
      "1110 finished\n",
      "1120 finished\n",
      "1130 finished\n",
      "1140 finished\n",
      "1150 finished\n",
      "1160 finished\n",
      "1170 finished\n",
      "1180 finished\n",
      "1190 finished\n",
      "1200 finished\n",
      "1210 finished\n",
      "1220 finished\n",
      "1230 finished\n",
      "1240 finished\n",
      "1250 finished\n",
      "1260 finished\n",
      "1270 finished\n",
      "1280 finished\n",
      "1290 finished\n",
      "1300 finished\n",
      "1310 finished\n",
      "1320 finished\n",
      "1330 finished\n",
      "1340 finished\n",
      "1350 finished\n",
      "1360 finished\n",
      "1370 finished\n",
      "1380 finished\n",
      "1390 finished\n",
      "1400 finished\n",
      "1410 finished\n",
      "1420 finished\n",
      "1430 finished\n",
      "1440 finished\n",
      "1450 finished\n",
      "1460 finished\n",
      "1470 finished\n",
      "1480 finished\n",
      "1490 finished\n",
      "1500 finished\n",
      "1510 finished\n",
      "1520 finished\n",
      "1530 finished\n",
      "1540 finished\n",
      "1550 finished\n",
      "1560 finished\n",
      "1570 finished\n",
      "1580 finished\n",
      "1590 finished\n",
      "1600 finished\n",
      "1610 finished\n",
      "1620 finished\n",
      "1630 finished\n",
      "1640 finished\n",
      "1650 finished\n",
      "1660 finished\n",
      "1670 finished\n",
      "1680 finished\n",
      "1690 finished\n",
      "1700 finished\n",
      "1710 finished\n",
      "1720 finished\n",
      "1730 finished\n",
      "1740 finished\n",
      "1750 finished\n",
      "1760 finished\n",
      "1770 finished\n",
      "1780 finished\n",
      "1790 finished\n",
      "1800 finished\n",
      "1810 finished\n",
      "1820 finished\n",
      "1830 finished\n",
      "1840 finished\n",
      "1850 finished\n",
      "1860 finished\n",
      "1870 finished\n",
      "1880 finished\n",
      "1890 finished\n",
      "1900 finished\n",
      "1910 finished\n",
      "1920 finished\n",
      "1930 finished\n",
      "1940 finished\n",
      "1950 finished\n",
      "1960 finished\n",
      "1970 finished\n",
      "1980 finished\n",
      "1990 finished\n",
      "2000 finished\n",
      "2010 finished\n",
      "2020 finished\n",
      "2030 finished\n",
      "2040 finished\n",
      "2050 finished\n",
      "2060 finished\n",
      "2070 finished\n",
      "2080 finished\n",
      "2090 finished\n"
     ]
    }
   ],
   "source": [
    "import math\n",
    "import warnings\n",
    "warnings.filterwarnings(\"ignore\")\n",
    "\n",
    "mse_loss = 0\n",
    "vali_len = len(validation_df.index)\n",
    "for i in range(vali_len):\n",
    "    line = validation_df.iloc[i]\n",
    "    text = line['review_content']\n",
    "    rating = line['rating']\n",
    "    pred = predict(text)\n",
    "    mse_loss += (rating - pred) ** 2\n",
    "    \n",
    "    if i % 10 == 0:\n",
    "        print(\"{} finished\".format(i))\n",
    "\n",
    "rmse_loss = math.sqrt(mse_loss / vali_len)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**RMSE:**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1.5641335777652257"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "rmse_loss"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Make Predictions on Test Set "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "ratings = []\n",
    "for line in test_df['review_content']:\n",
    "    ratings.append(predict(line))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {},
   "outputs": [],
   "source": [
    "output_data = {'review_content': test_df['review_content'], 'rating': ratings}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Save result\n",
    "output_df = pd.DataFrame(output_data)\n",
    "output_df.to_csv('senti_output.ss', sep='\\t')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Conclusion\n",
    "\n",
    "**Sizes:**\n",
    "\n",
    "Language Model Size:      191.32M\n",
    "\n",
    "Classifier Model Size:    487.05M\n",
    "\n",
    "Total Size:               678.37M\n",
    "\n",
    "**Loss:**\n",
    "\n",
    "RMSE:          1.5641335777652257\n",
    "\n",
    "**Test Set Output:**\n",
    "\n",
    "File:             senti_output.ss\n",
    "\n",
    "**Comment:**\n",
    "\n",
    "Apparently, this looks way better than \"Plan A\". I trained the language model using AWD_LSTM, and I trained the classifier using also AWD_LSTM, which makes those two models big yet powerful. With the size of almost 20 times as \"Plan A\", I managed to get the loss down to 68% of \"Plan A\".\n",
    " \n",
    "Judging by the look of testset predictions, I think the outcome is pretty impressive. Most predicted ratings won't be found absurd at all, instead, most of them are reasonable and hard to tell whether they are labels or predictions. "
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}