Project3-reddit-pulls.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"http://imgur.com/1ZcRyrc.png\" style=\"float: left; margin: 20px; height: 55px\" />\n",
    "\n",
    "### Project 3: Web APIs & NLP\n",
    "\n",
    "\n",
    "\n",
    "For project 3, your goal is two-fold: 1. Using Pushshift's API, you'll collect posts from two subreddits of your choosing. 2. You'll then use NLP to train a classifier on which subreddit a given post came from. This is a binary classification problem.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Executive Summary\n",
    "\n",
    "From hilarious dog and cat memes, to heated political debates, Reddit’s SubReddit discussion forums have taken off as another regularly used form of social media and news outlet. Posts are organized by subject and rated on content by the community members. \n",
    "\n",
    "Point being, you can find almost anything on a topic of your choice in one of these forums. While we complain about the kids these days sitting behind a computer, texting on their phones, and being on “The Google” all day, it sure is helpful for us in terms of collecting information! \n",
    "\n",
    "You want to know what NBA fans are talking about the most to direct your advertising team in the right direction for your high end clothing brand and we can figure out just that by sifting through these SubReddit posts created on each thread in these forums. Using Natural Language Processing on these posts to analyze not only the singular words in each post, but phrases as well. This can provide us with the content we’ll need to determine which teams will get to be the new face of Shwag, LLC. \n",
    "\n",
    "As a designer label, you’ll need high profile prospects to endorse your product. By utilizing the Popular nba players, you’ll increase your brand exposure and potential revenue. Let us help get you there!\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Import Libraries\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import libaries\n",
    "import requests\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "import json\n",
    "from bs4 import BeautifulSoup\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# change max rows to 3000\n",
    "pd.options.display.max_rows = 3000"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# change max columns to 999\n",
    "pd.options.display.max_columns = 999"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Importing Data for NBA & NBA Discussion subreddits\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "#make the url\n",
    "url = 'https://api.pushshift.io/reddit/search/submission?subreddit=nba'\n",
    "# url = 'https://api.pushshift.io/reddit/search/submission?subreddit=nbadiscussion' #used this one for second round of scraping"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "#set up parameters\n",
    "params = {\n",
    "    'subreddit': 'nbadiscussion',\n",
    "    'size' : 500,\n",
    "    'before': 1558890641 #last items utc\n",
    "}"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "res = requests.get(url, params)\n",
    "res.status_code\n",
    "data = res.json()\n",
    "posts = data['data']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "# posts[499]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = pd.DataFrame(posts) #columns= ['subreddit', 'title', 'selftext', 'created_utc'])\n",
    "# df[['subreddit', 'title', 'selftext']\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "df.to_csv('nba_disc9.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": true,
    "jupyter": {
     "outputs_hidden": true
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>all_awardings</th>\n",
       "      <th>author</th>\n",
       "      <th>author_flair_css_class</th>\n",
       "      <th>author_flair_richtext</th>\n",
       "      <th>author_flair_text</th>\n",
       "      <th>author_flair_type</th>\n",
       "      <th>author_fullname</th>\n",
       "      <th>author_patreon_flair</th>\n",
       "      <th>can_mod_post</th>\n",
       "      <th>contest_mode</th>\n",
       "      <th>created_utc</th>\n",
       "      <th>domain</th>\n",
       "      <th>full_link</th>\n",
       "      <th>gildings</th>\n",
       "      <th>id</th>\n",
       "      <th>is_crosspostable</th>\n",
       "      <th>is_meta</th>\n",
       "      <th>is_original_content</th>\n",
       "      <th>is_reddit_media_domain</th>\n",
       "      <th>is_robot_indexable</th>\n",
       "      <th>is_self</th>\n",
       "      <th>is_video</th>\n",
       "      <th>link_flair_background_color</th>\n",
       "      <th>link_flair_richtext</th>\n",
       "      <th>link_flair_text_color</th>\n",
       "      <th>link_flair_type</th>\n",
       "      <th>locked</th>\n",
       "      <th>media_only</th>\n",
       "      <th>no_follow</th>\n",
       "      <th>num_comments</th>\n",
       "      <th>num_crossposts</th>\n",
       "      <th>over_18</th>\n",
       "      <th>permalink</th>\n",
       "      <th>pinned</th>\n",
       "      <th>retrieved_on</th>\n",
       "      <th>score</th>\n",
       "      <th>selftext</th>\n",
       "      <th>send_replies</th>\n",
       "      <th>spoiler</th>\n",
       "      <th>stickied</th>\n",
       "      <th>subreddit</th>\n",
       "      <th>subreddit_id</th>\n",
       "      <th>subreddit_subscribers</th>\n",
       "      <th>subreddit_type</th>\n",
       "      <th>thumbnail</th>\n",
       "      <th>title</th>\n",
       "      <th>total_awards_received</th>\n",
       "      <th>updated_utc</th>\n",
       "      <th>url</th>\n",
       "      <th>post_hint</th>\n",
       "      <th>preview</th>\n",
       "      <th>crosspost_parent</th>\n",
       "      <th>crosspost_parent_list</th>\n",
       "      <th>gilded</th>\n",
       "      <th>link_flair_template_id</th>\n",
       "      <th>link_flair_text</th>\n",
       "      <th>author_flair_background_color</th>\n",
       "      <th>author_flair_text_color</th>\n",
       "      <th>thumbnail_height</th>\n",
       "      <th>thumbnail_width</th>\n",
       "      <th>edited</th>\n",
       "      <th>author_cakeday</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>499</th>\n",
       "      <td>[]</td>\n",
       "      <td>Shotclockcheese21</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_z2h9f5g</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1556387618</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bi1nr8</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bi1nr8/i_just_love_h...</td>\n",
       "      <td>False</td>\n",
       "      <td>1556387620</td>\n",
       "      <td>0</td>\n",
       "      <td>Just found the sub now and it is finally a pla...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>29548</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>I just love how this sub is a thing</td>\n",
       "      <td>0</td>\n",
       "      <td>1556474008</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>498</th>\n",
       "      <td>[]</td>\n",
       "      <td>Awesomeskrzr</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_2og71rrs</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1556393661</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bi2ox6</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>47</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bi2ox6/does_dangelo_...</td>\n",
       "      <td>False</td>\n",
       "      <td>1556393662</td>\n",
       "      <td>19</td>\n",
       "      <td>He just turned 23, is coming off an all star a...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>29563</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>Does D’angelo Russell deserve a max contract?</td>\n",
       "      <td>0</td>\n",
       "      <td>1556480041</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>497</th>\n",
       "      <td>[]</td>\n",
       "      <td>IAMONEGLOVE</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_ni3t1</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1556402562</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bi46b6</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bi46b6/how_do_you_fe...</td>\n",
       "      <td>False</td>\n",
       "      <td>1556402564</td>\n",
       "      <td>3</td>\n",
       "      <td>When watching post game press conferences, I f...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>29587</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>How do you feel about postgame interview quest...</td>\n",
       "      <td>0</td>\n",
       "      <td>1556488938</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>496</th>\n",
       "      <td>[]</td>\n",
       "      <td>ILikeAllThings</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_jexow</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1556417527</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bi6h0g</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>36</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bi6h0g/post_game_dis...</td>\n",
       "      <td>False</td>\n",
       "      <td>1556417528</td>\n",
       "      <td>29</td>\n",
       "      <td>[Box Score](https://www.nba.com/games/20190427...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>29696</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>Post game discussion: The Toronto Raptors defe...</td>\n",
       "      <td>0</td>\n",
       "      <td>1556503909</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>495</th>\n",
       "      <td>[]</td>\n",
       "      <td>darenglez37</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_3ocsr4fs</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1556418489</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bi6m0i</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bi6m0i/game_7/</td>\n",
       "      <td>False</td>\n",
       "      <td>1556418490</td>\n",
       "      <td>2</td>\n",
       "      <td>Nuggets? Spurs?</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>29703</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>Game 7</td>\n",
       "      <td>0</td>\n",
       "      <td>1556504862</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    all_awardings             author author_flair_css_class  \\\n",
       "499            []  Shotclockcheese21                   None   \n",
       "498            []       Awesomeskrzr                   None   \n",
       "497            []        IAMONEGLOVE                   None   \n",
       "496            []     ILikeAllThings                   None   \n",
       "495            []        darenglez37                   None   \n",
       "\n",
       "    author_flair_richtext author_flair_text author_flair_type author_fullname  \\\n",
       "499                    []              None              text      t2_z2h9f5g   \n",
       "498                    []              None              text     t2_2og71rrs   \n",
       "497                    []              None              text        t2_ni3t1   \n",
       "496                    []              None              text        t2_jexow   \n",
       "495                    []              None              text     t2_3ocsr4fs   \n",
       "\n",
       "    author_patreon_flair  can_mod_post  contest_mode  created_utc  \\\n",
       "499                False         False         False   1556387618   \n",
       "498                False         False         False   1556393661   \n",
       "497                False         False         False   1556402562   \n",
       "496                False         False         False   1556417527   \n",
       "495                False         False         False   1556418489   \n",
       "\n",
       "                 domain                                          full_link  \\\n",
       "499  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "498  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "497  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "496  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "495  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "\n",
       "    gildings      id  is_crosspostable  is_meta  is_original_content  \\\n",
       "499       {}  bi1nr8              True    False                False   \n",
       "498       {}  bi2ox6              True    False                False   \n",
       "497       {}  bi46b6              True    False                False   \n",
       "496       {}  bi6h0g              True    False                False   \n",
       "495       {}  bi6m0i              True    False                False   \n",
       "\n",
       "     is_reddit_media_domain  is_robot_indexable  is_self  is_video  \\\n",
       "499                   False                True     True     False   \n",
       "498                   False                True     True     False   \n",
       "497                   False                True     True     False   \n",
       "496                   False                True     True     False   \n",
       "495                   False                True     True     False   \n",
       "\n",
       "    link_flair_background_color link_flair_richtext link_flair_text_color  \\\n",
       "499                                              []                  dark   \n",
       "498                                              []                  dark   \n",
       "497                                              []                  dark   \n",
       "496                                              []                  dark   \n",
       "495                                              []                  dark   \n",
       "\n",
       "    link_flair_type  locked  media_only  no_follow  num_comments  \\\n",
       "499            text   False       False       True             5   \n",
       "498            text   False       False       True            47   \n",
       "497            text   False       False       True             5   \n",
       "496            text   False       False       True            36   \n",
       "495            text   False       False       True             4   \n",
       "\n",
       "     num_crossposts  over_18  \\\n",
       "499               0    False   \n",
       "498               0    False   \n",
       "497               0    False   \n",
       "496               0    False   \n",
       "495               0    False   \n",
       "\n",
       "                                             permalink  pinned  retrieved_on  \\\n",
       "499  /r/nbadiscussion/comments/bi1nr8/i_just_love_h...   False    1556387620   \n",
       "498  /r/nbadiscussion/comments/bi2ox6/does_dangelo_...   False    1556393662   \n",
       "497  /r/nbadiscussion/comments/bi46b6/how_do_you_fe...   False    1556402564   \n",
       "496  /r/nbadiscussion/comments/bi6h0g/post_game_dis...   False    1556417528   \n",
       "495           /r/nbadiscussion/comments/bi6m0i/game_7/   False    1556418490   \n",
       "\n",
       "     score                                           selftext  send_replies  \\\n",
       "499      0  Just found the sub now and it is finally a pla...          True   \n",
       "498     19  He just turned 23, is coming off an all star a...          True   \n",
       "497      3  When watching post game press conferences, I f...          True   \n",
       "496     29  [Box Score](https://www.nba.com/games/20190427...          True   \n",
       "495      2                                    Nuggets? Spurs?          True   \n",
       "\n",
       "     spoiler  stickied      subreddit subreddit_id  subreddit_subscribers  \\\n",
       "499    False     False  nbadiscussion     t5_3cw3x                  29548   \n",
       "498    False     False  nbadiscussion     t5_3cw3x                  29563   \n",
       "497    False     False  nbadiscussion     t5_3cw3x                  29587   \n",
       "496    False     False  nbadiscussion     t5_3cw3x                  29696   \n",
       "495    False     False  nbadiscussion     t5_3cw3x                  29703   \n",
       "\n",
       "    subreddit_type thumbnail  \\\n",
       "499         public      self   \n",
       "498         public      self   \n",
       "497         public      self   \n",
       "496         public      self   \n",
       "495         public      self   \n",
       "\n",
       "                                                 title  total_awards_received  \\\n",
       "499                I just love how this sub is a thing                      0   \n",
       "498      Does D’angelo Russell deserve a max contract?                      0   \n",
       "497  How do you feel about postgame interview quest...                      0   \n",
       "496  Post game discussion: The Toronto Raptors defe...                      0   \n",
       "495                                             Game 7                      0   \n",
       "\n",
       "     updated_utc                                                url post_hint  \\\n",
       "499   1556474008  https://www.reddit.com/r/nbadiscussion/comment...       NaN   \n",
       "498   1556480041  https://www.reddit.com/r/nbadiscussion/comment...       NaN   \n",
       "497   1556488938  https://www.reddit.com/r/nbadiscussion/comment...       NaN   \n",
       "496   1556503909  https://www.reddit.com/r/nbadiscussion/comment...       NaN   \n",
       "495   1556504862  https://www.reddit.com/r/nbadiscussion/comment...       NaN   \n",
       "\n",
       "    preview crosspost_parent crosspost_parent_list  gilded  \\\n",
       "499     NaN              NaN                   NaN     NaN   \n",
       "498     NaN              NaN                   NaN     NaN   \n",
       "497     NaN              NaN                   NaN     NaN   \n",
       "496     NaN              NaN                   NaN     NaN   \n",
       "495     NaN              NaN                   NaN     NaN   \n",
       "\n",
       "    link_flair_template_id link_flair_text author_flair_background_color  \\\n",
       "499                    NaN             NaN                           NaN   \n",
       "498                    NaN             NaN                           NaN   \n",
       "497                    NaN             NaN                           NaN   \n",
       "496                    NaN             NaN                           NaN   \n",
       "495                    NaN             NaN                           NaN   \n",
       "\n",
       "    author_flair_text_color  thumbnail_height  thumbnail_width  edited  \\\n",
       "499                     NaN               NaN              NaN     NaN   \n",
       "498                     NaN               NaN              NaN     NaN   \n",
       "497                     NaN               NaN              NaN     NaN   \n",
       "496                     NaN               NaN              NaN     NaN   \n",
       "495                     NaN               NaN              NaN     NaN   \n",
       "\n",
       "    author_cakeday  \n",
       "499            NaN  \n",
       "498            NaN  \n",
       "497            NaN  \n",
       "496            NaN  \n",
       "495            NaN  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#sorted values by showing the last created utc number\n",
    "df.sort_values(by='created_utc', ascending=True).head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": true,
    "jupyter": {
     "outputs_hidden": true
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "all_awardings                      0\n",
       "author                             0\n",
       "author_flair_css_class           500\n",
       "author_flair_richtext              1\n",
       "author_flair_text                500\n",
       "author_flair_type                  1\n",
       "author_fullname                    1\n",
       "author_patreon_flair               1\n",
       "can_mod_post                       0\n",
       "contest_mode                       0\n",
       "created_utc                        0\n",
       "domain                             0\n",
       "full_link                          0\n",
       "gildings                           0\n",
       "id                                 0\n",
       "is_crosspostable                   0\n",
       "is_meta                            0\n",
       "is_original_content                0\n",
       "is_reddit_media_domain             0\n",
       "is_robot_indexable                 0\n",
       "is_self                            0\n",
       "is_video                           0\n",
       "link_flair_background_color        0\n",
       "link_flair_richtext                0\n",
       "link_flair_text_color              0\n",
       "link_flair_type                    0\n",
       "locked                             0\n",
       "media_only                         0\n",
       "no_follow                          0\n",
       "num_comments                       0\n",
       "num_crossposts                     0\n",
       "over_18                            0\n",
       "permalink                          0\n",
       "pinned                             0\n",
       "retrieved_on                       0\n",
       "score                              0\n",
       "selftext                           0\n",
       "send_replies                       0\n",
       "spoiler                            0\n",
       "stickied                           0\n",
       "subreddit                          0\n",
       "subreddit_id                       0\n",
       "subreddit_subscribers              0\n",
       "subreddit_type                     0\n",
       "thumbnail                          0\n",
       "title                              0\n",
       "total_awards_received              0\n",
       "updated_utc                        0\n",
       "url                                0\n",
       "post_hint                        460\n",
       "preview                          460\n",
       "crosspost_parent                 487\n",
       "crosspost_parent_list            487\n",
       "gilded                           498\n",
       "link_flair_template_id           498\n",
       "link_flair_text                  498\n",
       "author_flair_background_color    499\n",
       "author_flair_text_color          499\n",
       "thumbnail_height                 497\n",
       "thumbnail_width                  497\n",
       "edited                           499\n",
       "author_cakeday                   497\n",
       "dtype: int64"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.isnull().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": true,
    "jupyter": {
     "outputs_hidden": true
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>all_awardings</th>\n",
       "      <th>author</th>\n",
       "      <th>author_flair_css_class</th>\n",
       "      <th>author_flair_richtext</th>\n",
       "      <th>author_flair_text</th>\n",
       "      <th>author_flair_type</th>\n",
       "      <th>author_fullname</th>\n",
       "      <th>author_patreon_flair</th>\n",
       "      <th>can_mod_post</th>\n",
       "      <th>contest_mode</th>\n",
       "      <th>created_utc</th>\n",
       "      <th>domain</th>\n",
       "      <th>full_link</th>\n",
       "      <th>gildings</th>\n",
       "      <th>id</th>\n",
       "      <th>is_crosspostable</th>\n",
       "      <th>is_meta</th>\n",
       "      <th>is_original_content</th>\n",
       "      <th>is_reddit_media_domain</th>\n",
       "      <th>is_robot_indexable</th>\n",
       "      <th>is_self</th>\n",
       "      <th>is_video</th>\n",
       "      <th>link_flair_background_color</th>\n",
       "      <th>link_flair_richtext</th>\n",
       "      <th>link_flair_text_color</th>\n",
       "      <th>link_flair_type</th>\n",
       "      <th>locked</th>\n",
       "      <th>media_only</th>\n",
       "      <th>no_follow</th>\n",
       "      <th>num_comments</th>\n",
       "      <th>num_crossposts</th>\n",
       "      <th>over_18</th>\n",
       "      <th>permalink</th>\n",
       "      <th>pinned</th>\n",
       "      <th>retrieved_on</th>\n",
       "      <th>score</th>\n",
       "      <th>selftext</th>\n",
       "      <th>send_replies</th>\n",
       "      <th>spoiler</th>\n",
       "      <th>stickied</th>\n",
       "      <th>subreddit</th>\n",
       "      <th>subreddit_id</th>\n",
       "      <th>subreddit_subscribers</th>\n",
       "      <th>subreddit_type</th>\n",
       "      <th>thumbnail</th>\n",
       "      <th>title</th>\n",
       "      <th>total_awards_received</th>\n",
       "      <th>updated_utc</th>\n",
       "      <th>url</th>\n",
       "      <th>post_hint</th>\n",
       "      <th>preview</th>\n",
       "      <th>crosspost_parent</th>\n",
       "      <th>crosspost_parent_list</th>\n",
       "      <th>gilded</th>\n",
       "      <th>link_flair_template_id</th>\n",
       "      <th>link_flair_text</th>\n",
       "      <th>author_flair_background_color</th>\n",
       "      <th>author_flair_text_color</th>\n",
       "      <th>thumbnail_height</th>\n",
       "      <th>thumbnail_width</th>\n",
       "      <th>edited</th>\n",
       "      <th>author_cakeday</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>[]</td>\n",
       "      <td>PMinisterOfMalaysia</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_hjrks</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1558886700</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bt9m72</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>6</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bt9m72/if_kawhi_stay...</td>\n",
       "      <td>False</td>\n",
       "      <td>1558886701</td>\n",
       "      <td>1</td>\n",
       "      <td></td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>38360</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>If Kawhi stays this off-season, do you try to ...</td>\n",
       "      <td>0</td>\n",
       "      <td>1559628248</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>[]</td>\n",
       "      <td>Pyromania1983</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_21a49h9t</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1558885938</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bt9gol</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bt9gol/in_the_regula...</td>\n",
       "      <td>False</td>\n",
       "      <td>1558885939</td>\n",
       "      <td>0</td>\n",
       "      <td>One case for why Philly should make it a prior...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>38360</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>In the regular season, the 76ers went 8-2 with...</td>\n",
       "      <td>0</td>\n",
       "      <td>1559628173</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>[]</td>\n",
       "      <td>rd3287</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_e6nlzih</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1558883254</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bt8ycb</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>24</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bt8ycb/potential_rap...</td>\n",
       "      <td>False</td>\n",
       "      <td>1558883256</td>\n",
       "      <td>20</td>\n",
       "      <td>In facing the Warriors, the Raptors will need ...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>38357</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>Potential Raptors Defensive Look</td>\n",
       "      <td>0</td>\n",
       "      <td>1559627918</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>[]</td>\n",
       "      <td>album1700ok</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_1zkwb7fz</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1558873566</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bt7caj</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>22</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bt7caj/raptors_rende...</td>\n",
       "      <td>False</td>\n",
       "      <td>1558873566</td>\n",
       "      <td>372</td>\n",
       "      <td>Haven’t seen this discussed with all the focus...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>38352</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>Raptors rendered Mirotic unplayable.</td>\n",
       "      <td>0</td>\n",
       "      <td>1559627122</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>[]</td>\n",
       "      <td>GSWBoii408</td>\n",
       "      <td>None</td>\n",
       "      <td>[]</td>\n",
       "      <td>None</td>\n",
       "      <td>text</td>\n",
       "      <td>t2_6ig2z</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>1558844616</td>\n",
       "      <td>self.nbadiscussion</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>{}</td>\n",
       "      <td>bt3u4l</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td></td>\n",
       "      <td>[]</td>\n",
       "      <td>dark</td>\n",
       "      <td>text</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>True</td>\n",
       "      <td>21</td>\n",
       "      <td>0</td>\n",
       "      <td>False</td>\n",
       "      <td>/r/nbadiscussion/comments/bt3u4l/now_that_the_...</td>\n",
       "      <td>False</td>\n",
       "      <td>1558844618</td>\n",
       "      <td>24</td>\n",
       "      <td>I really closely watched only the last two gam...</td>\n",
       "      <td>True</td>\n",
       "      <td>False</td>\n",
       "      <td>False</td>\n",
       "      <td>nbadiscussion</td>\n",
       "      <td>t5_3cw3x</td>\n",
       "      <td>38322</td>\n",
       "      <td>public</td>\n",
       "      <td>self</td>\n",
       "      <td>Now that the series is over, what do you guys ...</td>\n",
       "      <td>0</td>\n",
       "      <td>1559625382</td>\n",
       "      <td>https://www.reddit.com/r/nbadiscussion/comment...</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  all_awardings               author author_flair_css_class  \\\n",
       "0            []  PMinisterOfMalaysia                   None   \n",
       "1            []        Pyromania1983                   None   \n",
       "2            []               rd3287                   None   \n",
       "3            []          album1700ok                   None   \n",
       "4            []           GSWBoii408                   None   \n",
       "\n",
       "  author_flair_richtext author_flair_text author_flair_type author_fullname  \\\n",
       "0                    []              None              text        t2_hjrks   \n",
       "1                    []              None              text     t2_21a49h9t   \n",
       "2                    []              None              text      t2_e6nlzih   \n",
       "3                    []              None              text     t2_1zkwb7fz   \n",
       "4                    []              None              text        t2_6ig2z   \n",
       "\n",
       "  author_patreon_flair  can_mod_post  contest_mode  created_utc  \\\n",
       "0                False         False         False   1558886700   \n",
       "1                False         False         False   1558885938   \n",
       "2                False         False         False   1558883254   \n",
       "3                False         False         False   1558873566   \n",
       "4                False         False         False   1558844616   \n",
       "\n",
       "               domain                                          full_link  \\\n",
       "0  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "1  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "2  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "3  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "4  self.nbadiscussion  https://www.reddit.com/r/nbadiscussion/comment...   \n",
       "\n",
       "  gildings      id  is_crosspostable  is_meta  is_original_content  \\\n",
       "0       {}  bt9m72              True    False                False   \n",
       "1       {}  bt9gol              True    False                False   \n",
       "2       {}  bt8ycb              True    False                False   \n",
       "3       {}  bt7caj              True    False                False   \n",
       "4       {}  bt3u4l              True    False                False   \n",
       "\n",
       "   is_reddit_media_domain  is_robot_indexable  is_self  is_video  \\\n",
       "0                   False                True     True     False   \n",
       "1                   False                True     True     False   \n",
       "2                   False                True     True     False   \n",
       "3                   False                True     True     False   \n",
       "4                   False                True     True     False   \n",
       "\n",
       "  link_flair_background_color link_flair_richtext link_flair_text_color  \\\n",
       "0                                              []                  dark   \n",
       "1                                              []                  dark   \n",
       "2                                              []                  dark   \n",
       "3                                              []                  dark   \n",
       "4                                              []                  dark   \n",
       "\n",
       "  link_flair_type  locked  media_only  no_follow  num_comments  \\\n",
       "0            text   False       False       True             6   \n",
       "1            text   False       False       True             5   \n",
       "2            text   False       False       True            24   \n",
       "3            text   False       False       True            22   \n",
       "4            text   False       False       True            21   \n",
       "\n",
       "   num_crossposts  over_18                                          permalink  \\\n",
       "0               0    False  /r/nbadiscussion/comments/bt9m72/if_kawhi_stay...   \n",
       "1               0    False  /r/nbadiscussion/comments/bt9gol/in_the_regula...   \n",
       "2               0    False  /r/nbadiscussion/comments/bt8ycb/potential_rap...   \n",
       "3               0    False  /r/nbadiscussion/comments/bt7caj/raptors_rende...   \n",
       "4               0    False  /r/nbadiscussion/comments/bt3u4l/now_that_the_...   \n",
       "\n",
       "   pinned  retrieved_on  score  \\\n",
       "0   False    1558886701      1   \n",
       "1   False    1558885939      0   \n",
       "2   False    1558883256     20   \n",
       "3   False    1558873566    372   \n",
       "4   False    1558844618     24   \n",
       "\n",
       "                                            selftext  send_replies  spoiler  \\\n",
       "0                                                             True    False   \n",
       "1  One case for why Philly should make it a prior...          True    False   \n",
       "2  In facing the Warriors, the Raptors will need ...          True    False   \n",
       "3  Haven’t seen this discussed with all the focus...          True    False   \n",
       "4  I really closely watched only the last two gam...          True    False   \n",
       "\n",
       "   stickied      subreddit subreddit_id  subreddit_subscribers subreddit_type  \\\n",
       "0     False  nbadiscussion     t5_3cw3x                  38360         public   \n",
       "1     False  nbadiscussion     t5_3cw3x                  38360         public   \n",
       "2     False  nbadiscussion     t5_3cw3x                  38357         public   \n",
       "3     False  nbadiscussion     t5_3cw3x                  38352         public   \n",
       "4     False  nbadiscussion     t5_3cw3x                  38322         public   \n",
       "\n",
       "  thumbnail                                              title  \\\n",
       "0      self  If Kawhi stays this off-season, do you try to ...   \n",
       "1      self  In the regular season, the 76ers went 8-2 with...   \n",
       "2      self                   Potential Raptors Defensive Look   \n",
       "3      self               Raptors rendered Mirotic unplayable.   \n",
       "4      self  Now that the series is over, what do you guys ...   \n",
       "\n",
       "   total_awards_received  updated_utc  \\\n",
       "0                      0   1559628248   \n",
       "1                      0   1559628173   \n",
       "2                      0   1559627918   \n",
       "3                      0   1559627122   \n",
       "4                      0   1559625382   \n",
       "\n",
       "                                                 url post_hint preview  \\\n",
       "0  https://www.reddit.com/r/nbadiscussion/comment...       NaN     NaN   \n",
       "1  https://www.reddit.com/r/nbadiscussion/comment...       NaN     NaN   \n",
       "2  https://www.reddit.com/r/nbadiscussion/comment...       NaN     NaN   \n",
       "3  https://www.reddit.com/r/nbadiscussion/comment...       NaN     NaN   \n",
       "4  https://www.reddit.com/r/nbadiscussion/comment...       NaN     NaN   \n",
       "\n",
       "  crosspost_parent crosspost_parent_list  gilded link_flair_template_id  \\\n",
       "0              NaN                   NaN     NaN                    NaN   \n",
       "1              NaN                   NaN     NaN                    NaN   \n",
       "2              NaN                   NaN     NaN                    NaN   \n",
       "3              NaN                   NaN     NaN                    NaN   \n",
       "4              NaN                   NaN     NaN                    NaN   \n",
       "\n",
       "  link_flair_text author_flair_background_color author_flair_text_color  \\\n",
       "0             NaN                           NaN                     NaN   \n",
       "1             NaN                           NaN                     NaN   \n",
       "2             NaN                           NaN                     NaN   \n",
       "3             NaN                           NaN                     NaN   \n",
       "4             NaN                           NaN                     NaN   \n",
       "\n",
       "   thumbnail_height  thumbnail_width  edited author_cakeday  \n",
       "0               NaN              NaN     NaN            NaN  \n",
       "1               NaN              NaN     NaN            NaN  \n",
       "2               NaN              NaN     NaN            NaN  \n",
       "3               NaN              NaN     NaN            NaN  \n",
       "4               NaN              NaN     NaN            NaN  "
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.isull().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}