Summary of Kaggle-Pandas Course Content

Pandas

Solve short hands-on challenges to perfect your data manipulation skills.

Lesson 1. Creating, Reading and Writing

Importing Pandas

import pandas as pd

Pandas has two core objects: DataFrame and Series.

DataFrame

A DataFrame is a table. It contains an array of individual entries, each of which has a certain value. Each entry corresponds to a row (or record) and a column. DataFrame entries don’t need to be integers.

pd.DataFrame({'Bob': ['I liked it.', 'It was awful.'], 'Sue': ['Pretty good.', 'Bland.']})

DataFrames are declared using Python’s dictionary format. Keys are column names, and values are lists of items to be entered.

Usually, when declaring a DataFrame, column labels are assigned the column name, but row labels are assigned integers 0, 1, 2… If necessary, row labels can be manually specified. The list of row labels in a DataFrame is called an Index, and can be set using the index parameter.

pd.DataFrame({'Bob': ['I liked it.', 'It was awful.'], 
              'Sue': ['Pretty good.', 'Bland.']},
             index=['Product A', 'Product B'])

Series

A Series is a sequence of data values.

pd.Series([1, 2, 3, 4, 5])

A Series is essentially a single column of a DataFrame. Therefore, it can also have an index specified. The difference is that instead of a ‘column name’, it has a ‘name’, name.

pd.Series([30, 35, 40], index=['12015 Sales', '12016 Sales', '12017 Sales'], name='Product A')

Series and DataFrames are closely related. It helps to think of a DataFrame as simply a bunch of Series “glued together”.

Reading Data Files

In many cases, rather than writing data directly, existing data is imported and used. Data can be stored in various formats, but the most basic form is a CSV file. The contents of a CSV file typically look like this:

Product A,Product B,Product C,
30,21,9,
35,34,1,
41,11,11

That is, a CSV file is a table where each value is separated by a comma. That’s why it’s called “Comma-Separated Values”, CSV.

To load data in CSV file format into a DataFrame, use the pd.read_csv() function.

You can check the size of a DataFrame using the shape attribute.

You can view the first five rows of a DataFrame using the head() command.

The pd.read_csv() function has over 30 parameters. For example, if the CSV file you’re trying to load contains its own index, you can specify the value of the index_col parameter to use that column as the index instead of Pandas automatically assigning an index.

Writing Data

You can export a DataFrame to a CSV file using the to_csv() method. It’s used as follows:

(DataFrame name).to_csv("(CSV file path)")

Lesson 2. Indexing, Selecting & Assigning

Selecting specific values to use from a Pandas DataFrame or Series is a step in almost every data-related task.