Jupyter Notebook is a helpful open-source web app used for all types of data transformation, modeling, and visualization.
Below is a quick refresher on installing Jupyter Notebook and using Python commands to handle data sets within the app.
Let's jump right in!
Create and activate a virtual environment
macOS Terminal
User-Macbook:~ user$ cd desktop
User-Macbook:desktop user$ python3 -m venv jup
User-Macbook:desktop user$ cd jup
User-Macbook:jup user$ source bin/activate
Windows Command Prompt
C:\Users\Owner> cd desktop
C:\Users\Owner\desktop> py -m venv jup
C:\Users\Owner\desktop> cd jup
C:\Users\Owner\desktop\jup> Scripts\activate
First, type python3 -m venv env for Mac or py -m venv env for Windows to create a virtual environment named jup.
Then cd into the new directory and activate the virtual environment so you can properly install the JupyterLab desktop app in the next step.
Install JupyterLab desktop app
How to install JupyterLab on macOS Terminal
(jup)User-Macbook:jup user$ pip install jupyterlab
How to install JupyterLab on Windows Command Prompt
(jup)C:\Users\Owner\desktop\jup> pip install jupyterlab
Install JupyterLab, the interactive development environment for notebooks, with the command pip install juypterlab. This may take a couple of minutes.
Open JupyterLab in the browser
Open JupyterLab on macOS Terminal
(jup)User-Macbook:jup user$ jupyter notebook
Open JupyterLab on Windows Command Prompt
(jup)C:\Users\Owner\desktop\jup> jupyter notebook
Once the installation is complete, open the JupyterLab desktop app in your browser with the simple command juypter notebook.
You do not cd into Jupyter Notebook.
![Jupyter Notebook]()
Your virtual environment folders will then appear in the browser window.
How to create a new Jupyter notebook
Click on the "New" button on the right side of the screen then select, "Python3".
An untitled Jupyter notebook will then be created in a new tab.
![New Jupyter notebook]()
Install numpy pandas nltk in the Jupyter notebook
import sys
!{sys.executable} -m pip install numpy pandas nltk
Type in the command pip install numpy pandas nltk in the first cell. Click Shift + Enter to run the cell's code. An asterisk will then appear in the brackets indicating it is running the code.
When finished, a new cell will appear below. You are now ready to use Python commands to load-in and clean your data.
How to import pandas and load in your file
Import pandas into Jupyter notebook then load in a JSON file
import pandas as pd
df = pd.read_json(r'C:\Users\Owner\Desktop\data.json')
Import pandas into Jupyter notebook then load in a CSV file
import pandas as pd
df = pd.read_csv(r'C:\Users\Owner\Desktop\data.csv')
Import pandas into Jupyter notebook then load in an excel file
import pandas as pd
df = pd.read_excel(r'C:\Users\Owner\Desktop\data.xls')
In a new cell import pandas as pd. Then set a variable, in this case df for dataframe, as pd.read_doctype(r'full_path_to_file').
Run the cell.
How to display the dataframe in Jupyter notebook
display the dataframe in Jupyter notebook
df
Run df to display the dataframe in Jupyter notebook.
Working with columns
display all columns in Jupyter notebook
df.columns
Lists the names of all of the columns in the data frame.
display specific columns in Jupyter notebook
df['column_name']
df['column_name1', 'column_name2', 'column_name3']
Display one specific column or multiple columns by calling on their names.
sort columns alphabetically in Jupyter notebook
df.sort_values('column_name')
df.sort_values('column_name', ascending=False)
Display the data frame alphabetically by the column specified. Add ascending=False to sort by descending alphabetical order.
drop/delete columns in Jupyter notebook
df = df.drop(columns = ['column_name']))
Drops the column specified from the data set.
create a new column from existing columns in Jupyter notebook
df['new_column'] = df['column_name1'] + df['column_name2']
Creates a new column equal to the sum of column 1 plus column 2 data.
Working with rows
display first rows in Jupyter notebook
df.head()
df.head(10)
Displays the first 5 rows of the data frame. Add a number in the parentheses and that number of rows will display.
display last rows in Jupyter notebook
df.tail()
df.tail(10)
Displays the last 5 rows of the data frame. Add a number in the parentheses and that number of rows will display.
display a range of rows in Jupyter notebook
df.iloc[0:5]
Displays row 0-4 of the data frame. Note, the data frame starts counting rows/columns at 0 instead of 1.
Working with the columns and rows
locate a specific value by row and column in Jupyter notebook
df.iloc[2,1]
Displays a specific value in a designated location. The example above locates the value in row 2, column 1.
locate specific rows by column in Jupyter notebook
df.loc[df['column_name'] == 'column_value']
Displays all of the rows that meet the specified column value.
locate specific rows that adhere to all of the column values in Jupyter notebook
df.loc[(df['column_1'] == 'column_value') & df.loc(df['column_2'] == 'column_value')]
Displays all rows with the specific column value of column 1 and the specific column value of column 2.
locate specific rows that adhere to one of the column values in Jupyter notebook
df.loc[(df['column_1'] == 'column_value') | df.loc(df['column_2'] == 'column_value')]
Displays all rows with the specific column value of column 1 or the specific column value of column 2.
locate specific rows in a column that contain a certain word in Jupyter notebook
df.loc[df['column_1'].str.contains('word')]
Lists all of the rows in column 1 that contain the word specified.
drop specific rows in a column that contain a certain word in Jupyter notebook
df.loc[~df['column_1'].str.contains('word')]
Drop all of the rows in column 1 that contain the word specified.
Changing data types
view data types in Jupyter notebook
df.dtypes
Outputs the data type (i.e. object, int32, datetime64...) of each column.
change the data type to integer in Jupyter notebook
df.column_name.astype(int)
Changes the data type of the column specified from a string to an integer.
change data to datetime field
pd.to_datatime(df.column_name)
Changes the data type of the column specified from a string to a date/time integer.
Working with the data set as a whole
reset the index in Jupyter notebook
df.reset_index(drop=True, inplace=True)
Reset the index of the data frame if you delete or change the ordering of rows.
list duplicates in Jupyter notebook
df.drop_duplicates()
Identifies duplicates in the data set.
drop duplicates in Jupyter notebook
df.drop_duplicates()
Drops any duplicate rows from the data set.
combine dataframes in Jupyter notebook
data = pd.concat([df1, df2, df3])
Combines all of the data from each data frame into a new data set.
Saving updated data frames as files
create and save JSON file in Jupyter notebook
df.to_json('name_of_new_file.json')
Save the existing data frame as a new CSV file.
create and save CSV file in Jupyter notebook
df.to_csv('name_of_new_file.csv')
Save the existing data frame as a new CSV file.
create and save excel file w/o the index in Jupyter notebook
df.to_excel('name_of_new_file.xlsx', index=False)
Save the existing data frame as a new excel file without the index numbers. Note, index=False can be added to the other.