← Back to Projects

Data Preprocessing Project Tutorial

Goal

4Geeks Coding Projects tutorials and exercises for people learning to code or improving their coding skills

Difficulty

beginner

Repository

Click to open

Video

Not available

Live demo

Not available

Average duration

2 hrs

Technologies

  • Download the New York Airbnb data from Kaggle.com (Find the direct link below)
  • Do as much exploratory data analysis as you can to find patterns and get insights from the data.
  • Use your explore notebook to try different cleaning methods.
  • Once you have your final cleaning process, use your app.py file to create a pipeline that cleans your data.

🌱 How to start this project

You will not be forking this time, please take some time to read this instructions:

  1. Create a new repository based on machine learning project by clicking here.
  2. Open the recently created repostiroy on Gitpod by using the Gitpod button extension.
  3. Once Gitpod VSCode has finished opening you start your project following the Instructions below.

πŸš› How to deliver this project

Once you are finished creating your eda notebook and your cleaning pipeline, make sure to commit your changes, push to your repository and go to 4Geeks.com to upload the repository link.

πŸ“ Instructions

New York City Airbnb data:

This is a dataset that contains Airbnb data on New York City. You will use it to practice your new EDA (exploratory data analysis) and data cleaning skills.

Step 1:

Use the following online dataset:

https://raw.githubusercontent.com/4GeeksAcademy/data-preprocessing-project-tutorial/main/AB_NYC_2019.csv

Time to work on it!

Step 2:

Use the explore.ipynb notebook to find patterns and valuable information as much as you can. Make graphs that helps us understand the patterns found, get some statistics, create new variables if needed, etc.

  • What can we learn about different hosts and areas?

  • Which hosts are the busiest and why?

  • Is there any noticeable difference of traffic among different areas and what could be the reason for it?

Don't forget to write your observations.

Step 3:

Now that you have a beautiful EDA notebook, and you have a better knowledge of the data, let's imagine Airbnb asks you to deliver a machine learning pipeline that cleans the data, in order to give it to their modeling area for future price prediction.

Use the app.py to create your cleaning pipeline that makes data ready for modeling. Save your clean data in the 'Processed' data folder.

We used to add our .env file into the .gitignore file in order to hide our passwords and credentials from version control.

This time make sure to add the data folder to your .gitignore file. Specially for big datasets, this is very important.

In your README file write a brief summary of your cleaning process and explain where the data comes from (Add the link), because you won't upload any of the data folders.

Goal

4Geeks Coding Projects tutorials and exercises for people learning to code or improving their coding skills

Difficulty

beginner

Repository

Click to open

Video

Not available

Live demo

Not available

Average duration

2 hrs


Subscribe for more!


COMPANY

ABOUT

CONTACT

MEDIA KIT

SOCIAL & LIVE LEARNING

The most efficient way to learn: Join a cohort with classmates like yourself, live streamings, coding jam sessions, live mentorships with real experts and keep the motivation.

INTRO TO CODING

From zero to getting paid as a developer, learn the skills of the present and future. Boost your professional career and get hired by a tech company.

DATA SCIENCE

Start a career in data science and analytics. A hands-on approach with interactive exercises, chat support, and access to mentorships.

30DAYSOFGEEKCODING

Keep your motivation with this 30 day challenge. Join hundreds of other developers coding a little every day.

A.I. & MACHINE LEARNING

Start with Python and Data Science, Machine Learning, Deep Learning and maintaining a production environment in A.I.


Β©4Geeks Academy LLC 2019

Privacy policies


Cookies policies


Terms & Conditions