Function 2: Cleaner

[JuntingHe]

Function to clean web-scraped data with Pandas and Regex

[JuntingHe]

Function 2 takes in the scraped tibble scarping from Function 1 and returns a cleaned tibble object containing information like listing url, price, number of bedroom, area in sqft, and city and ready for filtering.

[JuntingHe]

Ideas/notes that are related to the cleaner function .

• convert the price column into integer data types
• extract the information about the number of bedroom of the housing and the area of the housing from the house_type column
• extract the information about which city are the housing located in from the listing_url column
• select the columns (listing url, price, number of bedroom, area in sqft, and city) which are useful for future filtering

[JuntingHe]

In designing the function, I tried to use databases of the cities like world.cities or canada.cities to verify they is actually city information in the city column but in fact, some cities like "Burnaby" are missing in those datasets. Hence, I decided to use city list instead of those database.