| Introduction |
|
Course Outline |
|
00:06:00 |
|
What is Web Scraping? |
|
00:09:00 |
|
Why use Python for Web Scraping? |
|
00:06:00 |
|
Applications of Web Scraping |
|
00:11:00 |
|
Is Web Scraping legal? |
|
00:08:00 |
|
Course Materials |
|
00:00:00 |
| Requirements and Installation of Tools |
|
Anaconda Installation: Mac and Linux |
|
00:03:00 |
|
Anaconda Installation: Windows |
|
00:04:00 |
| Structure and parts of an HTML Document |
|
Doctype |
|
00:05:00 |
|
Head Tag |
|
00:03:00 |
|
Body Tag |
|
00:04:00 |
|
Head and Paragraph tags |
|
00:04:00 |
|
List tags |
|
00:03:00 |
|
Table tags |
|
00:04:00 |
|
Anchor tags |
|
00:05:00 |
|
Grouping tags |
|
00:07:00 |
| CSS Selectors |
|
Class |
|
00:05:00 |
|
Id selector |
|
00:02:00 |
|
Tag or element |
|
00:04:00 |
|
Attribute selectors |
|
00:05:00 |
|
Pseudo class selectors |
|
00:09:00 |
| Making Requests using the Requests Library |
|
What is a request? |
|
00:05:00 |
|
GET request |
|
00:04:00 |
|
POST request |
|
00:02:00 |
|
PUT request |
|
00:04:00 |
|
DELETE request |
|
00:03:00 |
|
How to make requests in Python? |
|
00:03:00 |
|
HTTP Response codes |
|
00:09:00 |
| Introduction to Beautiful Soup |
|
What is Beautiful Soup? |
|
00:04:00 |
|
Inspecting a website on the browser |
|
00:03:00 |
|
How to get the HTML code from a website |
|
00:07:00 |
| Extracting content using Beautiful Soup |
|
By element name |
|
00:03:00 |
|
Using find and find_all methods |
|
00:10:00 |
|
Using CSS selectors: Element or tag name |
|
00:02:00 |
|
Using CSS selectors: ID and Class names |
|
00:03:00 |
|
Using CSS selectors: Pseudo class selector |
|
00:04:00 |
|
Using CSS selectors: Attribute name |
|
00:03:00 |
| Project One: Creating an ebay Price Tracker |
|
Project Description – 1 |
|
00:03:00 |
|
Inspecting the website and identifying the key elements – 1 |
|
00:03:00 |
|
Scraping the website – 1 |
|
00:12:00 |
| Project Two: Obtaining the top 20 hits from a Billboard website |
|
Project Description – 2 |
|
00:01:00 |
|
Inspecting the website – 2 |
|
00:02:00 |
|
Scraping the website – 2 |
|
00:08:00 |
| Project Three: Scraping the IMDB website for movie recommendations |
|
Project Description – 3 |
|
00:02:00 |
|
Inspecting the website – 3 |
|
00:03:00 |
|
Scraping the website – 3 |
|
00:09:00 |
| Project Four: Creating a Bitcoin Price Tracker |
|
Project Description – 4 |
|
00:02:00 |
|
Inspecting the website – 4 |
|
00:02:00 |
|
Scraping the website – 4 |
|
00:08:00 |