Mass Downloader Objectives: 1. Learn how to Retrieve objects over an HTTP connection. 2. Learn how to extract links from and an HTML file. Equipment and Software Tools Required: 1. PYTHON 2. urllib module 3. гegex module Introduction: In some cases, you reach a website that has a list of objects (links) you want to download. This could be a course website with a list of the slides in PDF format. Therefore, you can use an application or browser extension that provides mass or batch downloading, such as Flashget and Chrono Download Manager. Those applications/extensions extract all links from the HTML file, give you the option to select the ones to download, and it will download all selected objects. In this lab exercise, you are going to write a script that will work as a mass downloader. Requirements In this exercise, the learner should write a mass downloader script. The script should download all links of a certain type from a given website. Therefore, the script should do the following: • Ask a user for a valid URL address. • Download the HTML file of that address. Extract all URLS from the HTML file. • Ask the user to select a file type (use .pdf file type). Retrieve the objects of all links that match the selected file type.
Mass Downloader Objectives: 1. Learn how to Retrieve objects over an HTTP connection. 2. Learn how to extract links from and an HTML file. Equipment and Software Tools Required: 1. PYTHON 2. urllib module 3. гegex module Introduction: In some cases, you reach a website that has a list of objects (links) you want to download. This could be a course website with a list of the slides in PDF format. Therefore, you can use an application or browser extension that provides mass or batch downloading, such as Flashget and Chrono Download Manager. Those applications/extensions extract all links from the HTML file, give you the option to select the ones to download, and it will download all selected objects. In this lab exercise, you are going to write a script that will work as a mass downloader. Requirements In this exercise, the learner should write a mass downloader script. The script should download all links of a certain type from a given website. Therefore, the script should do the following: • Ask a user for a valid URL address. • Download the HTML file of that address. Extract all URLS from the HTML file. • Ask the user to select a file type (use .pdf file type). Retrieve the objects of all links that match the selected file type.
Computer Networking: A Top-Down Approach (7th Edition)
7th Edition
ISBN:9780133594140
Author:James Kurose, Keith Ross
Publisher:James Kurose, Keith Ross
Chapter1: Computer Networks And The Internet
Section: Chapter Questions
Problem R1RQ: What is the difference between a host and an end system? List several different types of end...
Related questions
Question
Transcribed Image Text:Mass Downloader
Objectives:
1. Learn how to Retrieve objects over an HTTP connection.
2. Learn how to extract links from and an HTML file.
Equipment and Software Tools Required:
1. PYTHON
2. urllib module
3. regex module
Introduction:
In some cases, you reach a website that has a list of objects (links) you want to download. This
could be a course website with a list of the slides in PDF format. Therefore, you can use an
application or browser extension that provides mass or batch downloading, such as Flashget
and Chrono Download Manager. Those applications/extensions extract all links from the
HTML file, give you the option to select the ones to download, and it will download all selected
objects. In this lab exercise, you are going to write a script that will work as a mass downloader.
Requirements
In this exercise, the learner should write a mass downloader script. The script should
download all links of a certain type from a given website.
Therefore, the script should do the following:
• Ask a user for a valid URL address.
• Download the HTML file of that address.
• Extract all URLS from the HTML file.
• Ask the user to select a file type (use .pdf file type).
Retrieve the objects of all links that match the selected file type.
Expert Solution
This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
This is a popular solution!
Trending now
This is a popular solution!
Step by step
Solved in 2 steps
Recommended textbooks for you
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Computer Networking: A Top-Down Approach (7th Edi…
Computer Engineering
ISBN:
9780133594140
Author:
James Kurose, Keith Ross
Publisher:
PEARSON
Computer Organization and Design MIPS Edition, Fi…
Computer Engineering
ISBN:
9780124077263
Author:
David A. Patterson, John L. Hennessy
Publisher:
Elsevier Science
Network+ Guide to Networks (MindTap Course List)
Computer Engineering
ISBN:
9781337569330
Author:
Jill West, Tamara Dean, Jean Andrews
Publisher:
Cengage Learning
Concepts of Database Management
Computer Engineering
ISBN:
9781337093422
Author:
Joy L. Starks, Philip J. Pratt, Mary Z. Last
Publisher:
Cengage Learning
Prelude to Programming
Computer Engineering
ISBN:
9780133750423
Author:
VENIT, Stewart
Publisher:
Pearson Education
Sc Business Data Communications and Networking, T…
Computer Engineering
ISBN:
9781119368830
Author:
FITZGERALD
Publisher:
WILEY