Government Polytechnic Thane

Institute Code : 0116

Vision
To create competent technical manpower to cater industrial and societal needs.

Mission
We are committed to –

M1 : Provide an environment that values and encourages knowledge acquisition

with effective curriculum implementation.
M2 : Maintain the well-equipped laboratories to develop industrial competencies
among the students.
M3 : Empower and motivate faculties towards building their domain expertise in
technology and management.
M4 : Groom all round personality of students towards leadership, self-
employability, and lifelong learning.
M5 : Promote Industry Institute Interaction through training and placement
services, continuing education programs, consultancy & Technical services,
etc. for socio-economic development.

Our Core Values are –

Ethics, Equity, Women Empowerment, safety and Eco-friendly practices
1
 Computer Engineering Department

Vision
To be a trend setting department in technical education providing highly
competent, efficient manpower to meet the ever technology.

Mission
We are committed to –

M1 : To provide an atmosphere for students and faculty to enhance problem

solving skills, leadership qualities, team spirit & ethical responsibilities.
M2 : To develop technical & professional skills to face Evolving Challenges and
Social Needs through Innovative Learning Process.
M3 : Establish Industry institute interaction program to enhance entrepreneurship
skills.
M4 : Enabling the Students to Excel in their Professions and Careers with life-long
learning keeping speedy growth with emerging technology.

2
 ASSESSMENT MANUAL
OF
PYTHON

Micro-Project
CO6I Diploma Program

MAHARASHTRA STATE BOARD OF

TECHNICAL EDUCATION, MUMBAI
(Autonomous) (Iso-9001-2008) (ISO/ICE 27001:2013)

(2022-2023)

3
 Government Polytechnic Thane

CERTIFICATE
This is to certified that following Third Year Computer Engineering students
have successfully and satisfactorily completed their micro project work, entitled
“Web Scraping using Python” in partial fulfilment of the requirement for diploma
in Computer Engineering Academic Year2022-2023.

Student Name Roll No.

Manish Mhatre 03
Siddhesh Wagh 14
Tejas Gunjal 21
Sujal Desale 27
Sujit Lendave 28

Smt. Poonam Chaudhary Smt. Prajakta Mahajan Dr. [Link]

Subject Teacher H.O.D. Principal

4
GOVERNMENT POLYTECHNIC,
THANE

Micro-Project
WEB SCRAPING USING PYTHON

SUBJECT :- PYTHON

COMPUTER ENGINEERING
GOVERNMENT POLYTECHNIC,
THANE – 400612

2022-2023

5
 Annexure II

A Micro-Project Report
On
WEB SCRAPING USING PYTHON

Submitted in Practical fulfillment of

The Diploma in
Computer Engineering

UNDER GUIDENCE OF
Ms. Poonam Chaudhary

Department Of
COMPUTER ENGINEERING

Submitted By

Roll No. Name Enrollment No.

03 Manish Mhatre 2001160165
14 Siddhesh Wagh 2001160176
21 Tejas Gunjal 2001160183
27 Sujal Desale 2001160189
28 Sujit Lendave 2001160191

6
 Table of Contents

Sr. No. Topics Page No.

1. Rationale 8

2. Aim/Benefits of the Micro-Project 8

3. Course Outcomes Achieved 8

4. Literature Review 8

5. Actual Procedure Followed 9

6. Actual Resources Used 9

7. Outputs of the Micro-Project 10 - 12

8. Skills Developed/Learning Outcomes of the Micro-Project 13

9. Applications of this Micro-Project 13

7
1.0 Rationale : -
Web scraping is an automated method used to extract large amounts of data from websites. Python
community has come up with some pretty powerful web scraping tools. The Internet hosts
perhaps the greatest source of information on the planet. Many disciplines, such as data science,
business intelligence, and investigative reporting, can benefit enormously from collecting and
analyzing data from websites. Python is powerful programming language and it has efficient high-
level data structures that is useful for data scraping.

2.0 Aim/Benefits of the Micro-Project :-

• The main aim of the project is to acquire the non-tabular or poorly structured data from
websites and convert it into a usable, structured format, such as a .csv file or spreadsheet.
• To learn the uses of web scraping and techniques to perform this web scraping process may
improve our data collection and analysis process.
• To learn different python libraries, and learn how to use this libraries in our project.

3.0 Course Outcomes Achieved :-

• Perform operations on data structures in python.
• Develop functions for a given problem and handling exceptions.
• Able to scraping the particular information from website
• Design classes for particular problems.

4.0 Literature Review :-

As we know Web Scraping is used for extract the data from various website for this we require
Beautiful Soup libraries. With over 10,626,990 downloads a week and 1.8K stars, Beautiful Soup
is one of the most helpful Python web scraping libraries for parsing HTML and XML documents
into a tree structure to identify and extract data. Beautiful Soup offers a Pythonic interface and
automated encoding conversions, making it easier to work with website data. Also we used
requests library, with over 52,881,567 weekly downloads, Requests is another popular Python
library that makes it easier to generate multiple HTTP requests. This is extremely helpful for web
scraping since the primary step in any web scraping process is to submit HTTP requests to the
website's server to extract the data displayed on the desired web page.

8
5.0 Actual Procedure Followed :-
To accomplish web scraping for our project, we utilized essential Python concepts such as lists
and their methods, dictionaries, arrays, and loop statements. We developed a .py file and imported
necessary libraries such as requests and bs4, which simplify the process of extracting data from
web pages by providing Pythonic idioms for parsing, searching, and modifying the HTML/XML
tree. Additionally, we employed the pandas library to efficiently handle large and complex data
sets, providing various data structures and operations for manipulating numerical data and time
series. Finally, we exported the extracted website data to an Excel sheet. This was our approach
to completing the project.

6.0 Actual Resources Used :-

Sr. Name of Resources Specifications Qty Remarks

No. Required

1. Computer System 8 GB Ram and i5 processor 1

2. MS Word Latest 1

3. IDE VS Code 1

4. Browser Chrome 1

9
7.0 Output of the Micro-Project :-
Source Code :-

10
11
 Output :-
Sr. NO. Name Rating Genre Release Date Runtime Director URL

1 Ant-Man and the Wasp: Quantumania 65.0 Action, Adventure, Science Fiction 02/17/2023 2h 5m Peyton Reed [Link]

2 The Super Mario Bros. Movie 75.0

Animation, Adventure, Family, Fantasy, Comedy
04/07/2023 1h 32m Aaron Horvath [Link]

3 Shazam! Fury of the Gods 69.0 Action, Comedy, Fantasy 03/17/2023 2h 10m David F. Sandberg [Link]

4 Avatar: The Way of Water 77.0 Science Fiction, Adventure, Action 12/16/2022 3h 12m James Cameron [Link]

5 The Last Kingdom: Seven Kings Must Die 73.0 Action, Adventure, History, Drama, War 04/14/2023 1h 51m Edward Bazalgette [Link]

6 Creed III 73.0 Drama, Action 03/03/2023 1h 56m Michael B. Jordan [Link]

7 Murder Mystery 2 66.0 Comedy, Mystery, Action 03/28/2023 1h 31m Jeremy Garelick [Link]

8 Evil Dead Rise 70.0 Horror, Thriller 04/21/2023 1h 36m Lee Cronin [Link]

9 Ghosted 73.0 Romance, Action, Comedy 04/18/2023 2h Dexter Fletcher [Link]

10 Scream VI 74.0 Horror, Mystery, Thriller 03/10/2023 2h 3m Tyler Gillett [Link]

11 Puss in Boots: The Last Wish Animation,

83.0 Family, Fantasy, Adventure, Comedy, Drama
01/20/2023 1h 43m Joel Crawford [Link]

12 Adrenaline 55.0 Action 12/15/2022 1h 15m Massimiliano Cerchi [Link]

13 65 63.0 Science Fiction, Adventure, Thriller, Action 03/10/2023 1h 33m Bryan Woods [Link]

14 The Pope's Exorcist 66.0 Horror, Thriller 04/07/2023 1h 43m Julius Avery [Link]

15 John Wick: Chapter 4 79.0 Action, Thriller, Crime 03/24/2023 2h 50m Chad Stahelski [Link]

16 The Communion Girl 64.0 Horror 02/10/2023 1h 43m Víctor García [Link]

17
Pirates Down the Street II: The Ninjas from Across
62.0 Family, Action, Adventure 04/20/2022 1h 29m Pim van Hoeve [Link]

18 Cocaine Bear 64.0 Thriller, Comedy, Crime 02/24/2023 1h 36m Elizabeth Banks [Link]

19 Gangs of Lagos 56.0 Crime 04/07/2023 None Jadesola Osiberu [Link]

20 Kill Boksoon 69.0 Action, Crime, Thriller 03/31/2023 2h 17m Byun Sung-hyun [Link]

21 Chupa 65.0 Adventure, Fantasy, Family 04/07/2023 1h 38m Jonás Cuarón [Link]

22 Attack on Titan 60.0 Action, Science Fiction 09/30/2022 1h 33m Noah Luke [Link]

23 Supercell 63.0 Action 03/17/2023 1h 40m Herbert James Winterstern [Link]

24 Mummies 71.0
Animation, Comedy, Family, Adventure, Fantasy
02/24/2023 1h 28m Juan Jesús García Galocha[Link]

25 Ripper's Revenge 44.0 Horror 04/03/2023 1h 25m Steven Lawson [Link]

26 Marcel the Shell with Shoes On 78.0Animation, Comedy, Family, Drama, Adventure
06/24/2022 1h 30m Dean Fleischer Camp [Link]

27 Prizefighter: The Life of Jem Belcher 62.0 Drama, History 07/22/2022 1h 47m Daniel Graham [Link]

28 Winnie the Pooh: Blood and Honey 57.0 Horror, Thriller 02/15/2023 1h 24m Rhys Frake-Waterfield [Link]

29 Black Panther: Wakanda Forever 73.0 Action, Adventure, Science Fiction 11/11/2022 2h 42m Ryan Coogler [Link]

30 The Park 59.0Action, Drama, Horror, Science Fiction, Thriller

03/02/2023 1h 20m Shal Ngo [Link]

31 Black Adam 71.0 Action, Adventure, Science Fiction, Fantasy 10/21/2022 2h 5m Jaume Collet-Serra [Link]

32 M3GAN 74.0 Science Fiction, Horror, Comedy 01/13/2023 1h 42m Gerard Johnstone [Link]

33 Black Warrant 54.0 Action, Thriller 01/09/2023 1h 34m Tibor Takács [Link]

34 Sisu 71.0 War, Action 01/27/2023 1h 31m Jalmari Helander [Link]

35 The Devil Conspiracy 63.0 Horror, Thriller 01/13/2023 1h 51m Nathan Frankowski [Link]

36 The Exorcist 57.0 Horror 11/02/2022 1h 41m Adrián García Bogliano [Link]

37 Plane 69.0 Action, Adventure, Thriller 01/13/2023 1h 47m Jean-François Richet [Link]

38 The Amazing Maurice 70.0

Animation, Adventure, Comedy, Family, Fantasy
02/09/2023 1h 33m Toby Genkel [Link]

39 A Tourist's Guide to Love 65.0 Romance, Comedy, Adventure 04/21/2023 1h 36m Steven K. Tsuchida [Link]

40 Knock at the Cabin 64.0 Horror, Mystery, Thriller 02/03/2023 1h 40m M. Night Shyamalan [Link]

That Time
41 I Got Reincarnated as a Slime the Movie: Scarlet
76.0 Bond Animation, Fantasy, Adventure 11/25/2022 1h 48m Yasuhito Kikuchi [Link]

42 The Mummy Resurrection 58.0 Horror 01/02/2023 1h 25m Steven Lawson [Link]

43 Knights of the Zodiac 67.0 Fantasy, Action, Adventure 04/28/2023 1h 52m Tomek Baginski [Link]

44 Unhappily Ever After 69.0 Comedy, Romance 01/26/2023 1h 30m Noé Santillán-López [Link]

45 Fast X 0.0 Action, Crime, Thriller 05/19/2023 2h 21m Louis Leterrier [Link]

46 Disquiet 67.0 Thriller, Horror, Mystery 02/10/2023 1h 25m Michael Winnick [Link]

47 Shotgun Wedding 63.0 Action, Comedy, Romance 01/18/2023 1h 41m Jason Moore [Link]

48 Phenomena 59.0 Comedy, Horror, Thriller 04/14/2023 1h 36m Carlos Therón [Link]

49 Sayen 62.0 Thriller, Action 03/03/2023 1h 34m Alexander Witt [Link]

50 Shark Side of the Moon 53.0 Action, Science Fiction, Thriller, Horror 08/12/2022 1h 28m Tammy Klein [Link]

51 Queens on the Run 71.0 Comedy, Action 04/14/2023 1h 36m Jorge Macaya [Link]

52 Gold Run 66.0 War, Action, Adventure, Thriller 12/15/2022 1h 57m Hallvard Bræin [Link]

53 One More Time 63.0 Comedy, Drama 04/21/2023 1h 25m Jonatan Etzler [Link]

54 Batman: The Doom That Came to Gotham 65.0 Animation, Fantasy, Horror, Action, Mystery 03/28/2023 1h 26m Christopher Berkeley [Link]

55 Prey for the Devil 71.0 Horror, Thriller 10/28/2022 1h 33m Daniel Stamm [Link]

56 Die Hart 61.0 Action, Comedy, Thriller 02/24/2023 1h 25m Eric Appel [Link]

57 Fall 73.0 Thriller 08/12/2022 1h 47m Scott Mann [Link]

58 The Magician's Elephant 72.0 Animation, Adventure, Family, Fantasy 03/17/2023 1h 39m Wendy Rogers [Link]

59 H.P. Lovecraft's Witch House 58.0 Horror 06/29/2022 1h 22m Bobby Easley [Link]

12
8.0 Skills Developed/Learning Outcomes of the Micro-Project :-
▪ We use this study to improve our web scraping process, and we discovered that most of the
web scrapers are often quite similar and general in nature designed to carry out generic and
easy jobs.
▪ Able to extract website data to Excel sheet.
▪ We learn how to use python basics in our project.

9.0 Applications of this Micro-Project :-

▪ Web scraping is widely utilized for a variety of purposes, including comparing prices online,
observing changes in weather data, website change detection, research, integrating data from
multiple sources, extracting offers and discounts, scraping job postings information from job
portals, brand monitoring, and market analysis.

13