Python Script 5: How to find most popular technologies on Stackoverflow

This script crawls the Stackoverflow pages to find the most popular technology by counting the number of tags on each question.

Important: Please do not send too many requests. Respect the robot.txt file.

Code is also available on Github.

You will require to install beautifulsoup  and requests  python package.

Code:
 

best python scripts

Other Scripts:

Opening top 10 Google search results in one hit.
Formatting and validating JSON.
Crawling all emails from a site.

 

Python Script 2 : Crawling all emails from a website

This is the second article in the series of python scripts. In this article we will see how to crawl all pages of a website and fetch all the emails.

Important: Please note that some sites may not want you to crawl their site. Please honour their robot.txt file. In some cases it may lead to legal action. 
This article is only for educational purpose. Readers are requested not to misuse it. 
Continue reading “Python Script 2 : Crawling all emails from a website”