Twitter API: Extracting Tweets with Specific Phrase

Twitter has been a good source for Data Mining. Many data scientists and analytics companies collect tweets and analyse them to understand people’s opinion about some matters.

In this tutorial, you will learn how to use Twitter API and Python Tweepy library to search for a word or phrase and extract tweets that include it and print the results.

Continue reading “Twitter API: Extracting Tweets with Specific Phrase”

Searching GitHub Using Python & GitHub API

GitHub is a web-based hosting service for version control using Git. It is mostly used for storing and sharing computer source code. It offers all of the distributed version control and source code management functionality of Git as well as adding its own features.

GitHub stores more than 3 million repositories with more than 1.7 million developers using it daily. With so much data, it can be quite daunting at first to find information one needs or do repetitive tasks, and that is when GitHub API comes handy.

In this tutorial, you are going to learn how to use GitHub API to search for repositories and files that much particular keywords(s) and retrieve their URLs using Python. You will learn also how to download files or a specific folder from a GitHub repository.

Continue reading “Searching GitHub Using Python & GitHub API”

Software Engineer & Dancer. Or is it the other way around? 🙂

Amazon S3 with Python Boto3 Library

Amazon S3 is the Simple Storage Service provided by Amazon Web Services (AWS) for object based file storage. With the increase of Big Data Applications and cloud computing, it is absolutely necessary that all the “big data” shall be stored on the cloud for easy processing over the cloud applications.

In this tutorial, you will learn how to use Amazon S3 service via the Python library Boto3. You will learn how to create S3 Buckets and Folders, and how to upload and access files to and from S3 buckets. Eventually, you will have a Python code that you can run on EC2 instance and access your data on the cloud while it is stored on the cloud.

Continue reading “Amazon S3 with Python Boto3 Library”

I am a Data Scientist in the Manufacturing  / IoT domain and a ML enthusiast. I like to work on data analysis and data infrastructure projects as well. Looking forward to connect.

Extracting YouTube Comments with YouTube API & Python

YouTube is the world’s largest video-sharing site with about 1.9 billion monthly active users. People use it to share info, teach, entertain, advertise and much more.

So YouTube has so much data that one can utilize to carry out research and analysis. For example, extracting YouTube video comments can be useful to run Sentiment Analysis and other Natural Language Processing tasks. YouTube API enables you to search for videos matching specific search criteria.

In this tutorial, you will learn how to extract comments from YouTube videos and store them in a CSV file using Python. It will cover setting up a project on Google console, enabling the necessary YouTube API and finally writing the script that interacts with the YouTube API.

Continue reading “Extracting YouTube Comments with YouTube API & Python”

Software Engineer & Dancer. Or is it the other way around? 🙂

Google Places API: Extracting Location Data & Reviews

Google places API allows developers to access a wealth of information from Google’s database for over 100 million places including location data, contact information, user ratings and reviews and more.

In this tutorial, you will learn how to create a reusable class to read and extract location related information from Google Places API. This tutorial will help you if you want to extract business’s name, address, phone number, website, and reviews.

Continue reading “Google Places API: Extracting Location Data & Reviews”

I speak Python!

Majid Alizadeh is a freelance developer specialized in web development, web scraping and automation. He provides high quality and sophisticated software for his clients. Beside Python he works with other languages like Ruby, PHP and JS as well.

Yelp Fusion API tutorial

Yelp Fusion API is a REST API that gives access to information across 50 million businesses across countries.

In this tutorial, you will be learning how to use the Yelp API to search businesses by providing their names, locations or phone numbers. You will also learn to match businesses in a given location to check their availability. You will be using the requests library of Python, Requests and JSON library to parse the JSON response of data.

This tutorial covers the following features of the Yelp API: Business Search, Reviews Search, Phone Search, and Business Match.

Finally, there will be a practical project to help you use Yelp API in a real-life case.

Continue reading “Yelp Fusion API tutorial”

Adding Telegram Group Members to Your Groups Using Telethon

In the previous Telethon tutorial you learned how to send messages to Telegram group members. Now you are going to learn how to add new members to your own group. We will read the member list from the csv file which we extracted in the previous tutorial and add them to our group.

Continue reading “Adding Telegram Group Members to Your Groups Using Telethon”

I speak Python!

Majid Alizadeh is a freelance developer specialized in web development, web scraping and automation. He provides high quality and sophisticated software for his clients. Beside Python he works with other languages like Ruby, PHP and JS as well.

Sending Message to Telegram Members Using Telethon

In this tutorial, we are going to use the CSV file that we generated in Scraping Telegram Members tutorial to send bulk messages to our scraped Telegram group members using Telegram API and Python Telethon library. So if you did not already checked that, visit this tutorial and learn how to get this file. Basically we will feed our new Python script with that CSV file to read usernames or user IDs from it and send a message to them.

Continue reading “Sending Message to Telegram Members Using Telethon”

I speak Python!

Majid Alizadeh is a freelance developer specialized in web development, web scraping and automation. He provides high quality and sophisticated software for his clients. Beside Python he works with other languages like Ruby, PHP and JS as well.

Scraping Telegram Group Members with Python and Telethon

Telegram is one of the best communications apps around the world. People usually use Telegram for managing their communities and promotions.

Startup companies or ongoing projects use Telegram for bringing audience attention to their products and services. Telegram Members are engaging with the community! This is what we all want. Engaged members will help to grow the community.

In this tutorial, you will learn how to use Telegram API extract group members.

Continue reading “Scraping Telegram Group Members with Python and Telethon”

I speak Python!

Majid Alizadeh is a freelance developer specialized in web development, web scraping and automation. He provides high quality and sophisticated software for his clients. Beside Python he works with other languages like Ruby, PHP and JS as well.

Data Extraction from APIs with Python – Currency Exchange

There are several popular platforms that give developers access to their “web services”, aka “APIs” (Application Programming Interface). So using APIs is the official way for data extraction and doing other stuff allowed by such applications. You can even benefit from some APIs to build other applications. REST APIs usually generate output in JSON or XML format because most of programming languages can handle these formats easily. In fact, JSON (JavaScript Object Notation) is very similar to data types in programming languages; for example, it is very similar to Python dictionaries. If a REST API allows you to get the data you want to retrieve, then you do not need regular web scraping.

Some APIs require authentication (API Key or Client ID and Client Secret, similar to a username and password, so to speak) to control their usage, and some do not. We will explain this later in multiple APIs. For the purpose of clarifying the basics, we will start with a very simple currency rate conversion API that does not require any authentication.

In this tutorial, you will learn how to use Python to extract data from ExchangeRatesAPI.io which is -according to its official website- “a free service for current and historical foreign exchange rates published by the European Central Bank.” Continue reading “Data Extraction from APIs with Python – Currency Exchange”