Web Scraping : Urdu News

-

Web scraping is an amazing method to collect data. Many data scientist use this method. I have scrape Urdu news. Urdu is difficult to scrape but thanks to Python and its libraries. Have a look at the code and outputs below:


Comments

Post a Comment

Popular posts from this blog

Data Modeling

-
Image
source: https://searchdatamanagement.techtarget.com/definition/data-modeling A wise person once said a picture is worth a thousand words . In real-world data is not just a few rows of excel sheet, yet it comprises several billion rows expanded through hundreds  of tables. A table is usually made up of rows and columns. Each table represents an Entity . Entity means an Object or thing. That Entity has several properties called Attributes . Those attributes represent the qualities or characteristics of the entity. Since there is more than one entity, so there should be a Relationship between those entities. If we look at the tables we cannot get a clear idea of the relationship between several tables/Entities. Hence, we need to represent the tables/data in the form of a picture or a flow graph. That flow graph or Entity-Relationship diagram is called a Data Model .  Data Modeling is a technique to represent how the tables are related to each other and to represent the s...
Read more

Organization Tips for Freshers

-
Image
Before going into the university or College we used to think that we will manage our university work along with our household work like a pro. But after just two to three days we start losing motivation and the panic sets in.  In this blog post, we will see how could we remain organized in the freshman year of our university. Here I am focusing on the freshman year because if you start in an organized manner then there are higher chances for you to continue being well organized in the years to come. so without further ado, let's get started... TIP#1: Backpack Preparation The most important thing that you will carry with you is your backpack. It must be organized in a way that makes your work easier. So, first of all, try to have a bag in which you can put a laptop, notebooks, and other essential things. Try to put less but necessary items in your bag. TIP#2:  Mobile Management You will probably gonna use a mobile phone at the university. Check the following ite...
Read more

Relational DB, ORM and ERP systems

-
Image
When something is getting obsolete, we usually use to say it in Urdu as: Translation:That time has gone... With each passing second data is increasing and to make efficient use of that data we need to store it in some structured form. In past almost all the enterprises used to store data, in rows and columns on paper; like for attendance of staff members, there was a register in which name and corresponding status of attendance is marked. Bills, payment status, resource planning, human resource management, everything was (just) on papers. so yeah, that time has almost gone; when people used to store a lot of data on papers and in files.  Image Source But then technology grew up and paperwork is shifted on digital world. (But, there are still many companies relaying on paper work more than on computers!). So as mentioned above, the problem is; data is expanding. We need to deal with it, we need to manage it properly.  According to Quickbase article on datab...
Read more

Data Engineering Tools

-
Image
   Data is a new oil. To channelize this data we need proper pipelines. These pipelines are mostly called ETL or data pipelines.  There are various tools out there to work out these Extract, Transform, and Load (ETL) operations.  Some of the scripting tools are:  - Python - SQL and NoSQL Apache provides a wide range of products that can be used as Data Engineering tools.  Some of the amazing apache DE services comprised of; - Hadoop - Spark - Kafka - Cassandra - Hive In addition, some cool DE tools are: - Tableau - Talend - MapReduce These DE tools provide a way to manage the data pipelines in a more effective, efficient, and better way.  Almost every Data-Oriented company in the corporate sector is highly dependent upon these technologies. They are leveraging many of the above-mentioned mechanisms for promising Data Services and Architecture. That's it for today. Hope you have enjoyed this article. If you want to know more about data or software relat...
Read more

Applications of Data Engineering

-
Image
In a previous blog post about data engineering, we went through several many concepts related to data engineering such as data modeling, and then we went through different types of databases, for example, relational databases and we also got a glimpse of relational as well as NoSQL databases. And in today's blog post we will be writing about data engineer applications. Which are basically the use cases of data engineering 1st let's see what data engineering applications mean; so basically when we have data and we have engineered it then there are several things that we can do with that data and these things that we can do with processed data are the use cases of the data engineering. For example: If we have filled our containers with the data then it's not of any good use if it is not clean and well-formed. If your data is well-formed and if there are no logical mistakes, missing values, and garbage then we can easily perform the use cases and applications of data enginee...
Read more

Relational Data Model

-
Image
In the previous blog post, we covered Data Modeling. We have seen that data modeling is really important before jumping into predictive modeling.  In this article, we will cover the Relational Data Model (RDM). Let's start from the very basics, relational means anything which is linked with some other thing. This link is called "Relationship". In RDM or RM there are major three types of relationship cardinalities (also called Multiplicities or Cardianalities): 1. One to one 2. One to many 3. Many to many We can understand these with the help of a few simple examples;  One to one: One department has one manager. One to many: One class has many students. Many to many: Many teachers can teach many students. Okay, so we have got an abstract overview of the term " Relational ", now the next thing is " Data ", data covers everything, anything... And finally, " Model " means something in the form of a template, design, a kind of blueprint.  To store...
Read more

Probability And Statistics For Engineers

-
Image
Billy Graham said: " We are not cisterns, made for hoarding. We are channels made for sharing. " So I am passing "Probability And Statistics For Engineers by R.A Johnson" to you. As I got this from someone else, to whom I am very thankful. In this book the concepts of the subject are explained very well, I hope you will find this book, helpful and beneficial. There are certain distorted page images, but you can still get it (Insha' Allah!) and, here you go...
Read more

Good Pieces of Advice for Freshers

-
Image
To let you know a few useful things, I asked some experienced people, and here is what they have for you... Be open to changes. Focus on improving your soft / people skills. It will be hard sometimes but believe in yourself. You have got it. ( Rahat-Undergraduate ) Try to do good in quizzes and OHTs (One hour test or mids) cause when finals don't go well, these can help in getting good gpa which are comparatively easy then finals. ( Ayesha Munir-Undergraduate )   A few years later when you would look back at this time, GPA won't make you happy, but the memories of these 4 years will. Your career is important but so is having a good time. So work hard, party harder! ( Haris-Undergraduate ) From the start try to build your connections with seniors because they know more than you and.. are best counselors.. Focus on your quizzes and assignments because they are the building blocks of your Grade.. Your Good Image play some important part for favoritism points in exam....
Read more

Simple Web Page : Step by Step

-
Image
Today I will tell you, how can you create a simple web page using HTML and CSS, step by step. so let's begin.. Make a folder on desktop (for easy access) naming MyFirstWeb . Open any text editor like Notepad etc. Type simple HTML structure in the text editor as: <!DOCTYPE html> <html>         <head>                     <title>                    </title>         </head>                         <body>                         </body> </html> Now save this file in the MyFirstWeb folder by naming it as : index.html You can see the file Icon as of your browser. Click this file to open it in the browser. Edit the above code a...
Read more

Github : Part 2 : Final : Full Guide

-
Image
In the Previous blog post   we have understood the basic concept behind GitHub, today we will see how to use it? Which tools are required for this? and much much more.... So our agenda is: How to start with GitHub Terms explained Guides And Support New Features Cheat Sheet How to start with GitHub? Let's start simple.  Go to GitHub.com Then click Sign Up button, if you already haven't done that. If you have already signed up then sign in to get to your profile. If not then after signing up, you can sign in ( Isn't it obvious... ) After that you will land on a page like this.. Here you can manage your account, make repositories... (What is a repository?) A repository is like a folder or a project folder, into which you can add (save) your code files and other project files like images etc. There is another thing, that is  Desktop Application  for GitHub. This is a local server, this allows you to make your reposit...
Read more