Web Scraping : Urdu News

-

Web scraping is an amazing method to collect data. Many data scientist use this method. I have scrape Urdu news. Urdu is difficult to scrape but thanks to Python and its libraries. Have a look at the code and outputs below:


Comments

Post a Comment

Popular posts from this blog

An Interview with Pakistani Data Scientist : Dr. Zeeshan Ul Hassan Usmani

-
Image
Dr. Zeeshan-ul-Hassan Usmani, the name known for Data Science, Predictify me, Eisenhower fellowship  and most importantly motivation for many of the students. He is the Author of book like  (C++) ++سی/سی ,  Bit Coin Block Chain aur Crypto Currency بٹ کوائن، بلاک چین اور کرپٹو کرنسی  and many other, you can visit them here . Today "Data Science Tales - A Tech blog by Bia Chaudhry," asked him some of the questions, as an interview and we are very glad that he gave his precious time to answer them. It was kinda "Remote Interview"... not the traditional one.. The Interview Question:  How can you describe " Dr. Zeeshan ul Hassan Usmani " ? ANSWER: I am a shameless idealist. We are all idealists at some stage of our lives but then it fades away and we live as a mediocre. I don’t want it to fade away. I remind myself almost every day that I need to make my today better than my yesterday, and the challenge is keep getting harder J . We onl...
Read more

Relational Data Model

-
Image
In the previous blog post, we covered Data Modeling. We have seen that data modeling is really important before jumping into predictive modeling.  In this article, we will cover the Relational Data Model (RDM). Let's start from the very basics, relational means anything which is linked with some other thing. This link is called "Relationship". In RDM or RM there are major three types of relationship cardinalities (also called Multiplicities or Cardianalities): 1. One to one 2. One to many 3. Many to many We can understand these with the help of a few simple examples;  One to one: One department has one manager. One to many: One class has many students. Many to many: Many teachers can teach many students. Okay, so we have got an abstract overview of the term " Relational ", now the next thing is " Data ", data covers everything, anything... And finally, " Model " means something in the form of a template, design, a kind of blueprint.  To store...
Read more

Relational DB, ORM and ERP systems

-
Image
When something is getting obsolete, we usually use to say it in Urdu as: Translation:That time has gone... With each passing second data is increasing and to make efficient use of that data we need to store it in some structured form. In past almost all the enterprises used to store data, in rows and columns on paper; like for attendance of staff members, there was a register in which name and corresponding status of attendance is marked. Bills, payment status, resource planning, human resource management, everything was (just) on papers. so yeah, that time has almost gone; when people used to store a lot of data on papers and in files.  Image Source But then technology grew up and paperwork is shifted on digital world. (But, there are still many companies relaying on paper work more than on computers!). So as mentioned above, the problem is; data is expanding. We need to deal with it, we need to manage it properly.  According to Quickbase article on datab...
Read more

Data Engineering Tools

-
Image
   Data is a new oil. To channelize this data we need proper pipelines. These pipelines are mostly called ETL or data pipelines.  There are various tools out there to work out these Extract, Transform, and Load (ETL) operations.  Some of the scripting tools are:  - Python - SQL and NoSQL Apache provides a wide range of products that can be used as Data Engineering tools.  Some of the amazing apache DE services comprised of; - Hadoop - Spark - Kafka - Cassandra - Hive In addition, some cool DE tools are: - Tableau - Talend - MapReduce These DE tools provide a way to manage the data pipelines in a more effective, efficient, and better way.  Almost every Data-Oriented company in the corporate sector is highly dependent upon these technologies. They are leveraging many of the above-mentioned mechanisms for promising Data Services and Architecture. That's it for today. Hope you have enjoyed this article. If you want to know more about data or software relat...
Read more

Freshman Year : For All Engineering Students

-
Image
I believe:  "sharing good is caring" , s o, I decided to share some of the important videos, for all the engineering students, who are about to start their first semester especially in NUST .  so here you go.. (Click on The bulleted item, and you will get to the corresponding link) 1. Calculus: First, foremost and the dearest subject of students is "Calculus" , this will make you both cry and smile. So, if you want to do it well ,here are some videos: Professor Leonard:    www.youtube.com/user/professorleonard57/playlists I found it, really helpful 2. Applied Physics: Applied Physics abbreviated as "AP" is the second favorite subject of engineers at NUST (on a lighter note).  Michel van Biezen :  This is the physics vector playlist. You also can watch other AP related videos here: www.youtube.com/user/ilectureonline/playlists 3. Discrete Mathematics: I took this subject very light, but it isn't, so you need to pu...
Read more

Applications of Data Engineering

-
Image
In a previous blog post about data engineering, we went through several many concepts related to data engineering such as data modeling, and then we went through different types of databases, for example, relational databases and we also got a glimpse of relational as well as NoSQL databases. And in today's blog post we will be writing about data engineer applications. Which are basically the use cases of data engineering 1st let's see what data engineering applications mean; so basically when we have data and we have engineered it then there are several things that we can do with that data and these things that we can do with processed data are the use cases of the data engineering. For example: If we have filled our containers with the data then it's not of any good use if it is not clean and well-formed. If your data is well-formed and if there are no logical mistakes, missing values, and garbage then we can easily perform the use cases and applications of data enginee...
Read more

A Survey of the Final Year University Students

-
Image
I don't know what should be the title of this blog post, but let's call it " A survey of the final year university students ". Pretty long title, huh? Okay, let me tell you about this survey... The story behind this thing: Well, one day I thought about writing a post on Facebook to ask people about their sentiments and reviews regarding the final year of university life, then another thought knocked my head to write a full blog post on this topic. Then I disseminated a google form for this purpose. The google form was saying: "Hello, final semester people! I thought to collect reviews of 2020 graduates specifically of NUST and other IT universities. I am planning to add these to my blog post. Please take a few seconds to fill this form, thank you." So that was a brief story behind this whole thing, Now let's have a look at the most awaited questions and the corresponding responses...  Question#1:  Do you feel like a better hu...
Read more

Pintos : Series : Part3 : Project 1 : Alarm Clock

-
Image
The PintOS project has 27 test cases that we need to pass. In the first project we are just going for the five test cases related to alarm clock that are as under: alarm_multiple alarm_single alarm_simultaneous alarm_negative alarm_zero But before jumping into the code, let's first understand the basic structure of PintOS and how it runs. Consider the following diagram: Here QEMU is an emulator on which pintOS runs. Test cases are the processes that we run on the PintOS (Operating System). So we only need to modify the PintOS code, we are not allowed to make any change to the test cases code as this would be a cheating. When you open up the PintOS directory, in tests/threads/tests.c all the test cases are declared. And in the tests/threads/ directory you can observe files with the extension " .ck " and " .c ". So the " test_Name.c " files are the files in which test cases are defined, while " test_Name.ck " file...
Read more

Web Applications

-
Image
When did you open your Facebook last time? Have you connected with other people on Linked In? If not then, you might have sent an email... What am I talking about? Image Source That's right! I am talking about Web applications . Web applications are the applications that run over the web or an Internet. There are some differences between website and web applications. Difference between Websites and Web applications.. The main differences between websites and web applications are as under: Websites: Provide information as a static file. Not very much interactive. Don't allow the user to do transactions. For example: news feeds, blogs, images etc. Web applications: Provide dynamic data. Interactive rather than just informative. Allow the user to do transactions. For example: bidding sites, on-line shopping sites, mailing sites, facebook, Twitter and Wikipedia etc. How do they work? On an abstract and simple level, The client(web browser...
Read more