Web Scraping : Urdu News

-

Web scraping is an amazing method to collect data. Many data scientist use this method. I have scrape Urdu news. Urdu is difficult to scrape but thanks to Python and its libraries. Have a look at the code and outputs below:


Comments

Post a Comment

Popular posts from this blog

Data Modeling

-
Image
source: https://searchdatamanagement.techtarget.com/definition/data-modeling A wise person once said a picture is worth a thousand words . In real-world data is not just a few rows of excel sheet, yet it comprises several billion rows expanded through hundreds  of tables. A table is usually made up of rows and columns. Each table represents an Entity . Entity means an Object or thing. That Entity has several properties called Attributes . Those attributes represent the qualities or characteristics of the entity. Since there is more than one entity, so there should be a Relationship between those entities. If we look at the tables we cannot get a clear idea of the relationship between several tables/Entities. Hence, we need to represent the tables/data in the form of a picture or a flow graph. That flow graph or Entity-Relationship diagram is called a Data Model .  Data Modeling is a technique to represent how the tables are related to each other and to represent the s...
Read more

Relational Data Model

-
Image
In the previous blog post, we covered Data Modeling. We have seen that data modeling is really important before jumping into predictive modeling.  In this article, we will cover the Relational Data Model (RDM). Let's start from the very basics, relational means anything which is linked with some other thing. This link is called "Relationship". In RDM or RM there are major three types of relationship cardinalities (also called Multiplicities or Cardianalities): 1. One to one 2. One to many 3. Many to many We can understand these with the help of a few simple examples;  One to one: One department has one manager. One to many: One class has many students. Many to many: Many teachers can teach many students. Okay, so we have got an abstract overview of the term " Relational ", now the next thing is " Data ", data covers everything, anything... And finally, " Model " means something in the form of a template, design, a kind of blueprint.  To store...
Read more

Pintos : Series : Part3 : Project 1 : Alarm Clock

-
Image
The PintOS project has 27 test cases that we need to pass. In the first project we are just going for the five test cases related to alarm clock that are as under: alarm_multiple alarm_single alarm_simultaneous alarm_negative alarm_zero But before jumping into the code, let's first understand the basic structure of PintOS and how it runs. Consider the following diagram: Here QEMU is an emulator on which pintOS runs. Test cases are the processes that we run on the PintOS (Operating System). So we only need to modify the PintOS code, we are not allowed to make any change to the test cases code as this would be a cheating. When you open up the PintOS directory, in tests/threads/tests.c all the test cases are declared. And in the tests/threads/ directory you can observe files with the extension " .ck " and " .c ". So the " test_Name.c " files are the files in which test cases are defined, while " test_Name.ck " file...
Read more

Data Engineering Tools

-
Image
   Data is a new oil. To channelize this data we need proper pipelines. These pipelines are mostly called ETL or data pipelines.  There are various tools out there to work out these Extract, Transform, and Load (ETL) operations.  Some of the scripting tools are:  - Python - SQL and NoSQL Apache provides a wide range of products that can be used as Data Engineering tools.  Some of the amazing apache DE services comprised of; - Hadoop - Spark - Kafka - Cassandra - Hive In addition, some cool DE tools are: - Tableau - Talend - MapReduce These DE tools provide a way to manage the data pipelines in a more effective, efficient, and better way.  Almost every Data-Oriented company in the corporate sector is highly dependent upon these technologies. They are leveraging many of the above-mentioned mechanisms for promising Data Services and Architecture. That's it for today. Hope you have enjoyed this article. If you want to know more about data or software relat...
Read more

Applications of Data Engineering

-
Image
In a previous blog post about data engineering, we went through several many concepts related to data engineering such as data modeling, and then we went through different types of databases, for example, relational databases and we also got a glimpse of relational as well as NoSQL databases. And in today's blog post we will be writing about data engineer applications. Which are basically the use cases of data engineering 1st let's see what data engineering applications mean; so basically when we have data and we have engineered it then there are several things that we can do with that data and these things that we can do with processed data are the use cases of the data engineering. For example: If we have filled our containers with the data then it's not of any good use if it is not clean and well-formed. If your data is well-formed and if there are no logical mistakes, missing values, and garbage then we can easily perform the use cases and applications of data enginee...
Read more

1-Machine Learning : Start...

-
Image
John went to the cafeteria 10 times at 1:00 P.M. on 10 Fridays, each time the cafeteria was closed at that particular time. John decided not to go to cafe at 1:00 P.M. on Friday because the cafe will be closed.  But wait! How did John know that the cafe will  also be closed on next Friday at 1:00 P.M.??? Yes, you are absolutely right.  "John Learned from his Experience that the Task of going to the cafeteria at 1:00 P.M. on Fridays resulted in waste of time, since the cafe was closed on each Friday, so it will Perform the same on the next Friday." In the above scenario, John learned something so we can call it " John Learning ". Similarly, if we replace John with some sort of Machine, that can learn from the Experience or from the History about how the tasks were performed in the past given certain situation. Such that the Machine will perform the same if the same task happen again in near future. Then this will be called as Machine Learning. To mak...
Read more

LINUX Kernel

-
Image
Back in the 18th century UNIX was developed. UNIX is said to be a mother of all the operating systems. LINUX is also based on UNIX. The best things about LINUX are: It is open source. It is totally FREE. One can modify it for customized usage. One can create ones own OS (Operating System) on Linux bases. It is more secure than Windows. If you have Linux, then you don't need to have any anti-virus. Linux has many applications, like windows. It's been improved in many years. It is the most favorite OS of developers.  and so on... to be continued....
Read more

Programming android applications

-
Image
2 USEFUL PROGRAMMING ANDROID APPLICATIONS P rogramming is an art but it needs a lot of practice, and those who have to travel a lot find it very difficult to practice programming, so there is a need of portable mobile applications to get better programming skills, so here I would like to share 2 apps that are useful in this regard: SoloLearn This application is recommended to me by one of my friends, I am very excited to have this application and it makes my learning so fun and interesting. So without any delay just get this free amazing application. HTML Code Play Web development is the most fun task to do, and  HTML Code Play  makes this task easier and faster then ever.  so dear programmers, why are you waiting? go and get these applications on your android mobile phones, and make your programming fluent like your native language  :) Note: ALL IMAGES ARE FROM GOOGLE.
Read more

Pintos : Series : Part 1 : Installation

-
Image
PintOS is an Operating system, but this is not a complete OS. There are many kernel level functions implemented but we need to modify it to implement it correctly. So, if you are taking OS course or interested in Operating Systems then you can follow my PintOS Series. As installation of PintOS is the most important and tedious task, so we need to do it first! Actually I have learnt about the installation steps from various sites, I will share their links side by side. What I grasped from there, I will compose it into this post. I know you might be thinking if the installation steps are already available on-line, then why am I writing them for you? The reason for this is that, when I installed PintOS, I found a lot of problems initially but then it worked. So, what I understood from my experience and from the sites, I will share that. I believe that if learning is done through mutual cooperation,  then this will benefit everyone . So, let's learn together.... First Mist...
Read more

E-Commerce : Platforms

-
Image
Before digging into E-commerce platforms, let's first understand what an E-commerce actually is? E-Commerce... According to the Tokenization Rule , E-commerce is the combination of "E" and "Commerce".  The word Commerce means trade or buying and selling of items, goods, services, hardwares and, softwares... etc. And " E " stands for "Electronic", electronic means something like electricity, like signals, like something in the form of electrons (at lower level).  Image Source So, the word " E-COMMERCE " means: " A type of trade, that is done using electronic devices (computer, mobile or ATM machines etc). "   And to achieve electronic commerce, what's the most important thing? think over it!  Yeah that's correct! your own Internet is the most important thing to do E-commerce.  Major areas of E-commerce are: On-line shopping or retailing On-line bidding or auction On-line soft...
Read more