Web scraping is an amazing method to collect data. Many data scientist use this method. I have scrape Urdu news. Urdu is difficult to scrape but thanks to Python and its libraries. Have a look at the code and outputs below:
In a previous blog post about data engineering, we went through several many concepts related to data engineering such as data modeling, and then we went through different types of databases, for example, relational databases and we also got a glimpse of relational as well as NoSQL databases. And in today's blog post we will be writing about data engineer applications. Which are basically the use cases of data engineering 1st let's see what data engineering applications mean; so basically when we have data and we have engineered it then there are several things that we can do with that data and these things that we can do with processed data are the use cases of the data engineering. For example: If we have filled our containers with the data then it's not of any good use if it is not clean and well-formed. If your data is well-formed and if there are no logical mistakes, missing values, and garbage then we can easily perform the use cases and applications of data enginee...
To let you know a few useful things, I asked some experienced people, and here is what they have for you... Be open to changes. Focus on improving your soft / people skills. It will be hard sometimes but believe in yourself. You have got it. ( Rahat-Undergraduate ) Try to do good in quizzes and OHTs (One hour test or mids) cause when finals don't go well, these can help in getting good gpa which are comparatively easy then finals. ( Ayesha Munir-Undergraduate ) A few years later when you would look back at this time, GPA won't make you happy, but the memories of these 4 years will. Your career is important but so is having a good time. So work hard, party harder! ( Haris-Undergraduate ) From the start try to build your connections with seniors because they know more than you and.. are best counselors.. Focus on your quizzes and assignments because they are the building blocks of your Grade.. Your Good Image play some important part for favoritism points in exam....
As we have learned much of the basics of HTML and CSS . Let us now learn how can we make our web applications more user friendly, flexible and versatile, using php . Today we will see how to make a chess board using php in collaboration with HTML and CSS . So, Let's start: BASIC php SYNTAX: Starting Closing Tags: <?php ?> Php code must be written in these tags. Variables: Start with "$" sign e.g. $num=3; ; is really important to put after every statement. Functions: Functions start with the keyword "function". E.g. function power(){} Print: echo "printing by using echo"; echo ("printing by using echo"); print "pri...
Data is a new oil. To channelize this data we need proper pipelines. These pipelines are mostly called ETL or data pipelines. There are various tools out there to work out these Extract, Transform, and Load (ETL) operations. Some of the scripting tools are: - Python - SQL and NoSQL Apache provides a wide range of products that can be used as Data Engineering tools. Some of the amazing apache DE services comprised of; - Hadoop - Spark - Kafka - Cassandra - Hive In addition, some cool DE tools are: - Tableau - Talend - MapReduce These DE tools provide a way to manage the data pipelines in a more effective, efficient, and better way. Almost every Data-Oriented company in the corporate sector is highly dependent upon these technologies. They are leveraging many of the above-mentioned mechanisms for promising Data Services and Architecture. That's it for today. Hope you have enjoyed this article. If you want to know more about data or software relat...
John went to the cafeteria 10 times at 1:00 P.M. on 10 Fridays, each time the cafeteria was closed at that particular time. John decided not to go to cafe at 1:00 P.M. on Friday because the cafe will be closed. But wait! How did John know that the cafe will also be closed on next Friday at 1:00 P.M.??? Yes, you are absolutely right. "John Learned from his Experience that the Task of going to the cafeteria at 1:00 P.M. on Fridays resulted in waste of time, since the cafe was closed on each Friday, so it will Perform the same on the next Friday." In the above scenario, John learned something so we can call it " John Learning ". Similarly, if we replace John with some sort of Machine, that can learn from the Experience or from the History about how the tasks were performed in the past given certain situation. Such that the Machine will perform the same if the same task happen again in near future. Then this will be called as Machine Learning. To mak...
I don't know what should be the title of this blog post, but let's call it " A survey of the final year university students ". Pretty long title, huh? Okay, let me tell you about this survey... The story behind this thing: Well, one day I thought about writing a post on Facebook to ask people about their sentiments and reviews regarding the final year of university life, then another thought knocked my head to write a full blog post on this topic. Then I disseminated a google form for this purpose. The google form was saying: "Hello, final semester people! I thought to collect reviews of 2020 graduates specifically of NUST and other IT universities. I am planning to add these to my blog post. Please take a few seconds to fill this form, thank you." So that was a brief story behind this whole thing, Now let's have a look at the most awaited questions and the corresponding responses... Question#1: Do you feel like a better hu...
In this blog post, we will be done with our Pintos Project #1 and this Pintos Series AlhumdullillAllah. so let's start... In the previous posts of this series, we have looked at the problem that is of busy waiting. To solve this problem I took help from code written by other people on Github, so to learn it deeper you can get to look at this code, by Muhammad Zaheer . The basic modification is done in two files i.e. timer.c and thread.h; ALARM CLOCK IMPLEMENTAIONS ========================== Changes in timer.c: - A global list of sleeping threads is created as: -static struct list sleep_list; Changes in thread.h: - For keeping track of a sleeping thread when woken up, we declared: -int64_t sleep_time; - When a thread calls timer_sleep(), it gets into the sleep list as: -struct list_elem sleep_list_elem Algorithms Used ...
The PintOS project has 27 test cases that we need to pass. In the first project we are just going for the five test cases related to alarm clock that are as under: alarm_multiple alarm_single alarm_simultaneous alarm_negative alarm_zero But before jumping into the code, let's first understand the basic structure of PintOS and how it runs. Consider the following diagram: Here QEMU is an emulator on which pintOS runs. Test cases are the processes that we run on the PintOS (Operating System). So we only need to modify the PintOS code, we are not allowed to make any change to the test cases code as this would be a cheating. When you open up the PintOS directory, in tests/threads/tests.c all the test cases are declared. And in the tests/threads/ directory you can observe files with the extension " .ck " and " .c ". So the " test_Name.c " files are the files in which test cases are defined, while " test_Name.ck " file...
Back in the 18th century UNIX was developed. UNIX is said to be a mother of all the operating systems. LINUX is also based on UNIX. The best things about LINUX are: It is open source. It is totally FREE. One can modify it for customized usage. One can create ones own OS (Operating System) on Linux bases. It is more secure than Windows. If you have Linux, then you don't need to have any anti-virus. Linux has many applications, like windows. It's been improved in many years. It is the most favorite OS of developers. and so on... to be continued....
your post is simply amazing and informative i recommend to read and bookmark for my blog ,
ReplyDeleteSoftware Development Company Islamabad
Thank you !
Deletenice post,
ReplyDeletepython online training
python training