Skip to main content

Posts

Showing posts from April, 2020

14 WAYS OF WRITING A WORD COUNT PROGRAM USING APACHE SPARK

Many of the IT professionals who are working on developing the Spark Applications or the other Engineers / Fresh Graduates who are willing to learn Spark, they will / have to start with the famous WordCount program. In this Article, we'll see in how many ways a Spark WordCount program can be written using Spark's RDD, DataFrame & Dataset APIs and Scala as the programming language. Before we get into the implementation of WordCount Program in Apache Spark, let's have a look at What is Bigdata? What is Big Data Big Data is one of the leading & trending technology in the IT industry, where many organisation are migrating / planning to migrate their projects into it, which deals with huge amounts of data like TeraBytes & PetaBytes at scale. For more info  ClickHere When we talk about Big Data, we always hear about two popular Open Source technologies: Apache Hadoop Apache Spark Apache Hadoop: The Apache Hadoop software library...