Topic outline

  • WELCOME LETTER

    Dear Students

    Welcome to the Big Data and IoT Theory (CSE 412) &  Lab (CSE 413) courses, I,   Sharun Akter Khushbu will be your co-pilot in this online journey of learning.

    I care about your success in these courses. I'm glad you are here.

    Sharun Akter Khushbu
    Lecturer,
    Department of Computer Science and Engineering,
    Daffodil International University



    Course Instructor


    Name

    Sharun Akter Khushbu
    Designation

    Lecturer, Daffodil International University
    Room Number

    DT - 112
    Email

    sharun.cse@diu.edu.bd
    Contact No

    +880-1679357283


    Course Rationals

    Big Data refers to a massive set of data that no conventional data management tool can handle. Big Data is therefore a concept that allows access to gigantic databases in real time. Big Data's main objectives are to improve a company's or system's responsiveness to a large amount of data collected, increase productivity and refine knowledge of customer behavior, so that it can offer personalized offers or advertisements and create new trends.

    The Internet of Things (IoT) is a concept that connects physical or virtual objects to the internet. The technology very often used is the sensor, allowing to link a physical object such as a watch, a drone or even a speaker, to the internet. If for a long time the few objects connected to the Internet were the telephone and the computer, this is no longer the case today and every year new types of objects incorporating IOT technology are born. IOT is one of the greatest technological revolutions of our era and its potential for exploitation is immense. IOT could have a huge impact on the cars of the future or on the new versions of smart-cities, an urban space connected to the Internet, thus significantly improving the lives of users, while reducing the negative impact of these on the planet. 

    Assessment Plan

    Final Exam
    40
    Mid-term Exam
    25
    3 Class Tests
    15
    Attendance
    07
    Assignment
    05
    Presentation
    08
    Total
    100
  • Week 1

    Introduction

    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
  • Topic 4

    Week 2

    Lab: Installtion of PySpark

  • Week 3

    Introduction to Hadoop

    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
  • Topic 6

    Week 3

    Lab: Introduction to pyspark programming

    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
  • Week 4: Map Reduce and Yarn

    Week 4

    Map Reduce and Yarn

  • Topic 8

    Week 4

    Lab: Introduction to RDD and DataFrame

    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
  • Week 5: Hadoop cluster and ecosystem

    Week 5

    Hadoop cluster and ecosystem

  • Topic 10

    Week 5

    LAb: DataFrames and Spark SQL

    • Due: Thursday, 22 September 2022, 11:59 PM
      View
    • Due: Thursday, 22 September 2022, 11:59 PM
      View
  • Week 6: Mid Term

    Week 6

    MIDTERM

    • Opened: Saturday, 8 October 2022, 11:03 AM
      Closed: Saturday, 8 October 2022, 12:40 PM
    • Opened: Saturday, 8 October 2022, 11:03 AM
      Closed: Saturday, 8 October 2022, 12:40 PM
  • Week 8: Apache Sqoop, Hive and Pig

    Week 8

    Apache sqoop, hive and pig

    • Due: Wednesday, 28 September 2022, 5:30 AM
    • Opened: Saturday, 1 October 2022, 11:00 AM
      Due: Saturday, 8 October 2022, 11:59 PM
    • Due: Wednesday, 28 September 2022, 5:30 AM
    • Opened: Saturday, 1 October 2022, 11:00 AM
      Due: Saturday, 8 October 2022, 11:59 PM
  • Lab-Week 8: IoT Lab

    Week 8

    IoT Lab

    • Week 9: Introduction to IoT

      Week 9

      Introduction to IoT

    • Lab-Week 9-10: Implementing to IoT - 2


      • Week 10: IOT

        Week 10

        M2M and IoT

        • Opened: Saturday, 3 December 2022, 9:10 PM
          Closed: Saturday, 3 December 2022, 10:15 PM
        • Opened: Saturday, 3 December 2022, 9:10 PM
          Closed: Saturday, 3 December 2022, 10:15 PM
      • Week 12: Presentation


      • Week 13: Review Class

        Topic of Discussion

                 Review on the topics of Week 8, Week 9, Week 10, Week 11 and Week 12.




        • Assignment

        • Project Report

        • Presentation