Topic outline

  • Welcome to Bigdata and IOT course

    Daffodil International University

    Department of Computer Science and Engineering (CSE)

    OBE Course Outline

    Course Code:

    CSE412

    Course Title:

    Bigdata and IOT 

    Program:

    B.Sc. in CSE

    Faculty:

    Faculty of Science and Information Technology (FSIT)

    Semester:

    Spring 2024

    Year:

    2024

    Credit:

    3

    Contact Hour:

    3hr/week

    Course Level:

    L3T2

    Prerequisite:

    CSE322

    Course Category:

    Core Engineering

    Instructor Name:

     Dr. Fizar Ahmed

    Designation:

    Associate Professor

    Email:

    fizar.cse@diu.edu.bd

    Office Address:

    301, AB-4, Daffodil Smart City, Ashulia.

  • Week-1

    IOT Introduction

    ·         Concepts and Definitions of The Internet of Things (IOT).

    ·         History of IOT

    ·         Requirements, Functionalists and structure of IOT.

    ·         IOT enabling technologies.

    ·         IOT Architecture.

    ·         Major component of IOT(Hardware & Software).

    ·         IOT communication and networking protocols, Role of wired and wireless communication.

    ·         IOT services and applications.

    ·         IOT Standards, Connectivity

    Lab works

    List of IOT Experiments: Experiments using NodeMCU/ Arduino

    Basic IoT setup with Arduino/NODEMCU
    What is ESP8266 node-MCU, Hardware Knowledge, Hand Shake with ESP8266, Developing the Environment, Overview about the board and IDE

  • Week-2

    IOT Case Studies

    ·         Project Case Study

    ·         Project Requirement (hardware & software)

    ·         How to Design IOT Application (Web, Mobile, Device)

    ·         Projects on every technology (At least 4 Project)

              Data generator


    Lab works:
    Distance Measurement of an object:
    Calculate the distance to an object with the help of an ultrasonic sensor and display it on an LCD


    • Week-3

      IOT Data Acquisition and Platforms

      ·         Micro Controllers (Arduino uno/mega2560, Raspberry-Pi, ARM), Real-time systems and embedded software

      ·         OS and Drivers (End Device Program)

               Hardware & Software Requirements.


      Lab Works:
      LDR Sensor, Alarm and temperature, humidity measurement:

      (a)Controlling relay state based on ambient light levels using LDR sensor.

      (b)Basic Burglar alarm security system with the help of PIR sensor and buzzer.

      (c)Displaying humidity and temperature values on LCD

    • Week-4

      IOT Data Communication

      ·         How to transfer data by Wireless / Wired connectivity.

      ·         Ipv4/Ipv6, Ethernet/GigE.

      ·         MIPI, M-PHY, UniPro, SPMI, BIF, SuperSpeed USB Inter-Chip (SSIC), Mobile PCIe (M-PCIe) and SPI

      ·         GSM, 2g ,3g ,4g & 5g

      ·         IEEE 802.15.4, IEEE 802.15.4e, 802.11ah

      ·         Relay Access Point (AP)

      ·         Grouping of station

               Target Wake Time (TWT)


      Lab Works:
      Experiments using Raspberry Pi / Arduino

      (a)Controlling relay state based on input from IR sensors 

      (b)Interfacing stepper motor with R-Pi

      (c)Advanced burglar alarm security system with the help of PIR sensor, buzzer and keypad. (Alarm gets disabled if correct keypad password is entered)

      (d)Automated LED light control based on input from PIR (to detect if people are present) and LDR (ambient light level)

    • Week-5

      Introduction to Bigdata

                   What is big data How is big data different from traditional data sources?

                   Small data vs Big data Attributes of big data

      Lab Works:

      Create User in IOT Cloud
      Data Transfer to IOT Cloud

    • Week-6

      Bigdata Analytics

      ·       What is big data analytics Life cycle of big data analytics

      ·       Types of big data analytics

              Tools used in big data analytics Big data application domains

      Lab Works:

      Basic uses of dataset:

      Install, configure and run python, numPy and Pandas. 

      Visualize data using basic plotting techniques in Python.

    • Week-7

      Revision for Mid Term Exam

      • Week-8

        Mid Term Examination

        • Week-9

          Bigdata Tools

          ·       Why Hadoop comes (Problems regarding RDBMS and DataWarehouse) What is Hadoop History of Hadoop         Examples of commercial distribution company for Hadoop

          ·       Basic Introduction to Hadoop components Introduction to Masternode, Slavenode & Self-healing

          ·       What is DFS and HDFS File Block and Replication Rack HDFS Architecture HDFS File Read Operation

                 HDFS Write Read Operation Rack Awareness

          Lab Works:

          Bigdata tools:

          Install, configure and run Hadoop and HDFS.

        • Week-10

          Bigdata Tools

          ·       Why Hadoop comes (Problems regarding RDBMS and Data Warehouse) What is Hadoop History of Hadoop  Examples of commercial distribution company for Hadoop

          ·       Basic Introduction to Hadoop components Introduction to Masternode, Slavenode & Self-healing

          ·       What is DFS and HDFS File Block and Replication Rack HDFS Architecture HDFS File Read Operation

          HDFS Write Read Operation Rack Awareness

        • Week 11

          Map Reduce

          ·       What is Hadoop MapReduce MapReduce in Nutshell Advantages of MapReduce Hadoop MapReduce Approach with an example Hadoop 1.1

                  Limitations of Hadoop 1.1 Need for yarn Hadoop 2.0 Hadoop MapReduce Yarn Components Yarn Architecture Yarn Working flow

        • Week 12

          Hadoop Cluster

          ·       What is Hadoop Cluster Hadoop Cluster Architecture Size of Hadoop Architecture Single Node and Muti-Node Cluster

          ·       Communication Protocol in Hadoop Cluster Benefits of Hadoop Cluster Challenges of Hadoop Cluster Hadoop Ecosystem

          Concept, Apache sqoop, Apache flume, Apache pig, Apache hive,

        • Week-13

          Data Storage and Retrieval

          ·       Overview and Role of Storage in Cloud / Server /Inhouse Storage.

          ·       Databases Connectivity with IOT and uses .

          ·       Case Study over Mysql / NoSql / NewSql .

          ·       Case Study over Cloud Services And Administration.

          Case Study Of Big Data & Hadoop Platforms.

          • Week-14

            Data Analysis and Visualization

            ·       Analysis Of data using python Module.

            ·       Visualization and interpretation of Data.

                     Data Cleaning in IOT

            • Week-15

              IOT and Bigdata Security

              ·       Attack, Défense, and Network Robustness of Internet of Things

              ·       Malware Propagation and Control in Internet of Things

              ·       Privacy Preservation Data Dissemination

              ·       Trust and Trust Models for the IoT

              ·       Authentication in IoT

              ·       Computational Security for the IoT

              ·       Security Protocols for IoT Access Networks

                       Security Testing

            • Week-16

              Projects

              Project with showcasing: IOT and Bigdata Product Development & Testing

            • Week-17

              Final Exam