Data Science and Big Data

Data Science and Big Data

1 Introduction to Data Science

  1. Data Science – Definition
  2. Types of Data
  3. Statistical Data Types
  4. Sampling
  5. Basic Methods of Data Analysis
  6. Common Misconceptions of Data Analysis
  7. Applications of Data Science
  8. Data Science Life cycle

2 Portability and Statistics for Data Science

  1. Probability
  2. Conditional Probability
  3. Random Variables and Basic Distributions
  4. The Normal Distribution
  5. Sampling Distribution and the Central Limit Theorem
  6. Statistical Hypothesis Testing
  7. Types of Errors in Hypothesis Testing

3 Data Preparation for Analysis

  1. Need for Data Preparation
  2. Data preprocessing
  3. Data Cleaning
  4. Data Integration
  5. Data Reduction
  6. Data Transformation
  7. Selection and Data Extraction
  8. Data Curation
  9. Data Integration
  10. Knowledge Discovery

4 Data Visualization and Interpretation

  1. Histograms
  2. Box plots
  3. Scatter plots
  4. Heat map
  5. Bubble chart
  6. Bar chart

5 Big Architecture

  1. Big Data and Characteristics
  2. Big data Applications
  3. Structured vs semi-structured and unstructured data
  4. Big Data Vs data warehouse
  5. Distributed file system
  6. HDFS and Map Reduce
  7. Apache Hadoop 1 and 2 (YARN)

6 Programming Using Mapreduce

  1. Map Reduce Operations
  2. Loading data into HDFS
  3. Executing the MapReduce phases
  4. Algorithms using MapReduce

7 Other Big data Architectures and Tools

  1. Apache SPARK Framework
  2. HIVE
  3. HBase
  4. Other Tools

8 NoSQL Database

  1. Introduction to NoSQL
  2. Types of NoSQL Databases
  3. Column based
  4. Graph based
  5. Key-value pair based
  6. Document based

9 Mining Big Data

  1. Finding Similar Items
  2. Finding Similar Sets
  3. Finding Similar Documents
  4. Distance Measures
  5. Introduction to Other Techniques

10 Mining Data Streams

  1. Data Streams
  2. Data Stream Management
  3. Queries of Data Stream
  4. Examples of Data Stream and Queries
  5. Issues and Challenges of Data Stream
  6. Data Sampling in Data Streams
  7. Bloom Filter
  8. Algorithm to Count Different Elements in Stream

11 Link Analysis

  1. Introduction to Link Analysis
  2. Page Ranking
  3. Different Mechanisms of Finding PageRank
  4. Web Structure and Associated Issues
  5. Use of PageRank in Search Engines
  6. Spider Trap and Dead End Problems
  7. PageRank Computation using MapReduce
  8. Topic Sensitive PageRank
  9. Link Spam
  10. Hubs and Authorities

12 Web and Social Network Analysis

  1. Web Analytics
  2. Advertising on the Web
  3. Recommendation Systems
  4. Mining Social Networks

13 Basic of R Programming

  1. Environment of R
  2. Data types, Variables, Operators, Factors
  3. Decision Making, Loops, Functions
  4. Data Structures in R

14 Data Interfacing and Visualisation in R

  1. Reading Data From Files
  2. Data Cleaning and Pre-processing
  3. Visualizations in R

15 Data Analysis and R

  1. Chi-Square Test
  2. Linear Regression
  3. Multiple Regression
  4. Logistic Regression
  5. Time Series Analysis

16 Advance Analysis Using R

  1. Decision Trees
  2. Random Forest
  3. Classification
  4. Clustering
  5. Association rules