UE23MA242A: Mathematics for Computer Science Engineers
Data Science is the study of data. It is about extracting, analyzing, visualizing, managing, and storing data to create insights. This course covers both Descriptive statistics to understand the data and the inferential statistics which seeks to infer something about a population on the basis of a statistical sample and build a simple linear regression model.
Course Objectives:
- Provide insights about the basic roles of a Data Scientist. Develop a greater understanding of the importance of Data Visualization techniques.
- Provide students with knowledge of Random Variables and their Distributions.
- Provide students with knowledge of Confidence Intervals and their importance. Make inferences about the population parameters using sample data and test it to draw meaningful conclusions.
- Provide an understanding on the importance and techniques of predicting a relationship between the two sets of data and determine the goodness of fit model.
Course Outcomes:
- Use Python and other tools to extract, clean and analyze data from several data sources (files, web) analyze an extremely large dataset and perform exploratory data analysis to extract meaningful insights.
- Analyze a real-world problem and solve the same with the knowledge gained from various distribution studies.
- Compute Confidence Intervals.
- Develop and test a hypothesis about the population parameters to draw meaningful conclusions and fit a regression model to data and use it for prediction.
Course Contents:
U1: Applications of Probability Distributions and Principles of Point Estimation
Introduction, Motivating Examples and Scope. Statistics: Introduction, Types of Statistics, Types of Data, Types of Experiments – Controlled and Observational study, Sampling: Sampling Methods, Sampling Errors, Case Study. Chebyshevs inequality, Normal Probability Plots, Introduction to Generation of Random Variates and mention the types, Acceptance-Rejection method, Sampling Distribution, The Central Limit Theorem and Applications, Principles of Point Estimation - Mean Squared Error for Bernoulli, Binomial, Poisson, Normal, Maximum Likelihood Estimate for Bernoulli, Binomial, Poisson, Normal and Case Study. Introduction to multivariate normal distribution, MAP distribution.
Self-Learning: Generation of Random Variates - Inverse Transform Method.
Confidence Intervals: Interval Estimates for Mean of Large and Small Samples, Students t Distribution, Interval Estimates for Proportion of Large and Small Samples, Confidence Intervals for the Difference between Two Means, Interval Estimates for Paired Data. Factors affecting Margin of Error, Hypothesis Testing for Population Mean and Population Proportion of Large and Small Samples, Drawing conclusions from the results of Hypothesis tests, Case Study.
Self-Learning: Confidence interval for difference between two proportions. Applications:
- t-distribution, confidence interval, students’ performance analysis based on hours of study
- z-test, application form processing in banking system.
- Hypothesis testing, randomly trained students placement into tier-I and tier-II companies
Unit 3: Distribution Free Tests and Multiple Linear Regression
Distribution Free Tests, Chi-squared Test, Fixed Level Testing, Type I and Type II Errors, Power of a Test, Factors Affecting Power of a Test. Simple Linear Regression: Introduction, Correlation, the Least Square Lines, Predictions using regression models - Uncertainties in Regression Coefficients, Checking Assumptions and transforming data, Introduction to the Multiple Regression Model, Case Study.
Self-Learning: F test for equality of Variance. Applications:
- Linear regression, stock market prediction
- using Chi-Square Test, Analyzing the association between vaccination and recovery of the patients considering COVID data.
- Chi-Square Test and Test of Independence, Analyzing the relationship between gender and preference for a product purchase.
- Identifying Type 1 and Type 2 Errors in Spam mail classification.
Unit 4: Engineering Optimization
Introduction to Optimization-Based Design, Modelling Concepts, Unconstrained Optimization, Discrete Variable Optimization, Genetic and Evolutionary Optimization, Constrained Optimization.
Self-Learning: Mathematical concepts of objective function, Constraints and Decision variables.
Applications:
- Minimize a Loss functions in Neural Networks using Batch gradient descent (Unconstrained Optimization).
- Lagrange Multipliers to find local maxima and minima of a function subject to equations constrains (Constrained Optimization).
- Case study on Bayesian Optimization with Discrete Variables (Discrete Variable optimization).
- Use Genetic Algorithms to optimize Production Scheduling in a manufacturing environment, focusing on minimizing total production costs while meeting job deadlines and machine constraints. Evaluate the GA’s effectiveness against traditional scheduling methods.