0% found this document useful (0 votes)
10 views2 pages

EECS 836: Introduction to Machine Learning

EECS 836: Machine Learning, taught by Professor Zijun Yao, covers course administration, motivation for studying AI/ML, historical milestones, machine learning tasks, neural networks, and optimization techniques. The course includes lectures, assignments, a team project, and emphasizes academic integrity. Key topics include regression, classification, and the use of loss functions and gradient descent in optimizing machine learning models.

Uploaded by

vinay
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
10 views2 pages

EECS 836: Introduction to Machine Learning

EECS 836: Machine Learning, taught by Professor Zijun Yao, covers course administration, motivation for studying AI/ML, historical milestones, machine learning tasks, neural networks, and optimization techniques. The course includes lectures, assignments, a team project, and emphasizes academic integrity. Key topics include regression, classification, and the use of loss functions and gradient descent in optimizing machine learning models.

Uploaded by

vinay
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Introduction to Machine Learning - EECS 836

1. Course Overview and Administration


Instructor & Schedule:
The course “EECS 836: Machine Learning” is taught by Professor Zijun Yao. It includes
regular lectures (Monday/Friday) with designated office hours, and all class materials
(slides, assignments, projects) are posted on Canvas.

Course Components:
- Lectures: Attend and actively engage.
- Slides & Readings: Review these materials before class.
- Assignments & Exams: Submit on time.
- Team Project: A group project (3–4 students) where you apply machine learning to a real-
world problem.

Grading Policy:
- Components Include: Attendance, assignments, two exams, and a team project.
- Academic Integrity: Cheating is not allowed and similar answers require explanation.

2. Motivation and Future of AI/ML


Why Study Machine Learning?
- AI is expected to create millions of new jobs while transforming industries (e.g.,
healthcare, finance).
- AI might contribute trillions to global GDP in the future.

Definition of AI and Its Subfields:


- AI: The broad science of making machines that can mimic human thinking and behavior.
- ML: A subset of AI focused on building algorithms that learn from data without being
explicitly programmed.
- Deep Learning: A technique within ML that uses neural networks with many layers for
tasks like image or speech recognition.

3. Historical Perspective and Key Milestones


Early AI (Turing Test, 1950): Introduced the idea of testing a machine’s ability to exhibit
intelligent behavior equivalent to humans.
- 1990s: Development of techniques like SVMs and Bayesian networks.
- 1997: Deep Blue (Chess AI) beats a world champion.
- 2010s: Advances like AlexNet, GANs, AlphaGo, and ChatGPT showcase AI’s rapid progress.

4. Machine Learning Tasks and Data Types


Tasks in ML:
- Regression: Predicting a continuous output (e.g., stock prices). Example formula:
y=b+w*x
- Classification: Assigning an input into predefined classes (e.g., spam filtering).

Data Types and Attributes:


- Nominal: Names or labels.
- Binary: Two possible states (0 or 1).
- Ordinal: Ordered values (e.g., small, medium, large).
- Numeric: Continuous (e.g., speed) or discrete values.

5. Neural Networks and Optimization


Neural Networks Basics:
- Consist of layers of interconnected neurons processing input data.
- Key Components: Weights, biases, and activation functions (e.g., Sigmoid function).

Loss Functions and Error Measurement:


- Mean Squared Error (MSE):
L(b, w) = (1/N) * Σ (y_n - ŷ_n)^2
- Mean Absolute Error (MAE): Uses absolute differences instead.

Optimization and Gradient Descent:


- Gradient Descent Formula:
w_new = w_old - η * (∂L/∂w)
where η is the learning rate and ∂L/∂w is the gradient.

6. Summary: Steps in Machine Learning


Step 1: Problem Formulation - Define the type of function needed for the task (e.g.,
classification, regression).
Step 2: Measuring Error - Use a loss function to quantify model performance.
Step 3: Optimization - Adjust model parameters using techniques like gradient descent to
minimize error.

Common questions

Powered by AI

Gradient descent facilitates error minimization by updating model parameters in the direction of the steepest decrease in the loss function, calculated using gradients. Loss functions like Mean Squared Error quantify the model's prediction error, guiding the optimization process to reduce discrepancies between predicted and actual outcomes .

Neural networks are significant in ML due to their ability to process input data through interconnected neurons. Key components include weights, biases, and activation functions, which collectively enable the model to learn from data, identify patterns, and make predictions, forming the backbone for tasks like classification and regression .

AI, particularly machine learning, is expected to create millions of new jobs and transform various industries such as healthcare and finance. It is also projected to contribute trillions to global GDP by improving efficiency and innovation across sectors, thus having a significant economic impact .

Key historical milestones in AI and ML include the Turing Test in 1950, the development of SVMs and Bayesian networks in the 1990s, Deep Blue defeating a chess world champion in 1997, and advances in the 2010s such as AlexNet, GANs, AlphaGo, and ChatGPT, marking rapid progress and innovation .

The 'EECS 836: Machine Learning' course, taught by Professor Zijun Yao, includes lectures, slides, readings, assignments, exams, and a team project. Active engagement and timely submission of assignments and exams are crucial. The grading policy encompasses attendance, assignments, exams, and a team project, with a strong emphasis on academic integrity, prohibiting cheating and demanding explanations for similar answers .

ML tasks include regression and classification. Data types—nominal, binary, ordinal, numeric—affect these tasks by determining the nature of input and its processing requirements. For instance, classification can leverage nominal data for categorical distinctions, whereas regression utilizes numeric data for continuous output predictions .

The team project in the 'EECS 836' course requires groups of 3–4 students to apply machine learning techniques to address a real-world problem. This demand involves collaborative work, integrating learning from lectures and assignments, and developing practical solutions using machine learning algorithms, demonstrating understanding and innovation .

Deep learning, a subset of machine learning, uses neural networks with multiple layers to automatically learn representations, making it particularly suitable for complex tasks like image and speech recognition. It differs by focusing on the depth of learning through multiple network layers, allowing for more intricate data extraction and feature recognition .

Solving an ML problem involves several steps: formulating the problem to determine the function type (e.g., classification), measuring error using a loss function to evaluate performance, and optimizing model parameters with methods like gradient descent to minimize error and enhance accuracy .

Students might face challenges like avoiding plagiarism in code sharing and maintaining originality in problem-solving. They must also ensure their collaborative work in projects does not result in similar outputs that breach integrity standards, necessitating comprehensive understanding and independent contributions to uphold academic ethics .

You might also like