W8_L3: Solving an unconstrained optimization problem | part 1

Описание: Welcome to Week 8 Lecture 3 of the course "Machine Learning Foundations" by Profs. Harish Guruprasad Ramaswamy, Arun Rajkumar, and Prashanth LA.
Full Course: https://study.iitm.ac.in/ds/course_pa...

Video Overview
In this lecture, we begin our study of solving optimization problems by focusing on the simplest case: unconstrained optimization. We start with a concrete example, applying the derivative-based approach and discussing its limitations.
Next, we move to an iterative method suited for computer-based problem solving, where we choose a direction and update the current guess. By analyzing a simple function minimization, we highlight one of the key challenges in optimization—step size—and conclude by pointing out what should be done to overcome this challenge.

About IIT Madras' online Bachelor of Science programme
IIT Madras offers four-year BS programmes that aim to provide quality education to all, irrespective of age, educational background, or location. The BS programme has multiple levels, which provide flexibility to students to exit at any of these levels. Depending on the courses completed and credits earned, the learner can receive a Foundation Certificate from IITM CODE (Centre for Outreach and Digital Education), Diploma(s) from IIT Madras, or BSc/BS Degrees from IIT Madras.
For more details, Visit: https://www.iitm.ac.in/academics/stud...

#optimization #unconstrainedoptimization #gradientdescent #iterativemethods #algorithms #derivatives #stepsize #machinelearning #minimization #problemsolving #calculus #machinelearningfoundations