Optimization is not just about finding a good answer. It is about finding a better answer than the one you have now. The hard part is knowing whether your current “best” is truly best, or just locally good. Core Idea Optimization is the process of improving a solution according to some objective. You start with a candidate solution. You measure how good it is. Then you search for a better one. That sounds simple. But the search space can be huge. And the best nearby solution may not be the best overall solution. The Key Structure A simple optimization loop looks like this: Candidate Solution → Evaluate Score → Explore Neighbor → Accept or Reject → Repeat More compactly: Optimization = search space + objective function + update strategy The objective function tells you what “better” means. The update strategy tells you how to move.…