Support Vector Machines (SVM) are supervised learning models used for classification and regression tasks. They work by finding the hyperplane that best separates data points of different classes in a high-dimensional space. The goal is to maximize the margin between the closest data points of each class, known as support vectors.