Google Professional ML Engineer Exam Guide
Google Professional ML Engineer Exam Guide
To architect a machine learning workflow that automatically starts a training job on Google Kubernetes Engine (GKE) when new data is available in Google Cloud Storage, you should configure a Cloud Storage trigger to send a message to a Pub/Sub topic. This message can then trigger a Cloud Function, which initiates the training job on a GKE cluster. This approach leverages Pub/Sub to detect new data and automatically start the downstream processes necessary for training the model .
A Slurm workload manager might be inadequate for handling a cloud-based machine learning setup with various frameworks because it is primarily designed for HPC environments and could struggle with the flexibility and scalability demands of diverse ML frameworks used in a cloud environment. Alternative solutions like custom containers on AI Platform are better suited for adapting to various frameworks and distributed training needs .
When experiencing difficulties with gradient optimization due to varying scales of features in a neural network project, the representation transformation technique, such as normalization, should be used. Normalization scales the feature ranges and helps in improving the convergence of the gradient descent algorithm .
When new products are introduced, a company should replace its test dataset with images of the newer products for retraining the ML models. This ensures that the models are trained and evaluated on the most current data, improving accuracy in identifying new products .
To train a custom neural network using Google's AI Platform when the ML framework and dependencies are unsupported, you should build and use custom containers for your training jobs. This allows you to package the specific dependencies and configurations required for your training setup, ensuring compatibility and resource efficiency on AI Platform .
To manage diverse machine learning frameworks in a cloud-based backend system, using the AI Platform custom containers feature is an effective strategy. This allows for receiving training jobs using any framework by encapsulating them in containers, facilitating ease of management and scalability .