100% Latest & Updated Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test Questions, Exam Dumps & Verified Answers!
30 Days Free Updates, Instant Download!
Amazon AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Test 48
Question 470
During a production readiness audit, three independent ML pipeline behaviors must be verified. Workstream A: A lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. Workstream B: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. Workstream C: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. Select exactly THREE observations, one diagnostic that directly tests each workstream.
- Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
- Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
- Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
Explanation
Correct Answers
A:This evidence directly tests the reported behavior: Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds. For this case, a product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The results tell the team whether to apply the targeted change: Run a controlled SageMaker endpoint A/B traffic experiment with per-variant business metrics.
B:This evidence directly tests the reported behavior: Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts. For this case, a lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. The results tell the team whether to apply the targeted change: Run supported Clarify bias monitoring on production predictions with an approved analysis design.
D:This evidence directly tests the reported behavior: Inspect the recent error series and the retraining pipeline's approval and evaluation stages. For this case, a price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. The results tell the team whether to apply the targeted change: Trigger a SageMaker Pipeline retraining candidate when a validated performance alarm fires.
Incorrect Answers
C:That alternative addresses a different task: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The selected workloads instead require Protected subgroup bias monitoring, A B variant measurement, Controlled drift retraining.
E:That alternative addresses a different task: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. The selected workloads instead require Protected subgroup bias monitoring, A B variant measurement, Controlled drift retraining.
F:That alternative addresses a different task: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. The selected workloads instead require Protected subgroup bias monitoring, A B variant measurement, Controlled drift retraining.
Question 471
During a production readiness audit, three independent ML pipeline behaviors must be verified. Workstream A: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. Workstream B: An ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. Workstream C: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. Select exactly THREE observations, one diagnostic that directly tests each workstream.
- Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls.
- Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
- Inspect the production model's response and the independently captured shadow predictions for the same requests.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts.
Explanation
Correct Answers
C:This evidence directly tests the reported behavior: Inspect the production model's response and the independently captured shadow predictions for the same requests. For this case, an ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. The results tell the team whether to apply the targeted change: Use SageMaker shadow testing with mirrored requests and separate candidate metrics.
D:This evidence directly tests the reported behavior: Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing. For this case, a customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. The results tell the team whether to apply the targeted change: Monitor actual labeled production performance over time and compare it with the accepted validation baseline.
E:This evidence directly tests the reported behavior: Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window. For this case, an endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The results tell the team whether to apply the targeted change: Monitor and correlate SageMaker endpoint error metrics with inference-container logs and request metadata.
Incorrect Answers
A:That alternative addresses a different task: A regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. The selected workloads instead require Labeled performance degradation, Shadow candidate validation, Endpoint invocation error diagnosis.
B:That alternative addresses a different task: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. The selected workloads instead require Labeled performance degradation, Shadow candidate validation, Endpoint invocation error diagnosis.
F:That alternative addresses a different task: A lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. The selected workloads instead require Labeled performance degradation, Shadow candidate validation, Endpoint invocation error diagnosis.
Question 472
During a production readiness audit, three independent ML pipeline behaviors must be verified. Workstream A: After a pipeline change, an online predictor starts receiving null values in a previously required numeric feature and returns elevated errors. Workstream B: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. Workstream C: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. Select exactly THREE observations, one diagnostic that directly tests each workstream.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
- Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
- Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
- Inspect captured inference payloads, schema validation failures, and endpoint 4xx/5xx trends.
Explanation
Correct Answers
D:This evidence directly tests the reported behavior: Inspect the latency distribution including ModelLatency and request-level p95 where instrumented. For this case, an API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. The results tell the team whether to apply the targeted change: Monitor a suitable high-percentile end-to-end inference latency measure with a tested alert.
E:This evidence directly tests the reported behavior: Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions. For this case, a data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. The results tell the team whether to apply the targeted change: Create a CloudWatch alarm for monitored data-quality violations and route alerts through an approved notification channel.
F:This evidence directly tests the reported behavior: Inspect captured inference payloads, schema validation failures, and endpoint 4xx/5xx trends. For this case, after a pipeline change, an online predictor starts receiving null values in a previously required numeric feature and returns elevated errors. The results tell the team whether to apply the targeted change: Validate production feature types and required fields before invoking the deployed model.
Incorrect Answers
A:That alternative addresses a different task: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. The selected workloads instead require Feature schema serving break, Actionable drift alert, Inference latency alert.
B:That alternative addresses a different task: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The selected workloads instead require Feature schema serving break, Actionable drift alert, Inference latency alert.
C:That alternative addresses a different task: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The selected workloads instead require Feature schema serving break, Actionable drift alert, Inference latency alert.
Question 473
During a production readiness audit, three independent ML pipeline behaviors must be verified. Workstream A: A regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. Workstream B: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. Workstream C: An existing SageMaker Model Monitor customer sees production insurance transaction amounts diverge markedly from its training baseline. Select exactly THREE observations, one diagnostic that directly tests each workstream.
- Inspect SageMaker Model Monitor feature quality reports against an approved training baseline.
- Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
- Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls.
Explanation
Correct Answers
A:This evidence directly tests the reported behavior: Inspect SageMaker Model Monitor feature quality reports against an approved training baseline. For this case, an existing SageMaker Model Monitor customer sees production insurance transaction amounts diverge markedly from its training baseline. The results tell the team whether to apply the targeted change: Configure SageMaker Model Monitor to capture and compare incoming feature distributions with the baseline.
B:This evidence directly tests the reported behavior: Inspect the recent error series and the retraining pipeline's approval and evaluation stages. For this case, a price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. The results tell the team whether to apply the targeted change: Trigger a SageMaker Pipeline retraining candidate when a validated performance alarm fires.
F:This evidence directly tests the reported behavior: Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls. For this case, a regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. The results tell the team whether to apply the targeted change: Enable appropriately scoped SageMaker Data Capture for endpoint requests and predictions.
Incorrect Answers
C:That alternative addresses a different task: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. The selected workloads instead require Inference data capture audit, Controlled drift retraining, Feature distribution drift.
D:That alternative addresses a different task: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The selected workloads instead require Inference data capture audit, Controlled drift retraining, Feature distribution drift.
E:That alternative addresses a different task: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The selected workloads instead require Inference data capture audit, Controlled drift retraining, Feature distribution drift.
Question 474
Before making a production change, an engineer must investigate this condition: A newly deployed recommender has no accepted reference statistics, so the team cannot tell whether future feature shifts are significant. Which diagnostic observation most directly evaluates the reported condition?
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
- Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts.
- Inspect a clean representative baseline dataset and generated feature statistics/constraints.
Explanation
Correct Answer
D:This evidence directly tests the reported behavior: Inspect a clean representative baseline dataset and generated feature statistics/constraints. For this case, a newly deployed recommender has no accepted reference statistics, so the team cannot tell whether future feature shifts are significant. The results tell the team whether to apply the targeted change: Generate and approve baseline statistics and constraints before enabling automated monitoring schedules.
Incorrect Answers
A:That diagnostic measures a different AWS ML behavior: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. It cannot establish the main condition: A newly deployed recommender has no accepted reference statistics, so the team cannot tell whether future feature shifts are significant. The decisive evidence for this case is: Inspect a clean representative baseline dataset and generated feature statistics/constraints.
B:That diagnostic measures a different AWS ML behavior: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. It cannot establish the main condition: A newly deployed recommender has no accepted reference statistics, so the team cannot tell whether future feature shifts are significant. The decisive evidence for this case is: Inspect a clean representative baseline dataset and generated feature statistics/constraints.
C:That diagnostic measures a different AWS ML behavior: A lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. It cannot establish the main condition: A newly deployed recommender has no accepted reference statistics, so the team cannot tell whether future feature shifts are significant. The decisive evidence for this case is: Inspect a clean representative baseline dataset and generated feature statistics/constraints.
Question 475
The ML operations team needs direct evidence about this situation: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. Which diagnostic observation most directly evaluates the reported condition?
- Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
- Inspect captured inference payloads, schema validation failures, and endpoint 4xx/5xx trends.
- Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
Explanation
Correct Answer
A:This evidence directly tests the reported behavior: Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds. For this case, a product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The results tell the team whether to apply the targeted change: Run a controlled SageMaker endpoint A/B traffic experiment with per-variant business metrics.
Incorrect Answers
B:That diagnostic measures a different AWS ML behavior: After a pipeline change, an online predictor starts receiving null values in a previously required numeric feature and returns elevated errors. It cannot establish the main condition: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The decisive evidence for this case is: Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
C:That diagnostic measures a different AWS ML behavior: A regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. It cannot establish the main condition: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The decisive evidence for this case is: Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
D:That diagnostic measures a different AWS ML behavior: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. It cannot establish the main condition: A product wants to determine whether a new ranking model improves completed purchases, and both old and new models can serve the same eligible user population. The decisive evidence for this case is: Inspect randomized variant assignment and purchase conversion metrics with statistical confidence bounds.
Question 476
A data-science incident must be diagnosed without guessing: An ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. Which diagnostic observation most directly evaluates the reported condition?
- Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts.
- Inspect the production model's response and the independently captured shadow predictions for the same requests.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
- Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls.
Explanation
Correct Answer
B:This evidence directly tests the reported behavior: Inspect the production model's response and the independently captured shadow predictions for the same requests. For this case, an ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. The results tell the team whether to apply the targeted change: Use SageMaker shadow testing with mirrored requests and separate candidate metrics.
Incorrect Answers
A:That diagnostic measures a different AWS ML behavior: A lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. It cannot establish the main condition: An ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. The decisive evidence for this case is: Inspect the production model's response and the independently captured shadow predictions for the same requests.
C:That diagnostic measures a different AWS ML behavior: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. It cannot establish the main condition: An ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. The decisive evidence for this case is: Inspect the production model's response and the independently captured shadow predictions for the same requests.
D:That diagnostic measures a different AWS ML behavior: A regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. It cannot establish the main condition: An ML team wants to test a candidate model on actual production requests without allowing its predictions to alter customer decisions. The decisive evidence for this case is: Inspect the production model's response and the independently captured shadow predictions for the same requests.
Question 477
Before making a production change, an engineer must investigate this condition: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. Which diagnostic observation most directly evaluates the reported condition?
- Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls.
- Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
Explanation
Correct Answer
D:This evidence directly tests the reported behavior: Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions. For this case, a data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. The results tell the team whether to apply the targeted change: Create a CloudWatch alarm for monitored data-quality violations and route alerts through an approved notification channel.
Incorrect Answers
A:That diagnostic measures a different AWS ML behavior: A regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. It cannot establish the main condition: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. The decisive evidence for this case is: Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
B:That diagnostic measures a different AWS ML behavior: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. It cannot establish the main condition: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. The decisive evidence for this case is: Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
C:That diagnostic measures a different AWS ML behavior: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. It cannot establish the main condition: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. The decisive evidence for this case is: Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
Question 478
The ML operations team needs direct evidence about this situation: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. Which diagnostic observation most directly evaluates the reported condition?
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Join recorded predictions to delayed ground-truth outcomes with reliable event IDs and timing.
- Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts.
- Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
Explanation
Correct Answer
D:This evidence directly tests the reported behavior: Inspect the recent error series and the retraining pipeline's approval and evaluation stages. For this case, a price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. The results tell the team whether to apply the targeted change: Trigger a SageMaker Pipeline retraining candidate when a validated performance alarm fires.
Incorrect Answers
A:That diagnostic measures a different AWS ML behavior: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. It cannot establish the main condition: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. The decisive evidence for this case is: Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
B:That diagnostic measures a different AWS ML behavior: A customer churn model's recent outcomes arrive two weeks after predictions, allowing actual predictive performance to be checked against its original evaluation results. It cannot establish the main condition: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. The decisive evidence for this case is: Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
C:That diagnostic measures a different AWS ML behavior: A lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. It cannot establish the main condition: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. The decisive evidence for this case is: Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
Question 479
A data-science incident must be diagnosed without guessing: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. Which diagnostic observation most directly evaluates the reported condition?
- Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
- Inspect the recent error series and the retraining pipeline's approval and evaluation stages.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Review SageMaker Clarify bias monitoring metrics and group-conditioned prediction counts.
Explanation
Correct Answer
C:This evidence directly tests the reported behavior: Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window. For this case, an endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The results tell the team whether to apply the targeted change: Monitor and correlate SageMaker endpoint error metrics with inference-container logs and request metadata.
Incorrect Answers
A:That diagnostic measures a different AWS ML behavior: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. It cannot establish the main condition: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The decisive evidence for this case is: Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
B:That diagnostic measures a different AWS ML behavior: A price prediction service experiences sustained labeled error growth and should start a reviewed retraining pipeline without automatically changing production weights. It cannot establish the main condition: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The decisive evidence for this case is: Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
D:That diagnostic measures a different AWS ML behavior: A lender with existing Clarify monitoring access must check whether a deployed model now treats monitored applicant groups differently. It cannot establish the main condition: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. The decisive evidence for this case is: Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
Question 480
Before making a production change, an engineer must investigate this condition: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. Which diagnostic observation most directly evaluates the reported condition?
- Review SageMaker endpoint data capture settings, selected S3 location, sampling rate, and encryption controls.
- Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
- Compare endpoint Invocation5XXErrors, Invocation4XXErrors, and container logs for the same time window.
- Inspect CloudWatch metrics or scheduled monitor output and alarm-to-notification subscriptions.
Explanation
Correct Answer
B:This evidence directly tests the reported behavior: Inspect the latency distribution including ModelLatency and request-level p95 where instrumented. For this case, an API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. The results tell the team whether to apply the targeted change: Monitor a suitable high-percentile end-to-end inference latency measure with a tested alert.
Incorrect Answers
A:That diagnostic measures a different AWS ML behavior: A regulated ML service must investigate particular prediction requests and preserve limited input/output evidence without retaining sensitive raw identifiers unnecessarily. It cannot establish the main condition: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. The decisive evidence for this case is: Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
C:That diagnostic measures a different AWS ML behavior: An endpoint has healthy instances but clients report sporadic failed predictions and the team needs to distinguish model-container errors from client validation errors. It cannot establish the main condition: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. The decisive evidence for this case is: Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
D:That diagnostic measures a different AWS ML behavior: A data-science team only learns of a broken input feed when an analyst manually reads a weekly SageMaker monitoring report. It cannot establish the main condition: An API has a strict model-serving p95 latency contract but average model response time still looks acceptable during serious tail-latency incidents. The decisive evidence for this case is: Inspect the latency distribution including ModelLatency and request-level p95 where instrumented.
AWS Certified Machine Learning Engineer - Associate MLA-C01 Practice Tests