TFX on Cloud AI Platform Pipelines Reviews

Not able to complete the lab after trying multiple time. See error below - RuntimeError: Job 'projects/qwiklabs-gcp-04-0ad550ad00bd/jobs/tfx_20240909003249' did not succeed. Detailed response {'jobId': 'tfx_20240909003249', 'trainingInput': {'region': 'us-central1', 'masterConfig': {'imageUri': 'gcr.io/qwiklabs-gcp-04-0ad550ad00bd/tfx_covertype_continuous_training@sha256:86551df27d7e82cbc2b920076050e5b75a4d7d2a0b20ea9da39095418c56c93f', 'containerCommand': ['python', '-m', 'tfx.scripts.run_executor', '--executor_class_path', 'tfx.components.trainer.executor.GenericExecutor', '--inputs', '{"examples": [{"artifact": {"id": "5", "type_id": "18", "uri": "gs://qwiklabs-gcp-04-0ad550ad00bd-kubeflowpipelines-default/tfx_covertype_continuous_training/1cd0935c-dff7-4d8a-bca9-de8db2920a52/Transform/transformed_examples/5", "properties": {"split_names": {"string_value": "[\\"train\\", \\"eval\\"]"}}, "custom_properties": {"producer_component": {"string_value": "Transform"}, "state": {"string_value": "published"}, "name": {"string_value": "transformed_examples"}}, "state": "LIVE", "create_time_since_epoch": "1725841851834", "last_update_time_since_epoch": "1725841943054"}, "artifact_type": {"id": "18", "name": "Examples", "properties": {"split_names": "STRING", "span": "INT", "version": "INT"}}, "__artifact_class_module__": "tfx.types.standard_artifacts", "__artifact_class_name__": "Examples"}], "schema": [{"artifact": {"id": "1", "type_id": "16", "uri": "schema", "create_time_since_epoch": "1725841773508", "last_update_time_since_epoch": "1725841773508"}, "artifact_type": {"id": "16", "name": "Schema"}, "__artifact_class_module__": "tfx.types.standard_artifacts", "__artifact_class_name__": "Schema"}], "transform_graph": [{"artifact": {"id": "4", "type_id": "22", "uri": "gs://qwiklabs-gcp-04-0ad550ad00bd-kubeflowpipelines-default/tfx_covertype_continuous_training/1cd0935c-dff7-4d8a-bca9-de8db2920a52/Transform/transform_graph/5", "custom_properties": {"producer_component": {"string_value": "Transform"}, "name": {"string_value": "transform_graph"}, "state": {"string_value": "published"}}, "state": "LIVE", "create_time_since_epoch": "1725841851831", "last_update_time_since_epoch": "1725841943053"}, "artifact_type": {"id": "22", "name": "TransformGraph"}, "__artifact_class_module__": "tfx.types.standard_artifacts", "__artifact_class_name__": "TransformGraph"}]}', '--outputs', '{"model": [{"artifact": {"id": "9", "type_id": "28", "uri": "gs://qwiklabs-gcp-04-0ad550ad00bd-kubeflowpipelines-default/tfx_covertype_continuous_training/1cd0935c-dff7-4d8a-bca9-de8db2920a52/Trainer/model/8", "custom_properties": {"producer_component": {"string_value": "Trainer"}, "name": {"string_value": "model"}}}, "artifact_type": {"id": "28", "name": "Model"}, "__artifact_class_module__": "tfx.types.standard_artifacts", "__artifact_class_name__": "Model"}], "model_run": [{"artifact": {"id": "10", "type_id": "29", "uri": "gs://qwiklabs-gcp-04-0ad550ad00bd-kubeflowpipelines-default/tfx_covertype_continuous_training/1cd0935c-dff7-4d8a-bca9-de8db2920a52/Trainer/model_run/8", "custom_properties": {"name": {"string_value": "model_run"}, "producer_component": {"string_value": "Trainer"}}}, "artifact_type": {"id": "29", "name": "ModelRun"}, "__artifact_class_module__": "tfx.types.standard_artifacts", "__artifact_class_name__": "ModelRun"}]}', '--exec-properties', '{"custom_config": "{\\"ai_platform_training_args\\": {\\"masterConfig\\": {\\"imageUri\\": \\"gcr.io/qwiklabs-gcp-04-0ad550ad00bd/tfx_covertype_continuous_training@sha256:86551df27d7e82cbc2b920076050e5b75a4d7d2a0b20ea9da39095418c56c93f\\"}, \\"project\\": \\"qwiklabs-gcp-04-0ad550ad00bd\\", \\"region\\": \\"us-central1\\", \\"serviceAccount\\": \\"tfx-tuner-caip-service-account@qwiklabs-gcp-04-0ad550ad00bd.iam.gserviceaccount.com\\"}}", "eval_args": "{\\"num_steps\\": 500}", "kfp_pod_name": "tfx-covertype-continuous-training-k8brw-2406777828", "module_file": "model.py", "run_fn": null, "train_args": "{\\"num_steps\\": 5000}", "trainer_fn": null}']}, 'serviceAccount': 'tfx-tuner-caip-service-account@qwiklabs-gcp-04-0ad550ad00bd.iam.gserviceaccount.com'}, 'createTime': '2024-09-09T00:33:08Z', 'startTime': '2024-09-09T00:42:41Z', 'endTime': '2024-09-09T00:43:12Z', 'state': 'FAILED', 'errorMessage': 'The replica master 0 exited with a non-zero status of 1. Termination reason: Error. To find out more about why your job exited please check the logs: https://console.cloud.google.com/logs/viewer?project=471960102083&resource=ml_job%2Fjob_id%2Ftfx_20240909003249&advancedFilter=resource.type%3D%22ml_job%22%0Aresource.labels.job_id%3D%22tfx_20240909003249%22 ', 'trainingOutput': {}, 'labels': {'tfx_executor': 'tfx-components-trainer-executor-genericexecutor', 'tfx_py_version': '3-7', 'tfx_runner': 'kfp', 'tfx_version': '0-25-0'}, 'etag': '7YURE5RtiMw=', 'jobPosition': '0'}. time="2024-09-09T00:43:14.038Z" level=info msg="sub-process exited" argo=true error="<nil>" time="2024-09-09T00:43:14.038Z" level=error msg="cannot save artifact /mlpipeline-ui-metadata.json" argo=true error="stat /mlpipeline-ui-metadata.json: no such file or directory" Error: exit status 1

Muhammad K. · Reviewed около 1 года ago

SIYA G. · Reviewed около 1 года ago

Avgi M. · Reviewed около 1 года ago

Ashley R. · Reviewed около 1 года ago

Naura J. · Reviewed около 1 года ago

Windaru W. · Reviewed около 1 года ago

Ankit U. · Reviewed около 1 года ago

Avgi M. · Reviewed около 1 года ago

Emmanuel A. · Reviewed около 1 года ago

Massimo S. · Reviewed около 1 года ago

mas r. · Reviewed около 1 года ago

mas r. · Reviewed около 1 года ago

Muhammad H. · Reviewed около 1 года ago

This lab also requires a full updated. AI Platform is no longer available on GCP and I don't know how to create a Vertex AI Pipeline instead of the one we are supposed to on this lab

Vicente W. · Reviewed около 1 года ago

Lab is completely broken. Upload Pipeline and Create Run checkpoints do not correctly identify my pipeline package and run

Callum G. · Reviewed около 1 года ago

Enzo P. · Reviewed около 1 года ago

Ricky Juniar I. · Reviewed около 1 года ago

Aiswaria A. · Reviewed около 1 года ago

Callum G. · Reviewed около 1 года ago

Nagesh P. · Reviewed около 1 года ago

The pipeline was deployed for hours yet it was not recognized.

Kunal A. · Reviewed около 1 года ago

Deprecated Software leading to errors.

Kunal A. · Reviewed около 1 года ago

Nagesh P. · Reviewed около 1 года ago

Build trainer image throws exception

Chen Y. · Reviewed около 1 года ago

Larasati Utami P. · Reviewed около 1 года ago