Google Cloud Composer

Cloud Composer is a managed Apache Airflow service that helps you create, schedule, monitor, and manage workflows. For more details, refer to the GCP documentation

Log and metric types

• Google Cloud Metrics
• Platform Logs
• Audit Logs

Setup

You can collect the logs and metrics for Sumo Logic's Google Cloud Composer integration by following the below steps.

Configure logs collection

• Collect Audit Logs using the Google Cloud Platform source. These Audit Logs can be accessed based on the permissions and roles. To enable logging for Google Composer, refer to Google documentation. For more detail on Composer operations being audited, refer to audited operations. While creating the sync in GCP, as part of the Choose logs to include in sink section, you can use the following query:

  (resource.type=audited_resource resource.labels.service=composer.googleapis.com)

• Collect Platform Logs using the Google Cloud Platform source. Composer platform logs include streaming logs. While creating the sync in GCP, as part of the Choose logs to include in sink section, you can use the following query:

  (resource.type=cloud_composer_environment)

Configure metrics collection

• Collect GCP Metrics using the GCP Metric source. Under the Services dropdown, select Cloud Composer. For Google Cloud Composer metrics and dimensions, refer to Google Cloud Composer metrics.