New Relic integrations with the Google Cloud Platform (GCP) include one that reports Google BigQuery data to New Relic. This document explains how to activate the GCP BigQuery integration and describes the data it reports.
Features
BigQuery is Google Cloud's serverless data warehouse. New Relic BigQuery integration collects query, execution, storage, and slot utilization metrics at both project and dataset scope.
Activate integration
To enable the integration, follow standard procedures to connect your GCP service to New Relic:
Polling frequency
New Relic integrations query your GCP services according to a polling interval that varies by integration. The polling frequency for Google BigQuery is 5 minutes. The resolution is 1 data point every minute.
Important
BigQuery supports 1-minute polling intervals for WIF integrations in limited preview. To request access, contact New Relic support.
Activate Table metrics
The collection of BigQuery table metrics is disabled by default. This affects the metrics listed under GcpBigQueryTableSample. To collect those metrics, turn on the "Enable table metrics" setting under the configuration menu of the BigQuery integration.
Workload Identity Federation
Find and use data
After you enable the integration, your BigQuery resources appear as entities in the New Relic entity explorer. To see dashboards and manage services, go to one.newrelic.com > All capabilities > Infrastructure > GCP.
All BigQuery metrics available in GCP Cloud Monitoring are collected as dimensional metrics in the Metric event type. Additional metrics beyond this table are collected automatically. See Google's BigQuery metrics documentation for the complete list.
Entities
Metric data
Key metrics — Project
Metric name | Unit | Description |
|---|---|---|
| Count | Number of queries executed in the project, faceted by |
| Seconds | Query execution time distribution across the project. |
| Count | Number of slots currently allocated to the project. |
| Bytes | Bytes uploaded to BigQuery in the project. |
| Count | Number of rows uploaded to BigQuery in the project. |
Key metrics — Dataset
Metric name | Unit | Description |
|---|---|---|
| Bytes | Total bytes stored in the dataset. |
| Count | Number of tables in the dataset. |
| Bytes | Logical bytes stored in the dataset (uncompressed size). |
| Bytes | Physical bytes stored in the dataset (compressed on-disk size). |
For the complete list of BigQuery metrics, see Google's BigQuery metrics documentation.
Service account or user account
Find and use data
After activating the integration and waiting a few minutes (based on the polling frequency), data will appear in the New Relic UI. To find and use your data, including links to your and alert settings, go to one.newrelic.com > All capabilities > Infrastructure > GCP > (select an integration).
To view metric data for your Google BigQuery integration in New Relic, create NRQL queries for GcpBigQueryProjectSample, GcpBigQueryDatasetSample, and GcpBigQueryTableSample events and their attributes.
GcpBigQueryProjectSample
Query GcpBigQueryProjectSample events in New Relic to view data for the following metrics. Resolution is one data point per minute with an 8-minute delay.
Attribute | Description |
|---|---|
| In-flight queries. |
| Distribution of query execution times. |
| Number of slots currently allocated for project. |
| Number of slots currently allocated for query jobs in the project. |
| Number of slots currently allocated for the project and job type. |
| Number of slots currently allocated for project in the reservation. |
| Number of slots currently allocated across projects in the reservation. |
| Total number of slots available for the project. |
GcpBigQueryDatasetSample
Query GcpBigQueryDatasetSample events in New Relic to view data for the following metrics. Resolution is one data point every 30 minutes with a 3-hour delay.
Attribute | Description |
|---|---|
| Amount of stored bytes. |
| Number of tables. |
GcpBigQueryTableSample
Query GcpBigQueryTableSample events to view data for the following metrics. Resolution is one data point per minute with a 6-hour delay.
Attribute | Description |
|---|---|
| Uploaded bytes. |
| Uploaded bytes billed. Currently only streaming API is billed. |
| Uploaded rows. |