Google Cloud Platform (GCP) Monitoring
Overview
A common framework for executing Google Cloud Platform (GCP) monitors is implemented and is used by Cavisson Application Agent. This framework is responsible for capturing and sending attributes of one or more GCP as per configuration of monitor.
Prerequisites
- The user can use a service account.
- Viewer access is required of a project or an application to access GCP.
- The frequency of data pull is minimum 60 seconds.
- Approximately seven or eight .jar files are required to run a monitor.
GCP Server Configuration
To configure GCP Server, follow the below mentioned steps:
- Login to a machine, go to Product UI Home page, click Monitors icon, and then click the Monitors menu item.
2. This displays the Monitor Group Select a ‘topology’ from the drop down list and click a ‘monitor group’ name.
- This displays a list of Monitors. Expand the GCP A list of following monitors is displayed:
- AgentCPULoadStats
- AgentCPUUsageStats
- AgentDiskStats
- BigQueryDatasetStats
- BigQueryGlobalStats
- BigtableClusterStats
- BigtableTableStats
- CloudSqlStats
- ComputeEngineStats
- DataProcHdfsYarnCustomStats
- DataProcHdfsYarnStats
- DataProcJobsStats
- DataflowStats
- DatastoreStats
- InstanceGroupStats
- MySQLBackupStats
- PubSubSubscriptionStats
- PubSubTopicStats
- StorageBucketStats
- StoragePermissionStats
- AutoScaler
- To configure any monitor, click the Configure Monitor icon (
). - This displays the Monitor Configuration window.
6. Provide the details for each field as follows:
- Exclude Tier: From the drop down list, the user can choose a tier that they want to exclude. The user can also type a pattern as a regular expression that allows them to exclude a tier. The user can type multiple regular expressions separated by comma.
- Type the Instance Name.
- Type the GCP Project ID.
- GCP Token File Path: Type the path of the token file along with the file name (for example, “/home/cavisson/work/Token/<token file name>”). This file contains credentials used to make connection with the Google cloud environment.
- Proxy Settings: Type the Proxy Host and the Proxy Port.
- Recovery Settings: Type the Retry Count. By default, the retry count value is 60.
- Advanced Settings: Provide the following details under advanced settings.
- Type the Alternate JRE Home.
- Delay Time in (Secs): Type the delay time that is used to get the last successful sample value. By default, the delay time is 90 seconds.
- Type the GCP Library Classpath.
- Type the Absolute Metrics Configuration File Path. This is used to give externally configured metrics.
- Click Add to add the monitor configuration.
- To delete one or more configured monitors, click the Delete icon in the lower-right corner of the window.
- Select the check box to enable the monitor and click Save.
GCP Monitoring
Below are the GCP capabilities:
AgentCPULoadStats
| SR No. | Metric | Metric Description |
| 1 | Load Average Over 1 Minute | Average load of system during each minute |
| 2 | Load Average Over 5 Minutes | Average load of system during 5 minute |
| 3 | Load Average Over 15 Minutes | Average load of system during 15 minute |
AgentCPUUsageStats
| SR No. | Metric | Metric Description |
| 1 | CPU Usage (Pct) | CPU usage in percentage |
AgentDiskStats
| SR No. | Metric | Metric Description |
| 1 | Disk Bytes Used (MB) | Disk bytes used in megabytes, where type of usage (free, used, and reserved) in device |
| 2 | Average I/O Time (ms)/Sec | Average time in millisecond an I/O-operation took to complete in device per second |
| 3 | Merged Operations/Sec | Number of merged operations per second, where direction (read and write) in device |
| 4 | Operations/Sec | Number of disk operations per second, where direction (read and write) in device |
| 5 | Operation Time (ms)/Sec | Total time in millisecond spent In disk operations (read and write) in device per second |
| 6 | Average Pending Operations | Number of Pending operations in device |
| 7 | Disk Used (Pct) | Disk percent used, where type of usage are free, used, and reserved in device |
| 8 | Bytes Read/Sec | Disk bytes read in device per second |
| 9 | Weighted I/O Time (ms)/Sec | Weighted number of millisecond spent I/O operation in device per second |
| 10 | Disk Bytes Transferred Kilobytes/Sec | Disk bytes transferred in kilobytes per second |
BigQueryDatasetStats
| SR No. | Metric | Metric Description |
| 1 | BigQuery Stored bytes/Sec | Number of bytes stored per second |
| 2 | BigQuery Table count | Number of tables |
| 3 | BigQuery Uploaded bytes/min | Uploaded bytes per minute |
| 4 | BigQuery Uploaded rows/min | Uploaded rows per minute |
BigQueryGlobalStats
| SR No. | Metric | Metric Description |
| 1 | BigQuery Queries Count | Number of In-flight queries |
| 2 | BigQuery Scanned Bytes/Min | Number of scanned bytes per minute |
| 3 | BigQuery Scanned Bytes Billed/Min | Number of server scanned bytes billed per minute |
| 4 | BigQuery Slots Used By Project | Number of slots used by project |
| 5 | BigQuery Total Slots | Total number of BigQuery slots available for the project |
| 6 | BigQuery Average Query Execution Time (Sec) | Average query execution time in seconds |
| 7 | BigQuery 5th Percentile Query Execution Time (Sec) | 5th percentile of time taken for processing query in seconds |
| 8 | BigQuery 50th Percentile Query Execution Time (Sec) | 50th percentile of time taken for processing query in seconds |
| 9 | BigQuery 95th Percentile Query Execution Time (Sec) | 95th percentile of time taken for processing query in seconds |
| 10 | BigQuery 99th Percentile Query Execution Time (Sec) | 99th percentile of time taken for processing query in seconds |
BigtableClusterStats
| SR No. | Metric | Metric Description |
| 1 | Bigtable Cluster Byte Used | Amount of compressed data for tables stored in a cluster |
| 2 | BigTable Cluster Node Count | Number of nodes in a cluster |
| 3 | Bigtable Cluster Disk Load | Utilization of HDD disks in a cluster |
| 4 | Bigtable Cluster CPU Load Hottest Node | CPU load of the busiest node in a cluster |
| 5 | BigTable Cluster CPU Load | CPU load of a cluster |
BigtableTableStats
| SR No. | Metric | Metric Description |
| 1 | Bigtable Server Sent Bytes/Sec | Number of uncompressed bytes of response data sent by servers for a table |
| 2 | Bigtable Server Returned Rows/Sec | Number of rows returned by server requests for a table |
| 3 | Bigtable Server Requests/Sec | Number of server requests for a table |
| 4 | Bigtable Server Received Bytes/Sec | Number of uncompressed bytes of request data received by servers for a table |
| 5 | Bigtable Server Modified Rows/Sec | Number of rows modified by server requests for a table |
| 6 | Bigtable Server Errors/Sec | Number of server requests for a table that failed with an error |
| 7 | Bigtable Average Server Latency (ms) | Average server request latency for a table in milliseconds |
| 8 | Bigtable 5th Percentile Server Latency (ms) | 5th percentile server request latency for a table in milliseconds |
| 9 | Bigtable 50th Percentile Server Latency (ms) | 50th percentile server request latency for a table in milliseconds |
| 10 | Bigtable 95th Percentile Server Latency (ms) | 95th percentile server request latency for a table in milliseconds |
| 11 | Bigtable 99th Percentile Server Latency (ms) | 95th percentile server request latency for a table in milliseconds |
CloudSqlStats
| SR No. | Metric | Metric Description |
| 1 | CloudSql Reserved Cores | Number of cores reserved for the database |
| 2 | CloudSql CPU Usage Time (Millisecond/Sec) | CPU usage time in millisecond per second |
| 3 | CloudSql Reserved CPU Utilization (Pct) | Fraction of the reserved cpu that is currently in use |
| 4 | CloudSql Bytes Used | Data utilization in bytes |
| 5 | CloudSql Disk Quota (GB) | Maximum data disk size in giga bytes |
| 6 | CloudSql Read Operations/Sec | Number of data disk read i/o operations per second |
| 7 | CloudSql Reserved Disk Utilization (Pct) | Fraction of the disk quota that is currently used in percentage |
| 8 | CloudSql Write Operations/Sec | Number of disk write i/o operations per second |
| 9 | CloudSql Memory Quota (GB) | Maximum ram size in giga bytes |
| 10 | CloudSql Memory Usage (MB) | RAM usage in mega bytes |
| 11 | CloudSql Reserved Memory Utilization (Pct) | Fraction of the memory quota that is currently used in percentage |
| 12 | CloudSql Unflushed Pages In InnoDB Buffer Pool | Number of unflushed pages in the inno db buffer pool |
| 13 | CloudSql Unused Pages In InnoDB Buffer Pool | Number of unused pages in the inno db buffer pool |
| 14 | CloudSql Total Pages In InnoDB Buffer Pool | Total number of pages in the inno db buffer pool |
| 15 | CloudSql InnoDB Fsync() Calls/Sec | Number of inno db fsync() calls per second |
| 16 | CloudSql InnoDB Fsync() Calls To Log File/Sec | Number of inno db fsync() calls to the log file per second |
| 17 | CloudSql InnoDB Pages Read/Sec | Number of inno db pages read per second |
| 18 | CloudSql InnoDB Pages Written/Sec | Number of inno db pages written per second |
| 19 | CloudSql Queries Executed By Server/Sec | Number of statements executed by the server per second |
| 20 | CloudSql Statements Executed By Server Sent By The Client/Sec | Number of statements executed by the server sent by the client per second |
| 21 | CloudSql Bytes Received By MySQL Process/Sec | Number of bytes received by mysql process per second |
| 22 | CloudSql Failover Operations Available On Master Instance | Number of failover operations is available on the master instance per second |
| 23 | CloudSql Read Replica Is Behind Its Master (Sec) | Number of seconds the read replica is behind its master |
| 24 | CloudSql Bytes Sent By MySQL Process/Sec | Number of bytes sent by mysql process per second |
| 25 | CloudSql Connections To MySQL Instance | Number of connections to the cloud sql mysql instance |
| 26 | CloudSql Bytes Received Through Network/Sec | Number of bytes received through the network per second |
| 27 | CloudSql Bytes Sent Count Through Network/Sec | Number of bytes sent through the network per second |
| 28 | CloudSql Cloud SQL PostgreSQL Instance Connections | Number of connections to the cloud sql postgresql instance |
| 29 | CloudSql Transaction Count/Sec | Number of transactions in postgresql per second |
| 30 | CloudSql Server UP Status | Indicates if the server is up or not. On-demand instances are spun down if no connections are made for a sufficient amount of time |
| 31 | CloudSql Instance Running Time (Millisecond/Sec) | Total time in seconds the instance has been running per second |
ComputeEngineStats
| SR No. | Metric | Metric Description |
| 1 | Compute Engine Dropped Bytes/Sec | Number of incoming bytes dropped per second by the firewall |
| 2 | Compute Engine Dropped Packets/Sec | Number of incoming packets dropped per second by the firewall |
| 3 | Compute Engine Reserved Cores | Number of cores reserved on the host of the instance |
| 4 | Compute Engine Average CPU Usage (Sec) | Average CPU usage for all cores in seconds |
| 5 | Compute Engine Average CPU Utilization (Pct) | The fraction of the allocated CPU that is currently in use on the instance in percentage |
| 6 | Compute Engine Disk Read Bytes/Sec | Number of bytes read per second from disk |
| 7 | Compute Engine Disk Read Operations/Sec | Number of disk read IO operations per second |
| 8 | Compute Engine Throttled Read Bytes/Sec | Number of bytes per second in throttled read operations |
| 9 | Compute Engine Throttled Read Operations/Sec | Number of throttled read operations per second |
| 10 | Compute Engine Throttled Write Bytes/Sec | Number of bytes per second in throttled write operations |
| 11 | Compute Engine Throttled Write Operations/Sec | Number of throttled write operations per second |
| 12 | Compute Engine Disk Write Bytes/Sec | Number of bytes per second written to disk |
| 13 | Compute Engine Disk Write Operations/Sec | Number of disk write IO operations per second |
| 14 | Compute Engine Received Bytes/Sec | Number of bytes received per second from the network |
| 15 | Compute Engine Received Packets/Sec | Number of packets received per second from the network |
| 16 | Compute Engine Sent Bytes/Sec | Number of bytes sent per second over the network |
| 17 | Compute Engine Sent Packets/Sec | Number of packets sent per second over the network |
| 18 | Compute Engine Uptime (Sec) | How long the VM is up in millisecond per seconds |
| SR No. | Metric | Metric Description |
| 1 | Yarn Heap Memory Usage Committed (MB) | Amount of heap memory in megabytes Reserved in cluster |
| 2 | Yarn Heap Memory Usage Max (MB) | Amount of maximum heap memory used in megabytes in cluster |
| 3 | Yarn Heap Memory Used (MB) | Amount of heap memory used in megabytes in cluster |
| 4 | Yarn Non Heap Memory Usage Committed (MB) | Amount of non heap memory in megabytes Reserved in cluster |
| 5 | Yarn Non Heap Memory Usage Max (MB) | Amount of maximum non heap memory used in megabytes in cluster |
| 6 | Yarn Non Heap Memory Usage Used (MB) | Amount of non heap memory used in megabytes in cluster |
| 7 | Yarn Number Of Active NMs | Number of active NMs (Network management system) in cluster |
| 8 | Yarn Allocated Memory (MB) | Amount of memory allocated to yarn in megabytes on cluster |
| 9 | Yarn Application Submitted/Sec | Number of Application submitted on cluster |
| 10 | Yarn Available Memory (MB) | Amount of Available memory in megabytes on cluster |
| 11 | Yarn Pending Containers | Number of pending containers on cluster |
| 12 | Yarn Pending Memory (MB) | Amount of pending memory in megabytes on cluster |
| 13 | Yarn Reserved Memory (MB) | Amount of reserved memory in megabytes on cluster |
| 14 | HDFS Heap Memory Usage Committed (MB) | Amount of heap memory in megabytes Reserved for hadoop distributed file system in cluster |
| 15 | HDFS Heap Memory Usage Max (MB) | Amount of maximum heap memory used in megabytes for hadoop distributed file system in cluster |
| 16 | HDFS Heap Memory Usage Used (MB) | Amount of heap memory in megabytes used for hadoop distributed file system in cluster |
| 17 | HDFS Non Heap Memory Usage Committed (MB) | Amount of non heap memory in megabytes Reserved for hadoop distributed file system in cluster |
| 18 | HDFS Non Heap Memory Usage Max (MB) | Amount of maximum non heap memory used in megabytes Reserved for hadoop distributed file system in cluster |
| 19 | HDFS Non Heap Memory Usage Used (MB) | Amount of non heap memory used in megabytes Reserved for hadoop distributed file system in cluster |
| 20 | HDFS Capacity Remaining (GB) | Amount of memory remaining in gigabytes that are reserved for hadoop distributed file system in cluster |
| 21 | HDFS Capacity Total (GB) | Amount of memory in gigabytes that are reserved for hadoop distributed file system in cluster |
| 22 | HDFS Capacity Used (GB) | Amount of memory used in gigabytes that are reserved for hadoop distributed file system in cluster |
| 23 | HDFS Total Files | Number of files in hadoop distributed file system in cluster |
| SR No. | Metric | Metric Description |
| 1 | DataProc Yarn Apps Failed/Sec | Number of yarn application failed in cluster per second |
| 2 | DataProc Yarn Containers Allocated | Number of Yarn containers allocated to cluster |
| 3 | DataProc Yarn Allocated Memory (MB) | Allocated yarn memory in megabytes to cluster |
| 4 | DataProc Yarn Vcores pending | Number of yarn virtual cores pending in cluster |
| 5 | DataProc Yarn Apps Killed/Sec | Number of yarn application killed in cluster per second |
| 6 | DataProc Yarn Nodes Lost | Number of yarn nodes lost in cluster |
| 7 | DataProc Yarn Nodes Decommissioned/Sec | Number of yarn nodes decommissioned in cluster per second |
| 8 | DataProc Yarn Nodes Unhealthy | Number of yarn nodes unhealthy in cluster |
| 9 | DataProc Yarn Available Memory (MB) | Available yarn memory in megabytes in cluster |
| 10 | DataProc Yarn Containers Reserved | Number of Yarn containers reserved in cluster |
| 11 | DataProc Yarn Pending Memory (MB) | Pending yarn memory in megabytes in cluster |
| 12 | DataProc Yarn Nodes Rebooted/Sec | Number of yarn nodes rebooted in cluster per second |
| 13 | DataProc Yarn Total Memory (MB) | Total yarn memory in megabytes in cluster |
| 14 | DataProc Yarn Apps Completed/Sec | Number of yarn application completed in cluster per second |
| 15 | DataProc Yarn Containers Pending | Number of Yarn containers pending in cluster |
| 16 | DataProc Yarn Apps Running | Number of yarn application running in cluster |
| 17 | DataProc Yarn Vcores Allocated | Number of yarn virtual cores allocated to cluster |
| 18 | DataProc Yarn Vcores Reserved | Number of yarn virtual cores reserved by cluster |
| 19 | DataProc Yarn Reserved Memory (MB) | Reserved yarn memory in megabytes by cluster |
| 20 | DataProc Yarn Total Vcores | Total number of yarn virtual cores available for cluster |
| 21 | DataProc Yarn Vcores Available | Number of yarn virtual cores available in cluster |
| 22 | DataProc Yarn Apps Submitted/Sec | Number of yarn application submitted in cluster per second |
| 23 | DataProc Yarn Nodes Active | Number of yarn nodes Active in cluster |
| 24 | DataProc Yarn Apps Pending | Number of yarn application pending in cluster |
| 25 | DataProc Dfs Capacity Used (Bytes) | Distributed file system capacity used in bytes |
| 26 | DataProc Dfs Capacity Present (Bytes) | Distributed file system capacity present in bytes |
| 27 | DataProc Dfs Nodes Decommissioned/Sec | Number of Distributed file system nodes decommissioned in cluster per second |
| 28 | DataProc Dfs Capacity Remaining (Bytes) | Distributed file system capacity remaining in bytes |
| 29 | DataProc Dfs Nodes Decommissioning | Number of Distributed file system nodes decommissioning in cluster |
| 30 | DataProc Dfs Blocks Missing | Number of Distributed file system blocks missing in cluster |
| 31 | DataProc Dfs Blocks Pending Deletion | Number of Distributed file system blocks pending for delete from cluster |
| 32 | DataProc Dfs Total Capacity (Bytes) | Distributed file system total capacity in bytes |
| 33 | DataProc Dfs Nodes running | Number of Distributed file system nodes running in cluster |
| 34 | DataProc Dfs Blocks Under Replication | Number of Distributed file system blocks under replication in cluster |
| 35 | DataProc Dfs Blocks Missing Replication | Number of Distributed file system blocks missing replication in cluster |
| 36 | DataProc Dfs Blocks Corrupt/Sec | Number of Distributed file system blocks corrupt in cluster per second |
DataProcJobsStats
| SR No. | Metric | Metric Description |
| 1 | DataProc Jobs Failed/Sec | Number of jobs failed in cluster per second |
| 2 | DataProc Operations Failed/Sec | Number of operation failed in cluster per second |
| 3 | DataProc Jobs Running | Number of jobs running in cluster |
| 4 | DataProc Operation Running | Number of operation running in cluster |
| 5 | DataProc Jobs Summited | Number of jobs submitted in cluster for execution |
| 6 | DataProc Operation Summited | Number of operation submitted in cluster for execution |
| 7 | DataProc 5th Percentile Job Completion Time (ms) | 5th percentile of time in millisecond, when jobs took to complete from the time the user submits a job to the time Dataproc reports it is completed |
| 8 | DataProc 50th Percentile Job Completion Time (ms) | 50th percentile of time in millisecond, when jobs took to complete from the time the user submits a job to the time Dataproc reports it is completed |
| 9 | DataProc 95th Percentile Job Completion Time (ms) | 95th percentile of time in millisecond, when jobs took to complete from the time the user submits a job to the time Dataproc reports it is completed |
| 10 | DataProc 99th Percentile Job Completion Time (ms) | 99th percentile of time in millisecond, when jobs took to complete from the time the user submits a job to the time Dataproc reports it is completed |
| 11 | DataProc 5th Percentile Job Time Taken (ms) | 5th percentile of time in millisecond jobs have spent in a given state |
| 12 | DataProc 50th Percentile Job Time Taken (ms) | 50th percentile of time in millisecond jobs have spent in a given state |
| 13 | DataProc 95th Percentile Job Time Taken (ms) | 95th percentile of time in millisecond jobs have spent in a given state |
| 14 | DataProc 99th Percentile Job Time Taken (ms) | 99th percentile of time in millisecond jobs have spent in a given state |
| 15 | DataProc 5th Percentile Operation Completion Time (ms) | 5th percentile of time in millisecond operations took to complete from the time the user submits a operation to the time Dataproc reports it is completed |
| 16 | DataProc 50th Percentile Operation Completion Time (ms) | 50th percentile of time in millisecond operations took to complete from the time the user submits a operation to the time Dataproc reports it is completed |
| 17 | DataProc 95th Percentile Operation Completion Time (ms) | 95th percentile of time in millisecond operations took to complete from the time the user submits a operation to the time Dataproc reports it is completed |
| 18 | DataProc 99th Percentile Operation Completion Time (ms) | 99th percentile of time in millisecond operations took to complete from the time the user submits a operation to the time Dataproc reports it is completed |
| 19 | DataProc 5th Percentile Operation Time Taken (ms) | 5th percentile of time in millisecond operation have spent in a given state |
| 20 | DataProc 50th Percentile Operation Time Taken (ms) | 50th percentile of time in millisecond operation have spent in a given state |
| 21 | DataProc 95th Percentile Operation Time Taken (ms) | 95th percentile of time in millisecond operation have spent in a given state |
| 22 | DataProc 99th Percentile Operation Time Taken (ms) | 99th percentile of time in millisecond operation have spent in a given state |
DataflowStats
| SR No. | Metric | Metric Description |
| 1 | Dataflow Job Current Active vCPUs | Number of vCPUs currently being used by this Dataflow job |
| 2 | Dataflow Job Data Watermark Age (Sec) | The age of the most recent item of data that has been fully processed by the pipeline in seconds |
| 3 | Dataflow Job Elapsed Time (Min) | Time duration that the current run of this pipeline has been in the Running state so far, in minutes |
| 4 | Dataflow Job Elements | Number of elements added to the pcollection (multi-element data set) so far |
| 5 | Dataflow Job Estimated Element Size (KB) | An estimated element size (in Kilobytes) added to the pcollection (multi-element data set) so far. Dataflow calculates the average encoded size of elements in a pcollection and multiplies it by the number of elements |
| 6 | Dataflow Job System Lag (Sec) | Current maximum duration that an item of data has been awaiting processing, in seconds |
| 7 | Dataflow Job Total vCPU | Total vCPU seconds used by this dataflow job |
DatastoreStats
| SR No. | Metric | Metric Description |
| 1 | Datastore API Request/sec | Number of API calls per second |
| 2 | Datastore Index Writes/sec | Number of index writes per second |
| 3 | Datastore 5th Percentile Read Size Entities (Bytes) | 5th percentile read size entities in bytes |
| 4 | Datastore 50th Percentile Read Size Entities (Bytes) | 50th percentile read size entities in bytes |
| 5 | Datastore 95th Percentile Read Size Entities (Bytes) | 95th percentile read size entities in bytes |
| 6 | Datastore 99th Percentile Read Size Entities (Bytes) | 99th percentile read size entities in bytes |
| 7 | Datastore 5th Percentile Written Size Entities (Bytes) | 5th percentile write size entities in bytes |
| 8 | Datastore 50th Percentile Written Size Entities (Bytes) | 50th percentile write size entities in bytes |
| 9 | Datastore 95th Percentile Written Size Entities (Bytes) | 95th percentile write size entities in bytes |
| 10 | Datastore 99th Percentile Written Size Entities (Bytes) | 99th percentile write size entities in bytes |
InstanceGroupStats
| SR No. | Metric | Metric Description |
| 1 | Running Instances | Number of running instances in an instance group |
| 2 | Terminated Instances | Number of terminated instances in an instance group |
MySQLBackupStats
| SR No. | Metric | Metric Description |
| 1 | Full Backup Status | Backup status (status = 1, backup service is active and status = 0, indicate is inactive) |
| 2 | Incremental Backup Status | Backup status (status = 1, backup service is active and status = 0, indicate is inactive) |
| 3 | Full Backup Size (MB) | The total amount of space used in Megabytes for full backup |
| 4 | Incremental Backup Size (MB) | The total amount of space used in Megabytes for Incremental backup |
PubSubSubscriptionStats
| SR No. | Metric | Metric Description |
| 1 | PubSub Subscription Backlog Size (KB) | Total size of the unacknowledged messages (backlog messages) in a subscription in Kilobytes |
| 2 | PubSub Subscription Cost (KB) | Cost of operations per subscription, measured in Kilobytes. This is used to measure utilization for quotas |
| 3 | PubSub Subscription Updates/Sec | Number of configuration changes per subscription, grouped by operation type and result |
| 4 | PubSub Subscription ModifyAckDeadline Message Operations/Sec | Number of modify acknowledgment deadline message operations per second, grouped by result |
| 5 | PubSub Subscription ModifyAckDeadline Requests/Sec | Number of Modify Acknowledgment Deadline requests, grouped by result |
| 6 | PubSub Subscription Outstanding Push Messages | Number of messages delivered to a subscription’s push endpoint, but not yet acknowledged |
| 7 | PubSub Subscription Retained Acknowledged Messages | Number of acknowledged messages retained in a subscription |
| 8 | PubSub Subscription Unacknowledged Messages | Number of unacknowledged messages (backlog messages) in a subscription |
| 9 | PubSub Subscription Average Oldest Retained Acknowledged Message Age (Sec) | Average Age (in seconds) of the oldest acknowledged message retained in a subscription |
| 10 | PubSub Subscription Average Oldest Unacknowledged Message Age (Sec) | Average Age (in seconds) of the oldest unacknowledged message (backlog message) in a subscription |
| 11 | PubSub Subscription Acknowledged Message Operations/Sec | Number of acknowledge message operations per second, grouped by result |
| 12 | PubSub Subscription Acknowledge Requests/Sec | Number of acknowledge requests per second, grouped by result |
| 13 | PubSub Subscription Pull Operations/Sec | Number of pull message operations per second, grouped by result |
| 14 | PubSub Subscription Pull Requests/Sec | Number of pull requests per second, grouped by result |
| 15 | PubSub Subscription Push Requests/Sec | Number of push attempts per second, grouped by result |
| 16 | PubSub Subscription Average Retained Acknowledged Size (Bytes) | Average byte size of the acknowledged messages retained in a subscription |
| 17 | PubSub Subscription Streaming Pull Acknowledge Message Operations/Sec | Number of streaming Pull acknowledge message operations per second, grouped by result |
| 18 | PubSub Subscription Streaming Pull Acknowledge Requests/Sec | Number of streaming pull requests per second with non-empty acknowledge ids, grouped by result |
| 19 | PubSub Subscription Streaming Pull Message Operations/Sec | Number of streaming pull message operations per second, grouped by result |
| 20 | PubSub Subscription Streaming Pull Modify Acknowledged Deadline Message Operations/Sec | Number of streaming Pull Modify acknowledged Deadline operations per second, grouped by result |
| 21 | PubSub Subscription Streaming Pull Modify Acknowledged Deadline Requests/Sec | Number of streaming pull requests per second with non-empty Modify acknowledged Deadline fields, grouped by result |
| 22 | PubSub Subscription Streaming Pull Responses/Sec | Number of streaming pull responses per second, grouped by result |
PubSubTopicStats
| SR No. | Metric | Metric Description |
| 1 | PubSub Topic Byte Cost/Sec | Cost of operations per topic per second, measured in bytes. This is used to measure utilization for quotas |
| 2 | PubSub Topic Updates/Sec | Number of configuration changes per topic per second, grouped by operation type and result |
| 3 | PubSub Topic Publish Message Operations/Sec | Number of publish message operations per second, grouped by result |
| 4 | PubSub Topic Publish Message Send Request/Sec | Average of publish requests per second, grouped by result |
| 5 | PubSub Topic Publish Average Message Size 5th Percentile (Bytes) | 5th percentile of publish message size in bytes |
| 6 | PubSub Topic Publish Average Message Size 50th Percentile (Bytes) | 50th percentile of publish message size in bytes |
| 7 | PubSub Topic Publish Average Message Size 95th Percentile (Bytes) | 95th percentile of publish message size in bytes |
| 8 | PubSub Topic Publish Average Message Size 99th Percentile (Bytes) | 99th percentile of publish message size in bytes |
StorageBucketStats
| SR No. | Metric | Metric Description |
| 1 | Storage bytes received over the network (KB) | Count of bytes received over the network in kilobyte, grouped by the API method (Write, Read ,Delete, etc.) and response code |
| 2 | Storage bytes sent over the network (KB) | Count of bytes sent over the network in kilobyte, grouped by the API method (Write, Read, Delete, etc.) and response code |
| 3 | Storage Request Counts/Sec | Number of API calls, grouped by the API method (Write, Read, Delete, etc.) and response code per second |
| 4 | Storage Bucket Size (KB) | Total size of all objects in the bucket |
StoragePermissionStats
| SR No. | Metric | Metric Description |
| 1 | Cloud Storage Read Permission | Read permission Status. 1= Allowed, 0= Not Allowed |
| 2 | Cloud Storage Write Permission | Write permission Status. 1= Allowed, 0= Not Allowed |
AutoScaler
| SR No. | Metric | Metric Description |
| 1 | Minimum Replicas | Minimum number of replicas |
| 2 | Maximum Replicas | Maximum number of replicas |
| 3 | Target CPU Utilization (Pct) | Target CPU utilization percentage |