Cold Storage Monitoring

Access the Cold Storage Dashboards

In Grafana, click Dashboards. Open the Data Services folder and click Cold Storage.

Monitoring Components

Overview

Metric

Description

Location

Allows choosing the cold location to focus on

Active sessions

Number of established TLP sessions

Active requests

Number of requests currently being served

Active jobs

Number of jobs currently being processed

Success rate

Percentage of successful/failed requests

Requests rate

Rate of requests served

Job rate

Rate of cold storage jobs processed

Archive Pack rate

Rate of upload of “archive packs” to cold storage

Jobs

Metric

Description

Jobs over time

Rate of jobs grouped by type

Pending jobs over time

Number of pending jobs by type

Job type breakdown

Job distribution by type

Archive job duration

Time to process a “Archive” job for each operation

Restore job duration

Time to process a “Restore” job for each operation

Delete job duration

Time to process a “Delete” job for each operation

S3 ops over time

Rate of S3 operation on the "hot" bucket, by type

S3 data rate over time

Average data rate of S3 operations on the "hot" bucket, by type

S3 archived object size

Size of S3 archived object for each operation

S3 restored object size

Size of S3 restored object for each operation

Tar Packs

Metric

Description

Queue length over time

Number of objects in Tar queue, waiting until conditions (size, timeout) to build a Tar pack are satisfied

Archive packs over time

Number of Tar packs currently being uploaded

Packs over time

Rate of Tar pack creation over time

Pack success rate

Percentage of successful/failed Tar pack creation

Pack size average

Average size of Tar pack

Pack size

Tar pack size for each operation

Pack object count

Average number of objects in a Tar pack

Pack object count average

Number of objects in a Tar pack, for each operation

Pack creation average duration

Average overall duration of Tar pack creation & upload

Pack creation duration

Overall duration of Tar pack creation & upload, for each pack

Pack creation latency

Average delay between first job and beginning of Tar pack upload

Pack creation average latency

Delay between first job and beginning of Tar pack upload, for each pack

Requests

Metric

Description

Request rate per action

HTTP/TLP request rate by action

Request duration

Time to process a request for each operation