Staging - [FIRING:1] Build Analysis: Message Abandoned Alert helix (d67c04dd4b26487db22334164bb03b63)

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=2438, C=1
Labels:

• alertname = Build Analysis: Message Abandoned Alert
• NotificationId = d67c04dd4b26487db22334164bb03b63
• grafana_folder = helix
  Annotations:
• description = The Build Analysis Service has abandoned a build.

Description and instructions for this alert
Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-message-abandoned/view?orgId=1
Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-message-abandoned&matcher=NotificationId%3Dd67c04dd4b26487db22334164bb03b63&orgId=1
Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1776979533727
Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1776979533727&viewPanel=37

Go to rule

@dotnet/dnceng, @dotnet/prodconsvcs, please investigate

Automation information below, do not change

Grafana-Automated-Alert-Id-0

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=2578, C=1
Labels:

• alertname = Build Analysis: Message Abandoned Alert
• NotificationId = d67c04dd4b26487db22334164bb03b63
• grafana_folder = helix
  Annotations:
• description = The Build Analysis Service has abandoned a build.

Description and instructions for this alert
Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-message-abandoned/view?orgId=1
Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-message-abandoned&matcher=NotificationId%3Dd67c04dd4b26487db22334164bb03b63&orgId=1
Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777037734808
Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777037734808&viewPanel=37

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=239, C=1
Labels:

• alertname = Build Analysis: Exceptions and Errors Alert
• NotificationId = 6fe0b7b34a004f0bad0064a42f9b9135
• grafana_folder = helix
  Annotations:
• description = Description and instructions for this alert
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-exceptions-and-errors/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-exceptions-and-errors&matcher=NotificationId%3D6fe0b7b34a004f0bad0064a42f9b9135&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777037734808
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777037734808&viewPanel=46

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=302, C=1
Labels:

• alertname = DotNetEng Status Failed Requests/Hour alert
• NotificationId = d2dd705a6c724ed68fcf6955561c06dd
• grafana_folder = dnceng
  Annotations:
• description = The number of failed DotNetEng Status requests per hour is above 20. This may indicate a systemic problem that needs to be investigated.\nTo intially investigate prod, run the following query in DotNetEng-Status-Prod, and to investigate staging, run the query in DotNetEng-Status-Staging:\n\n\nunion exceptions, traces\n| project timestamp, operation_Name, customDimensions, message, problemId, details\n| order by timestamp asc\n
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/dotneteng-status-failed-requests/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Ddotneteng-status-failed-requests&matcher=NotificationId%3Dd2dd705a6c724ed68fcf6955561c06dd&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/serviceAvailability?from=1776977620000&orgId=1&to=1777038934812
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/serviceAvailability?from=1776977620000&orgId=1&to=1777038934812&viewPanel=44

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=2699, C=1
Labels:

• alertname = Build Analysis: Message Abandoned Alert
• NotificationId = d67c04dd4b26487db22334164bb03b63
• grafana_folder = helix
  Annotations:
• description = The Build Analysis Service has abandoned a build.

Description and instructions for this alert
Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-message-abandoned/view?orgId=1
Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-message-abandoned&matcher=NotificationId%3Dd67c04dd4b26487db22334164bb03b63&orgId=1
Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777052156414
Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777052156414&viewPanel=37

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=240, C=1
Labels:

• alertname = Build Analysis: Exceptions and Errors Alert
• NotificationId = 6fe0b7b34a004f0bad0064a42f9b9135
• grafana_folder = helix
  Annotations:
• description = Description and instructions for this alert
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-exceptions-and-errors/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-exceptions-and-errors&matcher=NotificationId%3D6fe0b7b34a004f0bad0064a42f9b9135&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777052156414
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777052156414&viewPanel=46

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=251.2, C=1
Labels:

• alertname = DotNetEng Status Failed Requests/Hour alert
• NotificationId = d2dd705a6c724ed68fcf6955561c06dd
• grafana_folder = dnceng
  Annotations:
• description = The number of failed DotNetEng Status requests per hour is above 20. This may indicate a systemic problem that needs to be investigated.\nTo intially investigate prod, run the following query in DotNetEng-Status-Prod, and to investigate staging, run the query in DotNetEng-Status-Staging:\n\n\nunion exceptions, traces\n| project timestamp, operation_Name, customDimensions, message, problemId, details\n| order by timestamp asc\n
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/dotneteng-status-failed-requests/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Ddotneteng-status-failed-requests&matcher=NotificationId%3Dd2dd705a6c724ed68fcf6955561c06dd&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/serviceAvailability?from=1776977620000&orgId=1&to=1777053392185
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/serviceAvailability?from=1776977620000&orgId=1&to=1777053392185&viewPanel=44

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=2604, C=1
Labels:

• alertname = Build Analysis: Message Abandoned Alert
• NotificationId = d67c04dd4b26487db22334164bb03b63
• grafana_folder = helix
  Annotations:
• description = The Build Analysis Service has abandoned a build.

Description and instructions for this alert
Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-message-abandoned/view?orgId=1
Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-message-abandoned&matcher=NotificationId%3Dd67c04dd4b26487db22334164bb03b63&orgId=1
Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777066725040
Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777066725040&viewPanel=37

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=233, C=1
Labels:

• alertname = Build Analysis: Exceptions and Errors Alert
• NotificationId = 6fe0b7b34a004f0bad0064a42f9b9135
• grafana_folder = helix
  Annotations:
• description = Description and instructions for this alert
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-exceptions-and-errors/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-exceptions-and-errors&matcher=NotificationId%3D6fe0b7b34a004f0bad0064a42f9b9135&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777066725040
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777066725040&viewPanel=46

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=356.8, C=1
Labels:

• alertname = DotNetEng Status Failed Requests/Hour alert
• NotificationId = d2dd705a6c724ed68fcf6955561c06dd
• grafana_folder = dnceng
  Annotations:
• description = The number of failed DotNetEng Status requests per hour is above 20. This may indicate a systemic problem that needs to be investigated.\nTo intially investigate prod, run the following query in DotNetEng-Status-Prod, and to investigate staging, run the query in DotNetEng-Status-Staging:\n\n\nunion exceptions, traces\n| project timestamp, operation_Name, customDimensions, message, problemId, details\n| order by timestamp asc\n
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/dotneteng-status-failed-requests/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Ddotneteng-status-failed-requests&matcher=NotificationId%3Dd2dd705a6c724ed68fcf6955561c06dd&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/serviceAvailability?from=1776977620000&orgId=1&to=1777067925042
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/serviceAvailability?from=1776977620000&orgId=1&to=1777067925042&viewPanel=44

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=239, C=1
Labels:

• alertname = Build Analysis: Exceptions and Errors Alert
• NotificationId = 6fe0b7b34a004f0bad0064a42f9b9135
• grafana_folder = helix
  Annotations:
• description = Description and instructions for this alert
  Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-exceptions-and-errors/view?orgId=1
  Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-exceptions-and-errors&matcher=NotificationId%3D6fe0b7b34a004f0bad0064a42f9b9135&orgId=1
  Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777081246672
  Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1774564650000&orgId=1&to=1777081246672&viewPanel=46

Go to rule

[dotnet-eng-status-staging]

💔 Metric state changed to alerting

Firing

Value: B=2555, C=1
Labels:

• alertname = Build Analysis: Message Abandoned Alert
• NotificationId = d67c04dd4b26487db22334164bb03b63
• grafana_folder = helix
  Annotations:
• description = The Build Analysis Service has abandoned a build.

Description and instructions for this alert
Source: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/grafana/build-analysis-message-abandoned/view?orgId=1
Silence: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/alerting/silence/new?alertmanager=grafana&matcher=__alert_rule_uid__%3Dbuild-analysis-message-abandoned&matcher=NotificationId%3Dd67c04dd4b26487db22334164bb03b63&orgId=1
Dashboard: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777081246672
Panel: https://dnceng-grafana-staging-faf3f3ebf0f8afbm.wus2.grafana.azure.com/d/buildAnalysis?from=1775167590000&orgId=1&to=1777081246672&viewPanel=37

Go to rule