Daily

Get a morning list of firing Datadog monitors

Every day you see which monitors are in Alert or Warn, without opening Datadog.

Runs: Daily
Apps: Datadog
AI: Not needed
Access: monitors_read

Send this to your assistant

Create a ClickRuntime automation: every day at 8am, email me the Datadog monitors that are currently in Alert or Warn, with the monitor name, status and the service it covers.

Paste it into your assistant. It tells you what it will send or change before it runs live.

Add to ChatGPT Add to Claude

First time? Adding ClickRuntime to your assistant takes about two minutes.

Why use it

Why teams use this automation

Datadog monitors are meant to be acted on, yet many teams carry a backlog of monitors in Alert or Warn that nobody owns. Some are real problems waiting for a fix, some are stale thresholds, and some are noise that trains people to ignore the page. Without a regular review, the dashboard is permanently red and meaningless.

Each morning, this searches Datadog for monitors whose status is Alert or Warn and emails you the list. You see what is currently wrong, in one place, before the day's work begins.

Site reliability engineers, engineering managers and on-call leads use it as a daily check on operational health. The list comes from a search on monitor status in Datadog, so it shows what is currently in Alert or Warn, in the form of one email you can read in a minute.

What you get out of it

Start the day knowing what is wrong
A morning list of triggered monitors shows what needs attention now. Nothing depends on someone happening to open the monitors page. The day begins with a clear view of what is wrong, and nothing depends on someone happening to open the monitors page.
Find monitors nobody owns
A monitor that stays in Alert every day is either a real unresolved problem or a bad threshold. Seeing it daily forces a decision. A monitor in Alert every day is either an unresolved problem or a bad threshold, and seeing it daily forces a decision.
Reduce alert fatigue over time
Noisy monitors stand out in the daily list. Fixing or deleting them makes future alerts more trustworthy. Noisy monitors stand out in the daily list, and fixing or deleting them makes future alerts more trustworthy.
Brief managers without dashboards
Leaders get a plain list they can read in a minute. They understand the state of production without learning Datadog's interface. Leaders get a plain list they can read in a minute, and understand production health without learning the Datadog interface.
Support handovers between teams
A daily record of what was alerting helps the next shift. They know what was already visible when they arrived. A daily record of what was alerting helps the next shift know what was already visible when they arrived.

How it works

What happens, step by step

Every day ClickRuntime checks your Datadog monitors.
It keeps the ones currently in Alert or Warn.
You get an email listing each one with its status and service, without opening Datadog.

Before it runs live

Connect Datadog

What you get

RunsDaily

Get a morning list of firing Datadog monitorstoday, 9:00Succeeded

Email · Triggered monitorsAlert: High p95 latency on checkout (service: checkout-api) Warn: Disk usage above 80% (service: postgres)

Build your own

Need it to work differently?

This template is a starting point. Copy the prompt and change it, or describe a different automation from scratch, with your own conditions, more apps or an AI step. Your assistant writes it, tests it and runs it on ClickRuntime.

Your own rules
Conditions, thresholds, filters and exceptions, written the way you'd explain them to a colleague.
Any number of apps
One automation can read from one app and update several others. Over 248 apps are ready, and anything with an API works too.
AI where it helps
Summaries, classification, extraction and drafts use ClickRuntime's built-in AI, with no extra key.
On a schedule or on each event
Runs as often as every 5 minutes, or the moment an app sends an event, and keeps track of what it already handled.

Changes you can ask for

Run it at a different time, more or less often, or only on weekdays
Add an AI step, for example to summarize, sort or draft a reply
Add another app, for example also send it to Slack
Combine it with other Datadog steps into one automation

Under the hood

The code that runs this automation

This is the Python script that runs each time the automation starts. Your AI assistant writes it for you when you send the prompt, and you allow each step in your assistant. To change how the automation works, describe the change to your assistant and it updates the script for you. For every function it can use, see the script reference.

get_a_daily_digest_of_triggered_monitors.pyexample

from clickruntime import on_trigger, credentials, http, notify

DD = "https://api.datadoghq.com"

def dd(path, **params):
    resp = http.get(f"{DD}{path}", params=params, headers={"DD-API-KEY": credentials.secret("DD_API_KEY"),
                    "DD-APPLICATION-KEY": credentials.secret("DD_APP_KEY")})
    resp.raise_for_status()
    return resp.json()

@on_trigger
def run(event):
    monitors = dd("/api/v1/monitor/search", query="status:(alert OR warn)", per_page=100)["monitors"]
    lines = []
    for m in monitors:
        service = next((t.split(":", 1)[1] for t in m.get("tags", []) if t.startswith("service:")), "-")
        lines.append(f"{m['status']}: {m['name']} (service: {service})")
    notify.email_me(f"{len(lines)} Datadog monitors alerting", "\n".join(lines) or "All monitors OK.")
    return {"alerting": len(lines)}

FAQ

Common questions

Does it include muted monitors?

It lists monitors by status, so a muted monitor in Alert can still appear. For monitors that were deliberately silenced, the separate muted monitors report is a better fit. A muted monitor in Alert can still appear, and the muted monitors report is the better tool for silenced ones.

Can it be limited to certain tags or teams?

Yes. Datadog's monitor search supports tags, so a digest for team:payments or env:production is possible. Tell your AI assistant which tags and approve the revised search. Datadog's search supports tags, so a digest for a team or environment is possible, with the new search shown to you first.

Which Datadog keys does it need?

An API key and an application key with permission to read monitors. Both are stored as secrets, and the automation only reads monitors, so it cannot change or mute them. An API key and an application key with read access to monitors are needed, and both are stored as secrets so nothing can be changed.

What permissions does it need?

monitors_read. Nothing else in your accounts is used.

Does it need AI?

No. It runs without AI, so it doesn't use your plan's AI allowance.

How many runs does it use?

One run each time it runs (daily). Checks that find nothing to do and stop right away aren't counted.

Can I change how it works?

Yes. Describe the change to your AI assistant, for example a different schedule, channel or filter. It updates the automation, tests it and tells you what changed.

Weekly