How can you tell if your threat detection measures are working in AWS? Or that your security controls and incident response playbooks are effective?

One effective approach is to simulate real-world attack techniques, and see if it detects them or works as expected!

Sounds awesome, but how do I do that? Won’t that take a bunch of work?

It definitely would if you started from scratch, but turns out there are some awesome open source tools that do exactly that. Let’s take a look at a few:

  • Red Canary’s Atomic Red Team™
  • DataDog’s Stratus Red Team
  • Amazon’s GuardDuty tester

Let’s take a closer look at each of these.

🔴 Red Canary’s Atomic Red Team™

Atomic Red Team is — in a word — a beast. It’s an impressive library of tests that security teams can use to execute simulated adversarial attacks, which can help you identify whether your defenses are working as expected or not. It’s even mapped to MITRE ATT&CK®.

While this tool has multiple scenarios for cloud environments, it wasn’t specifically designed for the cloud. That’s where this next tool shines…

🔴 DataDog’s Stratus Red Team

Stratus Red Team was designed for the cloud and it includes tests for AWS, Azure, GCP, and Kubernetes.

For example, to retrieve a bunch of secrets stored in Amazon’s Secrets Manager, you can detonate this module:

> stratus detonate aws.credential-access.secretsmanager-batch-retrieve-secrets

What’s most impressive about this tool (at least to me) is how it creates its own required changes to detonate a TTP, keeps track of state, and then cleans up the resources. This is a lot easier said than done and quite impressive of an implementation.

🔴 Amazon’s GuardDuty tester

This one is a lot more specific because it’s really only focused on testing that you’ve successfully enabled Amazon GuardDuty in your environment(s) and it helps show examples of findings. Helpful, but limited and much more narrowly scoped than the prior two, and as compared to the rest of the list below. You can check it out here.

Simulate Cloud Attacks

Validate security controls and detection coverage with repeatable adversary emulation.

Atomic Red Team

Red Canary’s Atomic Red Team™

A library of tests mapped to the MITRE ATT&CK® framework for testing cloud environments, containers, Microsoft 365, Linux, macOS, Windows, and more.

  • Install Invoke-AtomicRedTeam
  • Import a module
  • Check prerequisites
  • List atomic tests

Review the details for a technique

› Invoke-AtomicTest T1003 -ShowDetailsBrief

Execute specific tests by atomic test number

› Invoke-AtomicTest T1218.010 -TestNumbers 1,2

Execute every test for a technique with a process timeout

› Invoke-AtomicTest T1218.010 -TimeoutSeconds 15

Create a CSV list of atomic tests for Atomic Runner to execute.

List each test in the CSV file

› Invoke-AtomicRunner -listOfAtomics .\IcedID.csv -ShowDetailsBrief

Run the prerequisites command for each test

› Invoke-AtomicRunner -listOfAtomics .\IcedID.csv -GetPrereqs

Run each test

› Invoke-AtomicRunner -listOfAtomics .\IcedID.csv

Clean up after the tests

› Invoke-AtomicRunner -listOfAtomics .\IcedID.csv -Cleanup
Stratus Red Team

Datadog’s Stratus Red Team

“Atomic Red Team™” for the cloud, providing granular, self-contained offensive techniques for AWS, Azure, GCP, Microsoft Entra ID, and Kubernetes.

› stratus -h
cleanupClean up leftover infrastructure or configuration
completionGenerate an autocompletion script for your shell
detonateDetonate one or more attack techniques
helpShow help for any command
listList attack techniques
revertRevert an attack technique
showDisplay details about an attack technique
statusDisplay the status of techniques
versionDisplay the current CLI version
warmupCreate prerequisites without detonating the technique
› stratus list --platform aws --mitre-attack-tactic persistence

Browse the full catalog at stratus-red-team.cloud/attack-techniques/list/

› stratus status
Example Stratus technique statuses
Technique IDTechnique nameStatus
aws.credential-access.ec2-get-password-dataRetrieve EC2 Password DataCOLD
aws.credential-access.ec2-steal-instance-credentialsSteal EC2 Instance CredentialsCOLD
aws.credential-access.secretsmanager-batch-retrieve-secretsRetrieve a High Number of Secrets Manager secrets (Batch)COLD
aws.credential-access.ssm-retrieve-securestring-parametersRetrieve And Decrypt SSM ParametersCOLD
aws.defense-evasion.cloudtrail-deleteDelete CloudTrail TrailCOLD
aws.defense-evasion.cloudtrail-event-selectorsDisable CloudTrail Logging Through Event SelectorsCOLD
aws.defense-evasion.cloudtrail-stopStop CloudTrail TrailCOLD
aws.defense-evasion.organizations-leaveAttempt to Leave the AWS OrganizationCOLD
aws.defense-evasion.vpc-remove-flow-logsRemove VPC Flow LogsCOLD

Use this cheat sheet with AI

Copy a ready-to-use prompt into your preferred AI assistant.

Preview prompt

If you know anyone who needs to test their cloud defenses, don’t forget to share this with them!