Posts in AWS
Pagerduty Cloudwatch integration
- 09 January 2022
It is possible to send your own custom payload to the Pagerduty Cloudwatch integration from a Lambda (instead of via a Cloudwatch alarm). Pagerduty does not document the internals but if you publish a custom message to the SNS topic that you have a HTTPS subscription to Pager duty following these simple rules you will see the event in Pagerduty.
Send payload to AWS Lambda from Cloudwatch scheduled event
- 01 January 2022
How to send payload to AWS Lambda from Cloudwatch scheduled event.
Demystifying AWS IAM Policies: Unraveling De Morgan’s Laws and S3 Buckets Policy
- 12 September 2021
Before we get into it we need to review how Condition evaluation works:
Trust on Cloud AWS S3 Threat Model
- 29 August 2021
Trust on Cloud have open sourced their AWS S3 threat model, this release is a great tool to make sense of the “shared responsibility model” and what “responsibility” means for AWS customers.
Monitoring VPN / Direct Connect Connectivity
- 18 July 2021
In an on premise network it is typical to do some type of topology discovery via the MIB-II SNMP tables of all your network gear and then use ICMP to ping each of the discovered routers or switches respective management interfaces to validate connectivity and contribute to intelligence when parts of the network go dark and speed up root cause analysis.
Running Amazon Linux 2 on prem on VMware
- 10 January 2021
There is no default ec2-user or root password set for the Amazon Linux 2 ova. You must use cloud-init via it’s nocloud datasource
Error: The maximum number of rules per security group has been reached
- 06 January 2021
How to deal with the error: “The maximum number of rules per security group has been reached.”
AWS Sagegemaker Jupyter Notebook
- 06 December 2020
I wanted to upgrade the version of pandas that comes with AWS Sagemaker Notebook to > 1.1 because this simplify handling of group by with null or NaN values.
OSS logstash with AWS Opendistro for Elasticsearch
- 22 November 2020
To get logstash talking to the Open Distro Elasticsearch the first thing that should be understood is that open distro only works with the OSS (Apache 2.0 Licensed) edition of the Elastic tools and not the Elastic licensed edition (Xpack).
SES Email client for S3
- 19 November 2020
You can conveniently browse the SES mail in S3 using this tool
Logstash ingestion of AWS billing customer usage reports
- 15 November 2020
To get the CUR reports into elastic search:
IAM resource based policy implicit allow
- 28 January 2020
Resource policy are typically used to allow cross account access for resources where it is supported some of which include:
AWS Boto KeyError endpoint_resolver in session.py when using multithreading
- 14 January 2020
When using multithreading in Python with AWS boto to get a session I was randomly hitting this error:
Route 53 Associate multiple private hosted zones with same name
- 10 January 2020
Can I associate multiple private hosted zones with the same domain name to the same VPC?
CloudTrail and VPC Endpoints Logging
- 10 January 2020
Today I learnt that AWS CloudTrail does not log requests that are denied by VPC endpoint policy. The reason for this is that it would allow an attacker to exfiltrate data via CloudTrail.
Cloudformation: Provided Load Balancers may not be valid. Please ensure they exist and try again
- 17 April 2018
Spent too much time troubleshooting the following error but I happy to find the solution for this error: