HarshadRanganathan / harshadranganathan.github.io

Personal Website
MIT License
0 stars 2 forks source link

AWS Solutions #36

Open HarshadRanganathan opened 2 years ago

HarshadRanganathan commented 2 years ago

Architecture https://aws.amazon.com/blogs/architecture/optimize-cost-by-automating-the-start-stop-of-resources-in-non-production-environments/

https://aws.amazon.com/blogs/architecture/understand-resiliency-patterns-and-trade-offs-to-architect-efficiently-in-the-cloud/

https://aws.amazon.com/blogs/architecture/lets-architect-modern-data-architectures/

https://aws.plainenglish.io/most-common-data-architecture-patterns-for-data-engineers-to-know-in-aws-72bc6ea81ed

Networking

https://cloudonaut.io/advanved-aws-networking-pitfalls-that-you-should-avoid/

https://aws.amazon.com/blogs/networking-and-content-delivery/aws-network-optimization-tips/

Containers https://aws.amazon.com/blogs/containers/introducing-security-groups-for-pods/

EMR https://aws.amazon.com/blogs/big-data/best-practices-for-successfully-managing-memory-for-apache-spark-applications-on-amazon-emr/

https://aws.amazon.com/blogs/big-data/doing-more-with-less-moving-from-transactional-to-stateful-batch-processing/

https://aws.amazon.com/blogs/big-data/authorize-sparksql-data-manipulation-on-amazon-emr-using-apache-ranger/

https://aws.amazon.com/blogs/big-data/visualize-data-using-apache-spark-running-on-amazon-emr-with-amazon-quicksight/

https://cevo.com.au/post/develop-and-test-apache-spark-apps-for-emr-locally-using-docker/

https://aws.amazon.com/blogs/devops/a-new-spark-plugin-for-cpu-and-memory-profiling/

EMR Serverless

https://aws.amazon.com/blogs/big-data/run-a-data-processing-job-on-amazon-emr-serverless-with-aws-step-functions/

https://aws.amazon.com/blogs/big-data/amazon-emr-serverless-cost-estimator/

https://medium.com/@maorboublil/benefiting-from-both-standard-and-serverless-emr-fef0d090b006

https://aws.amazon.com/about-aws/whats-new/2023/09/amazon-emr-serverless-application-wide-default-job-configurations/?utm_source=substack&utm_medium=email

EMR on EKS

https://aws.amazon.com/blogs/big-data/configure-amazon-emr-studio-and-amazon-eks-to-run-notebooks-with-amazon-emr-on-eks/

https://aws.amazon.com/blogs/big-data/reduce-costs-and-increase-resource-utilization-of-apache-spark-jobs-on-kubernetes-with-amazon-emr-on-amazon-eks/

https://aws.amazon.com/blogs/big-data/run-and-debug-apache-spark-applications-on-aws-with-amazon-emr-on-amazon-eks/

https://aws.amazon.com/blogs/big-data/run-a-spark-sql-based-etl-pipeline-with-amazon-emr-on-amazon-eks/

https://aws.amazon.com/blogs/containers/using-amazon-emr-on-amazon-eks-for-transient-emr-clusters/

https://aws.amazon.com/blogs/big-data/design-patterns-to-manage-amazon-emr-on-eks-workloads-for-apache-spark/

https://aws.amazon.com/blogs/big-data/run-apache-spark-with-amazon-emr-on-eks-backed-by-amazon-fsx-for-lustre-storage/

https://aws.amazon.com/blogs/big-data/design-considerations-for-amazon-emr-on-eks-in-a-multi-tenant-amazon-eks-environment/

https://aws.amazon.com/blogs/big-data/get-a-quick-start-with-apache-hudi-apache-iceberg-and-delta-lake-with-amazon-emr-on-eks/

Hive https://aws.amazon.com/blogs/big-data/up-to-15-times-improvement-in-hive-write-performance-with-the-amazon-emr-hive-zero-rename-feature/

Athena https://aws.amazon.com/blogs/big-data/improve-reusability-and-security-using-amazon-athena-parameterized-queries/

https://aws.amazon.com/blogs/big-data/improve-amazon-athena-query-performance-using-aws-glue-data-catalog-partition-indexes/

https://aws.amazon.com/blogs/big-data/query-data-in-amazon-opensearch-service-using-sql-from-amazon-athena/

https://aws.amazon.com/blogs/big-data/speed-up-your-amazon-athena-queries-using-partition-projection/

https://dev.to/aws-builders/how-not-to-spend-15000-per-month-with-aws-athena-1fn8

MSK

https://catalog.us-east-1.prod.workshops.aws/workshops/c2b72b6f-666b-4596-b8bc-bafa5dcca741/en-US

https://aws.amazon.com/blogs/big-data/back-up-and-restore-kafka-topic-data-using-amazon-msk-connect/

https://aws.amazon.com/blogs/big-data/best-practices-for-right-sizing-your-apache-kafka-clusters-to-optimize-performance-and-cost/

https://aws.amazon.com/blogs/big-data/evolve-json-schemas-in-amazon-msk-and-amazon-kinesis-data-streams-with-the-aws-glue-schema-registry/

https://aws.amazon.com/blogs/big-data/query-your-amazon-msk-topics-interactively-using-amazon-kinesis-data-analytics-studio/

https://aws.amazon.com/blogs/big-data/power-your-kafka-streams-application-with-amazon-msk-and-aws-fargate/

https://aws.amazon.com/pt/blogs/compute/creating-a-serverless-apache-kafka-publisher-using-aws-lambda/?

https://aws.amazon.com/blogs/big-data/reduce-network-traffic-costs-of-your-amazon-msk-consumers-with-rack-awareness/

https://www.kai-waehner.de/blog/2022/08/30/when-not-to-choose-amazon-msk-serverless-for-apache-kafka/

https://aws.amazon.com/blogs/big-data/ingest-streaming-data-to-apache-hudi-tables-using-aws-glue-and-apache-hudi-deltastreamer/

https://aws.amazon.com/blogs/big-data/use-msk-connect-for-managed-mirrormaker-2-deployment-with-iam-authentication/

https://betterprogramming.pub/aws-serverless-patterns-in-kafka-land-5f317540599a

https://www.kai-waehner.de/blog/2021/09/23/real-time-kappa-architecture-mainstream-replacing-batch-lambda/

https://medium.com/airwalk/amazon-msk-privatelink-solution-for-kafka-clients-with-sasl-iam-sasl-scram-authentication-6376d299b873

https://itnext.io/securely-decoupling-applications-on-amazon-eks-using-kafka-with-sasl-scram-48c340e1ffe9?gi=5c7cb860169a

https://aws.amazon.com/blogs/big-data/deep-dive-on-amazon-msk-tiered-storage/

https://aws.amazon.com/blogs/big-data/best-practices-for-running-production-workloads-using-amazon-msk-tiered-storage/

https://aws.amazon.com/blogs/aws/amazon-msk-introduces-managed-data-delivery-from-apache-kafka-to-your-data-lake

https://aws.amazon.com/blogs/aws/introducing-amazon-msk-replicator-fully-managed-replication-across-msk-clusters-in-same-or-different-aws-regions/

MSK Serverless

https://www.kai-waehner.de/blog/2022/08/30/when-not-to-choose-amazon-msk-serverless-for-apache-kafka

OpenSearch https://aws.amazon.com/blogs/big-data/introducing-cold-storage-for-amazon-opensearch-service/

https://aws.amazon.com/blogs/big-data/choose-the-right-storage-tier-for-your-needs-in-amazon-opensearch-service/

https://aws.amazon.com/blogs/big-data/view-summarized-data-with-amazon-opensearch-service-index-transforms/

https://aws.amazon.com/blogs/big-data/set-advanced-settings-with-the-amazon-opensearch-service-dashboards-api/

https://aws.amazon.com/blogs/big-data/automating-index-state-management-for-amazon-opensearch-service-successor-to-amazon-elasticsearch-service/

https://aws.amazon.com/blogs/big-data/automate-amazon-es-synonym-file-updates/

https://aws.amazon.com/blogs/big-data/monitor-your-amazon-es-domains-with-amazon-elasticsearch-service-monitor/

https://aws.amazon.com/about-aws/whats-new/2022/04/amazon-opensearch-observability-interface-log-analytics/

https://aws.amazon.com/about-aws/whats-new/2022/04/amazon-opensearch-domains-cross-cluster-search/

https://medium.com/@neuw84/integrating-springboot-apps-on-a-secured-amazon-opensearch-application-33760bdaf55a

https://aws.amazon.com/blogs/big-data/part-1-microservice-observability-with-amazon-opensearch-service-trace-and-log-correlation/

https://aws.amazon.com/blogs/big-data/amazon-opensearch-service-under-the-hood-multi-az-with-standby

https://blog.gopenai.com/opensearch-as-vector-db-supercharge-your-llm-fbd90d74c421

https://aws.amazon.com/blogs/big-data/improved-resiliency-with-backpressure-and-admission-control-for-amazon-opensearch-service/

https://opensearch.org/docs/latest/im-plugin/reindex-data/

OR1 instances

https://aws.amazon.com/blogs/aws/introducing-highly-durable-amazon-opensearch-service-clusters-with-30-price-performance-improvement/

OpenSearch Ingestion

https://docs.aws.amazon.com/opensearch-service/latest/developerguide/ingestion.html

OpenSearch Serverless

https://aws.amazon.com/about-aws/whats-new/2023/09/amazon-opensearch-serverless-auto-scaling-query-rates

OpenSearch Pipelines

https://aws.amazon.com/about-aws/whats-new/2023/10/aws-search-pipelines-opensearch/

OpenSearch Zero ETL

https://aws.amazon.com/blogs/aws/amazon-opensearch-service-zero-etl-integration-with-amazon-s3-preview/

DynamoDB Zero ETL

https://aws.amazon.com/blogs/aws/amazon-dynamodb-zero-etl-integration-with-amazon-opensearch-service-is-now-generally-available/

Service Events https://aws.amazon.com/blogs/big-data/audit-aws-service-events-with-amazon-eventbridge-and-amazon-kinesis-data-firehose/

RDS https://aws.amazon.com/blogs/big-data/create-a-low-latency-source-to-data-lake-pipeline-using-amazon-msk-connect-apache-flink-and-apache-hudi/

https://aws.amazon.com/blogs/database/amazon-aurora-postgresql-blue-green-deployment-using-fast-database-cloning/

https://aws.amazon.com/blogs/aws/new-fully-managed-blue-green-deployments-in-amazon-aurora-and-amazon-rds/

https://aws.amazon.com/blogs/devops/leverage-devops-guru-for-rds-to-detect-anomalies-and-resolve-operational-issues/

https://advancedweb.hu/how-to-set-up-amazon-rds-password-rotation-with-terraform/

https://medium.com/contino-engineering/aws-aurora-serverless-v2-whats-new-from-v1-6db64a3afdba

https://aws.amazon.com/blogs/database/improve-performance-of-your-bulk-data-import-to-amazon-rds-for-mysql/

https://advancedweb.hu/how-to-remove-the-rds-master-user-password-from-the-terraform-state/

https://aws.amazon.com/blogs/database/automate-schema-version-control-and-migration-with-flyway-and-aws-lambda-on-amazon-aurora-postgresql

https://sysdig.com/blog/monitoring-amazon-rds/

https://www.percona.com/blog/aws-rds-backups-whats-the-true-cost/

https://aws.amazon.com/blogs/database/modernize-legacy-databases-using-event-sourcing-and-cqrs-with-aws-dms/

https://aws.amazon.com/blogs/database/part-1-10-amazon-aurora-tips-for-application-developers/

https://aws.amazon.com/about-aws/whats-new/2023/10/amazon-relational-database-service-dedicated-log-volume/

https://aws.amazon.com/blogs/database/local-write-forwarding-with-amazon-aurora/

https://aws.amazon.com/blogs/database/amazon-aurora-mysql-version-2-with-mysql-5-7-compatibility-to-version-3-with-mysql-8-0-compatibility-upgrade-checklist-part-1/

Postgresql

https://aws.amazon.com/blogs/database/enable-near-real-time-notifications-from-amazon-aurora-postgresql-by-using-database-triggers-aws-lambda-and-amazon-sns/

https://aws.amazon.com/blogs/database/manage-long-running-read-queries-on-amazon-aurora-postgresql-compatible-edition/

https://aws.amazon.com/blogs/database/create-an-audit-trail-for-an-amazon-aurora-postgresql-table/

https://aws.amazon.com/blogs/database/configure-a-performance-testing-framework-for-amazon-aurora-postgresql/

https://aws.amazon.com/blogs/database/building-ai-powered-search-in-postgresql-using-amazon-sagemaker-and-pgvector/

https://aws.amazon.com/blogs/database/improve-app-performance-through-pipelining-queries-to-amazon-rds-for-postgresql-and-amazon-aurora-postgresql/

https://aws.amazon.com/blogs/database/build-a-centralized-audit-data-collection-for-amazon-rds-for-postgresql-using-amazon-s3-and-amazon-athena/

Datalake https://aws.amazon.com/blogs/big-data/automate-building-data-lakes-using-aws-service-catalog/

https://aws.amazon.com/blogs/big-data/streaming-amazon-dynamodb-data-into-a-centralized-data-lake/

https://aws.amazon.com/blogs/opensource/announcing-the-data-solutions-framework-on-aws/

Kinesis https://aws.amazon.com/blogs/big-data/load-cdc-data-by-table-and-shape-using-amazon-kinesis-data-firehose-dynamic-partitioning/

Log https://aws.amazon.com/blogs/big-data/unify-log-aggregation-and-analytics-across-compute-platforms/

VPC https://aws.amazon.com/blogs/big-data/optimize-performance-and-reduce-costs-for-network-analytics-with-vpc-flow-logs-in-apache-parquet-format/

https://aws.amazon.com/blogs/networking-and-content-delivery/designing-hyperscale-amazon-vpc-networks/

https://aws.amazon.com/blogs/mt/visualize-and-gain-insights-into-your-vpc-flow-logs-with-amazon-managed-grafana/

VPC lattice

https://aws.amazon.com/blogs/aws/introducing-vpc-lattice-simplify-networking-for-service-to-service-communication-preview/

https://aws.amazon.com/blogs/containers/build-secure-application-networks-with-vpc-lattice-amazon-ecs-and-aws-lambda/

https://aws.amazon.com/blogs/compute/building-private-serverless-apis-with-aws-lambda-and-amazon-vpc-lattice/

https://awstip.com/amazon-vpc-lattice-is-not-a-service-mesh-its-more-89ab4d7e361b

https://aws.amazon.com/blogs/networking-and-content-delivery/automating-large-scale-deployments-with-tags-for-amazon-vpc-lattice/

ETL https://aws.amazon.com/blogs/big-data/build-and-orchestrate-etl-pipelines-using-amazon-athena-and-aws-step-functions/

S3 https://aws.amazon.com/blogs/big-data/create-amazon-s3-storage-lens-metrics-dashboard-amazon-quicksight/

https://aws.amazon.com/blogs/storage/reduce-storage-costs-with-fewer-noncurrent-versions-using-amazon-s3-lifecycle/

https://aws.amazon.com/blogs/infrastructure-and-automation/manage-amazon-s3-event-notifications-using-lambda-function/

https://www.duckbillgroup.com/blog/s3-intelligent-tiering-what-it-takes-to-actually-break-even/

https://aws.amazon.com/blogs/storage/optimize-storage-costs-with-new-amazon-s3-lifecycle-filters-and-actions/

https://aws.amazon.com/blogs/storage/manage-amazon-s3-storage-costs-granularly-and-at-scale-using-s3-intelligent-tiering/

https://medium.com/insiderengineering/apache-iceberg-reduced-our-amazon-s3-cost-by-90-997cde5ce931

https://aws.amazon.com/blogs/compute/patterns-for-building-an-api-to-upload-files-to-amazon-s3/

https://aws.amazon.com/s3/features/access-points/

https://aws.amazon.com/s3/features/mountpoint/

Glacier

https://aws.amazon.com/blogs/aws/new-improve-amazon-s3-glacier-flexible-restore-time-by-up-to-85-using-standard-retrieval-tier-and-s3-batch-operations/

EKS

https://aws.amazon.com/de/blogs/containers/bootstrapping-clusters-with-eks-blueprints/

https://aws.github.io/aws-eks-best-practices/

https://aws.amazon.com/blogs/mt/introducing-amazon-eks-observability-accelerator/

https://aws-controllers-k8s.github.io/community/docs/community/overview/

https://aws.amazon.com/blogs/containers/addressing-latency-and-data-transfer-costs-on-eks-using-istio/

https://aws.amazon.com/blogs/containers/metrics-and-traces-collection-using-amazon-eks-add-ons-for-aws-distro-for-opentelemetry/

https://aws.amazon.com/blogs/containers/using-aws-load-balancer-controller-for-blue-green-deployment-canary-deployment-and-a-b-testing/

https://aws.amazon.com/blogs/containers/load-testing-your-workload-running-on-amazon-eks-with-locust/

https://aws.amazon.com/blogs/containers/seamlessly-migrate-workloads-from-eks-self-managed-node-group-to-eks-managed-node-groups/

https://aws.amazon.com/blogs/containers/customizing-scheduling-on-amazon-eks/

https://aws.amazon.com/blogs/containers/using-iam-database-authentication-with-workloads-running-on-amazon-eks/

https://aws.amazon.com/blogs/containers/using-aws-load-balancer-controller-for-blue-green-deployment-canary-deployment-and-a-b-testing/

https://aws.amazon.com/blogs/containers/managing-pod-scheduling-constraints-and-groupless-node-upgrades-with-karpenter-in-amazon-eks/

https://medium.com/summit-technology-group/karpenter-autoscaling-and-right-sizing-eks-nodes-bc6d2b83d48e

https://aws.amazon.com/blogs/compute/applying-spot-to-spot-consolidation-best-practices-with-karpenter/

https://aws.amazon.com/blogs/containers/how-costar-uses-karpenter-to-optimize-their-amazon-eks-resources/

https://aws.amazon.com/blogs/containers/how-to-upgrade-amazon-eks-worker-nodes-with-karpenter-drift/

https://medium.com/@zeeshanijaz086/karpenter-hacks-customize-control-9a94e7ae21d3

https://aws.amazon.com/blogs/containers/deliver-namespace-as-a-service-multi-tenancy-for-amazon-eks-using-karpenter/

https://aws.amazon.com/blogs/containers/scalable-and-cost-effective-event-driven-workloads-with-keda-and-karpenter-on-amazon-eks/

https://aws.amazon.com/blogs/containers/optimize-az-traffic-costs-using-amazon-eks-karpenter-and-istio/

https://aws.amazon.com/about-aws/whats-new/2024/02/disruption-controls-karpenter/#:~:text=Starting%20with%20today's%20release%20of,instances%20in%20their%20Kubernetes%20clusters.

https://medium.com/@zghanem/leveraging-on-demand-spot-ratio-split-technique-for-splitting-a-workload-across-on-demand-and-spot-2bc3b9301c22

https://aws.amazon.com/blogs/containers/how-to-expose-multiple-applications-on-amazon-eks-using-a-single-application-load-balancer/

https://aws.amazon.com/blogs/containers/how-to-leverage-application-load-balancers-advanced-request-routing-to-route-application-traffic-across-multiple-amazon-eks-clusters/

https://aws.amazon.com/blogs/containers/cloud-native-ci-cd-with-tekton-and-argocd-on-aws/

https://aws.amazon.com/blogs/containers/gitops-model-for-provisioning-and-bootstrapping-amazon-eks-clusters-using-crossplane-and-flux/

https://aws.amazon.com/blogs/containers/secure-end-to-end-traffic-on-amazon-eks-using-tls-certificate-in-acm-alb-and-istio/

https://aws.amazon.com/blogs/containers/serve-distinct-domains-with-tls-powered-by-acm-on-amazon-eks/

https://aws.amazon.com/blogs/containers/how-to-use-application-load-balancer-and-amazon-cognito-to-authenticate-users-for-your-kubernetes-web-apps/

https://aws.amazon.com/blogs/containers/backup-and-restore-your-amazon-eks-cluster-resources-using-velero/

https://aws.amazon.com/blogs/containers/leveraging-amazon-eks-managed-node-group-with-placement-group-for-low-latency-critical-applications/

https://aws.amazon.com/blogs/containers/implementing-the-saga-orchestration-pattern-with-amazon-eks-and-amazon-sns/

https://aws.amazon.com/blogs/containers/fluentd-considerations-and-actions-required-at-scale-in-amazon-eks/

https://aws.amazon.com/blogs/containers/a-multi-cluster-shared-services-architecture-with-amazon-eks-using-cilium-clustermesh/

https://aws.amazon.com/blogs/containers/integrate-amazon-api-gateway-with-amazon-eks/

https://aws.amazon.com/blogs/containers/policy-based-countermeasures-for-kubernetes-part-2/

https://aws.amazon.com/blogs/containers/policy-based-countermeasures-for-kubernetes-part-1/

https://aws.amazon.com/blogs/devops/automate-container-anomaly-monitoring-of-amazon-elastic-kubernetes-service-clusters-with-amazon-devops-guru/

https://aws.amazon.com/blogs/containers/customizing-scheduling-on-amazon-eks/

https://itnext.io/build-an-eks-cluster-with-terraform-d35db8005963

https://eng.grip.security/enabling-aws-iam-group-access-to-an-eks-cluster-using-rbac

https://aws.amazon.com/blogs/containers/kubernetes-cluster-upgrade-the-blue-green-deployment-strategy/

https://aws.amazon.com/blogs/containers/scaling-kubernetes-with-karpenter-advanced-scheduling-with-pod-affinity-and-volume-topology-awareness/

https://aws.amazon.com/blogs/containers/using-amazon-ebs-snapshots-for-persistent-storage-with-your-amazon-eks-cluster-by-leveraging-add-ons/

https://tomharrisonjr.com/aws-eks-managed-node-groups-via-terraform-b1e78f9d7273

https://aws.amazon.com/blogs/containers/maximizing-gpu-utilization-with-nvidias-multi-instance-gpu-mig-on-amazon-eks-running-more-pods-per-gpu-for-enhanced-performance/

https://medium.com/@fkafri/graceful-termination-of-django-and-celery-worker-pods-in-kubernetes-a5af1203258a

https://opssorry.substack.com/p/gitops-a-simple-approach-to-using

https://medium.com/@monica.colangelo/how-to-expose-multiple-applications-on-amazon-eks-with-a-single-application-load-balancer-c083671fe4e6

https://medium.com/geekculture/kubernetes-distributing-pods-evenly-across-cluster-c6bdc9b49699

https://blog.runx.dev/will-that-kubernetes-v1-22-upgrade-break-my-application-cc339dc2e2c7

https://aws.amazon.com/blogs/containers/continuous-deployment-and-gitops-delivery-with-amazon-eks-blueprints-and-argocd/

https://medium.com/@chauhanhimani512/install-argocd-on-the-eks-cluster-and-configure-sync-with-the-github-manifest-repository-9e3d62e1c093

https://aws.amazon.com/blogs/containers/managing-kubernetes-control-plane-events-in-amazon-eks/

https://aws.amazon.com/blogs/containers/aws-and-kubecost-collaborate-to-deliver-cost-monitoring-for-eks-customers/

https://medium.com/geekculture/kubernetes-distributing-pods-evenly-across-cluster-c6bdc9b49699

https://aws.amazon.com/blogs/mt/announcing-aws-observability-accelerator-to-configure-comprehensive-observability-for-amazon-eks/

https://aws.amazon.com/blogs/containers/understanding-and-cost-optimizing-amazon-eks-control-plane-logs/

https://aws.amazon.com/blogs/security/use-aws-network-firewall-to-filter-outbound-https-traffic-from-applications-hosted-on-amazon-eks/

https://aws.amazon.com/blogs/containers/implementing-pod-security-standards-in-amazon-eks/

https://aws.amazon.com/blogs/containers/amazon-eks-add-ons-preserve-customer-edits/

https://aws.amazon.com/blogs/storage/persistent-storage-for-kubernetes/

https://aws.amazon.com/blogs/containers/transparent-encryption-of-node-to-node-traffic-on-amazon-eks-using-wireguard-and-cilium/

https://aws.amazon.com/blogs/containers/managing-pod-security-on-amazon-eks-with-kyverno/

https://aws.amazon.com/blogs/big-data/use-karpenter-to-speed-up-amazon-emr-on-eks-autoscaling/

https://aws.amazon.com/blogs/containers/eliminate-kubernetes-node-scaling-lag-with-pod-priority-and-over-provisioning/

https://aws.amazon.com/blogs/containers/exposing-kubernetes-applications-part-2-aws-load-balancer-controller/

https://devopslearning.medium.com/lesson-learned-while-scaling-kubernetes-cluster-to-1000-pods-in-aws-eks-d2d399152bc2

https://blog.symops.com/2023/02/16/access-eks-rbac-aws-iam/

https://aws.amazon.com/blogs/containers/how-to-rapidly-scale-your-application-with-alb-on-eks-without-losing-traffic/

https://medium.com/@nithinjohn97/maximizing-cost-efficiency-with-karpenter-setting-up-eks-cluster-v1-24-b68bbd64f23c

https://aws.amazon.com/about-aws/whats-new/2023/03/aws-resilience-hub-amazon-eks/

https://aws.amazon.com/blogs/containers/managing-etcd-database-size-on-amazon-eks-clusters/

https://aws.amazon.com/blogs/containers/a-deeper-look-at-ingress-sharing-and-target-group-binding-in-aws-load-balancer-controller/

https://aws.amazon.com/blogs/containers/part-1-build-multi-cluster-gitops-using-amazon-eks-flux-cd-and-crossplane/

https://aws.amazon.com/blogs/containers/part-3-multi-cluster-gitops-application-onboarding/

https://awslabs.github.io/data-on-eks/

https://aws.amazon.com/blogs/containers/a-deeper-look-at-ingress-sharing-and-target-group-binding-in-aws-load-balancer-controller/

https://aws.amazon.com/blogs/containers/start-pods-faster-by-prefetching-images/

https://aws-observability.github.io/terraform-aws-observability-accelerator/eks/multicluster/

https://aws.github.io/aws-eks-best-practices/upgrades/

https://aws.amazon.com/about-aws/whats-new/2023/06/amazon-ecr-registry-k8s-io-upstream-pull-through-cache-repositories/

https://aws.amazon.com/blogs/containers/all-you-need-to-know-about-moving-to-containerd-on-amazon-eks/

https://aws.amazon.com/blogs/containers/multi-cluster-cost-monitoring-using-kubecost-with-amazon-eks-and-amazon-managed-service-for-prometheus/

https://aws.amazon.com/blogs/aws/amazon-managed-service-for-prometheus-collector-provides-agentless-metric-collection-for-amazon-eks/

https://aws.amazon.com/blogs/opensource/kubernetes-multi-cluster-service-discovery-using-open-source-aws-cloud-map-mcs-controller/

https://aws.amazon.com/blogs/storage/simplifying-amazon-ebs-volume-migration-and-modification-using-the-ebs-csi-driver/

https://aws.amazon.com/blogs/containers/all-you-need-to-know-about-moving-to-containerd-on-amazon-eks/

https://medium.com/binome/connection-pooling-and-intermittent-failures-in-k8s-9d1c89fbb50a

https://aws.amazon.com/blogs/containers/scale-from-100-to-10000-pods-on-amazon-eks/

https://itnext.io/efficient-kubernetes-cluster-deployment-accelerating-setup-with-eks-blueprints-68324b582ec9

https://medium.com/@danielresponda/testing-spot-reclamation-mechanisms-with-aws-node-termination-handler-and-kubernetes-autoscaler-43194d05dae0

https://edubonifs.github.io/multicluster-canary/

https://medium.com/@ozkanpoyrazoglu/configuring-eks-vpc-in-aws-tackling-ip-exhaustion-head-on-6c6204358568

https://medium.com/propertyfinder-engineering/unveiling-the-speed-mystery-investigating-slow-s3-uploads-from-aws-eks-pods-9bb676ef538e

https://aws.amazon.com/blogs/containers/deploy-generative-ai-models-on-amazon-eks/

https://aws.amazon.com/blogs/aws/amazon-eks-pod-identity-simplifies-iam-permissions-for-applications-on-amazon-eks-clusters/

https://community.aws/content/2amNz5BayUPTJP5QvMC6BCqc5LF/eks-pod-identities-explained-managing-aws-credentials-in-kubernetes-pods

https://community.aws/content/2achiN65CPtN9KwnfYMBaJ0ev4S/exploring-the-new-eks-pod-identity-associations

https://securitylabs.datadoghq.com/articles/eks-pod-identity-deep-dive/

https://www.mitiga.io/blog/how-aws-eks-pod-identity-feature-enhances-credential-management

https://securitylabs.datadoghq.com/articles/eks-cluster-access-management-deep-dive/

https://aws.amazon.com/blogs/security/how-to-use-aws-secrets-manager-and-abac-for-enhanced-secrets-management-in-amazon-eks/

https://aws.amazon.com/blogs/containers/using-crac-to-reduce-java-startup-times-on-amazon-eks/#:~:text=Coordinated%20Restore%20at%20Checkpoint%20(CRaC,time%20(%E2%80%9Ccheckpoint%E2%80%9D).

https://aws.amazon.com/blogs/opensource/using-istio-traffic-management-to-enhance-user-experience/

https://aws.amazon.com/blogs/containers/introducing-security-groups-for-pods/

Spark https://aws.amazon.com/blogs/big-data/build-a-sql-based-etl-pipeline-with-apache-spark-on-amazon-eks/

https://aws.amazon.com/blogs/devops/a-new-spark-plugin-for-cpu-and-memory-profiling/

https://itnext.io/wrong-spark-configuration-that-cost-us-3k-month-dc21f2a0a113

https://aws.amazon.com/blogs/big-data/introducing-amazon-emr-on-eks-job-submission-with-spark-operator-and-spark-submit/

Airflow https://aws.amazon.com/blogs/big-data/manage-and-process-your-big-data-workflows-with-amazon-mwaa-and-amazon-emr-on-amazon-eks/

SNS

https://aws.amazon.com/blogs/compute/introducing-payload-based-message-filtering-for-amazon-sns/

SQS

https://bitesizedserverless.com/bite/implement-the-priority-queue-pattern-with-sqs-and-lambda/

https://blog.serverlessq.com/aws-sns-vs-sqs-what-are-the-main-differences?

https://aws.amazon.com/blogs/compute/understanding-how-aws-lambda-scales-when-subscribed-to-amazon-sqs-queues/

https://aws.amazon.com/blogs/compute/estimating-cost-for-amazon-sqs-message-processing-using-aws-lambda/

https://medium.com/@connorbutch/avoid-this-incredibly-common-aws-sqs-mistake-f5b9e0311e59

https://aws.amazon.com/blogs/compute/introducing-attribute-based-access-controls-abac-for-amazon-sqs/

Backend for frontend

https://d1.awsstatic.com/architecture-diagrams/ArchitectureDiagrams/backend-for-frontend-using-api-gateway-ra.pdf

MicroFrontend

https://aws.amazon.com/blogs/compute/server-side-rendering-micro-frontends-the-architecture/

Cloudwatch

https://aws.amazon.com/blogs/infrastructure-and-automation/reduce-log-storage-costs-by-automating-retention-settings-in-amazon-cloudwatch/

https://aws.amazon.com/blogs/mt/delete-empty-cloudwatch-log-steams/

https://bit.kevinslin.com/p/youre-paying-too-much-for-cloudwatch

Step Functions

https://aws.amazon.com/blogs/architecture/use-direct-service-integrations-to-optimize-your-architecture/

https://betterprogramming.pub/a-data-engineers-perspective-on-aws-managed-airflow-and-aws-step-function-state-machine-d4d11517e042

https://cloudonaut.io/step-functions-pitfall-maximum-number-of-history-events/

https://aws.amazon.com/blogs/compute/building-cost-effective-aws-step-functions-workflows/

https://www.readysetcloud.io/blog/allen.helton/success-with-step-functions/

https://dev.to/cremich/aws-step-function-vs-aws-lambda-benchmark-4f41

https://medium.com/aws-lambda-serverless-developer-guide-with-hands/saga-pattern-for-orchestrate-distributed-transactions-using-aws-step-functions-2513db0de84e

https://aws.amazon.com/blogs/aws/step-functions-distributed-map-a-serverless-solution-for-large-scale-parallel-data-processing/

https://dev.to/aws-builders/avoiding-the-serverless-workflow-antipattern-2ba1

https://www.binaryheap.com/testing-step-function-workflows-locally/

https://towardsaws.com/step-functions-is-a-powerful-aws-product-an-addictive-substance-please-refrain-from-abusing-it-b1b4a1696552

https://blog.theserverlessterminal.com/series/aws-step-functions

https://arpadt.com/articles/error-handling-in-step-functions

https://awstip.com/stay-compliant-with-aws-step-functions-iam-users-access-key-age-notification-44ce2dd600b7

https://theburningmonk.com/2023/06/testing-step-functions-how-to-skip-time-when-testing-timeout-and-wait-states/

https://www.tecracer.com/blog/2023/08/handling-errors-and-retries-in-stepfunctions.html

https://aws.amazon.com/blogs/compute/enhancing-workflow-studio-with-new-features-for-streamlined-authoring/

https://blog.theserverlessterminal.com/the-jitter-strategy-for-step-functions-error-retries-on-the-new-workflow-studio

Multi-Region https://aws.amazon.com/blogs/networking-and-content-delivery/latency-based-routing-leveraging-amazon-cloudfront-for-a-multi-region-active-active-architecture/

https://aws.amazon.com/blogs/developer/10322-2/

Route53 https://aws.amazon.com/blogs/networking-and-content-delivery/creating-disaster-recovery-mechanisms-using-amazon-route-53/

https://aws.amazon.com/blogs/networking-and-content-delivery/building-highly-resilient-applications-using-amazon-route-53-application-recovery-controller-part-2-multi-region-stack/

https://aws.amazon.com/blogs/aws/zonal-autoshift-automatically-shift-your-traffic-away-from-availability-zones-when-we-detect-potential-issues/

Lambda

https://medium.com/i-love-my-local-farmer-engineering-blog/choosing-a-packaging-mechanism-for-java-based-aws-lambda-functions-2f006c72c605

https://aws.amazon.com/blogs/compute/introducing-aws-lambda-destinations/

https://aws.amazon.com/blogs/compute/understanding-how-aws-lambda-scales-when-subscribed-to-amazon-sqs-queues

https://aws.amazon.com/blogs/compute/accelerating-serverless-development-with-aws-sam-accelerate/

https://aws.amazon.com/fr/blogs/compute/understanding-aws-lambda-scaling-and-throughput/

https://aws.amazon.com/blogs/compute/scaling-aws-lambda-permissions-with-attribute-based-access-control-abac/

https://blog.symphonia.io/posts/2022-07-20_lambda_event_routing

https://aws.amazon.com/blogs/compute/securely-retrieving-secrets-with-aws-lambda/

https://medium.com/i-love-my-local-farmer-engineering-blog/connecting-your-java-aws-lambda-to-an-rds-database-and-rds-proxy-4512a3ba1c3d

https://towardsaws.com/lambda-event-filtering-with-sqs-cd4dd0f600db

https://enrico-portolan.medium.com/the-lambda-circuit-breaker-pattern-b3b436873ee3

https://aws.amazon.com/blogs/compute/building-aws-lambda-governance-and-guardrails/

https://awstip.com/monitoring-lambdas-using-aws-powertools-1d11c0157c8e

https://aws.amazon.com/blogs/compute/using-custom-consumer-group-id-support-for-the-aws-lambda-event-sources-for-msk-and-self-managed-kafka/

https://medium.com/@tshepomakhubela/unzip-large-files-from-s3-with-lambda-ee2555fd41b3

https://aws.amazon.com/blogs/apn/building-serverless-saas-microservices-with-aws-lambda-layers/

https://aws.amazon.com/blogs/architecture/extending-your-saas-platform-with-aws-lambda/

https://www.thedevtavern.com/blog/posts/5-things-that-will-change-the-way-you-use-aws-lambda/

https://medium.com/aws-lambda-serverless-developer-guide-with-hands

https://rieckpil.de/java-aws-lambda-container-image-support-complete-guide/

https://cloudash.dev/blog/guide-to-lambda-function-urls

https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/CloudWatch_Embedded_Metric_Format_Specification.html

https://dev.to/aws-heroes/aws-lambda-storage-options-o5p

https://aws.amazon.com/blogs/compute/integrating-amazon-memorydb-for-redis-with-java-based-aws-lambda/

https://www.miketheman.net/2022/10/04/reduce-aws-lambda-latencies-with-keep-alive-in-python/

https://moiadev.medium.com/when-lambda-deployments-arent-zero-downtime-and-how-to-fix-it-e53e37f1c17

https://docs.aws.amazon.com/secretsmanager/latest/userguide/retrieving-secrets_lambda.html

https://docs.aws.amazon.com/systems-manager/latest/userguide/ps-integration-lambda-extensions.html

https://aws.amazon.com/blogs/opensource/a-container-free-way-to-configure-kubernetes-using-aws-lambda/

https://blog.misterspex.tech/optimizing-aws-lambda-for-mass-data-import-4935b1dce332

https://jeromevdl.medium.com/when-to-use-a-lambda-function-and-when-not-9a225e6dd2dd

https://aws.amazon.com/blogs/aws/new-accelerate-your-lambda-functions-with-lambda-snapstart/

https://aws.amazon.com/blogs/compute/using-the-aws-parameter-and-secrets-lambda-extension-to-cache-parameters-and-secrets/

https://aws.amazon.com/blogs/compute/introducing-the-aws-lambda-telemetry-api

https://lumigo.io/blog/lambda-telemetry-api-a-new-way-to-process-lambda-telemetry-data-in-real-time/

https://www.ranthebuilder.cloud/post/build-aws-lambda-container-image-with-aws-cdk

https://aws.amazon.com/blogs/compute/aws-lambda-resilience-under-the-hood/

https://aws.amazon.com/blogs/compute/introducing-maximum-concurrency-of-aws-lambda-functions-when-using-amazon-sqs-as-an-event-source/

https://aws.amazon.com/blogs/compute/developing-portable-aws-lambda-functions/

https://www.ranthebuilder.cloud/post/aws-lambda-layers-best-practices

https://dev.to/aws-heroes/stop-using-lambda-layers-use-this-instead-46o0

https://theburningmonk.com/2021/05/lambda-layer-not-a-package-manager-but-a-deployment-optimization/

https://georgemao.medium.com/top-best-practices-you-should-follow-when-building-with-aws-lambda-e6ad577c99b0

https://georgemao.medium.com/top-things-you-should-avoid-when-building-with-aws-lambda-24a393033579

https://sodkiewiczm.medium.com/aws-opentelemetry-e553de8cadf

https://aws.amazon.com/blogs/compute/introducing-aws-lambda-response-streaming/

https://aws.amazon.com/blogs/compute/introducing-aws-lambda-response-streaming/

https://medium.com/@pubudusj/self-healing-serverless-app-with-lambda-destinations-and-eventbridge-b548d4554df0

https://speakerdeck.com/jeromevdl/when-to-use-a-lambda-function-and-when-not?slide=42

https://aws.amazon.com/blogs/compute/understanding-aws-lambdas-invoke-throttle-limits/

https://sbrisals.medium.com/lambda-vs-lambdas-de88a33f8536

https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/lambda-rds-connect.html

https://aaronstuyvenberg.com/posts/understanding-proactive-initialization

https://aws.amazon.com/about-aws/whats-new/2023/08/amazon-rds-connectivity-rds-aurora-database-lambda

https://www.concurrencylabs.com/blog/how-to-operate-aws-lambda/

https://medium.com/@pooyan_razian/stop-using-aws-lambda-for-everything-9d9b2d3a9763

https://aws.amazon.com/about-aws/whats-new/2023/11/aws-lambda-auto-scaling-kafka-event-sources/

https://aws.amazon.com/blogs/compute/scaling-improvements-when-processing-apache-kafka-with-aws-lambda/

https://aws.amazon.com/blogs/aws/aws-lambda-functions-now-scale-12-times-faster-when-handling-high-volume-requests/

https://community.aws/posts/improved-lambda-warm-start-speed-95

https://blog.bitsrc.io/amazon-api-gateway-vs-function-urls-2b6940168c21

https://aws.amazon.com/blogs/compute/re-platforming-java-applications-using-the-updated-aws-serverless-java-container/

Java

https://aws.amazon.com/blogs/developer/announcing-availability-of-the-aws-crt-http-client-in-the-aws-sdk-for-java-2-x/

https://medium.com/@geethika.guruge/the-good-bad-the-ugly-of-aws-lambda-e06df5930a9

https://aws.amazon.com/blogs/compute/developing-portable-aws-lambda-functions/

EC2

https://aws.amazon.com/blogs/compute/implementing-attribute-based-instance-type-selection-using-terraform/

https://aws.amazon.com/blogs/compute/simplifying-amazon-ec2-instance-type-flexibility-with-new-attribute-based-instance-type-selection-features/

https://cloudonaut.io/ec2-instances-2-0-time-to-update-your-toolbox/

Spot Instances

https://aws.amazon.com/blogs/compute/optimizing-amazon-ec2-spot-instances-with-spot-placement-scores/

https://pauley.me/post/2023/spot-price-trends/

https://cloudonaut.io/fallback-to-on-demand-ec2-instances-if-spot-capacity-is-unavailable/

https://leanercloud.beehiiv.com/p/thoughts-current-state-ec2-spot-pricing

https://aws.amazon.com/blogs/compute/best-practices-to-optimize-your-amazon-ec2-spot-instances-usage/

IDE

https://aws.amazon.com/visualstudiocode/

Misc

https://aws.amazon.com/solutions/implementations/aws-perspective/

https://aws.amazon.com/blogs/opensource/dashboards-as-code-a-new-approach-to-visualizing-aws-apis/

https://aws.amazon.com/blogs/compute/visualize-and-create-your-serverless-workloads-with-aws-application-composer/

https://aws.amazon.com/blogs/compute/enriching-operational-events-with-aws-serverless/

DynamoDB

https://aws.amazon.com/blogs/database/large-object-storage-strategies-for-amazon-dynamodb/

https://medium.com/@b.stoilov/what-ive-learned-from-using-aws-dynamodb-in-production-for-more-than-3-years-49a077886b5c

https://aws.amazon.com/blogs/database/amazon-dynamodb-can-now-import-amazon-s3-data-into-a-new-table/

https://www.alexdebrie.com/posts/dynamodb-paper/

DynamoDB: Under the hood, managing throughput, advanced design patterns - https://www.youtube.com/watch?v=0iGR8GnIItQ

https://aws.amazon.com/blogs/database/build-a-cqrs-event-store-with-amazon-dynamodb/

https://medium.com/@josh.armitage/the-quest-for-serverless-cqrs-part-2-78ab8c806785

https://aws.amazon.com/blogs/database/the-five-most-visited-amazon-dynamodb-blog-posts-of-2022/

https://medium.com/@zhaoyi0113/dynamodb-how-to-design-your-data-relationship-fit-into-one-table-part-1-99be52681338

https://aws.amazon.com/blogs/database/single-table-vs-multi-table-design-in-amazon-dynamodb/

https://aws.amazon.com/blogs/database/overview-of-building-resilient-applications-with-amazon-dynamodb-global-tables/

https://thenewstack.io/iso-better-scaling-instacart-drops-postgres-for-amazon-dynamodb/

https://betterprogramming.pub/how-to-scan-a-23-gb-dynamodb-table-in-1-minute-110730879e2b

https://www.boyney.io/blog/2022-11-03-eventbridge-events-with-dynamodb

https://aws.amazon.com/blogs/database/use-guardrails-to-protect-dynamodb-tables/

https://medium.com/@almirx101/dynamodb-nosql-one-practice-that-can-save-you-in-the-future-8cec55dcef8e

https://www.alexdebrie.com/posts/dynamodb-costs

https://medium.com/@deeptimittalblogger/dynamodb-data-partitioning-is-the-secret-sauce-c810eb9f80ca

https://dev.to/aws-builders/there-is-no-right-or-wrong-as-long-as-it-works-actually-how-you-use-dynamodb-makes-a-lot-of-difference-2668

https://dev.to/aws-builders/there-is-no-right-or-wrong-as-long-as-it-works-actually-how-you-use-dynamodb-makes-a-lot-of-difference-2668

https://aws.amazon.com/blogs/database/generate-a-distinct-set-of-partition-keys-for-an-amazon-dynamodb-table-efficiently/#:~:text=Scan%20the%20whole%20table,No%20items%20are%20needlessly%20read.

https://aws.amazon.com/about-aws/whats-new/2023/09/incremental-export-s3-amazon-dynamodb

https://aws.amazon.com/blogs/database/archive-to-cold-storage-with-amazon-dynamodb/

https://medium.com/@tommuc/dynamodb-mistakes-we-made-so-you-dont-have-to-cc7687d4b3bf

https://www.gomomento.com/blog/single-table-design-for-dynamodb-the-reality

DynamoDB Streams

https://www.alexdebrie.com/bites/dynamodb-streams/

API Gateway

https://dev.to/aws-builders/better-error-messages-for-non-existing-api-resources-with-amazon-api-gateway-50pb

https://www.readysetcloud.io/blog/allen.helton/direct-connections-with-api-gateway/

https://medium.com/@wrennkieran/why-i-would-have-a-single-api-gateway-endpoint-per-microservice-7d9295aad60c

https://medium.com/@paul.santus/deploy-a-simple-data-storage-api-with-very-little-code-using-amazon-api-gateway-and-dynamodb-a00e9e03672

https://robertbulmer.medium.com/storage-first-pattern-in-aws-with-api-gateway-part-1-using-s3-216e20b08353

IAM

https://aws.amazon.com/es/blogs/security/extend-aws-iam-roles-to-workloads-outside-of-aws-with-iam-roles-anywhere/

https://medium.com/lego-engineering/providing-on-demand-temporary-time-based-attribute-based-and-least-privilege-access-to-aws-e774ccdce09

https://aws.amazon.com/blogs/security/how-to-centralize-findings-and-automate-deletion-for-unused-iam-roles/

Event Bridge

https://aws.amazon.com/blogs/compute/building-an-event-driven-application-with-amazon-eventbridge/

https://matt.martz.codes/orchestrating-choreography-with-event-driven-step-functions

https://aws.amazon.com/about-aws/whats-new/2022/08/amazon-eventbridge-supports-receiving-events-github-stripe-twilio-using-webhooks/

https://puistikko.fi/posts/eventbridge-debug/

https://aws.amazon.com/blogs/aws/new-create-point-to-point-integrations-between-event-producers-and-consumers-with-amazon-eventbridge-pipes/

https://www.binaryheap.com/dynamodb-eventbridge-pipes-enrichment/

https://aws.amazon.com/blogs/compute/introducing-amazon-eventbridge-scheduler/

https://www.eliasbrange.dev/posts/debug-dynamodb-with-eventbridge-pipes-and-cloudwatch/

https://cbannes.medium.com/decoupling-microservices-with-aws-eventbridge-pipes-3cef3a1dfce7

https://awstip.com/is-eventbridge-pipes-the-missing-piece-in-your-event-driven-puzzle-79defe9f225b

https://blog.theserverlessterminal.com/amazon-eventbridge-the-missing-piece-to-your-app

https://theburningmonk.com/2023/02/the-biggest-problem-with-eventbridge-scheduler-and-how-to-fix-it

https://alatech.medium.com/eventbridge-pipes-a-comparison-before-and-after-d6fac1a4e9b6

https://blog.theserverlessterminal.com/amazon-eventbridge-the-missing-piece-to-your-app

https://aws.amazon.com/blogs/compute/implementing-architectural-patterns-with-amazon-eventbridge-pipes/

https://headforthe.cloud/article/lost-in-translation/

https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-patterns-best-practices.html

https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-rules-best-practices.html

https://aws.amazon.com/blogs/compute/decoupling-event-publishing-with-amazon-eventbridge-pipes/

https://aws.amazon.com/blogs/compute/filtering-events-in-amazon-eventbridge-with-wildcard-pattern-matching/

https://aws.amazon.com/blogs/compute/introducing-amazon-eventbridge-scheduler/

Security

https://aws.amazon.com/blogs/security/top-2021-aws-security-service-launches-part-1/

https://aws.amazon.com/blogs/security/top-2021-aws-service-launches-security-professionals-should-review-part-2/

Cost

https://aws.amazon.com/blogs/architecture/journey-to-cloud-native-architecture-series-6-improve-cost-visibility-and-re-architect-for-cost-optimization/

https://cloudonaut.io/aws-cost-optimization-101/

https://www.wellarchitectedlabs.com/cost/200_labs/200_cloud_intelligence/compute-optimizer-dashboards/

https://jeewansooriyaarachchi.medium.com/tips-for-saving-aws-eks-cost-519b06595deb

https://aws.amazon.com/blogs/storage/manage-amazon-s3-storage-costs-granularly-and-at-scale-using-s3-intelligent-tiering/

https://medium.com/empathyco/cloud-finops-part-4-kubernetes-cost-report-b4964be02dc3

Optimizations

https://aws.amazon.com/blogs/architecture/journey-to-adopt-cloud-native-architecture-series-2-maximizing-system-throughput/

https://aws.amazon.com/blogs/architecture/journey-to-adopt-cloud-native-architecture-series-3-improved-resilience-and-standardized-observability/

https://aws.amazon.com/blogs/architecture/optimizing-your-aws-infrastructure-for-sustainability-part-iv-databases/

Email

https://engineering.hashnode.com/mass-personalised-emails-using-aws-serverless

Auth https://blog.symphonia.io/posts/2022-07-20_lambda_event_routing

Fargate https://aws.amazon.com/blogs/containers/optimize-your-spring-boot-application-for-aws-fargate/

DynamoDb

https://enlear.academy/using-dynamodb-for-your-next-application-ed343b2aac59

https://medium.com/@jvroig.cascadeo/dynamodb-partiql-is-fun-but-dangerous-fec0f2803220

Patterns

https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/welcome.html

https://leejamesgilmore.medium.com/storage-first-serverless-solutions-c0fc182243b9

https://aws.amazon.com/blogs/architecture/web-application-access-control-patterns-using-aws-services/

Fargate

https://aws.amazon.com/blogs/containers/optimize-your-spring-boot-application-for-aws-fargate/

Batch

https://aws.amazon.com/blogs/database/replace-self-managed-database-scheduler-batch-jobs-using-aws-native-solutions/

Sagemaker

https://towardsaws.com/git-collaboration-in-amazon-sagemaker-studio-5d741589396f

https://docs.aws.amazon.com/sagemaker/latest/dg/studio-notebooks-emr-cluster-connect.html

https://catalog.workshops.aws/sagemaker-studio-emr/en-US/01-interacting-emr-cluster/01-creating

https://aws.amazon.com/blogs/machine-learning/part-1-create-and-manage-amazon-emr-clusters-from-sagemaker-studio-to-run-interactive-spark-and-ml-workloads/

https://github.com/aws-samples/sagemaker-studio-emr

https://towardsaws.com/a-lift-and-shift-approach-for-getting-started-with-amazon-sagemaker-b18109ce1b44

https://docs.aws.amazon.com/sagemaker/latest/dg/jupyterai.html

CDK

https://medium.com/@testep02/stop-using-aws-cdk-b2052abb4cb5

https://aws.amazon.com/blogs/devops/leverage-l2-constructs-to-reduce-the-complexity-of-your-aws-cdk-application/

Serverless

https://lumigo.io/blog/seven-tools-help-become-better-serverless-developer/

https://bitesizedserverless.com/bite/serverless-messaging-latency-compared/

https://medium.com/aws-lambda-serverless-developer-guide-with-hands

https://www.readysetcloud.io/blog/allen.helton/api-essentials-idempotency/

https://aws.amazon.com/blogs/compute/lifting-and-shifting-a-web-application-to-aws-serverless-part-1/

https://medium.com/aws-serverless-microservices-with-patterns-best/aws-lambda-best-practices-and-event-driven-architecture-d6b897d9c96e

https://medium.com/contino-engineering/serverless-testing-local-considered-harmful-cf6d3f940d36

https://aws.amazon.com/blogs/industries/how-to-plan-for-peak-demand-on-an-aws-serverless-digital-commerce-platform/

https://www.readysetcloud.io/blog/allen.helton/when-is-serverless-more-expensive/

https://medium.com/@marinradjenovic/why-do-you-still-need-to-think-of-scalability-when-architecting-serverless-apps-a2e1f14e3eca

https://aws.amazon.com/blogs/architecture/lets-architect-designing-serverless-solutions/

https://konfigthis.com/blog/serverless

https://www.serverlesslife.com/Nine_Ways_How_to_Lose_Data_Using_Serverless_Without_Even_Knowing.html

Cloudfront

https://aws.amazon.com/blogs/networking-and-content-delivery/amazon-cloudfront-introduces-origin-access-control-oac/

https://medium.com/meliopayments/summarizing-2-years-of-using-serverless-architecture-5b706e5ff573

ACK

https://aws.amazon.com/blogs/compute/deploying-aws-lambda-functions-using-aws-controllers-for-kubernetes-ack/

https://aws.amazon.com/blogs/containers/microservices-development-using-aws-controllers-for-kubernetes-ack-and-amazon-eks-blueprints/

App Config

https://dev.to/aws-builders/turn-off-appconfig-feature-flag-automatically-43jo

Comparison

https://cast.ai/blog/aws-eks-vs-ecs-vs-fargate-where-to-manage-your-kubernetes/

KMS

https://blog.lightspin.io/the-complete-guide-to-aws-kms

Disaster Recovery

https://docs.aws.amazon.com/whitepapers/latest/disaster-recovery-workloads-on-aws/disaster-recovery-options-in-the-cloud.html

ALB

https://aws.amazon.com/premiumsupport/knowledge-center/waf-restrict-alb-allow-cloudfront/

https://aws.amazon.com/about-aws/whats-new/2022/11/elastic-load-balancing-capabilities-application-availability/

https://aws.amazon.com/blogs/containers/exposing-kubernetes-applications-part-2-aws-load-balancer-controller/

https://aws.amazon.com/blogs/architecture/improving-performance-and-reducing-cost-using-availability-zone-affinity/

Tagging

https://aws.amazon.com/blogs/containers/achieve-consistent-application-level-tagging-for-cost-tracking-in-aws/

https://aws.amazon.com/blogs/mt/optimize-aws-resource-management-with-tag-inventory-reports-leveraging-aws-resource-explorer/

ECR

https://aws.amazon.com/blogs/containers/amazon-ecr-in-multi-account-and-multi-region-architectures/

https://aws.amazon.com/blogs/containers/building-better-container-images/

React

https://maxrohde.com/2022/10/16/serverless-react-ssr

https://github.com/allanchua101/react_aws_static_hosting

Graphql

https://aws.amazon.com/blogs/architecture/what-to-consider-when-modernizing-apis-with-graphql-on-aws

Service Catalog

https://aws.amazon.com/blogs/architecture/maintain-visibility-over-the-use-of-cloud-architecture-patterns/

https://aws.amazon.com/about-aws/whats-new/2022/11/service-catalog-syncing-products-infrastructure-code-template-files-github-enterprise-bitbucket/

Config

https://aws.amazon.com/about-aws/whats-new/2022/11/aws-config-rules-support-proactive-compliance/

Logging

https://medium.com/@connorbutch/how-to-implement-structured-logging-in-aws-fc3f80929750

Solutions Catalog

https://aws.amazon.com/blogs/aws/new-self-service-provisioning-of-terraform-open-source-configurations-with-aws-service-catalog/

Cost Anamoly

https://aws.amazon.com/blogs/aws-cloud-financial-management/new-aws-cost-explorer-users-can-now-automatically-detect-cost-anomalies/

Github

https://dev.to/pierregmn/kafka-rebalancing-impact-on-kafka-streams-consumers-performances-12dn

Parameter Store

https://theburningmonk.com/2023/03/the-old-faithful-why-ssm-parameter-store-still-reigns-over-secrets-manager/

Secrets Manager

https://aws.amazon.com/blogs/security/use-aws-secrets-manager-to-store-and-manage-secrets-in-on-premises-or-multicloud-workloads/

Notifications

https://aws.amazon.com/blogs/aws/new-set-up-your-aws-notifications-in-one-place/

Incidents

https://www.datadoghq.com/blog/2023-03-08-multiregion-infrastructure-connectivity-issue/

App Sync

https://aws.amazon.com/blogs/mobile/introducing-merged-apis-on-aws-appsync/

Microservices

https://aws.amazon.com/blogs/architecture/lets-architect-designing-microservices-architectures/

MultiRegion

https://medium.com/the-cloud-architect/adding-support-for-vpc-build-a-serverless-multi-region-active-active-backend-solution-d80d25157688

Multi-AZ

https://community.aws/posts/improving-availability-and-performance-with-multi-az-architecture

Autoscaling

https://www.infoworld.com/article/3702111/downsides-to-using-cloud-autoscaling-systems.html

VectorDB

https://aws.amazon.com/blogs/database/the-role-of-vector-datastores-in-generative-ai-applications/

Bedrock

https://aws.amazon.com/blogs/compute/building-a-serverless-document-chat-with-aws-lambda-and-amazon-bedrock/

https://aws.amazon.com/blogs/mt/monitoring-generative-ai-applications-using-amazon-bedrock-and-amazon-cloudwatch-integration/

https://aws.amazon.com/blogs/database/leverage-pgvector-and-amazon-aurora-postgresql-for-natural-language-processing-chatbots-and-sentiment-analysis

https://aws.amazon.com/blogs/mobile/create-a-fullstack-sample-web-app-powered-by-amazon-bedrock/

Event Driven

https://aws.amazon.com/blogs/mt/achieve-domain-consistency-in-event-driven-architectures/

NLB

https://aws.amazon.com/about-aws/whats-new/2023/10/aws-nlb-availability-performance-capabilities/

https://aws.amazon.com/blogs/containers/network-load-balancers-now-support-security-groups/

Helm

https://community.aws/content/2b4TRc5v5IHMy80UQCXlWB30EaZ/installing-multiple-helm-charts-in-one-go-approach-2-using-helmfile

Amazon Q

[1] Chat bots based on knowledge docs [2] Code suggestions/changes in IDE [3] Code transformations e.g. upgrade to java 21

Misc

https://aws.amazon.com/resourceexplorer/

https://aws.amazon.com/blogs/aws/introducing-aws-resource-explorer-quickly-find-resources-in-your-aws-account/

https://aws.amazon.com/blogs/aws/new-myapplications-in-the-aws-management-console-simplifies-managing-your-application-resources/

HarshadRanganathan commented 1 year ago

Cluster Autoscaler vs Karpenter

image_45580954-0420-4924-9d39-73a1684f6dfc20220708_065304

HarshadRanganathan commented 1 year ago

image_b4e84ae2-1290-4408-aca3-2e080355102620220722_115719

HarshadRanganathan commented 1 year ago
image
HarshadRanganathan commented 1 year ago

https://cloudonaut.io/alb-vs-nlb-which-aws-load-balancer-fits-your-needs/

image
HarshadRanganathan commented 1 year ago

https://cloudonaut.io/containers-on-aws-ecs-eks-and-fargate/

image
HarshadRanganathan commented 1 year ago
image
HarshadRanganathan commented 1 year ago
image
HarshadRanganathan commented 1 year ago

1659943343509

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

Serverless webapp

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 1 year ago

image

HarshadRanganathan commented 10 months ago

Trigger lambda directly via SNS or via SQS - https://www.linkedin.com/posts/theburningmonk_really-good-question-on-the-production-ready-activity-7082698738627944448-tj5G/

HarshadRanganathan commented 10 months ago

image

HarshadRanganathan commented 6 months ago
image
HarshadRanganathan commented 6 months ago
image
HarshadRanganathan commented 6 months ago
image
HarshadRanganathan commented 4 months ago

image