Cloud & Data Infrastructure

The Stack

A production-shaped AWS environment built end to end: analytics collection, a lakehouse, CI/CD, a Kubernetes ML platform, and the security posture holding it together. All of it Terraform-deployed and reproducible.

§ 1

Consoles

Live when the stack is up.

ServiceWhat it doesLink
JenkinsCI/CD server — see DevOpsjenkins.patrick-cloud.com
Snowplow CollectorEvent collection endpointcollector
Snowplow IgluSchema registryiglu
GrafanaMetrics dashboards/grafana
PrometheusMetrics collection/prometheus
KialiService mesh console/kiali
Argo CDGitOps delivery/argocd
dbt DocsModel documentation/dbt-docs
Ray DashboardCluster compute/ray-cluster-dashboard
Ray ServeModel serving endpoint/ray-service-serve
JupyterNotebooks/jupyter
§ 2

Practices

  • Least-privilege IAM roles, policies, and security groups throughout
  • All AWS resources encrypted with customer-managed KMS keys
  • Alarms on ALB, target groups, EC2, Kinesis, SQS, and RDS — each emailing on trigger
  • Public internet exposure limited via private subnets and VPC endpoints
  • All traffic encrypted with SSL; mTLS inside the cluster
  • CI enforces testing before deploy; IaC guarantees reproducibility
§ 3

Skills

AWS
EC2ECSEKSECRALBLambdaGlueRDSSQSSNSKinesisCloudwatchIAMKMSEndpointsRoute53Security Groups
Languages
PythonSQLLinux
Frameworks
TerraformDockerKuberneteskubectlKustomizeHelmAWS CLI
Libraries
SnowplowdbtNginxIstioPrometheusGrafanaArgoCDRayJupyterMLflow
CI/CD
GitHub ActionsAWS CodePipelineJenkins
Orchestration
AirflowPrefectEventBridge
Warehouses
DatabricksSnowflakePostgres
§ 4

Repositories