Files
dsk-iac/README.md
2023-07-02 00:19:59 +09:00

34 KiB

*기준 시간 : 2023.07.02 00:19:03

dsk-iac

aws 환경 구축 시 사용하는 파일을 정리한다.

directory 구조

  1. __docs: 문서파일 저장.
  2. architecture : aws 구성도
  3. kops: aws kubernetes cluster 구성
  4. packer: aws ami 생성
  5. script: lambda 실행, key 배포 등 스크립트
  6. terraform: terraform code

노드 목록 [33]

name ip taints_key instance_group cpu memory zone instance_type os k8s_ver runtime_ver
i-04abf3bdccadaf05c 172.24.13.138/23 - k8s-prod-tmp 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0628e1521b484fde1 172.24.11.188/23 control-plane - 2 4 ap-northeast-2b c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-041b16dbf097aa03f 172.24.12.111/23 control-plane - 2 4 ap-northeast-2c c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0446ae551deac0b98 172.24.8.218/23 control-plane - 2 4 ap-northeast-2a c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-06c80df6180d036bf 172.24.13.248/23 prod/data k8s-prod-data 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0c370e3211468e6e5 172.24.12.96/23 prod/data-druid k8s-prod-data-druid-middle 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07aebcfff479c0331 172.24.12.210/23 prod/data-druid k8s-prod-data-druid-small 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07046cde77753a2d4 172.24.12.252/23 prod/data-druid k8s-prod-data-druid-c 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f2de40153ccd640e 172.24.13.2/23 prod/data-druid k8s-prod-data-druid-middle 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0a36b91bce0b86b6f 172.24.12.142/23 prod/data-druid k8s-prod-data-druid-c 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0e5e379f9b04cd2fa 172.24.13.1/23 prod/data-es-data k8s-prod-data-es-data 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-076a7682ef711c83a 172.24.13.9/23 prod/data-es-data k8s-prod-data-es-data 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f0b728f94d19d020 172.24.12.153/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-04712bc4966dadc68 172.24.12.88/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0a0942fb91f9968d8 172.24.13.41/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0ddf860cc0e3c4b92 172.24.13.237/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-046572392b64748b1 172.24.13.78/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-09a8af86b9a3d6474 172.24.13.122/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0b38484102aa244e8 172.24.13.227/23 prod/druid-middlemanager k8s-prod-data-druid-large 16 63 ap-northeast-2c m5.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07fd9c87549c8ca0c 172.24.12.112/23 prod/druid-middlemanager k8s-prod-data-druid-large 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0dd28df2ff60bf63b 172.24.13.134/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0a768908aade20566 172.24.13.148/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-001143efb27f5c473 172.24.13.189/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0dc48b11bbb330012 172.24.13.236/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0317fd83555444cda 172.24.12.241/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-009e56755c657e557 172.24.13.8/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0e4a89bcc7c6421bf 172.24.13.66/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0524126bf5fdc1483 172.24.13.132/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f5eef7ed3a20e103 172.24.13.82/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0a4d55eadaedb7c09 172.24.12.146/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-002c03a3718ad3a6e 172.24.12.40/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5ad.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0569af4f8dd406dfa 172.24.12.191/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-00a37aeaacf807e19 172.24.13.180/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5ad.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8

리소스 목록 [109]

kind name count request_cpu request_mem limit_cpu limit_mem c_name namespace
deploy calico-kube-controllers 1 calico-kube-controllers kube-system
deploy cert-manager 1 cert-manager-controller cert-manager
deploy cert-manager-cainjector 1 cert-manager-cainjector cert-manager
deploy cert-manager-webhook 1 cert-manager-webhook cert-manager
deploy coredns 3 100m 70Mi 170Mi coredns kube-system
deploy coredns-autoscaler 1 20m 10Mi autoscaler kube-system
deploy dns-controller 1 50m 50Mi dns-controller kube-system
deploy druid-broker 2 28Gi 28Gi druid dsk-middle
deploy druid-coordinator 1 8Gi 8Gi druid dsk-middle
deploy druid-router 1 5Gi 5Gi druid dsk-middle
deploy dsk-entity-operator 1 tls-sidecar dsk-middle
deploy dsk-entity-operator 1 topic-operator dsk-middle
deploy dsk-entity-operator 1 user-operator dsk-middle
deploy dsk-kafka-exporter 1 dsk-kafka-exporter dsk-middle
deploy dsk-kubernetes-agent 1 100m 512Mi 1 1000Mi dsk-k8s-agent dsk-agent
deploy dsk-kubernetes-agent 1 100m 512Mi 1 1000Mi dsk-kube-state-agent dsk-agent
deploy dsk-otel 1 250m 512M 1 1024M otelcol dsk-stream-prod
deploy dsk-postgres-agents-pg-1 1 100m 512Mi 1 1000Mi dsk-plan-postgres-agent dsk-agent
deploy dsk-postgres-agents-pg-1 1 100m 512Mi 1 1000Mi dsk-postgres-agent dsk-agent
deploy dsk-vault-agent 1 vault-agent dsk-middle
deploy ebs-csi-controller 2 csi-attacher kube-system
deploy ebs-csi-controller 2 csi-provisioner kube-system
deploy ebs-csi-controller 2 csi-resizer kube-system
deploy ebs-csi-controller 2 ebs-plugin kube-system
deploy ebs-csi-controller 2 liveness-probe kube-system
deploy es-exporter-prometheus-elasticsearch-exporter 1 exporter dsk-middle
deploy kafka-ui 1 kafka-ui dsk-middle
deploy metrics-server 1 100m 200Mi metrics-server kube-system
deploy mongo-dsk-mongodb-sharded-mongos 1 mongos dsk-middle
deploy mongo-manifest-mongodb-sharded-mongos 1 mongos dsk-middle
deploy nfs-provisioner-prod-nfs-subdir-external-provisioner 1 nfs-subdir-external-provisioner nfs-provisioner-prod
deploy prod-dsk-agent-api 1 dsk-agent-api dsk-api-prod
deploy prod-dsk-agentmanager-api 5 dsk-agentmanager-api dsk-api-prod
deploy prod-dsk-alert-api 1 dsk-alert-api dsk-api-prod
deploy prod-dsk-apm-api 1 100m 256Mi 250m 512Mi dsk-apm-api dsk-api-prod
deploy prod-dsk-app-sender 1 dsk-app-sender dsk-api-prod
deploy prod-dsk-backoffice 0 dsk-backoffice dsk-api-prod
deploy prod-dsk-chart-api 10 300m 1536Mi 1 1536Mi dsk-chart-api dsk-api-prod
deploy prod-dsk-dashboard-api 1 dsk-dashboard-api dsk-api-prod
deploy prod-dsk-database-api 3 100m 256Mi 250m 512Mi dsk-database-api dsk-api-prod
deploy prod-dsk-database-plan-stream 1 dsk-database-plan-stream dsk-stream-prod
deploy prod-dsk-datagate-dsk-datagate-manifest 1 100m 100M 200m 200M prod-dsk-datagate-dsk-datagate-manifest dsk-datagate-prod
deploy prod-dsk-datagate-dsk-datagate-metric 6 250m 250M 500m 500M prod-dsk-datagate-dsk-datagate-metric dsk-datagate-prod
deploy prod-dsk-datagate-dsk-datagate-plan 1 100m 100M 250m 250M prod-dsk-datagate-dsk-datagate-plan dsk-datagate-prod
deploy prod-dsk-datagate-dsk-datagate-trace 2 100m 250M 200m 500M prod-dsk-datagate-dsk-datagate-trace dsk-datagate-prod
deploy prod-dsk-infrastructure-api 1 100m 256Mi 250m 512Mi dsk-infrastructure-api dsk-api-prod
deploy prod-dsk-kafka2storage-database-plan-stream 3 300m 500Mi 500m 1G dsk-kafka2storage dsk-stream-prod
deploy prod-dsk-kafka2storage-database-stat-query 3 300m 500Mi 500m 1G dsk-kafka2storage dsk-stream-prod
deploy prod-dsk-kafka2storage-manifest-original 3 300m 500Mi 500m 1G dsk-kafka2storage dsk-stream-prod
deploy prod-dsk-kafka2storage-trace-span-stream 3 300m 500Mi 500m 1G dsk-kafka2storage dsk-stream-prod
deploy prod-dsk-krakend 3 200m 256Mi 500m 512Mi dsk-krakend dsk-krakend-prod
deploy prod-dsk-log-api 1 dsk-log-api dsk-api-prod
deploy prod-dsk-log-connector 6 100m 500Mi 200m 600Mi dsk-log-connector dsk-stream-prod
deploy prod-dsk-loggate 4 300m 400Mi 1 600Mi dsk-loggate dsk-datagate-prod
deploy prod-dsk-metric-base-agg-stream-1h 6 500m 1Gi 1 2Gi prod-dsk-metric-base-agg-stream-1h dsk-stream-prod
deploy prod-dsk-metric-base-agg-stream-1m 6 500m 1Gi 1 2Gi prod-dsk-metric-base-agg-stream-1m dsk-stream-prod
deploy prod-dsk-metric-base-agg-stream-5m 3 500m 1Gi 1 2Gi prod-dsk-metric-base-agg-stream-5m dsk-stream-prod
deploy prod-dsk-metric-base-flat-stream 4 500m 500Mi 1 1Gi dsk-metric-base-flat-stream dsk-stream-prod
deploy prod-dsk-metric-custom-flat-stream 3 dsk-metric-custom-flat-stream dsk-stream-prod
deploy prod-dsk-notification-api 1 100m 250Mi 300m 750Mi dsk-notification-api dsk-api-prod
deploy prod-dsk-tagging-connector-group1 2 250m 250Mi 500m 750Mi prod-dsk-tagging-connector-group1 dsk-stream-prod
deploy prod-dsk-tagging-connector-group2 2 250m 250Mi 500m 750Mi prod-dsk-tagging-connector-group2 dsk-stream-prod
deploy prod-dsk-tagging-connector-group3 2 250m 250Mi 500m 750Mi prod-dsk-tagging-connector-group3 dsk-stream-prod
deploy prod-dsk-tagging-connector-group4 2 250m 250Mi 500m 750Mi prod-dsk-tagging-connector-group4 dsk-stream-prod
deploy prod-dsk-tagging-connector-jaeger-process 2 250m 250Mi 500m 750Mi prod-dsk-tagging-connector-jaeger-process dsk-stream-prod
deploy prod-dsk-tagging-connector-manifest 2 250m 250Mi 500m 750Mi prod-dsk-tagging-connector-manifest dsk-stream-prod
deploy prod-dsk-trace-stream 3 100m 250Mi 300m 750Mi dsk-trace-stream dsk-stream-prod
deploy prod-dsk-ui 1 dsk-ui dsk-front-prod
deploy prod-dsk-usergate-api 1 dsk-usergate-api dsk-api-prod
deploy prometheus-kube-state-metrics 1 100m 64Mi 400m 256Mi kube-state-metrics prometheus
deploy prometheus-prometheus-pushgateway 1 100m 30Mi 200m 50Mi pushgateway prometheus
deploy prometheus-server 1 2 4Gi 4 8Gi prometheus-server prometheus
deploy prometheus-server 1 prometheus-server-configmap-reload prometheus
deploy strimzi-cluster-operator 1 200m 384Mi 1 384Mi strimzi-cluster-operator dsk-middle
deploy vault-agent-injector 1 sidecar-injector dsk-middle
deploy zoo-entrance 1 cmak dsk-middle
deploy zoo-entrance 1 zoo-entrance dsk-middle
ds aws-cloud-controller-manager 3 200m aws-cloud-controller-manager kube-system
ds calico-node 33 100m calico-node kube-system
ds dsk-base-agent 33 50m 128Mi 100m 250Mi dsk-container-agent dsk-agent
ds dsk-base-agent 33 50m 128Mi 100m 250Mi dsk-node-agent dsk-agent
ds dsk-log-agent 19 250m 512Mi 500m 1G dsk-log-agent dsk-agent
ds dsk-trace-agent 33 dsk-trace-agent dsk-agent
ds ebs-csi-node 33 ebs-plugin kube-system
ds ebs-csi-node 33 liveness-probe kube-system
ds ebs-csi-node 33 node-driver-registrar kube-system
ds ingress-nginx-controller 7 100m 90Mi controller ingress-nginx
ds kops-controller 3 50m 50Mi kops-controller kube-system
ds prometheus-prometheus-node-exporter 33 node-exporter prometheus
ds promtail 33 promtail promtail
sts druid-historical 2 58Gi 58Gi druid dsk-middle
sts druid-middle-manager 2 1Gi 60Gi druid dsk-middle
sts druid-postgresql 1 250m 256Mi druid-postgresql dsk-middle
sts druid-zookeeper 3 250m 256Mi zookeeper dsk-middle
sts es-data 2 7 30Gi 8 31Gi elasticsearch dsk-middle
sts es-master 3 3 14Gi 4 15Gi elasticsearch dsk-middle
sts keycloak 1 keycloak dsk-middle
sts mongo-dsk-mongodb-sharded-configsvr 1 mongodb dsk-middle
sts mongo-dsk-mongodb-sharded-shard0-data 1 mongodb dsk-middle
sts mongo-dsk-mongodb-sharded-shard1-data 1 mongodb dsk-middle
sts mongo-manifest-mongodb-sharded-configsvr 1 mongodb dsk-middle
sts mongo-manifest-mongodb-sharded-shard0-data 1 mongodb dsk-middle
sts mongo-manifest-mongodb-sharded-shard1-data 1 mongodb dsk-middle
sts postgresql 1 250m 256Mi postgresql dsk-middle
sts postgresql-tenant 1 250m 256Mi postgresql dsk-middle
sts prometheus-alertmanager 1 100m 64Mi 400m 256Mi alertmanager prometheus
sts rabbitmq 1 rabbitmq dsk-middle
sts redis-master 1 redis dsk-middle
sts vault 1 vault dsk-middle

서비스 목록 (NodePort) [37]

name namespace type node_port age
rabbitmq dsk-middle NodePort 30038 6 mons 19 days 08:35:35
cmak dsk-middle NodePort 30082 24 days 07:58:33
mongo-manifest-mongodb-sharded dsk-middle NodePort 30111 2 mons 1 day 23:30:57
mongo-dsk-mongodb-sharded dsk-middle NodePort 30112 2 mons 1 day 22:18:17
redis-master dsk-middle NodePort 30229 6 mons 19 days 08:35:22
es-data dsk-middle NodePort 30347 24 days 12:35:32
druid-router dsk-middle NodePort 30517 5 mons 1 day 08:34:31
rabbitmq dsk-middle NodePort 30523 6 mons 19 days 08:35:35
rabbitmq dsk-middle NodePort 30565 6 mons 19 days 08:35:35
rabbitmq dsk-middle NodePort 30655 6 mons 19 days 08:35:35
rabbitmq dsk-middle NodePort 31021 6 mons 19 days 08:35:35
kafka-ui dsk-middle NodePort 31101 24 days 07:41:21
postgresql-tenant dsk-middle NodePort 31103 23 days 14:00:22
es-data dsk-middle NodePort 31110 24 days 12:35:32
es-master dsk-middle NodePort 31111 24 days 12:37:06
druid-router dsk-middle NodePort 31120 5 mons 1 day 08:34:31
keycloak dsk-middle NodePort 31130 6 mons 17 days 08:37:43
keycloak dsk-middle NodePort 31131 6 mons 17 days 08:37:43
prometheus-server prometheus NodePort 31132 1 mon 20 days 07:20:23
prometheus-alertmanager prometheus NodePort 31133 1 mon 20 days 07:20:23
prod-dsk-datagate-dsk-datagate-trace dsk-datagate-prod NodePort 31300 5 mons 14 days 05:30:44
prod-dsk-datagate-dsk-datagate-manifest dsk-datagate-prod NodePort 31301 5 mons 26 days 06:46:29
prod-dsk-datagate-dsk-datagate-metric dsk-datagate-prod NodePort 31302 5 mons 26 days 06:46:29
prod-dsk-datagate-dsk-datagate-plan dsk-datagate-prod NodePort 31303 5 mons 26 days 06:46:29
prod-dsk-loggate dsk-datagate-prod NodePort 31304 5 mons 20 days 07:00:18
prod-dsk-loggate dsk-datagate-prod NodePort 31305 5 mons 20 days 07:00:18
rel-dsk-datagate-trace dsk-datagate-rel NodePort 31310 1 mon 1 day 07:54:00
rel-dsk-datagate-manifest dsk-datagate-rel NodePort 31311 1 mon 1 day 07:54:00
rel-dsk-datagate-metric dsk-datagate-rel NodePort 31312 1 mon 1 day 07:54:00
rel-dsk-datagate-plan dsk-datagate-rel NodePort 31313 1 mon 1 day 07:54:00
rel-dsk-loggate dsk-datagate-rel NodePort 31314 1 mon 1 day 07:53:36
rel-dsk-loggate dsk-datagate-rel NodePort 31315 1 mon 1 day 07:53:36
prod-dsk-backoffice dsk-api-prod NodePort 31523 2 mons 25 days 12:42:14
rabbitmq dsk-middle NodePort 31987 6 mons 19 days 08:35:35
prod-dsk-log-connector dsk-stream-prod NodePort 32023 5 days 09:12:01
postgresql dsk-middle NodePort 32098 6 mons 19 days 08:35:58
es-master dsk-middle NodePort 32289 24 days 12:37:06

예약 인스턴스 사용 내역 [11]

availability_zone instance_type cpu memory ri_count ec2_count result
ap-northeast-2a t3.small 2 2 1 1 0
ap-northeast-2a c5a.large 2 4 1 1 0
ap-northeast-2b c5a.large 2 4 1 1 0
ap-northeast-2c m5a.2xlarge 8 32 1 8 7
ap-northeast-2c m5a.4xlarge 16 64 1 3 2
ap-northeast-2c m5a.large 2 8 0 1 1
ap-northeast-2c m5a.xlarge 4 16 7 10 3
ap-northeast-2c m6i.xlarge 4 16 4 4 0
ap-northeast-2c t3.small 2 2 2 0 -2
ap-northeast-2c c5a.large 2 4 1 1 0
ap-northeast-2c m5.4xlarge 16 64 0 1 1