sa_8001/dsk-iac
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
6cb2ca92eec774dd7bda25b7c8c909c7cc4a509b
dsk-iac/README.md
havelight-ee 6cb2ca92ee steampipe schedule
2023-06-07 19:10:05 +09:00

25 KiB
Raw Blame History

*기준 시간 : 2023.06.07 19:09:07

dsk-iac

aws 환경 구축 시 사용하는 파일을 정리한다.

directory 구조

  1. __docs: 문서파일 저장.
  2. architecture : aws 구성도
  3. kops: aws kubernetes cluster 구성
  4. packer: aws ami 생성
  5. script: lambda 실행, key 배포 등 스크립트
  6. terraform: terraform code

노드 목록 [33]

name ip taints_key instance_group cpu memory zone instance_type os k8s_ver runtime_ver
i-04abf3bdccadaf05c 172.24.13.138/23 - k8s-prod-tmp 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0446ae551deac0b98 172.24.8.218/23 control-plane - 2 4 ap-northeast-2a c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0628e1521b484fde1 172.24.11.188/23 control-plane - 2 4 ap-northeast-2b c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-041b16dbf097aa03f 172.24.12.111/23 control-plane - 2 4 ap-northeast-2c c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-06c80df6180d036bf 172.24.13.248/23 prod/data k8s-prod-data 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0c370e3211468e6e5 172.24.12.96/23 prod/data-druid k8s-prod-data-druid-middle 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07aebcfff479c0331 172.24.12.210/23 prod/data-druid k8s-prod-data-druid-small 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07046cde77753a2d4 172.24.12.252/23 prod/data-druid k8s-prod-data-druid-c 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f2de40153ccd640e 172.24.13.2/23 prod/data-druid k8s-prod-data-druid-middle 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0a36b91bce0b86b6f 172.24.12.142/23 prod/data-druid k8s-prod-data-druid-c 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0fd0e6d60f02a7b14 172.24.13.29/23 prod/data-es k8s-prod-data-es-c2 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-06e3ca9b0a909e7bd 172.24.13.62/23 prod/data-es k8s-prod-data-es-c 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0df4bd76188c35590 172.24.13.100/23 prod/data-es k8s-prod-data-es-c3 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-076a7682ef711c83a 172.24.13.9/23 prod/data-es-data k8s-prod-data-es-data 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0e5e379f9b04cd2fa 172.24.13.1/23 prod/data-es-data k8s-prod-data-es-data 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-09a912b0d23c15283 172.24.13.201/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-04712bc4966dadc68 172.24.12.88/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f0b728f94d19d020 172.24.12.153/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-046572392b64748b1 172.24.13.78/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0ddf860cc0e3c4b92 172.24.13.237/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-09a8af86b9a3d6474 172.24.13.122/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07fd9c87549c8ca0c 172.24.12.112/23 prod/druid-middlemanager k8s-prod-data-druid-large 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0b38484102aa244e8 172.24.13.227/23 prod/druid-middlemanager k8s-prod-data-druid-large 16 63 ap-northeast-2c m5.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-009e56755c657e557 172.24.13.8/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0e4a89bcc7c6421bf 172.24.13.66/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f5eef7ed3a20e103 172.24.13.82/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0dd28df2ff60bf63b 172.24.13.134/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0dc48b11bbb330012 172.24.13.236/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-001143efb27f5c473 172.24.13.189/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-04bb752f13f1d1ab6 172.24.13.157/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5d.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-02a3a683f4f214c90 172.24.12.74/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5ad.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-01fdcb39f35bf8b1b 172.24.12.50/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0c5072ea5d3ee0b52 172.24.12.191/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8

리소스 목록 [94]

name kind count reqeust_cpu reqeust_mem limit_cpu limit_mem
prometheus-prometheus-node-exporter DaemonSet 33
aws-cloud-controller-manager DaemonSet 3 200m
dsk-log-agent DaemonSet 22 250m 512Mi 500m 1G
calico-node DaemonSet 33 100m
kops-controller DaemonSet 3 50m 50Mi
dsk-trace-agent DaemonSet 33
dsk-base-agent DaemonSet 33 50m 128Mi 100m 250Mi
promtail DaemonSet 33
ebs-csi-node DaemonSet 33
ingress-nginx-controller DaemonSet 7 100m 90Mi
es-log-collector DaemonSet 4 10m 20Mi 50m 50Mi
dsk-entity-operator Deployment 1
dsk-kafka-exporter Deployment 1
dsk-kubernetes-agent Deployment 1 100m 512Mi 1 1000Mi
dsk-otel Deployment 1 250m 512M 1 2048M
dsk-postgres-agents-pg-1 Deployment 1 100m 512Mi 1 1000Mi
dsk-vault-agent Deployment 1
ebs-csi-controller Deployment 2
prod-dsk-metric-custom-flat-stream Deployment 3
calico-kube-controllers Deployment 1
cert-manager Deployment 1
cert-manager-cainjector Deployment 1
cert-manager-webhook Deployment 1
coredns Deployment 3 100m 70Mi 170Mi
coredns-autoscaler Deployment 1 20m 10Mi
dns-controller Deployment 1 50m 50Mi
druid-broker Deployment 2 26Gi 26Gi
druid-coordinator Deployment 1 1Gi 8Gi
druid-router Deployment 1
prod-dsk-metric-base-agg-stream-1m Deployment 3 500m 1Gi 1 2Gi
prod-dsk-metric-base-agg-stream-5m Deployment 3 500m 1Gi 1 2Gi
prod-dsk-metric-base-flat-stream Deployment 4 500m 500Mi 1 1Gi
prod-dsk-notification-api Deployment 1
prod-dsk-tagging-connector-group1 Deployment 1 500m 512Mi 1 1Gi
prod-dsk-tagging-connector-group2 Deployment 1 500m 512Mi 1 1Gi
prod-dsk-tagging-connector-group3 Deployment 1 500m 512Mi 1 1Gi
prod-dsk-tagging-connector-group4 Deployment 1 500m 512Mi 1 1Gi
prod-dsk-tagging-connector-jaeger-process Deployment 1 500m 512Mi 1 1Gi
prod-dsk-tagging-connector-manifest Deployment 1 500m 512Mi 1 1Gi
prod-dsk-trace-stream Deployment 3
prod-dsk-ui Deployment 1
prod-dsk-usergate-api Deployment 1
prometheus-kube-state-metrics Deployment 1 10m 32Mi 100m 64Mi
prometheus-prometheus-pushgateway Deployment 1 100m 30Mi 200m 50Mi
prometheus-server Deployment 1
strimzi-cluster-operator Deployment 1 200m 384Mi 1 384Mi
vault-agent-injector Deployment 1
zoo-entrance Deployment 1
kafka-ui Deployment 1
metrics-server Deployment 1 100m 200Mi
mongo-dsk-mongodb-sharded-mongos Deployment 1
mongo-manifest-mongodb-sharded-mongos Deployment 1
nfs-provisioner-prod-nfs-subdir-external-provisioner Deployment 1
prod-dsk-agent-api Deployment 1
prod-dsk-agentmanager-api Deployment 1
prod-dsk-alert-api Deployment 1
prod-dsk-apm-api Deployment 1 100m 256Mi 250m 512Mi
prod-dsk-app-sender Deployment 1
prod-dsk-backoffice Deployment 0
prod-dsk-chart-api Deployment 3 500m 512Mi 1 1Gi
prod-dsk-dashboard-api Deployment 1
prod-dsk-database-api Deployment 3 100m 256Mi 250m 512Mi
prod-dsk-database-plan-stream Deployment 1
prod-dsk-datagate-dsk-datagate-manifest Deployment 1 100m 100M 200m 200M
prod-dsk-datagate-dsk-datagate-metric Deployment 5 250m 250M 500m 500M
prod-dsk-datagate-dsk-datagate-plan Deployment 1 100m 100M 250m 250M
prod-dsk-datagate-dsk-datagate-trace Deployment 2 100m 250M 200m 500M
prod-dsk-infrastructure-api Deployment 1 100m 256Mi 250m 512Mi
prod-dsk-kafka2storage-database-plan-stream Deployment 1 300m 500Mi 500m 1G
prod-dsk-kafka2storage-database-stat-query Deployment 1 300m 500Mi 500m 1G
prod-dsk-kafka2storage-manifest-original Deployment 1 300m 500Mi 500m 1G
prod-dsk-kafka2storage-trace-span-stream Deployment 1 300m 500Mi 500m 1G
prod-dsk-krakend Deployment 3 200m 256Mi 500m 512Mi
prod-dsk-log-api Deployment 1
prod-dsk-loggate Deployment 8 100m 500Mi 200m 1500Mi
es-data Stateful_Set 2 7 30Gi 8 31Gi
es-master Stateful_Set 3 3 14Gi 4 15Gi
elasticsearch-master Stateful_Set 3 2 12Gi 2 12Gi
prometheus-alertmanager Stateful_Set 1 10m 32Mi 100m 128Mi
keycloak Stateful_Set 1
druid-zookeeper Stateful_Set 3 250m 256Mi
rabbitmq Stateful_Set 1
mongo-dsk-mongodb-sharded-configsvr Stateful_Set 1
druid-postgresql Stateful_Set 1 250m 256Mi
mongo-dsk-mongodb-sharded-shard0-data Stateful_Set 1
mongo-dsk-mongodb-sharded-shard1-data Stateful_Set 1
mongo-manifest-mongodb-sharded-configsvr Stateful_Set 1
druid-middle-manager Stateful_Set 2 1Gi 60Gi
mongo-manifest-mongodb-sharded-shard0-data Stateful_Set 1
mongo-manifest-mongodb-sharded-shard1-data Stateful_Set 1
redis-master Stateful_Set 1
postgresql Stateful_Set 1 250m 256Mi
vault Stateful_Set 1
druid-historical Stateful_Set 2 26Gi 26Gi

서비스 목록 (NodePort) [35]

name namespace type node_port age
rabbitmq dsk-middle NodePort 30038 5 mons 25 days 03:25:38
cmak dsk-middle NodePort 30082 02:48:36
keycloak dsk-middle NodePort 30100 5 mons 23 days 03:27:46
keycloak dsk-middle NodePort 30101 5 mons 23 days 03:27:46
mongo-manifest-mongodb-sharded dsk-middle NodePort 30111 1 mon 7 days 18:21:00
mongo-dsk-mongodb-sharded dsk-middle NodePort 30112 1 mon 7 days 17:08:20
redis-master dsk-middle NodePort 30229 5 mons 25 days 03:25:25
es-data dsk-middle NodePort 30347 07:25:35
elasticsearch-master dsk-middle NodePort 30433 1 mon 4 days 05:06:35
rabbitmq dsk-middle NodePort 30523 5 mons 25 days 03:25:38
rabbitmq dsk-middle NodePort 30565 5 mons 25 days 03:25:38
rabbitmq dsk-middle NodePort 30655 5 mons 25 days 03:25:38
rabbitmq dsk-middle NodePort 31021 5 mons 25 days 03:25:38
kafka-ui dsk-middle NodePort 31101 02:31:24
elasticsearch-master dsk-middle NodePort 31110 1 mon 4 days 05:06:35
prometheus-server prometheus NodePort 31132 26 days 02:10:26
prometheus-alertmanager prometheus NodePort 31133 26 days 02:10:26
prod-dsk-datagate-dsk-datagate-trace dsk-datagate-prod NodePort 31300 4 mons 20 days 00:20:47
prod-dsk-datagate-dsk-datagate-manifest dsk-datagate-prod NodePort 31301 5 mons 1 day 01:36:32
prod-dsk-datagate-dsk-datagate-metric dsk-datagate-prod NodePort 31302 5 mons 1 day 01:36:32
prod-dsk-datagate-dsk-datagate-plan dsk-datagate-prod NodePort 31303 5 mons 1 day 01:36:32
prod-dsk-loggate dsk-datagate-prod NodePort 31304 4 mons 26 days 01:50:21
prod-dsk-loggate dsk-datagate-prod NodePort 31305 4 mons 26 days 01:50:21
rel-dsk-datagate-trace dsk-datagate-rel NodePort 31310 7 days 02:44:03
rel-dsk-datagate-manifest dsk-datagate-rel NodePort 31311 7 days 02:44:03
rel-dsk-datagate-metric dsk-datagate-rel NodePort 31312 7 days 02:44:03
rel-dsk-datagate-plan dsk-datagate-rel NodePort 31313 7 days 02:44:03
rel-dsk-loggate dsk-datagate-rel NodePort 31314 7 days 02:43:39
rel-dsk-loggate dsk-datagate-rel NodePort 31315 7 days 02:43:39
prod-dsk-backoffice dsk-api-prod NodePort 31523 2 mons 1 day 07:32:17
rabbitmq dsk-middle NodePort 31987 5 mons 25 days 03:25:38
postgresql dsk-middle NodePort 32098 5 mons 25 days 03:26:01
es-data dsk-middle NodePort 32220 07:25:35
es-master dsk-middle NodePort 32221 07:27:09
es-master dsk-middle NodePort 32289 07:27:09

예약 인스턴스 사용 내역 [10]

availability_zone instance_type cpu memory ri_count ec2_count result
ap-northeast-2a t3.small 2 2 2 1 -1
ap-northeast-2a c5a.large 2 4 1 1 0
ap-northeast-2b c5a.large 2 4 1 1 0
ap-northeast-2c m5a.2xlarge 8 32 1 8 7
ap-northeast-2c m5a.4xlarge 16 64 1 3 2
ap-northeast-2c m5a.xlarge 4 16 7 9 2
ap-northeast-2c m6i.xlarge 4 16 4 5 1
ap-northeast-2c t3.small 2 2 1 1 0
ap-northeast-2c c5a.large 2 4 1 1 0
ap-northeast-2c m5.4xlarge 16 64 0 1 1