*기준 시간 : 2023.06.09 15:20:15 # dsk-iac aws 환경 구축 시 사용하는 파일을 정리한다. ## directory 구조 1. __docs: 문서파일 저장. 2. architecture : aws 구성도 3. kops: aws kubernetes cluster 구성 4. packer: aws ami 생성 5. script: lambda 실행, key 배포 등 스크립트 6. terraform: terraform code ## 노드 목록 [31] | name | ip | taints_key | instance_group | cpu | memory | zone | instance_type | os | k8s_ver | runtime_ver | |---------------------|------------------|---------------------------------------|----------------------------|-----|--------|-----------------|---------------|--------------------|---------|--------------------| | i-04abf3bdccadaf05c | 172.24.13.138/23 | - | k8s-prod-tmp | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0628e1521b484fde1 | 172.24.11.188/23 | control-plane | - | 2 | 4 | ap-northeast-2b | c5a.large | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0446ae551deac0b98 | 172.24.8.218/23 | control-plane | - | 2 | 4 | ap-northeast-2a | c5a.large | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-041b16dbf097aa03f | 172.24.12.111/23 | control-plane | - | 2 | 4 | ap-northeast-2c | c5a.large | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-06c80df6180d036bf | 172.24.13.248/23 | prod/data | k8s-prod-data | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0f2de40153ccd640e | 172.24.13.2/23 | prod/data-druid | k8s-prod-data-druid-middle | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-07aebcfff479c0331 | 172.24.12.210/23 | prod/data-druid | k8s-prod-data-druid-small | 4 | 16 | ap-northeast-2c | m6i.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0c370e3211468e6e5 | 172.24.12.96/23 | prod/data-druid | k8s-prod-data-druid-middle | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0a36b91bce0b86b6f | 172.24.12.142/23 | prod/data-druid | k8s-prod-data-druid-c | 16 | 62 | ap-northeast-2c | m5a.4xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-07046cde77753a2d4 | 172.24.12.252/23 | prod/data-druid | k8s-prod-data-druid-c | 16 | 62 | ap-northeast-2c | m5a.4xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-076a7682ef711c83a | 172.24.13.9/23 | prod/data-es-data | k8s-prod-data-es-data | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0e5e379f9b04cd2fa | 172.24.13.1/23 | prod/data-es-data | k8s-prod-data-es-data | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-09a912b0d23c15283 | 172.24.13.201/23 | prod/data-es-master | k8s-prod-data-es-master | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-04712bc4966dadc68 | 172.24.12.88/23 | prod/data-es-master | k8s-prod-data-es-master | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0f0b728f94d19d020 | 172.24.12.153/23 | prod/data-es-master | k8s-prod-data-es-master | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0ddf860cc0e3c4b92 | 172.24.13.237/23 | prod/data-kafka | k8s-prod-data-kafka | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-046572392b64748b1 | 172.24.13.78/23 | prod/data-kafka | k8s-prod-data-kafka | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-09a8af86b9a3d6474 | 172.24.13.122/23 | prod/data-kafka | k8s-prod-data-kafka | 8 | 31 | ap-northeast-2c | m5a.2xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0b38484102aa244e8 | 172.24.13.227/23 | prod/druid-middlemanager | k8s-prod-data-druid-large | 16 | 63 | ap-northeast-2c | m5.4xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-07fd9c87549c8ca0c | 172.24.12.112/23 | prod/druid-middlemanager | k8s-prod-data-druid-large | 16 | 62 | ap-northeast-2c | m5a.4xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-009e56755c657e557 | 172.24.13.8/23 | prod/process | k8s-prod-process-m5a | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-001143efb27f5c473 | 172.24.13.189/23 | prod/process | k8s-prod-process-m5a | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0dd28df2ff60bf63b | 172.24.13.134/23 | prod/process | k8s-prod-process-m6i | 4 | 16 | ap-northeast-2c | m6i.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0f5eef7ed3a20e103 | 172.24.13.82/23 | prod/process | k8s-prod-process-m5a | 4 | 16 | ap-northeast-2c | m5a.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0e4a89bcc7c6421bf | 172.24.13.66/23 | prod/process | k8s-prod-process-m6i | 4 | 16 | ap-northeast-2c | m6i.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0dc48b11bbb330012 | 172.24.13.236/23 | prod/process | k8s-prod-process-m6i | 4 | 16 | ap-northeast-2c | m6i.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-02ffe2238d8387b15 | 172.24.12.185/23 | prod/rel-process | k8s-rel-process-c | 4 | 16 | ap-northeast-2c | m5zn.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-014fd1c1824cc6ae4 | 172.24.13.145/23 | prod/rel-process | k8s-rel-process-c | 4 | 16 | ap-northeast-2c | m5d.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0bdba4f08525b72d3 | 172.24.13.197/23 | prod/rel-process | k8s-rel-process-c | 4 | 16 | ap-northeast-2c | m5zn.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0c6444f262a00977d | 172.24.12.121/23 | prod/rel-process | k8s-rel-process-c | 4 | 16 | ap-northeast-2c | m5d.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | | i-0ac3b27cbeafbd5ab | 172.24.13.183/23 | prod/rel-process | k8s-rel-process-c | 4 | 16 | ap-northeast-2c | m5zn.xlarge | Ubuntu 20.04.4 LTS | v1.25.2 | containerd://1.6.8 | ## 리소스 목록 [94] | name | kind | count | reqeust_cpu | reqeust_mem | limit_cpu | limit_mem | |------------------------------------------------------|--------------|-------|-------------|-------------|-----------|-----------| | prometheus-prometheus-node-exporter | DaemonSet | 31 | | | | | | aws-cloud-controller-manager | DaemonSet | 3 | 200m | | | | | dsk-log-agent | DaemonSet | 20 | 250m | 512Mi | 500m | 1G | | calico-node | DaemonSet | 31 | 100m | | | | | kops-controller | DaemonSet | 3 | 50m | 50Mi | | | | dsk-trace-agent | DaemonSet | 31 | | | | | | dsk-base-agent | DaemonSet | 31 | 50m | 128Mi | 100m | 250Mi | | promtail | DaemonSet | 31 | | | | | | ebs-csi-node | DaemonSet | 31 | | | | | | ingress-nginx-controller | DaemonSet | 7 | 100m | 90Mi | | | | es-log-collector | DaemonSet | 1 | 10m | 20Mi | 50m | 50Mi | | dsk-entity-operator | Deployment | 1 | | | | | | dsk-kafka-exporter | Deployment | 1 | | | | | | dsk-kubernetes-agent | Deployment | 1 | 100m | 512Mi | 1 | 1000Mi | | dsk-otel | Deployment | 1 | 250m | 512M | 1 | 2048M | | dsk-postgres-agents-pg-1 | Deployment | 1 | 100m | 512Mi | 1 | 1000Mi | | dsk-vault-agent | Deployment | 1 | | | | | | ebs-csi-controller | Deployment | 2 | | | | | | prod-dsk-metric-custom-flat-stream | Deployment | 3 | | | | | | calico-kube-controllers | Deployment | 1 | | | | | | cert-manager | Deployment | 1 | | | | | | cert-manager-cainjector | Deployment | 1 | | | | | | cert-manager-webhook | Deployment | 1 | | | | | | coredns | Deployment | 2 | 100m | 70Mi | | 170Mi | | coredns-autoscaler | Deployment | 1 | 20m | 10Mi | | | | dns-controller | Deployment | 1 | 50m | 50Mi | | | | druid-broker | Deployment | 2 | | 26Gi | | 26Gi | | druid-coordinator | Deployment | 1 | | 1Gi | | 8Gi | | druid-router | Deployment | 1 | | | | | | prod-dsk-metric-base-agg-stream-1m | Deployment | 3 | 500m | 1Gi | 1 | 2Gi | | prod-dsk-metric-base-agg-stream-5m | Deployment | 3 | 500m | 1Gi | 1 | 2Gi | | prod-dsk-metric-base-flat-stream | Deployment | 4 | 500m | 500Mi | 1 | 1Gi | | prod-dsk-notification-api | Deployment | 1 | | | | | | prod-dsk-tagging-connector-group1 | Deployment | 1 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-tagging-connector-group2 | Deployment | 1 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-tagging-connector-group3 | Deployment | 1 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-tagging-connector-group4 | Deployment | 1 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-tagging-connector-jaeger-process | Deployment | 1 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-tagging-connector-manifest | Deployment | 1 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-trace-stream | Deployment | 3 | | | | | | prod-dsk-ui | Deployment | 1 | | | | | | prod-dsk-usergate-api | Deployment | 1 | | | | | | prometheus-kube-state-metrics | Deployment | 1 | 10m | 32Mi | 100m | 64Mi | | prometheus-prometheus-pushgateway | Deployment | 1 | 100m | 30Mi | 200m | 50Mi | | prometheus-server | Deployment | 1 | | | | | | strimzi-cluster-operator | Deployment | 1 | 200m | 384Mi | 1 | 384Mi | | vault-agent-injector | Deployment | 1 | | | | | | zoo-entrance | Deployment | 1 | | | | | | kafka-ui | Deployment | 1 | | | | | | metrics-server | Deployment | 1 | 100m | 200Mi | | | | mongo-dsk-mongodb-sharded-mongos | Deployment | 1 | | | | | | mongo-manifest-mongodb-sharded-mongos | Deployment | 1 | | | | | | nfs-provisioner-prod-nfs-subdir-external-provisioner | Deployment | 1 | | | | | | prod-dsk-agent-api | Deployment | 1 | | | | | | prod-dsk-agentmanager-api | Deployment | 1 | | | | | | prod-dsk-alert-api | Deployment | 1 | | | | | | prod-dsk-apm-api | Deployment | 1 | 100m | 256Mi | 250m | 512Mi | | prod-dsk-app-sender | Deployment | 1 | | | | | | prod-dsk-backoffice | Deployment | 0 | | | | | | prod-dsk-chart-api | Deployment | 6 | 500m | 512Mi | 1 | 1Gi | | prod-dsk-dashboard-api | Deployment | 1 | | | | | | prod-dsk-database-api | Deployment | 3 | 100m | 256Mi | 250m | 512Mi | | prod-dsk-database-plan-stream | Deployment | 1 | | | | | | prod-dsk-datagate-dsk-datagate-manifest | Deployment | 1 | 100m | 100M | 200m | 200M | | prod-dsk-datagate-dsk-datagate-metric | Deployment | 5 | 250m | 250M | 500m | 500M | | prod-dsk-datagate-dsk-datagate-plan | Deployment | 1 | 100m | 100M | 250m | 250M | | prod-dsk-datagate-dsk-datagate-trace | Deployment | 2 | 100m | 250M | 200m | 500M | | prod-dsk-infrastructure-api | Deployment | 1 | 100m | 256Mi | 250m | 512Mi | | prod-dsk-kafka2storage-database-plan-stream | Deployment | 1 | 300m | 500Mi | 500m | 1G | | prod-dsk-kafka2storage-database-stat-query | Deployment | 1 | 300m | 500Mi | 500m | 1G | | prod-dsk-kafka2storage-manifest-original | Deployment | 1 | 300m | 500Mi | 500m | 1G | | prod-dsk-kafka2storage-trace-span-stream | Deployment | 1 | 300m | 500Mi | 500m | 1G | | prod-dsk-krakend | Deployment | 3 | 200m | 256Mi | 500m | 512Mi | | prod-dsk-log-api | Deployment | 1 | | | | | | prod-dsk-loggate | Deployment | 4 | 100m | 500Mi | 200m | 1500Mi | | es-master | Stateful_Set | 3 | 3 | 14Gi | 4 | 15Gi | | es-data | Stateful_Set | 2 | 7 | 30Gi | 8 | 31Gi | | prometheus-alertmanager | Stateful_Set | 1 | 10m | 32Mi | 100m | 128Mi | | keycloak | Stateful_Set | 1 | | | | | | druid-zookeeper | Stateful_Set | 3 | 250m | 256Mi | | | | rabbitmq | Stateful_Set | 1 | | | | | | mongo-dsk-mongodb-sharded-configsvr | Stateful_Set | 1 | | | | | | druid-postgresql | Stateful_Set | 1 | 250m | 256Mi | | | | mongo-dsk-mongodb-sharded-shard0-data | Stateful_Set | 1 | | | | | | mongo-dsk-mongodb-sharded-shard1-data | Stateful_Set | 1 | | | | | | mongo-manifest-mongodb-sharded-configsvr | Stateful_Set | 1 | | | | | | druid-middle-manager | Stateful_Set | 2 | | 1Gi | | 60Gi | | mongo-manifest-mongodb-sharded-shard0-data | Stateful_Set | 1 | | | | | | mongo-manifest-mongodb-sharded-shard1-data | Stateful_Set | 1 | | | | | | redis-master | Stateful_Set | 1 | | | | | | postgresql | Stateful_Set | 1 | 250m | 256Mi | | | | postgresql-tenant | Stateful_Set | 1 | 250m | 256Mi | | | | vault | Stateful_Set | 1 | | | | | | druid-historical | Stateful_Set | 2 | | 26Gi | | 26Gi | ## 서비스 목록 (NodePort) [34] | name | namespace | type | node_port | age | |-----------------------------------------|-------------------|----------|-----------|-------------------------| | rabbitmq | dsk-middle | NodePort | 30038 | 5 mons 26 days 23:36:46 | | cmak | dsk-middle | NodePort | 30082 | 1 day 22:59:44 | | keycloak | dsk-middle | NodePort | 30100 | 5 mons 24 days 23:38:54 | | keycloak | dsk-middle | NodePort | 30101 | 5 mons 24 days 23:38:54 | | mongo-manifest-mongodb-sharded | dsk-middle | NodePort | 30111 | 1 mon 9 days 14:32:08 | | mongo-dsk-mongodb-sharded | dsk-middle | NodePort | 30112 | 1 mon 9 days 13:19:28 | | redis-master | dsk-middle | NodePort | 30229 | 5 mons 26 days 23:36:33 | | es-data | dsk-middle | NodePort | 30347 | 2 days 03:36:43 | | rabbitmq | dsk-middle | NodePort | 30523 | 5 mons 26 days 23:36:46 | | rabbitmq | dsk-middle | NodePort | 30565 | 5 mons 26 days 23:36:46 | | rabbitmq | dsk-middle | NodePort | 30655 | 5 mons 26 days 23:36:46 | | rabbitmq | dsk-middle | NodePort | 31021 | 5 mons 26 days 23:36:46 | | kafka-ui | dsk-middle | NodePort | 31101 | 1 day 22:42:32 | | postgresql-tenant | dsk-middle | NodePort | 31103 | 1 day 05:01:33 | | prometheus-server | prometheus | NodePort | 31132 | 27 days 22:21:34 | | prometheus-alertmanager | prometheus | NodePort | 31133 | 27 days 22:21:34 | | prod-dsk-datagate-dsk-datagate-trace | dsk-datagate-prod | NodePort | 31300 | 4 mons 21 days 20:31:55 | | prod-dsk-datagate-dsk-datagate-manifest | dsk-datagate-prod | NodePort | 31301 | 5 mons 2 days 21:47:40 | | prod-dsk-datagate-dsk-datagate-metric | dsk-datagate-prod | NodePort | 31302 | 5 mons 2 days 21:47:40 | | prod-dsk-datagate-dsk-datagate-plan | dsk-datagate-prod | NodePort | 31303 | 5 mons 2 days 21:47:40 | | prod-dsk-loggate | dsk-datagate-prod | NodePort | 31304 | 4 mons 27 days 22:01:29 | | prod-dsk-loggate | dsk-datagate-prod | NodePort | 31305 | 4 mons 27 days 22:01:29 | | rel-dsk-datagate-trace | dsk-datagate-rel | NodePort | 31310 | 8 days 22:55:11 | | rel-dsk-datagate-manifest | dsk-datagate-rel | NodePort | 31311 | 8 days 22:55:11 | | rel-dsk-datagate-metric | dsk-datagate-rel | NodePort | 31312 | 8 days 22:55:11 | | rel-dsk-datagate-plan | dsk-datagate-rel | NodePort | 31313 | 8 days 22:55:11 | | rel-dsk-loggate | dsk-datagate-rel | NodePort | 31314 | 8 days 22:54:47 | | rel-dsk-loggate | dsk-datagate-rel | NodePort | 31315 | 8 days 22:54:47 | | prod-dsk-backoffice | dsk-api-prod | NodePort | 31523 | 2 mons 3 days 03:43:25 | | rabbitmq | dsk-middle | NodePort | 31987 | 5 mons 26 days 23:36:46 | | postgresql | dsk-middle | NodePort | 32098 | 5 mons 26 days 23:37:09 | | es-data | dsk-middle | NodePort | 32220 | 2 days 03:36:43 | | es-master | dsk-middle | NodePort | 32221 | 2 days 03:38:17 | | es-master | dsk-middle | NodePort | 32289 | 2 days 03:38:17 | ## 예약 인스턴스 사용 내역 [10] | availability_zone | instance_type | cpu | memory | ri_count | ec2_count | result | |-------------------|---------------|-----|--------|----------|-----------|--------| | ap-northeast-2a | t3.small | 2 | 2 | 2 | 1 | -1 | | ap-northeast-2a | c5a.large | 2 | 4 | 1 | 1 | 0 | | ap-northeast-2b | c5a.large | 2 | 4 | 1 | 1 | 0 | | ap-northeast-2c | m5a.2xlarge | 8 | 32 | 1 | 8 | 7 | | ap-northeast-2c | m5a.4xlarge | 16 | 64 | 1 | 3 | 2 | | ap-northeast-2c | m5a.xlarge | 4 | 16 | 7 | 7 | 0 | | ap-northeast-2c | m6i.xlarge | 4 | 16 | 4 | 4 | 0 | | ap-northeast-2c | t3.small | 2 | 2 | 1 | 1 | 0 | | ap-northeast-2c | c5a.large | 2 | 4 | 1 | 1 | 0 | | ap-northeast-2c | m5.4xlarge | 16 | 64 | 0 | 1 | 1 |