sa_8001/dsk-iac
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
9b95c71aef0fa6f51a01d55983931a22a12cf098
dsk-iac/README.md
havelight-ee 9b95c71aef steampipe schedule
2023-06-09 17:29:46 +09:00

31 KiB
Raw Blame History

*기준 시간 : 2023.06.09 17:28:50

dsk-iac

aws 환경 구축 시 사용하는 파일을 정리한다.

directory 구조

  1. __docs: 문서파일 저장.
  2. architecture : aws 구성도
  3. kops: aws kubernetes cluster 구성
  4. packer: aws ami 생성
  5. script: lambda 실행, key 배포 등 스크립트
  6. terraform: terraform code

노드 목록 [31]

name ip taints_key instance_group cpu memory zone instance_type os k8s_ver runtime_ver
i-04abf3bdccadaf05c 172.24.13.138/23 - k8s-prod-tmp 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0628e1521b484fde1 172.24.11.188/23 control-plane - 2 4 ap-northeast-2b c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0446ae551deac0b98 172.24.8.218/23 control-plane - 2 4 ap-northeast-2a c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-041b16dbf097aa03f 172.24.12.111/23 control-plane - 2 4 ap-northeast-2c c5a.large Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-06c80df6180d036bf 172.24.13.248/23 prod/data k8s-prod-data 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0a36b91bce0b86b6f 172.24.12.142/23 prod/data-druid k8s-prod-data-druid-c 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07aebcfff479c0331 172.24.12.210/23 prod/data-druid k8s-prod-data-druid-small 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f2de40153ccd640e 172.24.13.2/23 prod/data-druid k8s-prod-data-druid-middle 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07046cde77753a2d4 172.24.12.252/23 prod/data-druid k8s-prod-data-druid-c 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0c370e3211468e6e5 172.24.12.96/23 prod/data-druid k8s-prod-data-druid-middle 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-076a7682ef711c83a 172.24.13.9/23 prod/data-es-data k8s-prod-data-es-data 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0e5e379f9b04cd2fa 172.24.13.1/23 prod/data-es-data k8s-prod-data-es-data 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f0b728f94d19d020 172.24.12.153/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-04712bc4966dadc68 172.24.12.88/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-09a912b0d23c15283 172.24.13.201/23 prod/data-es-master k8s-prod-data-es-master 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-046572392b64748b1 172.24.13.78/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-09a8af86b9a3d6474 172.24.13.122/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0ddf860cc0e3c4b92 172.24.13.237/23 prod/data-kafka k8s-prod-data-kafka 8 31 ap-northeast-2c m5a.2xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0b38484102aa244e8 172.24.13.227/23 prod/druid-middlemanager k8s-prod-data-druid-large 16 63 ap-northeast-2c m5.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-07fd9c87549c8ca0c 172.24.12.112/23 prod/druid-middlemanager k8s-prod-data-druid-large 16 62 ap-northeast-2c m5a.4xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-009e56755c657e557 172.24.13.8/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0e4a89bcc7c6421bf 172.24.13.66/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0f5eef7ed3a20e103 172.24.13.82/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0dc48b11bbb330012 172.24.13.236/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0dd28df2ff60bf63b 172.24.13.134/23 prod/process k8s-prod-process-m6i 4 16 ap-northeast-2c m6i.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-001143efb27f5c473 172.24.13.189/23 prod/process k8s-prod-process-m5a 4 16 ap-northeast-2c m5a.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0c6444f262a00977d 172.24.12.121/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5d.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-02ffe2238d8387b15 172.24.12.185/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-014fd1c1824cc6ae4 172.24.13.145/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5d.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0ac3b27cbeafbd5ab 172.24.13.183/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8
i-0bdba4f08525b72d3 172.24.13.197/23 prod/rel-process k8s-rel-process-c 4 16 ap-northeast-2c m5zn.xlarge Ubuntu 20.04.4 LTS v1.25.2 containerd://1.6.8

리소스 목록 [107]

name c_name kind count request_cpu request_mem limit_cpu limit_mem
dsk-base-agent dsk-node-agent DaemonSet 31 50m 128Mi 100m 250Mi
aws-cloud-controller-manager aws-cloud-controller-manager DaemonSet 3 200m
promtail promtail DaemonSet 31
dsk-trace-agent dsk-trace-agent DaemonSet 31
prometheus-prometheus-node-exporter node-exporter DaemonSet 31
kops-controller kops-controller DaemonSet 3 50m 50Mi
calico-node calico-node DaemonSet 31 100m
ingress-nginx-controller controller DaemonSet 7 100m 90Mi
dsk-base-agent dsk-container-agent DaemonSet 31 50m 128Mi 100m 250Mi
dsk-log-agent dsk-log-agent DaemonSet 20 250m 512Mi 500m 1G
ebs-csi-node ebs-plugin DaemonSet 31
ebs-csi-node liveness-probe DaemonSet 31
ebs-csi-node node-driver-registrar DaemonSet 31
es-log-collector fluent-bit DaemonSet 1 10m 20Mi 50m 50Mi
dsk-kafka-exporter dsk-kafka-exporter Deployment 1
dsk-kubernetes-agent dsk-k8s-agent Deployment 1 100m 512Mi 1 1000Mi
dsk-kubernetes-agent dsk-kube-state-agent Deployment 1 100m 512Mi 1 1000Mi
dsk-otel otelcol Deployment 1 250m 512M 1 2048M
dsk-postgres-agents-pg-1 dsk-postgres-agent Deployment 1 100m 512Mi 1 1000Mi
dsk-vault-agent vault-agent Deployment 1
ebs-csi-controller csi-attacher Deployment 2
ebs-csi-controller csi-provisioner Deployment 2
ebs-csi-controller csi-resizer Deployment 2
ebs-csi-controller ebs-plugin Deployment 2
ebs-csi-controller liveness-probe Deployment 2
dsk-postgres-agents-pg-1 dsk-plan-postgres-agent Deployment 1 100m 512Mi 1 1000Mi
calico-kube-controllers calico-kube-controllers Deployment 1
cert-manager cert-manager-controller Deployment 1
cert-manager-cainjector cert-manager-cainjector Deployment 1
cert-manager-webhook cert-manager-webhook Deployment 1
coredns coredns Deployment 2 100m 70Mi 170Mi
coredns-autoscaler autoscaler Deployment 1 20m 10Mi
dns-controller dns-controller Deployment 1 50m 50Mi
druid-broker druid Deployment 2 26Gi 26Gi
druid-coordinator druid Deployment 1 1Gi 8Gi
druid-router druid Deployment 1
dsk-entity-operator tls-sidecar Deployment 1
dsk-entity-operator topic-operator Deployment 1
dsk-entity-operator user-operator Deployment 1
prod-dsk-metric-custom-flat-stream dsk-metric-custom-flat-stream Deployment 3
prod-dsk-notification-api dsk-notification-api Deployment 1 100m 250Mi 300m 750Mi
prod-dsk-tagging-connector-group1 prod-dsk-tagging-connector-group1 Deployment 1 250m 250Mi 500m 750Mi
prod-dsk-tagging-connector-group2 prod-dsk-tagging-connector-group2 Deployment 1 250m 250Mi 500m 750Mi
prod-dsk-tagging-connector-group3 prod-dsk-tagging-connector-group3 Deployment 1 250m 250Mi 500m 750Mi
prod-dsk-tagging-connector-group4 prod-dsk-tagging-connector-group4 Deployment 1 250m 250Mi 500m 750Mi
prod-dsk-tagging-connector-jaeger-process prod-dsk-tagging-connector-jaeger-process Deployment 1 250m 250Mi 500m 750Mi
prod-dsk-tagging-connector-manifest prod-dsk-tagging-connector-manifest Deployment 1 250m 250Mi 500m 750Mi
prod-dsk-trace-stream dsk-trace-stream Deployment 3 100m 250Mi 300m 750Mi
prod-dsk-ui dsk-ui Deployment 1
prod-dsk-usergate-api dsk-usergate-api Deployment 1
prometheus-kube-state-metrics kube-state-metrics Deployment 1 10m 32Mi 100m 64Mi
prometheus-prometheus-pushgateway pushgateway Deployment 1 100m 30Mi 200m 50Mi
prometheus-server prometheus-server Deployment 1 500m 2Gi 2 8Gi
prometheus-server prometheus-server-configmap-reload Deployment 1
strimzi-cluster-operator strimzi-cluster-operator Deployment 1 200m 384Mi 1 384Mi
vault-agent-injector sidecar-injector Deployment 1
zoo-entrance cmak Deployment 1
zoo-entrance zoo-entrance Deployment 1
kafka-ui kafka-ui Deployment 1
metrics-server metrics-server Deployment 1 100m 200Mi
mongo-dsk-mongodb-sharded-mongos mongos Deployment 1
mongo-manifest-mongodb-sharded-mongos mongos Deployment 1
nfs-provisioner-prod-nfs-subdir-external-provisioner nfs-subdir-external-provisioner Deployment 1
prod-dsk-agent-api dsk-agent-api Deployment 1
prod-dsk-agentmanager-api dsk-agentmanager-api Deployment 1
prod-dsk-alert-api dsk-alert-api Deployment 1
prod-dsk-apm-api dsk-apm-api Deployment 1 100m 256Mi 250m 512Mi
prod-dsk-app-sender dsk-app-sender Deployment 1
prod-dsk-backoffice dsk-backoffice Deployment 0
prod-dsk-chart-api dsk-chart-api Deployment 6 500m 512Mi 1 1Gi
prod-dsk-dashboard-api dsk-dashboard-api Deployment 1
prod-dsk-database-api dsk-database-api Deployment 3 100m 256Mi 250m 512Mi
prod-dsk-database-plan-stream dsk-database-plan-stream Deployment 1
prod-dsk-datagate-dsk-datagate-manifest prod-dsk-datagate-dsk-datagate-manifest Deployment 1 100m 100M 200m 200M
prod-dsk-datagate-dsk-datagate-metric prod-dsk-datagate-dsk-datagate-metric Deployment 5 250m 250M 500m 500M
prod-dsk-datagate-dsk-datagate-plan prod-dsk-datagate-dsk-datagate-plan Deployment 1 100m 100M 250m 250M
prod-dsk-datagate-dsk-datagate-trace prod-dsk-datagate-dsk-datagate-trace Deployment 2 100m 250M 200m 500M
prod-dsk-infrastructure-api dsk-infrastructure-api Deployment 1 100m 256Mi 250m 512Mi
prod-dsk-kafka2storage-database-plan-stream dsk-kafka2storage Deployment 1 300m 500Mi 500m 1G
prod-dsk-kafka2storage-database-stat-query dsk-kafka2storage Deployment 1 300m 500Mi 500m 1G
prod-dsk-kafka2storage-manifest-original dsk-kafka2storage Deployment 1 300m 500Mi 500m 1G
prod-dsk-kafka2storage-trace-span-stream dsk-kafka2storage Deployment 1 300m 500Mi 500m 1G
prod-dsk-krakend dsk-krakend Deployment 3 200m 256Mi 500m 512Mi
prod-dsk-log-api dsk-log-api Deployment 1
prod-dsk-loggate dsk-loggate Deployment 4 100m 500Mi 200m 1500Mi
prod-dsk-metric-base-agg-stream-1m prod-dsk-metric-base-agg-stream-1m Deployment 3 500m 1Gi 1 2Gi
prod-dsk-metric-base-agg-stream-5m prod-dsk-metric-base-agg-stream-5m Deployment 3 500m 1Gi 1 2Gi
prod-dsk-metric-base-flat-stream dsk-metric-base-flat-stream Deployment 4 500m 500Mi 1 1Gi
es-data elasticsearch Stateful_Set 2 7 30Gi 8 31Gi
es-master elasticsearch Stateful_Set 3 3 14Gi 4 15Gi
druid-zookeeper zookeeper Stateful_Set 3 250m 256Mi
druid-historical druid Stateful_Set 2 26Gi 26Gi
keycloak keycloak Stateful_Set 1
druid-postgresql druid-postgresql Stateful_Set 1 250m 256Mi
druid-middle-manager druid Stateful_Set 2 1Gi 60Gi
mongo-dsk-mongodb-sharded-configsvr mongodb Stateful_Set 1
rabbitmq rabbitmq Stateful_Set 1
mongo-dsk-mongodb-sharded-shard0-data mongodb Stateful_Set 1
mongo-dsk-mongodb-sharded-shard1-data mongodb Stateful_Set 1
mongo-manifest-mongodb-sharded-configsvr mongodb Stateful_Set 1
redis-master redis Stateful_Set 1
mongo-manifest-mongodb-sharded-shard0-data mongodb Stateful_Set 1
mongo-manifest-mongodb-sharded-shard1-data mongodb Stateful_Set 1
vault vault Stateful_Set 1
postgresql postgresql Stateful_Set 1 250m 256Mi
postgresql-tenant postgresql Stateful_Set 1 250m 256Mi
prometheus-alertmanager alertmanager Stateful_Set 1 10m 32Mi 100m 128Mi

서비스 목록 (NodePort) [34]

name namespace type node_port age
rabbitmq dsk-middle NodePort 30038 5 mons 27 days 01:45:21
cmak dsk-middle NodePort 30082 2 days 01:08:19
keycloak dsk-middle NodePort 30100 5 mons 25 days 01:47:29
keycloak dsk-middle NodePort 30101 5 mons 25 days 01:47:29
mongo-manifest-mongodb-sharded dsk-middle NodePort 30111 1 mon 9 days 16:40:43
mongo-dsk-mongodb-sharded dsk-middle NodePort 30112 1 mon 9 days 15:28:03
redis-master dsk-middle NodePort 30229 5 mons 27 days 01:45:08
es-data dsk-middle NodePort 30347 2 days 05:45:18
rabbitmq dsk-middle NodePort 30523 5 mons 27 days 01:45:21
rabbitmq dsk-middle NodePort 30565 5 mons 27 days 01:45:21
rabbitmq dsk-middle NodePort 30655 5 mons 27 days 01:45:21
rabbitmq dsk-middle NodePort 31021 5 mons 27 days 01:45:21
kafka-ui dsk-middle NodePort 31101 2 days 00:51:07
postgresql-tenant dsk-middle NodePort 31103 1 day 07:10:08
prometheus-server prometheus NodePort 31132 28 days 00:30:09
prometheus-alertmanager prometheus NodePort 31133 28 days 00:30:09
prod-dsk-datagate-dsk-datagate-trace dsk-datagate-prod NodePort 31300 4 mons 21 days 22:40:30
prod-dsk-datagate-dsk-datagate-manifest dsk-datagate-prod NodePort 31301 5 mons 2 days 23:56:15
prod-dsk-datagate-dsk-datagate-metric dsk-datagate-prod NodePort 31302 5 mons 2 days 23:56:15
prod-dsk-datagate-dsk-datagate-plan dsk-datagate-prod NodePort 31303 5 mons 2 days 23:56:15
prod-dsk-loggate dsk-datagate-prod NodePort 31304 4 mons 28 days 00:10:04
prod-dsk-loggate dsk-datagate-prod NodePort 31305 4 mons 28 days 00:10:04
rel-dsk-datagate-trace dsk-datagate-rel NodePort 31310 9 days 01:03:46
rel-dsk-datagate-manifest dsk-datagate-rel NodePort 31311 9 days 01:03:46
rel-dsk-datagate-metric dsk-datagate-rel NodePort 31312 9 days 01:03:46
rel-dsk-datagate-plan dsk-datagate-rel NodePort 31313 9 days 01:03:46
rel-dsk-loggate dsk-datagate-rel NodePort 31314 9 days 01:03:22
rel-dsk-loggate dsk-datagate-rel NodePort 31315 9 days 01:03:22
prod-dsk-backoffice dsk-api-prod NodePort 31523 2 mons 3 days 05:52:00
rabbitmq dsk-middle NodePort 31987 5 mons 27 days 01:45:21
postgresql dsk-middle NodePort 32098 5 mons 27 days 01:45:44
es-data dsk-middle NodePort 32220 2 days 05:45:18
es-master dsk-middle NodePort 32221 2 days 05:46:52
es-master dsk-middle NodePort 32289 2 days 05:46:52

예약 인스턴스 사용 내역 [10]

availability_zone instance_type cpu memory ri_count ec2_count result
ap-northeast-2a t3.small 2 2 2 1 -1
ap-northeast-2a c5a.large 2 4 1 1 0
ap-northeast-2b c5a.large 2 4 1 1 0
ap-northeast-2c m5a.2xlarge 8 32 1 8 7
ap-northeast-2c m5a.4xlarge 16 64 1 3 2
ap-northeast-2c m5a.xlarge 4 16 7 7 0
ap-northeast-2c m6i.xlarge 4 16 4 4 0
ap-northeast-2c t3.small 2 2 1 1 0
ap-northeast-2c c5a.large 2 4 1 1 0
ap-northeast-2c m5.4xlarge 16 64 0 1 1