Istio の Envoy Proxy のメモリ使用量の調査 2

昨日の Istio の Envoy Proxy のメモリ使用量の調査の続き。

前の投稿ではあまりメモリ消費量を増やせなかったので、問題となっているアプリを想定した構成にしたところ、メモリ使用量を大きくすることができた。 問題となっているアプリケーションは 1 Deployment が全て 1 Replica であり、各 Deployment には 1-2 の Service がある。1 Namespace にはこの Deployment が 50 個程度ある。

また Sidecar リソースを使って Namespace Isolation を行った場合の効果も合わせて測定した。

準備

m6i.large (2 core) を 100 ノードの構成にする。

$ k get nodes | head
NAME                                              STATUS   ROLES    AGE   VERSION
ip-10-0-101-103.ap-northeast-1.compute.internal   Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-101-58.ap-northeast-1.compute.internal    Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-102-166.ap-northeast-1.compute.internal   Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-102-32.ap-northeast-1.compute.internal    Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-104-145.ap-northeast-1.compute.internal   Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-104-163.ap-northeast-1.compute.internal   Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-104-37.ap-northeast-1.compute.internal    Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-104-43.ap-northeast-1.compute.internal    Ready    <none>   77m   v1.29.6-eks-1552ad0
ip-10-0-106-38.ap-northeast-1.compute.internal    Ready    <none>   20h   v1.29.6-eks-1552ad0
$ k get nodes | wc -l
     101

計測用の Pod を配置する Namespace を 2 つ用意する。片方には Sidecar リソースを作成し、自分自身の Namespace と istio-system Namespace との通信だけを許可する。

k create ns measure1
k label namespace measure1 istio-injection=enabled
k -n measure1 create deployment test1 --image=public.ecr.aws/docker/library/nginx --replicas=1
k create ns measure2
k label namespace measure2 istio-injection=enabled
k -n measure2 create deployment test1 --image=public.ecr.aws/docker/library/nginx --replicas=1
cat <<EOF | kubectl apply -f -
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
  name: default
  namespace: measure2
spec:
  egress:
  - hosts:
    - "./*"
    - "istio-system/*"
EOF
$ istioctl proxy-status
NAME                                CLUSTER        CDS              LDS              EDS              RDS              ECDS        ISTIOD                     VERSION
test1-6658f86b76-mppvq.measure1     Kubernetes     SYNCED (4s)      SYNCED (4s)      SYNCED (4s)      SYNCED (4s)      IGNORED     istiod-dd95d7bdc-ss9ws     1.23.0
test1-6658f86b76-vqkhm.measure2     Kubernetes     SYNCED (10s)     SYNCED (10s)     SYNCED (10s)     SYNCED (10s)     IGNORED     istiod-dd95d7bdc-jw984     1.23.0

テスト実施

テストは以下のようなスクリプトを実行して行う。アプリを 10 インスタンス作成し、その際にメモリ使用量の変化を測定する。

for i in {1..10}
do
  date
  echo "create ns${i}"
  k create ns ns${i}
  k label namespace ns${i} istio-injection=enabled
  for j in {1..50}
  do
    k -n ns${i} create deployment test${j} --image=public.ecr.aws/docker/library/nginx --replicas=1
    k -n ns${i} expose deployment test${j} --port=80 --target-port=80
    k -n ns${i} expose deployment test${j} --port=80 --target-port=80 --cluster-ip=None --name=test${j}-headless
  done
  echo "sleep 30sec"
  sleep 30
  echo "####################"
  echo "number of node"
  k get no -A --no-headers | wc -l
  echo "number of pod"
  k get po -A --no-headers | wc -l
  echo "number of service"
  k get svc -A --no-headers | wc -l
  echo "k top pod"
  k top pod --containers -n measure1 | grep istio-proxy
  k top pod --containers -n measure2 | grep istio-proxy
  echo "number of cluster"
  istioctl proxy-config cluster test1-6658f86b76-mppvq.measure1 | wc -l
  istioctl proxy-config cluster test1-6658f86b76-vqkhm.measure2 | wc -l
  echo "number of listener"
  istioctl proxy-config listener test1-6658f86b76-mppvq.measure1 | wc -l
  istioctl proxy-config listener test1-6658f86b76-vqkhm.measure2 | wc -l
  echo "number of route"
  istioctl proxy-config route test1-6658f86b76-mppvq.measure1 | wc -l
  istioctl proxy-config route test1-6658f86b76-vqkhm.measure2 | wc -l
  echo "number of endpoint"
  istioctl proxy-config endpoint test1-6658f86b76-mppvq.measure1 | wc -l
  istioctl proxy-config endpoint test1-6658f86b76-vqkhm.measure2 | wc -l
  echo "####################"
done

実行ログ

2024919日 木曜日 184532秒 JST
create ns1
namespace/ns1 created
namespace/ns1 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     257
number of service
     104
k top pod
test1-6658f86b76-mppvq   istio-proxy   6m           42Mi            
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     116
      12
number of listener
     222
      17
number of route
     108
       7
number of endpoint
      70
      13
####################
2024919日 木曜日 184827秒 JST
create ns2
namespace/ns2 created
namespace/ns2 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     310
number of service
     204
k top pod
test1-6658f86b76-mppvq   istio-proxy   2m           56Mi            
test1-6658f86b76-vqkhm   istio-proxy   2m           24Mi            
number of cluster
     216
      12
number of listener
     422
      17
number of route
     208
       7
number of endpoint
     132
      25
####################
2024919日 木曜日 185122秒 JST
create ns3
namespace/ns3 created
namespace/ns3 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     360
number of service
     304
k top pod
test1-6658f86b76-mppvq   istio-proxy   29m          73Mi            
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     316
      12
number of listener
     622
      17
number of route
     308
       7
number of endpoint
     182
      25
####################
2024919日 木曜日 185419秒 JST
create ns4
namespace/ns4 created
namespace/ns4 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     410
number of service
     404
k top pod
test1-6658f86b76-mppvq   istio-proxy   22m          89Mi            
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     416
      12
number of listener
     822
      17
number of route
     408
       7
number of endpoint
     232
      25
####################
2024919日 木曜日 185718秒 JST
create ns5
namespace/ns5 created
namespace/ns5 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     460
number of service
     504
k top pod
test1-6658f86b76-mppvq   istio-proxy   3m           105Mi           
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     516
      12
number of listener
    1022
      17
number of route
     508
       7
number of endpoint
     282
      25
####################
2024919日 木曜日 190019秒 JST
create ns6
namespace/ns6 created
namespace/ns6 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     510
number of service
     604
k top pod
test1-6658f86b76-mppvq   istio-proxy   3m           123Mi           
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     616
      12
number of listener
    1222
      17
number of route
     608
       7
number of endpoint
     332
      25
####################
2024919日 木曜日 190317秒 JST
create ns7
namespace/ns7 created
namespace/ns7 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     560
number of service
     704
k top pod
test1-6658f86b76-mppvq   istio-proxy   9m           136Mi           
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     716
      12
number of listener
    1422
      17
number of route
     708
       7
number of endpoint
     382
      25
####################
2024919日 木曜日 190617秒 JST
create ns8
namespace/ns8 created
namespace/ns8 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     610
number of service
     804
k top pod
test1-6658f86b76-mppvq   istio-proxy   19m          151Mi           
test1-6658f86b76-vqkhm   istio-proxy   2m           23Mi            
number of cluster
     816
      12
number of listener
    1622
      17
number of route
     808
       7
number of endpoint
     432
      25
####################
2024919日 木曜日 190922秒 JST
create ns9
namespace/ns9 created
namespace/ns9 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     660
number of service
     904
k top pod
test1-6658f86b76-mppvq   istio-proxy   3m           169Mi           
test1-6658f86b76-vqkhm   istio-proxy   1m           23Mi            
number of cluster
     916
      12
number of listener
    1822
      17
number of route
     908
       7
number of endpoint
     482
      25
####################
2024919日 木曜日 191227秒 JST
create ns10
namespace/ns10 created
namespace/ns10 labeled
deployment.apps/test1 created
service/test1 exposed
service/test1-headless exposed
deployment.apps/test2 created
service/test2 exposed
service/test2-headless exposed
deployment.apps/test3 created
service/test3 exposed
service/test3-headless exposed
deployment.apps/test4 created
service/test4 exposed
service/test4-headless exposed
deployment.apps/test5 created
service/test5 exposed
service/test5-headless exposed
deployment.apps/test6 created
service/test6 exposed
service/test6-headless exposed
deployment.apps/test7 created
service/test7 exposed
service/test7-headless exposed
deployment.apps/test8 created
service/test8 exposed
service/test8-headless exposed
deployment.apps/test9 created
service/test9 exposed
service/test9-headless exposed
deployment.apps/test10 created
service/test10 exposed
service/test10-headless exposed
deployment.apps/test11 created
service/test11 exposed
service/test11-headless exposed
deployment.apps/test12 created
service/test12 exposed
service/test12-headless exposed
deployment.apps/test13 created
service/test13 exposed
service/test13-headless exposed
deployment.apps/test14 created
service/test14 exposed
service/test14-headless exposed
deployment.apps/test15 created
service/test15 exposed
service/test15-headless exposed
deployment.apps/test16 created
service/test16 exposed
service/test16-headless exposed
deployment.apps/test17 created
service/test17 exposed
service/test17-headless exposed
deployment.apps/test18 created
service/test18 exposed
service/test18-headless exposed
deployment.apps/test19 created
service/test19 exposed
service/test19-headless exposed
deployment.apps/test20 created
service/test20 exposed
service/test20-headless exposed
deployment.apps/test21 created
service/test21 exposed
service/test21-headless exposed
deployment.apps/test22 created
service/test22 exposed
service/test22-headless exposed
deployment.apps/test23 created
service/test23 exposed
service/test23-headless exposed
deployment.apps/test24 created
service/test24 exposed
service/test24-headless exposed
deployment.apps/test25 created
service/test25 exposed
service/test25-headless exposed
deployment.apps/test26 created
service/test26 exposed
service/test26-headless exposed
deployment.apps/test27 created
service/test27 exposed
service/test27-headless exposed
deployment.apps/test28 created
service/test28 exposed
service/test28-headless exposed
deployment.apps/test29 created
service/test29 exposed
service/test29-headless exposed
deployment.apps/test30 created
service/test30 exposed
service/test30-headless exposed
deployment.apps/test31 created
service/test31 exposed
service/test31-headless exposed
deployment.apps/test32 created
service/test32 exposed
service/test32-headless exposed
deployment.apps/test33 created
service/test33 exposed
service/test33-headless exposed
deployment.apps/test34 created
service/test34 exposed
service/test34-headless exposed
deployment.apps/test35 created
service/test35 exposed
service/test35-headless exposed
deployment.apps/test36 created
service/test36 exposed
service/test36-headless exposed
deployment.apps/test37 created
service/test37 exposed
service/test37-headless exposed
deployment.apps/test38 created
service/test38 exposed
service/test38-headless exposed
deployment.apps/test39 created
service/test39 exposed
service/test39-headless exposed
deployment.apps/test40 created
service/test40 exposed
service/test40-headless exposed
deployment.apps/test41 created
service/test41 exposed
service/test41-headless exposed
deployment.apps/test42 created
service/test42 exposed
service/test42-headless exposed
deployment.apps/test43 created
service/test43 exposed
service/test43-headless exposed
deployment.apps/test44 created
service/test44 exposed
service/test44-headless exposed
deployment.apps/test45 created
service/test45 exposed
service/test45-headless exposed
deployment.apps/test46 created
service/test46 exposed
service/test46-headless exposed
deployment.apps/test47 created
service/test47 exposed
service/test47-headless exposed
deployment.apps/test48 created
service/test48 exposed
service/test48-headless exposed
deployment.apps/test49 created
service/test49 exposed
service/test49-headless exposed
deployment.apps/test50 created
service/test50 exposed
service/test50-headless exposed
sleep 30sec
####################
number of node
     100
number of pod
     710
number of service
    1004
k top pod
test1-6658f86b76-mppvq   istio-proxy   12m          179Mi           
test1-6658f86b76-vqkhm   istio-proxy   2m           23Mi            
number of cluster
    1016
      12
number of listener
    2022
      17
number of route
    1008
       7
number of endpoint
     532
      25
####################

グラフ

アプリケーションのインスタンス数に応じて線形に増えていることが確認できる。Sidecar がある場合は他の Namespace の影響を受けないので一切増えないことも確認できる。