Skip to content

Envoy proxy pods in completed state #7741

@PhiRie

Description

@PhiRie

Description:
Hi,

i run envoy as gateway api in front of a mqtt broker in a managed k8s cluster on Azure. The proxy pods are deployed as deployment with multiple instances and hpa enabled. I deployed the following manifests via kustomize:

apiVersion: gateway.envoyproxy.io/v1alpha1
kind: EnvoyProxy
metadata:
  name: somename-mqtt-proxy-config-dev
  namespace: somename-ingress-dev
spec:
  logging:
    level:
      default: info
  provider:
    kubernetes:
      envoyDeployment:
        container:
          imageRepository: private.repo/envoyproxy/envoy
          resources:
            limits:
              cpu: "1"
              memory: 4Gi
            requests:
              cpu: "1"
              memory: 4Gi
        pod:
          affinity:
            podAntiAffinity:
              preferredDuringSchedulingIgnoredDuringExecution:
              - podAffinityTerm:
                  labelSelector:
                    matchExpressions:
                    - key: app
                      operator: In
                      values:
                      - somename-mqtt-proxy-dev
                  topologyKey: kubernetes.io/hostname
                weight: 100
          annotations:
            iotcore.metrics/enable: "true"
            iotcore.metrics/path: /stats/prometheus
            iotcore.metrics/port: "19001"
          labels:
            app: somename-mqtt-proxy-dev
          nodeSelector:
            pool_type: somenamein
          tolerations:
          - effect: NoSchedule
            key: somenameIngressOnly
            operator: Equal
            value: "true"
      envoyHpa:
        behavior:
          scaleDown:
            policies:
            - periodSeconds: 60
              type: Percent
              value: 100
            selectPolicy: Max
            stabilizationWindowSeconds: 60
          scaleUp:
            policies:
            - periodSeconds: 60
              type: Pods
              value: 1
            - periodSeconds: 60
              type: Percent
              value: 100
            selectPolicy: Max
            stabilizationWindowSeconds: 60
        maxReplicas: 2
        metrics:
        - resource:
            name: memory
            target:
              averageUtilization: 80
              type: Utilization
          type: Resource
        - resource:
            name: cpu
            target:
              averageUtilization: 80
              type: Utilization
          type: Resource
        minReplicas: 2
      envoyPDB:
        minAvailable: 0
    type: Kubernetes
  telemetry:
    accessLog:
      disable: false
      settings:
      - format:
          json:
            bytes_received: '%BYTES_RECEIVED%'
            bytes_sent: '%BYTES_SENT%'
            downstream_local_address: '%DOWNSTREAM_LOCAL_ADDRESS%'
            downstream_local_subject: '%DOWNSTREAM_LOCAL_SUBJECT%'
            downstream_peer_cert: '%DOWNSTREAM_PEER_CERT%'
            downstream_peer_cert_v_end: '%DOWNSTREAM_PEER_CERT_V_END%'
            downstream_peer_cert_v_start: '%DOWNSTREAM_PEER_CERT_V_START%'
            downstream_peer_dns_san: '%DOWNSTREAM_PEER_DNS_SAN%'
            downstream_peer_fingerprint_1: '%DOWNSTREAM_PEER_FINGERPRINT_1%'
            downstream_peer_fingerprint_256: '%DOWNSTREAM_PEER_FINGERPRINT_256%'
            downstream_peer_ip_san: '%DOWNSTREAM_PEER_IP_SAN%'
            downstream_peer_serial: '%DOWNSTREAM_PEER_SERIAL%'
            downstream_peer_subject: '%DOWNSTREAM_PEER_SUBJECT%'
            downstream_remote_address: '%DOWNSTREAM_REMOTE_ADDRESS%'
            downstream_tls_cipher: '%DOWNSTREAM_TLS_CIPHER%'
            downstream_tls_session_id: '%DOWNSTREAM_TLS_SESSION_ID%'
            downstream_tls_version: '%DOWNSTREAM_TLS_VERSION%'
            duration: '%DURATION%'
            requested_server_name: '%REQUESTED_SERVER_NAME%'
            start_time: '%START_TIME%'
            upstream_local_address: '%UPSTREAM_LOCAL_ADDRESS%'
            upstream_peer_subject: '%UPSTREAM_PEER_SUBJECT%'
            upstream_remote_address: '%UPSTREAM_REMOTE_ADDRESS%'
            upstream_transport_failure_reason: '%UPSTREAM_TRANSPORT_FAILURE_REASON%'
          type: JSON
        sinks:
        - openTelemetry:
            backendRefs:
            - name: otel-collector
              namespace: some-namespace
              port: 4317
          type: OpenTelemetry
    metrics:
      prometheus:
        disable: false
      sinks:
      - openTelemetry:
          backendRefs:
          - name: otel-collector
            namespace: some-namespace
            port: 4317
        type: OpenTelemetry
    tracing:
      provider:
        backendRefs:
        - name: otel-collector
          namespace: some-namespace
          port: 4317
        type: OpenTelemetry

---
apiVersion: gateway.networking.k8s.io/v1
kind: Gateway
metadata:
  name: somename-mqtt-proxy-dev
  namespace: somename-ingress-dev
spec:
  gatewayClassName: somename-envoy-gateway-class-dev
  infrastructure:
    annotations:
      service.beta.kubernetes.io/azure-load-balancer-health-probe-request-path: /healthz
      service.beta.kubernetes.io/azure-load-balancer-internal: "true"
      service.beta.kubernetes.io/azure-load-balancer-internal-subnet: azure-subnet
      service.beta.kubernetes.io/azure-load-balancer-ipv4: some-private-ip
    parametersRef:
      group: gateway.envoyproxy.io
      kind: EnvoyProxy
      name: somename-mqtt-proxy-config-dev
  listeners:
  - allowedRoutes:
      kinds:
      - kind: TCPRoute
      namespaces:
        from: Same
    hostname: somename-mqtt-v1.dev.eu.iotcore.liebherr.com
    name: somename-mqtt-listener
    port: 8883
    protocol: TLS
    tls:
      certificateRefs:
      - kind: Secret
        name: somename-mqtt-gateway-tls-secret-dev
        namespace: somename-ingress-dev
      frontendValidation:
        caCertificateRefs:
        - group: ""
          kind: Secret
          name: somename-mqtt-gateway-ca-secret-dev
          namespace: somename-ingress-dev
      mode: Terminate
---
apiVersion: external-secrets.io/v1
kind: ExternalSecret
metadata:
  name: somename-mqtt-gateway-tls-external-secret-dev
  namespace: somename-ingress-dev
spec:
  data:
  - remoteRef:
      decodingStrategy: Base64
      key: somename-mqtt-key
    secretKey: tls.key
  - remoteRef:
      decodingStrategy: Base64
      key: somename-mqtt-crt
    secretKey: tls.crt
  refreshInterval: 1m
  secretStoreRef:
    kind: ClusterSecretStore
    name: some-kv
  target:
    creationPolicy: Owner
    deletionPolicy: Retain
    name: somename-mqtt-gateway-tls-secret-dev
    template:
      type: kubernetes.io/tls
---
apiVersion: external-secrets.io/v1
kind: ExternalSecret
metadata:
  name: somename-mqtt-gateway-ca-external-secret-dev
  namespace: somename-ingress-dev
spec:
  data:
  - remoteRef:
      decodingStrategy: Base64
      key: somename-mqtt-ca-trusts
    secretKey: ca.crt
  refreshInterval: 1m
  secretStoreRef:
    kind: ClusterSecretStore
    name: some-kv
  target:
    creationPolicy: Owner
    deletionPolicy: Retain
    name: somename-mqtt-gateway-ca-secret-dev
---
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: BackendTrafficPolicy
metadata:
  name: somename-mqtt-backend-traffic-policy-dev
  namespace: somename-ingress-dev
spec:
  circuitBreaker:
    maxConnections: 4294967295
    maxParallelRequests: 4294967295
    maxParallelRetries: 4294967295
    maxPendingRequests: 4294967295
  rateLimit:
    global:
      rules:
      - clientSelectors:
        - sourceCIDR:
            type: Distinct
            value: some-internal-service-ip/32
        limit:
          requests: 10
          unit: Second
    type: Global
  targetRefs:
  - group: gateway.networking.k8s.io
    kind: Gateway
    name: somename-mqtt-proxy-dev
---
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: ClientTrafficPolicy
metadata:
  name: somename-mqtt-client-traffic-policy-dev
  namespace: somename-ingress-dev
spec:
  connection:
    connectionLimit:
      value: 10240
  targetRefs:
  - group: gateway.networking.k8s.io
    kind: Gateway
    name: somename-mqtt-proxy-dev
    sectionName: somename-mqtt-listener
  tls:
    minVersion: "1.3"
---
apiVersion: gateway.networking.k8s.io/v1beta1
kind: ReferenceGrant
metadata:
  name: somename-mqtt-tcproute-grant-dev
  namespace: somename-dev
spec:
  from:
  - group: gateway.networking.k8s.io
    kind: TCPRoute
    namespace: somename-ingress-dev
  to:
  - group: ""
    kind: Service
---
apiVersion: gateway.networking.k8s.io/v1alpha2
kind: TCPRoute
metadata:
  name: somename-mqtt-tcproute-dev
  namespace: somename-ingress-dev
spec:
  parentRefs:
  - name: somename-mqtt-proxy-dev
    namespace: somename-ingress-dev
  rules:
  - backendRefs:
    - name: mqtt-broker-somename-dev
      namespace: somename-dev
      port: 1883
      weight: 1
---
apiVersion: gateway.networking.k8s.io/v1
kind: GatewayClass
metadata:
  name: somename-envoy-gateway-class-dev
  namespace: somename-ingress-dev
spec:
  controllerName: gateway.envoyproxy.io/somename-envoy-gateway-controller-dev
---
apiVersion: policy/v1
kind: PodDisruptionBudget
metadata:
  name: envoy-gateway
  namespace: somename-ingress-dev
spec:
  minAvailable: 1
  selector:
    matchLabels:
      app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
      app.kubernetes.io/name: gateway-helm
      control-plane: envoy-gateway
---
apiVersion: v1
kind: ServiceAccount
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    helm.sh/chart: gateway-helm-1.5.3
  name: envoy-gateway
  namespace: somename-ingress-dev
---
apiVersion: v1
data:
  envoy-gateway.yaml: |
    apiVersion: gateway.envoyproxy.io/v1alpha1
    kind: EnvoyGateway
    extensionApis: {}
    gateway:
      controllerName: gateway.envoyproxy.io/somename-envoy-gateway-controller-dev
    logging:
      level:
        default: info
    provider:
      kubernetes:
        rateLimitDeployment:
          container:
            image: private.repo/envoyproxy/ratelimit:e74a664a
          patch:
            type: StrategicMerge
            value:
              spec:
                template:
                  spec:
                    containers:
                    - imagePullPolicy: IfNotPresent
                      name: envoy-ratelimit
        shutdownManager:
          image: private.repo/envoyproxy/gateway:v1.5.3
      type: Kubernetes
kind: ConfigMap
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    helm.sh/chart: gateway-helm-1.5.3
  name: envoy-gateway-config
  namespace: somename-ingress-dev
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
  creationTimestamp: null
  name: somename-envoy-gateway-controller-dev-gateway-helm-envoy-gateway-role
rules:
- apiGroups:
  - ""
  resources:
  - nodes
  - namespaces
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - gateway.networking.k8s.io
  resources:
  - gatewayclasses
  verbs:
  - get
  - list
  - patch
  - update
  - watch
- apiGroups:
  - gateway.networking.k8s.io
  resources:
  - gatewayclasses/status
  verbs:
  - update
- apiGroups:
  - multicluster.x-k8s.io
  resources:
  - serviceimports
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - ""
  resources:
  - configmaps
  - secrets
  - services
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - apps
  resources:
  - deployments
  - daemonsets
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - discovery.k8s.io
  resources:
  - endpointslices
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - gateway.envoyproxy.io
  resources:
  - envoyproxies
  - envoypatchpolicies
  - clienttrafficpolicies
  - backendtrafficpolicies
  - securitypolicies
  - envoyextensionpolicies
  - backends
  - httproutefilters
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - gateway.envoyproxy.io
  resources:
  - envoypatchpolicies/status
  - clienttrafficpolicies/status
  - backendtrafficpolicies/status
  - securitypolicies/status
  - envoyextensionpolicies/status
  - backends/status
  verbs:
  - update
- apiGroups:
  - gateway.networking.k8s.io
  resources:
  - gateways
  - grpcroutes
  - httproutes
  - referencegrants
  - tcproutes
  - tlsroutes
  - udproutes
  - backendtlspolicies
  verbs:
  - get
  - list
  - watch
- apiGroups:
  - gateway.networking.k8s.io
  resources:
  - gateways/status
  - grpcroutes/status
  - httproutes/status
  - tcproutes/status
  - tlsroutes/status
  - udproutes/status
  - backendtlspolicies/status
  verbs:
  - update
- apiGroups:
  - ""
  resources:
  - pods
  - pods/binding
  verbs:
  - get
  - list
  - patch
  - update
  - watch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
  name: somename-envoy-gateway-controller-dev-gateway-helm-envoy-gateway-rolebinding
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: ClusterRole
  name: somename-envoy-gateway-controller-dev-gateway-helm-envoy-gateway-role
subjects:
- kind: ServiceAccount
  name: envoy-gateway
  namespace: somename-ingress-dev
---
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    helm.sh/chart: gateway-helm-1.5.3
  name: somename-envoy-gateway-controller-dev-gateway-helm-infra-manager
  namespace: somename-ingress-dev
rules:
- apiGroups:
  - ""
  resources:
  - serviceaccounts
  - services
  - configmaps
  verbs:
  - create
  - get
  - list
  - delete
  - deletecollection
  - patch
- apiGroups:
  - apps
  resources:
  - deployments
  - daemonsets
  verbs:
  - create
  - get
  - delete
  - deletecollection
  - patch
- apiGroups:
  - autoscaling
  - policy
  resources:
  - horizontalpodautoscalers
  - poddisruptionbudgets
  verbs:
  - create
  - get
  - list
  - delete
  - deletecollection
  - patch
- apiGroups:
  - certificates.k8s.io
  resources:
  - clustertrustbundles
  verbs:
  - list
  - get
  - watch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    helm.sh/chart: gateway-helm-1.5.3
  name: somename-envoy-gateway-controller-dev-gateway-helm-leader-election-role
  namespace: somename-ingress-dev
rules:
- apiGroups:
  - ""
  resources:
  - configmaps
  verbs:
  - get
  - list
  - watch
  - create
  - update
  - patch
  - delete
- apiGroups:
  - coordination.k8s.io
  resources:
  - leases
  verbs:
  - get
  - list
  - watch
  - create
  - update
  - patch
  - delete
- apiGroups:
  - ""
  resources:
  - events
  verbs:
  - create
  - patch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: RoleBinding
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    helm.sh/chart: gateway-helm-1.5.3
  name: somename-envoy-gateway-controller-dev-gateway-helm-infra-manager
  namespace: somename-ingress-dev
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: Role
  name: somename-envoy-gateway-controller-dev-gateway-helm-infra-manager
subjects:
- kind: ServiceAccount
  name: envoy-gateway
  namespace: somename-ingress-dev
---
apiVersion: rbac.authorization.k8s.io/v1
kind: RoleBinding
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    helm.sh/chart: gateway-helm-1.5.3
  name: somename-envoy-gateway-controller-dev-gateway-helm-leader-election-rolebinding
  namespace: somename-ingress-dev
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: Role
  name: somename-envoy-gateway-controller-dev-gateway-helm-leader-election-role
subjects:
- kind: ServiceAccount
  name: envoy-gateway
  namespace: somename-ingress-dev
---
apiVersion: v1
kind: Service
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    control-plane: envoy-gateway
    helm.sh/chart: gateway-helm-1.5.3
  name: envoy-gateway
  namespace: somename-ingress-dev
spec:
  ports:
  - name: grpc
    port: 18000
    targetPort: 18000
  - name: ratelimit
    port: 18001
    targetPort: 18001
  - name: wasm
    port: 18002
    targetPort: 18002
  - name: metrics
    port: 19001
    targetPort: 19001
  - name: webhook
    port: 9443
    targetPort: 9443
  selector:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/name: gateway-helm
    control-plane: envoy-gateway
---
apiVersion: apps/v1
kind: Deployment
metadata:
  labels:
    app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gateway-helm
    app.kubernetes.io/version: v1.5.3
    control-plane: envoy-gateway
    helm.sh/chart: gateway-helm-1.5.3
  name: envoy-gateway
  namespace: somename-ingress-dev
spec:
  replicas: 2
  selector:
    matchLabels:
      app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
      app.kubernetes.io/name: gateway-helm
      control-plane: envoy-gateway
  strategy:
    rollingUpdate:
      maxSurge: 1
      maxUnavailable: 1
    type: RollingUpdate
  template:
    metadata:
      annotations:
        iotcore.metrics/enable: "true"
        iotcore.metrics/path: /metrics
        iotcore.metrics/port: "19001"
        prometheus.io/port: "19001"
        prometheus.io/scrape: "true"
      labels:
        app: envoy-gateway-dev
        app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
        app.kubernetes.io/name: gateway-helm
        control-plane: envoy-gateway
    spec:
      affinity:
        podAntiAffinity:
          preferredDuringSchedulingIgnoredDuringExecution:
          - podAffinityTerm:
              labelSelector:
                matchExpressions:
                - key: app.kubernetes.io/name
                  operator: In
                  values:
                  - gateway-helm
                - key: app.kubernetes.io/instance
                  operator: In
                  values:
                  - somename-envoy-gateway-controller-dev
              topologyKey: kubernetes.io/hostname
            weight: 100
      containers:
      - args:
        - server
        - --config-path=/config/envoy-gateway.yaml
        env:
        - name: ENVOY_GATEWAY_NAMESPACE
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: metadata.namespace
        - name: KUBERNETES_CLUSTER_DOMAIN
          value: cluster.local
        image: private.repo/envoyproxy/gateway:v1.5.3
        imagePullPolicy: IfNotPresent
        livenessProbe:
          httpGet:
            path: /healthz
            port: 8081
          initialDelaySeconds: 15
          periodSeconds: 20
        name: envoy-gateway
        ports:
        - containerPort: 18000
          name: grpc
        - containerPort: 18001
          name: ratelimit
        - containerPort: 18002
          name: wasm
        - containerPort: 19001
          name: metrics
        - containerPort: 9443
          name: webhook
        readinessProbe:
          httpGet:
            path: /readyz
            port: 8081
          initialDelaySeconds: 5
          periodSeconds: 10
        resources:
          limits:
            cpu: 250m
            memory: 256Mi
          requests:
            cpu: 250m
            memory: 256Mi
        securityContext:
          allowPrivilegeEscalation: false
          capabilities:
            drop:
            - ALL
          privileged: false
          runAsGroup: 65532
          runAsNonRoot: true
          runAsUser: 65532
          seccompProfile:
            type: RuntimeDefault
        volumeMounts:
        - mountPath: /config
          name: envoy-gateway-config
          readOnly: true
        - mountPath: /certs
          name: certs
          readOnly: true
      imagePullSecrets: []
      nodeSelector:
        pool_type: somenamein
      serviceAccountName: envoy-gateway
      terminationGracePeriodSeconds: 10
      tolerations:
      - effect: NoSchedule
        key: somenameIngressOnly
        operator: Exists
      volumes:
      - configMap:
          defaultMode: 420
          name: envoy-gateway-config
        name: envoy-gateway-config
      - name: certs
        secret:
          secretName: envoy-gateway

In the logs I don't see any hint, why the pods are completed. The service uptime seems not to be affected by this case, because i have at least two pods running as defined as replicas for my proxy. It seems to be regular behavior because they are drained and killed by the shutdown-manager. But why does the shutdown manager get the signal for stopping the pods?

Here are the logs. They look the same on each completed pod:

: "141 lines displayed"
Total bytes processed: "120  kB"
Common labels: {"app":"somename-mqtt-proxy-prod","k8s_container_restart_count":"0","k8s_deployment_name":"envoy-somename-ingress-prod-somename-mqtt-proxy-prod-2f0fef75","k8s_namespace_name":"somename-ingress-prod","k8s_node_name":"aks-npcominpro-41340154-vmss000001","k8s_pod_name":"envoy-somename-ingress-prod-somename-mqtt-proxy-prod-2f0fef75-pp9ql","k8s_pod_start_time":"2025-12-10T12:01:04Z","k8s_pod_uid":"202619bd-a70f-43a4-aa45-254277a49e27","logtag":"F","service_name":"somename-mqtt-proxy-prod","service_namespace":"somename-ingress-prod"}


1765455681521	2025-12-11T12:21:21.521Z	2025-12-11T12:21:21.521Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455680519	2025-12-11T12:21:20.519Z	2025-12-11T12:21:20.519Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455679518	2025-12-11T12:21:19.518Z	2025-12-11T12:21:19.518Z	INFO	shutdown-manager	envoy/shutdown_manager.go:146	minimum drain period reached; will exit when total connections reaches 0
1765455679518	2025-12-11T12:21:19.518Z	2025-12-11T12:21:19.518Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455678518	2025-12-11T12:21:18.518Z	2025-12-11T12:21:18.517Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455677516	2025-12-11T12:21:17.516Z	2025-12-11T12:21:17.516Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455676515	2025-12-11T12:21:16.515Z	2025-12-11T12:21:16.515Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455675514	2025-12-11T12:21:15.514Z	2025-12-11T12:21:15.514Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455674512	2025-12-11T12:21:14.512Z	2025-12-11T12:21:14.512Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455673511	2025-12-11T12:21:13.511Z	2025-12-11T12:21:13.511Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455672510	2025-12-11T12:21:12.510Z	2025-12-11T12:21:12.510Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455671509	2025-12-11T12:21:11.509Z	2025-12-11T12:21:11.509Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455670508	2025-12-11T12:21:10.508Z	2025-12-11T12:21:10.508Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455669507	2025-12-11T12:21:09.507Z	2025-12-11T12:21:09.507Z	INFO	shutdown-manager	envoy/shutdown_manager.go:218	total connections: 1
1765455669505	2025-12-11T12:21:09.505Z	2025-12-11T12:21:09.505Z	INFO	shutdown-manager	envoy/shutdown_manager.go:127	initiating drain with 10 second minimum drain period and 60 second timeout
1765455669449	2025-12-11T12:21:09.449Z	2025-12-11T12:21:09.449Z	INFO	shutdown-manager	envoy/shutdown_manager.go:90	received shutdown ready request
1765369029488	2025-12-10T12:17:09.488Z	[2025-12-10 12:17:09.488][1][info][main] [source/server/drain_manager_impl.cc:226] shutting down parent after drain
1765368129506	2025-12-10T12:02:09.506Z	2025-12-10T12:02:09.506Z	INFO	shutdown-manager	envoy/shutdown_manager.go:74	starting shutdown manager
1765368129488	2025-12-10T12:02:09.488Z	[2025-12-10 12:02:09.488][1][info][config] [source/common/listener_manager/listener_manager_impl.cc:1003] all dependencies initialized. starting workers
1765368129481	2025-12-10T12:02:09.481Z	[2025-12-10 12:02:09.481][1][info][upstream] [source/common/listener_manager/lds_api.cc:109] lds: add/update listener 'somename-ingress-prod/somename-mqtt-proxy-prod/somename-mqtt-listener'
1765368129480	2025-12-10T12:02:09.480Z	[2025-12-10 12:02:09.480][1][info][upstream] [source/common/listener_manager/lds_api.cc:109] lds: add/update listener 'envoy-gateway-proxy-ready-0.0.0.0-19003'
1765368129476	2025-12-10T12:02:09.476Z	[2025-12-10 12:02:09.476][1][info][main] [source/server/server.cc:1023] all clusters initialized. initializing init manager
1765368129476	2025-12-10T12:02:09.476Z	[2025-12-10 12:02:09.476][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:248] cm init: all clusters initialized
1765368129472	2025-12-10T12:02:09.472Z	[2025-12-10 12:02:09.472][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:222] cm init: initializing secondary clusters
1765368129472	2025-12-10T12:02:09.472Z	[2025-12-10 12:02:09.472][1][info][upstream] [source/common/upstream/cds_api_helper.cc:87] cds: added/updated 3 cluster(s) (skipped 1 unmodified cluster(s)); removed 0 cluster(s)
1765368129471	2025-12-10T12:02:09.471Z	[2025-12-10 12:02:09.471][1][info][upstream] [source/common/upstream/cds_api_helper.cc:34] cds: response indicates 4 added/updated cluster(s), 0 removed cluster(s); applying changes
1765368129469	2025-12-10T12:02:09.469Z	[2025-12-10 12:02:09.469][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:244] cm init: initializing cds
1765368129466	2025-12-10T12:02:09.466Z	[2025-12-10 12:02:09.466][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:222] cm init: initializing secondary clusters
1765368129466	2025-12-10T12:02:09.466Z	[2025-12-10 12:02:09.466][1][info][runtime] [source/common/runtime/runtime_impl.cc:550] RTDS has finished initialization
1765368129450	2025-12-10T12:02:09.450Z	[2025-12-10 12:02:09.450][1][info][main] [source/server/server.cc:1043] starting main dispatch loop
1765368129450	2025-12-10T12:02:09.450Z	[2025-12-10 12:02:09.449][1][info][config] [source/server/configuration_impl.cc:156] loading stats configuration
1765368129449	2025-12-10T12:02:09.449Z	[2025-12-10 12:02:09.448][1][info][config] [source/server/configuration_impl.cc:140] loading 1 listener(s)
1765368129445	2025-12-10T12:02:09.445Z	[2025-12-10 12:02:09.445][1][info][config] [source/server/configuration_impl.cc:130] loading 4 cluster(s)
1765368129445	2025-12-10T12:02:09.445Z	[2025-12-10 12:02:09.445][1][info][config] [source/server/configuration_impl.cc:124] loading 0 static secret(s)
1765368129445	2025-12-10T12:02:09.445Z	[2025-12-10 12:02:09.445][1][info][config] [source/server/configuration_impl.cc:173] loading tracing configuration
1765368129445	2025-12-10T12:02:09.445Z	[2025-12-10 12:02:09.445][1][info][admin] [source/server/admin/admin.cc:65] admin address: 127.0.0.1:19000
1765368129445	2025-12-10T12:02:09.445Z	[2025-12-10 12:02:09.445][1][info][main] [source/server/server.cc:765] Starting admin HTTP server at 127.0.0.1:19000
1765368129444	2025-12-10T12:02:09.444Z	      envoy.restart_features.use_eds_cache_for_ads: true
1765368129444	2025-12-10T12:02:09.444Z	      re2.max_program_size.warn_level: 1000
1765368129444	2025-12-10T12:02:09.444Z	      re2.max_program_size.error_level: 4294967295
1765368129444	2025-12-10T12:02:09.444Z	    static_layer:
1765368129444	2025-12-10T12:02:09.444Z	  - name: global_config
1765368129444	2025-12-10T12:02:09.444Z	[2025-12-10 12:02:09.444][1][info][main] [source/server/server.cc:932] runtime: layers:
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527]   response trailer map: 144 bytes: grpc-message,grpc-status
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527]   response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527]   request trailer map: 120 bytes:
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527]   request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:524] HTTP header map info:
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.filters.listener: envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.srds_factory: envoy.srds_factory.default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.connection_handler: envoy.connection_handler.default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.regex_engines: envoy.regex_engines.google_re2
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.header_validators: envoy.http.header_validators.envoy_default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.network.application_protocols, envoy.network.ip, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.upstreams: envoy.filters.connection_pools.tcp.generic
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.generic_proxy.filters: envoy.filters.generic.router
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.retry_priorities: envoy.retry_priorities.previous_priorities
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.filter_state, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.thrift_proxy.transports: auto, framed, header, unframed
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   network.connection.client: default, envoy_internal
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.dubbo_proxy.filters: envoy.filters.dubbo.router
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.common.key_value: envoy.key_value.file_based
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.udp_proxy
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.route_config_update_requester: envoy.route_config_update_requester.default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.dubbo_proxy.protocols: dubbo
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   quic.http_server_connection: quic.http_server_connection.default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.health_checkers: envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.tracers: envoy.tracers.datadog, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.quic.proof_source: envoy.quic.proof_source.filter_chain
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.string_matcher: envoy.string_matcher.lua
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.bootstrap: envoy.bootstrap.internal_listener, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.upstream_options: envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.dubbo_proxy.serializers: dubbo.hessian2
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.dynamic_forward_proxy, envoy.clusters.redis
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_system_buffer, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.resolvers: envoy.ip
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.spiffe
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response
1765368129427	2025-12-10T12:02:09.427Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.action: envoy.matching.actions.format_string, filter-chain-name
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.geoip_providers: envoy.geoip_providers.maxmind
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.trie_matcher
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.access_loggers: envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.route.early_data_policy: envoy.route.early_data_policy.default
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.http_capsule
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.wasm
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.trie_matcher
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.path.match: envoy.path.match.uri_template.uri_template_matcher
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.rds_factory: envoy.rds_factory.default
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.health_check.event_sinks: envoy.health_check.event_sink.file
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.formatter: envoy.formatter.cel, envoy.formatter.metadata, envoy.formatter.req_without_query
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464]   envoy.request_id: envoy.request_id.uuid
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:462] statically linked extensions:
1765368129422	2025-12-10T12:02:09.422Z	[2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:460] initializing epoch 0 (base id=0, hot restart version=11.120)

In my case a have a lot of completed pods in my namespace because they are not garbage collected by k8s as per definition:

envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2772x   0/2     Completed   0              17d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2m5kr   0/2     Completed   0              15d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2mjkj   0/2     Completed   0              3d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2tjvb   0/2     Completed   0              4d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-4h7mv   0/2     Completed   0              12d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-655fl   0/2     Completed   0              12d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-6qfnj   0/2     Completed   0              8d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-7qlj2   0/2     Completed   0              7d19h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-7scbs   2/2     Running     0              17h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-8jx9t   0/2     Completed   0              18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-8tw9f   0/2     Completed   0              10d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-8xkmq   0/2     Completed   0              8d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-cbk6q   0/2     Completed   0              41h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-cxhg9   0/2     Completed   0              14d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-d58q9   2/2     Running     0              17h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-dbs57   0/2     Completed   0              14d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-djcwl   0/2     Completed   0              16d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-dqk89   0/2     Completed   0              5d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-fh5sk   0/2     Completed   0              13d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-g5gwc   0/2     Completed   0              11d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-gwgcv   0/2     Completed   0              5d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-k4vbs   0/2     Completed   0              6d19h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-kgc8v   0/2     Completed   0              2d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-l6l9w   0/2     Completed   0              18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-mhdjz   0/2     Completed   0              18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-msqp7   0/2     Completed   0              10d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-nczkv   0/2     Completed   0              16d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-nq66f   0/2     Completed   0              15d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-nr8dn   0/2     Completed   0              11d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-p22d8   0/2     Completed   0              9d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-pp9ql   0/2     Completed   0              4d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-qgr2x   0/2     Completed   0              13d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-sg5gc   0/2     Completed   0              2d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-spfr9   0/2     Completed   0              41h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-vpt2t   0/2     Completed   0              9d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-x5kjd   0/2     Completed   0              7d19h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-xjdlx   0/2     Completed   0              3d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-xzc2z   0/2     Completed   0              18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-z6wjd   0/2     Completed   0              17d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-zkpvv   0/2     Completed   0              6d19h

Is this regular envoy behavior because I don't see completed pods for other deployments in my cluster and as far as my understanding of a k8s deployment is, this shouldn't be the case. Is this some configuration issue on my side?

At least a hint how I could investigate the reason for the shutdowns would be much appreciated ;-) Thank you very much for your help.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions