-
Notifications
You must be signed in to change notification settings - Fork 610
Description
Description:
Hi,
i run envoy as gateway api in front of a mqtt broker in a managed k8s cluster on Azure. The proxy pods are deployed as deployment with multiple instances and hpa enabled. I deployed the following manifests via kustomize:
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: EnvoyProxy
metadata:
name: somename-mqtt-proxy-config-dev
namespace: somename-ingress-dev
spec:
logging:
level:
default: info
provider:
kubernetes:
envoyDeployment:
container:
imageRepository: private.repo/envoyproxy/envoy
resources:
limits:
cpu: "1"
memory: 4Gi
requests:
cpu: "1"
memory: 4Gi
pod:
affinity:
podAntiAffinity:
preferredDuringSchedulingIgnoredDuringExecution:
- podAffinityTerm:
labelSelector:
matchExpressions:
- key: app
operator: In
values:
- somename-mqtt-proxy-dev
topologyKey: kubernetes.io/hostname
weight: 100
annotations:
iotcore.metrics/enable: "true"
iotcore.metrics/path: /stats/prometheus
iotcore.metrics/port: "19001"
labels:
app: somename-mqtt-proxy-dev
nodeSelector:
pool_type: somenamein
tolerations:
- effect: NoSchedule
key: somenameIngressOnly
operator: Equal
value: "true"
envoyHpa:
behavior:
scaleDown:
policies:
- periodSeconds: 60
type: Percent
value: 100
selectPolicy: Max
stabilizationWindowSeconds: 60
scaleUp:
policies:
- periodSeconds: 60
type: Pods
value: 1
- periodSeconds: 60
type: Percent
value: 100
selectPolicy: Max
stabilizationWindowSeconds: 60
maxReplicas: 2
metrics:
- resource:
name: memory
target:
averageUtilization: 80
type: Utilization
type: Resource
- resource:
name: cpu
target:
averageUtilization: 80
type: Utilization
type: Resource
minReplicas: 2
envoyPDB:
minAvailable: 0
type: Kubernetes
telemetry:
accessLog:
disable: false
settings:
- format:
json:
bytes_received: '%BYTES_RECEIVED%'
bytes_sent: '%BYTES_SENT%'
downstream_local_address: '%DOWNSTREAM_LOCAL_ADDRESS%'
downstream_local_subject: '%DOWNSTREAM_LOCAL_SUBJECT%'
downstream_peer_cert: '%DOWNSTREAM_PEER_CERT%'
downstream_peer_cert_v_end: '%DOWNSTREAM_PEER_CERT_V_END%'
downstream_peer_cert_v_start: '%DOWNSTREAM_PEER_CERT_V_START%'
downstream_peer_dns_san: '%DOWNSTREAM_PEER_DNS_SAN%'
downstream_peer_fingerprint_1: '%DOWNSTREAM_PEER_FINGERPRINT_1%'
downstream_peer_fingerprint_256: '%DOWNSTREAM_PEER_FINGERPRINT_256%'
downstream_peer_ip_san: '%DOWNSTREAM_PEER_IP_SAN%'
downstream_peer_serial: '%DOWNSTREAM_PEER_SERIAL%'
downstream_peer_subject: '%DOWNSTREAM_PEER_SUBJECT%'
downstream_remote_address: '%DOWNSTREAM_REMOTE_ADDRESS%'
downstream_tls_cipher: '%DOWNSTREAM_TLS_CIPHER%'
downstream_tls_session_id: '%DOWNSTREAM_TLS_SESSION_ID%'
downstream_tls_version: '%DOWNSTREAM_TLS_VERSION%'
duration: '%DURATION%'
requested_server_name: '%REQUESTED_SERVER_NAME%'
start_time: '%START_TIME%'
upstream_local_address: '%UPSTREAM_LOCAL_ADDRESS%'
upstream_peer_subject: '%UPSTREAM_PEER_SUBJECT%'
upstream_remote_address: '%UPSTREAM_REMOTE_ADDRESS%'
upstream_transport_failure_reason: '%UPSTREAM_TRANSPORT_FAILURE_REASON%'
type: JSON
sinks:
- openTelemetry:
backendRefs:
- name: otel-collector
namespace: some-namespace
port: 4317
type: OpenTelemetry
metrics:
prometheus:
disable: false
sinks:
- openTelemetry:
backendRefs:
- name: otel-collector
namespace: some-namespace
port: 4317
type: OpenTelemetry
tracing:
provider:
backendRefs:
- name: otel-collector
namespace: some-namespace
port: 4317
type: OpenTelemetry
---
apiVersion: gateway.networking.k8s.io/v1
kind: Gateway
metadata:
name: somename-mqtt-proxy-dev
namespace: somename-ingress-dev
spec:
gatewayClassName: somename-envoy-gateway-class-dev
infrastructure:
annotations:
service.beta.kubernetes.io/azure-load-balancer-health-probe-request-path: /healthz
service.beta.kubernetes.io/azure-load-balancer-internal: "true"
service.beta.kubernetes.io/azure-load-balancer-internal-subnet: azure-subnet
service.beta.kubernetes.io/azure-load-balancer-ipv4: some-private-ip
parametersRef:
group: gateway.envoyproxy.io
kind: EnvoyProxy
name: somename-mqtt-proxy-config-dev
listeners:
- allowedRoutes:
kinds:
- kind: TCPRoute
namespaces:
from: Same
hostname: somename-mqtt-v1.dev.eu.iotcore.liebherr.com
name: somename-mqtt-listener
port: 8883
protocol: TLS
tls:
certificateRefs:
- kind: Secret
name: somename-mqtt-gateway-tls-secret-dev
namespace: somename-ingress-dev
frontendValidation:
caCertificateRefs:
- group: ""
kind: Secret
name: somename-mqtt-gateway-ca-secret-dev
namespace: somename-ingress-dev
mode: Terminate
---
apiVersion: external-secrets.io/v1
kind: ExternalSecret
metadata:
name: somename-mqtt-gateway-tls-external-secret-dev
namespace: somename-ingress-dev
spec:
data:
- remoteRef:
decodingStrategy: Base64
key: somename-mqtt-key
secretKey: tls.key
- remoteRef:
decodingStrategy: Base64
key: somename-mqtt-crt
secretKey: tls.crt
refreshInterval: 1m
secretStoreRef:
kind: ClusterSecretStore
name: some-kv
target:
creationPolicy: Owner
deletionPolicy: Retain
name: somename-mqtt-gateway-tls-secret-dev
template:
type: kubernetes.io/tls
---
apiVersion: external-secrets.io/v1
kind: ExternalSecret
metadata:
name: somename-mqtt-gateway-ca-external-secret-dev
namespace: somename-ingress-dev
spec:
data:
- remoteRef:
decodingStrategy: Base64
key: somename-mqtt-ca-trusts
secretKey: ca.crt
refreshInterval: 1m
secretStoreRef:
kind: ClusterSecretStore
name: some-kv
target:
creationPolicy: Owner
deletionPolicy: Retain
name: somename-mqtt-gateway-ca-secret-dev
---
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: BackendTrafficPolicy
metadata:
name: somename-mqtt-backend-traffic-policy-dev
namespace: somename-ingress-dev
spec:
circuitBreaker:
maxConnections: 4294967295
maxParallelRequests: 4294967295
maxParallelRetries: 4294967295
maxPendingRequests: 4294967295
rateLimit:
global:
rules:
- clientSelectors:
- sourceCIDR:
type: Distinct
value: some-internal-service-ip/32
limit:
requests: 10
unit: Second
type: Global
targetRefs:
- group: gateway.networking.k8s.io
kind: Gateway
name: somename-mqtt-proxy-dev
---
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: ClientTrafficPolicy
metadata:
name: somename-mqtt-client-traffic-policy-dev
namespace: somename-ingress-dev
spec:
connection:
connectionLimit:
value: 10240
targetRefs:
- group: gateway.networking.k8s.io
kind: Gateway
name: somename-mqtt-proxy-dev
sectionName: somename-mqtt-listener
tls:
minVersion: "1.3"
---
apiVersion: gateway.networking.k8s.io/v1beta1
kind: ReferenceGrant
metadata:
name: somename-mqtt-tcproute-grant-dev
namespace: somename-dev
spec:
from:
- group: gateway.networking.k8s.io
kind: TCPRoute
namespace: somename-ingress-dev
to:
- group: ""
kind: Service
---
apiVersion: gateway.networking.k8s.io/v1alpha2
kind: TCPRoute
metadata:
name: somename-mqtt-tcproute-dev
namespace: somename-ingress-dev
spec:
parentRefs:
- name: somename-mqtt-proxy-dev
namespace: somename-ingress-dev
rules:
- backendRefs:
- name: mqtt-broker-somename-dev
namespace: somename-dev
port: 1883
weight: 1
---
apiVersion: gateway.networking.k8s.io/v1
kind: GatewayClass
metadata:
name: somename-envoy-gateway-class-dev
namespace: somename-ingress-dev
spec:
controllerName: gateway.envoyproxy.io/somename-envoy-gateway-controller-dev
---
apiVersion: policy/v1
kind: PodDisruptionBudget
metadata:
name: envoy-gateway
namespace: somename-ingress-dev
spec:
minAvailable: 1
selector:
matchLabels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/name: gateway-helm
control-plane: envoy-gateway
---
apiVersion: v1
kind: ServiceAccount
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
helm.sh/chart: gateway-helm-1.5.3
name: envoy-gateway
namespace: somename-ingress-dev
---
apiVersion: v1
data:
envoy-gateway.yaml: |
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: EnvoyGateway
extensionApis: {}
gateway:
controllerName: gateway.envoyproxy.io/somename-envoy-gateway-controller-dev
logging:
level:
default: info
provider:
kubernetes:
rateLimitDeployment:
container:
image: private.repo/envoyproxy/ratelimit:e74a664a
patch:
type: StrategicMerge
value:
spec:
template:
spec:
containers:
- imagePullPolicy: IfNotPresent
name: envoy-ratelimit
shutdownManager:
image: private.repo/envoyproxy/gateway:v1.5.3
type: Kubernetes
kind: ConfigMap
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
helm.sh/chart: gateway-helm-1.5.3
name: envoy-gateway-config
namespace: somename-ingress-dev
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
creationTimestamp: null
name: somename-envoy-gateway-controller-dev-gateway-helm-envoy-gateway-role
rules:
- apiGroups:
- ""
resources:
- nodes
- namespaces
verbs:
- get
- list
- watch
- apiGroups:
- gateway.networking.k8s.io
resources:
- gatewayclasses
verbs:
- get
- list
- patch
- update
- watch
- apiGroups:
- gateway.networking.k8s.io
resources:
- gatewayclasses/status
verbs:
- update
- apiGroups:
- multicluster.x-k8s.io
resources:
- serviceimports
verbs:
- get
- list
- watch
- apiGroups:
- ""
resources:
- configmaps
- secrets
- services
verbs:
- get
- list
- watch
- apiGroups:
- apps
resources:
- deployments
- daemonsets
verbs:
- get
- list
- watch
- apiGroups:
- discovery.k8s.io
resources:
- endpointslices
verbs:
- get
- list
- watch
- apiGroups:
- gateway.envoyproxy.io
resources:
- envoyproxies
- envoypatchpolicies
- clienttrafficpolicies
- backendtrafficpolicies
- securitypolicies
- envoyextensionpolicies
- backends
- httproutefilters
verbs:
- get
- list
- watch
- apiGroups:
- gateway.envoyproxy.io
resources:
- envoypatchpolicies/status
- clienttrafficpolicies/status
- backendtrafficpolicies/status
- securitypolicies/status
- envoyextensionpolicies/status
- backends/status
verbs:
- update
- apiGroups:
- gateway.networking.k8s.io
resources:
- gateways
- grpcroutes
- httproutes
- referencegrants
- tcproutes
- tlsroutes
- udproutes
- backendtlspolicies
verbs:
- get
- list
- watch
- apiGroups:
- gateway.networking.k8s.io
resources:
- gateways/status
- grpcroutes/status
- httproutes/status
- tcproutes/status
- tlsroutes/status
- udproutes/status
- backendtlspolicies/status
verbs:
- update
- apiGroups:
- ""
resources:
- pods
- pods/binding
verbs:
- get
- list
- patch
- update
- watch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
name: somename-envoy-gateway-controller-dev-gateway-helm-envoy-gateway-rolebinding
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: ClusterRole
name: somename-envoy-gateway-controller-dev-gateway-helm-envoy-gateway-role
subjects:
- kind: ServiceAccount
name: envoy-gateway
namespace: somename-ingress-dev
---
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
helm.sh/chart: gateway-helm-1.5.3
name: somename-envoy-gateway-controller-dev-gateway-helm-infra-manager
namespace: somename-ingress-dev
rules:
- apiGroups:
- ""
resources:
- serviceaccounts
- services
- configmaps
verbs:
- create
- get
- list
- delete
- deletecollection
- patch
- apiGroups:
- apps
resources:
- deployments
- daemonsets
verbs:
- create
- get
- delete
- deletecollection
- patch
- apiGroups:
- autoscaling
- policy
resources:
- horizontalpodautoscalers
- poddisruptionbudgets
verbs:
- create
- get
- list
- delete
- deletecollection
- patch
- apiGroups:
- certificates.k8s.io
resources:
- clustertrustbundles
verbs:
- list
- get
- watch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
helm.sh/chart: gateway-helm-1.5.3
name: somename-envoy-gateway-controller-dev-gateway-helm-leader-election-role
namespace: somename-ingress-dev
rules:
- apiGroups:
- ""
resources:
- configmaps
verbs:
- get
- list
- watch
- create
- update
- patch
- delete
- apiGroups:
- coordination.k8s.io
resources:
- leases
verbs:
- get
- list
- watch
- create
- update
- patch
- delete
- apiGroups:
- ""
resources:
- events
verbs:
- create
- patch
---
apiVersion: rbac.authorization.k8s.io/v1
kind: RoleBinding
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
helm.sh/chart: gateway-helm-1.5.3
name: somename-envoy-gateway-controller-dev-gateway-helm-infra-manager
namespace: somename-ingress-dev
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: Role
name: somename-envoy-gateway-controller-dev-gateway-helm-infra-manager
subjects:
- kind: ServiceAccount
name: envoy-gateway
namespace: somename-ingress-dev
---
apiVersion: rbac.authorization.k8s.io/v1
kind: RoleBinding
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
helm.sh/chart: gateway-helm-1.5.3
name: somename-envoy-gateway-controller-dev-gateway-helm-leader-election-rolebinding
namespace: somename-ingress-dev
roleRef:
apiGroup: rbac.authorization.k8s.io
kind: Role
name: somename-envoy-gateway-controller-dev-gateway-helm-leader-election-role
subjects:
- kind: ServiceAccount
name: envoy-gateway
namespace: somename-ingress-dev
---
apiVersion: v1
kind: Service
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
control-plane: envoy-gateway
helm.sh/chart: gateway-helm-1.5.3
name: envoy-gateway
namespace: somename-ingress-dev
spec:
ports:
- name: grpc
port: 18000
targetPort: 18000
- name: ratelimit
port: 18001
targetPort: 18001
- name: wasm
port: 18002
targetPort: 18002
- name: metrics
port: 19001
targetPort: 19001
- name: webhook
port: 9443
targetPort: 9443
selector:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/name: gateway-helm
control-plane: envoy-gateway
---
apiVersion: apps/v1
kind: Deployment
metadata:
labels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/managed-by: Helm
app.kubernetes.io/name: gateway-helm
app.kubernetes.io/version: v1.5.3
control-plane: envoy-gateway
helm.sh/chart: gateway-helm-1.5.3
name: envoy-gateway
namespace: somename-ingress-dev
spec:
replicas: 2
selector:
matchLabels:
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/name: gateway-helm
control-plane: envoy-gateway
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 1
type: RollingUpdate
template:
metadata:
annotations:
iotcore.metrics/enable: "true"
iotcore.metrics/path: /metrics
iotcore.metrics/port: "19001"
prometheus.io/port: "19001"
prometheus.io/scrape: "true"
labels:
app: envoy-gateway-dev
app.kubernetes.io/instance: somename-envoy-gateway-controller-dev
app.kubernetes.io/name: gateway-helm
control-plane: envoy-gateway
spec:
affinity:
podAntiAffinity:
preferredDuringSchedulingIgnoredDuringExecution:
- podAffinityTerm:
labelSelector:
matchExpressions:
- key: app.kubernetes.io/name
operator: In
values:
- gateway-helm
- key: app.kubernetes.io/instance
operator: In
values:
- somename-envoy-gateway-controller-dev
topologyKey: kubernetes.io/hostname
weight: 100
containers:
- args:
- server
- --config-path=/config/envoy-gateway.yaml
env:
- name: ENVOY_GATEWAY_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: KUBERNETES_CLUSTER_DOMAIN
value: cluster.local
image: private.repo/envoyproxy/gateway:v1.5.3
imagePullPolicy: IfNotPresent
livenessProbe:
httpGet:
path: /healthz
port: 8081
initialDelaySeconds: 15
periodSeconds: 20
name: envoy-gateway
ports:
- containerPort: 18000
name: grpc
- containerPort: 18001
name: ratelimit
- containerPort: 18002
name: wasm
- containerPort: 19001
name: metrics
- containerPort: 9443
name: webhook
readinessProbe:
httpGet:
path: /readyz
port: 8081
initialDelaySeconds: 5
periodSeconds: 10
resources:
limits:
cpu: 250m
memory: 256Mi
requests:
cpu: 250m
memory: 256Mi
securityContext:
allowPrivilegeEscalation: false
capabilities:
drop:
- ALL
privileged: false
runAsGroup: 65532
runAsNonRoot: true
runAsUser: 65532
seccompProfile:
type: RuntimeDefault
volumeMounts:
- mountPath: /config
name: envoy-gateway-config
readOnly: true
- mountPath: /certs
name: certs
readOnly: true
imagePullSecrets: []
nodeSelector:
pool_type: somenamein
serviceAccountName: envoy-gateway
terminationGracePeriodSeconds: 10
tolerations:
- effect: NoSchedule
key: somenameIngressOnly
operator: Exists
volumes:
- configMap:
defaultMode: 420
name: envoy-gateway-config
name: envoy-gateway-config
- name: certs
secret:
secretName: envoy-gateway
In the logs I don't see any hint, why the pods are completed. The service uptime seems not to be affected by this case, because i have at least two pods running as defined as replicas for my proxy. It seems to be regular behavior because they are drained and killed by the shutdown-manager. But why does the shutdown manager get the signal for stopping the pods?
Here are the logs. They look the same on each completed pod:
: "141 lines displayed"
Total bytes processed: "120 kB"
Common labels: {"app":"somename-mqtt-proxy-prod","k8s_container_restart_count":"0","k8s_deployment_name":"envoy-somename-ingress-prod-somename-mqtt-proxy-prod-2f0fef75","k8s_namespace_name":"somename-ingress-prod","k8s_node_name":"aks-npcominpro-41340154-vmss000001","k8s_pod_name":"envoy-somename-ingress-prod-somename-mqtt-proxy-prod-2f0fef75-pp9ql","k8s_pod_start_time":"2025-12-10T12:01:04Z","k8s_pod_uid":"202619bd-a70f-43a4-aa45-254277a49e27","logtag":"F","service_name":"somename-mqtt-proxy-prod","service_namespace":"somename-ingress-prod"}
1765455681521 2025-12-11T12:21:21.521Z 2025-12-11T12:21:21.521Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455680519 2025-12-11T12:21:20.519Z 2025-12-11T12:21:20.519Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455679518 2025-12-11T12:21:19.518Z 2025-12-11T12:21:19.518Z INFO shutdown-manager envoy/shutdown_manager.go:146 minimum drain period reached; will exit when total connections reaches 0
1765455679518 2025-12-11T12:21:19.518Z 2025-12-11T12:21:19.518Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455678518 2025-12-11T12:21:18.518Z 2025-12-11T12:21:18.517Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455677516 2025-12-11T12:21:17.516Z 2025-12-11T12:21:17.516Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455676515 2025-12-11T12:21:16.515Z 2025-12-11T12:21:16.515Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455675514 2025-12-11T12:21:15.514Z 2025-12-11T12:21:15.514Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455674512 2025-12-11T12:21:14.512Z 2025-12-11T12:21:14.512Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455673511 2025-12-11T12:21:13.511Z 2025-12-11T12:21:13.511Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455672510 2025-12-11T12:21:12.510Z 2025-12-11T12:21:12.510Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455671509 2025-12-11T12:21:11.509Z 2025-12-11T12:21:11.509Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455670508 2025-12-11T12:21:10.508Z 2025-12-11T12:21:10.508Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455669507 2025-12-11T12:21:09.507Z 2025-12-11T12:21:09.507Z INFO shutdown-manager envoy/shutdown_manager.go:218 total connections: 1
1765455669505 2025-12-11T12:21:09.505Z 2025-12-11T12:21:09.505Z INFO shutdown-manager envoy/shutdown_manager.go:127 initiating drain with 10 second minimum drain period and 60 second timeout
1765455669449 2025-12-11T12:21:09.449Z 2025-12-11T12:21:09.449Z INFO shutdown-manager envoy/shutdown_manager.go:90 received shutdown ready request
1765369029488 2025-12-10T12:17:09.488Z [2025-12-10 12:17:09.488][1][info][main] [source/server/drain_manager_impl.cc:226] shutting down parent after drain
1765368129506 2025-12-10T12:02:09.506Z 2025-12-10T12:02:09.506Z INFO shutdown-manager envoy/shutdown_manager.go:74 starting shutdown manager
1765368129488 2025-12-10T12:02:09.488Z [2025-12-10 12:02:09.488][1][info][config] [source/common/listener_manager/listener_manager_impl.cc:1003] all dependencies initialized. starting workers
1765368129481 2025-12-10T12:02:09.481Z [2025-12-10 12:02:09.481][1][info][upstream] [source/common/listener_manager/lds_api.cc:109] lds: add/update listener 'somename-ingress-prod/somename-mqtt-proxy-prod/somename-mqtt-listener'
1765368129480 2025-12-10T12:02:09.480Z [2025-12-10 12:02:09.480][1][info][upstream] [source/common/listener_manager/lds_api.cc:109] lds: add/update listener 'envoy-gateway-proxy-ready-0.0.0.0-19003'
1765368129476 2025-12-10T12:02:09.476Z [2025-12-10 12:02:09.476][1][info][main] [source/server/server.cc:1023] all clusters initialized. initializing init manager
1765368129476 2025-12-10T12:02:09.476Z [2025-12-10 12:02:09.476][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:248] cm init: all clusters initialized
1765368129472 2025-12-10T12:02:09.472Z [2025-12-10 12:02:09.472][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:222] cm init: initializing secondary clusters
1765368129472 2025-12-10T12:02:09.472Z [2025-12-10 12:02:09.472][1][info][upstream] [source/common/upstream/cds_api_helper.cc:87] cds: added/updated 3 cluster(s) (skipped 1 unmodified cluster(s)); removed 0 cluster(s)
1765368129471 2025-12-10T12:02:09.471Z [2025-12-10 12:02:09.471][1][info][upstream] [source/common/upstream/cds_api_helper.cc:34] cds: response indicates 4 added/updated cluster(s), 0 removed cluster(s); applying changes
1765368129469 2025-12-10T12:02:09.469Z [2025-12-10 12:02:09.469][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:244] cm init: initializing cds
1765368129466 2025-12-10T12:02:09.466Z [2025-12-10 12:02:09.466][1][info][upstream] [source/common/upstream/cluster_manager_impl.cc:222] cm init: initializing secondary clusters
1765368129466 2025-12-10T12:02:09.466Z [2025-12-10 12:02:09.466][1][info][runtime] [source/common/runtime/runtime_impl.cc:550] RTDS has finished initialization
1765368129450 2025-12-10T12:02:09.450Z [2025-12-10 12:02:09.450][1][info][main] [source/server/server.cc:1043] starting main dispatch loop
1765368129450 2025-12-10T12:02:09.450Z [2025-12-10 12:02:09.449][1][info][config] [source/server/configuration_impl.cc:156] loading stats configuration
1765368129449 2025-12-10T12:02:09.449Z [2025-12-10 12:02:09.448][1][info][config] [source/server/configuration_impl.cc:140] loading 1 listener(s)
1765368129445 2025-12-10T12:02:09.445Z [2025-12-10 12:02:09.445][1][info][config] [source/server/configuration_impl.cc:130] loading 4 cluster(s)
1765368129445 2025-12-10T12:02:09.445Z [2025-12-10 12:02:09.445][1][info][config] [source/server/configuration_impl.cc:124] loading 0 static secret(s)
1765368129445 2025-12-10T12:02:09.445Z [2025-12-10 12:02:09.445][1][info][config] [source/server/configuration_impl.cc:173] loading tracing configuration
1765368129445 2025-12-10T12:02:09.445Z [2025-12-10 12:02:09.445][1][info][admin] [source/server/admin/admin.cc:65] admin address: 127.0.0.1:19000
1765368129445 2025-12-10T12:02:09.445Z [2025-12-10 12:02:09.445][1][info][main] [source/server/server.cc:765] Starting admin HTTP server at 127.0.0.1:19000
1765368129444 2025-12-10T12:02:09.444Z envoy.restart_features.use_eds_cache_for_ads: true
1765368129444 2025-12-10T12:02:09.444Z re2.max_program_size.warn_level: 1000
1765368129444 2025-12-10T12:02:09.444Z re2.max_program_size.error_level: 4294967295
1765368129444 2025-12-10T12:02:09.444Z static_layer:
1765368129444 2025-12-10T12:02:09.444Z - name: global_config
1765368129444 2025-12-10T12:02:09.444Z [2025-12-10 12:02:09.444][1][info][main] [source/server/server.cc:932] runtime: layers:
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527] response trailer map: 144 bytes: grpc-message,grpc-status
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527] request trailer map: 120 bytes:
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:527] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.426][1][info][main] [source/server/server.cc:524] HTTP header map info:
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.filters.listener: envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.srds_factory: envoy.srds_factory.default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.connection_handler: envoy.connection_handler.default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.regex_engines: envoy.regex_engines.google_re2
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.header_validators: envoy.http.header_validators.envoy_default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.network.application_protocols, envoy.network.ip, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.upstreams: envoy.filters.connection_pools.tcp.generic
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.generic_proxy.filters: envoy.filters.generic.router
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.retry_priorities: envoy.retry_priorities.previous_priorities
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.filter_state, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.thrift_proxy.transports: auto, framed, header, unframed
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] network.connection.client: default, envoy_internal
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.common.key_value: envoy.key_value.file_based
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.udp_proxy
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.route_config_update_requester: envoy.route_config_update_requester.default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.dubbo_proxy.protocols: dubbo
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] quic.http_server_connection: quic.http_server_connection.default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.health_checkers: envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.tracers: envoy.tracers.datadog, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.string_matcher: envoy.string_matcher.lua
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.bootstrap: envoy.bootstrap.internal_listener, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.upstream_options: envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.dubbo_proxy.serializers: dubbo.hessian2
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.dynamic_forward_proxy, envoy.clusters.redis
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_system_buffer, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.resolvers: envoy.ip
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.spiffe
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response
1765368129427 2025-12-10T12:02:09.427Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.action: envoy.matching.actions.format_string, filter-chain-name
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.geoip_providers: envoy.geoip_providers.maxmind
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.trie_matcher
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.access_loggers: envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.route.early_data_policy: envoy.route.early_data_policy.default
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.http_capsule
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.wasm
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.trie_matcher
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.rds_factory: envoy.rds_factory.default
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.health_check.event_sinks: envoy.health_check.event_sink.file
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.formatter: envoy.formatter.cel, envoy.formatter.metadata, envoy.formatter.req_without_query
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:464] envoy.request_id: envoy.request_id.uuid
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:462] statically linked extensions:
1765368129422 2025-12-10T12:02:09.422Z [2025-12-10 12:02:09.422][1][info][main] [source/server/server.cc:460] initializing epoch 0 (base id=0, hot restart version=11.120)
In my case a have a lot of completed pods in my namespace because they are not garbage collected by k8s as per definition:
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2772x 0/2 Completed 0 17d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2m5kr 0/2 Completed 0 15d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2mjkj 0/2 Completed 0 3d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-2tjvb 0/2 Completed 0 4d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-4h7mv 0/2 Completed 0 12d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-655fl 0/2 Completed 0 12d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-6qfnj 0/2 Completed 0 8d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-7qlj2 0/2 Completed 0 7d19h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-7scbs 2/2 Running 0 17h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-8jx9t 0/2 Completed 0 18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-8tw9f 0/2 Completed 0 10d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-8xkmq 0/2 Completed 0 8d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-cbk6q 0/2 Completed 0 41h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-cxhg9 0/2 Completed 0 14d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-d58q9 2/2 Running 0 17h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-dbs57 0/2 Completed 0 14d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-djcwl 0/2 Completed 0 16d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-dqk89 0/2 Completed 0 5d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-fh5sk 0/2 Completed 0 13d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-g5gwc 0/2 Completed 0 11d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-gwgcv 0/2 Completed 0 5d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-k4vbs 0/2 Completed 0 6d19h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-kgc8v 0/2 Completed 0 2d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-l6l9w 0/2 Completed 0 18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-mhdjz 0/2 Completed 0 18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-msqp7 0/2 Completed 0 10d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-nczkv 0/2 Completed 0 16d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-nq66f 0/2 Completed 0 15d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-nr8dn 0/2 Completed 0 11d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-p22d8 0/2 Completed 0 9d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-pp9ql 0/2 Completed 0 4d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-qgr2x 0/2 Completed 0 13d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-sg5gc 0/2 Completed 0 2d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-spfr9 0/2 Completed 0 41h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-vpt2t 0/2 Completed 0 9d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-x5kjd 0/2 Completed 0 7d19h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-xjdlx 0/2 Completed 0 3d18h
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-xzc2z 0/2 Completed 0 18d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-z6wjd 0/2 Completed 0 17d
envoy-ingress-dev-mqtt-proxy-dev-2f0fef75-zkpvv 0/2 Completed 0 6d19h
Is this regular envoy behavior because I don't see completed pods for other deployments in my cluster and as far as my understanding of a k8s deployment is, this shouldn't be the case. Is this some configuration issue on my side?
At least a hint how I could investigate the reason for the shutdowns would be much appreciated ;-) Thank you very much for your help.