Why am I seeing duplicate metrics or logs being sent from my clusters?
You are seeing duplicate log entries for your clusters.
The most common cause for this issue is that you have multiple logging agents installed in your cluster.
Remove the unsupported observability plug-in resources from your cluster.
-
Check for the unsupported agents.
kubectl get daemonsets -n ibm-observe
-
If there is a
logdna-agent
or asysdig-agent
, remove them.Example output that shows the resources which need to be removed.
NAME DESIRED CURRENT READY UP-TO-DATE AVAILABLE NODE SELECTOR AGE logdna-agent 9 9 9 9 9 <none> 4d sysdig-agent 9 9 9 9 9 <none> 4d
-
Delete the resources.
kubectl delete daemonset logdna-agent -n ibm-observe kubectl kubectl delete daemonset sysdig-agent -n ibm-observe
-
Verify the daemonset and its pods were deleted.
kubectl get daemonset logdna-agent -n ibm-observe kubectl get pods -l app=logdna-agent -n ibm-observe kubectl get daemonset sysdig-agent -n ibm-observe kubectl get pods -l app=sysdig-agent -n ibm-observe