Issue deploying prometheus : prometheus-node-exporter failing to start

Hey,

I’ve been running Prometheus using the community Helm chart (GitHub - prometheus-community/helm-charts: Prometheus community Helm charts) without issues before. Today, I created a new cluster with Karpenter, but I’m having trouble deploying Prometheus. It seems there are issues when starting prometheus-node-exporter. Could you help take a look? https://console.qovery.com/organization/b4271b12-477a-4b41-a274-9c9cba8043e8/project/f15b8795-c16f-4e96-b97e-5347595b4e19/environment/671b4bc5-6e80-4fa9-b218-d37dacc390a9/application/120fe109-cb10-4c0d-b38e-280e7c4e8874/general

Thanks!

Hello Ethan,

this looks like an issue with Karpenter.

When we deploy Karpenter, we use Fargate nodes only for Karpenter.

Can you try modifying your configuration and add this:

affinity:
    nodeAffinity:
      requiredDuringSchedulingIgnoredDuringExecution:
        nodeSelectorTerms:
          - matchExpressions:
            - key: eks.amazonaws.com/compute-type
              operator: NotIn
              values:
                - fargate

We have an example here with Datadog configuration: Kubernetes observability and monitoring with Datadog | Qovery

We also have this documentation regarding DaemonSet and Karpenter: Deploy a DaemonSet in a Karpenter context | Qovery

Please let me know if you need more help on this topic.

Regards,
Charles-Edouard