Hello, randomly we are starting getting a huge amount of error logs generating from a self managed GCP auto-pilot cluster with qovery. Errors are all from qovery namespace and looks like this:
We didn’t update the cluster neither touched nothing, but they started generating since August 18 2024:
This huge amount of logs cost a lot of money to us, so please can anyone provide any support/help/suggestion?
Hello @Nextools ,
Thanks for contacting us with your problem. Your cluster is self-managed, so we don’t have access to it, but I will try to help.
Looking at the log, this looks like a permission problem with Loki.
Can you check if the values you are using with the Loki Helm charts are right? Especially the serviceAccount.annotations.iam.gke.io/gcp-service-account.
It needs to have the role roles/storage.objectAdmin.
For managed clusters, we use this configuration:
project = project_name
role = "roles/storage.objectAdmin"
I hope this answer was helpful,
Regards,
Charles-Edouard