Hey there,
I’ve installed Datadog on my cluster, it’s working really well, but we only have 2 weeks of log retention there.
How can I easily retrieve and search for my application logs that were generated before two weeks?
Thanks!
Hey there,
I’ve installed Datadog on my cluster, it’s working really well, but we only have 2 weeks of log retention there.
How can I easily retrieve and search for my application logs that were generated before two weeks?
Thanks!
Hi @Kmaschta ,
Correct me if I am wrong, but what you want is getting access to the past logs from Qovery since you only keep Datadog logs for 2 weeks right?
Here is what you can do since Qovery stores all your logs for 12 weeks in one of your S3 buckets.
kubectl
kubectl -n prometheus port-forward svc/grafana 80:8888
For login
kubectl -n prometheus get secrets/grafana --template='{{.data.admin-user | base64decode}}'
For password
kubectl -n prometheus get secrets/grafana --template='{{.data.admin-password | base64decode}}'
http://localhost:8888
.loki
filter with the pod name or namespace.I hope it helps
Ok! I’ve figured this out, thanks.
Small changes I had to made:
-kubectl -n prometheus port-forward svc/grafana 80:8888
+kubectl -n prometheus port-forward svc/grafana 8888:80
Moreover, kubectl was not happy with the dashes in admin-user
and admin-password
so I just ran the following command:
kubectl -n prometheus get secrets/grafana --template='{{.data}}'
And manually decoded the base64.
Finally the question, what if I want to keep the logs for more than 12 weeks?
This is needed for some regulatory / compliance reasons, and I’d love Qovery to provide an easy way to stream or archive our logs to an S3 or a CloudWatch log group.
Do you provide something like that?
Well done @Kmaschta
Thank you for sharing what you found.
We can add an advanced setting at the cluster level for that. @Enzo can you do it?
Qovery and Loki store your logs already in an S3 bucket. Is it good enough for you?
Thank you
Sure! As soon as the logs are:
Seems like Loki is offering all of that features!