Velero Metrics reporting issue on Grafana

[baluchen1]

I have my Grafana running on same cluster where Velero also installed.

If I try to add my velero metrics end point in Grafana data source, I'm getting an error and couldn't create the data source.

Here is my
Velero version : 1.12.2
Grafana version: 10.1.5

I tested manually using curl and getting below output

grafana-container:/usr/share/grafana$ curl -ikv internal-velero-prometheus-test-sh-1xxxxxxxxx6.us-west-2.elb.amazonaws.com:8085/metrics
*   Trying x.x.x.x:8085...
* Connected to [internal-velero-prometheus-test-sh-1xxxxxxxxx6.us-west-2.elb.amazonaws.com](internal-velero-prometheus-test-sh-1xxxxxxxxx6.us-west-2.elb.amazonaws.com/) (x.x.x.x) port 8085
> GET /metrics HTTP/1.1
> Host: [internal-velero-prometheus-test-sh-1xxxxxxxxx6.us-west-2.elb.amazonaws.com:8085](internal-velero-prometheus-test-sh-1xxxxxxxxx6.us-west-2.elb.amazonaws.com:8085/)
> User-Agent: curl/8.4.0
> Accept: */*
> 
< HTTP/1.1 200 OK
HTTP/1.1 200 OK
< Date: Thu, 04 Jan 2024 16:46:33 GMT
Date: Thu, 04 Jan 2024 16:46:33 GMT
< Content-Type: text/plain; version=0.0.4; charset=utf-8
Content-Type: text/plain; version=0.0.4; charset=utf-8
< Transfer-Encoding: chunked
Transfer-Encoding: chunked
< Connection: keep-alive
Connection: keep-alive`

< 
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 4.1754e-05
go_gc_duration_seconds{quantile="0.25"} 6.5316e-05
go_gc_duration_seconds{quantile="0.5"} 7.3433e-05
go_gc_duration_seconds{quantile="0.75"} 8.3398e-05
go_gc_duration_seconds{quantile="1"} 0.001317865
go_gc_duration_seconds_sum 0.554280311
go_gc_duration_seconds_count 7309
# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge

But, When I try to connect with datasource of my Prometheus, it doesn't connect and getting below error message.

404 Not Found - There was an error returned querying the Prometheus API.

Can anyone help on adding the data source or there are any known issue with my Velero version?

Thank you
Bala

[newalexfl]

Can anyone help on ios adding the data source or there are any known issue with my Velero version?