node_hwmon_temp_celsius : Error on ingesting samples with different value but same timestamp

[nanowish]

Hi,

I have this logs warning on many servers on which i just deployed node_exporter v0.13.0-rc.1 / 2016-10-16 :

Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_0"} => 35 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_1"} => 36 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_2"} => 40 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_3"} => 38 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_4"} => 33 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_7"} => 39 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_0"} => 35 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_1"} => 36 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_2"} => 40 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_3"} => 38 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_4"} => 33 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=debug msg="Sample discarded" error="sample with repeated timestamp but different value" sample=node_hwmon_temp_celsius{alias="MYSERVER", chip="coretemp", instance="MYSERVER", job="MYJOBSERVER", management_ip="SERVERIP", sensor="core_7"} => 39 @[1479310091.033] source="scrape.go:461"
Nov 16 16:28:11 prometheus prometheus_instanceX[37014]: @cee:time="2016-11-16T16:28:11+01:00" level=warning msg="Error on ingesting samples with different value but same timestamp" numDropped=6 source="scrape.go:471"
Nov 16 16:28:11 prometheus prometheus[37014]: time="2016-11-16T16:28:11+01:00" level=warning msg="Error on ingesting samples with different value but same timestamp" numDropped=6 source="scrape.go:471"
Nov 16 16:28:11 prometheus prometheus[46875]: time="2016-11-16T16:28:11+01:00" level=info msg="Done checkpointing in-memory metrics and chunks in 1.3206331s." source="persistence.go:573"

node_exporter exec:
/usr/local/bin/node_exporter -web.listen-address XXXXXX:9100

OS: Debian Jessie

Related to: 081ecc5

Thanks

[SuperQ]

I think this has been fixed by #334. Would you mind testing against a master build?

[nanowish]

Sorry i didn't see #334 , I have tested build with last sources and no more errors. I will wait next release :)

Thanks !

[SuperQ]

No problem, I should hopefully cut a release soon. Just want to fix a couple minor mdstat bugs.