prometheus sum one NaN value result into NaN. How to avoid it?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}
I have the following metrics in prometheus: it counts memcached command by sec:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m])) by (command)
Result:
{command="delete"} 0
{command="flush"} 0
{command="get"} 62.733333333333334
{command="incr"} 0
{command="set"} 93.43333333333334
{command="touch"} NaN
{command="cas"} 0
{command="decr"} 0
I want to count commands by sec (without separate rate for different commands). I have tried the following formula:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]))
But the result is:
{} NaN
I expect about 155, but it is NaN. I suppose it is command="touch" the culprit. It is possible to exclude NaN from the sum?
monitoring prometheus
add a comment |
I have the following metrics in prometheus: it counts memcached command by sec:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m])) by (command)
Result:
{command="delete"} 0
{command="flush"} 0
{command="get"} 62.733333333333334
{command="incr"} 0
{command="set"} 93.43333333333334
{command="touch"} NaN
{command="cas"} 0
{command="decr"} 0
I want to count commands by sec (without separate rate for different commands). I have tried the following formula:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]))
But the result is:
{} NaN
I expect about 155, but it is NaN. I suppose it is command="touch" the culprit. It is possible to exclude NaN from the sum?
monitoring prometheus
add a comment |
I have the following metrics in prometheus: it counts memcached command by sec:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m])) by (command)
Result:
{command="delete"} 0
{command="flush"} 0
{command="get"} 62.733333333333334
{command="incr"} 0
{command="set"} 93.43333333333334
{command="touch"} NaN
{command="cas"} 0
{command="decr"} 0
I want to count commands by sec (without separate rate for different commands). I have tried the following formula:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]))
But the result is:
{} NaN
I expect about 155, but it is NaN. I suppose it is command="touch" the culprit. It is possible to exclude NaN from the sum?
monitoring prometheus
I have the following metrics in prometheus: it counts memcached command by sec:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m])) by (command)
Result:
{command="delete"} 0
{command="flush"} 0
{command="get"} 62.733333333333334
{command="incr"} 0
{command="set"} 93.43333333333334
{command="touch"} NaN
{command="cas"} 0
{command="decr"} 0
I want to count commands by sec (without separate rate for different commands). I have tried the following formula:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]))
But the result is:
{} NaN
I expect about 155, but it is NaN. I suppose it is command="touch" the culprit. It is possible to exclude NaN from the sum?
monitoring prometheus
monitoring prometheus
asked Nov 22 '18 at 12:16
GiovanniGiovanni
230113
230113
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
I have figured it out:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]) > 0)
returns the correct number. >0
does the trick.
add a comment |
The only way irate
can produce a NaN is if it's being given a NaN as input. Given that irate
is meant to work on counters, that should be impossible. I'd suggest looking into why memcached_commands_total is producing NaN.
NaN arrives from memcached exporter. The following lines are copied from the exporter output:memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
I am monitoring a old memcached version (1.4.4) that doesn't supporttouch
command, so memcached exporter report me NaN abouttouch
statistics. Maybe this it is asked a million of times: why prometheussum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you
– Giovanni
Nov 22 '18 at 18:10
1
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53430836%2fprometheus-sum-one-nan-value-result-into-nan-how-to-avoid-it%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
I have figured it out:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]) > 0)
returns the correct number. >0
does the trick.
add a comment |
I have figured it out:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]) > 0)
returns the correct number. >0
does the trick.
add a comment |
I have figured it out:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]) > 0)
returns the correct number. >0
does the trick.
I have figured it out:
sum (irate (memcached_commands_total{instance="memcached-instance"}[5m]) > 0)
returns the correct number. >0
does the trick.
answered Nov 22 '18 at 13:46
GiovanniGiovanni
230113
230113
add a comment |
add a comment |
The only way irate
can produce a NaN is if it's being given a NaN as input. Given that irate
is meant to work on counters, that should be impossible. I'd suggest looking into why memcached_commands_total is producing NaN.
NaN arrives from memcached exporter. The following lines are copied from the exporter output:memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
I am monitoring a old memcached version (1.4.4) that doesn't supporttouch
command, so memcached exporter report me NaN abouttouch
statistics. Maybe this it is asked a million of times: why prometheussum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you
– Giovanni
Nov 22 '18 at 18:10
1
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
add a comment |
The only way irate
can produce a NaN is if it's being given a NaN as input. Given that irate
is meant to work on counters, that should be impossible. I'd suggest looking into why memcached_commands_total is producing NaN.
NaN arrives from memcached exporter. The following lines are copied from the exporter output:memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
I am monitoring a old memcached version (1.4.4) that doesn't supporttouch
command, so memcached exporter report me NaN abouttouch
statistics. Maybe this it is asked a million of times: why prometheussum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you
– Giovanni
Nov 22 '18 at 18:10
1
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
add a comment |
The only way irate
can produce a NaN is if it's being given a NaN as input. Given that irate
is meant to work on counters, that should be impossible. I'd suggest looking into why memcached_commands_total is producing NaN.
The only way irate
can produce a NaN is if it's being given a NaN as input. Given that irate
is meant to work on counters, that should be impossible. I'd suggest looking into why memcached_commands_total is producing NaN.
answered Nov 22 '18 at 14:42
brian-brazilbrian-brazil
15.9k13241
15.9k13241
NaN arrives from memcached exporter. The following lines are copied from the exporter output:memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
I am monitoring a old memcached version (1.4.4) that doesn't supporttouch
command, so memcached exporter report me NaN abouttouch
statistics. Maybe this it is asked a million of times: why prometheussum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you
– Giovanni
Nov 22 '18 at 18:10
1
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
add a comment |
NaN arrives from memcached exporter. The following lines are copied from the exporter output:memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
I am monitoring a old memcached version (1.4.4) that doesn't supporttouch
command, so memcached exporter report me NaN abouttouch
statistics. Maybe this it is asked a million of times: why prometheussum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you
– Giovanni
Nov 22 '18 at 18:10
1
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
NaN arrives from memcached exporter. The following lines are copied from the exporter output:
memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
NaN arrives from memcached exporter. The following lines are copied from the exporter output:
memcached_commands_total{command="touch",status="hit"} NaN
memcached_commands_total{command="touch",status="miss"} NaN
– Giovanni
Nov 22 '18 at 17:45
I am monitoring a old memcached version (1.4.4) that doesn't support
touch
command, so memcached exporter report me NaN about touch
statistics. Maybe this it is asked a million of times: why prometheus sum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you– Giovanni
Nov 22 '18 at 18:10
I am monitoring a old memcached version (1.4.4) that doesn't support
touch
command, so memcached exporter report me NaN about touch
statistics. Maybe this it is asked a million of times: why prometheus sum
doesn't exclude NaN values aka sum in sql excludes null values? Thank you– Giovanni
Nov 22 '18 at 18:10
1
1
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
This is a bug in the exporter. NaN is not the same as null, a missing value is the equivalent in Prometheus.
– brian-brazil
Nov 22 '18 at 21:24
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
github.com/prometheus/memcached_exporter/issues/38 filed for this.
– brian-brazil
Nov 23 '18 at 9:40
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53430836%2fprometheus-sum-one-nan-value-result-into-nan-how-to-avoid-it%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown