logstash - output single event into multiple line output file
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1, c2, c3. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
add a comment |
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1, c2, c3. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
add a comment |
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1, c2, c3. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
I have a jdbc input with a select statement. each row in the restult set has 3 columns. c1, c2, c3. the event emitted has the following structure:
{"c1":"v1", "c2":"v2", "c3":"v3", "file_name":"tmp.csv"}
I want to output the values in a file in the following manner:
output file:
v1
v2
v3
this is the output configuration:
file {
path => "/tmp/%{file_name}"
codec => plain { format => "%{c1}n%{c2}n%{c3}" }
write_behavior => "overwrite"
flush_interval => 0
}
but what is generated is
outputfile:
v1nv2nv3
is the plain codec plugin not the one i need? is there any other codec plugin for the output file plugin that i can use? or is the only option i have is to write my own plugin?
Thanks!
logstash
logstash
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
asked Nov 22 '18 at 9:27
Mr T.Mr T.
1,77562444
1,77562444
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
what output do you get?
– Faulander
Nov 26 '18 at 10:18
I'm getting the same thing as in the question:v1nv2nv3. I couldn't add the line break.
– baudsp
Nov 26 '18 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53427649%2flogstash-output-single-event-into-multiple-line-output-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
what output do you get?
– Faulander
Nov 26 '18 at 10:18
I'm getting the same thing as in the question:v1nv2nv3. I couldn't add the line break.
– baudsp
Nov 26 '18 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
add a comment |
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
what output do you get?
– Faulander
Nov 26 '18 at 10:18
I'm getting the same thing as in the question:v1nv2nv3. I couldn't add the line break.
– baudsp
Nov 26 '18 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
add a comment |
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
what you are looking for is the line codec plugin: https://www.elastic.co/guide/en/logstash/current/plugins-codecs-line.html
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
answered Nov 23 '18 at 12:07
FaulanderFaulander
1036
1036
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
what output do you get?
– Faulander
Nov 26 '18 at 10:18
I'm getting the same thing as in the question:v1nv2nv3. I couldn't add the line break.
– baudsp
Nov 26 '18 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
add a comment |
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
what output do you get?
– Faulander
Nov 26 '18 at 10:18
I'm getting the same thing as in the question:v1nv2nv3. I couldn't add the line break.
– baudsp
Nov 26 '18 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
Could you indicate what configuration you used? I tried to do it with the line codec and couldn't.
– baudsp
Nov 23 '18 at 12:55
what output do you get?
– Faulander
Nov 26 '18 at 10:18
what output do you get?
– Faulander
Nov 26 '18 at 10:18
I'm getting the same thing as in the question:
v1nv2nv3. I couldn't add the line break.– baudsp
Nov 26 '18 at 12:53
I'm getting the same thing as in the question:
v1nv2nv3. I couldn't add the line break.– baudsp
Nov 26 '18 at 12:53
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
didn't try it, but are you on windows? Maybe try "rn" as delimiter?
– Faulander
Nov 26 '18 at 13:16
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
I'm on Windows and I did try with rn, with the same result.
– baudsp
Nov 26 '18 at 17:11
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53427649%2flogstash-output-single-event-into-multiple-line-output-file%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
