apache pig - Pig Batch mode: how to set logging level to hide INFO log messages? -


using apache pig version 0.10.1.21 (rexported). when execute pig script, there lots of info logging lines looks that: 

2013-05-18 14:30:12,810 [thread-28] info  org.apache.hadoop.mapred.task - task 'attempt_local_0005_r_000000_0' done. 2013-05-18 14:30:18,064 [main] warn  org.apache.pig.tools.pigstats.pigstatsutil - failed runningjob job job_local_0005 2013-05-18 14:30:18,094 [thread-31] warn  org.apache.hadoop.mapred.jobclient - no job jar file set.  user classes may not found. see jobconf(class) or jobconf#setjar(string). 2013-05-18 14:30:18,114 [thread-31] info  org.apache.hadoop.mapreduce.lib.input.fileinputformat - total input paths process : 1 2013-05-18 14:30:18,254 [thread-32] info  org.apache.hadoop.mapred.task -  using resourcecalculatorplugin : org.apache.hadoop.util.linuxresourcecalculatorplugin@3fcb2dd1 2013-05-18 14:30:18,265 [thread-32] info  org.apache.hadoop.mapred.maptask - io.sort.mb = 10

is there set command within pig script or command line flag allow logging level? hide [thread-xx] info messages. showing warning , error. have tried command line debug flag. unfortunately, info messages still show up:

pig -x local -d warn myscript.pig

hope there solution. in advance help.

solved: answer by loran bendig, set log4j.properties. summarized here convenience

step1: copy log4j config file folder pig scripts located.

cp /etc/pig/conf.dist/log4j.properties log4j_warn

step2: edit log4j_warn file , make sure these 2 lines present

log4j.logger.org.apache.pig=warn, log4j.logger.org.apache.hadoop = warn,

step3: run pig script , instruct use custom log4j

pig -x local -4 log4j_warn myscript.pig

another setting this:

create file named nolog.conf, following content

log4j.rootlogger=fatal

and run pig follows

pig -x local -4 nolog.conf

Comments

Post a Comment

Popular posts from this blog

SPSS keyboard combination alters encoding -

my question not have programming practical issue on spss. accident keyword combination cannot remember because did not intend press changed encoding in spss , text in data in different language english shown small boxes. nevertheless, when kind of analysis performed different language text shown in output. does know reason? tried change encoding did not produce result. first, @ edit > options , see whether setting unicode or locale. might fix it. if have text in multiple languages, want unicode. otherwise, may have specific locale set wrong. can change set locale, need know locale want use.
Read more

Add new record to the table by click on the button in Microsoft Access -

in ms access form want implement separate button, adds new record table. in order added button , attached button event: private sub btnaddrec_click() refresh codecontextobject on error resume next docmd.gotorecord , , acnewrec if err.number <> 0 btnaddrec.enabled = false end if end end sub everything ok when open window , click btnaddrec button, problem when first of perform navigation through existed records , after click on button. got runtime error: 2105: «you can't go specified record. may @ end of recordset» . how solve issue, need have ability add new record on click on specific button, no matter, have walked or not walked through records before. thanks. i created simple form field call description (and autonumber) , created button code follows click event. filled number of records , navigated through them, clicked addnewrec button. form navigated new record without issues. able click addnewrec button directly after
Read more

CSS3 Transition to highlight new elements created in JQuery -

i want use css3 color transition apply highlight-fading color effect (yellow transparent) new elements appended markup using jquery. css #content div { background-color:transparent; -moz-transition:background-color 2s; -webkit-transition:background-color 2s; -o-transition:background-color 2s; transition:background-color 2s; } #content div.new { background-color:yellow; } html <div id="content"></div> <a id="add-element" href="#">add new element</a> js $('#add-element').click(function() { var newelement = $('<div class="new">new element</div>'); $('#content').append(newelement); newelement.removeclass('new'); }); when click link, new element created. class "new" (background color yellow) , it's appended html markup. should able remove "new" class trigger background color transition transparent (or whate
Read more