script:
A = load '$INPUT' as (line);
B = foreach A generate flatten(TOKENIZE(line)) as word;
C = group B by word;
D = foreach C generate group, COUNT(B);
store D into '$OUTPUT';
there is no any exceptions ocurr in jobtacker,namenode,tasktracker or datanode logs. the only exceptions which i can find in /opt/oozie/logs/oozie.log is as follows:
2014-02-28 06:12:49,347 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Running bundle status service from last instance time = 2014-02-28T06:11Z
2014-02-28 06:12:49,350 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Released lock for [org.apache.oozie.service.StatusTransitService]
2014-02-28 06:13:09,664 INFO PauseTransitService:539 - USER[-] GROUP[-] Acquired lock for [org.apache.oozie.service.PauseTransitService]
2014-02-28 06:13:09,687 INFO PauseTransitService:539 - USER[-] GROUP[-] Released lock for [org.apache.oozie.service.PauseTransitService]
2014-02-28 06:13:49,351 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Acquired lock for [org.apache.oozie.service.StatusTransitService]
2014-02-28 06:13:49,352 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Running coordinator status service from last instance time = 2014-02-28T06:12Z
2014-02-28 06:13:49,355 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Running bundle status service from last instance time = 2014-02-28T06:12Z
2014-02-28 06:13:49,358 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Released lock for [org.apache.oozie.service.StatusTransitService]
2014-02-28 06:14:09,689 INFO PauseTransitService:539 - USER[-] GROUP[-] Acquired lock for [org.apache.oozie.service.PauseTransitService]
2014-02-28 06:14:09,712 INFO PauseTransitService:539 - USER[-] GROUP[-] Released lock for [org.apache.oozie.service.PauseTransitService]
2014-02-28 06:14:49,358 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Acquired lock for [org.apache.oozie.service.StatusTransitService]
2014-02-28 06:14:49,359 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Running coordinator status service from last instance time = 2014-02-28T06:13Z
2014-02-28 06:14:49,362 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Running bundle status service from last instance time = 2014-02-28T06:13Z
2014-02-28 06:14:49,366 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Released lock for [org.apache.oozie.service.StatusTransitService]
2014-02-28 06:15:05,358 WARN LiteWorkflowAppService:542 - USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://v-ndhoo-v-nn-001:8020/user/hadoop/worldcount/4496286e-d5e0-42fe-8842-800bace75f54/lib] does not exist
2014-02-28 06:15:05,499 INFO ActionStartXCommand:539 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@:start:] Start action [0000004-140227105121167-oozie-hado-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-02-28 06:15:05,499 WARN ActionStartXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@:start:] [***0000004-140227105121167-oozie-hado-W@:start:***]Action status=DONE
2014-02-28 06:15:05,500 WARN ActionStartXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@:start:] [***0000004-140227105121167-oozie-hado-W@:start:***]Action updated in DB!
2014-02-28 06:15:05,602 INFO ActionStartXCommand:539 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] Start action [0000004-140227105121167-oozie-hado-W@job-node] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-02-28 06:15:06,029 WARN PigActionExecutor:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] credentials is null for the action
2014-02-28 06:15:06,475 WARN JobClient:746 - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2014-02-28 06:15:06,575 WARN JobClient:870 - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
2014-02-28 06:15:06,820 INFO PigActionExecutor:539 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] checking action, external ID [job_201402271128_0005] status [RUNNING]
2014-02-28 06:15:06,825 WARN ActionStartXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] [***0000004-140227105121167-oozie-hado-W@job-node***]Action status=RUNNING
2014-02-28 06:15:06,826 WARN ActionStartXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] [***0000004-140227105121167-oozie-hado-W@job-node***]Action updated in DB!
2014-02-28 06:15:09,712 INFO PauseTransitService:539 - USER[-] GROUP[-] Acquired lock for [org.apache.oozie.service.PauseTransitService]
2014-02-28 06:15:09,728 INFO PauseTransitService:539 - USER[-] GROUP[-] Released lock for [org.apache.oozie.service.PauseTransitService]
2014-02-28 06:15:19,450 INFO CallbackServlet:539 - USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] callback for action [0000004-140227105121167-oozie-hado-W@job-node]
2014-02-28 06:15:19,531 INFO PigActionExecutor:539 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] action completed, external ID [job_201402271128_0005]
------------------------------------------------------------------------------------------------------------------------
2014-02-28 06:15:19,558 WARN PigActionExecutor:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] Launcher ERROR, reason: Main class [org.apache.oozie.action.hadoop.PigMain], exit code [2]
-------------------------------------------------------------------------------------------------------------------------
2014-02-28 06:15:19,659 INFO ActionEndXCommand:539 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@job-node] ERROR is considered as FAILED for SLA
2014-02-28 06:15:19,762 INFO ActionStartXCommand:539 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@fail] Start action [0000004-140227105121167-oozie-hado-W@fail] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2014-02-28 06:15:19,767 WARN ActionStartXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@fail] [***0000004-140227105121167-oozie-hado-W@fail***]Action status=DONE
2014-02-28 06:15:19,767 WARN ActionStartXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[0000004-140227105121167-oozie-hado-W@fail] [***0000004-140227105121167-oozie-hado-W@fail***]Action updated in DB!
2014-02-28 06:15:19,855 WARN CoordActionUpdateXCommand:542 - USER[hadoop] GROUP[-] TOKEN[] APP[job-wf] JOB[0000004-140227105121167-oozie-hado-W] ACTION[-] E1100: Command precondition does not hold before execution, [, coord action is null], Error Code: E1100
2014-02-28 06:15:49,366 INFO StatusTransitService$StatusTransitRunnable:539 - USER[-] GROUP[-] Acquired lock for [org.apache.oozie.service.StatusTransitService]