73103

how to start and check job history on hadoop 2.5.2

<ol> <li>in the mapreduce webconsole for each application there is a tracking ui link which points to xx:19888/jobhistory/, but how to start the service on 19888 (i have started 4 services: yarn-resource-manager, yarn-node-manager, hdfs-name-node, hdfs-data-node, what i have missed?)</li> <li>is the jobtracker removed in 2.5.2</li> <li>I want to check the job.xml generated for my job, where can i find it. I have specified "mapreduce.jobtracker.jobhistory.location" but nothing is there</li> </ol>

Thank you.

Answer1:

Please try 'jps' command to verify all the services are running.

try //jhs_host:port/ Default HTTP port is 19888."

Make sure that your hadoop services are running.

Answer2:

<ol> <li>To access the JobHistory server's web interface then you have start the hadoop-mapreduce-historyserver service, which will bind to 19888 by default.</li> <li>If your are running YARN in the cluster then you don't need jobtracker anymore, the work done jobtracker is offloaded to ResourceManager, NodeManager's & ApplicationMaster's. But, you could still install just MRv1 in that case you will install JobTracker and TaskTracker's (which is not recommended).</li> <li>You could check the job.xml from the ResourceManager's UI by navigating to http://RESOURCEMANAGER_HOST:8088/cluster -> select your application's Tracking UI -> Select your Job ID -> On the left tab you'll be able to see Configuration. Or simply if you already know you'r job's id then visit this link: http://JOBHISTORY_SERVER:19888/jobhistory/conf/YOUR_JOB_ID.</li> </ol>

Answer3:

$HADOOP_HOME/sbin/mr-jobhistory-daemon.sh --config $HADOOP_HOME/etc/hadoop start historyserver

then run jps to see if it is running.

Recommend

  • How do I split “abcd efgh” into “abcd” and “efgh”?
  • Gracefully stopping a java process started by maven-antrun-plugin
  • python function to set accuracy of float
  • Easy Way to Get Averages Based on Names in List
  • maven-dependency-plugin ignores outputDirectory configuration
  • object play not found in scala application
  • Regex for nested values
  • Is there a way to set up a fallback for the formAction attribute in HTML5?
  • How to upload specific List image using click on Upload button
  • HttpClient: disabling chunked encoding
  • Aptana 3 remove bundle (jquery)
  • How can I run DataNucleus Bytecode Enhancer from SBT?
  • How do I get the list of bad records that didn't load in Bigquery?
  • Zoom in and out of jPanel
  • Firefox Extension - Monitor refresh and change of tab
  • Saving Changes After In-App Purchase Has Been Purchased
  • Email verification using google app script and google forms
  • Could not find rake using whenever rails
  • How to avoid particles glitching together in an elastic particle collision simulator?
  • How to use an array of arrays with array_map(…) in PHP?
  • Q promise. Difference between .when and .then
  • Recording logins for password protected directories
  • Why is an OPTIONS request sent to the server?
  • Jenkins: How To Build multiple projects from a TFS repository?
  • Splitting given String into two variables - php
  • How do I fake an specific browser client when using Java's Net library?
  • How to set/get protobuf's extension field in Go?
  • Check if a string to interpolate provides expected placeholders
  • Cassandra Data Model
  • Trying to switch camera back to front but getting exception
  • Importing jscolor library in angular 2
  • what is the difference between the asp.net mvc application and asp.net web application
  • To display the title for the current loaction in map in iphone
  • Apache 2.4 - remove | delete | uninstall
  • RestKit - RKRequestDelegate does not exist
  • Run Powershell script from inside other Powershell script with dynamic redirection to file
  • How can I remove ASP.NET Designer.cs files?
  • python draw pie shapes with colour filled
  • Is there any way to bind data to data.frame by some index?
  • How can i traverse a binary tree from right to left in java?