hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brahma Reddy Battula <bra...@apache.org>
Subject Re: [VOTE] Release Apache Hadoop 3.0.0 RC0
Date Wed, 22 Nov 2017 16:45:01 GMT
bq. (a) The behavior of this command. Clearly, it will conflict with the
MapReduce JHS - only one of them can be started on the same node.

Yes,Since the PID <http://(a) The behavior of this command. Clearly, it
will conflict with the MapReduce JHS - only one of them can be started on
the same node.> file will be same.

This problem will not present in branch-2.9 + as pid file will be suffix
with mapred(for JHS)
<https://github.com/apache/hadoop/blob/branch-2.9/hadoop-mapreduce-project/bin/mr-jobhistory-daemon.sh#L93>and
yarn (for AHS)
<https://github.com/apache/hadoop/blob/branch-2.9/hadoop-yarn-project/hadoop-yarn/bin/yarn-daemon.sh#L95>..i.e
PID is exported on each daemon script.

May be,
1) Change the name
2) Create PID based on the CLASS Name, here applicationhistoryserver and
jobhistoryserver
3) Use same as branch-2.9..i.e suffixing with mapred or yarn


@allen, any thoughts on this..?




On Wed, Nov 22, 2017 at 2:46 AM, Vinod Kumar Vavilapalli <vinodkv@apache.org
> wrote:

> >> - $HADOOP_YARN_HOME/sbin/yarn-daemon.sh start historyserver doesn't
> even work. Not just deprecated in favor of timelineserver as was advertised.
> >
> >       This works for me in trunk and the bash code doesn’t appear to
> have changed in a very long time.  Probably something local to your
> install.  (I do notice that the deprecation message says “starting” which
> is awkward when the stop command is given though.)  Also: is the
> deprecation message even true at this point?
>
>
> Sorry, I mischaracterized the problem.
>
> The real issue is that I cannot use this command line when the MapReduce
> JobHistoryServer is already started on the same machine.
>
> ~/tmp/yarn$ $HADOOP_YARN_HOME/sbin/yarn-daemon.sh start historyserver
> WARNING: Use of this script to start YARN daemons is deprecated.
> WARNING: Attempting to execute replacement "yarn --daemon start" instead.
> DEPRECATED: Use of this command to start the timeline server is deprecated.
> Instead use the timelineserver command for it.
> Starting the History Server anyway...
> historyserver is running as process 86156.  Stop it first.
>
> So, it looks like in shell-scripts, there can ever be only one daemon of a
> given name, irrespective of which daemon scripts are invoked.
>
> We need to figure out two things here
>  (a) The behavior of this command. Clearly, it will conflict with the
> MapReduce JHS - only one of them can be started on the same node.
>  (b) We need to figure out if this V1 TimelineService should even be
> support given ATSv2.
>
> @Vrushani / @Rohith / @Varun Saxena et.al, if you are watching, please
> comment on (b).
>
> Thanks
> +Vinod




-- 



--Brahma Reddy Battula

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message