samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Manohar Reddy <Manohar.Re...@happiestminds.com>
Subject RE: yarn UI not showing after succesfull installation
Date Fri, 11 Mar 2016 07:02:00 GMT

Change in yarn-site.xml:
actuals
<property>
    <name>yarn.resourcemanager.hostname</name>
    <value>localhost</value>
  </property>

Changed property
<property>
    <name>yarn.resourcemanager.hostname</name>
    <value>changed to system ip instead of locahhost</value>
  </property>

Change in server.properties:


Actuals
# Hostname the broker will bind to. If not set, the server will bind to all interfaces
#host.name=localhost

Changes is uncomment and give my ip instead of localhost
# Hostname the broker will bind to. If not set, the server will bind to all interfaces
host.name= changed to system ip instead of locahhost
 apart from those I configure my system ip in /etc/hosts file

Thanks,
Manohar

-----Original Message-----
From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
Sent: Friday, March 11, 2016 1:01 AM
To: dev@samza.apache.org
Subject: Re: yarn UI not showing after succesfull installation

Hi Manohar,
Thanks for getting back. For the benefit of others in the community, could you please let
us know what specific changes you did to the config in Kafka, and to your host file?

I've never used windows, and hence, I'm not aware if you can execute shell script in windows.
If not, please use an emulator like cygwin to execute linux commands. For development, you
can still setup your IDE in windows.


On Thu, Mar 10, 2016 at 12:49 AM, Manohar Reddy < Manohar.Reddy@happiestminds.com> wrote:

> Hi All,
> Finally am able to run samza in my local Ubuntu box with few config
> file changes  in kafka and host file of the servesrs.:) Team please
> help me out how to set it up on standalone on windows  for development
> and is there any utility API to read data from Hadoop in our java api.
>
>
> Thanks,
> Manohar
>
> -----Original Message-----
> From: Manohar Reddy [mailto:Manohar.Reddy@happiestminds.com]
> Sent: Thursday, March 10, 2016 12:51 PM
> To: dev@samza.apache.org
> Subject: RE: yarn UI not showing after succesfull installation
>
> We are running all three servers are running in same host. Hats why I
> don’t have no configuration changes ,so I am assuming localhost should
> work. But still it is causing the problem.
> I doubt default kafka config coming with samza grid script  should
> have some changes and the same should be effect some host file.
>
> I am trying with that options ,meanwhile if any gets more info on this
> please post here.
>
>
> Thanks,
> ~~Manohar
>
> -----Original Message-----
> From: Navina Ramesh [mailto:nramesh@linkedin.com.INVALID]
> Sent: Thursday, March 10, 2016 12:17 PM
> To: dev@samza.apache.org
> Subject: Re: yarn UI not showing after succesfull installation
>
> Hi Manohar,
>
> On what machine are you running your Samza job and Kafka brokers?
> Sounds like "localhost" is not getting resolved on your machine. Have
> you verified that "localhost" resolves correctly on your machine?
>
> Thanks!
> Navina
>
> On Wed, Mar 9, 2016 at 9:24 PM, Manohar Reddy <
> Manohar.Reddy@happiestminds.com> wrote:
>
> > Hi Jagadish,
> > Below is the error in nodemanager log and the same error in kafka
> > logs also.
> >
> > 2016-03-09 12:54:39,281 INFO
> org.apache.hadoop.yarn.event.AsyncDispatcher:
> > Registering class
> > org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType
> > for class
> > org.apache.hadoop.yarn.server.nodemanager.containermanager.Container
> > Ma
> > nagerImpl
> > 2016-03-09 12:54:39,281 INFO
> org.apache.hadoop.yarn.event.AsyncDispatcher:
> > Registering class
> > org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for
> > class org.apache.hadoop.yarn.server.nodemanager.NodeManager
> > 2016-03-09 12:54:39,348 INFO
> > org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties
> > from hadoop-metrics2.properties
> > 2016-03-09 12:54:39,459 ERROR
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Error getting
> > localhost name. Using 'localhost'...
> > java.net.UnknownHostException: ip-10-252-1-235: ip-10-252-1-235:
> > unknown error at
> > java.net.InetAddress.getLocalHost(InetAddress.java:1505)
> > at
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl.getHostname(Metric
> > sS
> > ystemImpl.java:546)
> > at
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configureSystem(Me
> > tr
> > icsSystemImpl.java:485)
> > at
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl.configure(MetricsS
> > ys
> > temImpl.java:481)
> > at
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl.start(MetricsSyste
> > mI
> > mpl.java:188)
> > at
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystem
> > Im
> > pl.java:163)
> > at
> > org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetr
> > ic
> > sSystem.java:54)
> > at
> > org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(Defau
> > lt
> > MetricsSystem.java:50)
> > at
> > org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(No
> > de
> > Manager.java:249) at
> > org.apache.hadoop.service.AbstractService.init(AbstractService.java:
> > 16
> > 3)
> > at
> > org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNo
> > de
> > Manager(NodeManager.java:480)
> > at
> > org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManag
> > er
> > .java:527) Caused by: java.net.UnknownHostException: ip-10-252-1-235:
> > unknown error at java.net.Inet6AddressImpl.lookupAllHostAddr(Native
> > Method) at
> > java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
> > at
> > java.net.InetAddress.getAddressesFromNameService(InetAddress.java:13
> > 23
> > ) at java.net.InetAddress.getLocalHost(InetAddress.java:1500)
> > ... 11 more
> > 2016-03-09 12:54:39,464 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled
> > snapshot period at 10 second(s).
> > 2016-03-09 12:54:39,464 INFO
> > org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager
> > metrics system started
> >
> > -----Original Message-----
> > From: Jagadish Venkatraman [mailto:jagadish1989@gmail.com]
> > Sent: Wednesday, March 9, 2016 9:58 PM
> > To: dev@samza.apache.org
> > Subject: Re: yarn UI not showing after succesfull installation
> >
> > The mail server strips screenshots. Please describe the problem in
> > greater detail (in words). If you want to upload a screenshot,
> > upload it externally and provide us with a link/
> >
> >
> > On Wed, Mar 9, 2016 at 4:45 AM, Manohar Reddy <
> > Manohar.Reddy@happiestminds.com> wrote:
> >
> > > Hi All,
> > >
> > > After checking the logs am finding the below error.
> > >
> > > Is there any configuration required for hello-samza make it up and
> > running.
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > Thaks In Advance
> > >
> > > ~~Manohar
> > >
> > > *From:* Manohar Reddy
> > > *Sent:* Wednesday, March 9, 2016 5:09 PM
> > > *To:* dev@samza.apache.org
> > > *Subject:* yarn UI not showing after succesfull installation
> > >
> > >
> > >
> > > After successful bootstrap , I am not able to see YARN UI by using
> > > the below URL
> > >
> > > *http://ec2-52-26-201-98.us-west-2.compute.amazonaws.com:8088/
> > > <http://ec2-52-26-201-98.us-west-2.compute.amazonaws.com:8088/>*
> > >
> > > *as per this screen I hope everything went well to see the YARN
> > > UI.*
> > >
> > > *Please help me out if I am doing anything wrong .*
> > >
> > >
> > >
> > >
> > >
> > > ------------------------------
> > > Happiest Minds Disclaimer
> > >
> > > This message is for the sole use of the intended recipient(s) and
> > > may contain confidential, proprietary or legally privileged
> information.
> > > Any unauthorized review, use, disclosure or distribution is
> > > prohibited. If you are not the original intended recipient of the
> > > message, please contact the sender by reply email and destroy all
> > > copies
> > of the original message.
> > > Happiest Minds Technologies <http://www.happiestminds.com>
> > >
> > > ------------------------------
> > >
> >
> >
> >
> > --
> > Jagadish V,
> > Graduate Student,
> > Department of Computer Science,
> > Stanford University
> > ________________________________
> > Happiest Minds Disclaimer
> >
> > This message is for the sole use of the intended recipient(s) and
> > may contain confidential, proprietary or legally privileged information.
> > Any unauthorized review, use, disclosure or distribution is
> > prohibited. If you are not the original intended recipient of the
> > message, please contact the sender by reply email and destroy all
> > copies
> of the original message.
> >
> > Happiest Minds Technologies <http://www.happiestminds.com>
> >
> > ________________________________
> >
>
>
>
> --
> Navina R.
> ________________________________
> Happiest Minds Disclaimer
>
> This message is for the sole use of the intended recipient(s) and may
> contain confidential, proprietary or legally privileged information.
> Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the original intended recipient of the
> message, please contact the sender by reply email and destroy all copies of the original
message.
>
> Happiest Minds Technologies <http://www.happiestminds.com>
>
> ________________________________
> ________________________________
> Happiest Minds Disclaimer
>
> This message is for the sole use of the intended recipient(s) and may
> contain confidential, proprietary or legally privileged information.
> Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the original intended recipient of the
> message, please contact the sender by reply email and destroy all copies of the original
message.
>
> Happiest Minds Technologies <http://www.happiestminds.com>
>
> ________________________________
>



--
Jagadish V,
Graduate Student,
Department of Computer Science,
Stanford University
________________________________
Happiest Minds Disclaimer

This message is for the sole use of the intended recipient(s) and may contain confidential,
proprietary or legally privileged information. Any unauthorized review, use, disclosure or
distribution is prohibited. If you are not the original intended recipient of the message,
please contact the sender by reply email and destroy all copies of the original message.

Happiest Minds Technologies <http://www.happiestminds.com>

________________________________
Mime
View raw message