hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fancy Yin <yfxh...@gmail.com>
Subject Re: how to debug bsp jobs in hama
Date Wed, 08 Jun 2011 06:36:30 GMT
Hi, Edward:

Thank you for your suggestion!

I noticed the issue:
https://issues.apache.org/jira/browse/HAMA-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

So it is as same as Hadoop! I will try it!

Maybe Hama can add more features for debug. For example the feature
similar with org.apache.hadoop.mapred.IsolationRunner and so on.

B.R.
Fancy

2011/6/8, Edward J. Yoon <edwardyoon@apache.org>:
> Hi,
>
> There's a thread-based 'LocalBSPRunner'. It can be useful to debug.
>
> On Wed, Jun 8, 2011 at 11:10 AM, Fancy Yin <yfxhust@gmail.com> wrote:
>> Hello:
>>
>> I am new to distributed system.
>>
>> When I tried to write some experimental
>> code with Hama, I met one problem:how to debug a BSP job in Hama
>> pseudo-distributed environment.
>>
>> From code, I know that GroomServer child task is spawned like this:
>>
>> this.process = Runtime.getRuntime().exec(args, null, dir);
>>
>> This is a child process. In Netbeans, I run the job as main process.
>> For the main process, I can make breakpoint and debug it in any way.
>> But for the child process, what should I do if I want to debug it ?
>> How can I make sure whether there is some mistake in my bsp job.
>>
>> or maybe there is another way to debug it not in pseudo-distributed
>> environment?
>>
>> My development environment is a pseudo-distributed enviroment.
>> BSPMasterRunner process and GroomServerRunner are in the same
>> computer.
>>
>> The following is my process snapshot when I run my bsp job.
>>
>> 5087 HRegionServer
>> 25763 GroomServer$Child
>> 16258 Main
>> 22918 BSPMasterRunner
>> 4653 TaskTracker
>> 4412 SecondaryNameNode
>> 4839 QuorumPeerMain
>> 4490 JobTracker
>> 25930 Jps
>> 25694 Main
>> 4933 HMaster
>> 4247 DataNode
>> 4060 NameNode
>> 23055 GroomServerRunner
>>
>> I will appreciate u very much if you can give me some suggestions.
>>
>> B.R.
>> Fancy
>>
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

Mime
View raw message