hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Fancy Yin <yfxh...@gmail.com>
Subject Re: how to debug bsp jobs in hama
Date Thu, 09 Jun 2011 08:59:08 GMT
I will have a look at how org.apache.hadoop.mapred.IsolationRunne runs
in Hadoop.

2011/6/8, Edward J. Yoon <edwardyoon@apache.org>:
>> Maybe Hama can add more features for debug. For example the feature
>> similar with org.apache.hadoop.mapred.IsolationRunner and so on.
>
> Yes that's good idea.
>
> Please feel free file a JIRA and Patch!
>
> On Wed, Jun 8, 2011 at 3:36 PM, Fancy Yin <yfxhust@gmail.com> wrote:
>> Hi, Edward:
>>
>> Thank you for your suggestion!
>>
>> I noticed the issue:
>> https://issues.apache.org/jira/browse/HAMA-374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>>
>> So it is as same as Hadoop! I will try it!
>>
>> Maybe Hama can add more features for debug. For example the feature
>> similar with org.apache.hadoop.mapred.IsolationRunner and so on.
>>
>> B.R.
>> Fancy
>>
>> 2011/6/8, Edward J. Yoon <edwardyoon@apache.org>:
>>> Hi,
>>>
>>> There's a thread-based 'LocalBSPRunner'. It can be useful to debug.
>>>
>>> On Wed, Jun 8, 2011 at 11:10 AM, Fancy Yin <yfxhust@gmail.com> wrote:
>>>> Hello:
>>>>
>>>> I am new to distributed system.
>>>>
>>>> When I tried to write some experimental
>>>> code with Hama, I met one problem:how to debug a BSP job in Hama
>>>> pseudo-distributed environment.
>>>>
>>>> From code, I know that GroomServer child task is spawned like this:
>>>>
>>>> this.process = Runtime.getRuntime().exec(args, null, dir);
>>>>
>>>> This is a child process. In Netbeans, I run the job as main process.
>>>> For the main process, I can make breakpoint and debug it in any way.
>>>> But for the child process, what should I do if I want to debug it ?
>>>> How can I make sure whether there is some mistake in my bsp job.
>>>>
>>>> or maybe there is another way to debug it not in pseudo-distributed
>>>> environment?
>>>>
>>>> My development environment is a pseudo-distributed enviroment.
>>>> BSPMasterRunner process and GroomServerRunner are in the same
>>>> computer.
>>>>
>>>> The following is my process snapshot when I run my bsp job.
>>>>
>>>> 5087 HRegionServer
>>>> 25763 GroomServer$Child
>>>> 16258 Main
>>>> 22918 BSPMasterRunner
>>>> 4653 TaskTracker
>>>> 4412 SecondaryNameNode
>>>> 4839 QuorumPeerMain
>>>> 4490 JobTracker
>>>> 25930 Jps
>>>> 25694 Main
>>>> 4933 HMaster
>>>> 4247 DataNode
>>>> 4060 NameNode
>>>> 23055 GroomServerRunner
>>>>
>>>> I will appreciate u very much if you can give me some suggestions.
>>>>
>>>> B.R.
>>>> Fancy
>>>>
>>>
>>>
>>>
>>> --
>>> Best Regards, Edward J. Yoon
>>> @eddieyoon
>>>
>>
>
>
>
> --
> Best Regards, Edward J. Yoon
> @eddieyoon
>

Mime
View raw message