hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Bai Shen <baishen.li...@gmail.com>
Subject Job stuck in attempt loop on LocalJobRunner, produces no errors
Date Mon, 22 Oct 2012 14:05:48 GMT
Apologies for the cross posting, but I'm not sure where the problem lies.

I'm running Nutch 2 on CDH3.  Some of my operations run in to a problem and
then get stuck in an attempt loop.  Attempt after attempt fails until I
manually stop the job.  I can't seem to find any errors in the log files.

Any suggestions of what to look at would be appreciated.

Thanks.

[root@node9-0 nutch]# bin/nutch updatedb
12/10/22 09:58:35 INFO crawl.DbUpdaterJob: DbUpdaterJob: starting
12/10/22 09:58:35 INFO plugin.PluginRepository: Plugins: looking in:
/tmp/hadoop-root/hadoop-unjar6739081384204202184/classes/plugins
12/10/22 09:58:35 INFO plugin.PluginRepository: Plugin Auto-activation
mode: [true]
12/10/22 09:58:35 INFO plugin.PluginRepository: Registered Plugins:
12/10/22 09:58:35 INFO plugin.PluginRepository:         the nutch core
extension points (nutch-extensionpoints)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Basic URL
Normalizer (urlnormalizer-basic)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Basic Indexing
Filter (index-basic)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Language Detection
Filter (language-detection)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Http / Https
Protocol Plug-in (protocol-httpclient)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Location Extraction
Filter (location-extraction)
12/10/22 09:58:35 INFO plugin.PluginRepository:         HTTP Framework
(lib-http)
12/10/22 09:58:35 INFO plugin.PluginRepository:         More Indexing
Filter (index-more)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Regex URL Filter
(urlfilter-regex)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Pass-through URL
Normalizer (urlnormalizer-pass)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Http Protocol
Plug-in (protocol-http)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Regex URL
Normalizer (urlnormalizer-regex)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Tika Parser Plug-in
(parse-tika)
12/10/22 09:58:35 INFO plugin.PluginRepository:         OPIC Scoring
Plug-in (scoring-opic)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Anchor Indexing
Filter (index-anchor)
12/10/22 09:58:35 INFO plugin.PluginRepository:         JavaScript Parser
(parse-js)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Domain URL Filter
(urlfilter-domain)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Regex URL Filter
Framework (lib-regex-filter)
12/10/22 09:58:35 INFO plugin.PluginRepository: Registered Extension-Points:
12/10/22 09:58:35 INFO plugin.PluginRepository:         Nutch URL
Normalizer (org.apache.nutch.net.URLNormalizer)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Nutch Protocol
(org.apache.nutch.protocol.Protocol)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Parse Filter
(org.apache.nutch.parse.ParseFilter)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Nutch URL Filter
(org.apache.nutch.net.URLFilter)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Nutch Indexing
Filter (org.apache.nutch.indexer.IndexingFilter)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Nutch Content
Parser (org.apache.nutch.parse.Parser)
12/10/22 09:58:35 INFO plugin.PluginRepository:         Nutch Scoring
(org.apache.nutch.scoring.ScoringFilter)
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.3.2-1031432, built on 11/05/2010 05:32 GMT
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client environment:host.name
=node9-0
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_05
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/java/jdk1.7.0_05/jre
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/usr/lib/hadoop-0.20/conf:/usr/java/default/lib/tools.jar:/usr/lib/hadoop-0.20:/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u5.jar:/usr/lib/hadoop-0.20/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop-0.20/lib/asm-3.2.jar:/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop-0.20/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop-0.20/lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop-0.20/lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop-0.20/lib/commons-io-2.1.jar:/usr/lib/hadoop-0.20/lib/commons-lang-2.4.jar:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop-0.20/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop-0.20/lib/commons-net-3.1.jar:/usr/lib/hadoop-0.20/lib/core-3.1.1.jar:/usr/lib/hadoop-0.20/lib/guava-r09-jarjar.jar:/usr/lib/hadoop-0.20/lib/hadoop-fairscheduler-0.20.2-cdh3u5.jar:/usr/lib/hadoop-0.20/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop-0.20/lib/jersey-core-1.8.jar:/usr/lib/hadoop-0.20/lib/jersey-json-1.8.jar:/usr/lib/hadoop-0.20/lib/jersey-server-1.8.jar:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20/lib/jetty-6.1.26.cloudera.1.jar:/usr/lib/hadoop-0.20/lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/lib/hadoop-0.20/lib/jetty-util-6.1.26.cloudera.1.jar:/usr/lib/hadoop-0.20/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20/lib/junit-4.5.jar:/usr/lib/hadoop-0.20/lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar:/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop-0.20/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop-0.20/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop-0.20/lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop-0.20/lib/jsp-2.1/jsp-api-2.1.jar
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:os.version=2.6.32-279.el6.x86_64
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client environment:user.name
=root
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:user.home=/root
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/opt/nutch
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000 watcher=hconnection
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0be,
negotiated timeout = 40000
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0bf,
negotiated timeout = 40000
12/10/22 09:58:35 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0bf
closed
12/10/22 09:58:35 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:36 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c0,
negotiated timeout = 40000
12/10/22 09:58:36 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c0
closed
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:36 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
12/10/22 09:58:36 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
12/10/22 09:58:36 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c1,
negotiated timeout = 40000
12/10/22 09:58:36 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c1
closed
12/10/22 09:58:36 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:37 INFO mapred.JobClient: Running job: job_local_0001
12/10/22 09:58:37 INFO util.ProcessTree: setsid exited with exit code 0
12/10/22 09:58:37 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@45b028db
12/10/22 09:58:37 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c2,
negotiated timeout = 40000
12/10/22 09:58:37 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c2
closed
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:37 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c3,
negotiated timeout = 40000
12/10/22 09:58:37 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c3
closed
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:37 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c4,
negotiated timeout = 40000
12/10/22 09:58:37 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c4
closed
12/10/22 09:58:37 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:37 INFO mapreduce.GoraRecordReader: gora.buffer.read.limit =
10000
12/10/22 09:58:37 INFO mapred.MapTask: io.sort.mb = 100
12/10/22 09:58:37 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/22 09:58:37 INFO mapred.MapTask: record buffer = 262144/327680
12/10/22 09:58:38 INFO mapred.MapTask: Starting flush of map output
12/10/22 09:58:38 INFO mapred.MapTask: Finished spill 0
12/10/22 09:58:38 INFO mapred.Task: Task:attempt_local_0001_m_000000_0 is
done. And is in the process of commiting
12/10/22 09:58:38 INFO mapred.LocalJobRunner:
12/10/22 09:58:38 INFO mapred.Task: Task 'attempt_local_0001_m_000000_0'
done.
12/10/22 09:58:38 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1038aa1e
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c5,
negotiated timeout = 40000
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c5
closed
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c6,
negotiated timeout = 40000
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c6
closed
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c7,
negotiated timeout = 40000
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c7
closed
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:38 INFO mapreduce.GoraRecordReader: gora.buffer.read.limit =
10000
12/10/22 09:58:38 INFO mapred.MapTask: io.sort.mb = 100
12/10/22 09:58:38 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/22 09:58:38 INFO mapred.MapTask: record buffer = 262144/327680
12/10/22 09:58:38 INFO mapred.JobClient:  map 100% reduce 0%
12/10/22 09:58:38 INFO mapred.MapTask: Starting flush of map output
12/10/22 09:58:38 INFO mapred.MapTask: Finished spill 0
12/10/22 09:58:38 INFO mapred.Task: Task:attempt_local_0001_m_000001_0 is
done. And is in the process of commiting
12/10/22 09:58:38 INFO mapred.LocalJobRunner:
12/10/22 09:58:38 INFO mapred.Task: Task 'attempt_local_0001_m_000001_0'
done.
12/10/22 09:58:38 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@68ccc170
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c8,
negotiated timeout = 40000
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c8
closed
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0c9,
negotiated timeout = 40000
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0c9
closed
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0ca,
negotiated timeout = 40000
12/10/22 09:58:38 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0ca
closed
12/10/22 09:58:38 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:38 INFO mapreduce.GoraRecordReader: gora.buffer.read.limit =
10000
12/10/22 09:58:38 INFO mapred.MapTask: io.sort.mb = 100
12/10/22 09:58:38 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/22 09:58:38 INFO mapred.MapTask: record buffer = 262144/327680
12/10/22 09:58:39 INFO mapred.MapTask: Starting flush of map output
12/10/22 09:58:39 INFO mapred.MapTask: Finished spill 0
12/10/22 09:58:39 INFO mapred.Task: Task:attempt_local_0001_m_000002_0 is
done. And is in the process of commiting
12/10/22 09:58:39 INFO mapred.LocalJobRunner:
12/10/22 09:58:39 INFO mapred.Task: Task 'attempt_local_0001_m_000002_0'
done.
12/10/22 09:58:39 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@e9e1e25
12/10/22 09:58:39 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0cb,
negotiated timeout = 40000
12/10/22 09:58:39 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0cb
closed
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:39 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0cc,
negotiated timeout = 40000
12/10/22 09:58:39 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0cc
closed
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:39 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0cd,
negotiated timeout = 40000
12/10/22 09:58:39 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0cd
closed
12/10/22 09:58:39 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:39 INFO mapreduce.GoraRecordReader: gora.buffer.read.limit =
10000
12/10/22 09:58:39 INFO mapred.MapTask: io.sort.mb = 100
12/10/22 09:58:39 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/22 09:58:39 INFO mapred.MapTask: record buffer = 262144/327680
12/10/22 09:58:40 INFO mapred.MapTask: Starting flush of map output
12/10/22 09:58:40 INFO mapred.MapTask: Finished spill 0
12/10/22 09:58:40 INFO mapred.Task: Task:attempt_local_0001_m_000003_0 is
done. And is in the process of commiting
12/10/22 09:58:40 INFO mapred.LocalJobRunner:
12/10/22 09:58:40 INFO mapred.Task: Task 'attempt_local_0001_m_000003_0'
done.
12/10/22 09:58:40 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1fd6f2be
12/10/22 09:58:40 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0ce,
negotiated timeout = 40000
12/10/22 09:58:40 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0ce
closed
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:40 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0cf,
negotiated timeout = 40000
12/10/22 09:58:40 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0cf
closed
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:40 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0d0,
negotiated timeout = 40000
12/10/22 09:58:40 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0d0
closed
12/10/22 09:58:40 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:40 INFO mapreduce.GoraRecordReader: gora.buffer.read.limit =
10000
12/10/22 09:58:40 INFO mapred.MapTask: io.sort.mb = 100
12/10/22 09:58:41 INFO mapred.MapTask: data buffer = 79691776/99614720
12/10/22 09:58:41 INFO mapred.MapTask: record buffer = 262144/327680
12/10/22 09:58:41 INFO mapred.MapTask: Starting flush of map output
12/10/22 09:58:41 INFO mapred.MapTask: Finished spill 0
12/10/22 09:58:41 INFO mapred.Task: Task:attempt_local_0001_m_000004_0 is
done. And is in the process of commiting
12/10/22 09:58:41 INFO mapred.LocalJobRunner:
12/10/22 09:58:41 INFO mapred.Task: Task 'attempt_local_0001_m_000004_0'
done.
12/10/22 09:58:41 INFO mapred.Task:  Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@547e6602
12/10/22 09:58:41 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0d1,
negotiated timeout = 40000
12/10/22 09:58:41 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0d1
closed
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:41 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Session establishment complete
on server node1-0/192.168.66.11:2181, sessionid = 0x13a74e68810d0d2,
negotiated timeout = 40000
12/10/22 09:58:41 INFO zookeeper.ZooKeeper: Session: 0x13a74e68810d0d2
closed
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: EventThread shut down
12/10/22 09:58:41 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=node1-0:2181 sessionTimeout=180000
watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@62b243a2
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Opening socket connection to
server node1-0/192.168.66.11:2181
12/10/22 09:58:41 INFO zookeeper.ClientCnxn: Socket connection established
to node1-0/192.168.66.11:2181, initiating session

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message