kudu-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Heo <jason.heo....@gmail.com>
Subject tserver died during bulk indexing and dies again after restarting
Date Sat, 22 Apr 2017 09:11:35 GMT
Hi.

I'm using Apache Kudu 1.2.

One of tservers has been dead during bulk indexing. Here is the log of the
dead tserver.

Can I know that's the problem and how to start tserver?

==============================
$ tail -f kudu-tserver.WARNING
Log file created at: 2017/04/22 14:44:59
Running on machine: hostname
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
E0422 14:44:59.401752 124050 consensus_queue.cc:415] T
7db58ed040b24faf9dac3cd729e98d74 P 58fce39a905b4971b1951929ba30fe30
[LEADER]: Error trying to read ahead of the log while preparing peer
request: Incomplete: Op with index 16588 is ahead of the local log (next
sequential op: 16588). Destination peer: Peer:
0abff808ff3e4248a9ddd97b01910e6c, Is new: false, Last received: 1.16588,
Next index: 16589, Last known committed idx: 16586, Last exchange result:
SUCCESS, Needs tablet copy: false
F0422 14:44:59.624615 125459 transaction_driver.cc:358] T
30aaccdf7c8c496a8ad73255856a1724 P 58fce39a905b4971b1951929ba30fe30 S RD-NP
Ts 6114672227972882432: Cannot cancel transactions that have already
replicated: Invalid argument: Cannot decode client schema: Duplicate column
name: id transaction:RD-NP WriteTransaction [type=REPLICA,
start_time=2017-04-22 14:44:59, state=WriteTransactionState 0xd46f49c0
[op_id=(term: 1 index: 16758), ts=6114672227972882432, rows=[]]]
=========================

If I start tserver, it dies again.

============
tail -f kudu-tserver.INFO
Log file created at: 2017/04/22 18:06:19
Running on machine: hostname
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
F0422 18:06:19.268718  7058 transaction_driver.cc:358] T
30aaccdf7c8c496a8ad73255856a1724 P 58fce39a905b4971b1951929ba30fe30 S R-NP
Ts 6114672227972882432: Cannot cancel transactions that have already
replicated: Invalid argument: Cannot decode client schema: Duplicate column
name: id transaction:R-NP WriteTransaction [type=REPLICA,
start_time=2017-04-22 18:06:19, state=WriteTransactionState 0x57049c0
[op_id=(term: 1 index: 16758), ts=6114672227972882432, rows=[]]]
===============


Thanks,

Jason

Mime
View raw message