cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Terje Marthinussen (JIRA)" <>
Subject [jira] [Commented] (CASSANDRA-2604) EOFException on commitlogs
Date Wed, 04 May 2011 23:10:03 GMT


Terje Marthinussen commented on CASSANDRA-2604:

Time for some sleep, but I stepped through this code with a bad commit table (not the same
which caused the above error though, but produces same stack).

    public void deserializeColumns(DataInput dis, ColumnFamily cf, boolean intern, boolean
fromRemote) throws IOException
        int size = dis.readInt();
        ColumnFamilyStore interner = intern ?
: null;
        for (int i = 0; i < size; ++i)
            IColumn column = cf.getColumnSerializer().deserialize(dis, interner, fromRemote,
(int) (System.currentTimeMillis() / 1000));

The size of the buffer underlying "dis" is 153 byte.

"size" in the above code is 4.

With i == 2 finished, dis has just reached position 153 (perfectly) in the underlying buffer,
although I cannot guarantee that the value is completely read.

Obviously, when trying to read at i==3, it crashes as it is already at the end of the buffer.

I would expect the entry which it is trying to decode in this case to have 4, not 3 columns.

I do see some of my own code is actually involved here, but unless the commitlog does its
own serialization fully or partly and uses the "standard" deserializer my code is unlikely
to cause any problems like this.

> EOFException on commitlogs
> --------------------------
>                 Key: CASSANDRA-2604
>                 URL:
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>    Affects Versions: 0.8 beta 1
>            Reporter: Terje Marthinussen
>            Assignee: Sylvain Lebresne
> I have seen this occasionally since we started testing 0.8.
> It happens when reading commitlogs on startups.
> However, I have seen it a lot less on 0.8 beta2 (although this is from beta 2)
> ERROR [main] 2011-05-04 18:02:38,134 (line 330) Exception
encountered during startup.
> 	at
> 	at org.apache.cassandra.utils.ByteBufferUtil.readShortLength(
> 	at org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(
> 	at org.apache.cassandra.db.ColumnSerializer.deserialize(
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserializeColumns(
> 	at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(
> 	at org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(
> 	at org.apache.cassandra.db.commitlog.CommitLog.recover(
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(
> Note that the line numbers on columnserializer may be off due to some local changes,
but those changes are in code not executed in this case and I am 100% sure they do not trigger
this problem.
> I looked on this in the debugger in eclipse on a trunk from 0.8 2 weeks ago, and the
interesting thing I saw was that according to the debugger, the offset of the inputstream
to the deserializer was already at the end (very last byte) of the underlying bytebuffer but
according to the stack, it was trying to read the length of the column name (first read done
in the deserialized).

This message is automatically generated by JIRA.
For more information on JIRA, see:

View raw message