kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Garcia <dav...@spiceworks.com>
Subject Re: TimeBasePartitioner for confluent
Date Fri, 03 Mar 2017 23:44:20 GMT
Gah…nm…looked at source code…use this:

schema.generator.class=io.confluent.connect.storage.hive.schema.TimeBasedSchemaGenerator

On 3/3/17, 5:36 PM, "David Garcia" <davidg@spiceworks.com> wrote:

    Trying to user s3-loader and am getting this error:
    
    org.apache.kafka.common.config.ConfigException: Invalid generator class: class io.confluent.connect.storage.hive.schema.DefaultSchemaGenerator
                    at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.newSchemaGenerator(TimeBasedPartitioner.java:107)
                    at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.init(TimeBasedPartitioner.java:44)
                    at io.confluent.connect.storage.partitioner.TimeBasedPartitioner.configure(TimeBasedPartitioner.java:87)
                    at io.confluent.connect.s3.S3SinkTask.newPartitioner(S3SinkTask.java:146)
                    at io.confluent.connect.s3.S3SinkTask.start(S3SinkTask.java:100)
                    at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:231)
                    at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:145)
                    at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:139)
                    at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:182)
    
    
    perhaps this is a configuration issue?
    
    -David
    

Mime
View raw message