kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Bhattacharjee <abhishek.bhattacharje...@gmail.com>
Subject Re: Unable to build kafka.
Date Thu, 05 Jun 2014 16:40:26 GMT
Thanks a lot for your reply. I'll migrate later :-D . I'll use the 0.8.0 as
per now.
Thanks.
On Jun 5, 2014 6:03 PM, "Joe Stein" <joe.stein@stealth.ly> wrote:

> There are overloaded changes. You don't have to use them (e.g. key is now
> used in compaction with partKey for the partition key
>
> https://github.com/apache/kafka/commit/d285e263bf403f3db27f5d138594c395643a2284#diff-9df10051217ceff96ecce28d087cf0bb
> for new compaction feature
> https://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction).  If you
> can keep on the latest stable release you will get the most support options
> from the community.
>
> We also have downloads for the 0.8.0 release so you do not have to build.
>  That might be an option for now and migrate later?
>
> https://kafka.apache.org/downloads.html
>
>    - Release Notes
>    <https://archive.apache.org/dist/kafka/0.8.0/RELEASE_NOTES.html>
>    - Source download: kafka-0.8.0-src.tgz
>    <https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz> (asc
>    <https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz.asc>,
>    md5
>    <
> https://archive.apache.org/dist/kafka/0.8.0/0.8.0/kafka-0.8.0-src.tgz.md5>
>    )
>    - Binary download: kafka_2.8.0-0.8.0.tar.gz
>    <https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz>
> (
>    asc
>    <
> https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.asc>
>    , md5
>    <
> https://archive.apache.org/dist/kafka/0.8.0/kafka_2.8.0-0.8.0.tar.gz.md5>
>    )
>
> You can also look at the release process for 0.8.0 and below
> https://cwiki.apache.org/confluence/display/KAFKA/Release+Process with sbt
> maybe there is a step you missed or incorrect something or another.
>
> /*******************************************
>  Joe Stein
>  Founder, Principal Consultant
>  Big Data Open Source Security LLC
>  http://www.stealth.ly
>  Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> ********************************************/
>
>
> On Thu, Jun 5, 2014 at 8:16 AM, Abhishek Bhattacharjee <
> abhishek.bhattacharjee11@gmail.com> wrote:
>
> > I have a project running on kafka.0.8.0. Are there any changes in the
> > Producer and consumer APIs in the new version ?
> > Thanks.
> > On Jun 5, 2014 3:53 PM, "Joe Stein" <joe.stein@stealth.ly> wrote:
> >
> > > Can you try the latest stable branch, please?
> > >
> > > We moved to gradle
> https://github.com/apache/kafka/blob/0.8.1/README.md
> > > and
> > > also distribute binaries as artifacts for download
> > > https://kafka.apache.org/downloads.html
> > >
> > > /*******************************************
> > >  Joe Stein
> > >  Founder, Principal Consultant
> > >  Big Data Open Source Security LLC
> > >  http://www.stealth.ly
> > >  Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > > ********************************************/
> > >
> > >
> > > On Thu, Jun 5, 2014 at 4:25 AM, Abhishek Bhattacharjee <
> > > abhishek.bhattacharjee11@gmail.com> wrote:
> > >
> > > > Thanks for the reply. I re built kafka. And now when I am running
> > server
> > > it
> > > > is stopping saying it cannot find the class Kafka.Kafka.
> > > > I don't know what went most probably it's an sbt problem.
> > > > Any help is welcome.
> > > > Thanks :-)
> > > > On Jun 5, 2014 6:05 AM, "Joe Stein" <joe.stein@stealth.ly> wrote:
> > > >
> > > > > The build looks fine your error seems valid maybe like your
> broker(s)
> > > > > is(are) not up.
> > > > >
> > > > > /*******************************************
> > > > >  Joe Stein
> > > > >  Founder, Principal Consultant
> > > > >  Big Data Open Source Security LLC
> > > > >  http://www.stealth.ly
> > > > >  Twitter: @allthingshadoop
> > > > > ********************************************/
> > > > >
> > > > >
> > > > > > On Jun 4, 2014, at 8:07 PM, Abhishek Bhattacharjee <
> > > > > abhishek.bhattacharjee11@gmail.com> wrote:
> > > > > >
> > > > > > I followed the readme for kafka-0.8.0.
> > > > > > After I am getting the following warnings
> > > > > >
> > > > > >>> ./sbt assembly-package-dependency
> > > > > >
> > > > > > [info] Loading project definition from
> > > > > > /home/abhishek/Project/kafka-0.8.0-src/project
> > > > > > [warn] Multiple resolvers having different access mechanism
> > > configured
> > > > > with
> > > > > > same name 'sbt-plugin-releases'. To avoid conflict, Remove
> > duplicate
> > > > > > project resolvers (`resolvers`) or rename publishing resolver
> > > > > (`publishTo`).
> > > > > > [info] Set current project to Kafka (in build
> > > > > > file:/home/abhishek/Project/kafka-0.8.0-src/)
> > > > > > [warn] Credentials file /home/abhishek/.m2/.credentials does
not
> > > exist
> > > > > > [info] Compiling 213 Scala sources and 2 Java sources to
> > > > > >
> > > >
> > /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/classes...
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/LeaderAndIsrResponse.scala:66:
> > > > > > non variable type-argument String in type pattern (String, Int)
> is
> > > > > > unchecked since it is eliminated by erasure
> > > > > > [warn]     for ((key:(String, Int), value) <- responseMap)
{
> > > > > > [warn]               ^
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/api/StopReplicaResponse.scala:67:
> > > > > > non variable type-argument String in type pattern (String, Int)
> is
> > > > > > unchecked since it is eliminated by erasure
> > > > > > [warn]     for ((key:(String, Int), value) <- responseMap){
> > > > > > [warn]               ^
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/utils/Utils.scala:383:
> > > > > > non variable type-argument V in type pattern List[V] is unchecked
> > > since
> > > > > it
> > > > > > is eliminated by erasure
> > > > > > [warn]         case Some(l: List[V]) => m.put(k, v :: l)
> > > > > > [warn]                      ^
> > > > > > [warn] three warnings found
> > > > > > [warn] warning: [options] bootstrap class path not set in
> > conjunction
> > > > > with
> > > > > > -source 1.5
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:261:
> > > > > > warning: [unchecked] unchecked conversion
> > > > > > [warn]         ProducerThread producerThread = new
> > > > > > ProducerThread(producerDataChannel, producer, i);
> > > > > > [warn]
> > > > > >            ^
> > > > > > [warn]   required: Producer<byte[],byte[]>
> > > > > > [warn]   found:    Producer
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V)
> as
> > a
> > > > > member
> > > > > > of the raw type KeyedMessage
> > > > > > [warn]           KeyedMessage<byte[], byte[]> producerData
= new
> > > > > > KeyedMessage((String)topic, null, bytes);
> > > > > > [warn]                                                     
 ^
> > > > > > [warn]   where K,V are type-variables:
> > > > > > [warn]     K extends Object declared in class KeyedMessage
> > > > > > [warn]     V extends Object declared in class KeyedMessage
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:338:
> > > > > > warning: [unchecked] unchecked conversion
> > > > > > [warn]           KeyedMessage<byte[], byte[]> producerData
= new
> > > > > > KeyedMessage((String)topic, null, bytes);
> > > > > > [warn]                                                     
 ^
> > > > > > [warn]   required: KeyedMessage<byte[],byte[]>
> > > > > > [warn]   found:    KeyedMessage
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > > > warning: [unchecked] unchecked call to KeyedMessage(String,K,V)
> as
> > a
> > > > > member
> > > > > > of the raw type KeyedMessage
> > > > > > [warn]     private KeyedMessage<byte[], byte[]> shutdownMessage
=
> > new
> > > > > > KeyedMessage("shutdown", null, null);
> > > > > > [warn]
>  ^
> > > > > > [warn]   where K,V are type-variables:
> > > > > > [warn]     K extends Object declared in class KeyedMessage
> > > > > > [warn]     V extends Object declared in class KeyedMessage
> > > > > > [warn]
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/src/main/scala/kafka/tools/KafkaMigrationTool.java:371:
> > > > > > warning: [unchecked] unchecked conversion
> > > > > > [warn]     private KeyedMessage<byte[], byte[]> shutdownMessage
=
> > new
> > > > > > KeyedMessage("shutdown", null, null);
> > > > > > [warn]
>  ^
> > > > > > [warn]   required: KeyedMessage<byte[],byte[]>
> > > > > > [warn]   found:    KeyedMessage
> > > > > > [warn] 6 warnings
> > > > > > [info] Including zkclient-0.3.jar
> > > > > > [info] Including snappy-java-1.0.4.1.jar
> > > > > > [info] Including zookeeper-3.3.4.jar
> > > > > > [info] Including metrics-core-2.2.0.jar
> > > > > > [info] Including metrics-annotation-2.2.0.jar
> > > > > > [info] Including log4j-1.2.15.jar
> > > > > > [info] Including scala-compiler.jar
> > > > > > [info] Including jopt-simple-3.2.jar
> > > > > > [info] Including slf4j-api-1.7.2.jar
> > > > > > [info] Including slf4j-simple-1.6.4.jar
> > > > > > [info] Including scala-library.jar
> > > > > > [warn] Merging 'META-INF/NOTICE' with strategy 'rename'
> > > > > > [warn] Merging 'org/xerial/snappy/native/README' with strategy
> > > 'rename'
> > > > > > [warn] Merging
> > 'META-INF/maven/org.xerial.snappy/snappy-java/LICENSE'
> > > > > with
> > > > > > strategy 'rename'
> > > > > > [warn] Merging 'LICENSE.txt' with strategy 'rename'
> > > > > > [warn] Merging 'META-INF/LICENSE' with strategy 'rename'
> > > > > > [warn] Merging 'META-INF/MANIFEST.MF' with strategy 'discard'
> > > > > > [warn] Strategy 'discard' was applied to a file
> > > > > > [warn] Strategy 'rename' was applied to 5 files
> > > > > > [info] Packaging
> > > > > >
> > > > >
> > > >
> > >
> >
> /home/abhishek/Project/kafka-0.8.0-src/core/target/scala-2.8.0/kafka-assembly-0.8.0-deps.jar
> > > > > > ...
> > > > > > [info] Done packaging.
> > > > > > [success] Total time: 67 s, completed 5 Jun, 2014 5:31:28 AM
> > > > > >
> > > > > > I am not able run my Producer to insert into kafka.
> > > > > > The server runs but data doesn't go in.
> LeaderNotAvailableException
> > > is
> > > > > > raised.
> > > > > >
> > > > > > Thanks
> > > > > > --
> > > > > > *Abhishek Bhattacharjee*
> > > > > > *Pune Institute of Computer Technology*
> > > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message