kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "M. Manna" <manme...@gmail.com>
Subject Re: Kafka on Windows
Date Wed, 05 Sep 2018 09:40:44 GMT
I believe this needs to be articulated a bit more, which is not a big
issue. The common practice for a large-scale distributed system is to use
Linux servers, and it's always been a popular choice. That doesn't mean the
Windows is ignored. The issue at hand is that file deletion/renaming seems
to have a different behaviour at OS core level when it comes to Windows.

Different users including myself have tried different approaches to resolve
this, but the issue still prevails. And unless people appreciates this
already, Kafka is one of the most complex distributed systems today, with a
very low-friction entry barrier (except streams !). So, fixing this
platform-specific issue is a certainly a pain to deal with.

And as a fair clarification - https://kafka.apache.org/documentation/#os
can be referenced. Reading the docs is also a skill which I always struggle
with :)

I would request humbly that the disclaimer is made slightly more explicit,
but since most of the users have been adopting K8s/bare-metal linux for
deployment, I suspect we won't know whether Windows will be supported in
the future at all.

Regards,

On Wed, 5 Sep 2018 at 10:22, jan <rtm443x@googlemail.com.invalid> wrote:

> Hi Liam,
> as a DB guy  that does MSSQL (on windows, obviously) I literally have
> no idea what a .sh file is,or what that would imply. I guess it's bash
> so yeah.
> But what's so terrifying about actually stating in the FAQ that you
> should not run it as production on windows?
> Why should I conclude that kafka on windows, with java (which is
> supported on windows), and a filesystem (which windows has), and
> reliable networking (ditto), doesn't work?
> When is "just read the code" ever an acceptable answer?
> Why should I lose 3 days just because someone couldn't put "don't do
> it" in the FAQ (which I did read), and also have other people need to
> ask here whether windows is supported?
> Why?
> This is just nuts.
>
> cheers
>
> jan
>
>
> On 05/09/2018, Liam Clarke <liam.clarke@adscale.co.nz> wrote:
> > Hi Jan,
> >
> > I'd presume that downloading an archive and seeing a bunch of .sh files
> > would imply that Kafka wasn't built to run on Windows.
> >
> > Given that it's a cluster based technology, I'd assume that it wouldn't
> be
> > supported for Windows given that most server based stuff isn't unless
> > Microsoft built it.
> >
> > Kind regards,
> >
> > Liam Clarke
> >
> > On Wed, 8 Aug. 2018, 2:42 am jan, <rtm443x@googlemail.com.invalid>
> wrote:
> >
> >> This is an excellent suggestion and I intend to do so henceforth
> >> (thanks!), but it would be an adjunct to my request rather than the
> >> answer; it still needs to be made clear in the docs/faq that you
> >> *can't* use windows directly.
> >>
> >> jan
> >>
> >> On 07/08/2018, Rahul Singh <rahul.xavier.singh@gmail.com> wrote:
> >> > I would recommend using Docker — it would end up being run on a Linux
> >> kernel
> >> > VM on windows and is easier to get started on with a bit of learning
> >> curve
> >> > for Docker. Less time wasted overall and at least at that point you
> >> > would
> >> > know Docker.
> >> >
> >> > Rahul
> >> > On Aug 7, 2018, 4:50 AM -0400, jan <rtm443x@googlemail.com.invalid>,
> >> wrote:
> >> >> I tried using it just for learning a while back and wasted 3 days
> >> >> because it's not supported on windows. Even basic stuff didn't work.
> I
> >> >> did read the docs first!
> >> >>
> >> >> I think I've seen other people on this list have questions
> >> >> about/problems for exactly the same reason, and that could be a lot
> of
> >> >> time saved if it was in the docs - it needs to be. So how do I ask
> the
> >> >> maintainers to put 'No, Not Windows" in there?
> >> >> Serious question.
> >> >>
> >> >> I resent losing 3 days of work because of essential missing info. It
> >> >> sounds like (compared to @M. Manna) that I got off lightly.
> >> >>
> >> >> So can we put a clear caveat in the documentation, please, right at
> >> >> the
> >> >> top?
> >> >>
> >> >> jan
> >> >>
> >> >> On 07/08/2018, M. Manna <manmedia@gmail.com> wrote:
> >> >> > The answer is - Absolutely not. If you don’t have Linux rack,
or
> >> >> > Kubernetes
> >> >> > deployment -it will not work on Windows as guaranteed.
> >> >> >
> >> >> > I know this because I have tried to make it work for the past
1
> >> >> > year.
> >> >> > File
> >> >> > handling always fails and crashes the cluster on Windows.
> >> >> >
> >> >> > Thanks,
> >> >> >
> >> >> >
> >> >> >
> >> >> > On Tue, 7 Aug 2018 at 01:54, Alew <alewmt@gmail.com> wrote:
> >> >> >
> >> >> > > Hi!
> >> >> > >
> >> >> > > Is it recommended to use production Kafka cluster on Windows?
> >> >> > >
> >> >> > > Can't get it from the documentation. It is possible to start
> Kafka
> >> on
> >> >> > > Windows, but maybe it's for development purposes only.
> >> >> > >
> >> >> > > Thanks.
> >> >> > >
> >> >> > >
> >> >> > >
> >> >> > >
> >> >> >
> >> >
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message