Well, there are other approaches. I don't want to be a broken record, but
these problems are all solved in MapR. (there I said it... I won't repeat
it for a week or more).
The long and short of it is that HDFS is not a given. It should be
supported, but the limitations of HDFS should not be baked into Drill as
gospel.
On Tue, Aug 28, 2012 at 9:07 AM, Min Zhou <coderplay@gmail.com> wrote:
> On Tue, Aug 28, 2012 at 7:39 PM, Ted Dunning <ted.dunning@gmail.com>
> wrote:
>
> > Can't do variable block size in vanilla hadoop. That is part of the
> whole
> > namenode legacy.
> >
> Exactly. HDFS doesn't support variable block sizes. There is a jira of HDFS
> metioned such feature (HDFS-2362). After all, variable block sizes would
> make things more complex. It seems that we need a tradeoff: locality or
> simplicity.
>
|