flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Exception while running Flink jobs (1.0.0)
Date Thu, 06 Oct 2016 08:32:34 GMT
The problem is that data is very large and usually cannot run on a single
machine :(

On Thu, Oct 6, 2016 at 10:11 AM, Ufuk Celebi <uce@apache.org> wrote:

> On Wed, Oct 5, 2016 at 7:08 PM, Tarandeep Singh <tarandeep@gmail.com>
> wrote:
> > @Stephan my flink cluster setup- 5 nodes, each running 1 TaskManager.
> Slots
> > per task manager: 2-4 (I tried varying this to see if this has any
> impact).
> > Network buffers: 5k - 20k (tried different values for it).
>
> Could you run the job first on a single task manager to see if the
> error occurs even if no network shuffle is involved? That should be
> less overhead for you than running the custom build (which might be
> buggy ;)).
>
> – Ufuk
>

Mime
View raw message