drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jinfeng Ni <jinfengn...@gmail.com>
Subject Re: EMR + Error closing operators
Date Thu, 18 Aug 2016 04:01:46 GMT
The source code that raised this exception seems to be here [1]. Can
you please check your drillbit.log and see if it has more information?


[1] https://github.com/apache/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/physical/impl/BaseRootExec.java#L144

On Wed, Aug 17, 2016 at 8:37 PM, Stefan Sedich <stefan.sedich@gmail.com> wrote:
> I have a gzipped json sample file ~2GB which I can create a parquet table
> from perfectly fine on my laptop.
>
> I have spun up a new EMR cluster running MapR M5 and am using the bootstrap
> script: https://www.mapr.com/blog/bootstrap-apache-drill-amazon-emr
>
> Running the same CTAS I can see if gets through reading around 1/5th of the
> rows from the json and crashes with the following:
>
> Error: SYSTEM ERROR: RuntimeException: Error closing operators
>
> What is my best way to really diagnose what is going on? I wouldn't have
> thought it would be a memory issue as these EMR nodes have far more memory
> that that of my laptop.
>
> Any advice is appreciated.
>
>
>
> Thanks

Mime
View raw message