drill-user mailing list archives

Hi Team,

Learned about apache drill that - 'Drill is memory intensive and therefore requires sufficient
memory to run optimally. You can modify how much memory that you want allocated to Drill.
Drill typically performs better with as much memory as possible.'

With this I tried allocating as much as memory I could for drill to run. I'm running the drill
on my local machine so configured the JAVA_TOOL_OPTIONS to 8GB as Environment variable. Which
in turn increased the heap memory.

[cid:image005.jpg@01D5F7D0.468F6AC0]

While running a query for generating a parquet file from SQL Server having millions of record,
the drill just uses 3 - 4 % of heap memory. Any ways there is no increase in the performance(reduce
in time of file generation).

Can you please let us know if there's a way to reduce the file generation time?


[cid:image006.jpg@01D5F7D0.468F6AC0]


Please let me know if any further details are required.


Looking for your reply to Vishwajeet Anantvilas SONUNE <vishwajeet.anantvilas.sonune@hsbc.co.in>


Thanks
Vishwajeet Sonune




*******************************************************************
This e-mail is confidential. It may also be legally privileged. 
If you are not the addressee you may not copy, forward, disclose 
or use any part of it. If you have received this message in error, 
please delete it and all copies from your system and notify the 
sender immediately by return e-mail.
Internet communications cannot be guaranteed to be timely, 
secure, error or virus-free. The sender does not accept liability 
for any errors or omissions.
*******************************************************************
"SAVE PAPER - THINK BEFORE YOU PRINT!"