drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chun Chang (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-5617) spill filename conflict
Date Wed, 28 Jun 2017 23:29:00 GMT
Chun Chang created DRILL-5617:
---------------------------------

             Summary: spill filename conflict
                 Key: DRILL-5617
                 URL: https://issues.apache.org/jira/browse/DRILL-5617
             Project: Apache Drill
          Issue Type: Bug
          Components: Functions - Drill
    Affects Versions: 1.11.0
            Reporter: Chun Chang
            Assignee: Boaz Ben-Zvi


Spill location can be configured to be written on hdfs such as:

  hashagg: {
    # The partitions divide the work inside the hashagg, to ease
    # handling spilling. This initial figure is tuned down when
    # memory is limited.
    #  Setting this option to 1 disables spilling !
    num_partitions: 32,
    spill: {
        # The 2 options below override the common ones
        # they should be deprecated in the future
        directories : [ "/tmp/drill/spill" ],
        fs : "maprfs:///"
     }
  }

However, this could cause spill filename conflict since name convention does not contain node
name.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message