carbondata-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vimal...@apache.org
Subject [1/2] incubator-carbondata git commit: If the compaction is triggered without data load then compaction is failing. corrected the code.
Date Wed, 07 Sep 2016 16:52:02 GMT
Repository: incubator-carbondata
Updated Branches:
  refs/heads/master f15906973 -> c3597743d


If the compaction is triggered without data load then compaction is failing. corrected the
code.


Project: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/commit/dbf3ef9e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/tree/dbf3ef9e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-carbondata/diff/dbf3ef9e

Branch: refs/heads/master
Commit: dbf3ef9eb111b714b4a8b9dc3d856cc623bd54b1
Parents: f159069
Author: ravikiran <ravikiran.sn042@gmail.com>
Authored: Wed Sep 7 05:08:43 2016 -0700
Committer: Vimal-Das <vimaldas@apache.org>
Committed: Wed Sep 7 22:14:55 2016 +0530

----------------------------------------------------------------------
 .../org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala    | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/incubator-carbondata/blob/dbf3ef9e/integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
----------------------------------------------------------------------
diff --git a/integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
b/integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
index ef2920f..31cc8ac 100644
--- a/integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
+++ b/integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala
@@ -402,7 +402,7 @@ object CarbonDataRDDFactory extends Logging {
       carbonLoadModel.getLoadMetadataDetails
     )
     CarbonDataMergerUtil.sortSegments(sortedSegments)
-    val lastSegment = sortedSegments.get(sortedSegments.size() - 1)
+
     var segList = carbonLoadModel.getLoadMetadataDetails
     var loadsToMerge = CarbonDataMergerUtil.identifySegmentsToBeMerged(
       hdfsStoreLocation,
@@ -413,6 +413,7 @@ object CarbonDataRDDFactory extends Logging {
       compactionModel.compactionType
     )
     while (loadsToMerge.size() > 1) {
+      val lastSegment = sortedSegments.get(sortedSegments.size() - 1)
       deletePartialLoadsInCompaction(carbonLoadModel)
       val futureList: util.List[Future[Void]] = new util.ArrayList[Future[Void]](
         CarbonCommonConstants


Mime
View raw message