hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Purtell <apurt...@apache.org>
Subject Re: Multi-family support for Bulkload
Date Tue, 28 Jun 2011 02:00:30 GMT
> From: "Gan, Xiyun" <ganxiyun@gmail.com>

> I still have another question, how to remove the partitions_$timpstamp
> files produced in the HFileOutputFormat?

One option is to accept a configuration option for the partitions file:

-    Path partitionsPath = new Path(job.getWorkingDirectory(),
-        "partitions_" + System.currentTimeMillis());
+    Path partitionsPath = new Path(job.getConfiguration()
+        .get("hbase.hfileoutputformat.partitions.file", 
+          "partitions_" + System.currentTimeMillis()));

Then you can configure the job with a path you know, and use the path to delete the file after
the job completes.

  - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)

View raw message