sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matthieu Labour <matth...@actionx.com>
Subject How does one preprocess the data so that they can be exported using sqoop
Date Fri, 17 May 2013 21:44:03 GMT

I would be grateful for any tips on how to "prepare" the data so they can
be exported to a Postgesql Database using sqoop.

As an example:

Provided some files of events. (user events, product events,
productActivity events)

event:user propertes:{name:"john" ...}
event:product properties:{ref:123,color:"blue",...
event:productActivity properties:{user:"john", product:"ref", action:"buy"}

How does one come up with the primary keys and the user_product join table
ready to be exported?

On other words.

function(Input:eventfile) => output:[productFile, userFile,
user_productFile with auto generated primary keys ]

what goes into function?

I hope this makes sense!

Thank you in advance for any help


View raw message