Was going to say my goto for this kind of issue is the 'tr' command in
unix, but if I understand right you'd rather not have to preprocess,
instead preferring an in-Drill solution.
As I think you're hinting at, a Drill UDF tailored to the data might
be one way to handle it.
On Mon, Feb 8, 2016 at 10:07 AM, Abdel Hakim Deneche
<adeneche@maprtech.com> wrote:
> is dos2unix an option ?
>
> On Mon, Feb 8, 2016 at 9:56 AM, John Omernik <john@omernik.com> wrote:
>
>> Are there any decent tricks for dealing with Windows based text files (that
>> use /r/n as the line ending rather than just /n)
>>
>> Right now my last field has /r showing up, and I'd like to not have that
>> there, I guess I could regex_replace it maybe? I was hoping for a
>> performant way to handle (Without reprocessing either)
>>
>> John
>>
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
> <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>
|