drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From John Omernik <j...@omernik.com>
Subject Re: Dealing with files created in Windows
Date Mon, 08 Feb 2016 18:22:38 GMT
No, I do not want to reprocess files. I am sorry for bluntness, but this
seems like something that shouldn't require Drill to require an outside ETL
process to prune the files. (The data I have is large, and it just seems
like a process prone to failure).



On Mon, Feb 8, 2016 at 12:07 PM, Abdel Hakim Deneche <adeneche@maprtech.com>
wrote:

> is dos2unix an option ?
>
> On Mon, Feb 8, 2016 at 9:56 AM, John Omernik <john@omernik.com> wrote:
>
> > Are there any decent tricks for dealing with Windows based text files
> (that
> > use /r/n as the line ending rather than just /n)
> >
> > Right now my last field has /r showing up, and I'd like to not have that
> > there, I guess I could regex_replace it maybe? I was hoping for a
> > performant way to handle (Without reprocessing either)
> >
> > John
> >
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
>   <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message