spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anbutech <>
Subject Spark Write method not ignoring double quotes in the csv file
Date Fri, 12 Jul 2019 03:45:33 GMT
Hello All, Could you please help me to fix the below questions

Question 1:

I have tried the below options while writing the final data in a csv file to
ignore double quotes in the same csv file .nothing is worked. I'm using
spark version 2.2 and scala version 2.11 .

option("quote", "\"")

.option("escape", ":")

.option("escape", "")

.option("quote", "\u0000")










I want to remove double quotes in the csv file while writing spark
there any options available?

Question 2: Is there any way to remove the trailing white spaces in the
fields while reading the parquet file.

Thanks Anbu

Sent from:

To unsubscribe e-mail:

View raw message