spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vaquar khan <vaquar.k...@gmail.com>
Subject Re: Writing to Google Cloud Storage with v2 algorithm safe?
Date Sun, 04 Apr 2021 05:27:39 GMT
Hi Jecek ,

I have answered , hope you find it useful.

Regards,
Viquar khan

On Sat, Apr 3, 2021 at 11:19 AM Jacek Laskowski <jacek@japila.pl> wrote:

> Hi,
>
> I've just posted a question on StackOverflow [1] about the safety of the
> v2 algorithm while writing out to Google Cloud Storage. I think I'm missing
> some fundamentals on how cloud object stores work (GCS in particular) and
> hence the question.
>
> Is this all about File.rename and how many HTTP calls are there under the
> covers? How to know it for GCS?
>
> Thank you for any help you can provide. Merci beaucoup mes amis :)
>
> [1] https://stackoverflow.com/q/66933229/1305344
>
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski
> "The Internals Of" Online Books <https://books.japila.pl/>
> Follow me on https://twitter.com/jaceklaskowski
>
> <https://twitter.com/jaceklaskowski>
>


-- 
Regards,
Vaquar Khan
+1 -224-436-0783
Greater Chicago

Mime
View raw message