spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wilbert S." <wilbertseo...@gmail.com>
Subject Re: Spark Security
Date Mon, 01 Jun 2020 12:20:15 GMT
Hello,

My hard drive has about 80 GB of space left on it, and the RAM is about
12GB.

I am not sure the size of the .tsv file, but it will most likely be around
30 GB.


Thanks,

Wilbert Seoane



On Fri, May 29, 2020 at 5:03 PM Anwar AliKhan <anwaralikhanuae@gmail.com>
wrote:

> What is the size of your .tsv file   sir  ?
> What is the size of your local hard drive   sir  ?
>
>
> Regards
>
>
> Wali Ahaad
>
>
> On Fri, 29 May 2020, 16:21 , <wilbertseoane@gmail.com> wrote:
>
>> Hello,
>>
>> I plan to load in a local .tsv file from my hard drive using sparklyr (an
>> R package). I have figured out how to do this already on small files.
>>
>> When I decide to receive my client’s large .tsv file, can I be confident
>> that loading in data this way will be secure? I know that this creates a
>> Spark connection to help process the data more quickly, but I want to
>> verify that the data will be secure after loading it with the Spark
>> connection and sparklyr.
>>
>>
>> Thanks,
>>
>> Wilbert J. Seoane
>>
>> Sent from iPhone
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>>

Mime
View raw message