spark-user mailing list archives: June 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
nishanthps Hive Custom Transform Scripts (read from stdin and print to stdout) in Spark Wed, 10 Jun, 21:02
Re: How to set KryoRegistrator class in spark-shell
bhomass   Re: How to set KryoRegistrator class in spark-shell Wed, 10 Jun, 22:16
Igor Berman     Re: How to set KryoRegistrator class in spark-shell Thu, 11 Jun, 12:30
Eugen Cepoi       Re: How to set KryoRegistrator class in spark-shell Thu, 11 Jun, 12:33
barmaley Can't access Ganglia on EC2 Spark cluster Wed, 10 Jun, 22:16
Akhil Das   Re: Can't access Ganglia on EC2 Spark cluster Thu, 11 Jun, 05:43
Justin Yip NullPointerException with functions.rand() Thu, 11 Jun, 01:15
Ted Yu   Re: NullPointerException with functions.rand() Thu, 11 Jun, 02:15
Ted Yu     Re: NullPointerException with functions.rand() Fri, 12 Jun, 23:02
how to deal with continued records
Zhang Jiaqiang   how to deal with continued records Thu, 11 Jun, 06:58
wushuzh   how to deal with continued records Thu, 11 Jun, 07:09
Sonal Goyal     Re: how to deal with continued records Thu, 11 Jun, 08:33
luohui20...@sina.com How many APPs does spark support to running simultaneously in one cluster? Thu, 11 Jun, 07:33
luohui20...@sina.com How many APPs does spark support to run simultaneously in one cluster? Thu, 11 Jun, 07:52
amit tewari How to run scala script in Datastax Spark distribution? Thu, 11 Jun, 09:02
[No Subject]
Wangfei (X)   [No Subject] Thu, 11 Jun, 09:33
Wangfei (X)     spark sql insert into table performance issue Thu, 11 Jun, 09:34
Nipun Arora   [No Subject] Thu, 18 Jun, 02:48
Silvio Fiorito     Re: Thu, 18 Jun, 02:52
ÐΞ...@Ҝ (๏̯͡๏)   [No Subject] Wed, 24 Jun, 00:16
Akhil Das     Re: Wed, 24 Jun, 14:16
ÐΞ...@Ҝ (๏̯͡๏)       Re: Wed, 24 Jun, 17:31
ÐΞ...@Ҝ (๏̯͡๏)         Re: Wed, 24 Jun, 17:34
ÐΞ...@Ҝ (๏̯͡๏)           Re: Wed, 24 Jun, 17:45
ÐΞ...@Ҝ (๏̯͡๏)             Re: Wed, 24 Jun, 18:13
Akhil Das               Re: Wed, 24 Jun, 18:39
ÐΞ...@Ҝ (๏̯͡๏)                 Re: Wed, 24 Jun, 18:49
Akhil Das                   Re: Thu, 25 Jun, 07:06
ÐΞ...@Ҝ (๏̯͡๏)                     Re: Thu, 25 Jun, 19:10
Akhil Das                       Re: Fri, 26 Jun, 06:28
Re: Is there a way to limit the sql query result size?
neeravsalaria   Re: Is there a way to limit the sql query result size? Thu, 11 Jun, 09:50
hbogert Spark on Mesos fine-grained - has one core less per executor Thu, 11 Jun, 11:47
唐思成   spark stream and spark sql with data warehouse Thu, 11 Jun, 14:47
Yi Tian     Re: spark stream and spark sql with data warehouse Thu, 11 Jun, 16:03
Akhil Das     Re: spark stream and spark sql with data warehouse Fri, 12 Jun, 18:57
gaurav sharma How to pass arguments dynamically, that needs to be used in executors Thu, 11 Jun, 12:23
Todd Nist   Re: How to pass arguments dynamically, that needs to be used in executors Thu, 11 Jun, 13:12
gaurav sharma     Re: How to pass arguments dynamically, that needs to be used in executors Fri, 12 Jun, 14:38
John Omernik Reopen Jira or New Jira Thu, 11 Jun, 12:34
Yana Kadiyska   Re: Reopen Jira or New Jira Thu, 11 Jun, 13:25
davidkl ClassCastException: BlockManagerId cannot be cast to [B Thu, 11 Jun, 12:55
davidkl   Re: ClassCastException: BlockManagerId cannot be cast to [B Fri, 12 Jun, 16:35
SLiZn Liu Reading Really Big File Stream from HDFS Thu, 11 Jun, 13:07
ayan guha   Re: Reading Really Big File Stream from HDFS Thu, 11 Jun, 13:27
SLiZn Liu     Re: Reading Really Big File Stream from HDFS Fri, 12 Jun, 05:19
Saisai Shao       Re: Reading Really Big File Stream from HDFS Fri, 12 Jun, 07:23
shahab Reading file from S3, facing java.lang.NoClassDefFoundError: org/jets3t/service/ServiceException Thu, 11 Jun, 13:14
Akhil Das   Re: Reading file from S3, facing java.lang.NoClassDefFoundError: org/jets3t/service/ServiceException Fri, 12 Jun, 18:50
shahab     Re: Reading file from S3, facing java.lang.NoClassDefFoundError: org/jets3t/service/ServiceException Mon, 15 Jun, 10:43
diplomatic Guru Could Spark batch processing live within Spark Streaming? Thu, 11 Jun, 13:24
prajod.vettiyat...@wipro.com   RE: Could Spark batch processing live within Spark Streaming? Fri, 12 Jun, 06:32
matthewrj How to deal with an explosive flatmap Thu, 11 Jun, 14:57
Sanjay Subramanian   spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Thu, 11 Jun, 15:43
Josh Rosen     Re: spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Fri, 12 Jun, 14:13
Josh Rosen     Re: spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Fri, 12 Jun, 14:15
Sanjay Subramanian       Re: spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Sun, 14 Jun, 00:08
Josh Rosen         Re: spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Sun, 14 Jun, 00:38
Sanjay Subramanian           Re: spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Tue, 16 Jun, 16:12
Sanjay Subramanian             spark-sql CLI options does not work --master yarn --deploy-mode client Tue, 16 Jun, 21:24
Sanjay Subramanian     Re: spark-sql from CLI --->EXCEPTION: java.lang.OutOfMemoryError: Java heap space Thu, 18 Jun, 02:05
Ted Yu   Re: How to deal with an explosive flatmap Thu, 11 Jun, 16:23
Mark Tse ReduceByKey with a byte array as the key Thu, 11 Jun, 15:57
Sonal Goyal   Re: ReduceByKey with a byte array as the key Thu, 11 Jun, 16:58
Mark Tse     RE: ReduceByKey with a byte array as the key Thu, 11 Jun, 17:08
Aaron Davidson       RE: ReduceByKey with a byte array as the key Thu, 11 Jun, 17:13
Re: Running Spark in Local Mode
mrm   Re: Running Spark in Local Mode Thu, 11 Jun, 16:03
Patrick Wendell [ANNOUNCE] Announcing Spark 1.4 Thu, 11 Jun, 16:05
Al M Limit Spark Shuffle Disk Usage Thu, 11 Jun, 16:16
Akhil Das   Re: Limit Spark Shuffle Disk Usage Fri, 12 Jun, 19:03
rahulkumar-aws   Re: Limit Spark Shuffle Disk Usage Mon, 15 Jun, 22:58
Himanshu Mehra   Re: Limit Spark Shuffle Disk Usage Tue, 16 Jun, 09:49
Al M     Re: Limit Spark Shuffle Disk Usage Wed, 17 Jun, 07:24
barmaley takeSample() results in two stages Thu, 11 Jun, 16:43
Imran Rashid   Re: takeSample() results in two stages Fri, 12 Jun, 19:23
Tom Hubregtsen DataFrames for non-SQL computation? Thu, 11 Jun, 17:08
Michael Armbrust   Re: DataFrames for non-SQL computation? Thu, 11 Jun, 19:59
Re: spark-1.2.0--standalone-ha-zookeeper
scar0909   Re: spark-1.2.0--standalone-ha-zookeeper Thu, 11 Jun, 17:23
Re: Shutdown with streaming driver running in cluster broke master web UI permanently
scar0909   Re: Shutdown with streaming driver running in cluster broke master web UI permanently Thu, 11 Jun, 18:24
Tathagata Das     Re: Shutdown with streaming driver running in cluster broke master web UI permanently Fri, 12 Jun, 00:59
scar scar       Re: Shutdown with streaming driver running in cluster broke master web UI permanently Mon, 22 Jun, 15:54
Tathagata Das         Re: Shutdown with streaming driver running in cluster broke master web UI permanently Tue, 23 Jun, 07:00
scar scar           Re: Shutdown with streaming driver running in cluster broke master web UI permanently Tue, 23 Jun, 14:04
Crystal Xing Spark distinct() returns incorrect results for some types? Thu, 11 Jun, 18:36
Sean Owen   Re: Spark distinct() returns incorrect results for some types? Thu, 11 Jun, 18:44
Crystal Xing     Re: Spark distinct() returns incorrect results for some types? Thu, 11 Jun, 18:54
Sean Owen       Re: Spark distinct() returns incorrect results for some types? Thu, 11 Jun, 19:17
Will Briggs   Re: Spark distinct() returns incorrect results for some types? Thu, 11 Jun, 19:21
Crystal Xing     Re: Spark distinct() returns incorrect results for some types? Thu, 11 Jun, 20:14
Gary Ogden how to use a properties file from a url in spark-submit Thu, 11 Jun, 19:48
Marcelo Vanzin   Re: how to use a properties file from a url in spark-submit Thu, 11 Jun, 19:52
Matthew Jones     Re: how to use a properties file from a url in spark-submit Fri, 12 Jun, 01:17
Gary Ogden       Re: how to use a properties file from a url in spark-submit Fri, 12 Jun, 16:32
Matthew Jones         Re: how to use a properties file from a url in spark-submit Fri, 12 Jun, 17:20
Gary Ogden           Re: how to use a properties file from a url in spark-submit Fri, 12 Jun, 18:49
Wang, Ningjun (LNG-NPV) How to set spark master URL to contain domain name? Thu, 11 Jun, 20:01
prajod.vettiyat...@wipro.com   RE: How to set spark master URL to contain domain name? Fri, 12 Jun, 05:43
Wang, Ningjun (LNG-NPV)     RE: How to set spark master URL to contain domain name? Fri, 12 Jun, 14:42
Re: UDF accessing hive struct array fails with buffer underflow from kryo
Yutong Luo   Re: UDF accessing hive struct array fails with buffer underflow from kryo Thu, 11 Jun, 21:25
Siegfried Bilstein Deleting HDFS files from Pyspark Thu, 11 Jun, 22:56
ayan guha   Re: Deleting HDFS files from Pyspark Fri, 12 Jun, 01:06
Ruslan Dautkhanov Does MLLib has attribute importance? Thu, 11 Jun, 23:33
Xiangrui Meng   Re: Does MLLib has attribute importance? Wed, 17 Jun, 23:50
Ruslan Dautkhanov     Re: Does MLLib has attribute importance? Thu, 18 Jun, 05:22
Xiangrui Meng       Re: Does MLLib has attribute importance? Thu, 18 Jun, 19:02
Ruslan Dautkhanov         Re: Does MLLib has attribute importance? Thu, 18 Jun, 21:07
Debasish Das     Re: Does MLLib has attribute importance? Fri, 19 Jun, 02:04
Elkhan Dadashov Is it possible to see Spark jobs on MapReduce job history ? (running Spark on YARN cluster) Fri, 12 Jun, 02:01
Steve Loughran   Re: Is it possible to see Spark jobs on MapReduce job history ? (running Spark on YARN cluster) Fri, 12 Jun, 13:19
foobar Spark Streaming reads from stdin or output from command line utility Fri, 12 Jun, 02:25
Tathagata Das   Re: Spark Streaming reads from stdin or output from command line utility Fri, 12 Jun, 03:11
Heath Guo     Re: Spark Streaming reads from stdin or output from command line utility Fri, 12 Jun, 04:56
Tathagata Das       Re: Spark Streaming reads from stdin or output from command line utility Fri, 12 Jun, 06:43
Heath Guo         Re: Spark Streaming reads from stdin or output from command line utility Fri, 12 Jun, 06:46
Gerard Maas           Re: Spark Streaming reads from stdin or output from command line utility Fri, 12 Jun, 07:21
Re: SparkSQL JDBC Datasources API when running on YARN - Spark 1.3.0
Sathish Kumaran Vairavelu   Re: SparkSQL JDBC Datasources API when running on YARN - Spark 1.3.0 Fri, 12 Jun, 02:28
Daniel Mahler Error using json4s with Apache Spark in spark-shell Fri, 12 Jun, 04:08
Amit Ramesh Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 04:36
Saisai Shao   Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 05:02
Amit Ramesh     Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 05:48
Saisai Shao       Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 05:54
Amit Ramesh         Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 05:59
Saisai Shao           Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 06:05
Cody Koeninger             Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 13:59
Juan Rodríguez Hortalá               Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Fri, 12 Jun, 22:17
Amit Ramesh                 Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Sat, 13 Jun, 00:23
Juan Rodríguez Hortalá                   Re: Spark 1.4: Python API for getting Kafka offsets in direct mode? Sat, 13 Jun, 08:18
Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows.
Cheng Lian   Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Fri, 12 Jun, 07:25
Chaudhary, Umesh Optimizing Streaming from Websphere MQ Fri, 12 Jun, 07:28
Akhil Das   Re: Optimizing Streaming from Websphere MQ Fri, 12 Jun, 19:39
Chaudhary, Umesh     RE: Optimizing Streaming from Websphere MQ Mon, 15 Jun, 09:10
Akhil Das       Re: Optimizing Streaming from Websphere MQ Tue, 16 Jun, 07:14
Chaudhary, Umesh         RE: Optimizing Streaming from Websphere MQ Tue, 16 Jun, 13:35
Re: 回复: Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows.
Cheng Lian   Re: 回复: Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Fri, 12 Jun, 07:51
Cheng, Hao     RE: 回复: Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Fri, 12 Jun, 08:17
Cheng, Hao     RE: 回复: Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Fri, 12 Jun, 08:17
Cheng Lian       Re: 回复: Re: 回复: Re: 回复: Re: 回复: Re: Met OOM when fetching more than 1,000,000 rows. Fri, 12 Jun, 08:34
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · Next »Thread · Author · Date
Box list
Dec 202113
Nov 2021153
Oct 202194
Sep 2021126
Aug 2021171
Jul 2021158
Jun 2021179
May 2021187
Apr 2021267
Mar 2021346
Feb 2021166
Jan 2021242
Dec 2020203
Nov 2020147
Oct 2020236
Sep 2020136
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137