spark-dev mailing list archives: August 2016

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
Sean Owen Default date formats in CSV and JSON: see SPARK-16216 Mon, 01 Aug, 14:07
Re: sampling operation for DStream
Martin Le   Re: sampling operation for DStream Mon, 01 Aug, 16:24
Cody Koeninger     Re: sampling operation for DStream Mon, 01 Aug, 16:43
Martin Le       Re: sampling operation for DStream Mon, 01 Aug, 20:22
Cody Koeninger         Re: sampling operation for DStream Mon, 01 Aug, 21:01
Hao Ren [MLlib] Term Frequency in TF-IDF seems incorrect Mon, 01 Aug, 22:29
Yanbo Liang   Re: [MLlib] Term Frequency in TF-IDF seems incorrect Tue, 02 Aug, 03:44
Nick Pentreath     Re: [MLlib] Term Frequency in TF-IDF seems incorrect Tue, 02 Aug, 09:25
Maciej Szymkiewicz What happens in Dataset limit followed by rdd Tue, 02 Aug, 01:08
Sun Rui   Re: What happens in Dataset limit followed by rdd Tue, 02 Aug, 09:57
Maciej Szymkiewicz     Re: What happens in Dataset limit followed by rdd Tue, 02 Aug, 10:51
Sun Rui       Re: What happens in Dataset limit followed by rdd Tue, 02 Aug, 12:12
Maciej Szymkiewicz         Re: What happens in Dataset limit followed by rdd Wed, 03 Aug, 12:04
Re: tpcds for spark2.0
kevin   Re: tpcds for spark2.0 Tue, 02 Aug, 01:49
Re: Testing --supervise flag
Noorul Islam Kamal Malmiyoda   Re: Testing --supervise flag Tue, 02 Aug, 12:07
Ulanov, Alexander Graph edge type pattern matching in GraphX Tue, 02 Aug, 12:29
Bryan Cutler AccumulatorV2 += operator Tue, 02 Aug, 20:46
Holden Karau   Re: AccumulatorV2 += operator Tue, 02 Aug, 21:52
Bryan Cutler     Re: AccumulatorV2 += operator Wed, 03 Aug, 15:05
Holden Karau       Re: AccumulatorV2 += operator Wed, 03 Aug, 17:02
马晓宇 SQL Based Authorization for SparkSQL Wed, 03 Aug, 01:40
Ted Yu   Re: SQL Based Authorization for SparkSQL Wed, 03 Aug, 04:00
satyajit vegesna Spark on yarn, only 1 or 2 vcores getting allocated to the containers getting created. Wed, 03 Aug, 04:11
Saisai Shao   Re: Spark on yarn, only 1 or 2 vcores getting allocated to the containers getting created. Wed, 03 Aug, 07:53
Olivier Girardot Spark SQL and Kryo registration Wed, 03 Aug, 08:49
Jacek Laskowski   Re: Spark SQL and Kryo registration Thu, 04 Aug, 15:14
Amit Sela     Re: Spark SQL and Kryo registration Thu, 04 Aug, 15:41
Maciej Bryński       Re: Spark SQL and Kryo registration Fri, 05 Aug, 08:07
Olivier Girardot         Re: Spark SQL and Kryo registration Thu, 18 Aug, 06:16
Soumitra Johri How does MapWithStateRDD distribute the data Wed, 03 Aug, 14:42
Cody Koeninger   Re: How does MapWithStateRDD distribute the data Wed, 03 Aug, 16:34
Tao Li Quick question about hive-exec 1.2.1.spark2 Wed, 03 Aug, 22:30
Fred Reiss Source API requires unbounded distributed storage? Thu, 04 Aug, 23:38
Michael Armbrust   Re: Source API requires unbounded distributed storage? Thu, 04 Aug, 23:52
Fred Reiss     Re: Source API requires unbounded distributed storage? Tue, 09 Aug, 02:24
Hyukjin Kwon Inquery about Spark's behaviour for configurations in Hadoop configuration instance via read/write.options() Fri, 05 Aug, 01:26
Sean Owen We don't use ASF Jenkins builds, right? Fri, 05 Aug, 04:15
Reynold Xin   Re: We don't use ASF Jenkins builds, right? Fri, 05 Aug, 04:19
Nicholas Chammas PySpark: Make persist() return a context manager Fri, 05 Aug, 04:56
Reynold Xin   Re: PySpark: Make persist() return a context manager Fri, 05 Aug, 06:08
Nicholas Chammas     Re: PySpark: Make persist() return a context manager Fri, 05 Aug, 17:44
Koert Kuipers       Re: PySpark: Make persist() return a context manager Fri, 05 Aug, 22:50
Nicholas Chammas         Re: PySpark: Make persist() return a context manager Fri, 05 Aug, 23:04
Koert Kuipers           Re: PySpark: Make persist() return a context manager Sat, 06 Aug, 03:28
Maciej Bryński Result code of whole stage codegen Fri, 05 Aug, 07:55
Herman van Hövell tot Westerflier   Re: Result code of whole stage codegen Fri, 05 Aug, 08:06
Maciej Bryński     Re: Result code of whole stage codegen Fri, 05 Aug, 08:18
jpivar...@gmail.com Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 19:40
Holden Karau   Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 19:43
Jeremy Smith     Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 20:14
Jim Pivarski     Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 21:18
Holden Karau       Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 21:22
Nicholas Chammas         Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 22:14
Jim Pivarski           Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 22:53
Nicholas Chammas             Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Fri, 05 Aug, 23:07
Micah Kornfield               Re: Apache Arrow data in buffer to RDD/DataFrame/Dataset? Sat, 06 Aug, 03:17
Ruslan Dautkhanov Spark requires sysctl tuning? Servers unresponsive Sat, 06 Aug, 06:29
Hao Ren [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Sun, 07 Aug, 21:31
Hao Ren   Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 08:02
Simon Scott     RE: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 12:16
Reynold Xin       Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 20:00
Hao Ren         Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 21:05
Reynold Xin           Re: [SPARK-2.0][SQL] UDF containing non-serializable object does not work as expected Mon, 08 Aug, 22:02
r7raul1...@163.com Kafka Support new topic subscriptions without requiring restart of the streaming context Mon, 08 Aug, 06:12
Cody Koeninger   Re: Kafka Support new topic subscriptions without requiring restart of the streaming context Mon, 08 Aug, 13:20
ekass Spark 2.0 sql module empty columns in result over parquet tables Mon, 08 Aug, 11:14
Matei Zaharia Welcoming Felix Cheung as a committer Mon, 08 Aug, 18:15
Ted Yu   Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 18:15
Dongjoon Hyun     Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 18:17
Nicholas Chammas       Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 18:45
Suresh Thalamati     Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 18:57
Timothy Chen   Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 19:27
Tarun Kumar     Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 19:28
dhruve ashar       Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 21:57
Herman van Hövell tot Westerflier         Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 22:04
Xiao Li           Re: Welcoming Felix Cheung as a committer Mon, 08 Aug, 22:47
Hyukjin Kwon             Re: Welcoming Felix Cheung as a committer Tue, 09 Aug, 00:49
Jeff Zhang               Re: Welcoming Felix Cheung as a committer Tue, 09 Aug, 01:14
Kai Jiang                 Re: Welcoming Felix Cheung as a committer Tue, 09 Aug, 01:21
Yanbo Liang                   Re: Welcoming Felix Cheung as a committer Tue, 09 Aug, 02:41
Felix Cheung                     Re: Welcoming Felix Cheung as a committer Tue, 09 Aug, 04:44
Denny Lee                       Re: Welcoming Felix Cheung as a committer Tue, 09 Aug, 05:53
SURESH CHAGANTI   Re: Welcoming Felix Cheung as a committer Fri, 12 Aug, 17:54
Jacek Laskowski   Re: Welcoming Felix Cheung as a committer Sat, 13 Aug, 01:45
Paul Roy   Re: Welcoming Felix Cheung as a committer Mon, 15 Aug, 09:27
mayur bhole     Re: Welcoming Felix Cheung as a committer Mon, 15 Aug, 13:16
Joseph Bradley       Re: Welcoming Felix Cheung as a committer Tue, 16 Aug, 22:51
Michael Allman Scaling partitioned Hive table support Mon, 08 Aug, 18:53
Eric Liang   Re: Scaling partitioned Hive table support Mon, 08 Aug, 19:51
Michael Allman     Re: Scaling partitioned Hive table support Mon, 08 Aug, 21:01
Michael Allman     Re: Scaling partitioned Hive table support Tue, 09 Aug, 18:20
Michael Gummelt SASL Support Mon, 08 Aug, 22:48
Reynold Xin   Re: SASL Support Mon, 08 Aug, 22:49
Re: Spark 2.0.1 / 2.1.0 on Maven
Chris Fregly   Re: Spark 2.0.1 / 2.1.0 on Maven Tue, 09 Aug, 18:52
Jacek Laskowski     Re: Spark 2.0.1 / 2.1.0 on Maven Mon, 15 Aug, 01:11
Sean Owen       Re: Spark 2.0.1 / 2.1.0 on Maven Mon, 15 Aug, 08:08
Steve Loughran         Re: Spark 2.0.1 / 2.1.0 on Maven Mon, 15 Aug, 10:10
Jacek Laskowski         Re: Spark 2.0.1 / 2.1.0 on Maven Tue, 16 Aug, 00:41
Minudika Malshan Get data from CSV files to feed SparkML library methods Wed, 10 Aug, 11:16
Yanbo Liang   Re: Get data from CSV files to feed SparkML library methods Wed, 10 Aug, 13:39
Minudika Malshan     Re: Get data from CSV files to feed SparkML library methods Wed, 10 Aug, 14:58
Deepak Sharma Use cases around image/video processing in spark Wed, 10 Aug, 15:20
Benjamin Fradet   Re: Use cases around image/video processing in spark Wed, 10 Aug, 16:27
Nicholas Chammas Serving Spark ML models via a regular Python web app Thu, 11 Aug, 02:50
Michael Allman   Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 04:28
Nick Pentreath     Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 07:01
Nicholas Chammas       Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 14:42
Chris Fregly         Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 16:35
Chris Fregly           Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 16:42
Nicholas Chammas             Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 17:53
Michael Allman             Re: Serving Spark ML models via a regular Python web app Thu, 11 Aug, 17:58
Jason Moore Sorting within partitions is not maintained in parquet? Thu, 11 Aug, 06:23
Hyukjin Kwon   Re: Sorting within partitions is not maintained in parquet? Thu, 11 Aug, 11:27
Michael Armbrust     Re: Sorting within partitions is not maintained in parquet? Thu, 11 Aug, 18:54
Sean Owen Who controls 'databricks-jenkins'? Thu, 11 Aug, 08:54
mikhainin Spark hangs after OOM in Serializer Mon, 15 Aug, 13:39
Minudika Malshan How to resolve the SparkExecption : Size exceeds Integer.MAX_VALUE Mon, 15 Aug, 16:46
Ewan Leith   Re: How to resolve the SparkExecption : Size exceeds Integer.MAX_VALUE Mon, 15 Aug, 19:04
Rachana Srivastava Number of tasks on executors become negative after executor failures Mon, 15 Aug, 19:13
Guo, Chenzhao Structured Streaming with Kafka sources/sinks Tue, 16 Aug, 02:12
Cody Koeninger   Re: Structured Streaming with Kafka sources/sinks Tue, 16 Aug, 02:26
Reynold Xin     Re: Structured Streaming with Kafka sources/sinks Tue, 16 Aug, 06:04
Koert Kuipers       Re: Structured Streaming with Kafka sources/sinks Sat, 27 Aug, 21:32
Fred Reiss         Re: Structured Streaming with Kafka sources/sinks Mon, 29 Aug, 19:39
Ofir Manor           Re: Structured Streaming with Kafka sources/sinks Tue, 30 Aug, 06:56
Cody Koeninger             Re: Structured Streaming with Kafka sources/sinks Tue, 30 Aug, 15:09
Nicholas Chammas               Re: Structured Streaming with Kafka sources/sinks Tue, 30 Aug, 15:44
Reynold Xin                 Re: Structured Streaming with Kafka sources/sinks Tue, 30 Aug, 16:02
Cody Koeninger                   Re: Structured Streaming with Kafka sources/sinks Tue, 30 Aug, 16:12
Niranda Perera Resultant RDD after a group by query always returns 200 partitions Tue, 16 Aug, 06:01
Rishi Mishra   Re: Resultant RDD after a group by query always returns 200 partitions Tue, 16 Aug, 08:47
colzer   Re: Resultant RDD after a group by query always returns 200 partitions Tue, 16 Aug, 10:14
Niranda Perera Executors go OOM when using JDBC relation provider Tue, 16 Aug, 13:26
Tim Hunter GraphFrames 0.2.0 released Tue, 16 Aug, 16:32
Shagun Sodhani   Re: GraphFrames 0.2.0 released Tue, 16 Aug, 17:13
Jacek Laskowski   Re: GraphFrames 0.2.0 released Wed, 17 Aug, 01:18
Maciej Bryński     Re: GraphFrames 0.2.0 released Wed, 24 Aug, 17:11
Joseph Bradley       Re: GraphFrames 0.2.0 released Sat, 27 Aug, 00:10
Jacek Laskowski [master] ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists) Wed, 17 Aug, 02:33
Yin Huai   Re: [master] ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists) Wed, 17 Aug, 05:51
Jacek Laskowski     Re: [master] ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists) Wed, 17 Aug, 06:06
Yin Huai       Re: [master] ERROR RetryingHMSHandler: AlreadyExistsException(message:Database default already exists) Wed, 17 Aug, 14:46
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Dec 2019113
Nov 2019215
Oct 2019229
Sep 2019241
Aug 2019236
Jul 2019138
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333