spark-dev mailing list archives: January 2017

Site index · List index
Message list1 · 2 · 3 · Next »Thread · Author · Date
khyati Task not Serializable Exception Sun, 01 Jan, 04:06
Prashant Sharma   Re: Task not Serializable Exception Mon, 02 Jan, 11:15
khyati Skip Corrupted Parquet blocks / footer. Sun, 01 Jan, 04:11
Abhishek   Re: Skip Corrupted Parquet blocks / footer. Sun, 01 Jan, 19:16
Reynold Xin   Re: Skip Corrupted Parquet blocks / footer. Sun, 01 Jan, 22:49
khyati     Re: Skip Corrupted Parquet blocks / footer. Tue, 03 Jan, 19:03
Ryan Blue       Re: Skip Corrupted Parquet blocks / footer. Tue, 03 Jan, 20:13
khyati         Re: Skip Corrupted Parquet blocks / footer. Wed, 04 Jan, 01:06
Liang-Chi Hsieh       Re: Skip Corrupted Parquet blocks / footer. Wed, 04 Jan, 08:06
Liang-Chi Hsieh         Re: Skip Corrupted Parquet blocks / footer. Wed, 04 Jan, 08:12
Liang-Chi Hsieh       Re: Skip Corrupted Parquet blocks / footer. Thu, 05 Jan, 05:11
khyati.shah   Re: Skip Corrupted Parquet blocks / footer. Wed, 04 Jan, 00:52
khyati     Re: Skip Corrupted Parquet blocks / footer. Wed, 04 Jan, 02:46
Re: context.runJob() was suspended in getPreferredLocations() function
Liang-Chi Hsieh   Re: context.runJob() was suspended in getPreferredLocations() function Sun, 01 Jan, 12:34
Re: Kafka Spark structured streaming latency benchmark.
Prashant Sharma   Re: Kafka Spark structured streaming latency benchmark. Mon, 02 Jan, 11:19
Dino Cannot pass broker list parameter from Scala to Kafka: Property bootstrap.servers is not valid Mon, 02 Jan, 11:49
Re: Spark Improvement Proposals
Cody Koeninger   Re: Spark Improvement Proposals Mon, 02 Jan, 15:45
Joseph Bradley     Re: Spark Improvement Proposals Tue, 03 Jan, 21:30
Imran Rashid       Re: Spark Improvement Proposals Tue, 03 Jan, 22:08
Cody Koeninger         Re: Spark Improvement Proposals Tue, 03 Jan, 23:16
Tim Hunter           Re: Spark Improvement Proposals Thu, 05 Jan, 23:29
Reynold Xin             Re: Spark Improvement Proposals Wed, 11 Jan, 09:13
Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized?
Shuai Lin   Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized? Mon, 02 Jan, 17:30
Jacek Laskowski     Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized? Tue, 03 Jan, 12:55
Herman van Hövell tot Westerflier       Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized? Tue, 03 Jan, 14:06
Jacek Laskowski         Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized? Tue, 03 Jan, 14:27
Liang-Chi Hsieh   Re: What is mainly different from a UDT and a spark internal type that ExpressionEncoder recognized? Wed, 04 Jan, 07:21
Re: mllib metrics vs ml evaluators and how to improve apis for users
Joseph Bradley   Re: mllib metrics vs ml evaluators and how to improve apis for users Mon, 02 Jan, 20:28
Jeremy Smith StateStoreSaveExec / StateStoreRestoreExec Mon, 02 Jan, 22:05
Michael Armbrust   Re: StateStoreSaveExec / StateStoreRestoreExec Tue, 03 Jan, 23:36
Michael Armbrust     Re: StateStoreSaveExec / StateStoreRestoreExec Tue, 03 Jan, 23:39
Jacek Laskowski Why ShuffleMapTask has transient locs and preferredLocs?! Tue, 03 Jan, 11:27
Imran Rashid   Re: Why ShuffleMapTask has transient locs and preferredLocs?! Tue, 03 Jan, 21:08
Jacek Laskowski     Re: Why ShuffleMapTask has transient locs and preferredLocs?! Wed, 04 Jan, 09:12
Re: Apache Hive with Spark Configuration
Ryan Blue   Re: Apache Hive with Spark Configuration Tue, 03 Jan, 20:32
Chetan Khatri     Re: Apache Hive with Spark Configuration Wed, 04 Jan, 09:35
dstuck DataFrame Distinct Sample Bug? Tue, 03 Jan, 23:15
Reynold Xin   Re: DataFrame Distinct Sample Bug? Wed, 04 Jan, 01:34
Re: Why is spark.shuffle.sort.bypassMergeThreshold 200?
Kay Ousterhout   Re: Why is spark.shuffle.sort.bypassMergeThreshold 200? Wed, 04 Jan, 00:15
Kay Ousterhout Tests failing with GC limit exceeded Wed, 04 Jan, 00:35
shane knapp   Re: Tests failing with GC limit exceeded Wed, 04 Jan, 02:49
shane knapp     Re: Tests failing with GC limit exceeded Wed, 04 Jan, 21:22
shane knapp       Re: Tests failing with GC limit exceeded Thu, 05 Jan, 21:19
Kay Ousterhout         Re: Tests failing with GC limit exceeded Thu, 05 Jan, 23:02
Marcelo Vanzin         Re: Tests failing with GC limit exceeded Fri, 06 Jan, 00:38
Kay Ousterhout           Re: Tests failing with GC limit exceeded Fri, 06 Jan, 00:58
Marcelo Vanzin             Re: Tests failing with GC limit exceeded Fri, 06 Jan, 01:02
shane knapp               Re: Tests failing with GC limit exceeded Fri, 06 Jan, 05:00
shane knapp                 Re: Tests failing with GC limit exceeded Fri, 06 Jan, 20:20
shane knapp                   Re: Tests failing with GC limit exceeded Fri, 06 Jan, 20:22
shane knapp                     Re: Tests failing with GC limit exceeded Fri, 06 Jan, 21:06
shane knapp                       Re: Tests failing with GC limit exceeded Tue, 10 Jan, 18:44
Re: ml word2vec finSynonyms return type
Asher Krim   Re: ml word2vec finSynonyms return type Wed, 04 Jan, 07:58
Felix Cheung   Re: ml word2vec finSynonyms return type Thu, 05 Jan, 20:44
Joseph Bradley     Re: ml word2vec finSynonyms return type Thu, 05 Jan, 22:33
Asher Krim       Re: ml word2vec finSynonyms return type Fri, 06 Jan, 09:03
Re: Dependency Injection and Microservice development with Spark
Chetan Khatri   Re: Dependency Injection and Microservice development with Spark Wed, 04 Jan, 11:34
Jiří Syrový   Re: Dependency Injection and Microservice development with Spark Wed, 04 Jan, 12:06
darren   Re: Dependency Injection and Microservice development with Spark Wed, 04 Jan, 15:08
Re: Approach: Incremental data load from HBASE
Chetan Khatri   Re: Approach: Incremental data load from HBASE Wed, 04 Jan, 11:37
ayan guha     Re: Approach: Incremental data load from HBASE Wed, 04 Jan, 20:32
Chetan Khatri       Re: Approach: Incremental data load from HBASE Fri, 06 Jan, 08:22
ayan guha         Re: Approach: Incremental data load from HBASE Fri, 06 Jan, 09:53
Chetan Khatri           Re: Approach: Incremental data load from HBASE Fri, 06 Jan, 11:07
Sean Owen Quick request: prolific PR openers, review your open PRs Wed, 04 Jan, 12:35
Liang-Chi Hsieh   Re: Quick request: prolific PR openers, review your open PRs Wed, 04 Jan, 12:57
Hyukjin Kwon     Re: Quick request: prolific PR openers, review your open PRs Thu, 05 Jan, 00:35
Kazuaki Ishizaki   Re: Quick request: prolific PR openers, review your open PRs Sun, 08 Jan, 13:01
Takeshi Yamamuro     Re: Quick request: prolific PR openers, review your open PRs Sun, 08 Jan, 13:05
Jacek Laskowski   Re: Quick request: prolific PR openers, review your open PRs Sun, 08 Jan, 14:41
geoHeil Clarification about typesafe aggregations Wed, 04 Jan, 15:19
Reynold Xin   Re: Clarification about typesafe aggregations Wed, 04 Jan, 22:36
geoHeil     Re: Clarification about typesafe aggregations Wed, 04 Jan, 23:02
Andy Dang Converting an InternalRow to a Row Wed, 04 Jan, 19:27
Liang-Chi Hsieh   Re: Converting an InternalRow to a Row Thu, 05 Jan, 02:53
Andy Dang     Re: Converting an InternalRow to a Row Thu, 05 Jan, 10:55
Andy Dang       Re: Converting an InternalRow to a Row Thu, 05 Jan, 11:58
Liang-Chi Hsieh         Re: Converting an InternalRow to a Row Fri, 06 Jan, 03:48
Andy Dang           Re: Converting an InternalRow to a Row Fri, 06 Jan, 10:02
Liang-Chi Hsieh             Re: Converting an InternalRow to a Row Sat, 07 Jan, 10:11
Andy Dang               Re: Converting an InternalRow to a Row Sat, 07 Jan, 22:37
unsubscribe
Nikola Z   unsubscribe Thu, 05 Jan, 10:57
Vincent Frochot   unsubscribe Thu, 05 Jan, 10:59
Boris Lenzinger   unsubscribe Sun, 15 Jan, 13:28
Hosun Lee   unsubscribe Mon, 16 Jan, 00:35
Re: Spark SQL - Applying transformation on a struct inside an array
Olivier Girardot   Re: Spark SQL - Applying transformation on a struct inside an array Thu, 05 Jan, 20:01
Re: Spark GraphFrame ConnectedComponents
Ankur Srivastava   Re: Spark GraphFrame ConnectedComponents Thu, 05 Jan, 23:45
Felix Cheung     Re: Spark GraphFrame ConnectedComponents Fri, 06 Jan, 00:57
Joseph Bradley       Re: Spark GraphFrame ConnectedComponents Fri, 06 Jan, 01:44
Felix Cheung   Spark checkpointing Sat, 07 Jan, 08:29
Steve Loughran     Re: Spark checkpointing Mon, 09 Jan, 09:56
Unsubscribe
write2sivaku...@gmail   Unsubscribe Fri, 06 Jan, 04:01
Kyle Kelley     Re: Unsubscribe Fri, 06 Jan, 06:03
williamtellme...@gmail.com   Unsubscribe Thu, 12 Jan, 17:40
anuj ojha   Unsubscribe Fri, 13 Jan, 00:55
geoHeil handling of empty partitions Fri, 06 Jan, 19:30
Liang-Chi Hsieh   Re: handling of empty partitions Mon, 09 Jan, 04:30
Holden Karau     Re: handling of empty partitions Mon, 09 Jan, 05:40
geoHeil       Re: handling of empty partitions Mon, 09 Jan, 06:52
Liang-Chi Hsieh         Re: handling of empty partitions Mon, 09 Jan, 08:08
Georg Heiler           Re: handling of empty partitions Mon, 09 Jan, 08:26
Liang-Chi Hsieh             Re: handling of empty partitions Thu, 12 Jan, 02:47
Georg Heiler               Re: handling of empty partitions Thu, 12 Jan, 07:08
Ryan Blue Parquet patch release Fri, 06 Jan, 23:46
Reynold Xin   Re: Parquet patch release Fri, 06 Jan, 23:48
Xiao Li   Re: Parquet patch release Fri, 06 Jan, 23:49
Dongjoon Hyun     Re: Parquet patch release Sat, 07 Jan, 00:04
Liang-Chi Hsieh   Re: Parquet patch release Sat, 07 Jan, 09:36
Cheng Lian   Re: Parquet patch release Tue, 10 Jan, 01:25
Maciej Szymkiewicz [SQL][PYTHON] UDF improvements. Sat, 07 Jan, 20:39
Ryan Blue   Re: [SQL][PYTHON] UDF improvements. Mon, 09 Jan, 18:30
Maciej Szymkiewicz     Re: [SQL][PYTHON] UDF improvements. Tue, 10 Jan, 22:19
Jacek Laskowski protected val mapStatuses is ConcurrentHashMap in both MapOutputTrackerMaster and MapOutputTrackerWorker? Sun, 08 Jan, 19:48
Gilad Barkan A note about MLlib's StandardScaler Sun, 08 Jan, 20:06
Holden Karau   Re: A note about MLlib's StandardScaler Mon, 09 Jan, 03:30
Liang-Chi Hsieh     Re: A note about MLlib's StandardScaler Mon, 09 Jan, 06:50
Sean Owen       Re: A note about MLlib's StandardScaler Mon, 09 Jan, 11:23
Jacek Laskowski scala.MatchError: scala.collection.immutable.Range.Inclusive from catalyst.ScalaReflection.serializerFor? Mon, 09 Jan, 08:16
Liang-Chi Hsieh   Re: scala.MatchError: scala.collection.immutable.Range.Inclusive from catalyst.ScalaReflection.serializerFor? Mon, 09 Jan, 09:01
Holden Karau     Re: scala.MatchError: scala.collection.immutable.Range.Inclusive from catalyst.ScalaReflection.serializerFor? Mon, 09 Jan, 09:12
Andy Dang How to hint Spark to use HashAggregate() for UDAF Mon, 09 Jan, 13:52
Takeshi Yamamuro   Re: How to hint Spark to use HashAggregate() for UDAF Mon, 09 Jan, 14:05
Andy Dang     Re: How to hint Spark to use HashAggregate() for UDAF Mon, 09 Jan, 14:13
Liang-Chi Hsieh       Re: How to hint Spark to use HashAggregate() for UDAF Tue, 10 Jan, 02:01
Andy Dang         Re: How to hint Spark to use HashAggregate() for UDAF Tue, 10 Jan, 17:35
Prasun Ratn Spark performance tests Tue, 10 Jan, 03:50
Kazuaki Ishizaki   Re: Spark performance tests Tue, 10 Jan, 09:21
Adam Roberts     Re: Spark performance tests Tue, 10 Jan, 09:58
Prasun Ratn       Re: Spark performance tests Tue, 10 Jan, 12:25
dragonly [SQL][CodeGen] Is there a way to set break point and debug the generated code? Tue, 10 Jan, 11:21
Reynold Xin   Re: [SQL][CodeGen] Is there a way to set break point and debug the generated code? Tue, 10 Jan, 17:31
Maciej Szymkiewicz [PYSPARK] Python tests organization Wed, 11 Jan, 12:18
Saikat Kanjilal   Re: [PYSPARK] Python tests organization Wed, 11 Jan, 17:44
Reynold Xin     Re: [PYSPARK] Python tests organization Wed, 11 Jan, 17:47
Saikat Kanjilal       Re: [PYSPARK] Python tests organization Wed, 11 Jan, 17:54
Reynold Xin         Re: [PYSPARK] Python tests organization Wed, 11 Jan, 18:02
Saikat Kanjilal     Re: [PYSPARK] Python tests organization Wed, 11 Jan, 18:36
Saikat Kanjilal     Re: [PYSPARK] Python tests organization Thu, 12 Jan, 18:20
Holden Karau       Re: [PYSPARK] Python tests organization Thu, 12 Jan, 18:34
Saikat Kanjilal         Re: [PYSPARK] Python tests organization Thu, 12 Jan, 18:36
Maciej Szymkiewicz           Re: [PYSPARK] Python tests organization Thu, 12 Jan, 18:44
Saikat Kanjilal           Re: [PYSPARK] Python tests organization Sat, 14 Jan, 20:01
Maciej Szymkiewicz         Re: [PYSPARK] Python tests organization Thu, 12 Jan, 18:49
Kalvin Chau [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 22:38
Shixiong(Ryan) Zhu   Re: [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 22:53
Kalvin Chau     Re: [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 23:25
Shixiong(Ryan) Zhu       Re: [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 23:27
Kalvin Chau         Re: [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 23:33
Shixiong(Ryan) Zhu           Re: [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 23:43
Kalvin Chau             Re: [Streaming] ConcurrentModificationExceptions when Windowing Wed, 11 Jan, 23:53
Shixiong(Ryan) Zhu               Re: [Streaming] ConcurrentModificationExceptions when Windowing Thu, 12 Jan, 00:04
Kalvin Chau                 Re: [Streaming] ConcurrentModificationExceptions when Windowing Thu, 12 Jan, 01:20
Shixiong(Ryan) Zhu                   Re: [Streaming] ConcurrentModificationExceptions when Windowing Thu, 12 Jan, 01:43
Kalvin Chau                     Re: [Streaming] ConcurrentModificationExceptions when Windowing Thu, 12 Jan, 02:17
Sharan F FOSDEM 2017 Open Source Conference - Brussels Thu, 12 Jan, 12:12
sujith chacko Limit Query Performance Suggestion Fri, 13 Jan, 07:19
Liang-Chi Hsieh   Re: Limit Query Performance Suggestion Mon, 16 Jan, 03:36
sujith71955     Re: Limit Query Performance Suggestion Wed, 18 Jan, 02:40
Liang-Chi Hsieh       Re: Limit Query Performance Suggestion Wed, 18 Jan, 07:48
wangzhenhua (G)         答复: Limit Query Performance Suggestion Wed, 18 Jan, 08:53
Liang-Chi Hsieh           Re: 答复: Limit Query Performance Suggestion Wed, 18 Jan, 08:57
Both Spark AM and Client are trying to delete Staging Directory
Rostyslav Sotnychenko   Both Spark AM and Client are trying to delete Staging Directory Fri, 13 Jan, 10:44
Liang-Chi Hsieh     Re: Both Spark AM and Client are trying to delete Staging Directory Sun, 15 Jan, 13:19
Rostyslav Sotnychenko       Re: Both Spark AM and Client are trying to delete Staging Directory Mon, 16 Jan, 12:51
Steve Loughran         Re: Both Spark AM and Client are trying to delete Staging Directory Mon, 16 Jan, 22:00
Rostyslav Sotnychenko   Both Spark AM and Client are trying to delete Staging Directory Fri, 13 Jan, 11:24
Marcelo Vanzin     Re: Both Spark AM and Client are trying to delete Staging Directory Sat, 14 Jan, 19:37
Marcelo Vanzin       Re: Both Spark AM and Client are trying to delete Staging Directory Sat, 14 Jan, 19:42
Steve Loughran         Re: Both Spark AM and Client are trying to delete Staging Directory Tue, 17 Jan, 11:58
Rostyslav Sotnychenko           Re: Both Spark AM and Client are trying to delete Staging Directory Tue, 17 Jan, 17:45
Sean Owen Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 13:27
Artur Sukhenko   Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 13:54
Sean Owen     Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 14:28
Artur Sukhenko       Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 14:32
Sean Owen         Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 14:35
Artur Sukhenko           Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 15:47
Shivaram Venkataraman           Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 16:11
Shivaram Venkataraman             Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 16:15
Sean Owen               Re: Can anyone edit JIRAs SPARK-19191 to SPARK-19202? Fri, 13 Jan, 16:18
Asher Krim Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 17:23
Sean Owen   Re: Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 17:25
Asher Krim     Re: Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 17:29
Sean Owen       Re: Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 17:42
Nick Pentreath         Re: Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 18:02
Asher Krim           Re: Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 20:16
Sean Owen             Re: Why are ml models repartition(1)'d in save methods? Fri, 13 Jan, 20:55
Asher Krim               Re: Why are ml models repartition(1)'d in save methods? Mon, 16 Jan, 16:41
Message list1 · 2 · 3 · Next »Thread · Author · Date
Box list
Jul 201967
Jun 2019147
May 2019168
Apr 2019260
Mar 2019344
Feb 2019300
Jan 2019270
Dec 2018194
Nov 2018247
Oct 2018396
Sep 2018354
Aug 2018304
Jul 2018283
Jun 2018260
May 2018211
Apr 2018198
Mar 2018172
Feb 2018242
Jan 2018232
Dec 2017134
Nov 2017243
Oct 2017151
Sep 2017256
Aug 2017253
Jul 2017142
Jun 2017241
May 2017179
Apr 2017157
Mar 2017175
Feb 2017277
Jan 2017383
Dec 2016342
Nov 2016395
Oct 2016461
Sep 2016374
Aug 2016284
Jul 2016354
Jun 2016395
May 2016315
Apr 2016445
Mar 2016436
Feb 2016324
Jan 2016285
Dec 2015466
Nov 2015531
Oct 2015419
Sep 2015482
Aug 2015352
Jul 2015556
Jun 2015437
May 2015557
Apr 2015606
Mar 2015456
Feb 2015444
Jan 2015379
Dec 2014413
Nov 2014499
Oct 2014427
Sep 2014452
Aug 2014531
Jul 2014491
Jun 2014231
May 2014439
Apr 2014273
Mar 20142861
Feb 20142878
Jan 2014385
Dec 2013228
Nov 2013100
Oct 2013121
Sep 2013313
Aug 2013140
Jul 201387
Jun 201333