spark-user mailing list archives: December 2017

Site index · List index
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
163 How to persistent database/table created in sparkSession Tue, 05 Dec, 07:22
☼ R Nair (रविशंकर नायर) Question on using pseudo columns in spark jdbc options Sun, 03 Dec, 06:39
☼ R Nair (रविशंकर नायर) Re: Question on using pseudo columns in spark jdbc options Fri, 08 Dec, 07:17
☼ R Nair (रविशंकर नायर) Re: Save hive table from spark in hive 2.1.1 Sat, 09 Dec, 23:51
☼ R Nair (रविशंकर नायर) Re: Save hive table from spark in hive 2.1.0 Sun, 10 Dec, 15:21
张万新 Re: JDBC to hive batch use case in spark Sat, 09 Dec, 13:20
Renato Marroquín Mogrovejo Re: NASA CDF files in Spark Tue, 26 Dec, 20:23
Szuromi Tamás Re: Windows10 + pyspark + ipython + csv file loading with timestamps Mon, 18 Dec, 11:03
王双 unsubscribe Tue, 26 Dec, 05:58
施朝浩 unsubscribe Fri, 22 Dec, 15:17
Jörn Franke Re: Spark loads data from HDFS or S3 Wed, 13 Dec, 10:23
Jörn Franke Re: NASA CDF files in Spark Sat, 16 Dec, 08:46
Jörn Franke Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 06:55
Jörn Franke Re: Reading data from OpenTSDB or KairosDB Thu, 21 Dec, 11:48
Jörn Franke Re: Spark Docker Mon, 25 Dec, 09:06
Aakash Basu Passing an array of more than 22 elements in a UDF Fri, 22 Dec, 09:24
Aakash Basu Re: Passing an array of more than 22 elements in a UDF Tue, 26 Dec, 05:13
Afshin, Bardia UDF issues with spark Fri, 08 Dec, 19:54
Alejandro Reina Re: Save hive table from spark in hive 2.1.0 Sun, 10 Dec, 11:17
Alejandro Reina Re: Save hive table from spark in hive 2.1.0 Sun, 10 Dec, 17:47
An Qin Why Spark 2.2.1 still bundles old Hive jars? Mon, 11 Dec, 06:43
Anastasios Zouzias Re: Several Aggregations on a window function Mon, 18 Dec, 16:15
Anastasios Zouzias Re: Several Aggregations on a window function Mon, 18 Dec, 19:37
Anshuman Kumar unsubscribe Tue, 12 Dec, 16:29
Anthony Thomas Re: How do I save the dataframe data as a pdf file? Tue, 12 Dec, 19:29
Anthony Thomas Re: How do I save the dataframe data as a pdf file? Tue, 12 Dec, 19:53
Anu B Nair Fwd: [pyspark][MLlib] Getting WARN FPGrowth: Input data is not cached for cached data Fri, 22 Dec, 07:44
Anurag Sharma NullPointerException while reading a column from the row Tue, 19 Dec, 09:23
Arkadiusz Bicz Spark Streaming with Confluent Wed, 13 Dec, 17:05
Art Rand Re: Spark job only starts tasks on a single node Wed, 06 Dec, 13:57
Art Rand Re: Spark job only starts tasks on a single node Thu, 07 Dec, 19:34
Ashwin Raju Recompute Spark outputs intelligently Fri, 15 Dec, 08:00
Bang Xiao AM restart in a other node makes SparkSQL jobs into a state of feign death Thu, 21 Dec, 07:02
Bang Xiao AM restart in a other node make SparkSQL job into a state of feign death Thu, 21 Dec, 07:03
Bogdan Cojocar Spark Structured Streaming how to read data from AWS SQS Mon, 11 Dec, 15:15
Bogdan Cojocar Different behaviour when querying a spark DataFrame from dynamodb Wed, 13 Dec, 17:28
Burak Yavuz Re: Infer JSON schema in structured streaming Kafka. Mon, 11 Dec, 17:29
Christopher Piggott NASA CDF files in Spark Sat, 16 Dec, 02:33
Christopher Piggott Spark 2.2.1 worker invocation Tue, 26 Dec, 16:00
Christopher Piggott Converting binary files Sat, 30 Dec, 20:44
Cody Koeninger Re: [Spark streaming] No assigned partition error during seek Fri, 01 Dec, 15:54
Cody Koeninger Re: bulk upsert data batch from Kafka dstream into Postgres db Thu, 14 Dec, 14:47
Cody Koeninger Re: bulk upsert data batch from Kafka dstream into Postgres db Thu, 14 Dec, 17:42
Cody Koeninger Re: How to properly execute `foreachPartition` in Spark 2.2 Mon, 18 Dec, 15:26
Cody Koeninger Re: Which kafka client to use with spark streaming Tue, 26 Dec, 15:46
CondyZhou keep sparkContext alive and wait for next job just like spark-shell Thu, 21 Dec, 03:31
Daniel Haviv Re: UDF issues with spark Sun, 10 Dec, 09:10
Daniel Haviv Writing a UDF that works with an Interval in PySpark Mon, 11 Dec, 18:15
Daniel de Oliveira Mantovani Re: Getting Message From Structured Streaming Format Kafka Fri, 01 Dec, 21:52
David Hodefi spark datatypes Sun, 03 Dec, 14:12
Debasish Das ECOS Spark Integration Mon, 18 Dec, 01:25
Deepak Sharma Re: Help Required on Spark - Convert DataFrame to List<JavaClass> with out using collect Tue, 19 Dec, 04:12
Diogo Munaro Vieira Re: Apache Spark - Structured Streaming graceful shutdown Tue, 26 Dec, 01:39
Diogo Munaro Vieira Re: Apache Spark - Structured Streaming from file - checkpointing Tue, 26 Dec, 01:40
Diogo Munaro Vieira Re: Apache Spark - (2.2.0) - window function for DataSet Tue, 26 Dec, 01:43
Diogo Munaro Vieira Re: Which kafka client to use with spark streaming Tue, 26 Dec, 01:58
Divya Narayan unsubscribe Tue, 12 Dec, 17:16
Don Drake flatMap() returning large class Thu, 14 Dec, 18:20
Don Drake Re: flatMap() returning large class Sun, 17 Dec, 23:12
Dongjoon Hyun Apache Spark 2.3 and Apache ORC 1.4 finally Tue, 05 Dec, 17:47
Donni Khan cosine similarity in Java Spark Thu, 14 Dec, 10:39
Donni Khan cosine similarity implementation in Java Spark Thu, 14 Dec, 11:26
Elior Malul Re: learning Spark Tue, 05 Dec, 07:16
Eric Dain Cascading Spark Structured streams Thu, 28 Dec, 22:14
Esa Heikkinen Windows10 + pyspark + ipython + csv file loading with timestamps Sat, 16 Dec, 10:04
Esa Heikkinen Spark and neural networks Wed, 27 Dec, 14:57
Esa Heikkinen Pyspark and searching items from data structures Thu, 28 Dec, 12:33
Eyal Zituny Re: Standalone Cluster: ClassNotFound org.apache.kafka.common.serialization.ByteArrayDeserializer Wed, 27 Dec, 08:56
Eyal Zituny Re: Apache Spark - Structured Streaming graceful shutdown Wed, 27 Dec, 09:15
Felipe Gustavo unsubscribe Tue, 12 Dec, 13:06
Felix Cheung Re: Passing an array of more than 22 elements in a UDF Mon, 25 Dec, 01:21
Felix Cheung Re: Spark 2.2.1 worker invocation Tue, 26 Dec, 19:05
Felix Cheung Re: Passing an array of more than 22 elements in a UDF Tue, 26 Dec, 19:19
Filipp Zhinkin [ML] LogisticRegression and dataset's standardization before training Wed, 06 Dec, 10:13
Filipp Zhinkin Re: ML Transformer: create feature that uses multiple columns Sat, 09 Dec, 11:48
Gaurav1809 What does Blockchain technology mean for Big Data? And how Hadoop/Spark will play role with it? Tue, 19 Dec, 04:56
Geoff Von Allmen Standalone Cluster: ClassNotFound org.apache.kafka.common.serialization.ByteArrayDeserializer Tue, 26 Dec, 23:08
Geoff Von Allmen Re: Standalone Cluster: ClassNotFound org.apache.kafka.common.serialization.ByteArrayDeserializer Wed, 27 Dec, 09:27
Georg Heiler Re: Row Encoder For DataSet Fri, 08 Dec, 07:17
Georg Heiler Re: Feature generation / aggregate functions / timeseries Thu, 14 Dec, 18:40
Georg Heiler Re: Feature generation / aggregate functions / timeseries Thu, 14 Dec, 18:41
Georg Heiler Re: Can spark shuffle leverage Alluxio to abtain higher stability? Thu, 21 Dec, 08:34
Gerard Maas Re: Do I need to do .collect inside forEachRDD Tue, 05 Dec, 21:54
Gerard Maas Re: Do I need to do .collect inside forEachRDD Wed, 06 Dec, 09:43
Gerard Maas Re: Union of RDDs Hung Tue, 12 Dec, 08:33
Gerard Maas Re: Spark Streaming with Confluent Wed, 13 Dec, 17:10
Gourav Sengupta Re: kinesis throughput problems Fri, 15 Dec, 15:12
Gourav Sengupta Re: /tmp fills up to 100GB when using a window function Wed, 20 Dec, 19:58
Gourav Sengupta Re: Spark Streaming to REST API Thu, 21 Dec, 22:30
Gourav Sengupta Re: Spark on EMR suddenly stalling Thu, 28 Dec, 18:42
Gourav Sengupta Re: Spark on EMR suddenly stalling Thu, 28 Dec, 20:09
Gourav Sengupta Re: Spark on EMR suddenly stalling Sat, 30 Dec, 19:20
Hajira Jabeen SANSA 0.3 (Scalable Semantic Analytics Stack) Released Mon, 18 Dec, 09:21
Hajira Jabeen Re: SANSA 0.3 (Scalable Semantic Analytics Stack) Released Mon, 18 Dec, 15:05
Himasha de Silva [Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java Fri, 08 Dec, 04:45
Himasha de Silva [Spark SQL]: Dataset<Row> can not map into Dataset<Integer> in java Fri, 08 Dec, 05:11
Himasha de Silva Loading a spark dataframe column into T-Digest using java Mon, 11 Dec, 06:27
Hokam Singh Chauhan JDBC to hive batch use case in spark Sat, 09 Dec, 12:02
Holden Karau Re: Is Databricks REST API open source ? Sun, 03 Dec, 05:46
Holden Karau Re: Recommended way to serialize Hadoop Writables' in Spark Sun, 03 Dec, 22:41
Message list1 · 2 · 3 · 4 · Next »Thread · Author · Date
Box list
May 2019273
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137