spark-user mailing list archives: August 2015

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
andrew.row...@thomsonreuters.com Re: Driver running out of memory - caused by many tasks? Thu, 27 Aug, 16:24
andy petrella Re: Re: Real-time data visualization with Zeppelin Thu, 06 Aug, 10:52
andy petrella Re: Spark is in-memory processing, how then can Tachyon make Spark faster? Fri, 07 Aug, 20:28
andy petrella Re: Spark + Jupyter (IPython Notebook) Wed, 19 Aug, 05:44
anshu shukla Setting number of CORES from inside the Topology (JAVA code ) Wed, 26 Aug, 13:56
ashensw How to get the radius of clusters in spark K means Thu, 20 Aug, 06:14
ashensw Calculating Min and Max Values using Spark Transformations? Fri, 28 Aug, 12:39
ashensw Distance Calculation in Spark K means clustering Mon, 31 Aug, 06:53
ashrowty Spark shell and StackOverFlowError Sun, 30 Aug, 03:21
ayan guha Re: Writing to HDFS Tue, 04 Aug, 01:40
ayan guha Re: large scheduler delay in pyspark Wed, 05 Aug, 21:20
ayan guha Re: multiple dependency jars using pyspark Mon, 10 Aug, 08:08
ayan guha Re: Partitioning in spark streaming Tue, 11 Aug, 23:21
ayan guha Re: Regarding rdd.collect() Tue, 18 Aug, 08:34
ayan guha Re: Transform KafkaRDD to KafkaRDD, not plain RDD, or how to keep OffsetRanges after transformation Tue, 18 Aug, 14:36
ayan guha Re: spark kafka partitioning Fri, 21 Aug, 03:44
ayan guha Re: Creating Spark DataFrame from large pandas DataFrame Fri, 21 Aug, 09:16
b.bhavesh History server is not receiving any event Mon, 24 Aug, 19:37
bcajes Re: Spark Mesos Dispatcher Sun, 23 Aug, 14:22
billchambers Cannot Import Package (spark-csv) Mon, 03 Aug, 03:33
billchambers Re: Cannot Import Package (spark-csv) Mon, 03 Aug, 04:00
bo yang Re: Accessing S3 files with s3n:// Sun, 09 Aug, 17:45
bo yang Re: How to create DataFrame from a binary file? Sun, 09 Aug, 17:51
bo yang Re: How to create DataFrame from a binary file? Sun, 09 Aug, 18:22
bstempi Issues with S3 paths that contain colons Tue, 18 Aug, 15:20
canan chen Why use spark.history.fs.logDirectory instead of spark.eventLog.dir Fri, 07 Aug, 08:20
canan chen Re: Why use spark.history.fs.logDirectory instead of spark.eventLog.dir Tue, 11 Aug, 03:09
canan chen Error when running SparkPi in Intellij Wed, 12 Aug, 03:56
canan chen TestSQLContext compilation error when run SparkPi in Intellij ? Sun, 16 Aug, 02:40
canan chen Re: TestSQLContext compilation error when run SparkPi in Intellij ? Sun, 16 Aug, 03:33
canan chen Re: TestSQLContext compilation error when run SparkPi in Intellij ? Sun, 16 Aug, 09:06
canan chen Why standalone mode don't allow to set num-executor ? Tue, 18 Aug, 09:35
canan chen What's the best practice for developing new features for spark ? Wed, 19 Aug, 08:44
canan chen Re: What's the best practice for developing new features for spark ? Wed, 19 Aug, 12:10
canan chen Re: Why use spark.history.fs.logDirectory instead of spark.eventLog.dir Wed, 19 Aug, 12:13
canan chen Re: Why use spark.history.fs.logDirectory instead of spark.eventLog.dir Thu, 20 Aug, 01:35
canan chen Where is the doc about the spark rest api ? Mon, 31 Aug, 03:24
canan chen Re: Where is the doc about the spark rest api ? Mon, 31 Aug, 08:19
cheez Get bucket details created in shuffle phase Fri, 07 Aug, 18:32
cingram Spark 1.3.1 saveAsParquetFile hangs on app exit Wed, 26 Aug, 14:46
cingram Re: Spark 1.3.1 saveAsParquetFile hangs on app exit Wed, 26 Aug, 17:19
clark djilo kuissu Re: TFIDF Transformation Tue, 04 Aug, 11:35
clark djilo kuissu Delete NA in a dataframe Tue, 04 Aug, 12:03
clark djilo kuissu Re: Delete NA in a dataframe Tue, 04 Aug, 13:19
d..@lumity.com ExternalSorter: Thread *** spilling in-memory map of 352.6 MB to disk (38 times so far) Mon, 24 Aug, 21:27
diplomatic Guru Is it this a BUG?: Why Spark Flume Streaming job is not deploying the Receiver to the specified host? Tue, 18 Aug, 11:45
diplomatic Guru Re: Is it this a BUG?: Why Spark Flume Streaming job is not deploying the Receiver to the specified host? Wed, 19 Aug, 00:25
dizzy5112 pregel graphx job not finishing Wed, 12 Aug, 02:23
dizzy5112 graphx class not found error Fri, 14 Aug, 01:17
dizzy5112 Re: graphx class not found error Fri, 14 Aug, 01:19
dizzy5112 grpah x issue spark 1.3 Mon, 17 Aug, 05:19
dizzy5112 error accessing vertexRDD Thu, 27 Aug, 00:45
dong.yajun How can I save the RDD result as Orcfile with spark1.3? Sat, 22 Aug, 02:36
dong.yajun Re: How can I save the RDD result as Orcfile with spark1.3? Sat, 22 Aug, 05:21
dong.yajun Re: How can I save the RDD result as Orcfile with spark1.3? Tue, 25 Aug, 06:36
dugdun `show tables like 'tmp*';` does not work in Spark 1.3.0+ Mon, 24 Aug, 21:44
dutrow Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 15:36
dutrow Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 15:42
dutrow Re: Maintaining Kafka Direct API Offsets Fri, 14 Aug, 17:34
ericbless Re: Python, Spark and HBase Mon, 03 Aug, 20:34
farhan mllib kmeans produce 1 large and many extremely small clusters Mon, 10 Aug, 04:58
foobar Pause Spark Streaming reading or sampling streaming data Wed, 05 Aug, 23:44
freedafeng spark's behavior about failed tasks Wed, 12 Aug, 20:22
fuellee lee how to ignore MatchError then processing a large json file in spark-sql Sun, 02 Aug, 18:27
gaurav sharma Re: Writing streaming data to cassandra creates duplicates Tue, 04 Aug, 18:43
gaurav sharma Worker Machine running out of disk for Long running Streaming process Fri, 21 Aug, 09:59
gauravsehgal Re: Running Spark on user-provided Hadoop installation Tue, 18 Aug, 08:34
gen tang large scheduler delay in pyspark Mon, 03 Aug, 16:00
gen tang Re: large scheduler delay in pyspark Wed, 05 Aug, 13:54
gen tang Re: How to get total CPU consumption for Spark job Sat, 08 Aug, 00:35
gen tang Re: Problems getting expected results from hbase_inputformat.py Sat, 08 Aug, 00:58
gen tang Re: Spark MLib v/s SparkR Sat, 08 Aug, 01:12
gen tang Questions about SparkSQL join on not equality conditions Sun, 09 Aug, 13:08
gen tang Re: Questions about SparkSQL join on not equality conditions Mon, 10 Aug, 15:29
gen tang Re: Questions about SparkSQL join on not equality conditions Tue, 11 Aug, 13:53
gen tang Spark works with the data in another cluster(Elasticsearch) Tue, 18 Aug, 14:39
gen tang Re: Spark works with the data in another cluster(Elasticsearch) Tue, 25 Aug, 10:54
go canal matrix inverse and multiplication Fri, 14 Aug, 03:59
go canal Re: matrix inverse and multiplication Fri, 14 Aug, 07:52
go canal How to save a string to a text file ? Sat, 15 Aug, 02:50
go canal Re: How to save a string to a text file ? Sat, 15 Aug, 03:31
gpatcham Removing empty partitions before we write to HDFS Thu, 06 Aug, 19:02
gpatcham query avro hive table in spark sql Wed, 26 Aug, 18:32
guoqing0...@yahoo.com.hk Insert operation in Dataframe Fri, 07 Aug, 11:14
hide Spark job endup with NPE Fri, 14 Aug, 11:05
iceback distributing large matrices Fri, 07 Aug, 15:17
ihainan What's the logic in RangePartitioner.rangeBounds method of Apache Spark Mon, 17 Aug, 16:13
jatinpreet CHAID Decision Trees Tue, 25 Aug, 16:39
java8964 Spark SQL query AVRO file Fri, 07 Aug, 18:30
java8964 RE: Spark SQL query AVRO file Fri, 07 Aug, 18:42
java8964 RE: Spark SQL query AVRO file Fri, 07 Aug, 18:48
java8964 Spark Job Hangs on our production cluster Tue, 11 Aug, 20:19
java8964 RE: Spark Job Hangs on our production cluster Tue, 11 Aug, 21:19
java8964 Spark 1.2.2 build problem with Hive 0.12, bringing in wrong version of avro-mapred Wed, 12 Aug, 14:36
java8964 RE: Spark Job Hangs on our production cluster Fri, 14 Aug, 19:14
java8964 Spark Job Hangs on our production cluster Mon, 17 Aug, 14:55
java8964 RE: Spark Job Hangs on our production cluster Tue, 18 Aug, 19:23
java8964 RE: Failed to fetch block error Wed, 19 Aug, 12:53
java8964 Any suggestion about "sendMessageReliably failed because ack was not received within 120 sec" Fri, 21 Aug, 00:49
java8964 RE: Any suggestion about "sendMessageReliably failed because ack was not received within 120 sec" Fri, 21 Aug, 02:51
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · Next »Thread · Author · Date
Box list
Sep 2020107
Aug 2020166
Jul 2020248
Jun 2020263
May 2020282
Apr 2020335
Mar 2020232
Feb 2020136
Jan 2020141
Dec 2019138
Nov 2019125
Oct 2019124
Sep 2019160
Aug 2019187
Jul 2019193
Jun 2019265
May 2019317
Apr 2019263
Mar 2019248
Feb 2019186
Jan 2019244
Dec 2018202
Nov 2018235
Oct 2018275
Sep 2018235
Aug 2018262
Jul 2018309
Jun 2018377
May 2018386
Apr 2018410
Mar 2018444
Feb 2018383
Jan 2018332
Dec 2017350
Nov 2017267
Oct 2017410
Sep 2017452
Aug 2017525
Jul 2017520
Jun 2017645
May 2017549
Apr 2017564
Mar 2017621
Feb 2017744
Jan 2017889
Dec 2016865
Nov 20161118
Oct 20161115
Sep 20161402
Aug 20161564
Jul 20161684
Jun 20161457
May 20161496
Apr 20161411
Mar 20162044
Feb 20161799
Jan 20161740
Dec 20151870
Nov 20151541
Oct 20152041
Sep 20152125
Aug 20151978
Jul 20152343
Jun 20152366
May 20151864
Apr 20152314
Mar 20152577
Feb 20152187
Jan 20152152
Dec 20141937
Nov 20142024
Oct 20142244
Sep 20142094
Aug 20141949
Jul 20142389
Jun 20141773
May 20141397
Apr 20141459
Mar 20141286
Feb 20141029
Jan 2014925
Dec 2013611
Nov 2013558
Oct 2013505
Sep 2013235
Aug 201397
Jul 20137