spark-issues mailing list archives: July 2019

Site index · List index
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · Next »Thread · Author · Date
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28336) Tried running same code in local machine in IDE pycharm it running fine but issue arises when i setup all on EC2 my RDD has Json Value and convert it to data frame and show dataframe by Show method it fails to show my data frame. Thu, 11 Jul, 02:23
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28336) Tried running same code in local machine in IDE pycharm it running fine but issue arises when i setup all on EC2 my RDD has Json Value and convert it to data frame and show dataframe by Show method it fails to show my data frame. Thu, 11 Jul, 02:25
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28327) Spark SQL can't support union with left query have queryOrganization Thu, 11 Jul, 02:27
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28327) Spark SQL can't support union with left query have queryOrganization Thu, 11 Jul, 02:27
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28320) Spark job eventually fails after several "attempted to access non-existent accumulator" in DAGScheduler Thu, 11 Jul, 02:51
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD Thu, 11 Jul, 02:53
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28269) ArrowStreamPandasSerializer get stack Thu, 11 Jul, 02:57
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack Thu, 11 Jul, 04:07
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack Thu, 11 Jul, 04:15
Hyukjin Kwon (JIRA) [jira] [Comment Edited] (SPARK-28269) ArrowStreamPandasSerializer get stack Thu, 11 Jul, 04:52
Hyukjin Kwon (JIRA) [jira] [Comment Edited] (SPARK-28269) ArrowStreamPandasSerializer get stack Thu, 11 Jul, 04:53
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28279) Convert and port 'group-analysis.sql' into UDF test base Thu, 11 Jul, 09:26
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base Thu, 11 Jul, 09:27
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110) Thu, 11 Jul, 23:53
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28359) Make integrated UDF tests robust by making them no-op Fri, 12 Jul, 05:30
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling compressed Fri, 12 Jul, 09:42
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling compressed Fri, 12 Jul, 09:42
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28354) Use JIRA user name instead of JIRA user key Fri, 12 Jul, 09:45
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28378) Remove usage of cgi.escape Sun, 14 Jul, 06:27
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28378) Remove usage of cgi.escape Sun, 14 Jul, 06:27
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28378) Remove usage of cgi.escape Sun, 14 Jul, 06:31
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base Mon, 15 Jul, 01:24
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base Mon, 15 Jul, 01:25
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base Mon, 15 Jul, 01:54
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base Mon, 15 Jul, 01:54
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28392) Converted PostgreSQL UDF test should change some default config Mon, 15 Jul, 01:54
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28288) Convert and port 'window.sql' into UDF test base Mon, 15 Jul, 02:41
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28393) Convert and port 'pgSQL/join.sql' into UDF test base Mon, 15 Jul, 02:45
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) Mon, 15 Jul, 03:22
Hyukjin Kwon (JIRA) [jira] [Comment Edited] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) Mon, 15 Jul, 03:24
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) Mon, 15 Jul, 03:25
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28381) Upgraded version of Pyrolite to 4.30 Mon, 15 Jul, 03:31
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28381) Upgraded version of Pyrolite to 4.30 Mon, 15 Jul, 03:31
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28380) DataSourceV2 API based JDBC connector Mon, 15 Jul, 05:08
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28376) Support to write sorted parquet files in each row group Mon, 15 Jul, 05:09
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28376) Write sorted parquet files Mon, 15 Jul, 05:09
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28376) Support to write sorted parquet files in each row group Mon, 15 Jul, 05:12
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28376) Support to write sorted parquet files in each row group Mon, 15 Jul, 05:12
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories. Mon, 15 Jul, 05:13
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories. Mon, 15 Jul, 05:14
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28363) Enable run test with clover Mon, 15 Jul, 05:15
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28374) DataSourceV2: Add method to support INSERT ... IF NOT EXISTS Mon, 15 Jul, 06:04
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28368) Row.getAs() return different values in scala and java Mon, 15 Jul, 06:05
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28368) Row.getAs() return different values in scala and java Mon, 15 Jul, 06:07
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28352) Spark UI misses some executor metrics Mon, 15 Jul, 06:09
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28352) Spark UI shows RDD blocks as 0 in some executor metrics Mon, 15 Jul, 06:10
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data Mon, 15 Jul, 06:10
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data Mon, 15 Jul, 06:12
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data Mon, 15 Jul, 06:13
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28392) Converted PostgreSQL UDF test should change some default config Mon, 15 Jul, 07:21
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28392) Converted PostgreSQL UDF test should change some default config Mon, 15 Jul, 07:21
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28380) DataSourceV2 API based JDBC connector Mon, 15 Jul, 09:15
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28368) Row.getAs() return different values in scala and java Mon, 15 Jul, 09:19
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) Tue, 16 Jul, 03:51
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) Tue, 16 Jul, 03:52
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) Tue, 16 Jul, 03:52
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) Tue, 16 Jul, 03:53
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) Tue, 16 Jul, 03:53
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28345) PythonUDF predicate should be able to pushdown to join Tue, 16 Jul, 07:17
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28345) PythonUDF predicate should be able to pushdown to join Tue, 16 Jul, 07:17
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28129) Add float8.sql Tue, 16 Jul, 10:32
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28129) Add float8.sql Tue, 16 Jul, 10:32
Hyukjin Kwon (JIRA) [jira] [Created] (SPARK-28418) Flaky Test: pyspark.sql.tests.test_dataframe: test_query_execution_listener_on_collect Wed, 17 Jul, 06:26
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories. Wed, 17 Jul, 09:09
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28363) Enable run test with clover Wed, 17 Jul, 09:09
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-27820) case insensitive resolver should be used in GetMapValue Wed, 17 Jul, 11:55
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-27027) from_avro function does not deserialize the Avro record of a struct column type correctly Wed, 17 Jul, 12:10
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28246) State of UDAF: buffer is not cleared Wed, 17 Jul, 12:19
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-27609) from_json expects values of options dictionary to be Thu, 18 Jul, 04:38
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-27609) from_json expects values of options dictionary to be Thu, 18 Jul, 04:38
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28411) insertInto with overwrite inconsistent behaviour Python/Scala Thu, 18 Jul, 04:39
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28411) insertInto with overwrite inconsistent behaviour Python/Scala Thu, 18 Jul, 04:39
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement Thu, 18 Jul, 07:06
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base Thu, 18 Jul, 10:47
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base Thu, 18 Jul, 10:47
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base Thu, 18 Jul, 10:48
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base Thu, 18 Jul, 10:51
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base Thu, 18 Jul, 10:51
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base Thu, 18 Jul, 10:53
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base Thu, 18 Jul, 10:53
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base Thu, 18 Jul, 13:25
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base Thu, 18 Jul, 13:25
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base Fri, 19 Jul, 01:50
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base Fri, 19 Jul, 01:51
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base Fri, 19 Jul, 03:18
Hyukjin Kwon (JIRA) [jira] [Commented] (SPARK-28442) Potentially persist data without leadership Fri, 19 Jul, 03:26
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28438) Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema Fri, 19 Jul, 03:26
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28436) Throw better exception when datasource's schema is not equal to user-specific shema Fri, 19 Jul, 03:27
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28438) Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema Fri, 19 Jul, 03:27
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28277) Convert and port 'except.sql' into UDF test base Fri, 19 Jul, 04:45
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28277) Convert and port 'except.sql' into UDF test base Fri, 19 Jul, 04:45
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base Fri, 19 Jul, 04:46
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base Fri, 19 Jul, 07:28
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base Fri, 19 Jul, 07:28
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used Fri, 19 Jul, 12:14
Hyukjin Kwon (JIRA) [jira] [Updated] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used Fri, 19 Jul, 12:15
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base Sat, 20 Jul, 06:21
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base Sat, 20 Jul, 06:21
Hyukjin Kwon (JIRA) [jira] [Assigned] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base Sat, 20 Jul, 06:22
Hyukjin Kwon (JIRA) [jira] [Resolved] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base Sat, 20 Jul, 06:23
Message list« Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 · 9 · 10 · 11 · 12 · 13 · 14 · 15 · 16 · 17 · 18 · 19 · 20 · 21 · 22 · 23 · 24 · 25 · 26 · Next »Thread · Author · Date
Box list
Mar 2021675
Feb 20212404
Jan 20213118
Dec 20203114
Nov 20202574
Oct 20202364
Sep 20202465
Aug 20202548
Jul 20202987
Jun 20202495
May 20202296
Apr 20202233
Mar 20202569
Feb 20201689
Jan 20202030
Dec 20191984
Nov 20191999
Oct 20192605
Sep 20192562
Aug 20191971
Jul 20192560
Jun 20192148
May 20196634
Apr 20191770
Mar 20192729
Feb 20191990
Jan 20192470
Dec 20183548
Nov 20182719
Oct 20183017
Sep 20182838
Aug 20183000
Jul 20182380
Jun 20182087
May 20182671
Apr 20182287
Mar 20182229
Feb 20182319
Jan 20183319
Dec 20172281
Nov 20172408
Oct 20172299
Sep 20172506
Aug 20173310
Jul 20172915
Jun 20173101
May 20173314
Apr 20173090
Mar 20173629
Feb 20173151
Jan 20173354
Dec 20163726
Nov 20164722
Oct 20164453
Sep 20163741
Aug 20164396
Jul 20164608
Jun 20165512
May 20165539
Apr 20166102
Mar 20166117
Feb 20164280
Jan 20164706
Dec 20154974
Nov 20156194
Oct 20154747
Sep 20154598
Aug 20157076
Jul 20156772
Jun 20156218
May 20156438
Apr 20155360
Mar 20154473
Feb 20154636
Jan 20153246
Dec 20142821
Nov 20143092
Oct 20142923
Sep 20142921
Aug 20142949
Jul 20142711
Jun 20141751
May 20141587
Apr 20141553
Mar 2014189