| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28336) Tried running same code in local machine in IDE pycharm it running fine but issue arises when i setup all on EC2 my RDD has Json Value and convert it to data frame and show dataframe by Show method it fails to show my data frame. |
Thu, 11 Jul, 02:23 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28336) Tried running same code in local machine in IDE pycharm it running fine but issue arises when i setup all on EC2 my RDD has Json Value and convert it to data frame and show dataframe by Show method it fails to show my data frame. |
Thu, 11 Jul, 02:25 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28327) Spark SQL can't support union with left query have queryOrganization |
Thu, 11 Jul, 02:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28327) Spark SQL can't support union with left query have queryOrganization |
Thu, 11 Jul, 02:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28320) Spark job eventually fails after several "attempted to access non-existent accumulator" in DAGScheduler |
Thu, 11 Jul, 02:51 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28300) Kmeans is failing when we run parallely passing an RDD |
Thu, 11 Jul, 02:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28269) ArrowStreamPandasSerializer get stack |
Thu, 11 Jul, 02:57 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack |
Thu, 11 Jul, 04:07 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28269) ArrowStreamPandasSerializer get stack |
Thu, 11 Jul, 04:15 |
| Hyukjin Kwon (JIRA) |
[jira] [Comment Edited] (SPARK-28269) ArrowStreamPandasSerializer get stack |
Thu, 11 Jul, 04:52 |
| Hyukjin Kwon (JIRA) |
[jira] [Comment Edited] (SPARK-28269) ArrowStreamPandasSerializer get stack |
Thu, 11 Jul, 04:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28279) Convert and port 'group-analysis.sql' into UDF test base |
Thu, 11 Jul, 09:26 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base |
Thu, 11 Jul, 09:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-25080) NPE in HiveShim$.toCatalystDecimal(HiveShim.scala:110) |
Thu, 11 Jul, 23:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Created] (SPARK-28359) Make integrated UDF tests robust by making them no-op |
Fri, 12 Jul, 05:30 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling compressed |
Fri, 12 Jul, 09:42 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28357) Fix Flaky Test - FileAppenderSuite.rolling file appender - size-based rolling compressed |
Fri, 12 Jul, 09:42 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28354) Use JIRA user name instead of JIRA user key |
Fri, 12 Jul, 09:45 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28378) Remove usage of cgi.escape |
Sun, 14 Jul, 06:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28378) Remove usage of cgi.escape |
Sun, 14 Jul, 06:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28378) Remove usage of cgi.escape |
Sun, 14 Jul, 06:31 |
| Hyukjin Kwon (JIRA) |
[jira] [Created] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base |
Mon, 15 Jul, 01:24 |
| Hyukjin Kwon (JIRA) |
[jira] [Created] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base |
Mon, 15 Jul, 01:25 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28391) Convert and port 'pgSQL/select_implicit.sql' into UDF test base |
Mon, 15 Jul, 01:54 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28390) Convert and port 'pgSQL/select_having.sql' into UDF test base |
Mon, 15 Jul, 01:54 |
| Hyukjin Kwon (JIRA) |
[jira] [Created] (SPARK-28392) Converted PostgreSQL UDF test should change some default config |
Mon, 15 Jul, 01:54 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28288) Convert and port 'window.sql' into UDF test base |
Mon, 15 Jul, 02:41 |
| Hyukjin Kwon (JIRA) |
[jira] [Created] (SPARK-28393) Convert and port 'pgSQL/join.sql' into UDF test base |
Mon, 15 Jul, 02:45 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) |
Mon, 15 Jul, 03:22 |
| Hyukjin Kwon (JIRA) |
[jira] [Comment Edited] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) |
Mon, 15 Jul, 03:24 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28358) Fix Flaky Tests - test_time_with_timezone (pyspark.sql.tests.test_serde.SerdeTests) |
Mon, 15 Jul, 03:25 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28381) Upgraded version of Pyrolite to 4.30 |
Mon, 15 Jul, 03:31 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28381) Upgraded version of Pyrolite to 4.30 |
Mon, 15 Jul, 03:31 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28380) DataSourceV2 API based JDBC connector |
Mon, 15 Jul, 05:08 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28376) Support to write sorted parquet files in each row group |
Mon, 15 Jul, 05:09 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28376) Write sorted parquet files |
Mon, 15 Jul, 05:09 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28376) Support to write sorted parquet files in each row group |
Mon, 15 Jul, 05:12 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28376) Support to write sorted parquet files in each row group |
Mon, 15 Jul, 05:12 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories. |
Mon, 15 Jul, 05:13 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories. |
Mon, 15 Jul, 05:14 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28363) Enable run test with clover |
Mon, 15 Jul, 05:15 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28374) DataSourceV2: Add method to support INSERT ... IF NOT EXISTS |
Mon, 15 Jul, 06:04 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28368) Row.getAs() return different values in scala and java |
Mon, 15 Jul, 06:05 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28368) Row.getAs() return different values in scala and java |
Mon, 15 Jul, 06:07 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28352) Spark UI misses some executor metrics |
Mon, 15 Jul, 06:09 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28352) Spark UI shows RDD blocks as 0 in some executor metrics |
Mon, 15 Jul, 06:10 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data |
Mon, 15 Jul, 06:10 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data |
Mon, 15 Jul, 06:12 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28338) spark.read.format("csv") treat empty string as null if csv file don't have quotes in data |
Mon, 15 Jul, 06:13 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28392) Converted PostgreSQL UDF test should change some default config |
Mon, 15 Jul, 07:21 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28392) Converted PostgreSQL UDF test should change some default config |
Mon, 15 Jul, 07:21 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28380) DataSourceV2 API based JDBC connector |
Mon, 15 Jul, 09:15 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28368) Row.getAs() return different values in scala and java |
Mon, 15 Jul, 09:19 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) |
Tue, 16 Jul, 03:51 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) |
Tue, 16 Jul, 03:52 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) |
Tue, 16 Jul, 03:52 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) |
Tue, 16 Jul, 03:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28398) Exception thrown while writing record: BatchCleanupEvent(ArrayBuffer()) |
Tue, 16 Jul, 03:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28345) PythonUDF predicate should be able to pushdown to join |
Tue, 16 Jul, 07:17 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28345) PythonUDF predicate should be able to pushdown to join |
Tue, 16 Jul, 07:17 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28129) Add float8.sql |
Tue, 16 Jul, 10:32 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28129) Add float8.sql |
Tue, 16 Jul, 10:32 |
| Hyukjin Kwon (JIRA) |
[jira] [Created] (SPARK-28418) Flaky Test: pyspark.sql.tests.test_dataframe: test_query_execution_listener_on_collect |
Wed, 17 Jul, 06:26 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28364) Unable to read complete data from an external hive table stored as ORC that points to a managed table's data files which is getting stored in sub-directories. |
Wed, 17 Jul, 09:09 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28363) Enable run test with clover |
Wed, 17 Jul, 09:09 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-27820) case insensitive resolver should be used in GetMapValue |
Wed, 17 Jul, 11:55 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-27027) from_avro function does not deserialize the Avro record of a struct column type correctly |
Wed, 17 Jul, 12:10 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28246) State of UDAF: buffer is not cleared |
Wed, 17 Jul, 12:19 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-27609) from_json expects values of options dictionary to be |
Thu, 18 Jul, 04:38 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-27609) from_json expects values of options dictionary to be |
Thu, 18 Jul, 04:38 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28411) insertInto with overwrite inconsistent behaviour Python/Scala |
Thu, 18 Jul, 04:39 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28411) insertInto with overwrite inconsistent behaviour Python/Scala |
Thu, 18 Jul, 04:39 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28194) [SQL] A NoSuchElementException maybe thrown when EnsureRequirement |
Thu, 18 Jul, 07:06 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base |
Thu, 18 Jul, 10:47 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base |
Thu, 18 Jul, 10:47 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28276) Convert and port 'cross-join.sql' into UDF test base |
Thu, 18 Jul, 10:48 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base |
Thu, 18 Jul, 10:51 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28283) Convert and port 'intersect-all.sql' into UDF test base |
Thu, 18 Jul, 10:51 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base |
Thu, 18 Jul, 10:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28278) Convert and port 'except-all.sql' into UDF test base |
Thu, 18 Jul, 10:53 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base |
Thu, 18 Jul, 13:25 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28286) Convert and port 'pivot.sql' into UDF test base |
Thu, 18 Jul, 13:25 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base |
Fri, 19 Jul, 01:50 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28287) Convert and port 'udaf.sql' into UDF test base |
Fri, 19 Jul, 01:51 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base |
Fri, 19 Jul, 03:18 |
| Hyukjin Kwon (JIRA) |
[jira] [Commented] (SPARK-28442) Potentially persist data without leadership |
Fri, 19 Jul, 03:26 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28438) Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema |
Fri, 19 Jul, 03:26 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28436) Throw better exception when datasource's schema is not equal to user-specific shema |
Fri, 19 Jul, 03:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28438) Ignore metadata's(comments) difference when comparing datasource's schema and user-specific schema |
Fri, 19 Jul, 03:27 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28277) Convert and port 'except.sql' into UDF test base |
Fri, 19 Jul, 04:45 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28277) Convert and port 'except.sql' into UDF test base |
Fri, 19 Jul, 04:45 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28285) Convert and port 'outer-join.sql' into UDF test base |
Fri, 19 Jul, 04:46 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base |
Fri, 19 Jul, 07:28 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28284) Convert and port 'join-empty-relation.sql' into UDF test base |
Fri, 19 Jul, 07:28 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used |
Fri, 19 Jul, 12:14 |
| Hyukjin Kwon (JIRA) |
[jira] [Updated] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used |
Fri, 19 Jul, 12:15 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base |
Sat, 20 Jul, 06:21 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28279) Convert and port 'group-analytics.sql' into UDF test base |
Sat, 20 Jul, 06:21 |
| Hyukjin Kwon (JIRA) |
[jira] [Assigned] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base |
Sat, 20 Jul, 06:22 |
| Hyukjin Kwon (JIRA) |
[jira] [Resolved] (SPARK-28282) Convert and port 'inline-table.sql' into UDF test base |
Sat, 20 Jul, 06:23 |