spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jungtaek Lim (Jira)" <>
Subject [jira] [Created] (SPARK-28931) Fix couple of bugs in FsHistoryProviderSuite
Date Fri, 30 Aug 2019 14:58:00 GMT
Jungtaek Lim created SPARK-28931:

             Summary: Fix couple of bugs in FsHistoryProviderSuite
                 Key: SPARK-28931
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: Jungtaek Lim

There're some bugs reside on FsHistoryProviderSuite itself.
 # When creating log file via {{newLogFile}}, codec is ignored, leading to wrong file name.
(No one tends to create test for test code, as well as the bug doesn't affect existing tests
indeed, so not easy to catch.)
 # When writing events to log file via {{writeFile}}, metadata (in case of new format) gets
written to file regardless of its codec, and the content is overwritten by another stream,
hence no information for Spark version is available. It affects existing test, hence we have
wrong expected value to workaround the bug.

Note that they're bugs on test code, non-test code works fine.

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message