spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hyukjin Kwon (Jira)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-30164) Exclude Hive domain in Unidoc build explicitly
Date Mon, 09 Dec 2019 04:17:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-30164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Hyukjin Kwon updated SPARK-30164:
---------------------------------
    Description: 
We don't publish this as a part of Spark documentation (see also https://github.com/apache/spark/blob/master/docs/_plugins/copy_api_dirs.rb#L30)
and most of them are copy of Hive thrift server so that we can officially use Hive 2.3 release.

It doesn't much make sense to check the documentation generation against another domain, and
that we don't use in documentation publish.

  was:
In the latest master branch, the document generation command:

{code:java}
./build/sbt -Phadoop-2.7 -Phive-2.3 -Pyarn -Phive -Pmesos -Pkinesis-asl -Pspark-ganglia-lgpl
-Pkubernetes -Phadoop-cloud -Phive-thriftserver unidoc

{code}

failed with such message

{code:java}
[error] /Users/gengliang.wang/Downloads/spark/sql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java:248:
 error: incompatible types: org.apache.hive.service.rpc.thrift.TSessionHandle cannot be converted
to org.apache.hive.service.cli.thrift.TSessionHandle
[error]       resp.setSessionHandle(sessionHandle.toTSessionHandle());
[error]                                                           ^
[error] /Users/gengliang.wang/Downloads/spark/sql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java:259:
 error: incompatible types: org.apache.hive.service.rpc.thrift.TStatus cannot be converted
to org.apache.hive.service.cli.thrift.TStatus
[error]       resp.setStatus(HiveSQLException.toTStatus(e));
[error]                                                ^
[error] /Users/gengliang.wang/Downloads/spark/sql/hive-thriftserver/v2.3/src/main/java/org/apache/hive/service/cli/thrift/ThriftCLIService.java:346:
 error: method getMinVersion in class ThriftCLIService cannot be applied to given types;
[error]     TProtocolVersion protocol = getMinVersion(CLIService.SERVER_VERSION,
[error]  
{code}

To fix it, we should add change "sbt unidoc" to "sbt clean unidoc"


> Exclude Hive domain in Unidoc build explicitly
> ----------------------------------------------
>
>                 Key: SPARK-30164
>                 URL: https://issues.apache.org/jira/browse/SPARK-30164
>             Project: Spark
>          Issue Type: Bug
>          Components: Documentation, Tests
>    Affects Versions: 3.0.0
>            Reporter: Gengliang Wang
>            Assignee: Gengliang Wang
>            Priority: Major
>
> We don't publish this as a part of Spark documentation (see also https://github.com/apache/spark/blob/master/docs/_plugins/copy_api_dirs.rb#L30)
and most of them are copy of Hive thrift server so that we can officially use Hive 2.3 release.
> It doesn't much make sense to check the documentation generation against another domain,
and that we don't use in documentation publish.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message