kylin-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Harvey Yue (Jira)" <j...@apache.org>
Subject [jira] [Commented] (KYLIN-4389) Change Flink jar dependence from compile to provided
Date Sun, 01 Mar 2020 11:09:00 GMT

    [ https://issues.apache.org/jira/browse/KYLIN-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17048530#comment-17048530
] 

Harvey Yue commented on KYLIN-4389:
-----------------------------------

I have verified these change in my CDH 6.2 environment, attach part of kylin process status
info:

/opt/spark/jars/jackson-module-scala_2.11-2.6.7.1.jar:/opt/spark/jars/jackson-module-paranamer-2.7.9.jar:/opt/spark/jars/jackson-module-jaxb-annotations-2.6.7.jar:/opt/spark/jars/parquet-avro-1.10.1.jar
-Dkylin.flink.dependency=/opt/flink/lib/flink-table_2.11-1.9.0.jar:/opt/flink/lib/flink-dist_2.11-1.9.0.jar:/opt/flink/lib/flink-table-blink_2.11-1.9.0.jar:/opt/flink/lib/flink-metrics-prometheus_2.11-1.9.0.jar
-Dkylin.hadoop.conf.dir=/etc/hadoop/conf -Dkylin.server.host-address=ng-dc-node5:7070 -Dspring.profiles.active=testing
org.apache.hadoop.util.RunJar /opt/kylin/bin/../tomcat/bin/bootstrap.jar org.apache.catalina.startup.Bootstrap
start

> Change Flink jar dependence from compile to provided 
> -----------------------------------------------------
>
>                 Key: KYLIN-4389
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4389
>             Project: Kylin
>          Issue Type: Sub-task
>          Components: Flink Engine
>            Reporter: Harvey Yue
>            Assignee: Harvey Yue
>            Priority: Major
>             Fix For: v3.1.0
>
>
> Currently, build module engine-flink which including flink related core jar to kylin
package, blow up 70M to package, so I suggest that change flink dependence scope
> One more thing, I guess this fat jar(kylin-job-xxx.jar) causeĀ  the issue KYLIN-4387



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message