flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Dongwon Kim <eastcirc...@gmail.com>
Subject Run programs w/ params including comma via REST api
Date Fri, 20 Apr 2018 10:37:53 GMT

I'm trying to run a program by sending POST requests.
I've already spawned dispatcher in YARN and uploaded a jar file to the dispatcher.

I want to execute my application using the following arguments (--topic and --kafkaParams):
	--topic gps-topic --kafkaParams bootstrap.servers=dacoe2:20245,group.id=trajectory-tracker
As you can see, there's a comma in the value of kafkaParams.

When I'm sending my application using the following command from Bash (%20 is a space and
$2C is a comma), 
bash> curl -X POST 'http://dacoe4.weave.local:45097/jars/7b6880d7-b899-4243-8b9b-a01ad7f8a854_Tmap-1.0-SNAPSHOT.jar/run?entry-class=com.skt.tmap.trajectorytracker.TrajectoryTracker&program-args=--topic%20gps-topic%20--kafkaParams%20bootstrap.servers=dacoe2:20245%2Cgroup.id=trajectory-tracker'

I get the following response from the dispatcher:
    "errors": [
        "Expected only one value [--topic gps-topic --kafkaParams bootstrap.servers=dacoe2:20245,

What I found from the source code is that org.apache.flink.runtime.rest.messages.MessageQueue
tries split the value of program-ages using comma as a delimiter.

I think I could modify my program to get arguments in a different way but it is not going
to be intuitive to use different characters for a delimiter instead of comma.

How you guys think?

Or there's a way to avoid this behavior of splitting the value of program-args into multiple


- Dongwon
View raw message