samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Naveen Somasundaram <nsomasunda...@linkedin.com.INVALID>
Subject Re: How to pass quoted string in the configuration
Date Thu, 19 Mar 2015 23:23:24 GMT
Hey Jae,
      I verified passing Java properties with the property you specified and it seems to be
working fine.  However, if I pass the same properties to the hello-samza, it fails with same
error you have. I have opened a bug to track this here:
https://issues.apache.org/jira/browse/SAMZA-609

Thanks,
Naveen

On Mar 19, 2015, at 3:44 PM, Bae, Jae Hyeon <metacret@gmail.com<mailto:metacret@gmail.com>>
wrote:

Double quote character is escaped as the following but the \\" cannot be
correctly parsed as the string. It should be \".

\"filter.map.filter1.property\":\"xpath(\\"name\\") in
(\\"uiBrowseStartup.ended\\", \\"subscription.ended\\",
\\"uiStartup.ended\\") or xpath(\\"category\\") = \\"uiIntent\\"\",\"
job.name\":\"clevent-kafka\",

Anyway, I will use url encode-decode to make json parsing more comfortable.

On Thu, Mar 19, 2015 at 3:21 PM, Bae, Jae Hyeon <metacret@gmail.com<mailto:metacret@gmail.com>>
wrote:

The problem is json processing. I have to use the different expression
format... hm...

Java HotSpot(TM) 64-Bit Server VM (build 24.71-b01, mixed mode)
Exception in thread "main" org.codehaus.jackson.JsonParseException: Unrecognized character
escape ')' (code 41)
at [Source: java.io.StringReader@73dd3c7d; line: 1, column: 863]
at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433)
at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521)
at org.codehaus.jackson.impl.JsonParserMinimalBase._handleUnrecognizedCharacterEscape(JsonParserMinimalBase.java:496)
at org.codehaus.jackson.impl.ReaderBasedParser._decodeEscaped(ReaderBasedParser.java:1606)
at org.codehaus.jackson.impl.ReaderBasedParser._finishString2(ReaderBasedParser.java:1353)
at org.codehaus.jackson.impl.ReaderBasedParser._finishString(ReaderBasedParser.java:1330)
at org.codehaus.jackson.impl.ReaderBasedParser.getText(ReaderBasedParser.java:200)
at org.codehaus.jackson.map.deser.std.UntypedObjectDeserializer.deserialize(UntypedObjectDeserializer.java:59)
at org.codehaus.jackson.map.deser.std.MapDeserializer._readAndBind(MapDeserializer.java:319)
at org.codehaus.jackson.map.deser.std.MapDeserializer.deserialize(MapDeserializer.java:249)
at org.codehaus.jackson.map.deser.std.MapDeserializer.deserialize(MapDeserializer.java:33)
at org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2732)
at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863)
at org.apache.samza.config.serializers.JsonConfigSerializer$.fromJson(JsonConfigSerializer.scala:34)
at org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:72)
at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)


On Thu, Mar 19, 2015 at 3:10 PM, Chris Riccomini <criccomini@apache.org<mailto:criccomini@apache.org>>
wrote:

Hey Jae,

If you're using the PropertiesConfigFactory (the default), then it's just
a
Java Properties object. You should be able to escape it. I'm actually not
even sure if quotes are a problem in Java Properties objects. I would
think
that they wouldn't be. The second '=' sign might be, though.

In any case, to see what went wrong, you'll have to check your AM
container
logs. Can you find those? They're usually linked to from the YARN RM UI.

Cheers,
Chris

On Thu, Mar 19, 2015 at 2:32 PM, Bae, Jae Hyeon <metacret@gmail.com<mailto:metacret@gmail.com>>
wrote:

Hi Samza Devs

I want to pass the quoted string like

filter.map.filter1.property=xpath("name") in ("uiBrowseStartup.ended",
"subscription.ended", "uiStartup.ended") or xpath("category") =
"uiIntent"

through the configuration to the container but AM keeps failing

Application application_1423090724595_0045 failed 2 times due to AM
Container for appattempt_1423090724595_0045_000002 exited with
exitCode: 1
due to: Exception from container-launch:
org.apache.hadoop.util.Shell$ExitCodeException:
org.apache.hadoop.util.Shell$ExitCodeException:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
at org.apache.hadoop.util.Shell.run(Shell.java:418)
at

org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
at


org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)

at


org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)

at


org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)

at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at


java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

at


java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

at java.lang.Thread.run(Thread.java:745)
  Container exited with a non-zero exit code 1
.Failing this attempt.. Failing the application.

Any idea or recommendation?

Thank you
Best, Jae






Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message