samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bae, Jae Hyeon" <metac...@gmail.com>
Subject Re: How to pass quoted string in the configuration
Date Thu, 19 Mar 2015 23:33:45 GMT
Thanks Naveen

On Thu, Mar 19, 2015 at 4:23 PM, Naveen Somasundaram <
nsomasundaram@linkedin.com.invalid> wrote:

> Hey Jae,
>       I verified passing Java properties with the property you specified
> and it seems to be working fine.  However, if I pass the same properties to
> the hello-samza, it fails with same error you have. I have opened a bug to
> track this here:
> https://issues.apache.org/jira/browse/SAMZA-609
>
> Thanks,
> Naveen
>
> On Mar 19, 2015, at 3:44 PM, Bae, Jae Hyeon <metacret@gmail.com<mailto:
> metacret@gmail.com>> wrote:
>
> Double quote character is escaped as the following but the \\" cannot be
> correctly parsed as the string. It should be \".
>
> \"filter.map.filter1.property\":\"xpath(\\"name\\") in
> (\\"uiBrowseStartup.ended\\", \\"subscription.ended\\",
> \\"uiStartup.ended\\") or xpath(\\"category\\") = \\"uiIntent\\"\",\"
> job.name\":\"clevent-kafka\",
>
> Anyway, I will use url encode-decode to make json parsing more comfortable.
>
> On Thu, Mar 19, 2015 at 3:21 PM, Bae, Jae Hyeon <metacret@gmail.com
> <mailto:metacret@gmail.com>> wrote:
>
> The problem is json processing. I have to use the different expression
> format... hm...
>
> Java HotSpot(TM) 64-Bit Server VM (build 24.71-b01, mixed mode)
> Exception in thread "main" org.codehaus.jackson.JsonParseException:
> Unrecognized character escape ')' (code 41)
> at [Source: java.io.StringReader@73dd3c7d; line: 1, column: 863]
> at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1433)
> at
> org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:521)
> at
> org.codehaus.jackson.impl.JsonParserMinimalBase._handleUnrecognizedCharacterEscape(JsonParserMinimalBase.java:496)
> at
> org.codehaus.jackson.impl.ReaderBasedParser._decodeEscaped(ReaderBasedParser.java:1606)
> at
> org.codehaus.jackson.impl.ReaderBasedParser._finishString2(ReaderBasedParser.java:1353)
> at
> org.codehaus.jackson.impl.ReaderBasedParser._finishString(ReaderBasedParser.java:1330)
> at
> org.codehaus.jackson.impl.ReaderBasedParser.getText(ReaderBasedParser.java:200)
> at
> org.codehaus.jackson.map.deser.std.UntypedObjectDeserializer.deserialize(UntypedObjectDeserializer.java:59)
> at
> org.codehaus.jackson.map.deser.std.MapDeserializer._readAndBind(MapDeserializer.java:319)
> at
> org.codehaus.jackson.map.deser.std.MapDeserializer.deserialize(MapDeserializer.java:249)
> at
> org.codehaus.jackson.map.deser.std.MapDeserializer.deserialize(MapDeserializer.java:33)
> at
> org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java:2732)
> at org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1863)
> at
> org.apache.samza.config.serializers.JsonConfigSerializer$.fromJson(JsonConfigSerializer.scala:34)
> at org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:72)
> at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
>
>
> On Thu, Mar 19, 2015 at 3:10 PM, Chris Riccomini <criccomini@apache.org
> <mailto:criccomini@apache.org>>
> wrote:
>
> Hey Jae,
>
> If you're using the PropertiesConfigFactory (the default), then it's just
> a
> Java Properties object. You should be able to escape it. I'm actually not
> even sure if quotes are a problem in Java Properties objects. I would
> think
> that they wouldn't be. The second '=' sign might be, though.
>
> In any case, to see what went wrong, you'll have to check your AM
> container
> logs. Can you find those? They're usually linked to from the YARN RM UI.
>
> Cheers,
> Chris
>
> On Thu, Mar 19, 2015 at 2:32 PM, Bae, Jae Hyeon <metacret@gmail.com
> <mailto:metacret@gmail.com>>
> wrote:
>
> Hi Samza Devs
>
> I want to pass the quoted string like
>
> filter.map.filter1.property=xpath("name") in ("uiBrowseStartup.ended",
> "subscription.ended", "uiStartup.ended") or xpath("category") =
> "uiIntent"
>
> through the configuration to the container but AM keeps failing
>
> Application application_1423090724595_0045 failed 2 times due to AM
> Container for appattempt_1423090724595_0045_000002 exited with
> exitCode: 1
> due to: Exception from container-launch:
> org.apache.hadoop.util.Shell$ExitCodeException:
> org.apache.hadoop.util.Shell$ExitCodeException:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:505)
> at org.apache.hadoop.util.Shell.run(Shell.java:418)
> at
>
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
> at
>
>
>
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>
> at
>
>
>
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:300)
>
> at
>
>
>
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
>
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> at
>
>
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
> at java.lang.Thread.run(Thread.java:745)
>   Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
>
> Any idea or recommendation?
>
> Thank you
> Best, Jae
>
>
>
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message