samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shekar Tippur <ctip...@gmail.com>
Subject Re: Couple of issues with malformed jsons
Date Tue, 16 Dec 2014 22:10:10 GMT
You are right chris. I seem to be using 0.7 in one of my environments.
Let me try the latest version.

- Shekar

On Tue, Dec 16, 2014 at 1:46 PM, Chris Riccomini <
criccomini@linkedin.com.invalid> wrote:
>
> Hey Shekar,
>
> Are you running against 0.7.0 or 0.8.?
>
> Cheers,
> Chris
>
> On 12/16/14 1:42 PM, "Shekar Tippur" <ctippur@gmail.com> wrote:
>
> >Chris -
> >
> >I have tried adding both:
> >
> >task.drop.deserialization.errors=true
> >
> >task.ignored.exceptions=org.codehaus.jackson.JsonParseException
> >
> >Samza still crashes.
> >
> >
> >- Shekar
> >
> >On Tue, Dec 16, 2014 at 1:30 PM, Chris Riccomini <
> >criccomini@linkedin.com.invalid> wrote:
> >>
> >> Hey Shekar,
> >>
> >> The default behavior for Samza when a serialization exception occurs is
> >>to
> >> fail the container, which will eventually trigger a failure of the job.
> >> Samza is very conservative about things--by default it will try to never
> >> drop messages. In a case where deserialization fails, you have two
> >> options: fail, or drop (or some version of drop, like log bad msgs to a
> >> different topic). Samza fails by default.
> >>
> >> To drop, you can set this configuration:
> >>
> >>   task.drop.deserialization.errors
> >>
> >>
> >> See
> >>
> >>
> http://samza.incubator.apache.org/learn/documentation/0.8/jobs/configurat
> >>io
> >> n-table.html for details.
> >>
> >> Cheers,
> >> Chris
> >>
> >> On 12/16/14 12:44 PM, "Shekar Tippur" <ctippur@gmail.com> wrote:
> >>
> >> >Hello,
> >> >
> >> >I am facing issue when I pass a malformed json.
> >> >
> >> >
> >> >I was testing on how the system would behave if I sent a malformed
> >>json. I
> >> >seem to get a jsonparse exception and the samza process terminates. Any
> >> >idea on what could be going on and how to mitigate this?
> >> >
> >> >Exception in thread "ThreadJob"
> >>org.codehaus.jackson.JsonParseException:
> >> >Unexpected character ('D' (code 68)): expected a valid value (number,
> >> >String, array, object, 'true', 'false' or 'null')
> >> >
> >> > at [Source: [B@ef49347; line: 1, column: 16]
> >> >
> >> >        at
> >> >org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1291)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserM
> >>>in
> >> >imalBase.java:385)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(Js
> >>>on
> >> >ParserMinimalBase.java:306)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.impl.Utf8StreamParser._handleUnexpectedValue(Utf8St
> >>>re
> >> >amParser.java:1582)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.ja
> >>>va
> >> >:386)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.map.deser.UntypedObjectDeserializer.mapObject(Untyp
> >>>ed
> >> >ObjectDeserializer.java:173)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.map.deser.UntypedObjectDeserializer.deserialize(Unt
> >>>yp
> >> >edObjectDeserializer.java:76)
> >> >
> >> >        at
> >>
> >>>org.codehaus.jackson.map.ObjectMapper._readMapAndClose(ObjectMapper.java
> >>>:2
> >> >402)
> >> >
> >> >        at
> >> >org.codehaus.jackson.map.ObjectMapper.readValue(ObjectMapper.java:1674)
> >> >
> >> >        at
> >> >org.apache.samza.serializers.JsonSerde.fromBytes(JsonSerde.scala:33)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.serializers.SerdeManager.fromBytes(SerdeManager.scala:1
> >>>15
> >> >)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.system.SystemConsumers$$anonfun$org$apache$samza$system
> >>>$S
> >> >ystemConsumers$$poll$5.apply(SystemConsumers.scala:245)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.system.SystemConsumers$$anonfun$org$apache$samza$system
> >>>$S
> >> >ystemConsumers$$poll$5.apply(SystemConsumers.scala:242)
> >> >
> >> >        at scala.collection.Iterator$class.foreach(Iterator.scala:727)
> >> >
> >> >        at
> >>scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
> >> >
> >> >        at
> >> >scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
> >> >
> >> >        at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
> >> >
> >> >        at org.apache.samza.system.SystemConsumers.org
> >> >$apache$samza$system$SystemConsumers$$poll(SystemConsumers.scala:242)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.system.SystemConsumers$$anon$1$$anonfun$call$2.apply(Sy
> >>>st
> >> >emConsumers.scala:180)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.system.SystemConsumers$$anon$1$$anonfun$call$2.apply(Sy
> >>>st
> >> >emConsumers.scala:180)
> >> >
> >> >        at
> >>
> >>>scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.sc
> >>>al
> >> >a:244)
> >> >
> >> >        at
> >>
> >>>scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.sc
> >>>al
> >> >a:244)
> >> >
> >> >        at scala.collection.Iterator$class.foreach(Iterator.scala:727)
> >> >
> >> >        at
> >>scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
> >> >
> >> >        at
> >> >scala.collection.MapLike$DefaultKeySet.foreach(MapLike.scala:174)
> >> >
> >> >        at
> >> >scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
> >> >
> >> >        at
> >>
> >>>scala.collection.AbstractSet.scala$collection$SetLike$$super$map(Set.sca
> >>>la
> >> >:47)
> >> >
> >> >        at scala.collection.SetLike$class.map(SetLike.scala:93)
> >> >
> >> >        at scala.collection.AbstractSet.map(Set.scala:47)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.system.SystemConsumers$$anon$1.call(SystemConsumers.sca
> >>>la
> >> >:180)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.util.DoublingBackOff.maybeCall(DoublingBackOff.scala:44
> >>>)
> >> >
> >> >        at
> >>
> >>>org.apache.samza.system.SystemConsumers.choose(SystemConsumers.scala:208
> >>>)
> >> >
> >> >        at org.apache.samza.container.RunLoop.process(RunLoop.scala:73)
> >> >
> >> >        at org.apache.samza.container.RunLoop.run(RunLoop.scala:57)
> >> >
> >> >        at
> >> >org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:504)
> >> >
> >> >        at
> >> >org.apache.samza.job.local.ThreadJob$$anon$1.run(ThreadJob.scala:42)
> >>
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message