nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alberto Bengoa <albe...@propus.com.br>
Subject Re: Hyphenated Tables and Columns names
Date Wed, 06 Dec 2017 18:06:57 GMT
Matt,

Perfect! Enabled and working now.

Thank you!

Cheers,
Alberto



On Wed, Dec 6, 2017 at 3:54 PM, Matt Burgess <mattyb149@apache.org> wrote:

> Alberto,
>
> What version of NiFi are you using? As of version 1.1.0,
> QueryDatabaseTable has a "Normalize Table/Column Names" property that
> you can set to true, and it will replace all Avro-illegal characters
> with underscores.
>
> Regards,
> Matt
>
>
> On Wed, Dec 6, 2017 at 12:06 PM, Alberto Bengoa <alberto@propus.com.br>
> wrote:
> > Hey Folks,
> >
> > I'm facing an odd situation with Nifi and Tables / Columns that have
> hyphens
> > on names (traceback below).
> >
> > I found on Avro Spec [1] that hyphens are not allowed, which makes sense
> to
> > have this error.
> >
> > There is any way to deal with this situation on Nifi instead of changing
> > table/columns name or creating views to rename the hyphenated names?
> >
> > I'm getting this error on the first processor (QueryDatabaseTable) of my
> > flow.
> >
> > Thanks!
> >
> > Alberto Bengoa
> >
> > [1] - https://avro.apache.org/docs/1.7.7/spec.html#Names
> >
> >
> > 2017-12-06 14:37:25,809 ERROR [Timer-Driven Process Thread-2]
> > o.a.n.p.standard.QueryDatabaseTable
> > QueryDatabaseTable[id=9557387b-bbd6-1b2f-b68b-5a4458986794] Unable to
> > execute SQL select query SELECT "_Change-Sequence" FROM
> PUB.man_factory_cdc
> > due to org.apache.nifi.processor.exception.ProcessException: Error
> during
> > database query or conversion of records to Avro.: {}
> > org.apache.nifi.processor.exception.ProcessException: Error during
> database
> > query or conversion of records to Avro.
> >         at
> > org.apache.nifi.processors.standard.QueryDatabaseTable.
> lambda$onTrigger$0(QueryDatabaseTable.java:289)
> >         at
> > org.apache.nifi.controller.repository.StandardProcessSession.write(
> StandardProcessSession.java:2526)
> >         at
> > org.apache.nifi.processors.standard.QueryDatabaseTable.
> onTrigger(QueryDatabaseTable.java:283)
> >         at
> > org.apache.nifi.controller.StandardProcessorNode.onTrigger(
> StandardProcessorNode.java:1118)
> >         at
> > org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(
> ContinuallyRunProcessorTask.java:147)
> >         at
> > org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(
> ContinuallyRunProcessorTask.java:47)
> >         at
> > org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(
> TimerDrivenSchedulingAgent.java:132)
> >         at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> >         at java.util.concurrent.FutureTask.runAndReset(
> FutureTask.java:308)
> >         at
> > java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> >         at
> > java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> >         at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >         at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >         at java.lang.Thread.run(Thread.java:745)
> > Caused by: org.apache.avro.SchemaParseException: Illegal character in:
> > _Change-Sequence
> >
>

Mime
View raw message