nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aruna Sankaralingam <Aruna.Sankaralin...@Cormac-Corp.com>
Subject RE: Nifi : 504 Gateway Time-Out Error
Date Thu, 09 Nov 2017 18:29:39 GMT
Thank you Matt. Could you please let me know where I can find the bootstrap.conf file?

Out of the two options you have given, which one is recommended?

From: Matt Burgess [mailto:mattyb149@apache.org]
Sent: Thursday, November 09, 2017 12:14 PM
To: users@nifi.apache.org
Subject: Re: Nifi : 504 Gateway Time-Out Error

Aruna,

The reason you can no longer log in is due to the Out Of Memory Error occurring on the JVM
running NiFi. I believe you will need to restart NiFi in order to reconnect.

For the original issue, PutDatabaseRecord uses the JDBC driver to set up a prepared statement
along with rows of values. Each incoming record will be a row, and each column/field in that
row becomes an object stored by the driver.  With a million records, I presume it takes more
memory to store these objects than you have allocated to your JVM's heap. There are a couple
of options:

1) Increase your heap size in the bootstrap.conf file. This might get things moving again
but is not a scalable solution (i.e. 2 million rows might make you run out of memory again).
2) Use SplitRecord [1] before PutDatabaseRecord, to split the million-record file into slightly
smaller files (say, 10000 records per split or so, although you may need to tune this value
based on your available memory)

The latter option will still allow multiple records to be processed at once, but they can
be done in smaller chunks, so memory can be reused for the next chunk, rather than having
to have all million rows in memory at once.

Regards,
Matt

[1] http://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.4.0/org.apache.nifi.processors.standard.SplitRecord/index.html


On Thu, Nov 9, 2017 at 11:53 AM, Aruna Sankaralingam <Aruna.Sankaralingam@cormac-corp.com<mailto:Aruna.Sankaralingam@cormac-corp.com>>
wrote:
Hi,

I tried to load about a million records in postgres to see how long it takes as I was testing
earlier with less than 100 records. When it was in the last step where it loads the data into
postgres, I got an error something like “Unexpected error occurred. Check the logs” and
after that I am unable to logon and I get this error. Could you please let me know what went
wrong?

[cid:image001.png@01D3595E.CBE6E120]

Nifi-app.log:

2017-11-09 16:42:04,423 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@202fd4c4<mailto:org.wali.MinimalLockingWriteAheadLog@202fd4c4>
checkpointed with 0 Records and 0 Swap Files in 4 milliseconds (Stop-the-world time = 0 milliseconds,
Clear Edit Logs time = 0 millis), max Transaction ID -1
2017-11-09 16:42:07,977 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating
checkpoint of FlowFile Repository
2017-11-09 16:42:08,019 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff<mailto:org.wali.MinimalLockingWriteAheadLog@28833fff>
checkpointed with 0 Records and 0 Swap Files in 41 milliseconds (Stop-the-world time = 21
milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 100
2017-11-09 16:42:08,019 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully
checkpointed FlowFile Repository with 0 records in 41 milliseconds
2017-11-09 16:42:15,792 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]
2017-11-09 16:42:15,793 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f]
2017-11-09 16:42:15,798 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a]
2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5]
2017-11-09 16:42:15,799 INFO [StandardProcessScheduler Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] to run with 1 threads
2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc]
2017-11-09 16:42:15,803 INFO [StandardProcessScheduler Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] to run with 1 threads
2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-2] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] to run with 1 threads
2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-6] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] to run with 1 threads
2017-11-09 16:42:15,850 INFO [StandardProcessScheduler Thread-7] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] to run with 1 threads
2017-11-09 16:42:17,252 INFO [Flow Service Tasks Thread-1] o.a.nifi.controller.StandardFlowService
Saved flow controller org.apache.nifi.controller.FlowController@447301a2<mailto:org.apache.nifi.controller.FlowController@447301a2>
// Another save pending = false
2017-11-09 16:42:23,755 INFO [Provenance Maintenance Thread-3] o.a.n.p.PersistentProvenanceRepository
Created new Provenance Event Writers for events starting with ID 14
2017-11-09 16:42:23,788 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.lucene.SimpleIndexManager
Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager
and is no longer in use. Closing Index Writer
2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository
Successfully merged 16 journal files (3 records) into single Provenance Log File ./provenance_repository/11.prov
in 45 milliseconds
2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository
Successfully Rolled over Provenance Event file containing 12 records. In the past 5 minutes,
3 events have been written to the Provenance Repository, totaling 2.33 KB
2017-11-09 16:43:04,174 INFO [Provenance Maintenance Thread-1] o.a.n.p.PersistentProvenanceRepository
Created new Provenance Event Writers for events starting with ID 16
2017-11-09 16:44:30,309 ERROR [Event-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at org.apache.nifi.controller.EventDrivenWorkerQueue$WorkerReadyQueue.poll(EventDrivenWorkerQueue.java:201)
        at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:61)
        at org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:169)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        ... 2 common frames omitted
2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository
Failed to cleanup archive for container default due to java.lang.OutOfMemoryError: Java heap
space
2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,310 WARN [NiFi Web Server-20-acceptor-0@27563558-ServerConnector@3cc819e2{SSL,[ssl,
http/1.1]}{0.0.0.0:8443<http://0.0.0.0:8443>}] o.eclipse.jetty.server.AbstractConnector
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Flow Service Tasks Thread-2,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,312 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Provenance Maintenance Thread-3,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository
Failed to expire Provenance Query Results due to java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 ERROR [Timer-Driven Process Thread-8] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating
checkpoint of FlowFile Repository
2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,316 WARN [Timer-Driven Process Thread-5] o.apache.nifi.controller.FlowController
Unable to update Remote Process Groups due to java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,317 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository
Failed to cleanup content claims due to {}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,317 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler
Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap
space
2017-11-09 16:44:30,317 INFO [Provenance Repository Rollover Thread-1] o.a.n.p.lucene.SimpleIndexManager
Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager
and is no longer in use. Closing Index Writer
2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Flow Service Tasks Thread-1,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:31,747 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@202fd4c4<mailto:org.wali.MinimalLockingWriteAheadLog@202fd4c4>
checkpointed with 0 Records and 0 Swap Files in 25381 milliseconds (Stop-the-world time =
1 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1
2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-2,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-3,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:33,203 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@5d5f3326<mailto:org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@5d5f3326>
failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session:
{}
java.lang.OutOfMemoryError: Java heap space
        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)
        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)
        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2017-11-09 16:44:33,204 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]
failed to process session due to java.lang.OutOfMemoryError: Java heap space: {}
java.lang.OutOfMemoryError: Java heap space
        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)
        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)
        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded
for 1 sec due to processing failure
2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask
Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to
uncaught Exception: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask
java.lang.OutOfMemoryError: Java heap space
        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)
        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)
        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2017-11-09 16:44:33,678 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff<mailto:org.wali.MinimalLockingWriteAheadLog@28833fff>
checkpointed with 1 Records and 0 Swap Files in 3365 milliseconds (Stop-the-world time = 3344
milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 104
2017-11-09 16:44:33,678 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully
checkpointed FlowFile Repository with 1 records in 3365 milliseconds
2017-11-09 16:44:34,211 INFO [FileSystemRepository Workers Thread-2] o.a.n.c.repository.FileSystemRepository
Successfully archived 2 Resource Claims for Container default in 1 millis
2017-11-09 16:46:15,026 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,026 ERROR [Cleanup Archive for default] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,027 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool Unexpected
thread death: org.eclipse.jetty.util.thread.QueuedThreadPool$2@33e78315<mailto:org.eclipse.jetty.util.thread.QueuedThreadPool$2@33e78315>
in NiFi Web Server{STARTED,8<=8<=200,i=5,q=0}
2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,027 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository
Failed to cleanup content claims due to {}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,027 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler
Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap
space
2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@2a991dcd<mailto:org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@2a991dcd>
failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session:
{}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-2] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Event-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]
failed to process session due to java.lang.OutOfMemoryError: Java heap space: {}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Provenance Maintenance Thread-4,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Flow Service Tasks Thread-3,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded
for 1 sec due to processing failure
2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-5,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask
Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to
uncaught Exception: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:31,754 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@202fd4c4<mailto:org.wali.MinimalLockingWriteAheadLog@202fd4c4>
checkpointed with 0 Records and 0 Swap Files in 6 milliseconds (Stop-the-world time = 1 milliseconds,
Clear Edit Logs time = 1 millis), max Transaction ID -1
2017-11-09 16:46:33,679 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating
checkpoint of FlowFile Repository
2017-11-09 16:46:33,889 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff<mailto:org.wali.MinimalLockingWriteAheadLog@28833fff>
checkpointed with 1 Records and 0 Swap Files in 210 milliseconds (Stop-the-world time = 41
milliseconds, Clear Edit Logs time = 161 millis), max Transaction ID 104
2017-11-09 16:46:33,889 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully
checkpointed FlowFile Repository with 1 records in 210 milliseconds


Mime
View raw message