nifi-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aruna Sankaralingam <Aruna.Sankaralin...@Cormac-Corp.com>
Subject Nifi : 504 Gateway Time-Out Error
Date Thu, 09 Nov 2017 16:53:28 GMT
Hi,

I tried to load about a million records in postgres to see how long it takes as I was testing
earlier with less than 100 records. When it was in the last step where it loads the data into
postgres, I got an error something like "Unexpected error occurred. Check the logs" and after
that I am unable to logon and I get this error. Could you please let me know what went wrong?

[cid:image001.png@01D35951.5A5CCA90]

Nifi-app.log:

2017-11-09 16:42:04,423 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files
in 4 milliseconds (Stop-the-world time = 0 milliseconds, Clear Edit Logs time = 0 millis),
max Transaction ID -1
2017-11-09 16:42:07,977 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating
checkpoint of FlowFile Repository
2017-11-09 16:42:08,019 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff
checkpointed with 0 Records and 0 Swap Files in 41 milliseconds (Stop-the-world time = 21
milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 100
2017-11-09 16:42:08,019 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully
checkpointed FlowFile Repository with 0 records in 41 milliseconds
2017-11-09 16:42:15,792 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]
2017-11-09 16:42:15,793 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f]
2017-11-09 16:42:15,798 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a]
2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5]
2017-11-09 16:42:15,799 INFO [StandardProcessScheduler Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] to run with 1 threads
2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting
UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc]
2017-11-09 16:42:15,803 INFO [StandardProcessScheduler Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] to run with 1 threads
2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-2] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] to run with 1 threads
2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-6] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] to run with 1 threads
2017-11-09 16:42:15,850 INFO [StandardProcessScheduler Thread-7] o.a.n.c.s.TimerDrivenSchedulingAgent
Scheduled PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] to run with 1 threads
2017-11-09 16:42:17,252 INFO [Flow Service Tasks Thread-1] o.a.nifi.controller.StandardFlowService
Saved flow controller org.apache.nifi.controller.FlowController@447301a2 // Another save pending
= false
2017-11-09 16:42:23,755 INFO [Provenance Maintenance Thread-3] o.a.n.p.PersistentProvenanceRepository
Created new Provenance Event Writers for events starting with ID 14
2017-11-09 16:42:23,788 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.lucene.SimpleIndexManager
Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager
and is no longer in use. Closing Index Writer
2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository
Successfully merged 16 journal files (3 records) into single Provenance Log File ./provenance_repository/11.prov
in 45 milliseconds
2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository
Successfully Rolled over Provenance Event file containing 12 records. In the past 5 minutes,
3 events have been written to the Provenance Repository, totaling 2.33 KB
2017-11-09 16:43:04,174 INFO [Provenance Maintenance Thread-1] o.a.n.p.PersistentProvenanceRepository
Created new Provenance Event Writers for events starting with ID 16
2017-11-09 16:44:30,309 ERROR [Event-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at org.apache.nifi.controller.EventDrivenWorkerQueue$WorkerReadyQueue.poll(EventDrivenWorkerQueue.java:201)
        at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:61)
        at org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:169)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        ... 2 common frames omitted
2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository
Failed to cleanup archive for container default due to java.lang.OutOfMemoryError: Java heap
space
2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,310 WARN [NiFi Web Server-20-acceptor-0@27563558-ServerConnector@3cc819e2{SSL,[ssl,
http/1.1]}{0.0.0.0:8443}] o.eclipse.jetty.server.AbstractConnector
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Flow Service Tasks Thread-2,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,312 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Provenance Maintenance Thread-3,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository
Failed to expire Provenance Query Results due to java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 ERROR [Timer-Driven Process Thread-8] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,313 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating
checkpoint of FlowFile Repository
2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,316 WARN [Timer-Driven Process Thread-5] o.apache.nifi.controller.FlowController
Unable to update Remote Process Groups due to java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,317 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository
Failed to cleanup content claims due to {}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,317 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler
Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap
space
2017-11-09 16:44:30,317 INFO [Provenance Repository Rollover Thread-1] o.a.n.p.lucene.SimpleIndexManager
Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager
and is no longer in use. Closing Index Writer
2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Flow Service Tasks Thread-1,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:31,747 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files
in 25381 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 0 millis),
max Transaction ID -1
2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-2,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-3,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:33,203 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@5d5f3326
failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session:
{}
java.lang.OutOfMemoryError: Java heap space
        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)
        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)
        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2017-11-09 16:44:33,204 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]
failed to process session due to java.lang.OutOfMemoryError: Java heap space: {}
java.lang.OutOfMemoryError: Java heap space
        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)
        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)
        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded
for 1 sec due to processing failure
2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask
Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to
uncaught Exception: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask
java.lang.OutOfMemoryError: Java heap space
        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)
        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)
        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)
        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown
Source)
        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)
        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2017-11-09 16:44:33,678 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff
checkpointed with 1 Records and 0 Swap Files in 3365 milliseconds (Stop-the-world time = 3344
milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 104
2017-11-09 16:44:33,678 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully
checkpointed FlowFile Repository with 1 records in 3365 milliseconds
2017-11-09 16:44:34,211 INFO [FileSystemRepository Workers Thread-2] o.a.n.c.repository.FileSystemRepository
Successfully archived 2 Resource Claims for Container default in 1 millis
2017-11-09 16:46:15,026 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,026 ERROR [Cleanup Archive for default] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,027 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool Unexpected
thread death: org.eclipse.jetty.util.thread.QueuedThreadPool$2@33e78315 in NiFi Web Server{STARTED,8<=8<=200,i=5,q=0}
2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,027 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository
Failed to cleanup content claims due to {}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,027 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler
Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap
space
2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@2a991dcd
failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session:
{}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-2] org.apache.nifi.engine.FlowEngine
A flow controller task execution stopped abnormally
java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:192)
        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Event-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]
failed to process session due to java.lang.OutOfMemoryError: Java heap space: {}
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Provenance Maintenance Thread-4,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Flow Service Tasks Thread-3,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord
PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded
for 1 sec due to processing failure
2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi An Unknown
Error Occurred in Thread Thread[Timer-Driven Process Thread-5,5,main]: java.lang.OutOfMemoryError:
Java heap space
2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask
Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to
uncaught Exception: java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask
java.lang.OutOfMemoryError: Java heap space
2017-11-09 16:46:31,754 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog
org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files
in 6 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 1 millis),
max Transaction ID -1
2017-11-09 16:46:33,679 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating
checkpoint of FlowFile Repository
2017-11-09 16:46:33,889 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff
checkpointed with 1 Records and 0 Swap Files in 210 milliseconds (Stop-the-world time = 41
milliseconds, Clear Edit Logs time = 161 millis), max Transaction ID 104
2017-11-09 16:46:33,889 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully
checkpointed FlowFile Repository with 1 records in 210 milliseconds


Mime
View raw message