Hi,

 

I tried to load about a million records in postgres to see how long it takes as I was testing earlier with less than 100 records. When it was in the last step where it loads the data into postgres, I got an error something like “Unexpected error occurred. Check the logs” and after that I am unable to logon and I get this error. Could you please let me know what went wrong?

 

 

Nifi-app.log:

 

2017-11-09 16:42:04,423 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files in 4 milliseconds (Stop-the-world time = 0 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1

2017-11-09 16:42:07,977 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository

2017-11-09 16:42:08,019 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 0 Records and 0 Swap Files in 41 milliseconds (Stop-the-world time = 21 milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 100

2017-11-09 16:42:08,019 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 0 records in 41 milliseconds

2017-11-09 16:42:15,792 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93]

2017-11-09 16:42:15,793 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f]

2017-11-09 16:42:15,798 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a]

2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5]

2017-11-09 16:42:15,799 INFO [StandardProcessScheduler Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] to run with 1 threads

2017-11-09 16:42:15,799 INFO [NiFi Web Server-122] o.a.n.c.s.StandardProcessScheduler Starting UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc]

2017-11-09 16:42:15,803 INFO [StandardProcessScheduler Thread-1] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled UpdateRecord[id=352b83fa-015f-1000-b22f-1ce3e446367f] to run with 1 threads

2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-2] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled UpdateRecord[id=1221b2fe-015f-1000-9235-11d12a9fdbcc] to run with 1 threads

2017-11-09 16:42:15,804 INFO [StandardProcessScheduler Thread-6] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled GetFile[id=26d8ff6d-820e-34a9-0263-b2ab9e7c902a] to run with 1 threads

2017-11-09 16:42:15,850 INFO [StandardProcessScheduler Thread-7] o.a.n.c.s.TimerDrivenSchedulingAgent Scheduled PutS3Object[id=09a19ecf-2455-3687-43c0-74dc385164b5] to run with 1 threads

2017-11-09 16:42:17,252 INFO [Flow Service Tasks Thread-1] o.a.nifi.controller.StandardFlowService Saved flow controller org.apache.nifi.controller.FlowController@447301a2 // Another save pending = false

2017-11-09 16:42:23,755 INFO [Provenance Maintenance Thread-3] o.a.n.p.PersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 14

2017-11-09 16:42:23,788 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.lucene.SimpleIndexManager Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager and is no longer in use. Closing Index Writer

2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Successfully merged 16 journal files (3 records) into single Provenance Log File ./provenance_repository/11.prov in 45 milliseconds

2017-11-09 16:42:23,790 INFO [Provenance Repository Rollover Thread-2] o.a.n.p.PersistentProvenanceRepository Successfully Rolled over Provenance Event file containing 12 records. In the past 5 minutes, 3 events have been written to the Provenance Repository, totaling 2.33 KB

2017-11-09 16:43:04,174 INFO [Provenance Maintenance Thread-1] o.a.n.p.PersistentProvenanceRepository Created new Provenance Event Writers for events starting with ID 16

2017-11-09 16:44:30,309 ERROR [Event-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally

java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space

        at java.util.concurrent.FutureTask.report(FutureTask.java:122)

        at java.util.concurrent.FutureTask.get(FutureTask.java:192)

        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.OutOfMemoryError: Java heap space

        at org.apache.nifi.controller.EventDrivenWorkerQueue$WorkerReadyQueue.poll(EventDrivenWorkerQueue.java:201)

        at org.apache.nifi.controller.EventDrivenWorkerQueue.poll(EventDrivenWorkerQueue.java:61)

        at org.apache.nifi.controller.scheduling.EventDrivenSchedulingAgent$EventDrivenTask.run(EventDrivenSchedulingAgent.java:169)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        ... 2 common frames omitted

2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository Failed to cleanup archive for container default due to java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,310 ERROR [Cleanup Archive for default] o.a.n.c.repository.FileSystemRepository

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,310 WARN [NiFi Web Server-20-acceptor-0@27563558-ServerConnector@3cc819e2{SSL,[ssl, http/1.1]}{0.0.0.0:8443}] o.eclipse.jetty.server.AbstractConnector

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow Service Tasks Thread-2,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,311 ERROR [Flow Service Tasks Thread-2] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,312 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance Maintenance Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-3] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository Failed to expire Provenance Query Results due to java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,313 ERROR [Provenance Maintenance Thread-2] o.a.n.p.PersistentProvenanceRepository

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,313 ERROR [Timer-Driven Process Thread-8] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally

java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space

        at java.util.concurrent.FutureTask.report(FutureTask.java:122)

        at java.util.concurrent.FutureTask.get(FutureTask.java:192)

        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,313 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository

2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,315 ERROR [Timer-Driven Process Thread-4] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,316 WARN [Timer-Driven Process Thread-5] o.apache.nifi.controller.FlowController Unable to update Remote Process Groups due to java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,317 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims due to {}

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,317 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,317 INFO [Provenance Repository Rollover Thread-1] o.a.n.p.lucene.SimpleIndexManager Index Writer for ./provenance_repository/index-1507819090000 has been returned to Index Manager and is no longer in use. Closing Index Writer

2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow Service Tasks Thread-1,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,317 ERROR [Flow Service Tasks Thread-1] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally

java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space

        at java.util.concurrent.FutureTask.report(FutureTask.java:122)

        at java.util.concurrent.FutureTask.get(FutureTask.java:192)

        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:31,747 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files in 25381 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 0 millis), max Transaction ID -1

2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-2,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:30,318 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-3] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:31,748 ERROR [Timer-Driven Process Thread-2] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:33,203 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@5d5f3326 failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session: {}

java.lang.OutOfMemoryError: Java heap space

        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)

        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)

        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)

        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown Source)

        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown Source)

        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)

        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown Source)

        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)

        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)

        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)

        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)

        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)

        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2017-11-09 16:44:33,204 ERROR [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to process session due to java.lang.OutOfMemoryError: Java heap space: {}

java.lang.OutOfMemoryError: Java heap space

        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)

        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)

        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)

        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown Source)

        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown Source)

        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)

        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown Source)

        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)

        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)

        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)

        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)

        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)

        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded for 1 sec due to processing failure

2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:44:33,205 WARN [Timer-Driven Process Thread-10] o.a.n.c.t.ContinuallyRunProcessorTask

java.lang.OutOfMemoryError: Java heap space

        at org.postgresql.jdbc.PgPreparedStatement.setInt(PgPreparedStatement.java:306)

        at org.postgresql.jdbc.PgPreparedStatement.setObject(PgPreparedStatement.java:924)

        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)

        at org.apache.commons.dbcp.DelegatingPreparedStatement.setObject(DelegatingPreparedStatement.java:169)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.executeDML(PutDatabaseRecord.java:654)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$null$1(PutDatabaseRecord.java:382)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$246/806461661.apply(Unknown Source)

        at org.apache.nifi.processor.util.pattern.ExceptionHandler.execute(ExceptionHandler.java:127)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$new$3(PutDatabaseRecord.java:357)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$58/111888987.apply(Unknown Source)

        at org.apache.nifi.processor.util.pattern.Put.putFlowFiles(Put.java:59)

        at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:101)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.lambda$onTrigger$9(PutDatabaseRecord.java:689)

        at org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981.execute(Unknown Source)

        at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)

        at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)

        at org.apache.nifi.processors.standard.PutDatabaseRecord.onTrigger(PutDatabaseRecord.java:689)

        at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1119)

        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)

        at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)

        at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

        at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2017-11-09 16:44:33,678 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records and 0 Swap Files in 3365 milliseconds (Stop-the-world time = 3344 milliseconds, Clear Edit Logs time = 12 millis), max Transaction ID 104

2017-11-09 16:44:33,678 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 1 records in 3365 milliseconds

2017-11-09 16:44:34,211 INFO [FileSystemRepository Workers Thread-2] o.a.n.c.repository.FileSystemRepository Successfully archived 2 Resource Claims for Container default in 1 millis

2017-11-09 16:46:15,026 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,026 ERROR [Cleanup Archive for default] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally

java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space

        at java.util.concurrent.FutureTask.report(FutureTask.java:122)

        at java.util.concurrent.FutureTask.get(FutureTask.java:192)

        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,027 WARN [NiFi Web Server-20] o.e.jetty.util.thread.QueuedThreadPool Unexpected thread death: org.eclipse.jetty.util.thread.QueuedThreadPool$2@33e78315 in NiFi Web Server{STARTED,8<=8<=200,i=5,q=0}

2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-1] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally

java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space

        at java.util.concurrent.FutureTask.report(FutureTask.java:122)

        at java.util.concurrent.FutureTask.get(FutureTask.java:192)

        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,027 ERROR [FileSystemRepository Workers Thread-1] o.a.n.c.repository.FileSystemRepository Failed to cleanup content claims due to {}

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,027 ERROR [Framework Task Thread Thread-1] o.a.n.c.s.StandardProcessScheduler Failed to run Framework Task Expire FlowFiles due to java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,027 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] org.apache.nifi.processors.standard.PutDatabaseRecord$$Lambda$243/1454465981@2a991dcd failed to process due to java.lang.OutOfMemoryError: Java heap space; rolling back session: {}

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-2] org.apache.nifi.engine.FlowEngine A flow controller task execution stopped abnormally

java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space

        at java.util.concurrent.FutureTask.report(FutureTask.java:122)

        at java.util.concurrent.FutureTask.get(FutureTask.java:192)

        at org.apache.nifi.engine.FlowEngine.afterExecute(FlowEngine.java:100)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1157)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

Caused by: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Event-Driven Process Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,028 ERROR [Event-Driven Process Thread-4] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,028 ERROR [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] failed to process session due to java.lang.OutOfMemoryError: Java heap space: {}

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Provenance Maintenance Thread-4,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,028 ERROR [Provenance Maintenance Thread-4] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Flow Service Tasks Thread-3,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,029 ERROR [Flow Service Tasks Thread-3] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.p.standard.PutDatabaseRecord PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] Processor Administratively Yielded for 1 sec due to processing failure

2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi An Unknown Error Occurred in Thread Thread[Timer-Driven Process Thread-5,5,main]: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,029 ERROR [Timer-Driven Process Thread-5] org.apache.nifi.NiFi

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask Administratively Yielding PutDatabaseRecord[id=041fc840-4d80-322a-c9f7-71a695c3ce93] due to uncaught Exception: java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:15,029 WARN [Timer-Driven Process Thread-7] o.a.n.c.t.ContinuallyRunProcessorTask

java.lang.OutOfMemoryError: Java heap space

2017-11-09 16:46:31,754 INFO [Write-Ahead Local State Provider Maintenance] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@202fd4c4 checkpointed with 0 Records and 0 Swap Files in 6 milliseconds (Stop-the-world time = 1 milliseconds, Clear Edit Logs time = 1 millis), max Transaction ID -1

2017-11-09 16:46:33,679 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Initiating checkpoint of FlowFile Repository

2017-11-09 16:46:33,889 INFO [pool-10-thread-1] org.wali.MinimalLockingWriteAheadLog org.wali.MinimalLockingWriteAheadLog@28833fff checkpointed with 1 Records and 0 Swap Files in 210 milliseconds (Stop-the-world time = 41 milliseconds, Clear Edit Logs time = 161 millis), max Transaction ID 104

2017-11-09 16:46:33,889 INFO [pool-10-thread-1] o.a.n.c.r.WriteAheadFlowFileRepository Successfully checkpointed FlowFile Repository with 1 records in 210 milliseconds