spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kmat <kurianmath...@hotmail.com>
Subject RE: Spark 2.0 Continuous Processing
Date Fri, 01 Jul 2016 01:01:13 GMT
In a continuous processing pipeline with dataframes is there any way to checkpoint the processing
state (by the user) at periodic intervals. The thought process behind this is to rewind to
any particular checkpoint and then fast forward processing thereon.
Date: Wed, 29 Jun 2016 23:17:47 -0700
From: ml-node+s1001560n27250h41@n3.nabble.com
To: kurianmathewp@hotmail.com
Subject: Re: Spark 2.0 Continuous Processing



	 it also supports interactive and batch queries. With Spark 2.0, DataFrames and Datasets
are being combined and which ensures that an event or file is processed once, and only once.Writing
resources are guaranteed that grammar and spelling all will remain accurate and correct.

	
	
	
	

	

	
	
		If you reply to this email, your message will be added to the discussion below:
		http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-0-Continuous-Processing-tp27226p27250.html
	
	
		
		To unsubscribe from Spark 2.0 Continuous Processing, click here.

		NAML
	 		 	   		  



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-2-0-Continuous-Processing-tp27226p27253.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Mime
View raw message