spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rémy DUBOIS (JIRA) <j...@apache.org>
Subject [jira] [Comment Edited] (SPARK-6401) Unable to load a old API input format in Spark streaming
Date Wed, 18 Mar 2015 20:18:38 GMT

    [ https://issues.apache.org/jira/browse/SPARK-6401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14367789#comment-14367789
] 

Rémy DUBOIS edited comment on SPARK-6401 at 3/18/15 8:18 PM:
-------------------------------------------------------------

Yes I mean the mapred API.

All our input formats are developed in mapred API so it would allow us to avoid rewriting
them in mapreduce API.
Since the batch API can read from a mapred InputFormat, don't you think it would be more consistent
to have the same possibility in the streaming API?


was (Author: rdubois):
Yes I mean the mapred API.

All our input formats are developed in mapred API so it would allow us to avoid rewriting
them in mapreduce API. Or at least, it would allow us to do it gradually.
Since the batch API can read from a mapred InputFormat, don't you think it would be more consistent
to have the same possibility in the streaming API?

> Unable to load a old API input format in Spark streaming
> --------------------------------------------------------
>
>                 Key: SPARK-6401
>                 URL: https://issues.apache.org/jira/browse/SPARK-6401
>             Project: Spark
>          Issue Type: Improvement
>            Reporter: Rémy DUBOIS
>            Priority: Minor
>
> The fileStream method of the JavaStreamingContext class does not allow using a old API
InputFormat.
> This feature exists in Spark batch but not in streaming.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message