spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ionized <ioni...@gmail.com>
Subject Re: Spark SQL registerAsTable requires a Java Class?
Date Tue, 08 Jul 2014 20:04:23 GMT
Thanks for the heads-up.

In the meantime, we'd like to test this out ASAP - are there any open PR's
we could take to try it out? (or do you have an estimate on when some will
be available?)


On Tue, Jul 8, 2014 at 12:24 AM, Michael Armbrust <michael@databricks.com>
wrote:

> This is on the roadmap for the next release (1.1)
>
> JIRA: SPARK-2179 <https://issues.apache.org/jira/browse/SPARK-2179>
>
>
> On Mon, Jul 7, 2014 at 11:48 PM, Ionized <ionized@gmail.com> wrote:
>
>> The Java API requires a Java Class to register as table.
>>
>> // Apply a schema to an RDD of JavaBeans and register it as a table.JavaSchemaRDD
schemaPeople = sqlCtx.applySchema(people, Person.class);schemaPeople.registerAsTable("people");
>>
>> If instead of JavaRDD<Person> I had JavaRDD<List> (along with the
>> knowledge of column names and types that go along with the List) and wanted
>> to write a general-purpose registerAsTable, is there any other way besides
>> using ASM and dynamically creating Java Classes?
>>
>
>

Mime
View raw message