drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paul Rogers <par0...@yahoo.com.INVALID>
Subject Re: REST data source?
Date Tue, 24 Mar 2020 18:43:46 GMT
Hi Rafael,

We are seeing increasing interest in Drill obtaining data via REST. At present, there are
no real standards for things like telling the server which fields are wanted, or "pushing"
filter conditions to the source. It would be great if we can build on Charle's work to add
some kind of solution.

Can you share a bit about the REST service to which you want to connect? How does it handle
the "projection" and "filter" issues described above? How does it return the data? Streaming
JSON? JSON embedded in a response structure? Something else?

- Paul


    On Tuesday, March 24, 2020, 7:17:20 AM PDT, Jaimes, Rafael - 0993 - MITLL <rafael.jaimes@ll.mit.edu>
Thank you so much. I apologize, looks like someone asked a similar question right after I
checked the archives yesterday. This looks great.

-          Rafael 


From: Charles Givre <cgivre@gmail.com> 
Sent: Tuesday, March 24, 2020 10:14 AM
To: user@drill.apache.org
Cc: Jaimes, Rafael - 0993 - MITLL <Rafael.Jaimes@ll.mit.edu>
Subject: Re: REST data source?


Hi Rafael, 

Thanks for your interest in Drill.  To answer your question, there is a PR in progress which
allows you to query REST APIs from Drill. [1]. Here's a link to the documentation as well.
[2].  The idea behind Drill is to be able to query a wide variety of data sources, and this
PR will enable you to reach out to REST endpoints and query that data. 


Mechanically, this is very different from how Drill queries other RDBMS systems via JDBC.
 If you have any questions, please let me know. 





[1]: https://github.com/apache/drill/pull/1892

[2]: https://github.com/apache/drill/blob/27e72499a3a80c0b2927d532d2d4959d8be4eea6/contrib/storage-http/README.md



On Mar 24, 2020, at 9:22 AM, Jaimes, Rafael - 0993 - MITLL <Rafael.Jaimes@ll.mit.edu>


I know you can use REST API to query against Drill, but can Drill make REST queries itself?


It might seem unnecessary but if the idea is one stop shop for all querying, I don’t see
how it’s different than using SQL against Drill which then queries against a RDBMS using


Thanks in advance.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message