drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 王亮 <wanglian...@gmail.com>
Subject Query local files in different machines?
Date Sun, 05 Aug 2018 08:55:12 GMT
Hi all,

I have apache HTTP server logs in different machines and want to query
these log files.

So I  install the drill (distributed mode) in these machines, for example,

I use  this command:
sqlline –u jdbc:drill:zk:node1,node2
sqlline –u jdbc:drill:drillbit:node1,node2

then input query like: select count(*) from dfs.`/apache/logs/access_log`
I could only get the data of one machine.

Maybe I can upload all logs file to s3 or Hadoop.
But is there an easy way to query all local files in different machines by

If we need develop the new features to support this requirement, How much
work we should do?  for example, only revise the physical plan distribution
codes? or need write the completely new data source plugin?

I found these discussions, but seems no clear answer.





Wang Liang

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message