samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Milinda Pathirage" <mili...@apache.org>
Subject Re: Review Request 33280: [SAMZA-561] Basic streaming SQL query planning support
Date Sun, 19 Apr 2015 04:49:09 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33280/
-----------------------------------------------------------

(Updated April 19, 2015, 4:49 a.m.)


Review request for samza and Yi Pan (Data Infrastructure).


Bugs: SAMZA-561
    https://issues.apache.org/jira/browse/SAMZA-561


Repository: samza


Description
-------

This patch contains initial query execution planner implementation based on Apache Calcite.


- Basic 'insert into' and 'where' clause support
- Doesn't support projections, widnowing and aggregates. They will be added later.


Diffs
-----

  build.gradle a042567 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/Utils.java PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/planner/ExecutionPlanner.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/planner/QueryPlanner.java e1c22e9

  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/planner/RexToJavaCompiler.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/planner/rules/FilterableStreamScanRule.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/planner/rules/ProjectableStreamScanRule.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/planner/rules/RemoveIdentityProjectRule.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/rel/ProjectableFilterableStreamScan.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/rel/StreamScan.java PRE-CREATION

  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/schema/AvroSchemaConverter.java
705c0ff 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/schema/AvroSchemaUtils.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/schema/RelDataTypeUtils.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/schema/SamzaStreamType.java
PRE-CREATION 
  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/schema/Stream.java PRE-CREATION

  samza-sql-calcite/src/main/java/org/apache/samza/sql/calcite/task/StreamSqlTask.java PRE-CREATION

  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/planner/SamzaStreamTableFactory.java
fd87aa5 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/planner/TestExecutionPlanner.java
PRE-CREATION 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/planner/TestQueryPlanner.java
0bb15b2 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/planner/TestRexToJavaCompiler.java
PRE-CREATION 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/schema/TestAvroSchemaConverter.java
fbb5c59 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/schema/TestAvroSchemaUtils.java
PRE-CREATION 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/test/Constants.java PRE-CREATION

  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/test/OrderStreamTableFactory.java
PRE-CREATION 
  samza-sql-calcite/src/test/java/org/apache/samza/sql/calcite/test/Utils.java PRE-CREATION

  samza-sql-core/src/main/java/org/apache/samza/sql/Utils.java PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/api/data/Field.java PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/api/data/Schema.java 1e8f192 
  samza-sql-core/src/main/java/org/apache/samza/sql/api/expressions/Expression.java PRE-CREATION

  samza-sql-core/src/main/java/org/apache/samza/sql/api/operators/spec/OperatorSpec.java 96385e2

  samza-sql-core/src/main/java/org/apache/samza/sql/data/DataUtils.java PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/data/IntermediateMessageTuple.java PRE-CREATION

  samza-sql-core/src/main/java/org/apache/samza/sql/data/avro/AvroSchema.java 577cf74 
  samza-sql-core/src/main/java/org/apache/samza/sql/data/serializers/SqlAvroSerdeFactory.java
aad18f4 
  samza-sql-core/src/main/java/org/apache/samza/sql/data/string/StringSchema.java 348fc0c

  samza-sql-core/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorFactoryImpl.java
916b166 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorSpec.java
93d4ebb 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/factory/TypeAwareOperatorSpec.java
PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/insert/InsertToStreamOp.java
PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/insert/InsertToStreamSpec.java
PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/project/ProjectOp.java PRE-CREATION

  samza-sql-core/src/main/java/org/apache/samza/sql/operators/project/ProjectSpec.java PRE-CREATION

  samza-sql-core/src/main/java/org/apache/samza/sql/operators/scan/ProjectableFilterableStreamScanOp.java
PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/scan/ProjectableFilterableStreamScanSpec.java
PRE-CREATION 
  samza-sql-core/src/main/java/org/apache/samza/sql/operators/scan/StreamScanSpec.java PRE-CREATION

  samza-sql-core/src/test/java/org/apache/samza/sql/data/serializers/SqlAvroSerdeTest.java
7412669 
  samza-sql-core/src/test/java/org/apache/samza/sql/data/serializers/TestSqlAvroSerde.java
PRE-CREATION 
  samza-sql-core/src/test/resources/orders.avsc PRE-CREATION 
  samza-test/src/main/config/sql-filter.properties PRE-CREATION 
  samza-test/src/main/java/org/apache/samza/test/integration/sql/OrdersStreamFactory.java
PRE-CREATION 
  samza-test/src/main/python/integration_tests.py df64e23 
  samza-test/src/main/python/requirements.txt 2ae9590 
  samza-test/src/main/python/tests/sql_tests.py PRE-CREATION 
  samza-test/src/main/resources/orders.avsc PRE-CREATION 
  samza-test/src/main/resources/orders.json PRE-CREATION 

Diff: https://reviews.apache.org/r/33280/diff/


Testing (updated)
-------

* ./bin/check-all.sh passed.
* Integration tests passed including new streaming sql integration test.


Thanks,

Milinda Pathirage


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message