samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Pan (Data Infrastructure)" <yi...@linkedin.com>
Subject Review Request 30800: WIP: improving the manual operator interface
Date Mon, 09 Feb 2015 18:22:27 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30800/
-----------------------------------------------------------

Review request for samza, Chris Riccomini, Navina Ramesh, and Naveen Somasundaram.


Bugs: SAMZA-482
    https://issues.apache.org/jira/browse/SAMZA-482


Repository: samza


Description
-------

WIP: improving the manual operator interface
- Separated in-memory operator output collector vs the system stream message collector
- Added implementation of a in-memory output buffer collector
- Created manual operator classes to make random use case more intuitive


Diffs
-----

  samza-sql/src/main/java/org/apache/samza/sql/api/data/Relation.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/api/operators/ManualOperator.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/api/operators/Operator.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/api/operators/RelationOperator.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/api/operators/TupleOperator.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/data/OrderedRelationBuf.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperator.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorFactoryImpl.java
PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/factory/SimpleOperatorSpec.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/partition/PartitionOp.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/partition/PartitionSpec.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/relation/Join.java PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/relation/JoinSpec.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/relation/ManualJoin.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/stream/InsertStream.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/stream/InsertStreamSpec.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/window/BoundedTimeWindow.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/sql/operators/window/ManualFixedTimeWindow.java
PRE-CREATION 
  samza-sql/src/main/java/org/apache/samza/sql/operators/window/WindowSpec.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/task/sql/BufferedOutputCollector.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/task/sql/OperatorMessageCollector.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/task/sql/SqlMessageCollector.java PRE-CREATION

  samza-sql/src/main/java/org/apache/samza/task/sql/StoreMessageCollector.java PRE-CREATION

  samza-sql/src/test/java/org/apache/samza/task/sql/RandomOperatorTask.java PRE-CREATION 
  samza-sql/src/test/java/org/apache/samza/task/sql/StreamSqlTask.java PRE-CREATION 

Diff: https://reviews.apache.org/r/30800/diff/


Testing
-------

./gradlew clean build passed


Thanks,

Yi Pan (Data Infrastructure)


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message