samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yi Pan \(Data Infrastructure\)" <yi...@linkedin.com>
Subject Review Request 54647: WIP: job-level fluent API
Date Mon, 12 Dec 2016 08:10:49 GMT

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/54647/
-----------------------------------------------------------

Review request for samza, Boris Shkolnik, Chris Pettitt, Jake Maes, Navina Ramesh, Prateek
Maheshwari, Jagadish Venkatraman, and Xinyu Liu.


Repository: samza


Description
-------

WIP: job level fluent API. Adding MessageStreamsBuilder to create SystemStream level DAG

Code example of this API to work w/ standalone and pipeline jobs are here: https://github.com/nickpan47/samza/blob/standalone-operators/samza-operator/src/test/java/org/apache/samza/pipeline/TestBasePipelineWithStreamsBuilder.java
and https://github.com/nickpan47/samza/blob/standalone-operators/samza-operator/src/test/java/org/apache/samza/processor/TestMessageStreamsBuilderBasedProcessor.java


Diffs
-----

  samza-api/src/main/java/org/apache/samza/operators/MessageStreamsBuilder.java PRE-CREATION

  samza-operator/src/main/java/org/apache/samza/operators/MessageStreamImpl.java 231d3f5fd9df36a1119f3b8663657c39aa3e1ecc

  samza-operator/src/main/java/org/apache/samza/operators/MessageStreamsBuilderImpl.java PRE-CREATION

  samza-operator/src/main/java/org/apache/samza/operators/MessageStreamsBuilderTask.java PRE-CREATION

  samza-operator/src/main/java/org/apache/samza/operators/impl/OperatorImpl.java c77914eebc96b0a9fbf296f10557c975cd7ed8df

  samza-operator/src/main/java/org/apache/samza/operators/impl/OperatorImpls.java 79446be310dfb70415003e217eaaa5c079bdac50

  samza-operator/src/main/java/org/apache/samza/operators/impl/SessionWindowOperatorImpl.java
e8a635c60fcbcadefc5ad9e605e9103ea4a5d0dc 
  samza-operator/src/main/java/org/apache/samza/operators/spec/OperatorSpec.java 8b75cdc6abe66724988870a2992e2aec211f0087

  samza-operator/src/main/java/org/apache/samza/operators/spec/OperatorSpecs.java f622b343ea7183ffc734866ff026137a04d03023

  samza-operator/src/main/java/org/apache/samza/operators/spec/PartialJoinOperatorSpec.java
f74f35d584d6e14b17bce139195b9566f8365378 
  samza-operator/src/main/java/org/apache/samza/operators/spec/SinkOperatorSpec.java 4348bc0e75ce45c9a6d5b555dfb6407b180137dc

  samza-operator/src/main/java/org/apache/samza/operators/spec/StreamOperatorSpec.java ed18da4f7d311aa540a145a275932aa4426d52da

  samza-operator/src/main/java/org/apache/samza/operators/spec/WindowOperatorSpec.java 2f5b1e76f2dfbecec44195142ffe309f46226d6c


Diff: https://reviews.apache.org/r/54647/diff/


Testing
-------


Thanks,

Yi Pan (Data Infrastructure)


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message