Skip to content

feat: implement reduce stream sdk#91

Merged
KeranYang merged 11 commits into
numaproj:mainfrom
KeranYang:reduce-stream
Jan 23, 2024
Merged

feat: implement reduce stream sdk#91
KeranYang merged 11 commits into
numaproj:mainfrom
KeranYang:reduce-stream

Conversation

@KeranYang
Copy link
Copy Markdown
Member

@KeranYang KeranYang commented Jan 15, 2024

  • Define the user interface as two methods - processMessage and handleEndOfStream.
  • Continue using akka to handle concurrency. Introduce an OutputActor to make sure we are sending responses back to the gRPC output stream synchronously.

Testing: I developed a simple e2e test and it passed. KeranYang/numaflow#97

Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
@KeranYang KeranYang changed the title feat: implement reduce stream sdk feat(WIP): implement reduce stream sdk Jan 15, 2024
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Comment thread src/main/java/io/numaproj/numaflow/reducestreamer/model/Datum.java
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
@KeranYang KeranYang changed the title feat(WIP): implement reduce stream sdk feat: implement reduce stream sdk Jan 18, 2024
@KeranYang KeranYang marked this pull request as ready for review January 18, 2024 01:19
@KeranYang KeranYang requested review from a team and yhl25 January 18, 2024 01:19
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Comment thread src/main/java/io/numaproj/numaflow/reducestreamer/ResponseStreamActor.java Outdated
Comment thread src/main/java/io/numaproj/numaflow/reducestreamer/ActorResponseType.java Outdated
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Comment thread src/main/java/io/numaproj/numaflow/reducestreamer/OutputActor.java Outdated
Signed-off-by: Keran Yang <yangkr920208@gmail.com>
@KeranYang KeranYang merged commit cb91f37 into numaproj:main Jan 23, 2024
KeranYang added a commit to KeranYang/numaflow-java that referenced this pull request Jan 22, 2025
* Define the user interface as two methods - processMessage and handleEndOfStream.
* Continue using akka to handle concurrency. Introduce an OutputActor to make sure we are sending responses back to the gRPC output stream synchronously.

Signed-off-by: Keran Yang <yangkr920208@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants