Task Summary
The five files in amber/src/main/scala/org/apache/texera/amber/engine/common/ambermessage (WorkflowMessage, WorkflowFIFOMessagePayload, DirectControlMessagePayload, RecoveryPayload) define the message envelopes that flow through the engine, but only DataFrame.equals/DataFrame.inMemSize is currently tested. Add AmberMessageEnvelopesSpec:
WorkflowFIFOMessage and WorkflowRecoveryMessage envelope shape
RecoveryPayload subtypes (UpdateRecoveryStatus, ResendOutputTo, NotifyFailedNode) carry their args; the ResendOutputTo ActorRef field is exercised via a real Pekko ActorSystem
WorkflowMessage.getInMemSize returns the DataFrame.inMemSize for a DataFrame payload, zero for an empty-frame, and defaults to 200L for any other WorkflowFIFOMessagePayload
WorkflowFIFOMessagePayload and DirectControlMessagePayload traits are implementable
Priority
P3 – Low
Task Type
Task Summary
The five files in
amber/src/main/scala/org/apache/texera/amber/engine/common/ambermessage(WorkflowMessage,WorkflowFIFOMessagePayload,DirectControlMessagePayload,RecoveryPayload) define the message envelopes that flow through the engine, but onlyDataFrame.equals/DataFrame.inMemSizeis currently tested. AddAmberMessageEnvelopesSpec:WorkflowFIFOMessageandWorkflowRecoveryMessageenvelope shapeRecoveryPayloadsubtypes (UpdateRecoveryStatus,ResendOutputTo,NotifyFailedNode) carry their args; theResendOutputToActorRef field is exercised via a real PekkoActorSystemWorkflowMessage.getInMemSizereturns theDataFrame.inMemSizefor a DataFrame payload, zero for an empty-frame, and defaults to 200L for any other WorkflowFIFOMessagePayloadWorkflowFIFOMessagePayloadandDirectControlMessagePayloadtraits are implementablePriority
P3 – Low
Task Type