RFC: Addition of BatchProcessing Utilities for EventSource Mapping triggers (akin to python utility)

[walmsles]

BatchProcessing Utility

Adding a BatchProcessing utility with the feature set from Python is needed to simplify coding and developer experience around processing data from EventSource mappings.

• RFC PR: (leave this empty)
• Related issue(s), if known:
• Area: BatchProcessor (new)
• Meet tenets: Yes
• Approved by: ''
• Reviewed by: ''

Summary

Motivation

This utility IMO allows teams to move faster and not make silly mistakes in batch processing - it provides a safety net for new serverless developers who make similar mistakes over and over, which I can prevent by making them use Python 😬. The automated handling of Batch Errors in Python is Out of the Box and dead simple to use, so Devs can get it right 100% of the time without thinking too deeply about it.

Combined with Idempotency across functions (when available) is a killer feature and is what provides the "Power" in Powertools for me.

Proposal

I am not a Node Typescript expert, so leaving a more detailed proposal to the wider Typescript contributors, maintainers and community.

User Experience

Drawbacks

Rationale and alternatives

Unresolved questions

[dreamorosi]

Hi @walmsles, thank you for opening this RFC.

Batch processing is definitely one of the use cases that we want to look into and consider for the future, however at the moment we cannot commit to any timeline as we are already working on Idempotency, Parameters, and other topics.

However I think this is a valuable RFC and I would be keen to hear what the community & other maintainers have to say in terms of design, DX, etc.

[Jemesson]

+1