GH-48962: [Python] Add restack_batches()

[guillaume-rochette-oxb]

Rationale for this change

Hi everyone,
This PR solve the issue #48962.
In the sense that it adds a functionality enabling to dynamically restack/resize a stream of pa.RecordBatch w.r.t. to minimums and maximums of rows and bytes.
That would means that too large batches would be chunked in smaller ones, and conversely small batches would be concatenated into bigger ones.
That way we would have more predictable resource usage for parallel processing tasks.

What changes are included in this PR?

The function restack_batches() and its unit tests 😃

Are these changes tested?

Yes 🫡

Are there any user-facing changes?

No 🙅

• GitHub Issue: [Python] Add restack_batches() #48962

[github-actions]

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

See also:

• Other pull requests
• Contribution Guidelines - Contributing Overview

[github-actions]

⚠️ GitHub issue #48962 has been automatically assigned in GitHub to PR creator.