Skip to content

Allow customizing divideAndConquerThreshold in TransferManagerConfig #3524

@t-peoples

Description

@t-peoples

Thanks for stopping by to let us know something could be better!

PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Is your feature request related to a problem? Please describe.

divideAndConquerThreshold is set to 128 MiB in DefaultQoS. There's no way to change this from any public methods. Our use case requires downloading files of arbitrary sizes concurrently, some < 128 MiB, some < 1 GiB, and some > 10+ GiB. We see that divideAndConquerThreshold adds overhead for these medium sized files.

Describe the solution you'd like

Allow defining divideAndConquerThreshold via public methods in TransferManagerConfig.

Describe alternatives you've considered

There's no way to accomplish this currently from what I can tell.

Additional context

Is there a reason 128 MiB was chosen?

Metadata

Metadata

Assignees

No one assigned

    Labels

    api: storageIssues related to the googleapis/java-storage API.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions