Skip to content

Introduce the logic of splitting tasks based on file size when reading CoW #17729

@TheR1sing3un

Description

@TheR1sing3un

Task Description

What needs to be done:

When reading the cow table, set FileFormat#isSplitable to true

Why this task is needed:

For overly large single files, we can use multiple concurrent tasks to read them, thereby reducing the overall job reading time consumption

Task Type

Performance optimization

Related Issues

Parent feature issue: (if applicable )
Related issues:
NOTE: Use Relationships button to add parent/blocking issues after issue is created.

Metadata

Metadata

Assignees

No one assigned

    Labels

    type:devtaskDevelopment tasks and maintenance work

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions