Skip to content

[VL] Task run in DeadLock when lacking memory and native writer throw OOM exception #10112

Open
@zjuwangg

Description

@zjuwangg

Backend

VL (Velox)

Bug description

We observed a very rarely dead lock problem during our production environment. The situation happened when native writer throw an oom exception and make the task fake in running status forever and also block other task to running.
The java stack act like following picture

Image

Gluten version

main branch, Gluten-1.2

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions