Open
Description
Backend
VL (Velox)
Bug description
error msg:
ExecutorLostFailure (executor 38 exited caused by one of the running tasks) Reason: Container killed by YARN for exceeding physical memory limits. 4.1 GB of 4 GB physical memory used. Consider boosting spark.executor.memoryOverhead.
Driver stacktrace:
jemalloc profile:
Gluten version
No response
Spark version
None
Spark configurations
spark.executorEnv.MALLOC_CONF=prof:true,lg_prof_interval:30,prof_prefix:/tmp/gluten_heap_perf;
spark.memory.offHeap.size 2g
spark.executor.memory 1g
spark.executor.memoryOverhead 1024
System information
No response