Skip to content

Commit d1ef219

Browse files
xy2953396112FMX
authored andcommitted
[CELEBORN-2139] Fix the condition for using OSS storage
### What changes were proposed in this pull request? Fix the condition for using OSS storage ### Why are the changes needed? When OSS is enabled, the local disk should be used first if it is available. ### Does this PR introduce _any_ user-facing change? NO ### How was this patch tested? CI Closes #3463 from xy2953396112/CELEBORN-2139. Authored-by: xxx <953396112@qq.com> Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com> (cherry picked from commit 750aeef) Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
1 parent a13c04f commit d1ef219

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

worker/src/main/scala/org/apache/celeborn/service/deploy/worker/storage/StorageManager.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1146,7 +1146,7 @@ final private[worker] class StorageManager(conf: CelebornConf, workerSource: Abs
11461146
fileName,
11471147
s3FileInfo)
11481148
return (s3Flusher.get, s3FileInfo, null)
1149-
} else if (hasOssStorage && location.getStorageInfo.OSSAvailable()) {
1149+
} else if (dirs.isEmpty && location.getStorageInfo.OSSAvailable()) {
11501150
val shuffleDir =
11511151
new Path(new Path(ossDir, conf.workerWorkingDir), s"$appId/$shuffleId")
11521152
FileSystem.mkdirs(

0 commit comments

Comments
 (0)