-
|
we can set hive.strict.checks.no.partition.filter in hive to protect yarn resource exausted by some big query or non-standard SQL with no partition.but cannot find same solution in spark. will kyuubi plan to optimize this? |
Beta Was this translation helpful? Give feedback.
Answered by
pan3793
Jan 15, 2026
Replies: 1 comment 1 reply
-
|
Kyuubi does not pursue 100% to replicate Hive's strict mode behavior, but for this case, try https://kyuubi.readthedocs.io/en/master/extensions/engines/spark/rules.html |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
thanks it works |
Beta Was this translation helpful? Give feedback.
Answer selected by
trexguojc
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Kyuubi does not pursue 100% to replicate Hive's strict mode behavior, but for this case, try
spark.sql.watchdog.maxPartitionshttps://kyuubi.readthedocs.io/en/master/extensions/engines/spark/rules.html