We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent a5eb604 commit 1b145e2Copy full SHA for 1b145e2
docs/sql-migration-guide-upgrade.md
@@ -10,8 +10,9 @@ displayTitle: Spark SQL Upgrading Guide
10
## Upgrading from Spark SQL 2.4 to 2.4.5
11
12
- Starting from 2.4.5, SQL configurations are effective also when a Dataset is converted to an RDD and its
13
- plan is executed due to action on the derived RDD. The previous buggy behavior can be restored setting
14
- `spark.sql.legacy.rdd.applyConf` to `false`.
+ plan is executed due to action on the derived RDD. The previous behavior can be restored setting
+ `spark.sql.legacy.rdd.applyConf` to `false`: in this case, SQL configurations are ignored for operations
15
+ performed on a RDD derived from a Dataset.
16
17
## Upgrading from Spark SQL 2.4 to 2.4.1
18
0 commit comments