September 15, 2022
This release of the Cloudera Data Warehouse (CDW) service on CDP Public Cloud introduces these changes.
Support for Amazon Elastic Kubernetes Service 1.21 cluster
This release 1.4.3-b225 (released September 15, 2022) automatically uses and provisions Amazon Elastic Kubernetes Service (EKS) 1.21 when you activate an environment from CDW. In this release, upgrading a cluster from EKS 1.20 to 1.21 is not supported.
Support for Azure Kubernetes Service 1.24 cluster
This release 1.4.3-b225 (released September 15, 2022) supports the Azure CLI to upgrade the AKS cluster to/from the following AKS versions only:
- Upgrade to AKS 1.24
- Upgrade from AKS 1.22 (running on 1.4.2 (released August 1, 2022).
Upgrading from environments earlier than AKS 1.22 is not supported. Cloudera does not plan to support upgrading from environments earlier than 1.4.2.
Alert notification configuration
You can now configure alert notifications that appear in user notification system. The notifications supplement alert information in charts on the Manage/Hive/Compaction Observability dashboard in Grafana.
Impala Virtual Warehouse catalog high availability
In earlier releases, the single instance limitation of the Impala Virtual Warehouse catalog made the catalog a single point of failure. In this release, you can optionally configure replication of the Impala catalog for high availability. One instance operates in active mode, the other in passive mode to provide failover. The passive instance serves as a backup and takes over if the active instance goes down.
General availability of Managed Storage Access
General availability of SSO to Virtual Warehouses
In this release, the capability to enable SSO (single sign-on) to your Virtual Warehouse from JDBC/ODBC clients is generally available (GA).
Hive to Iceberg table migration disallowed under certain conditions
If you attempt to migrate a Hive table having VARCHAR or CHAR columns to Iceberg, an exception will occur in this release. Migration under these conditions is not allowed in this release because incorrect query results can occur. To work around this limitation, change VARCHAR and CHAR columns to string columns, and then migrate the table to Iceberg.
Impala Autoscaler Web UI
This release includes an addition to the Impala Web UI for debugging the Impala Virtual Warehouse. The new UI provides insight into Autoscaler operations, accessing log messages, and resetting the log level.
Additions to IAM policy, standard and restricted, permissions
In this release, if you want to use Amazon CloudWatch, add logging permissions: to your IAM policy: "logs:CreateLogGroup","logs:CreateLogStream","logs:DescribeLogStreams", and "logs:PutLogEvents". The arn:aws:iam::aws:policy/CloudWatchAgentAdminPolicy must also be added to the standard and restricted permissions.
CREATE TABLE LIKE PARQUET FILE feature in Unified Analytics
You can base a new table on a schema in a Parquet file using the CREATE TABLE LIKE PARQUET FILE statement.