v0.76.0

Release v0.76.0

New Features and Improvements

• Add support for unified hosts with experimental flag

v0.75.0

Release v0.75.0

API Changes

• Add databricks.sdk.service.postgres package.
• Add w.postgres workspace-level service.
• Add apply_environment() method for w.pipelines workspace-level service.
• Add effective_usage_policy_id and usage_policy_id fields for databricks.sdk.service.apps.App.
• Add external_access_enabled field for databricks.sdk.service.catalog.CreateAccountsMetastore.
• Add external_access_enabled field for databricks.sdk.service.catalog.CreateMetastore.
• Add external_access_enabled field for databricks.sdk.service.catalog.UpdateAccountsMetastore.
• Add external_access_enabled field for databricks.sdk.service.catalog.UpdateMetastore.
• Add usage_policy_id field for databricks.sdk.service.ml.OnlineStore.
• Add error_message field for databricks.sdk.service.settings.CustomerFacingNetworkConnectivityConfigAwsPrivateEndpointRule.
• Add error_message field for databricks.sdk.service.settings.NccAzurePrivateEndpointRule.
• Add control_plane_connection_failure and control_plane_connection_failure_due_to_misconfig enum values for databricks.sdk.service.compute.TerminationReasonCode.
• Add control_plane_connection_failure and control_plane_connection_failure_due_to_misconfig enum values for databricks.sdk.service.sql.TerminationReasonCode.

v0.74.0

Release v0.74.0

New Features and Improvements

• Add new auth type (runtime-oauth) for notebooks: Introduce a new authentication mechanism that allows notebooks to authenticate using OAuth tokens

Bug Fixes

• Fixed an issue where download from Shared Volumes could fail by falling back to Files API whenever Presigned URLs are not available.

API Changes

• Add create_space() and update_space() methods for w.genie workspace-level service.
• Add create_kafka_config(), delete_kafka_config(), get_kafka_config(), list_kafka_configs() and update_kafka_config() methods for w.feature_engineering workspace-level service.
• Add delete_online_table() method for w.feature_store workspace-level service.
• Add retrieve_user_visible_metrics() method for w.vector_search_endpoints workspace-level service.
• Add major_version field for databricks.sdk.service.billing.CreateBillingUsageDashboardRequest.
• Add include_serialized_space field for databricks.sdk.service.dashboards.GenieGetSpaceRequest.
• Add serialized_space field for databricks.sdk.service.dashboards.GenieSpace.
• Add purpose field for databricks.sdk.service.dashboards.TextAttachment.
• Add budget_policy_id field for databricks.sdk.service.database.NewPipelineSpec.
• Add model field for databricks.sdk.service.jobs.TriggerSettings.
• Add kafka_source field for databricks.sdk.service.ml.DataSource.
• Add connection_parameters field for databricks.sdk.service.pipelines.IngestionGatewayPipelineDefinition.
• Add ingest_from_uc_foreign_catalog field for databricks.sdk.service.pipelines.IngestionPipelineDefinition.
• Add rewind_spec field for databricks.sdk.service.pipelines.StartUpdate.
• Add type_text field for databricks.sdk.service.vectorsearch.ColumnInfo.
• Add foreign_catalog enum value for databricks.sdk.service.pipelines.IngestionSourceType.
• Add creating and create_failed enum values for databricks.sdk.service.settings.CustomerFacingNetworkConnectivityConfigAwsPrivateEndpointRulePrivateLinkConnectionState.
• Add creating and create_failed enum values for databricks.sdk.service.settings.NccAzurePrivateEndpointRuleConnectionState.
• [Breaking] Change destinations field for databricks.sdk.service.catalog.AccessRequestDestinations to no longer be required.
• Change destinations field for databricks.sdk.service.catalog.AccessRequestDestinations to no longer be required.
• [Breaking] Change online_store_config field for databricks.sdk.service.ml.MaterializedFeature to type databricks.sdk.service.ml.OnlineStoreConfig dataclass.
• Add w.workspace_entity_tag_assignments workspace-level service.
• Add clone() method for w.pipelines workspace-level service.
• Add dataset_catalog and dataset_schema fields for databricks.sdk.service.dashboards.CreateDashboardRequest.
• Add dataset_catalog and dataset_schema fields for databricks.sdk.service.dashboards.UpdateDashboardRequest.
• Add purge_data field for databricks.sdk.service.database.DeleteSyncedDatabaseTableRequest.
• Add cron_schedule field for databricks.sdk.service.ml.MaterializedFeature.
• Add truncation field for databricks.sdk.service.pipelines.PipelineEvent.
• Add gcp_service_account field for databricks.sdk.service.provisioning.CreateGcpKeyInfo.
• Add gcp_service_account field for databricks.sdk.service.provisioning.GcpKeyInfo.
• Add has_delta_uniform_iceberg field for databricks.sdk.service.sharing.TableInternalAttributes.
• Add foreign_table and volume enum values for databricks.sdk.service.sharing.SharedDataObjectDataObjectType.
• Change time_window field for databricks.sdk.service.ml.Feature to no longer be required.
• [Breaking] Change time_window field for databricks.sdk.service.ml.Feature to no longer be required.

v0.73.0

Release v0.73.0

Security

• Update protobuf dependency constraints to exclude known vulnerable versions (related to SNYK-PYTHON-PROTOBUF-10364902).

v0.72.0

Release v0.72.0

Bug Fixes

• Fix FilesExt can fail to upload and download data when Presigned URLs are not available in certain environments (e.g. Serverless GPU clusters).

• Fix FilesExt.upload and FilesExt.upload_from would fail when the source content is empty and use_parallel=True.

API Changes

• Add google_ads, tiktok_ads, salesforce_marketing_cloud, hubspot, workday_hcm, guidewire and zendesk enum values for databricks.sdk.service.pipelines.IngestionSourceType.
• Add batch_create_materialized_features() method for w.feature_engineering workspace-level service.
• Add lineage_context field for databricks.sdk.service.ml.Feature.
• Add autoscale_v2 enum value for databricks.sdk.service.compute.EventDetailsCause.
• Add unsupported_conversation_type_exception enum value for databricks.sdk.service.dashboards.MessageErrorType.
• Add red_state and yellow_state enum values for databricks.sdk.service.vectorsearch.EndpointStatusState.
• [Breaking] Change table_names field for databricks.sdk.service.jobs.TableUpdateTriggerConfiguration to be required.
• Change table_names field for databricks.sdk.service.jobs.TableUpdateTriggerConfiguration to be required.

v0.71.0

Release v0.71.0

Bug Fixes

• Fix the issue where FilesExt.upload's second parameter was changed from contents to content unintentionally. Now the interface is backward compatible to versions previous than 0.69.0.

API Changes

• Add instance_profile_arn field for databricks.sdk.service.compute.InstancePoolAwsAttributes.
• Add continuous, sliding and tumbling fields for databricks.sdk.service.ml.TimeWindow.
• Add usage_policy_id field for databricks.sdk.service.pipelines.CreatePipeline.
• Add usage_policy_id field for databricks.sdk.service.pipelines.EditPipeline.
• Add usage_policy_id field for databricks.sdk.service.pipelines.PipelineSpec.
• Add read_files_bytes field for databricks.sdk.service.sql.QueryMetrics.
• Add select enum value for databricks.sdk.service.apps.AppManifestAppResourceUcSecurableSpecUcSecurablePermission.
• Add table enum value for databricks.sdk.service.apps.AppManifestAppResourceUcSecurableSpecUcSecurableType.
• Add decommission_started and decommission_ended enum values for databricks.sdk.service.compute.EventType.
• Add dbr_image_resolution_failure enum value for databricks.sdk.service.compute.TerminationReasonCode.
• Add dbr_image_resolution_failure enum value for databricks.sdk.service.sql.TerminationReasonCode.
• [Breaking] Change offline_store_config and online_store_config fields for databricks.sdk.service.ml.MaterializedFeature to no longer be required.
• Change offline_store_config and online_store_config fields for databricks.sdk.service.ml.MaterializedFeature to no longer be required.
• [Breaking] Change lifecycle_state field for databricks.sdk.service.sql.AlertV2 to type databricks.sdk.service.sql.AlertLifecycleState dataclass.
• [Breaking] Remove table field for databricks.sdk.service.jobs.TriggerSettings.
• [Breaking] Remove duration and offset fields for databricks.sdk.service.ml.TimeWindow.

v0.70.0

Release v0.70.0

Bug Fixes

• Improving the error message that is shown when the unsupported dbutils.credentials.getServiceCredentialsProvider method is used. This method can only be used inside of a notebook.

API Changes

• Add create_materialized_feature(), delete_materialized_feature(), get_materialized_feature(), list_materialized_features() and update_materialized_feature() methods for w.feature_engineering workspace-level service.
• Add filter_condition field for databricks.sdk.service.ml.Feature.
• Add absolute_session_lifetime_in_minutes and enable_single_use_refresh_tokens fields for databricks.sdk.service.oauth2.TokenAccessPolicy.
• Add network_connectivity_config_id field for databricks.sdk.service.provisioning.CreateWorkspaceRequest.
• Add oauth_mtls enum value for databricks.sdk.service.catalog.CredentialType.
• Add network_check_nic_failure_due_to_misconfig, network_check_dns_server_failure_due_to_misconfig, network_check_storage_failure_due_to_misconfig, network_check_metadata_endpoint_failure_due_to_misconfig, network_check_control_plane_failure_due_to_misconfig and network_check_multiple_components_failure_due_to_misconfig enum values for databricks.sdk.service.compute.TerminationReasonCode.
• Add creating and create_failed enum values for databricks.sdk.service.settings.NccPrivateEndpointRulePrivateLinkConnectionState.
• Add network_check_nic_failure_due_to_misconfig, network_check_dns_server_failure_due_to_misconfig, network_check_storage_failure_due_to_misconfig, network_check_metadata_endpoint_failure_due_to_misconfig, network_check_control_plane_failure_due_to_misconfig and network_check_multiple_components_failure_due_to_misconfig enum values for databricks.sdk.service.sql.TerminationReasonCode.
• [Breaking] Change display_name, evaluation, query_text, schedule and warehouse_id fields for databricks.sdk.service.sql.AlertV2 to be required.
• Change display_name, evaluation, query_text, schedule and warehouse_id fields for databricks.sdk.service.sql.AlertV2 to be required.
• Change comparison_operator and source fields for databricks.sdk.service.sql.AlertV2Evaluation to be required.
• [Breaking] Change comparison_operator and source fields for databricks.sdk.service.sql.AlertV2Evaluation to be required.
• Change name field for databricks.sdk.service.sql.AlertV2OperandColumn to be required.
• [Breaking] Change name field for databricks.sdk.service.sql.AlertV2OperandColumn to be required.
• [Breaking] Change quartz_cron_schedule and timezone_id fields for databricks.sdk.service.sql.CronSchedule to be required.
• Change quartz_cron_schedule and timezone_id fields for databricks.sdk.service.sql.CronSchedule to be required.
• [Breaking] Remove update() method for w.recipient_federation_policies workspace-level service.
• [Breaking] Remove results field for databricks.sdk.service.sql.ListAlertsV2Response.

v0.69.0

Release v0.69.0

New Features and Improvements

• Add a new interface upload_from to databricks.sdk.mixins.FilesExt to support upload from a file in local filesystem.
• Improve databricks.sdk.mixins.FilesExt upload throughput by uploading data in parallel by default.
• Add a new interface download_to to databricks.sdk.mixins.FilesExt to support download to a file in local filesystem. This interface will also download the file in parallel by default. Parallel downloading is currently unavailable on Windows.
• Improve databricks.sdk.mixins.FilesExt.upload to support uploading when Presigned URL is not enabled for the Workspace by introducing a fallback to Single Part Upload.

API Changes

• Add upload_from(), download_to() method for databricks.sdk.mixins.FilesExt.
• Add use_parallel, parallelism, part_size field for databricks.sdk.mixins.FilesExt.upload.
• [Breaking] Change files_api_client_download_max_total_recovers to files_ext_client_download_max_total_recovers for databricks.sdk.Config
• [Breaking] Change files_api_client_download_max_total_recovers_without_progressing to files_ext_client_download_max_total_recovers_without_progressing for databricks.sdk.Config
• [Breaking] Change multipart_upload_min_stream_size to files_ext_multipart_upload_min_stream_size for databricks.sdk.Config
• [Breaking] Change multipart_upload_batch_url_count to files_ext_multipart_upload_batch_url_count for databricks.sdk.Config
• [Breaking] Change multipart_upload_chunk_size to files_ext_multipart_upload_default_part_size for databricks.sdk.Config
• [Breaking] Change multipart_upload_url_expiration_duration to files_ext_multipart_upload_url_expiration_duration for databricks.sdk.Config
• [Breaking] Change multipart_upload_max_retries to files_ext_multipart_upload_max_retries for databricks.sdk.Config
• Add files_ext_client_download_streaming_chunk_size, files_ext_multipart_upload_part_size_options, files_ext_multipart_upload_max_part_size, files_ext_multipart_upload_default_parallelism, files_ext_presigned_download_url_expiration_duration, files_ext_parallel_download_default_parallelism, files_ext_parallel_download_min_file_size, files_ext_parallel_download_default_part_size, files_ext_parallel_download_max_retries for databricks.sdk.Config

v0.68.0

Release v0.68.0

New Features and Improvements

• Add native support for authentication through Azure DevOps OIDC.

Bug Fixes

• Fix a security issue that resulted in bearer tokens being logged in exception messages.

API Changes

• Add databricks.sdk.service.dataquality package.
• Add w.data_quality workspace-level service.
• Add create_update() and get_update() methods for w.apps workspace-level service.
• Add compute_size field for databricks.sdk.service.apps.App.
• Add genie_space field for databricks.sdk.service.apps.AppResource.
• Add skip_validation field for databricks.sdk.service.catalog.AccountsCreateStorageCredential.
• Add skip_validation field for databricks.sdk.service.catalog.AccountsUpdateStorageCredential.
• Add aliases, browse_only, created_at, created_by, full_name, metastore_id, owner, updated_at and updated_by fields for databricks.sdk.service.catalog.CreateRegisteredModelRequest.
• Add catalog_name, id, model_name and schema_name fields for databricks.sdk.service.catalog.RegisteredModelAlias.
• Add aliases, catalog_name, created_at, created_by, id, metastore_id, model_name, model_version_dependencies, run_id, run_workspace_id, schema_name, source, status, storage_location, updated_at and updated_by fields for databricks.sdk.service.catalog.UpdateModelVersionRequest.
• Add aliases, browse_only, catalog_name, created_at, created_by, metastore_id, name, schema_name, storage_location, updated_at and updated_by fields for databricks.sdk.service.catalog.UpdateRegisteredModelRequest.
• Add key_region field for databricks.sdk.service.provisioning.CreateAwsKeyInfo.
• Add role_arn field for databricks.sdk.service.provisioning.CreateStorageConfigurationRequest.
• Add azure_key_info field for databricks.sdk.service.provisioning.CustomerManagedKey.
• [Breaking] Add customer_facing_private_access_settings field for databricks.sdk.service.provisioning.ReplacePrivateAccessSettingsRequest.
• Add role_arn field for databricks.sdk.service.provisioning.StorageConfiguration.
• [Breaking] Add customer_facing_workspace field for databricks.sdk.service.provisioning.UpdateWorkspaceRequest.
• Add update_mask field for databricks.sdk.service.provisioning.UpdateWorkspaceRequest.
• Add compute_mode, network, network_connectivity_config_id and storage_mode fields for databricks.sdk.service.provisioning.Workspace.
• Add enable_serverless_compute field for databricks.sdk.service.sql.GetWorkspaceWarehouseConfigResponse.
• Add page_size and page_token fields for databricks.sdk.service.sql.ListWarehousesRequest.
• Add next_page_token field for databricks.sdk.service.sql.ListWarehousesResponse.
• Add enable_serverless_compute field for databricks.sdk.service.sql.SetWorkspaceWarehouseConfigRequest.
• Add model_version_status_unknown enum value for databricks.sdk.service.catalog.ModelVersionInfoStatus.
• Add k8s_active_pod_quota_exceeded and cloud_account_pod_quota_exceeded enum values for databricks.sdk.service.compute.TerminationReasonCode.
• Add internal_catalog_asset_creation_ongoing_exception, internal_catalog_asset_creation_failed_exception and internal_catalog_asset_creation_unsupported_exception enum values for databricks.sdk.service.dashboards.MessageErrorType.
• Add ssh_bootstrap_failure, aws_inaccessible_kms_key_failure, init_container_not_finished, spark_image_download_throttled, spark_image_not_found, cluster_operation_throttled, cluster_operation_timeout, serverless_long_running_terminated, azure_packed_deployment_partial_failure, invalid_worker_image_failure, workspace_update, invalid_aws_parameter, driver_out_of_disk, driver_out_of_memory, driver_launch_timeout, driver_unexpected_failure, unexpected_pod_recreation, gcp_inaccessible_kms_key_failure, gcp_kms_key_permission_denied, driver_eviction, user_initiated_vm_termination, gcp_iam_timeout, aws_resource_quota_exceeded, cloud_account_setup_failure, aws_invalid_key_pair, driver_pod_creation_failure, maintenance_mode, internal_capacity_failure, executor_pod_unscheduled, storage_download_failure_slow, storage_download_failure_throttled, dynamic_spark_conf_size_exceeded, aws_instance_profile_update_failure, instance_pool_not_found, instance_pool_max_capacity_reached, aws_invalid_kms_key_state, gcp_insufficient_capacity, gcp_api_rate_quota_exceeded, gcp_resource_quota_exceeded, gcp_ip_space_exhausted, gcp_service_account_access_denied, gcp_service_account_not_found, gcp_forbidden, gcp_not_found, resource_usage_blocked, data_access_config_changed, access_token_failure, invalid_instance_placement_protocol, budget_policy_resolution_failure, in_penalty_box, disaster_recovery_replication, bootstrap_timeout_due_to_misconfig, instance_unreachable_due_to_misconfig, storage_download_failure_due_to_misconfig, control_plane_request_failure_due_to_misconfig, cloud_provider_launch_failure_due_to_misconfig, gcp_subnet_not_ready, cloud_operation_cancelled, cloud_provider_instance_not_launched, gcp_trusted_image_projects_violated, budget_policy_limit_enforcement_activated, eos_spark_image, no_matched_k8s, lazy_allocation_timeout, driver_node_unreachable, secret_creation_failure, pod_scheduling_failure, pod_assignment_failure, allocation_timeout, allocation_timeout_no_unallocated_clusters, allocation_timeout_no_matched_clusters, allocation_timeout_no_ready_clusters, allocation_timeout_no_warmed_up_clusters, allocation_timeout_node_daemon_not_ready, allocation_timeout_no_healthy_clusters, netvisor_setup_timeout, no_matched_k8s_testing_tag, cloud_provider_resource_stockout_due_to_misconfig, gke_based_cluster_termination, allocation_timeout_no_healthy_and_warmed_up_clusters, docker_invalid_os_exception, docker_container_creation_exception, docker_image_too_large_for_instance_exception, dns_resolution_error, gcp_denied_by_org_policy, secret_permission_denied, network_check_nic_failure, network_check_dns_server_failure, network_check_storage_failure, network_check_metadata_endpoint_failure, network_check_control_plane_failure, network_check_multiple_components_failure, driver_unhealthy, security_agents_failed_initial_verification, driver_dns_resolution_failure, no_activated_k8s, usage_policy_entitlement_denied, no_activated_k8s_testing_tag, k8s_active_pod_quota_exceeded and cloud_account_pod_quota_exceeded enum values for databricks.sdk.service.sql.TerminationReasonCode.
• [Breaking] Change create() method for a.account_metastore_assignments account-level service to start returning databricks.sdk.service.catalog.AccountsCreateMetastoreAssignmentResponse dataclass.
• [Breaking] Change delete() method for a.account_metastore_assignments account-level service to start returning databricks.sdk.service.catalog.AccountsDeleteMetastoreAssignmentResponse dataclass.
• [Breaking] Change update() method for a.account_metastore_assignments account-level service to start returning databricks.sdk.service.catalog.AccountsUpdateMetastoreAssignmentResponse dataclass.
• [Breaking] Change create() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsCreateMetastoreResponse dataclass.
• [Breaking] Change delete() method for a.account_metastores account-level service to start returning databricks.sdk.service.catalog.AccountsDeleteMetastoreResponse dataclass.
• [Breaking] Change get() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsGetMetastoreResponse dataclass.
• [Breaking] Change list() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsListMetastoresResponse dataclass.
• [Breaking] Change update() method for a.account_metastores account-level service to return databricks.sdk.service.catalog.AccountsUpdateMetastoreResponse dataclass.
• [Breaking] Change create() method for a.account_storage_credentials account-level service to return databricks.sdk.service.catalog.AccountsCreateStorageCredentialInfo dataclass.
• [Breaking] Change delete() method for a.account_storage_credentials account-level service to start returning databricks.sdk.service.catalog.AccountsDeleteStorageCredentialResponse dataclass.
• [Breaking] Change update() method for a.account_storage_credentials account-level service to return `databricks.sdk.service.ca...

v0.67.0

Release v0.67.0

API Changes

• Add update_notifications() method for w.serving_endpoints workspace-level service.
• Add parameters field for databricks.sdk.service.dashboards.GenieQueryAttachment.
• Add database_instance_name field for databricks.sdk.service.database.CreateDatabaseInstanceRoleRequest.
• Add custom_tags, effective_custom_tags, effective_usage_policy_id and usage_policy_id fields for databricks.sdk.service.database.DatabaseInstance.
• Add effective_attributes and instance_name fields for databricks.sdk.service.database.DatabaseInstanceRole.
• Add external_use_schema enum value for databricks.sdk.service.catalog.Privilege.
• Add stream_native enum value for databricks.sdk.service.catalog.SystemType.
• Add exceeded_max_token_length_exception enum value for databricks.sdk.service.dashboards.MessageErrorType.
• Change name field for databricks.sdk.service.database.DatabaseInstanceRole to be required.
• [Breaking] Change name field for databricks.sdk.service.database.DatabaseInstanceRole to be required.