Skip to content

Commit f83e8b7

Browse files
fix: added missing permission 'roles/serviceusage.serviceUsageConsumer' (#1153)
* fix: added missing permission 'roles/serviceusage.serviceUsageConsumer' This permission is necessary for Data Explorer to be able to auto-discover the GCS Buckets the Platform credential has access to (limited to Buckets in the GCP Project from which the credential was issued). Not having this permission will cause Buckets not to be auto-discovered and a message like the following being emitted in the Platform logs: """ backend-1 | Feb-24 13:57:37.874 [data-link-fetch-worker-4] - DEBUG i.s.t.s.data.cache.DataLinkStoreImpl - Update data links to error for credentials: 73k0ncyXvpbnwZRyNBnmC, errorMessage: com.google.cloud.storage.StorageException: SERVICE-ACCOUNT-NAME@GCP-PROJECT.iam.gserviceaccount.com does not have serviceusage.services.use access to the Google Cloud project. Permission 'serviceusage.services.use' denied on resource (or it may not exist). """ * pre-commit --------- Co-authored-by: Justine Geffen <justinegeffen@users.noreply.github.com>
1 parent 9d0bdec commit f83e8b7

File tree

5 files changed

+36
-26
lines changed

5 files changed

+36
-26
lines changed

platform-enterprise_versioned_docs/version-24.1/compute-envs/google-cloud-batch.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
---
22
title: "Google Cloud Batch"
33
description: "Instructions to set up Google Cloud Batch in Seqera Platform"
4-
date: "21 Apr 2023"
4+
date created: "2023-04-21"
5+
last updated: "2026-02-24"
56
tags: [google, batch, gcp, compute environment]
67
---
78

@@ -62,6 +63,7 @@ By default, Google Cloud Batch uses the default Compute Engine service account t
6263
- Batch Job Editor (`roles/batch.jobsEditor`) on the project
6364
- Logs Writer (`roles/logging.logWriter`) on the project (to let jobs generate logs in Cloud Logging)
6465
- Service Account User (`roles/iam.serviceAccountUser`)
66+
- Service Usage Consumer (`roles/serviceusage.serviceUsageConsumer`)
6567

6668
If your Google Cloud project does not require access restrictions on any of its Cloud Storage buckets, you can grant project Storage Admin (`roles/storage.admin`) permissions to your service account to simplify setup. To grant access only to specific buckets, add the service account as a principal on each bucket individually. See [Cloud Storage bucket](#cloud-storage-bucket) below.
6769

@@ -160,7 +162,7 @@ Select **Enable Fusion v2** to allow access to your Google Cloud Storage data vi
160162
<summary>Use Fusion v2</summary>
161163

162164
:::note
163-
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
165+
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
164166
:::
165167

166168
1. Use Seqera Platform version 23.1 or later.
@@ -198,10 +200,10 @@ Apply [**Resource labels**][resource-labels] to the cloud resources consumed by
198200

199201
1. Expand **Staging options** to include:
200202
- Optional [pre- or post-run Bash scripts](../launch/advanced#pre-and-post-run-scripts) that execute before or after the Nextflow pipeline execution in your environment.
201-
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
202-
203+
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
204+
203205
:::info
204-
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
206+
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
205207
:::
206208

207209
1. Specify custom **Environment variables** for the head and compute jobs.

platform-enterprise_versioned_docs/version-24.2/compute-envs/google-cloud-batch.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
---
22
title: "Google Cloud Batch"
33
description: "Instructions to set up Google Cloud Batch in Seqera Platform"
4-
date: "21 Apr 2023"
4+
date created: "2023-04-21"
5+
last updated: "2026-02-24"
56
tags: [google, batch, gcp, compute environment]
67
---
78

@@ -62,6 +63,7 @@ By default, Google Cloud Batch uses the default Compute Engine service account t
6263
- Batch Job Editor (`roles/batch.jobsEditor`) on the project
6364
- Logs Writer (`roles/logging.logWriter`) on the project (to let jobs generate logs in Cloud Logging)
6465
- Service Account User (`roles/iam.serviceAccountUser`)
66+
- Service Usage Consumer (`roles/serviceusage.serviceUsageConsumer`)
6567

6668
If your Google Cloud project does not require access restrictions on any of its Cloud Storage buckets, you can grant project Storage Admin (`roles/storage.admin`) permissions to your service account to simplify setup. To grant access only to specific buckets, add the service account as a principal on each bucket individually. See [Cloud Storage bucket](#cloud-storage-bucket) below.
6769

@@ -160,7 +162,7 @@ Select **Enable Fusion v2** to allow access to your Google Cloud Storage data vi
160162
<summary>Use Fusion v2</summary>
161163

162164
:::note
163-
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
165+
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
164166
:::
165167

166168
1. Use Seqera Platform version 23.1 or later.
@@ -190,7 +192,7 @@ Wave containers and Fusion v2 are recommended features for added capability and
190192

191193
#### GCP resources
192194

193-
Enable **Spot** to use Spot instances, which have significantly reduced cost compared to on-demand instances.
195+
Enable **Spot** to use Spot instances, which have significantly reduced cost compared to on-demand instances.
194196

195197
:::note
196198
From Nextflow version 24.10, the default Spot reclamation retry setting changed to `0` on AWS and Google. By default, no internal retries are attempted on these platforms. Spot reclamations now lead to an immediate failure, exposed to Nextflow in the same way as other generic failures (returning for example, `exit code 1` on AWS). Nextflow will treat these failures like any other job failure unless you actively configure a retry strategy. For more information, see the [Spot instance failures and retries guide](https://docs.seqera.io/platform/24.2/troubleshooting_and_faqs/nextflow#spot-instance-failures-and-retries-in-nextflow).
@@ -202,9 +204,9 @@ Apply [**Resource labels**][resource-labels] to the cloud resources consumed by
202204

203205
- Expand **Staging options** to include:
204206
- Optional [pre- or post-run Bash scripts](../launch/advanced#pre-and-post-run-scripts) that execute before or after the Nextflow pipeline execution in your environment.
205-
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
207+
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
206208
:::info
207-
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
209+
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
208210
:::
209211

210212

platform-enterprise_versioned_docs/version-25.1/compute-envs/google-cloud-batch.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
---
22
title: "Google Cloud Batch"
33
description: "Instructions to set up Google Cloud Batch in Seqera Platform"
4-
date: "21 Apr 2023"
4+
date created: "2023-04-21"
5+
last updated: "2026-02-24"
56
tags: [google, batch, gcp, compute environment]
67
---
78

@@ -62,6 +63,7 @@ By default, Google Cloud Batch uses the default Compute Engine service account t
6263
- Batch Job Editor (`roles/batch.jobsEditor`) on the project
6364
- Logs Writer (`roles/logging.logWriter`) on the project (to let jobs generate logs in Cloud Logging)
6465
- Service Account User (`roles/iam.serviceAccountUser`)
66+
- Service Usage Consumer (`roles/serviceusage.serviceUsageConsumer`)
6567

6668
If your Google Cloud project does not require access restrictions on any of its Cloud Storage buckets, you can grant project Storage Admin (`roles/storage.admin`) permissions to your service account to simplify setup. To grant access only to specific buckets, add the service account as a principal on each bucket individually. See [Cloud Storage bucket](#cloud-storage-bucket) below.
6769

@@ -160,7 +162,7 @@ Select **Enable Fusion v2** to allow access to your Google Cloud Storage data vi
160162
<summary>Use Fusion v2</summary>
161163

162164
:::note
163-
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
165+
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
164166
:::
165167

166168
1. Use Seqera Platform version 23.1 or later.
@@ -192,7 +194,7 @@ Wave containers and Fusion v2 are recommended features for added capability and
192194

193195
Enable **Spot** to use Spot instances, which have significantly reduced cost compared to On-Demand instances.
194196

195-
:::note
197+
:::note
196198
From Nextflow version 24.10, the default Spot reclamation retry setting changed to `0` on AWS and Google. By default, no internal retries are attempted on these platforms. Spot reclamations now lead to an immediate failure, exposed to Nextflow in the same way as other generic failures (returning for example, `exit code 1` on AWS). Nextflow will treat these failures like any other job failure unless you actively configure a retry strategy. For more information, see [Spot instance failures and retries](https://docs.seqera.io/platform/24.2/troubleshooting_and_faqs/nextflow#spot-instance-failures-and-retries-in-nextflow).
197199
:::
198200

@@ -202,9 +204,9 @@ Apply [**Resource labels**][resource-labels] to the cloud resources consumed by
202204

203205
- Expand **Staging options** to include:
204206
- Optional [pre- or post-run Bash scripts](../launch/advanced#pre-and-post-run-scripts) that execute before or after the Nextflow pipeline execution in your environment.
205-
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
207+
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
206208
:::info
207-
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
209+
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
208210
:::
209211

210212

platform-enterprise_versioned_docs/version-25.2/compute-envs/google-cloud-batch.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
---
22
title: "Google Cloud Batch"
33
description: "Instructions to set up Google Cloud Batch in Seqera Platform"
4-
date: "21 Apr 2023"
4+
date created: "2023-04-21"
5+
last updated: "2026-02-24"
56
tags: [google, batch, gcp, compute environment]
67
---
78

@@ -62,6 +63,7 @@ By default, Google Cloud Batch uses the default Compute Engine service account t
6263
- Batch Job Editor (`roles/batch.jobsEditor`) on the project
6364
- Logs Writer (`roles/logging.logWriter`) on the project (to let jobs generate logs in Cloud Logging)
6465
- Service Account User (`roles/iam.serviceAccountUser`)
66+
- Service Usage Consumer (`roles/serviceusage.serviceUsageConsumer`)
6567

6668
If your Google Cloud project does not require access restrictions on any of its Cloud Storage buckets, you can grant project Storage Admin (`roles/storage.admin`) permissions to your service account to simplify setup. To grant access only to specific buckets, add the service account as a principal on each bucket individually. See [Cloud Storage bucket](#cloud-storage-bucket) below.
6769

@@ -160,7 +162,7 @@ Select **Enable Fusion v2** to allow access to your Google Cloud Storage data vi
160162
<summary>Use Fusion v2</summary>
161163

162164
:::note
163-
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
165+
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
164166
:::
165167

166168
1. Use Seqera Platform version 23.1 or later.
@@ -192,7 +194,7 @@ Wave containers and Fusion v2 are recommended features for added capability and
192194

193195
Enable **Spot** to use Spot instances, which have significantly reduced cost compared to On-Demand instances.
194196

195-
:::note
197+
:::note
196198
From Nextflow version 24.10, the default Spot reclamation retry setting changed to `0` on AWS and Google. By default, no internal retries are attempted on these platforms. Spot reclamations now lead to an immediate failure, exposed to Nextflow in the same way as other generic failures (returning for example, `exit code 1` on AWS). Nextflow will treat these failures like any other job failure unless you actively configure a retry strategy. For more information, see [Spot instance failures and retries](https://docs.seqera.io/platform/24.2/troubleshooting_and_faqs/nextflow#spot-instance-failures-and-retries-in-nextflow).
197199
:::
198200

@@ -202,9 +204,9 @@ Apply [**Resource labels**][resource-labels] to the cloud resources consumed by
202204

203205
- Expand **Staging options** to include:
204206
- Optional [pre- or post-run Bash scripts](../launch/advanced#pre-and-post-run-scripts) that execute before or after the Nextflow pipeline execution in your environment.
205-
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
207+
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
206208
:::info
207-
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
209+
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
208210
:::
209211

210212

platform-enterprise_versioned_docs/version-25.3/compute-envs/google-cloud-batch.md

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,8 @@
11
---
22
title: "Google Cloud Batch"
33
description: "Instructions to set up Google Cloud Batch in Seqera Platform"
4-
date: "21 Apr 2023"
4+
date created: "2023-04-21"
5+
last updated: "2026-02-24"
56
tags: [google, batch, gcp, compute environment]
67
---
78

@@ -36,7 +37,7 @@ See [here](https://console.cloud.google.com/flows/enableapi?apiid=batch.googleap
3637
- Compute Engine API
3738
- Cloud Storage API
3839

39-
Select your project from the dropdown menu and select **Enable**.
40+
Select your project from the drop-down menu and select **Enable**.
4041

4142
Alternatively, you can enable each API manually by selecting your project in the navigation bar and visiting each API page:
4243

@@ -62,6 +63,7 @@ By default, Google Cloud Batch uses the default Compute Engine service account t
6263
- Batch Job Editor (`roles/batch.jobsEditor`) on the project
6364
- Logs Writer (`roles/logging.logWriter`) on the project (to let jobs generate logs in Cloud Logging)
6465
- Service Account User (`roles/iam.serviceAccountUser`)
66+
- Service Usage Consumer (`roles/serviceusage.serviceUsageConsumer`)
6567

6668
If your Google Cloud project does not require access restrictions on any of its Cloud Storage buckets, you can grant project Storage Admin (`roles/storage.admin`) permissions to your service account to simplify setup. To grant access only to specific buckets, add the service account as a principal on each bucket individually. See [Cloud Storage bucket](#cloud-storage-bucket) below.
6769

@@ -160,7 +162,7 @@ Select **Enable Fusion v2** to allow access to your Google Cloud Storage data vi
160162
<summary>Use Fusion v2</summary>
161163

162164
:::note
163-
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
165+
The compute recommendations below are based on internal benchmarking performed by Seqera. Benchmark runs of [nf-core/rnaseq](https://github.com/nf-core/rnaseq) used profile `test_full`, consisting of an input dataset with 16 FASTQ files and a total size of approximately 123.5 GB.
164166
:::
165167

166168
1. Use Seqera Platform version 23.1 or later.
@@ -192,7 +194,7 @@ Wave containers and Fusion v2 are recommended features for added capability and
192194

193195
Enable **Spot** to use Spot instances, which have significantly reduced cost compared to On-Demand instances.
194196

195-
:::note
197+
:::note
196198
From Nextflow version 24.10, the default Spot reclamation retry setting changed to `0` on AWS and Google. By default, no internal retries are attempted on these platforms. Spot reclamations now lead to an immediate failure, exposed to Nextflow in the same way as other generic failures (returning for example, `exit code 1` on AWS). Nextflow will treat these failures like any other job failure unless you actively configure a retry strategy. For more information, see [Spot instance failures and retries](https://docs.seqera.io/platform/24.2/troubleshooting_and_faqs/nextflow#spot-instance-failures-and-retries-in-nextflow).
197199
:::
198200

@@ -202,9 +204,9 @@ Apply [**Resource labels**][resource-labels] to the cloud resources consumed by
202204

203205
- Expand **Staging options** to include:
204206
- Optional [pre- or post-run Bash scripts](../launch/advanced#pre-and-post-run-scripts) that execute before or after the Nextflow pipeline execution in your environment.
205-
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
207+
- Global Nextflow configuration settings for all pipeline runs launched with this compute environment. Values defined here are pre-filled in the **Nextflow config file** field in the pipeline launch form. These values can be overridden during pipeline launch.
206208
:::info
207-
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
209+
Configuration settings in this field override the same values in the pipeline repository `nextflow.config` file. See [Nextflow config file](../launch/advanced#nextflow-config-file) for more information on configuration priority.
208210
:::
209211

210212

0 commit comments

Comments
 (0)