Skip to content

Add log buffering to increase performance when streaming big logs #25002

Add log buffering to increase performance when streaming big logs

Add log buffering to increase performance when streaming big logs #25002

Status Failure
Total duration 35m 48s
Artifacts 53

ci-amd-arm.yml

on: pull_request
Build info
33s
Build info
Matrix: Build CI images / build-ci-images
Matrix: Airflow CTL tests / distributions-tests
Matrix: Basic tests / tests-shared-distributions
Basic tests  /  Breeze unit tests
1m 5s
Basic tests / Breeze unit tests
Basic tests  /  Breeze integration tests
1m 2s
Basic tests / Breeze integration tests
Basic tests  /  Scripts tests
14s
Basic tests / Scripts tests
Basic tests  /  React UI tests
1m 40s
Basic tests / React UI tests
Basic tests  /  Check translation completeness
21s
Basic tests / Check translation completeness
Basic tests  /  Static checks: basic checks only
Basic tests / Static checks: basic checks only
Basic tests  /  Test git clone on Windows
23s
Basic tests / Test git clone on Windows
Basic tests  /  Upgrade checks
Basic tests / Upgrade checks
Basic tests  /  Test Airflow release commands
Basic tests / Test Airflow release commands
Basic tests  /  Test Airflow standalone commands
26s
Basic tests / Test Airflow standalone commands
Go SDK tests
38s
Go SDK tests
Platform: ARM
Platform: ARM
Platform: AMD
3s
Platform: AMD
Verify release calendar
Verify release calendar
Matrix: Generate constraints / generate-constraints-matrix
Matrix: MySQL tests: core / tests
Matrix: MySQL tests: providers / tests
Matrix: Non-DB tests: core / tests
Matrix: Non-DB tests: providers / tests
Matrix: Postgres tests: core / tests
Matrix: Postgres tests: providers / tests
Matrix: Sqlite tests: core / tests
Matrix: Sqlite tests: providers / tests
Matrix: Task SDK tests / distributions-tests
Matrix: Low dep tests:core / tests
Matrix: Low dep tests: providers / tests
Matrix: Additional CI image checks / Push Early Image Cache / push-ci-image-cache
Waiting for pending jobs
Matrix: Additional CI image checks / Push Early Image Cache / push-prod-image-cache
Waiting for pending jobs
Matrix: CI image checks / Build documentation
Matrix: CI image checks / MyPy checks
Matrix: provider distributions tests / prepare-install-verify-provider-distributions
Matrix: provider distributions tests / providers-compatibility-tests-matrix
Matrix: Helm tests / tests-helm
Matrix: Integration and System Tests / tests-core-integration
Matrix: Integration and System Tests / tests-providers-integration
Matrix: Special tests / Latest Boto test: core / tests
Matrix: Special tests / Latest Boto test: providers / tests
Matrix: Special tests / Latest SQLAlchemy test: providers / tests
Matrix: Special tests / Latest SQLAlchemy test: core / tests
Matrix: Special tests / Min SQLAlchemy test: providers / tests
Matrix: Special tests / Min SQLAlchemy test: core / tests
Matrix: Special tests / Pendulum2 test: core / tests
Matrix: Special tests / Pendulum2 test: providers / tests
Matrix: Special tests / Quarantined test: core / tests
Matrix: Special tests / Quarantined test: providers / tests
Matrix: tests-special / tests-system-core / tests
Additional CI image checks  /  Check that image builds quickly
10m 53s
Additional CI image checks / Check that image builds quickly
CI image checks  /  Static checks
21m 14s
CI image checks / Static checks
CI image checks  /  Test Python API client
4m 25s
CI image checks / Test Python API client
Helm tests  /  Release Helm
1m 34s
Helm tests / Release Helm
Integration and System Tests  /  System Tests
4m 9s
Integration and System Tests / System Tests
Build PROD images  /  Build Airflow and provider distributions
3m 50s
Build PROD images / Build Airflow and provider distributions
CI image checks  /  Publish documentation and validate versions
5m 39s
CI image checks / Publish documentation and validate versions
Summarize warnings
1m 21s
Summarize warnings
Matrix: Build PROD images / build-prod-images
Additional PROD image tests  /  ...  /  Build Airflow and provider distributions
Additional PROD image tests / PROD image extra checks (main) / pip-image / Build Airflow and provider distributions
Additional PROD image tests  /  ...  /  Build Airflow and provider distributions
Additional PROD image tests / PROD image extra checks (release) / pip-image / Build Airflow and provider distributions
Additional PROD image tests  /  Test examples of PROD image building
3m 13s
Additional PROD image tests / Test examples of PROD image building
Additional PROD image tests  /  Docker Compose quick start with PROD image verifying
4m 20s
Additional PROD image tests / Docker Compose quick start with PROD image verifying
Additional PROD image tests  /  Task SDK integration tests with PROD image
3m 43s
Additional PROD image tests / Task SDK integration tests with PROD image
Additional PROD image tests  /  ...  /  Regular e2e test
9m 49s
Additional PROD image tests / Test e2e integration tests with PROD image / Regular e2e test
Additional PROD image tests  /  ...  /  Remote logging e2e test
4m 34s
Additional PROD image tests / Remote logging tests with PROD image / Remote logging e2e test
Additional PROD image tests  /  ...  /  Elasticsearch remote logging e2e test
5m 4s
Additional PROD image tests / Elasticsearch remote logging tests with PROD image / Elasticsearch remote logging e2e test
Additional PROD image tests  /  ...  /  XCom object storage backend e2e test
4m 41s
Additional PROD image tests / XCom object storage backend tests with PROD image / XCom object storage backend e2e test
Additional PROD image tests  /  ...  /  Chromium UI e2e tests
16m 34s
Additional PROD image tests / Chromium UI e2e tests with PROD image / Chromium UI e2e tests
Additional PROD image tests  /  ...  /  Firefox UI e2e tests
20m 22s
Additional PROD image tests / Firefox UI e2e tests with PROD image / Firefox UI e2e tests
Additional PROD image tests  /  ...  /  WebKit UI e2e tests
35m 40s
Additional PROD image tests / WebKit UI e2e tests with PROD image / WebKit UI e2e tests
Additional PROD image tests  /  Airflow CTL integration tests with PROD image
5m 3s
Additional PROD image tests / Airflow CTL integration tests with PROD image
Matrix: Kubernetes tests / tests-kubernetes
Matrix: Additional PROD image tests / PROD image extra checks (main) / pip-image / build-prod-images
Waiting for pending jobs
Matrix: Additional PROD image tests / PROD image extra checks (release) / pip-image / build-prod-images
Waiting for pending jobs
Finalize tests  /  Update constraints
Finalize tests / Update constraints
Matrix: Finalize tests / dependency-upgrade-summary
Waiting for pending jobs
Matrix: finalize-tests / push-buildx-cache-to-github-registry / push-ci-image-cache
Waiting for pending jobs
Matrix: finalize-tests / push-buildx-cache-to-github-registry / push-prod-image-cache
Waiting for pending jobs
Notify Slack
0s
Notify Slack
Fit to window
Zoom out
Zoom in

Annotations

10 errors and 1 notice
[webkit] › tests/e2e/specs/dags-list.spec.ts:105:3 › Dags View Toggle › should toggle between card view and table view: airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts#L532
5) [webkit] › tests/e2e/specs/dags-list.spec.ts:105:3 › Dags View Toggle › should toggle between card view and table view Error: expect(locator).toBeVisible() failed Locator: locator('[data-testid="card-list"]').or(locator('[data-testid="table-list"]')).or(getByText(/no dag/i)).or(locator('table')) Expected: visible Timeout: 30000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 30000ms - waiting for locator('[data-testid="card-list"]').or(locator('[data-testid="table-list"]')).or(getByText(/no dag/i)).or(locator('table')) at ../pages/DagsPage.ts:532 530 | 531 | // Wait for any of these elements to appear > 532 | await expect(cardList.or(tableList).or(noDagFound).or(fallbackTable)).toBeVisible({ | ^ 533 | timeout: 30_000, 534 | }); 535 | at DagsPage.waitForDagList (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts:532:75) at DagsPage.navigate (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts:260:16) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dags-list.spec.ts:107:5
[webkit] › tests/e2e/specs/dag-code-tab.spec.ts:42:3 › DAG Code Tab › Verify code is scrollable for long files: airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts#L42
4) [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:42:3 › DAG Code Tab › Verify code is scrollable for long files Error: expect(locator).toBeVisible() failed Locator: locator('[role="code"]') Expected: visible Timeout: 5000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 5000ms - waiting for locator('[role="code"]') Call Log: - Test timeout of 60000ms exceeded at ../pages/DagCodePage.ts:42 40 | await this.navigateTo(`/dags/${dagId}/code`); 41 | await expect(this.editorContainer).toBeVisible({ timeout: 5000 }); > 42 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 43 | await this.waitForCodeReady(); 44 | } 45 | at DagCodePage.navigateToCodeTab (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts:42:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dag-code-tab.spec.ts:31:20
[webkit] › tests/e2e/specs/dag-code-tab.spec.ts:34:3 › DAG Code Tab › Verify DAG source code is displayed: airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts#L42
3) [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:34:3 › DAG Code Tab › Verify DAG source code is displayed Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: expect(locator).toBeVisible() failed Locator: locator('[role="code"]') Expected: visible Timeout: 5000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 5000ms - waiting for locator('[role="code"]') Call Log: - Test timeout of 60000ms exceeded at ../pages/DagCodePage.ts:42 40 | await this.navigateTo(`/dags/${dagId}/code`); 41 | await expect(this.editorContainer).toBeVisible({ timeout: 5000 }); > 42 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 43 | await this.waitForCodeReady(); 44 | } 45 | at DagCodePage.navigateToCodeTab (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts:42:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dag-code-tab.spec.ts:31:20
[webkit] › tests/e2e/specs/dag-code-tab.spec.ts:34:3 › DAG Code Tab › Verify DAG source code is displayed: airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts#L42
3) [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:34:3 › DAG Code Tab › Verify DAG source code is displayed Error: expect(locator).toBeVisible() failed Locator: locator('[role="code"]') Expected: visible Timeout: 5000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 5000ms - waiting for locator('[role="code"]') Call Log: - Test timeout of 60000ms exceeded at ../pages/DagCodePage.ts:42 40 | await this.navigateTo(`/dags/${dagId}/code`); 41 | await expect(this.editorContainer).toBeVisible({ timeout: 5000 }); > 42 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 43 | await this.waitForCodeReady(); 44 | } 45 | at DagCodePage.navigateToCodeTab (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts:42:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dag-code-tab.spec.ts:31:20
[webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run: airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts#L349
2) [webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timeout 60000ms exceeded while waiting on the predicate at ../pages/DagsPage.ts:349 347 | await this.navigateToDagDetail(dagName); 348 | await expect(this.triggerButton).toBeVisible({ timeout: 5000 }); > 349 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 350 | await this.triggerButton.click(); 351 | 352 | return this.handleTriggerDialog(); at DagsPage.triggerDag (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts:349:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dags-list.spec.ts:34:37
[webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run: airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts#L349
2) [webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timeout 60000ms exceeded while waiting on the predicate at ../pages/DagsPage.ts:349 347 | await this.navigateToDagDetail(dagName); 348 | await expect(this.triggerButton).toBeVisible({ timeout: 5000 }); > 349 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 350 | await this.triggerButton.click(); 351 | 352 | return this.handleTriggerDialog(); at DagsPage.triggerDag (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts:349:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dags-list.spec.ts:34:37
[webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run: airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts#L349
2) [webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run Error: Timeout 60000ms exceeded while waiting on the predicate at ../pages/DagsPage.ts:349 347 | await this.navigateToDagDetail(dagName); 348 | await expect(this.triggerButton).toBeVisible({ timeout: 5000 }); > 349 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 350 | await this.triggerButton.click(); 351 | 352 | return this.handleTriggerDialog(); at DagsPage.triggerDag (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagsPage.ts:349:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dags-list.spec.ts:34:37
[webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed: airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts#L42
1) [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Test timeout of 60000ms exceeded at ../pages/DagCodePage.ts:42 40 | await this.navigateTo(`/dags/${dagId}/code`); 41 | await expect(this.editorContainer).toBeVisible({ timeout: 5000 }); > 42 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 43 | await this.waitForCodeReady(); 44 | } 45 | at DagCodePage.navigateToCodeTab (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts:42:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dag-code-tab.spec.ts:31:20
[webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed: airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts#L42
1) [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Test timeout of 60000ms exceeded at ../pages/DagCodePage.ts:42 40 | await this.navigateTo(`/dags/${dagId}/code`); 41 | await expect(this.editorContainer).toBeVisible({ timeout: 5000 }); > 42 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 43 | await this.waitForCodeReady(); 44 | } 45 | at DagCodePage.navigateToCodeTab (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts:42:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dag-code-tab.spec.ts:31:20
[webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed: airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts#L42
1) [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed Error: expect(locator).toBeVisible() failed Locator: locator('[role="code"]') Expected: visible Timeout: 5000ms Error: element(s) not found Call log: - Expect "toBeVisible" with timeout 5000ms - waiting for locator('[role="code"]') Call Log: - Test timeout of 60000ms exceeded at ../pages/DagCodePage.ts:42 40 | await this.navigateTo(`/dags/${dagId}/code`); 41 | await expect(this.editorContainer).toBeVisible({ timeout: 5000 }); > 42 | }).toPass({ intervals: [2000], timeout: 60_000 }); | ^ 43 | await this.waitForCodeReady(); 44 | } 45 | at DagCodePage.navigateToCodeTab (/home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/pages/DagCodePage.ts:42:8) at /home/runner/work/airflow/airflow/airflow-core/src/airflow/ui/tests/e2e/specs/dag-code-tab.spec.ts:31:20
🎭 Playwright Run Summary
2 failed [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:46:3 › DAG Code Tab › Verify line numbers are displayed [webkit] › tests/e2e/specs/dags-list.spec.ts:31:3 › Dag Trigger Workflow › should successfully trigger a Dag run 5 flaky [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:34:3 › DAG Code Tab › Verify DAG source code is displayed [webkit] › tests/e2e/specs/dag-code-tab.spec.ts:42:3 › DAG Code Tab › Verify code is scrollable for long files [webkit] › tests/e2e/specs/dags-list.spec.ts:105:3 › Dags View Toggle › should toggle between card view and table view [webkit] › tests/e2e/specs/events-page.spec.ts:105:3 › Events with Generated Data › verify search for specific event type and filtered results [webkit] › tests/e2e/specs/requiredAction.spec.ts:43:3 › Verify Required Action page › Verify the actions list/table is displayed (or empty state if none) 1 skipped 80 passed (31.3m)

Artifacts

Produced during runtime
Name Size Digest
playwright-report-webkit
127 MB
sha256:7a96bf3bffbb3c69b3c8895f9a40019b0f5bc7deed76a16d544495bec40016e6