Skip to content

feat: Speed up asset uploads#7263

Merged
mergify[bot] merged 3 commits intoos-autoinst:masterfrom
Martchus:upload-junk-size
Apr 13, 2026
Merged

feat: Speed up asset uploads#7263
mergify[bot] merged 3 commits intoos-autoinst:masterfrom
Martchus:upload-junk-size

Conversation

@Martchus
Copy link
Copy Markdown
Contributor

@Martchus Martchus commented Apr 10, 2026

  • Increase default upload junk size from 1 MB to 10 MB
  • Adjust client_body_buffer_size setting as well adding a little bit of headroom
  • Define the constant for the default upload junk size only in one place

Related ticket: https://progress.opensuse.org/issues/199397


I'm adding the "not-ready" label because I still want to do some local tests and I also need to check whether the NGINX config needs to be changed manually in production. It looks like /etc/nginx/vhosts.d/openqa-endpoints.inc is modified on o3 and OSD so we'll have to change those files manually. So I'll change I changed the setting there manually.

Copy link
Copy Markdown
Contributor

@perlpunk perlpunk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tests need to be adjusted.
Maybe I would have conducted some more tests in production, but if turns out problematic, it's easy to fix

@perlpunk
Copy link
Copy Markdown
Contributor

And maybe it would be good to split the refactoring of the constant and the adjustment of the value to different commits.

@Martchus Martchus force-pushed the upload-junk-size branch 2 times, most recently from 36a2958 to 6195322 Compare April 13, 2026 10:15
@codecov
Copy link
Copy Markdown

codecov bot commented Apr 13, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.97%. Comparing base (e5bc742) to head (b5dd1d2).
⚠️ Report is 12 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #7263   +/-   ##
=======================================
  Coverage   99.97%   99.97%           
=======================================
  Files         421      421           
  Lines       44165    44167    +2     
=======================================
+ Hits        44152    44154    +2     
  Misses         13       13           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copy link
Copy Markdown
Contributor

@perlpunk perlpunk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For the recent PR regarding the VNC port it was requested to split the definition of the constant to a separate commit.
I don't know why @okurz approves here without that split.

@okurz
Copy link
Copy Markdown
Member

okurz commented Apr 13, 2026

For the recent PR regarding the VNC port it was requested to split the definition of the constant to a separate commit. I don't know why @okurz approves here without that split.

Because I trust that besides this change what you "requested" @Martchus will not include more

@perlpunk perlpunk dismissed their stale review April 13, 2026 12:03

Others disagree with me, no strong opinion

* Increase default upload junk size from 1 MB to 10 MB (speeds up the
  upload for me locally by around 35 %)
* Adjust `client_body_buffer_size` setting as well adding a little bit of
  headroom

Related ticket: https://progress.opensuse.org/issues/199397
Copy link
Copy Markdown
Contributor

@perlpunk perlpunk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

s/refactor(upload): Define junk size only once/refactor(upload): Define chunk size only once/

@perlpunk perlpunk dismissed their stale review April 13, 2026 12:47

resolved

openqa-git-sync pushed a commit to os-autoinst/salt-states-openqa that referenced this pull request Apr 13, 2026
To make full use of the upstream change introduced by
os-autoinst/openQA#7263.

Related ticket: https://progress.opensuse.org/issues/199397
@mergify mergify bot merged commit d18a5b3 into os-autoinst:master Apr 13, 2026
51 checks passed
@Martchus Martchus deleted the upload-junk-size branch April 13, 2026 14:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants