Skip to content

feat: real-world benchmark with nix-store -qR dependency data - #97

Merged
dominicusin merged 1 commit into
mainfrom
feat/0.24.0-real-data
Sep 8, 2026
Merged

dominicusin merged 1 commit into
mainfrom
feat/0.24.0-real-data

Conversation

@dominicusin

Copy link
Copy Markdown
Owner

What's New

  • Real dependency data via nix-store -qR (same mechanism as package managers)
  • 21 real packages with 954 actual dependency edges from NixOS store
  • All 7 solvers benchmarked against real package data
  • Results:
    • Fastest: greedy (0.0003s)
    • Most correct: z3 (0.0142s)
    • All solvers: 100% accuracy, 0 conflicts on real data
  • Data extraction scripts: real_data_extractor.py, extract_real_deps.py
  • Results: real_world_benchmark_results.json, real_deps_data.json

- Extracts REAL package dependencies via nix-store -qR (same mechanism as package managers)
- 21 real packages with 954 actual dependency edges from NixOS store
- All 7 solvers benchmarked against real data
- Results: greedy fastest (0.0003s), z3 most correct (0.0142s)
- All solvers 100% accuracy, 0 conflicts on real data
@qodo-code-review

Copy link
Copy Markdown

Qodo reviews are paused for this user.

Troubleshooting steps vary by plan Learn more →

On a Teams plan?
Reviews resume once this user has a paid seat and their Git account is linked in Qodo.
Link Git account →

Using GitHub Enterprise Server, GitLab Self-Managed, or Bitbucket Data Center?
These require an Enterprise plan - Contact us
Contact us →

@coderabbitai

coderabbitai Bot commented Sep 8, 2026

Copy link
Copy Markdown

Warning

Review limit reached

Next included review available in 42 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Learn how review limits work.

Review configuration:

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Advanced

Run ID: 2ea07b60-f968-4d38-88ee-0fd74f51771b

📥 Commits

Reviewing files that changed from the base of the PR and between b12bb76 and b6751aa.

📒 Files selected for processing (8)
  • extract_real_deps.py
  • real_data_extractor.py
  • real_deps_data.json
  • real_world_benchmark_results.json
  • real_world_data.json
  • real_world_data.py
  • real_world_solver_bench.py
  • run_benchmark.py

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@read-the-docs-community

Copy link
Copy Markdown

Documentation build overview

📚 package-maximizer | 🛠️ Build #34444985 | 📁 Comparing b6751aa against latest (b12bb76)

  🔍 Preview build  

2 files changed
± tui.html
± _modules/package_maximizer/tui/app.html

@dominicusin
dominicusin merged commit 8b760f3 into main Sep 8, 2026
15 of 16 checks passed
@dominicusin
dominicusin deleted the feat/0.24.0-real-data branch September 8, 2026 07:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant