BuildBench/timeline.html at main · AIOps-Lab-NKU/BuildBench · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
<!doctype html>
<html lang="en">
  <head>
    <meta charset="UTF-8" />
    <meta name="viewport" content="width=device-width, initial-scale=1.0" />
    <meta name="description" content="Participant dates for the Build-Bench Challenge, from the website beta and invited pilot through public evaluation, the final Agent freeze, and final results." />
    <title>Timeline | Build-Bench Challenge</title>
    <link rel="canonical" href="https://aiops-lab-nku.github.io/BuildBench/timeline.html" />
    <link rel="icon" type="image/svg+xml" href="assets/logo.svg" />
    <link rel="alternate icon" type="image/png" href="assets/favicon.png" />
    <link rel="stylesheet" href="styles.css?v=20260810-7" />
    <script src="assets/vendor/lucide.min.js?v=20260810-7" defer></script>
    <script src="i18n/timeline.js?v=20260803-3" defer></script>
    <script src="i18n.js?v=20260810-7" defer></script>
    <script src="auth-client.js?v=20260810-7" defer></script>
    <script src="app.js?v=20260810-7" defer></script>
  </head>
  <body class="timeline-page" data-page="timeline">
    <a class="skip-link" href="#main-content">Skip to main content</a>
    <header class="site-header">
      <div class="header-inner">
        <a class="brand" href="index.html" aria-label="Build-Bench Challenge home"><span class="brand-mark" aria-hidden="true"><img src="assets/logo.svg" alt="" /></span><span>Build-Bench</span></a>
        <button class="icon-button menu-button" type="button" aria-label="Open navigation" aria-expanded="false" aria-controls="site-nav" title="Open navigation" data-menu-button><i data-lucide="menu" aria-hidden="true"></i></button>
        <nav class="site-nav" id="site-nav" aria-label="Primary navigation" data-nav>
          <a href="index.html">Overview</a>
          <a href="task.html">Challenge</a>
          <a href="submission.html">Participate</a>
          <a href="evaluation.html">Evaluation</a>
          <a class="nav-emphasis" href="leaderboard.html"><i data-lucide="trophy" aria-hidden="true"></i>Leaderboard</a>
          <a href="rules.html">Rules</a>
          <div class="nav-more active" data-nav-more>
            <button class="nav-more-toggle" type="button" aria-expanded="false" aria-controls="nav-more-menu" data-nav-more-toggle>
              <span>More</span><span class="nav-more-caret" aria-hidden="true">▾</span>
            </button>
            <div class="nav-more-menu" id="nav-more-menu" data-nav-more-menu>
              <a href="timeline.html" class="active" aria-current="page"><span>Timeline</span><small>Competition dates and milestones</small></a>
              <a href="faq.html"><span>FAQ</span><small>Common questions and participant support</small></a>
            </div>
          </div>
        </nav>
      </div>
    </header>

    <main id="main-content">
      <section class="page-masthead timeline-masthead">
        <div class="content-wrap">
          <div>
            <span class="page-kicker">Competition dates</span>
            <h1>Timeline</h1>
            <p>The participant schedule from the website beta and invited pilot through public evaluation, the final Agent freeze, and publication of the official results.</p>
          </div>
        </div>
      </section>

      <div class="content-wrap timeline-content">
        <article class="timeline-document">
          <header class="timeline-introduction">
            <h2>Competition schedule</h2>
            <p>Use these dates to plan Agent development, testing, and final-version selection. Operational limits published on August 31 will apply when public development and validation open.</p>
          </header>

          <ol class="roadmap" aria-label="Build-Bench competition milestones">
            <li class="active">
              <time datetime="2026-08-14"><strong>August 14, 2026</strong><span>Participant release</span></time>
              <div><span class="roadmap-status release">Release</span><h3>Website beta and initial documentation</h3><p>The participant-facing website beta, updated dataset and Starter Kit information, and initial competition documentation are released. Teams can begin reviewing the task, submission format, and local development workflow.</p></div>
            </li>
            <li>
              <time datetime="2026-08-17"><strong>August 17&ndash;28, 2026</strong><span>Pre-launch test</span></time>
              <div><span class="roadmap-status pilot">Pilot</span><h3>Invited pilot</h3><p>Invited teams test registration, Agent upload, Hosted Smoke Test, Full Evaluation, and the supporting infrastructure. Pilot feedback may be used to correct the interface before the public phase.</p></div>
            </li>
            <li>
              <time datetime="2026-08-31"><strong>August 31, 2026</strong><span>Protocol freeze</span></time>
              <div><span class="roadmap-status policy">Policy freeze</span><h3>Rules and resource limits frozen</h3><p>The organizers publish the frozen dataset split sizes, per-Case timeouts, submission limits, resource policy, build-bypass policy, and validation protocol.</p></div>
            </li>
            <li>
              <time datetime="2026-09-07"><strong>September 7, 2026</strong><span>Public phase</span></time>
              <div><span class="roadmap-status opening">Opening</span><h3>Public development and validation open</h3><p>Registration, public development resources, Agent submission, Hosted Smoke Test, and public validation open to eligible teams.</p></div>
            </li>
            <li>
              <time datetime="2026-11-13"><strong>November 13, 2026</strong><span>Final selection</span></time>
              <div><span class="roadmap-status deadline">Deadline</span><h3>Final Agent version freeze</h3><p>Each Team must select the qualified, immutable Agent version to be used for final hidden evaluation. Later uploads will not replace the selected final version.</p></div>
            </li>
            <li>
              <time datetime="2026-11-20"><strong>By November 20, 2026</strong><span>Official publication</span></time>
              <div><span class="roadmap-status results">Results</span><h3>Final results published</h3><p>Hidden evaluation and result review conclude, and the official final results are published by this date.</p></div>
            </li>
          </ol>

          <p class="timeline-update"><strong>Schedule updates.</strong> If a date changes, this page will be versioned and the change will be announced through the official competition website.</p>

          <nav class="next-page" aria-label="Next page"><span>Next</span><a href="faq.html"><strong>FAQ</strong><small>Read answers to common competition questions</small><i data-lucide="arrow-right" aria-hidden="true"></i></a></nav>
        </article>
      </div>
    </main>

    <footer class="site-footer"><div class="footer-inner"><div class="footer-brand"><span class="brand-mark" aria-hidden="true"><img src="assets/logo.svg" alt="" /></span><div><strong>Build-Bench Challenge</strong><small>ICSE 2027 Competition Track</small></div></div><nav class="footer-links" aria-label="Footer navigation"><a href="submission.html">Participate</a><a href="evaluation.html">Evaluation</a><a href="timeline.html">Timeline</a><a href="faq.html">FAQ</a></nav><a href="#main-content">Back to top<i data-lucide="arrow-up" aria-hidden="true"></i></a></div></footer>
  </body>
</html>