About the weights of hidden cases

[qqq1357962]

Since the metrics' weights differ in different test cases, I want to confirm whether the weights of a hidden case are the same as its corresponding public case.

[liangrj2014]

We will run the beta submissions on the hidden testcases, and then determine the weights of hidden cases and releases them

[sherlock55341]

I wonder if it is possible to give the weights as the input.

[liangrj2014]

That's a good suggestion! We will see how to achieve this

[qqq1357962]

As the final submission deadline approaches, could you update the input files for public test cases if weights will be included? Also, would it be possible to share median performance on hidden cases to give us a rough idea of the relative importance of different metrics?

Thank you.

[liangrj2014]

Already updated. Thanks!