Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Issue when evaluating Ministral-3-14B-Instruct-2512 .github/workflows/pr_style_bot.yaml #258: Issue comment #1270 (comment) by kafetzopoulos
Failure
Failure
Fix KeyError: 'default' for bigbench tasks with nonexistent split .github/workflows/pr_style_bot.yaml #257: Issue comment #1262 (comment) by nuthalapativarun
Failure
Failure
Document unconditioned_query requirement for PMI normalization .github/workflows/pr_style_bot.yaml #256: Issue comment #1261 (comment) by nuthalapativarun
Failure
Failure
Fix non-deterministic cache hash for MetricGrouping tasks .github/workflows/pr_style_bot.yaml #255: Issue comment #1260 (comment) by nuthalapativarun
Failure
Failure
Sync LightevalTaskConfig docstring with current fields .github/workflows/pr_style_bot.yaml #254: Issue comment #1259 (comment) by nuthalapativarun
Failure
Failure
Fix broken default_tasks.py link in quicktour docs .github/workflows/pr_style_bot.yaml #253: Issue comment #1258 (comment) by nuthalapativarun
Failure
Failure
Add script-aware language tags for FLORES 200 Build PR Documentation #2025: Pull request #1272 opened by goktugozkanmd
Action required goktugozkanmd:a67-issue-745-language-script
goktugozkanmd:a67-issue-745-language-script
Action required
Add script-aware language tags for FLORES 200 Slow end to end tests #1521: Pull request #1272 opened by goktugozkanmd
Action required goktugozkanmd:a67-issue-745-language-script
goktugozkanmd:a67-issue-745-language-script
Action required
Add script-aware language tags for FLORES 200 Tests #3921: Pull request #1272 opened by goktugozkanmd
Action required goktugozkanmd:a67-issue-745-language-script
goktugozkanmd:a67-issue-745-language-script
Action required
Add script-aware language tags for FLORES 200 Quality #3922: Pull request #1272 opened by goktugozkanmd
Action required goktugozkanmd:a67-issue-745-language-script
goktugozkanmd:a67-issue-745-language-script
Action required
[BUG] [eval] --max-samples 10 and then without, you get the cached data from the previous run. .github/workflows/pr_style_bot.yaml #252: Issue comment #1040 (comment) by shipbehaves
Failure
Failure
Fix sample-cache corruption under accelerate data-parallel .github/workflows/pr_style_bot.yaml #251: Issue comment #1271 (comment) by NathanHB
Failure
Failure
Fix sample-cache corruption under accelerate data-parallel .github/workflows/pr_style_bot.yaml #250: Issue comment #1271 (comment) by bot-ci-comment Bot
Failure
Failure
Upload PR Documentation Upload PR Documentation #1556: completed by shipbehaves
33s
33s
Keep trailing context space for answer-only bits-per-byte .github/workflows/pr_style_bot.yaml #249: Issue comment #1264 (comment) by kashif
Failure
Failure
add move_trailing_context_space flag for answer-only bits-per-byte (#… Build Documentation #371: Commit 95ad3bc pushed by NathanHB
2m 0s main
main
2m 0s
add move_trailing_context_space flag for answer-only bits-per-byte (#… Slow end to end tests #1520: Commit 95ad3bc pushed by NathanHB
18m 56s main
main
18m 56s
add move_trailing_context_space flag for answer-only bits-per-byte (#… Scan Secret Leaks #1567: Commit 95ad3bc pushed by NathanHB
19s main
main
19s
add move_trailing_context_space flag for answer-only bits-per-byte (#… Tests #3920: Commit 95ad3bc pushed by NathanHB
2m 43s main
main
2m 43s
add move_trailing_context_space flag for answer-only bits-per-byte (#… Quality #3921: Commit 95ad3bc pushed by NathanHB
1m 59s main
main
1m 59s
Keep trailing context space for answer-only bits-per-byte .github/workflows/pr_style_bot.yaml #248: Issue comment #1264 (comment) by NathanHB
Failure
Failure
Fix sample-cache corruption under accelerate data-parallel Build PR Documentation #2024: Pull request #1271 opened by shipbehaves
1m 54s shipbehaves:fix/cache-only-main-process-writes
shipbehaves:fix/cache-only-main-process-writes
1m 54s
Fix sample-cache corruption under accelerate data-parallel Tests #3919: Pull request #1271 opened by shipbehaves
2m 51s shipbehaves:fix/cache-only-main-process-writes
shipbehaves:fix/cache-only-main-process-writes
2m 51s
Fix sample-cache corruption under accelerate data-parallel Slow end to end tests #1519: Pull request #1271 opened by shipbehaves
18m 43s shipbehaves:fix/cache-only-main-process-writes
shipbehaves:fix/cache-only-main-process-writes
18m 43s
Fix sample-cache corruption under accelerate data-parallel Quality #3920: Pull request #1271 opened by shipbehaves
2m 8s shipbehaves:fix/cache-only-main-process-writes
shipbehaves:fix/cache-only-main-process-writes
2m 8s