Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
Honor the model's generation_config.eos_token_id in the transformers backend Build PR Documentation #2032: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Tests #3929: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Slow end to end tests #1529: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
Honor the model's generation_config.eos_token_id in the transformers backend Quality #3930: Pull request #1279 opened by waqaskhan137
Action required waqaskhan137:fix-eos-token-id-chat-models
waqaskhan137:fix-eos-token-id-chat-models
Action required
[BUG] [eval] --max-samples 10 and then without, you get the cached data from the previous run. .github/workflows/pr_style_bot.yaml #262: Issue comment #1040 (comment) by NathanHB
Failure
Failure
Fix reversed gold index in boolq:contrastset prompt Build PR Documentation #2031: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
Fix reversed gold index in boolq:contrastset prompt Tests #3928: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
Fix reversed gold index in boolq:contrastset prompt Quality #3929: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
Fix reversed gold index in boolq:contrastset prompt Slow end to end tests #1528: Pull request #1277 opened by vineethsaivs
Action required vineethsaivs:fix/boolq-contrastset-gold-index
vineethsaivs:fix/boolq-contrastset-gold-index
Action required
feat: add static linter command for custom tasks Build PR Documentation #2030: Pull request #1268 synchronize by Kesav2k04
Action required Kesav2k04:feature/task-integrity-linter
Kesav2k04:feature/task-integrity-linter
Action required
feat: add static linter command for custom tasks Slow end to end tests #1527: Pull request #1268 synchronize by Kesav2k04
Action required Kesav2k04:feature/task-integrity-linter
Kesav2k04:feature/task-integrity-linter
Action required
feat: add static linter command for custom tasks Tests #3927: Pull request #1268 synchronize by Kesav2k04
Action required Kesav2k04:feature/task-integrity-linter
Kesav2k04:feature/task-integrity-linter
Action required
feat: add static linter command for custom tasks Quality #3928: Pull request #1268 synchronize by Kesav2k04
Action required Kesav2k04:feature/task-integrity-linter
Kesav2k04:feature/task-integrity-linter
Action required
Only the main process writes the sample cache under data-parallel (#1… Build Documentation #372: Commit 64f4f5a pushed by NathanHB
1m 34s main
main
1m 34s
Only the main process writes the sample cache under data-parallel (#1… Tests #3926: Commit 64f4f5a pushed by NathanHB
2m 45s main
main
2m 45s
Only the main process writes the sample cache under data-parallel (#1… Slow end to end tests #1526: Commit 64f4f5a pushed by NathanHB
19m 11s main
main
19m 11s
Only the main process writes the sample cache under data-parallel (#1… Quality #3927: Commit 64f4f5a pushed by NathanHB
1m 53s main
main
1m 53s
Only the main process writes the sample cache under data-parallel (#1… Scan Secret Leaks #1568: Commit 64f4f5a pushed by NathanHB
16s main
main
16s
Fix sample-cache corruption under accelerate data-parallel .github/workflows/pr_style_bot.yaml #261: Issue comment #1271 (comment) by NathanHB
Failure
Failure
vLLM Main Branch Tests vLLM Main Branch Tests #18: Scheduled
1h 5m 38s main
main
1h 5m 38s
Fix sample-cache corruption under accelerate data-parallel .github/workflows/pr_style_bot.yaml #260: Issue comment #1271 (comment) by shipbehaves
Failure
Failure
Add unit tests for VLLMModel sampling params and config wiring .github/workflows/pr_style_bot.yaml #259: Issue comment #1276 (comment) by jayzuccarelli
Failure
Failure
Fix CorpusLevelF1Score(None) to report positive-class F1, not max-per-class Build PR Documentation #2028: Pull request #1275 opened by iamsharduld
Action required iamsharduld:fix/corpus-f1-binary
iamsharduld:fix/corpus-f1-binary
Action required
Fix CorpusLevelF1Score(None) to report positive-class F1, not max-per-class Quality #3925: Pull request #1275 opened by iamsharduld
Action required iamsharduld:fix/corpus-f1-binary
iamsharduld:fix/corpus-f1-binary
Action required
Fix CorpusLevelF1Score(None) to report positive-class F1, not max-per-class Slow end to end tests #1524: Pull request #1275 opened by iamsharduld
Action required iamsharduld:fix/corpus-f1-binary
iamsharduld:fix/corpus-f1-binary
Action required