hydra: testing scheduler fixes on staging#1092
Merged
Merged
Conversation
Mic92
force-pushed
the
scheduler-fixes
branch
2 times, most recently
from
9dd507e to
1e65dba
Compare
The CA cert path used ../non-critical-infra, resolving to the nonexistent macs/non-critical-infra instead of the repo root. A bare path literal in a flake is rebased onto the source store path without an existence check, so the builder built fine but crash-looped at runtime unable to read ca.crt. Fix the path and wrap the static certs in builtins.path so a wrong path fails at eval. mac04 and mac05 were reinstalled with rotated host keys, so their sops age recipients were stale and queue-runner-client.key no longer decrypted. Re-key.
Builders upload NARs directly to S3 via presigned URLs instead of streaming through the queue runner. This requires every builder to substitute from the forced cache, otherwise the queue runner rejects it, so add the staging cache as a substituter on all staging builders via a shared module.
eval04 and build05 used the bare ::/64 address instead of ::1/64 like the other ofborg nodes, and their AAAA records pointed at the same address. The all-zero interface ID is reserved as the Subnet-Router anycast address (RFC 4291), so it is not a valid host unicast address, and it was not reachable from here. Use ::1 in both the host config and DNS to match the other nodes.
turns out when you get an error on a multi-part complete, you have to check if actually completed successfully.
Read cached-build nix-support from the .ls listing/NAR, not the local store.
Read requiredSystemFeatures from structured attrs so big-parallel builds schedule correctly.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
this will also deployed to hydra.nixos.org in the same PR.