Skip to content

New merging worker prepare_spread#1141

Open
dwpaley wants to merge 17 commits intocctbx:masterfrom
dwpaley:spread_workflow_automation
Open

New merging worker prepare_spread#1141
dwpaley wants to merge 17 commits intocctbx:masterfrom
dwpaley:spread_workflow_automation

Conversation

@dwpaley
Copy link
Copy Markdown
Contributor

@dwpaley dwpaley commented Mar 25, 2026

Quasi-monochromatic SpReAD refinements via the moving-window approach. This PR adds a cctbx.xfel.merge worker that prepares a large Slurm array job containing all the partial-dataset merges and finishing with a parallel run of all Phenix refinements. Equal-width and equal-count binning modes are supported. Some documentation is included.

dwpaley and others added 17 commits March 20, 2026 17:15
Add activate scripts, direct access to params, return unchanged expts
and refls
This reverts commit 024a593.
- Quote SLURM_ARRAY_TASK_ID variable in bash conditionals (fixes local execution)
- Validate bin_start_eV and bin_end_eV are set in width binning mode
- Validate activation script paths exist before script generation

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- Quote all file path variables in bash template (fixes space-in-path issues)
- Validate activation scripts are SET before checking existence
- Validate phenix input files exist
- Move parameter validation to start of run() for fail-fast behavior
- Add warning logging for excluded experiments in width mode

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@dwpaley dwpaley requested review from asmit3, nksauter and phyy-nx March 25, 2026 15:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant