Skip to content

Implement multi-dimensional DistConv sharding#27

Merged
PatrickRMiles merged 26 commits into
LBANN:mainfrom
PatrickRMiles:miles30/multidim_distconv
Mar 26, 2026
Merged

Implement multi-dimensional DistConv sharding#27
PatrickRMiles merged 26 commits into
LBANN:mainfrom
PatrickRMiles:miles30/multidim_distconv

Conversation

@PatrickRMiles

Copy link
Copy Markdown
Collaborator

No description provided.

Comment thread ScaFFold/utils/evaluate.py
Comment thread ScaFFold/configs/benchmark_default.yml Outdated
Comment thread ScaFFold/utils/trainer.py
Comment thread ScaFFold/utils/config_utils.py Outdated
@michaelmckinsey1

michaelmckinsey1 commented Mar 13, 2026

Copy link
Copy Markdown
Collaborator

Could you also make unet_bottleneck_dim a CLI argument for running scale 9+. This would be convienient nvm it already is a CLI arg

Comment thread ScaFFold/worker.py
@PatrickRMiles PatrickRMiles changed the title Draft: Implement multi-dimensional DistConv sharding Implement multi-dimensional DistConv sharding Mar 19, 2026
@michaelmckinsey1 michaelmckinsey1 mentioned this pull request Mar 21, 2026
4 tasks
@michaelmckinsey1
michaelmckinsey1 self-requested a review March 26, 2026 21:39
@PatrickRMiles
PatrickRMiles merged commit e62125c into LBANN:main Mar 26, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants