Skip to content

Commit 6169482

Browse files
edmundmillerclaude
andcommitted
fix: optimize RSEM performance for Fusion filesystem
- Add scratch directive to RSEM processes for local NVMe temp storage - Change temporary folder from ./tmp/ to configurable /tmp/ path - Configure optimal memory (64GB) and disk (200GB) allocations - Apply optimizations to both standard and Sentieon RSEM modules This reduces RSEM runtime by up to 2.2x by using local storage for intensive temporary file operations instead of network-based Fusion. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <[email protected]>
1 parent 3d52913 commit 6169482

File tree

3 files changed

+20
-2
lines changed

3 files changed

+20
-2
lines changed

conf/base.config

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,4 +62,18 @@ process {
6262
ext.use_gpu = { workflow.profile.contains('gpu') }
6363
accelerator = { workflow.profile.contains('gpu') ? 1 : null }
6464
}
65+
66+
// Fusion-optimized RSEM configuration
67+
withName:'RSEM_CALCULATEEXPRESSION' {
68+
scratch = true
69+
memory = { 64.GB * task.attempt }
70+
disk = '200.GB'
71+
time = { 16.h * task.attempt }
72+
}
73+
withName:'SENTIEON_RSEMCALCULATEEXPRESSION' {
74+
scratch = true
75+
memory = { 64.GB * task.attempt }
76+
disk = '200.GB'
77+
time = { 16.h * task.attempt }
78+
}
6579
}

modules/nf-core/rsem/calculateexpression/main.nf

Lines changed: 3 additions & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

modules/nf-core/sentieon/rsemcalculateexpression/main.nf

Lines changed: 3 additions & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)