From 58e46b2ca17cb9cd5968684a323634accd7b7bf0 Mon Sep 17 00:00:00 2001 From: Adam Talbot <12817534+adamrtalbot@users.noreply.github.com> Date: Fri, 12 Apr 2024 09:33:52 +0100 Subject: [PATCH 1/2] Improve documentation about azcopy installation requirements for custom Azure Batch worker pools Signed-off-by: Adam Talbot <12817534+adamrtalbot@users.noreply.github.com> --- docs/azure.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/azure.md b/docs/azure.md index 2130242518..d172cf71af 100644 --- a/docs/azure.md +++ b/docs/azure.md @@ -242,6 +242,7 @@ When Nextflow is configured to use a pool already available in the Batch account 1. The pool must be declared as `dockerCompatible` (`Container Type` property). 2. The task slots per node must match the number of cores for the selected VM. Otherwise, Nextflow will return an error like "Azure Batch pool 'ID' slots per node does not match the VM num cores (slots: N, cores: Y)". +3. If `azure.batch.copyToolInstallMode = 'node'`, all pools must have [AzCopy](https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-v10) available in the PATH. By default Nextflow uses a [start task](https://learn.microsoft.com/en-us/azure/batch/jobs-and-tasks#start-task) to install this to `$AZ_BATCH_NODE_SHARED_DIR/bin/`. ### Pool autoscaling From d8c32fcad00aa226268094d68c95bff0da75df70 Mon Sep 17 00:00:00 2001 From: Adam Talbot <12817534+adamrtalbot@users.noreply.github.com> Date: Fri, 12 Apr 2024 10:14:56 +0100 Subject: [PATCH 2/2] Rephrase to make it a bit simpler Signed-off-by: Adam Talbot <12817534+adamrtalbot@users.noreply.github.com> --- docs/azure.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/azure.md b/docs/azure.md index ff3b8ddd0b..a805ad6fde 100644 --- a/docs/azure.md +++ b/docs/azure.md @@ -248,7 +248,7 @@ When Nextflow is configured to use a pool already available in the Batch account 1. The pool must be declared as `dockerCompatible` (`Container Type` property). 2. The task slots per node must match the number of cores for the selected VM. Otherwise, Nextflow will return an error like "Azure Batch pool 'ID' slots per node does not match the VM num cores (slots: N, cores: Y)". -3. If `azure.batch.copyToolInstallMode = 'node'`, all pools must have [AzCopy](https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-v10) available in the PATH. By default Nextflow uses a [start task](https://learn.microsoft.com/en-us/azure/batch/jobs-and-tasks#start-task) to install this to `$AZ_BATCH_NODE_SHARED_DIR/bin/`. +3. Unless you are using [Fusion](./fusion.md), all tasks must have [AzCopy](https://learn.microsoft.com/en-us/azure/storage/common/storage-use-azcopy-v10) available in the path. If `azure.batch.copyToolInstallMode = 'node'` this will require every node to have the azcopy binary located at `$AZ_BATCH_NODE_SHARED_DIR/bin/`. ### Pool autoscaling