Uploaded image for project: 'Artifactory Binary Repository'
  1. Artifactory Binary Repository
  2. RTFACT-16004

Artifactory fails to upload very large files to Azure blob storage

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Duplicate
    • Affects Version/s: 5.9.0, 6.13.1
    • Fix Version/s: 6.16.0
    • Component/s: Azure
    • Labels:
      None
    • Severity:
      High

      Description

      Artifactory fails to upload very large files to Azure blob storage.

      To reproduce

      1. Set up Artifactory with an Azure binary backend
      2. Create a 24GB file (fallocate -l 24G myLargeFile.out)
      3. Upload the file to Artifactory
      4. Let it try to upload the file and observe the failure

      The error

      java.io.IOException: Failed to put blob '82b9d07c2a89cd03a451731d3f38105a26bccebd' to Azure blob storage
      	at org.artifactory.addon.filestore.type.azureblobstorage.AzureBlobStorageBinaryProvider.addBigStream(AzureBlobStorageBinaryProvider.java:259)
      	at org.artifactory.addon.filestore.type.azureblobstorage.AzureBlobStorageBinaryProvider.addStream(AzureBlobStorageBinaryProvider.java:188)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:154)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:162)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:162)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:162)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:162)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:162)
      	at org.jfrog.storage.binstore.providers.RetryBinaryProvider.addStream(RetryBinaryProvider.java:69)
      	at org.artifactory.addon.filestore.eventual.task.EventuallyPersistedAddFileTask.run(EventuallyPersistedAddFileTask.java:73)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:748)
      Caused by: java.lang.RuntimeException: Failure occurred during blob upload
      	at org.artifactory.addon.filestore.type.azureblobstorage.AzureBlobStorageBinaryProvider.doBlockUpload(AzureBlobStorageBinaryProvider.java:311)
      	at org.artifactory.addon.filestore.type.azureblobstorage.AzureBlobStorageBinaryProvider.listFileBlocksTobeUploaded(AzureBlobStorageBinaryProvider.java:298)
      	at org.artifactory.addon.filestore.type.azureblobstorage.AzureBlobStorageBinaryProvider.addBigStream(AzureBlobStorageBinaryProvider.java:250)
      	... 14 common frames omitted
      Caused by: com.microsoft.azure.storage.StorageException: The request body is too large and exceeds the maximum permissible limit.
      	at com.microsoft.azure.storage.StorageException.translateException(StorageException.java:89)
      	at com.microsoft.azure.storage.core.StorageRequest.materializeException(StorageRequest.java:305)
      	at com.microsoft.azure.storage.core.ExecutionEngine.executeWithRetry(ExecutionEngine.java:175)
      	at com.microsoft.azure.storage.blob.CloudBlockBlob.uploadBlockInternal(CloudBlockBlob.java:904)
      	at com.microsoft.azure.storage.blob.CloudBlockBlob.uploadBlock(CloudBlockBlob.java:876)
      	at org.artifactory.addon.filestore.type.azureblobstorage.AzureBlobStorageBinaryProvider.doBlockUpload(AzureBlobStorageBinaryProvider.java:308)
      	... 16 common frames omitted
      

        Attachments

          Issue Links

            Activity

                People

                Assignee:
                tamirh Tamir Hadad
                Reporter:
                arturoa Arturo Aparicio (Inactive)
                Votes:
                3 Vote for this issue
                Watchers:
                6 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved:

                    Sync Status

                    Connection: RTFACT Sync
                    RTMID-16004 -
                    SYNCHRONIZED
                    • Last Sync Date: