Uploaded image for project: 'Artifactory Binary Repository'
  1. Artifactory Binary Repository
  2. RTFACT-23406

Eventual Queue waiting for the first file to be uploaded to S3 before deploying other files

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Affects Version/s: 6.20.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Severity:
      Critical
    • Team:
      dev-artifactory-core3
    • Release Notes:
      No

      Description

      Eventual Queue waiting for the first file to be uploaded to S3 before deploying other files.

      This means all other files deployed will wait in line before being available on the s3, and will also remain in the _queue directory until the first file is uploaded. 

      Reproduce Steps:

      1. Prepare 3 files, the 1st file “30g.dat”(size=30GB); 2nd file “1k.dat”(size=1KB); 3rd file “2k.dat”(size=2KB)
      2. Upload the file “30g.dat” to Artifactory successfully.
      3. Wait for 15s, make sure the dispatcher already dispatched it to some worker.
      4. Upload file “1k.dat” to Artifactory successfully.
      5. Wait for 15s, check the eventual _queue folder: <artifactory_data_dir>/eventual/_queue/, we expect the “1k.dat” should be scheduled to some idle worker after 1s and transfer it to s3 server, then remove it from _queue folder.
      6. But the “1k.dat” stays in the _queue folder for a very long time, until the “30g.dat” transferring to s3 server finish, then the dispatcher start dispatching the file “1k.dat” and remove it from _queue folder.
      7. Similarly upload “2k.dat” to Artifactory, notice the same behavior as “1k.dat”.
      8. Do a thread dump after uploading “2k.dat”( “30g.dat” transferring is still ongoing) , found 5 s3 worker threads, but only one thread is “Runnable”, all others are “Parking”. Attached my captured thread dump.

       

      Binarystore.xml file used:

      <config version="2">
         <chain template="cluster-s3"/>
         <provider id="s3" type="s3">
            <endpoint>http://s3.amazonaws.com</endpoint>
            <identity>xxxxxxxxxxxxxxx</identity>
            <credential>xxxxxxxxxxxxx</credential>
            <path>artifactory</path>
            <bucketName>mybucketname</bucketName>
         </provider>
      </config>
      

        Attachments

          Activity

              People

              Assignee:
              oleksandrl Oleksandr Legenkiy [EXT]
              Reporter:
              ohadl Ohad Levy
              Votes:
              2 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Sync Status

                  Connection: RTFACT Sync
                  RTMID-23406 -
                  SYNCHRONIZED
                  • Last Sync Date: