Uploaded image for project: 'Artifactory Binary Repository'
  1. Artifactory Binary Repository
  2. RTFACT-17627

Leak in file descriptors on replicator when replicating

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Normal
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.5.1
    • Component/s: Replicator
    • Labels:
      None

      Description

      When replicating large files target replicator becomes very slow.
      This was introduced in 6.3.

      Fix includes changes only in replicator.

      To reproduce:
      create a source artifactory with replicator enabled
      create target artifactory with replicator enabled
      upload a large file to source artifactory example: https://jfrog-int.bintray.com/generic-qa-automation/CSMS-Astro-07.17.03.00-09.iso (in the below example it is uploaded to example-repo-local)
      generate admin token on target artifactory:

       curl -uadmin:password -XPOST "http://localhost:8081/artifactory/api/security/token" -d "username=admin" -d "scope=jfrt@01c243683j2c2e19fztztb1qma:admin" -dexpires_in=0
       

      invoke the following api on artifactory source:

       
      curl -uadmin:password -XPOST -H"Content-Type:application/json" -H"X-Auth-Token-Delegate:<token from previous step>" http://localhost:8082/artifactory/api/replication/replicate/file/example-repo-local --data '{"source_path":"example-repo-local/CSMS-Astro-07.17.03.00-09.iso","target_artifactory_url":"http://rt-target:8081/artifactory","target_path":"example-repo-local/path/CSMS-Astro-07.17.03.00-09.iso","release_bundle":true}'
      

      Upload is very slow.
      In my testing I used docker for source and target.
      Target replicator log is getting slower and slower and eventually getting stuck on

       INFO[Oct 14 14:17:08.128] Bulk Upload Parts v2 request from: rt-target:6061 

      All docker commands are getting stucked.
      Only way to release the machine is restart to docker machine.

        Attachments

          Activity

            People

            • Assignee:
              galba Gal Ben Ami
              Reporter:
              galba Gal Ben Ami
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: