Uploaded image for project: 'Artifactory Binary Repository'
  1. Artifactory Binary Repository
  2. RTFACT-17019

Helm Virtual index resolution will frequently hang in HA deployments when concurrent requests get routed to different nodes

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: 2 - Critical
    • Resolution: Done
    • Affects Version/s: 6.0.3
    • Fix Version/s: 6.1.0
    • Component/s: Helm
    • Labels:
      None
    • Severity:
      Critical

      Description

      Reproduce:

      1.

      a=1; while [ $a -le 10 ]; do curl "http://<LOAD_BALANCER_URL>/artifactory/helm-virtual/index.yaml" > $a & a=`expr $a + 1`; done

      2. List the creation time of the downloaded files, notice the times are quite staggered, meaning it took too long to serve some of those requests.

      ls -l -T

      Running this several times will cause some of the requests to hang up to 2 minutes (the Work Queue timeout to wait for an async invocation), or until another request to the same index.yaml (same underlying WorkQueue unique key) goes to the node where the hung requests were routed which "revives" the queue, but only if its actually able to acquire a lock on that unique key.  

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              shayb Shay Bagants
              Reporter:
              uriahl Uriah Levy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Sync Status

                  Connection: RTFACT Sync
                  RTMID-17019 -
                  SYNCHRONIZED
                  • Last Sync Date: