Details

    • Type: Improvement
    • Status: Open
    • Priority: Normal
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Support Zone
    • Labels:
      None

      Description

      Large instances can take a very long time to gather support bundles. See this 5 node cluster:
      $ grep "art-exec-4264" artifactory*
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,142",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.ArtifactorySupportBundleCollector:89",message="Initiating support content collection '/var/opt/jfrog/artifactory/data/tmp/work/...'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,153",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:59",message="Awaiting for tasks collecting content ..."
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,153",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectThreadDump'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,155",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectSecurityConfig'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,157",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectConfigDescriptor'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,157",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectConfigurationFiles'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,158",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectStorageSummary'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,159",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectSystemInfo'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:32:10,160",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectSystemLogs'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:42:56,333",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.BundleCollector:69",message="All collecting tasks were accomplished!"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:42:56,337",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.ArtifactorySupportBundleCollector:202",message="Flushing node manifest info NodeManifest(serviceType=jfrt, microserviceName=artifactory, microserviceVersion=6.12.2, serviceId=jfrt@01bnzqp8ex0eny1z3tb0zv0848, nodeId=artifact001, bundleInfo=NodeManifestBundleInfo(id=2019-11-13_High_DB_load-1573669916295, name=2019-11-13_High_DB_load, description=High Postgres DB load, created=2019-11-13T18:31:56.285Z[UTC], status=in progress)) was successfully accomplished"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:42:56,337",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.ArtifactorySupportBundleCollector:194",message="Compressing collected content ..."
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:44:12,248",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.ArtifactorySupportBundleCollector:166",message="Deployed bundle archive "..." under '...'"
      artifactory.2019-11-13_1847.log:timestamp="2019-11-13 18:44:12,250",thread="art-exec-4264",level="INFO ",class="o.a.a.s.c.ArtifactorySupportBundleCollector:106",message="Support request content collection is done!, - [...]"

      Then it moves on to the next node, takes another ~15 minutes. The last recorded timestamp in one of the nodes:
      artifactory.log:timestamp="2019-11-13 19:12:47,132",thread="art-exec-13253",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectSystemInfo'"
      artifactory.log:timestamp="2019-11-13 19:12:47,133",thread="art-exec-13253",level="INFO ",class="o.a.a.s.c.BundleCollector:151",message="Scheduling task 'collectSystemLogs'"
      [Customer decided to just tar xvzf at this point - it had been running for over 40 minutes at this point, as it would have taken over an hour to complete]

      Eventually the customer just decided to tar -xvzf his logs, which took 3 minutes, compared to our job taking 10 minutes to collect logs, and another 2 minutes to compress, and multiply by # of nodes (5 in this case).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                loreny Loren Yeung
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: