Uploaded image for project: 'Artifactory Binary Repository'
  1. Artifactory Binary Repository
  2. RTFACT-26647

Log Collection Feature Collecting Duplicate Logs

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Resolution: Unresolved
    • Affects Version/s: 7.29.7
    • Fix Version/s: None
    • Component/s: Artifactory Cloud
    • Labels:
      None
    • Environment:

      SaaS Artifactory 7.29.8

    • Location:
      External

      Description

      Problem Statement:

      SaaS log collection will upload the same log file twice: first from the /tmp directory and then again from the /opt/jfrog/artifactory/var/log/archived/ directory:

       

      2021-12-17T23:45:28.744Z [jfob ] [INFO ] [32511ed107beee28] [artifactory_client.go:41 ] [main ] - Shipping the log file /tmp/access-request.2021-12-17T23-45-03.253.log.gz474322536 to RT : http://localhost:8046/artifactory/api/v1/system/logs/generic/artifactory/2021-12-17/xxx-access-request.2021-12-17T23-45-03.253.log.gz/ [artifactory_client]
      2021-12-18T17:52:28.142Z [jfob ] [INFO ] [32511ed107beee28] [artifactory_client.go:41 ] [main ] - Shipping the log file /opt/jfrog/artifactory/var/log/archived/access-request.2021-12-17T23-45-03.253.log.gz to RT : http://localhost:8046/artifactory/api/v1/system/logs/generic/artifactory/2021-12-18/xxx-access-request.2021-12-17T23-45-03.253.log.gz/ [artifactory_client]
      

       

      These logs are placed into different directories with the same file name but their contents differ by several lines:

       

      diff a0oxc3vh4ylo-access-request.2021-12-17T23-45-03.253.log a0oxc3vh4ylo-access-request.2021-12-17T23-45-03.253\ \(1\).log | wc -l
      7
      

       

       Expected results:

      Archived logs are collected into Artifactory once when the log collection is enabled but not again when new logs are added to archive

      Impact:

      Increased SaaS storage usage

      Difficulty in parsing logs due to repeat file names and large amount of duplicate content

      Steps to reproduce:

      Enable Log Collection

        Attachments

          Activity

              People

              Assignee:
              Unassigned
              Reporter:
              jayv Jay Virtanen
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:

                  Sync Status

                  Connection: RTFACT Sync
                  RTMID-26657 -
                  SYNCHRONIZED
                  • Last Sync Date: