Uploaded image for project: 'Artifactory Binary Repository'
  1. Artifactory Binary Repository
  2. RTFACT-12654

Out of space when uploading large files

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: Normal
    • Resolution: Unresolved
    • Affects Version/s: 4.9.0
    • Fix Version/s: None
    • Component/s: Docker
    • Environment:

      Description

      We are using the Docker image provided by JFrog.

      Whenever we try to upload large files (>5GB), we get an "Internal server error" (HTTP 500). This happens both in case of uploading from the UI and direct upload (via curl).

      After investingating the issue, we found that the overlay partition is running out from space. Apparently, nginx keeps the temporary files somewhere on the overlay partition and it passes them to Artifactory after the upload has completed. (Note that $ARTIFACTORY_HOME is set to /var/opt/jfrog/artifactory which is on a separate partition)

      We could not find out where exactly the temporary files are stored. Using strace we found out that a new file is created in /var/cache/nginx/client_temp, but it is unlinked directly after creation (??) and its file descriptor is used until the uploaded data is received and sent to artifactory.

      Could you please provide a way to upload large files without increasing the size of the overlay partition?

        Attachments

          Activity

            People

            Assignee:
            Unassigned
            Reporter:
            td_ul TD
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated: