Cloud customer?
 Upgrade in MyJFrog >

Search





Overview

The JFrog Platform hosts the following repository types:

Local and remote repositories are true physical repositories, while a virtual repository is actually an aggregation of them used to create controlled domains for search and resolution of artifacts.

To manage repositories, go to the Administration module under Repositories.

One Package Type Per Repository

When creating a repository, you must select a specific package type; this is a fundamental characteristic of the repository and can not be changed later. Once the repository type is set, the system will index artifacts and calculate the corresponding metadata for every package uploaded which optimizes performance when resolving artifacts. Note that virtual repositories can only include repositories of the same type.

Page Contents

Generic Repositories

You can define a repository as Generic in which case it has no particular type, and you may upload packages of any type. Generic repositories do not maintain separate package indexes. For using a client associated with a specific package type (e.g. yum, gem) you should create a matching repository. Generic repositories do not maintain separate package indexes, because they are not specific to any package type. They are useful when you want to proxy unsupported package types, store installers, navigation files, audio files, etc.

For example, you can create a generic remote repository that proxies and caches Homebrew artifacts. To do this, simply set up a Homebrew repository with the https://homebrew.bintray.com/ URL.

Uploading an Incorrect Package Type

While the system will not prevent you from uploading a package of the wrong type to a repository, we strongly recommend maintaining consistency between the repository type and packages you upload. If you do upload packages of the wrong type to a repository, Artifactory will not index the package or update the metadata for the repository.


Local Repositories

Local repositories are physical, locally-managed repositories into which you can deploy artifacts.

Artifacts in a local repository can be accessed directly using the following URL:
http://<host>:<port>/artifactory/<local-repository-name>/<artifact-path>

For full details on configuring local repositories, please refer to the Local Repositories page.


Remote Repositories

remote repository serves as a caching proxy for a repository managed at a remote URL (which may itself be another Artifactory remote repository).  

Artifacts are stored and updated in remote repositories according to various configuration parameters that control the caching and proxying behavior. You can remove artifacts from a remote repository cache but you cannot actually deploy a new artifact into a remote repository.

Artifacts in a remote repository can be accessed directly using the following URL:

http://<host>:<port>/artifactory/<remote-repository-name>/<artifact-path>

This URL will fetch a remote artifact to the cache if it has not yet been stored.

In some cases it is useful to directly access artifacts that are already stored in the cache (for example to avoid remote update checks).

To directly access artifacts that are already stored in the cache you can use the following URL:

http://<host>:<port>/artifactory/<remote-repository-name>-cache/<artifact-path> 

Proxy vs. Mirror

A remote repository acts as a proxy not as a mirror. Artifacts are not pre-fetched to a remote repository cache. They are only fetched and stored on demand when requested by a client.
Therefore, a remote repository should not contain any artifacts in its cache immediately after creation. Artifacts will only be fetched to the cache once clients start working with the remote repository and issuing requests.

For full details on configuring remote repositories please refer to the Remote Repositories page.


Virtual Repositories

A virtual repository (or "repository group") aggregates several repositories with the same package type under a common URL. 

Generic Virtual Repositories

By their nature, Virtual Repositories whose package type has been specified as Generic can aggregate repositories of any type, however generic virtual repositories do not maintain any metadata.

The Default Virtual Repository (Deprecated)

Artifactory offers an option to use a global virtual, which contains all local and remote repositories.

By default this option is disabled, to enable the Default Virtual Repository edit the artifactory.system.properties located at $JFROG_HOME/artifactory/var/etc/artifactory and set the following flag to false:

## Disable the download access to the global 'repo'
artifactory.repo.global.disabled=false

This change requires you restart your Artifactory service.

Once enabled the repository is available at:

http://<hostname>:<port>/artifactory/repo

Virtual Resolution Order

When an artifact is requested from a virtual repository, the order in which repositories are searched or resolved is local repositories first, then remote repository caches, and finally remote repositories themselves.

Within each of these, the order by which repositories are queried is determined by the order in which they are listed in the configuration as described in General Resolution Order below.

For a virtual repository, you can see the effective search and resolution order in the Included Repositories list view in the Basic settings tab. This is particularly helpful when nesting virtual repositories. For more details on configuring a virtual repository please refer to the Virtual Repositories page.


General Resolution Order

You can set the order in which repositories of each type (local, remote and virtual) are searched and resolved by simply ordering them accordingly within the corresponding section of the Configure Repositories page. To set the order you need to add the repositories to the list of selected repositories in the order in which they should be searched to resolve artifacts.

The order in which repositories are searched is also affected by additional factors such as security privileges, include/exclude patterns and policies for handling snapshots and releases.


Common Settings

Several of the settings are common for local, remote and virtual repositories. These are found in the Basic tab of the corresponding New/Edit screen. Additional settings may be found in the type-specific section according to the package types specified for the repository.

Package Type
The Package Type. This must be specified when the repository is created, and once set, cannot be changed.
Repository Key
The Repository Key. A mandatory identifier for the repository and must be unique. It cannot begin with a number or contain spaces or special characters. For local repositories, we recommend using a "-local" suffix (e.g. "libs-release-local").
Repository Layout
Sets the layout that the repository should use for storing and identifying modules. A recommended layout that corresponds to the package type defined is suggested, and index packages uploaded and calculate metadata accordingly.
Public Description
A free text field that describes the content and purpose of the repository.
Internal Description
A free text field to add additional notes about the repository. These are only visible to the administrator.
Include and Exclude Patterns

The Include Patterns and the Exclude Patterns fields provide a way to filter out specific repositories when trying to resolve the location of different artifacts.

In each field you can specify a list of Ant-like patterns to filter in and filter out artifact queries. Filtering works by subtracting the excluded patterns (default is none) from the included patterns (default is all).

Example:

Consider that the Include Patterns and Exclude Patterns for a repository are as follows:

Include Patterns: org/apache/**,com/acme/**
Exclude Patterns: com/acme/exp-project/**

In this case, the repository is searched for org/apache/maven/parent/1/1.pom and com/acme/project-x/core/1.0/nit-1.0.jar but not for com/acme/exp-project/core/1.1/san-1.1.jar because com/acme/exp-project/** is specified as an Exclude pattern.

Enable Indexing in Xray

Enables indexing on the repository for security and compliance analysis. Available with JFrog Xray.

Avoiding Security Risks with an Exclude Pattern

Any proprietary artifacts you deploy are stored within local repositories so that they are available for secured and authorized internal use. Anyone searching for one of your internal artifacts by name will extract it through Artifactory from the local repository.

However, consider what happens if a request for an internal artifact is inadvertently directed outside of the organization.

Two examples of how this could happen are:

  • there is a simple typo in the requested artifact name
  • the developer has requested a snapshot with a version number that does not exist.

In this case, since the system does not find the requested artifact in a local repository, it continues to search through the remote repositories defined in the system. A search through all the remote repositories defined in your system before returning "Not found".

This presents a security risk since any request made on a remote repository may be logged exposing all details of the query including the full artifact name which may include sensitive business information.

Best practices using an excludes pattern for remote repositories to avoid security risks

To avoid exposing sensitive business information as described above, we strongly recommend the following best practices:

  • The list of remote repositories used in an organization should be managed under a single virtual repository to which all requests are directed
  • All internal artifacts should be specified in the Exclude Pattern field of the virtual repository (or alternatively, of each remote repository) using wildcard characters to encapsulate the widest possible specification of internal artifacts.
     

Avoiding Performance Issues with an Include Pattern

Include patterns help you avoid clutter in your local repositories by making sure that only certain types of artifact can be hosted there.  In a typical scenario, the system willl reference large all-purpose repositories such as JCenter or Maven Central for resolving artifacts.

In addition, Artifactory may reference any number of additional repositories which may host a more specialized and specific set of of artifacts.

If Artifactory receives a request for a deterministic set of artifacts (e.g. a specific version of an artifact), then it searches through the different repositories according to its resolution order until the artifact is found.

However, if Artifactory receives a request for a non-deterministic set of artifacts ( e.g. all versions of maven-metadata.xml) then it must search through all of the repositories it references until it can provide a complete response.

In most cases, the majority of artifacts downloaded by an organization will come from one of the large all-purpose repositories, but in non-deterministic requests performance is downgraded because Artifactory continues to search through all the specialized repositories before it can return a response.

Best practices using an includes pattern for remote repositories to avoid needless and wasteful search

To avoid performing needless and wasteful search when responding to non-deterministic requests we strongly recommend that all specialized repositories be configured with an appropriate Include Pattern specifying only the set of artifacts that the organization might need.

In this case, non-deterministic requests for artifacts that are typically found in general purpose repositories will skip over the specialized repositories thereby improving performance.

Local and Remote Repositories

In addition to the settings above, Local and Remote repositories share the following settings in the type-specific section for relevant package types.

Max Unique Snapshots

Specifies the maximum number of unique snapshots of the same artifact that should be stored. Once this number is reached and a new snapshot is uploaded, the oldest stored snapshot is removed automatically.

Blank (default) indicates that there is no limit on the number of unique snapshots.

Handle Releases
If set, Artifactory allows you to deploy release artifacts into this repository.
Handle Snapshots
If set, Artifactory allows you to deploy snapshot artifacts into this repository.
Copyright © 2020 JFrog Ltd.