Adding a data file to a catalog

You can upload a data file to a catalog to create a new data asset.

Required permissions

  1. You must have the Editor or Admin role in a catalog to add a data asset from a data file.

Limitations

  1. The files that you add to a catalog are not checked for malicious code. You must ensure that your files do not contain malware or other types of malicious software that other collaborators might download."

  2. Only some file types are profiled. For more information, see Profiles of data assets.

  3. Local structured CSV or TSV files must have a valid schema that contains a header with unique column names.

Limitations

  1. The maximum size for files that you can load into a catalog is 5 GB.
    To add a larger file to a catalog, add it as a connected data asset.

  2. Only some types of files are profiled. For more information, see Profiles of data assets.

Adding a file

When you add a local file to a catalog, the following happens:

  • A data asset that contains information about the file is created in the catalog.
  • The file is saved in the catalog storage in the server's file system.

To add a local data file to a catalog:

  1. Click Add to catalog > Local file.
  2. Browse for the file or drag it onto the drop area.
  3. Specify the asset properties.
  4. Click Add. The asset is added to the catalog and the file starts loading into the catalog storage. Don't exit the catalog before the file finishes loading.

After the data asset appears on the Browse page, click its name to view and update it. If policies are enforced for the catalog, the asset preview is unavailable until the asset is evaluated by policies.

Next steps