Adding Source Data

Before you begin, see Requirements for Source Datasets.

For BigQuery and Snowflake, you can add a single source table at a time.

For ADLS, Delta Lake, GCS, and S3, you can add either a single file or multiple files from the same location. If adding multiple files, all the files must have the same column headers. Tamr combines these files into a single source dataset.

To add a new source:

1. Navigate to Configurations > Sources.
2. In the bottom right, select Add Source.
3. Enter a Source Name and optional description.
4. Select the type of source you are adding: ADLS, BigQuery, Delta Lake, GCS, S3, Snowflake, or file Upload.
5. Select a configured connection for adding this source.
   Note: If a connection has not been configured for the source type, select Add Connection to set up a new connection. See Managing Connections.
6. Depending on the source type:
   • For BigQuery, or Snowflake, enter the source table.
   • For ADLS, Delta Lake, GCS, or S3, enter the path to the file. If you are adding multiple files, enter the path to the location at which these files are stored.
     Note: For GCS sources, the file path cannot include colons.
   • Browse to the file for upload.
7. If you are adding a source file, specify the following format options:
   • Delimiter character. Default is comma ,.
   • Quote character used in field values. Default is double quote ".
   • Escape character for quote characters inside field values. Default is double quote ".

You can now use this source in a data product.