Skip to main content

๐Ÿš€ Setting up Free Trial Account

This guide helps you set up a Fivetran File Connector to ingest files from cloud storage into Snowflake. Ideal for CSV, JSON, Excel, Parquet, and other file-based data ingestion.


๐Ÿงช Step 0: Create a Free Trial Fivetran Accountโ€‹

  1. Go to Fivetran Signup
  2. Sign up using your work email
  3. Verify your email and log in to the Fivetran dashboard
  4. You now have access to a 14-day free trial with full feature access

๐Ÿ–ผ๏ธ Trial Dashboard Previewโ€‹

Once logged in, you'll see a screen similar to this:

Fivetran Trial Dashboard

โ„น๏ธ Note: If you're running this Markdown in a GitHub repo or static site generator like Docusaurus, make sure the image path above matches your folder structure.


๐Ÿ“‚ Step 1: Prepare Your File Sourceโ€‹

Choose a source:

  • โœ… Amazon S3
  • โœ… Azure Blob
  • โœ… Google Cloud Storage (GCS)
  • โœ… SFTP, FTPS
  • โœ… Dropbox, Box

Setps to set S3 as source:

  • Create a folder: s3://your-bucket/my_data/
  • Upload test files: sales.csv, employees.json, etc.
Fivetran Trial Dashboard

๐Ÿ”— Step 2: Set Up File Connector in Fivetranโ€‹

  1. From the dashboard, click โž• Add Connector
  2. Search for "Files" and select your storage type (e.g., S3)
click โž• **Add Connector**

Connect

๐Ÿ” Step 3: Provide Authentication to Your Cloud Storageโ€‹

To allow Fivetran to access your files stored in a cloud service (like S3), you must set up authentication.

โœ… Options:โ€‹

  • IAM Role ARN (Recommended)
  • Access Key ID + Secret Access Key (for simpler setups or testing)

๐Ÿ› ๏ธ Step 1: Create an IAM Policy (for S3)โ€‹

This policy gives Fivetran read-only access to your S3 bucket.

Example Policy:

{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "FivetranS3ReadAccess",
"Effect": "Allow",
"Action": [
"s3:GetObject",
"s3:ListBucket"
],
"Resource": [
"arn:aws:s3:::your-bucket-name",
"arn:aws:s3:::your-bucket-name/*"
]
}
]
}

๐Ÿ› ๏ธ Step 1.1: Create an IAM Policy (for S3)โ€‹

This policy gives Fivetran read-only access to your S3 bucket.

Policy:

Connect

๐Ÿ› ๏ธ Step 1.2: Editing Permission (for S3)โ€‹

Connect

๐Ÿ› ๏ธ Step 1.3: Verifying Permission (for S3)โ€‹

Connect

๐Ÿ› ๏ธ Step 1.4: Create an IAM Role with Created Policy (for S3)โ€‹

Connect

๐Ÿ› ๏ธ Step 1.5: Getting Role ARN (for S3)โ€‹

Connect

  1. ๐Ÿ› ๏ธ Step 1: Setting Role ARN (for S3) & Test the Connection
Connect
  1. Set folder path and optional wildcards:
Connect
  • e.g., my_data/*.csv
  1. Choose your destination schema and destination table name

๐Ÿ—๏ธ Step 3: Set Up Destination โ€“ Snowflakeโ€‹

  1. Click โž• Add Destination (if not already set)
Connect
  1. Choose Snowflake
Connect
  1. Enter:
    • Account ID (e.g., xy12345.ap-south-1)
    • Warehouse
    • Database
    • Schema
    • User/Password or Key Pair Authentication
Connect
  1. Test the connection
Connect

๐Ÿง  Step 4: Configure File Parsingโ€‹

  • File format detection: Auto (or choose manually CSV, JSON, etc.)
  • Configure:
    • Header row
    • Encoding (UTF-8, etc.)
    • Delimiters
    • Quoting
  • Enable automatic schema detection

๐Ÿ” Step 5: Sync Settingsโ€‹

  • Set sync frequency (e.g., every hour, daily)
  • Choose file sync mode:
    • Process once
    • Rescan and update if modified

โœ… Step 6: Run First Syncโ€‹

  • Click Start Initial Sync
  • Monitor progress under the Connector Overview
  • Tables will be created automatically in Snowflake

๐Ÿ” Monitoring Syncโ€‹

  • Go to the Connectors tab
  • Click your connector
  • View:
    • Sync status
    • Last sync time
    • Schema changes
    • Error logs (if any)

๐Ÿ“˜ Additional Resourcesโ€‹


๐Ÿ Closing Notesโ€‹

  • Use the 14-day trial to evaluate performance and schema flexibility.
  • For production use, consider using naming conventions in file names for auto-splitting into separate tables.
  • Integrate with dbt or BI tools once data is landed in Snowflake.