Skip to main content

Required settings

  • Account identifier
  • Virtual warehouse
  • Service account
  • Database name
  • Schema name
You can find your account identifier at the bottom left corner of your Snowflake console.Retrieving your account identifier
To use key-pair authentication, you will want to generate an RSA key pair.
Then upload the public key to Snowflake
Once this is done, provide us the private key to authenticate with.

Advanced features

Snowflake turbo mode

Snowflake turbo mode allows you to switch between warehouse sizes based on your data volume and lag.
Artie continuously monitors the ingestion lag and row backlog for each pipeline writing to Snowflake. When both metrics exceed configurable thresholds, Artie automatically switches the pipeline to a larger Snowflake warehouse to accelerate catch-up. Once the backlog clears and metrics stay below thresholds for several consecutive checks, Artie scales back down to the pipeline’s normal warehouse.

How it works

1

Monitoring

Every 10 minutes, Artie queries the pipeline’s current ingestion latency (in minutes) and pending row count.
2

Scale up

If both the latency and row backlog exceed their thresholds, the pipeline is switched to the configured turbo warehouse and you are notified.
3

Scale down

Once both metrics drop below thresholds for 3 consecutive checks, the pipeline is returned to its normal warehouse and you are notified again.

Configuration

You can activate this feature by going to your pipeline’s destination advanced settings.

Key behaviors

  • Both thresholds must be exceeded simultaneously to activate turbo mode - a spike in only one metric will not trigger a scale-up.
  • Scale-down requires 3 consecutive below-threshold checks to avoid flapping between warehouses.
  • You will receive a notification whenever turbo mode is activated or deactivated.
Snowflake turbo mode

Snowflake eco mode

Snowflake eco mode is a great option if you only need faster data syncs during business hours. Click here to learn more!
  1. Edit your pipeline
  2. Go into the Destinations tab
  3. Open Advanced settings and select + New schedule
  4. Define your peak hours and your time zone
  5. Define your flush rules for off-peak hours
  6. Save schedule
  7. Deploy your changes
Setting up Snowflake eco mode

Troubleshooting

To start, We would recommend you to go with a x-small and decide whether or not you need to scale based off of our Snowflake insights metrics from our Analytics portal.Generally speaking, if your overall query execution time is high, then you may want to scale to a larger instance. If your queued overload time is high, you may want to have more virtual warehouse nodes to increase your parallelizable slots.
Snowflake’s native RBAC makes it so that the account that created the resource is the native owner. To change this, assign the ARTIE service account’s role to your account and you will be able to operate on the table. See the GIF below on how to fix this problem.Snowflake access control