Skip to main content

Required settings

  • Bucket (required)
  • Folder name (optional)
  • Checkpoint interval (optional, default: 10)
  • Service account (required)

Bucket structure

Artie will write all the delta files into an S3 bucket. The bucket structure will be as follows:

Checkpoint interval

Artie periodically writes a Delta Lake checkpoint file to consolidate the transaction log. The checkpoint interval controls how many commits occur between each checkpoint. A lower value means more frequent checkpoints (faster reads, more write overhead); a higher value means fewer checkpoints (less write overhead, slower cold reads). The default is 10.