atoti_azure package

Module contents

Plugin to load CSV and parquet files from Azure Blob Storage into atoti tables.

This package is required to load files with path like https://{ACCOUNT_NAME}.blob.core.windows.net/path/to/data-*.

Authentication is done with a connection string that will be read from the AZURE_CONNECTION_STRING environment variable or, if it does not exist, from the file at ~/.azure/credentials (C:\\Users\\{USERNAME}\\.azure\\credentials on Windows).

See also

AzureConfig to configure how atoti interacts with Azure.

atoti_azure.create_azure_key_pair(*, key_id, private_key, public_key)

Create the key pair to use for client side encryption.

Warning

Each encrypted blob must have the metadata attribute unencrypted_content_length with the unencrypted file size. If this is not set, an Issue while downloading error will occur.

Parameters
  • key_id (str) – The ID of the key used to encrypt the blob.

  • private_key (str) – The private key.

  • public_key (str) – The public key.

Return type

ClientSideEncryption