Skip to content

Upgrade Azure Storage Blob Client and Support OAuth2 for Storage Account#27

Open
gintau wants to merge 2 commits into
htgc:masterfrom
gintau:master
Open

Upgrade Azure Storage Blob Client and Support OAuth2 for Storage Account#27
gintau wants to merge 2 commits into
htgc:masterfrom
gintau:master

Conversation

@gintau
Copy link
Copy Markdown

@gintau gintau commented Dec 14, 2018

Hello,

This originally for my own use case but might be useful to merge it back. Please contact me if further discussion is needed.

The change is mainly migrating authentication method from storage key to MSI-based oauth token, as I feel it's a security risk to store secret in a file and look for similar experience of fluentd-s3, which relies on instance profile to auth s3 buckets.

Changes involved:

  1. Upgrade Azure SDK to azure-blob-client 1.1.0. At the time of write Azure SDK is divided into submodules and distributed separately. Blob client is the only one needed here.

  2. Introduce new config params azure_instance_msi and azure_oauth_refresh_interval to support OAuth, details is added in Authentication section in readme.

  3. Change config param auto_create_container to false, now Azure by default makes container private, returns 404 for get_properties, and invalidates ensure_container(). Hence users need to adjust the properties of their account if they'd like to enable creation. Making default value to false to enforce user to be aware of this fact.

Ting-Kuan Wu added 2 commits December 14, 2018 09:31
… to MSI-based oauth token, as I feel it's a security risk to store secret in a file and look for similar experience of fluentd-s3, which relies on instance profile to auth s3 buckets.

Changes involved:

Upgrade Azure SDK to azure-blob-client 1.1.0. At the time of write Azure SDK is divided into submodules and distributed separately. Blob client is the only one needed here.

Introduce new config params azure_instance_msi and azure_oauth_refresh_interval to support OAuth, details is added in Authentication section in readme.

Change config param auto_create_container to false, now Azure by default makes container private, returns 404 for get_properties, and invalidates ensure_container(). Hence users need to adjust the properties of their account if they'd like to enable creation. Making default value to false to enforce user to be aware of this fact.
incompatible 1.0.1 from azure-storage-blob dependency settings.

2. Fix refresh token function.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant