This is a continuation of the previous posts on Azure Data Platform and discusses one of the best clients to access storage both on-premises and cloud providers.

1.download:

rclone config                            

Current remotes:

 

Name                 Type

====                 ====

con-s3-mac-prj-1     s3

 

e) Edit existing remote

n) New remote

d) Delete remote

r) Rename remote

c) Copy remote

s) Set configuration password

q) Quit config

e/n/d/r/c/s/q> e

 

Select remote.

Choose a number from below, or type in an existing value.

 1 > con-s3-mac-prj-1

remote> 1

 

Editing existing "con-s3-mac-prj-1" remote with options:

- type: s3

- provider: IBMCOS

- access_key_id: <your_access_key>

- secret_access_key: <your_access_secret>

- endpoint: s3-onpremise-store.company.com

2. Upload:

Data downloaded via rclone can be uploaded to Azure via AzCopy:

AzCopy is a command-line utility that can run on the system inside an on-premises network with no link connectivity to the Azure public cloud and leverage the web accessibility to transfer files to an Azure storage account with or without hierarchical namespace support.

 

The command is usually specified as:

Azcopy copy ‘./localFolder’ ‘https://mystorageacount.dfs.core.windows.net/mycontainer/folder/’ --recursive