Comments (4)
As we have following in mail, we are considering to have a callback for this to change destination's name before the transfer really happens. A private build drop has been provided, and we are also considering to add the callback in public released DMLib for others.
from azure-storage-net-data-movement.
@EmmaZhu , please follow-up.
from azure-storage-net-data-movement.
Here is my scenario: I'm migrating files from Azure Files to Azure Blobs, and in Files I have certain directory structure. In blob storage I don't want to mirror that directory structure, only want flat blobs list. Also, source files have extensions, and I don't want to have extensions in blob names. So essentially I need at least a callback which gives me a chance to tweak the destination location path. Currently, this logic is hardcoded in different INameResolver
implementations (AzureFileToAzureNameResolver
for my case), and there is no way to provide my own or somehow else take part in this process.
As a workaround, I had to build my own version of the library where AzureFileToAzureNameResolver
is made public and allows assigning global (static) callback delegate to override the logic. I can afford this dirty trick as the migration tool I'm building is for one-time use. But longer-living software needs simpler and more robust solution. I would also say that described scenario would be nice to support in the AzCopy as well.
from azure-storage-net-data-movement.
I have a similar issue. My scenario: I'm developing a tool for migrating local files to Azure Blobs. Local files have a certain directory structure. In blob storage files should be stored as a flat list. Blob names are formed from parts of a local file path.
A callback or special class can solve this issue.
from azure-storage-net-data-movement.
Related Issues (20)
- Do not retry already failed files when restoring transfer from journal context
- Exception while creating Azure UserDelegation Key
- Send an Arbitrarily Large Stream to File Shares
- To download 267 MB files take 3 minutes
- Hang in DMLib when "System.Windows.Forms.Form" is loaded.
- Is there anything in the new API that replaces TransferManager.CopyDirectoryAsync ? HOT 1
- I am using this API for my Azure Data Lake Gen2 and it seems to work
- Method not found: 'Void Microsoft.Azure.Storage.Blob.BlobRequestOptions.set_EncryptionScope(System.String)
- Progress reporting reports different values for Upload/Download (a blob) and for download for a blob and a file share service HOT 1
- Trouble persisting to file a file or directory upload to file share
- A transfer hangs when two processes use Data Movement Library HOT 4
- How to write DownloadDirectoryAsync response in a Stream. HOT 1
- This repo is missing important files
- Copying files from one azure blob storage account to another
- Access to Azure File Share fails on Android (using .Net Maui)
- Support Status
- A file gets 409 error while data are committed HOT 1
- Include "Retry-After" in the Response Header when Graph Throttling occurs while moving the files from Sharepoint.
- BlobContainerClient.StartDownloadToDirectoryAsync url-encodes subdirectories containing spaces.
- Microsoft.Azure.Storage.DataMovement GPL Issue
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from azure-storage-net-data-movement.