Comments (8)
EmmaZhu
commented on September 13, 2024
Are you invoking CopyDirectoryAsync to copy blobs? Did you assign true or false to isServiceCopy when invoking the method? Are the two storage account in the same DC or not?
You can use ProgressHandler in TransferContext to monitor copying progress.
from azure-storage-net-data-movement.
prabhakarreddy1234
commented on September 13, 2024
Yes. I am invoking CopyDirectoryAsync.
Yes. I assigned IsServiceCopy = True
They are not in the same DC as it is backup, i want to make sure the backup lives in other DC.
I am using ProgressHandler and it is showing the copy progress. But not sure which file is transferred. I mean, the file uploaded after the copy process started ?
from azure-storage-net-data-movement.
EmmaZhu
commented on September 13, 2024
There is an EventHandler FileTransferred in DirectoryTransferContext which can be used to monitor files got copied successfully, the EventHandler FileFailed can be used to monitor transfer failures.
from azure-storage-net-data-movement.
prabhakarreddy1234
commented on September 13, 2024
I am using FileTransferred, FilesSkipped, FileFailed call backs. But my question is about the dataslice which is being copied. If during the copy, if i add another blob to the blob storage then would that new blob as well be copied to the destination ?
If yes, When does the job gets completed in the case where high volume applications pushing blobs into blob storage continuously 24/7 ?
If No, What should be the dataslice start and end times ? can we configure it ?
from azure-storage-net-data-movement.
blueww
commented on September 13, 2024
DMLib don't support changing source and destination.
From the code perspective, if the new added blob name location in the list sequence is still not listed by DMlib (such as you add a blob with name "z", and DMlib just list to "a"), it will be transferred by DMlib finally; else (e.g. you add blob name "a", and DMlib list to "z"), then the blob will not be transferred.
from azure-storage-net-data-movement.
vinjiang
commented on September 13, 2024
@EmmaZhu , please follow up the remaining questions.
from azure-storage-net-data-movement.
EmmaZhu
commented on September 13, 2024
@prabhakarreddy1234
Have our reply answered your questions? Do you need our further assistant?
from azure-storage-net-data-movement.
EmmaZhu
commented on September 13, 2024
Close this issue for now. Please feel free to reopen it or open a new one if any further assistant needed.
from azure-storage-net-data-movement.
Related Issues (20)
- Do not retry already failed files when restoring transfer from journal context
- Exception while creating Azure UserDelegation Key
- Send an Arbitrarily Large Stream to File Shares
- To download 267 MB files take 3 minutes
- Hang in DMLib when "System.Windows.Forms.Form" is loaded.
- Is there anything in the new API that replaces TransferManager.CopyDirectoryAsync ? HOT 1
- I am using this API for my Azure Data Lake Gen2 and it seems to work
- Method not found: 'Void Microsoft.Azure.Storage.Blob.BlobRequestOptions.set_EncryptionScope(System.String)
- Progress reporting reports different values for Upload/Download (a blob) and for download for a blob and a file share service HOT 1
- Trouble persisting to file a file or directory upload to file share
- A transfer hangs when two processes use Data Movement Library HOT 4
- How to write DownloadDirectoryAsync response in a Stream. HOT 1
- This repo is missing important files
- Copying files from one azure blob storage account to another
- Access to Azure File Share fails on Android (using .Net Maui)
- Support Status
- A file gets 409 error while data are committed HOT 1
- Include "Retry-After" in the Response Header when Graph Throttling occurs while moving the files from Sharepoint.
- BlobContainerClient.StartDownloadToDirectoryAsync url-encodes subdirectories containing spaces.
- Microsoft.Azure.Storage.DataMovement GPL Issue
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from azure-storage-net-data-movement.