adding to azure blob storage with stream

Question

I am trying to add an IFormFile received via a .net core web API to an azure blob storage. These are the properties I have set up:

static internal CloudStorageAccount StorageAccount => 
    new CloudStorageAccount(new StorageCredentials(AccountName, AccessKey, AccessKeyName), true);

// Create a blob client.
static internal CloudBlobClient BlobClient => StorageAccount.CreateCloudBlobClient();

// Get a reference to a container 
static internal CloudBlobContainer Container(string ContainerName) 
                        => BlobClient.GetContainerReference(ContainerName);

static internal CloudBlobContainer ProfilePicContainer 
        => Container(ProfilePicContainerName);

Now I use the ProfilePicContainer like this:

var Container = BlobStorage.ProfilePicContainer;
string fileName = Guid.NewGuid().ToString("N") + Path.GetExtension(ProfileImage.FileName);
var blockBlob = Container.GetBlockBlobReference(fileName);
var fileStream = ProfileImage.OpenReadStream();
fileStream.Position = 0;
await blockBlob.UploadFromStreamAsync(fileStream);

This gives me the following error:

Microsoft.WindowsAzure.Storage.StorageException: 'Cannot access a closed Stream.'

Inner Exception ObjectDisposedException: Cannot access a closed Stream.

When debugging, I have noticed even before fileStream.Position = 0 it's position is already 0. However I added the line since I was getting this error. Also right at the await line, the fileStream's _disposed is set to false.

Moreover regarding the blob connection I have tried setting an invalid value for the string constant AccessKey and it shows the exact same error. Which means I have no idea if it is even connection. I have checked all values within blobBlock in the debugger, but I have no idea how to verify if it is connected.

It sounds like `fileStream` is already closed rather than a problem with the azure storage sdk? Are you able to access the `fileStream` stream at all? Can you write it to disk with something like `using (var testStream = File.OpenWrite(Path.GetTempFileName())) fileStream.CopyTo(testStream)`? — Stewart_R, Nov 15 '17 at 12:40
yes have tried the fileStream to write to file and to write to bytes. both works fine. — Neville Nazerane, Nov 15 '17 at 18:29
i had tried that earlier. I had other errors and saw recommendations online that said to not use using — Neville Nazerane, Feb 18 '18 at 06:07

score 2 · Accepted Answer · answered Feb 18 '18 at 06:10

There seems to be some issue when trying to write directly from the stream. I was able to run the code by converting the stream to a byte array.

await blockBlob.UploadFromByteArrayAsync(ReadFully(fileStream, blockBlob.StreamWriteSizeInBytes),
                            0, (int)fileStream.Length);

The ReadFully was a modification over this answer https://stackoverflow.com/a/221941

static byte[] ReadFully(Stream input, int size)
{
    byte[] buffer = new byte[size];
    using (MemoryStream ms = new MemoryStream())
    {
        int read;
        while ((read = input.Read(buffer, 0, size)) > 0)
        {
            ms.Write(buffer, 0, read);
        }
        return ms.ToArray();
    }
}

Will there be any comparative performance issues with multiple files 50 MB to 300 MB? — Souvik Ghosh, Jul 09 '18 at 04:02
i haven't tested that yet. but you can always use the simulated offline blob storage and test this out — Neville Nazerane, Jul 09 '18 at 04:28

adding to azure blob storage with stream

1 Answers1

Linked