Starting with Azure NetApp Files is it better than Storage Spaces Direct in Azure. #Azure #NetApp #storagespaces #S2D #diskspd #WVD # Cloud #MVPBuzz #WIMVP   Leave a comment

Recently I did a blog post on the Azure VM size limit and what disk performance you get. Picking the right VM in Azure is important when you use Azure Storage SSD disks, as machines are limited in throughput. With a D64s_V3 and ultra SSD disk I get the 81544 IOPS that’s good but costly the VM is $5K then the disk will cost you also some $$. 

This post is not about costs or good or bad but it will show you that picking random resources will cost you more that a selective menu and get even better performance ad a lower cost.

https://robertsmit.wordpress.com/2019/07/09/azure-vm-vs-disk-vs-costs-does-size-matter-or-a-higher-price-for-better-specifications-azure-storage-performance/

#Azure #NetApp #storagespaces #S2D #diskspd #WVD # Cloud #MVPBuzz #WIMVP HTML5 #WVD #RDS #VDI #RDP #RDmi Security Center #Azure #NSG #Network Windows Server 2019 File Server clustering With powershell or GUI #Cluster #HA #Azure #WindowsAdminCenter #WindowsServer2019

below is my biggest IOPS number I have seen in Azure with a Diskspd test and this is not bad at all and the cost are not even worse that the D64 this is done with a H16r cost $1,472 per month

Getting massive IOPS in a VM is still not plug and play.

Azure NetApp Files 1200K IOPS

In my former blog post I tested some VM to get the maximum speed and selecting the right Azure VM can save some costs

Azure NetApp Files

When using VM’s with disk attached then the storage throughput is important, in a Azure VM cluster with Storage spaces direct the network is also important. Now with SMB storage the VM well it’s a VM but the setup of this VM is more important, what is the Network bandwidth and can it do #RDMA ? Basically a 1Gbps can do 95 Mb/s that’s not bad but we want to do more right.

But what if we use other storage will this be the same or different ? to give a good answer on this I’m doing the same test as I did in the blog post

https://robertsmit.wordpress.com/2019/07/09/azure-vm-vs-disk-vs-costs-does-size-matter-or-a-higher-price-for-better-specifications-azure-storage-performance/

https://robertsmit.wordpress.com/2019/07/09/azure-vm-vs-disk-vs-costs-does-size-matter-or-a-higher-price-for-better-specifications-azure-storage-performance/

here I got 80.000 IOPS not bad but at what costs. Storage is cheap in Azure but Performance cost a lot. and then the latency of the disks. It is all part of your solution.

https://azure.microsoft.com/en-us/services/netapp/

In this case I’m using the new Azure NetApp files It’s NFS or SMB and the pricing is different than the Azure disks. Cheaper or more Expensive it al depends on your solution and performance what you need. but your solution may need a different setup, as this is a SMB solution and not a direct attached disk.

Azure NetApp Files

A comparison between the Azure Files and the Azure Netapp Files and Azure Disks

image

Big numbers but it comes with a BUT for 320K IOPS on a 500TB pool times the $0.39 per GB that’s also a big cost So handle with care. but it’s a lot off IOPS.

image

Azure NetApp Files Comes in 3 options Standard, Premium and Ultra Seems fast.

Azure NetApp Files

Well lets test this and see where the difference is between premium and ultra. We add the AzureNetapp files to Our Azure subscription.

hero-img-cloud-sync-4

For starters the subscription need to be white listed before we can use this. We create NetApp Account and then we create some pools and Disks

Azure NetApp Files 

Now we have a virtual NetApp Storage device. We can create pools and volumes to work with.

image

For SMB Connections we need to join the Active Directory first.  As we need to create a Fileserver name similar like a SOFS server. This is created in your own Active directory and not in the Azure AD. Fileserver Computer Accounts will be created in your AD

Azure NetApp Filesimage

Whit these settings we have a similar configuration as the on premise config with RDMA Hyper-v or S2D or Azurestack HCI with these thoughts we can get big performance goals.

A user account that can create computer objects in the OU.  The LDAP structure is without the DC= part and My OU is in the Root so a short syntax.

#Azure #NetApp #storagespaces #S2D #diskspd #WVD # Cloud #MVPBuzz #WIMVP HTML5 #WVD #RDS #VDI #RDP #RDmi Security Center #Azure #NSG #Network Windows Server 2019 File Server clustering With powershell or GUI #Cluster #HA #Azure #WindowsAdminCenter #WindowsServer2019

Here you can see the just created link to the Domain.

Azure NetApp Files

Our next step is creating a Capacity pool These can be Large but remember pay per use! 

imageimage

Remember you will pay for the provisioned capacity, and here is the catch the larger the Pool the more IOPS you get. So if you have a tiny application that need performance you need to see what is the right choice.

Now that the Pool is created we can create a volume in the pool, all the basics are similar to the Microsoft Storage Pools.

Create Volume off 100GB in the 4 TB pool. the Costs are 4TB and not the 100GB.

Azure NetApp Files

I create a new Storage network, this is also a must a dedicated storage network for the NetApp files. If you are familiar with Storage spaces direct and multichannel SMB then you have a new playground, but less building.

image

image

Network is done File server is created and share is created, at this time no ACL’s are available on the share.

image

image

When the setup is done we see a File server in the AD structure. Netapp is using only the given name but will add a –XXXX to make the name unique. that makes sense as the deployment will fail on this. 

Azure NetApp Files

My first test on the 100GB share. Testing this with a Azure VM D2s_v3 Capable of delivering 4000 IOPS on the Disks

image

image

That is impressive almost 29.000 IOPS on a simple VM. well in my volumes I have just 4TB so 4x 4000 IOPS not bad

Azure NetApp Files

So a bigger machine is not needed than, well now the VM selection should not be on the Disk size but on the network throughput and more network adapters is needed the max out the storage as the D machine is having a 1Gbps nic this is to low for this.

Azure NetApp Filesimage

Impressed by the low latency numbers and how easy you got the performance.

Azure NetApp Files

Hitting the Network adapter limit Winking smile

image

 

image

29K IOPS on a cheap Azure D2 VM that’s not bad at all.

Good performance but I want more lets create some bigger pools and better network machines. Thinking about SMB direct or some big pool to hit real hard the storage to get big numbers. Like the demo’s of Jeff Woolsey @WSV_GUY

image

Looking into the resource group, here you can see the created resources and two NIC’s that’s resource I created a premium and an Ultra pool.

I can Imagine that this nic will be a throttle, in a big Pool hitting all the data to one NIC. 

Azure NetApp Files

Let me start a H8 Azure VM this is a new VM better network performance. Should be good.  pricing below $1000 monthly

Azure NetApp Files

Azure NetApp Files with a Premium 16TB disk

Azure NetApp Files

Low Latency good performance, with Azure disk I needed more disks and a bigger VM to get these results.

Azure NetApp Files

Same test with Ultra 16T Storage pool

imageimage

imageimage

No big changes between the Premium and Ultra and the cost are $0.10 more per GB 

So a new test  this time with a H16R nic with RDMA with this we can optimize the network performance a bit

image

https://docs.microsoft.com/en-us/azure/virtual-machines/windows/sizes-hpc#h-series

Azure NetApp Files

Well that’s good eh better than good big performance, but I must say this is not the default H16r machine I tweaked it a bit and used the same technique as when you build a Azurestack HCI or Hyper-v over SMB

Azure NetApp Files

I was to late to grab a decent CPU and nic performance screenshot.

I was planning to the same results on a A9 VM on my Windows Virtual desktop with the FSLogix profiles (user profile disks) but Running these is a A machine compaired a H or N series an NC24r or a ND40 or 24 cost some $ but huge performance. This is something for a next blog post.

image

But initial test where not better and the A9 VM is more expensive, and gives me thoughts on different options. what and how Can I extend the Azure networks to get the ultimate sweet spot cost vs performance.

I think this is a real good replacement for Azure S2D, its cheaper and faster, Suppose you run a RDS site with lots of User profile disks or Windows virtual desktop with FsLogix, build profiles high available will take you to a storage space direct cluster at least two nodes and 6 Disk. Replacing this with Azure NetApp files could save you some $$ and sure lots of options are in the cloud there and yes you may need a extra network, but if you can offload your network with some extra network adapters and have a storage network to boost the performance, then you have a great solution in the Cloud.

Follow Me on Twitter @ClusterMVP

Follow My blog https://robertsmit.wordpress.com

Linkedin Profile Robert Smit MVP Linkedin profile

Google  : Robert Smit MVP profile

 

Posted August 1, 2019 by Robert Smit [MVP] in Azure

Tagged with

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

  • Twitter

  • RSS Azure and Microsoft Windows Server Blog

  • %d bloggers like this: