This is Cormac Hogan's Typepad Profile.
Join Typepad and start following Cormac Hogan's activity
Cormac Hogan
Cork, Ireland
Senior Technical Marketing Architect for Storage at VMware
Recent Activity
London, Brussels, Dublin, Birmingham and Copenhagen in November
I have a whole host of speaking engagements this month. Most of these are at VMUGs (VMware User Group Meetings), but I do have some customer & partner meetings too. This always seems to be the busiest time of year for these events, I guess because it is so soon... Continue reading
Posted Nov 13, 2012 at Cormac's Blog
Comment
0
Barcelona in October
This was the European leg of the VMworld conference for work. Again, not a huge amount of free time, but my wife came with me on this trip. On our final day, we went on a bus tour of the city. Bus tours were never very appealing to me, but... Continue reading
Posted Nov 12, 2012 at Cormac's Blog
Comment
0
San Francisco in August
We had our annual conference show (VMworld) in the Moscone Centre in downtown San Francisco this month. Not really too much time for sight-seeing as these conferences are usually pretty hectic. I did get a chance to walk around on the day before. This is the St. Peter & Paul... Continue reading
Posted Nov 12, 2012 at Cormac's Blog
Comment
0
Storage vMotion Considerations when using dedicated VM Swapfile Datastore
I had a query recently asking if I could explain why the space usage on a dedicated VM swapfile datastore increased during a Storage vMotion operation. I did some testing in-house and noticed that a second .vswp file is created on the dedicated VM swap datastore during a migration. The reason why this occurs is that the VM's swapfile name is appended with a hash of the absolute path to the VM's config file, which is based on the VM's current home directory path. As a result, when you Storage vMotion the VM to a new home directory on a... Continue reading
Posted Aug 15, 2012 at VMware vSphere Blog
Comment
0
I'm guessing you mean VMFS-3 here Rob. We never had a VMFS-4 :-)
Yes, my understanding is that it is ok to run the vmkfstools reclaim command against a VMFS-3 datastore. The VMFS drivers which ship with 5.0 and later have the necessary VAAI TP extension code.
You can verify that the UNMAPS are occurring with esxtop by looking at the DELETE field in the VAAI stats view: esxtop -> u (device view) -> f (select fields) -> O (VAAI Stats)
VAAI Thin Provisioning Block Reclaim/UNMAP In Action
Posted by Cormac Hogan Technical Marketing Architect (Storage) I have done a number of blog posts in the recent past related to our newest VAAI primitive UNMAP. For those who do not know, VAAI UNMAP was introduced in vSphere 5.0 to allow the ESXi host to inform the storage array that files or ...
vSphere Storage Appliance (VSA) & Fault Tolerant VMs
I was recently involved in some discussions about how Fault Tolerance would behave on the vSphere Storage Appliance. The crux of the matter was what would happen if a host in the vSphere Storage Appliance (VSA) suffered a failure. Those of you who are familiar with the VSA will be aware that the VSA takes the local storage from an ESXi host and presents it as a mirrored NFS datastore. Therefore both compute and storage are on the same host. In the event of a host failure, another VSA node (ESXi host) in the cluster takes over the role of... Continue reading
Posted Aug 13, 2012 at VMware vSphere Blog
Comment
0
Hi Karl,
Yes - my understanding is that this article is being reworked to include some of the guidelines in this blog post. Thanks for highlighting.
Cormac
VMFS Heap Considerations
By default, an ESXi host has 80MB of VMFS heap at its disposal. This is defined in the advanced setting VMFS3.MaxHeapSizeMB. The main consumer of VMFS heap are the pointer blocks which are used to address file blocks in very large files/VMDKs on a VMFS filesystem. Therefore, the larger your VMDK...
Hi Conor,
In this case, presenting those LUNs directly to a VM would necessitate the use of RDMs, which do not require VMFS heap. Therefore you do not need to take VMFS heap into consideration in that case.
VMFS Heap Considerations
By default, an ESXi host has 80MB of VMFS heap at its disposal. This is defined in the advanced setting VMFS3.MaxHeapSizeMB. The main consumer of VMFS heap are the pointer blocks which are used to address file blocks in very large files/VMDKs on a VMFS filesystem. Therefore, the larger your VMDK...
VMFS Heap Considerations
By default, an ESXi host has 80MB of VMFS heap at its disposal. This is defined in the advanced setting VMFS3.MaxHeapSizeMB. The main consumer of VMFS heap are the pointer blocks which are used to address file blocks in very large files/VMDKs on a VMFS filesystem. Therefore, the larger your VMDKs, the more VMFS heap you can consume. This is more true on VMFS-5, where double-indirect pointers exist to allow the unified 1MB file block size back a 2TB VMDK. As a rule of thumb, we are conservatively estimating that a single ESXi host should have enough default heap space... Continue reading
Posted Aug 10, 2012 at VMware vSphere Blog
Comment
4
It could be one of the heartbeat datastores. in your vSphere HA cluster, edit the settings and see which datastores are being used for heartbeating. If this datastore is being used, change the settings to use another one.
What could be writing to a VMFS when no Virtual Machines are running?
[Updated with vSphere HA clarifications] This was an interesting question that came my way recently. One of our storage partners wanted to ensure that a VMFS volume was completely quiesced (no activity) and was interested to know what could possibly be the cause of writes to the VMFS volume when...
These test were done on 5.0 Ray.
When migrating a vRDM, if you choose to change the format, you can convert it to a VMDK.
Migrating RDMs, and a question for RDM Users.
Posted by Cormac Hogan Technical Marketing Manager (Storage) On a number of occasions recently, I had to investigate what happened to a Raw Device Mapping (RDM) when: The VM to which the RDM was attached was Storage vMotion'ed (VM Powered On) The VM to which the RDM was attached was Cold ...
@VMwareStorage at VMworld 2012
Posted by Cormac Hogan Technical Marketing Architect (Storage) A brief note to tell you about what I am involved in at this years VMworld 2012. Of course, it is all storage related. I'd be delighted if you come along to one of my 'official' sessions, but I understand that there is so much to see and do in a limited time. I'd particularly encourage you to attend one or more of the Group Discussions. My one is GD10. I'll be joined by one of our support superstars, Patrick Carmichael, and we'll be having a very informal chat around vSphere storage... Continue reading
Posted Aug 8, 2012 at VMware vSphere Blog
Comment
0
Thank you Dario. I will investigate this with the KB team.
2TB VMDKs on Upgraded VMFS-3 to VMFS-5. Really?
Yes! :-) I've had this query a number of times now, so I decided to do a quick note about it. There seems to be some uncertainty around whether or not you can create larger (2TB - 512 byte) VMDKs on VMFS-3 filesystems that have been upgraded to VMFS-5. The answer is "yes you can". I think this u...
Sparrow, unfortunately much of the output will not make much sense without a deep understanding of VMFS metadata and layout, and that is not something I can share.
The interesting part is the lock, and thank you for replying to Tia in the previous post - you are correct. If no-one has a lock on the file, then the host which runs the command will lock it which is why you see that list of zeros.
Some useful vmkfstools 'hidden' options
I was recently playing around with vmkfstools, checking out a few things for one of our storage partners. I noticed that I was using some undocumented options to look at a few things, and thought I would share them with you here. 1. Display hosts which are actively using a volume ~ # vmkfstool...
Thanks for the update Leslie.
VMware's Software FCoE (Fibre Channel over Ethernet) Adapter
Introduction In vSphere 5.0, VMware introduced a new software FCoE (Fibre Channel over Ethernet) adapter. This means that if you have a NIC which supports partial FCoE offload, this adapter will allow you to access LUNs over FCoE without needing a dedicated HBA or third party FCoE drivers insta...
Some useful vmkfstools 'hidden' options
I was recently playing around with vmkfstools, checking out a few things for one of our storage partners. I noticed that I was using some undocumented options to look at a few things, and thought I would share them with you here. 1. Display hosts which are actively using a volume ~ # vmkfstools --activehosts /vmfs/volumes/VNX-20 Found 1 actively heartbeating hosts on volume '/vmfs/volumes/VNX-20' (1): MAC address 98:4b:e1:0a:24:d8 This option will show the management interface MAC address of any hosts which is actively using a datastore. This is exactly what vSphere HA uses to see if a host is still... Continue reading
Posted Aug 3, 2012 at VMware vSphere Blog
Comment
4
Hi Greg,
Nope - no impact. This feature/primitive is all about the ESXi host telling the array that these blocks, which I was using previously but I am no longer using, can be placed back on your free list (reclaimed).
CBT is all about tracking which blocks have changed within a VMDK during a particular epoch.
A scenario where they might co-exist is a Storage vMotion in 5.0. CBT is used to recursively keep track of blocks changing in a VM during the migration. Eventually the number of blocks which have changed during one of the recursive copies should be small enough in number to allow us to switch over to the VM on the destination. UNMAP can then be used to tell the array that the block which the VM occupied on the source datastore may now be reclaimed.
Cormac
VAAI Thin Provisioning Block Reclaim/UNMAP is back in 5.0U1
When vSphere 5.0 launched last year, I did a post on the new VAAI (VMware Storage APIs for Array Integration) primitives. One of the cool new features was the the ability to reclaim stranded space on Thin Provisioned datastores, something we could not do previously, which meant large amounts of ...
Hi Martin,
Thanks for the feedback. Could I ask you to describe your use case for larger than 2TB VMDK? I'd appreciate it if you could add the comments to this post as we are actively tracking these requirements going forward.
http://blogs.vmware.com/vsphere/2012/01/how-much-storage-can-i-present-to-a-virtual-machine.html
Thank you
Cormac
vSphere 5.0 Storage Features Part 1 - VMFS-5
One of the primary objectives of Storage enhancements in 5.0 is to make the management of storage much simpler. One way to do this is to reduce the number of storage objects that a customer has to manager, i.e. enable our customers to use far fewer and much larger datastores. To that end, we are...
Derek,
No - to the best of my knowledge, there are no requirements on the VM HW version.
vSphere 5.0 Storage Features Part 1 - VMFS-5
One of the primary objectives of Storage enhancements in 5.0 is to make the management of storage much simpler. One way to do this is to reduce the number of storage objects that a customer has to manager, i.e. enable our customers to use far fewer and much larger datastores. To that end, we are...
Hi Johnny,
That is true, if we were still using the bus walking method. If you have all your disks in a contiguous range starting from 0, then once we meet the first empty position, we stop scanning.
However REPORT_LUNs avoids this as it requests a target SCSI layer to return a logical unit inventory (LUN list) to the initiator SCSI layer rather than querying each LUN individually.
My understanding is that Disk.SupportSparseLUN doesn't play a role when REPORT_LUNs is used (and that is the default since ESX 2.x I think)
Advanced VMkernel Settings for Disk Storage
As regular readers will know by now, many of these blog posts are a result of internal discussions held between myself and other VMware folks (or indeed storage partners). This one is no different. I was recently involved in a discussion about how VMs did sequential I/O, which led me to point ou...
We are looking to handle this condition on single-target, single LUN arrays going forward. I can't say anymore about this right now except to keep following the blog.
vSphere 5.0 Storage Features Part 8 - Handling the All Paths Down (APD) condition
All Paths Down (APD) is an issue which has come up time and time again, and has impacted a number of our customers. Let's start with a brief description about what All Paths Down (APD) actually is & how it occurs, & what impact it has on the host. Then we'll get into how we have improved the beh...
Advanced VMkernel Settings for Disk Storage
As regular readers will know by now, many of these blog posts are a result of internal discussions held between myself and other VMware folks (or indeed storage partners). This one is no different. I was recently involved in a discussion about how VMs did sequential I/O, which led me to point out a number of VMkernel parameters related to performance vs fairness for VM I/O. In fact, I have seen other postings about these parameters, but I realised that I never did post anything myself. A word of caution! These parameters have already been fine tuned by VMware. There... Continue reading
Posted Aug 1, 2012 at VMware vSphere Blog
Comment
3
Hi Adam,
I don't see why not. If there were some constraints, these should be called out in the HCL footnotes.
Does VMware Support Shared/Switched SAS?
An interesting observation was made on a previous blog posting of mine which compared different storage protocols. The commenter asked why I didn't include Shared SAS in the comparison (SAS is Serial-Attached SCSI). I personally have not seen a lot of shared SAS configurations, so I decided to h...
Hey Gareth,
We are working on it. Hopefully I'll have some details in and around the VMworld timeframe.
VAAI Thin Provisioning Block Reclaim/UNMAP is back in 5.0U1
When vSphere 5.0 launched last year, I did a post on the new VAAI (VMware Storage APIs for Array Integration) primitives. One of the cool new features was the the ability to reclaim stranded space on Thin Provisioned datastores, something we could not do previously, which meant large amounts of ...
Sorry for the delayed repsonse vmitguy. I only just came across your question.
The datastore browser does not use the internal VMkernel Data Mover or VAAI for that matter - it has its own API.
Therefore what you observe is correct - datastore browser copy/paste operations will not use VAAI.
Low Level VAAI Behaviour
We’re getting a lot of queries lately around how exactly VAAI behaves at the lower level. One assumes more and more VMware customers are seeing the benefit of offloading certain storage intensive tasks to the array. Recently the questions I have been getting are even more in-depth. I’ve been bac...
More...
Subscribe to Cormac Hogan’s Recent Activity