http://www.oracle-base.com/articles/11g/OracleDB11gR1RACInstallationOnRHEL5UsingVMwareESXAndNFS.php
So the database has been created as per the end of these instructions. Nothing customized. No data populated or anything of any substance has been done yet.
But if I now follow the instructions in this link (you do need a Netapp NOW login, but basically on the filer you do a nfstat -z to clear the stats, then nfsstat -l to see the top talkers, and then nfsstat -h <IP> to see the kind of traffic per host):
https://now.netapp.com/Knowledgebase/solutionarea.asp?id=kb36582
My top two servers by a long shot are the brand new RAC Nodes. Even more than the VMware NFS IP's used to carry all the guest vm traffic. After 10 minutes the top host had 450,000 NFSOPS. The third highest was less than 50,000.
The bottom of that netapp link states "If it looks like it is the culprit that is generating too many getattr, access, or other requests at a rate of 50% or higher at the expense of reads and writes, you should work with your UNIX vendor or support team to analyze that data and determine what processes on the host are running against the filer to cause so many unoptimized requests."
My values for "getattr" and "access" are 62% and 35% of the total traffic. My reads and writes are 2% and 1% respectively. According to Netapp this is a problem and hugely unoptimized. What the heck is Oracle or CRS doing? Anybody with a similar setup see the same thing? Is this a cause for concern? Should we bring it up with Technical Support or is this expected behavior for Oracle/RAC? Let me know what you all are seeing.
Thanks!