If you have two HBA on a server, have you ensured that both of them are presented to the SAN as a target?
You may also want to look at an uplink between those switches, or it's possible for the right (or wrong) single cable to cause an outage.
As you mention it's a P4500 - I hope you've applied the recent security updates and closed the backdoor accounts 