Page 1 of 1

Intermittent Storage Performance Degradation

Posted: Tue Jul 25, 2017 2:20 pm
by D9BDCEA2CE
Occasionally, although not every day, at about 1200 I am getting a string of about a dozen messages from one of my nodes about Storage Performance Degradation. The messages stop after maybe a minute. I have two nodes and have received warnings from both about different CSVs.

I've seen these warnings before when I had issues with an HDD so I have a custom view set up in Event Viewer which shows me just stuff from the Storage Service. That has nothing which coincides with the messages from Starwind. After a restart, for example to install updates, there are a few 'unexpected sense' warnings but I understand that's normal.

I've checked the Dell OMSA and that has nothing useful to offer.

I'm happy to provide any logs or other information if anyone has any ideas about what might be causing the problems.

So far the best I have is the suggestion that it could be Starwind noticing an issue which the rest of the software hasn't detected yet but I'd like to try to track it down.

Re: Intermittent Storage Performance Degradation

Posted: Tue Jul 25, 2017 2:53 pm
by Ivan (staff)
Hello D9BDCEA2CE,
Thanks for your interest in StarWind solution.
Could you please collect the logs and share it with us (dropbox or onedrive)? For quicker and easier log collection from StarWind nodes please do not hesitate using the script from our knowledge base article below:
https://knowledgebase.starwindsoftware. ... ogs-bat-2/
Also, could you describe your system (disks(RPM), RAID, backup tasks etc.)?
Thanks,
Ivan.

Re: Intermittent Storage Performance Degradation

Posted: Wed Jul 26, 2017 11:00 am
by D9BDCEA2CE
Here are the log files:
https://1drv.ms/f/s!An_uTU8KpVOAajvxdd4xHSWRlH0

The two nodes are in a cluster together. There aren't any backup tasks. Both CSVs sit on RAID10 arrays made of 10 2TB HDDs @ 7200RPM? (ST2000DM001). Each node supports 4 VMs. There's a picture I made of how it works on that link.

At the moment I'm thinking that one of the guests could be creating heavy load with some scheduled task, I'm working through them trying to find a suspect.

Re: Intermittent Storage Performance Degradation

Posted: Mon Jul 31, 2017 2:29 pm
by Ivan (staff)
Hello D9BDCEA2CE,
Can you update us about the scheduled tasks on your guests?
We are looking forward to hearing from you

Re: Intermittent Storage Performance Degradation

Posted: Wed Aug 23, 2017 7:50 am
by D9BDCEA2CE
I've been watching this, after I checked the hosts and convinced myself there was no reason for them to be causing it I set up Performance Monitors on the guests to identify the source of the problem and... it stopped. Typical. :)

I'm convinced it was something a user was doing, we do a lot of testing and development here so sometimes they throw large numbers of small files at the servers. It hasn't happened for a while now so I'm a bit stuck. I'll let you know if I track it down.

Re: Intermittent Storage Performance Degradation

Posted: Thu Aug 24, 2017 3:18 pm
by Ivan (staff)
Hello D9BDCEA2CE,
Thank you for an update.
Of course, if you will face with this issue one more time, please let us know.