MPIO no performance boost?

Software-based VM-centric and flash-friendly VM storage + free version

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

Post Reply
Zeon
Posts: 3
Joined: Sat Apr 21, 2012 6:56 am

Tue Jul 10, 2012 11:41 pm

Hey guys,
I've just started investigating MPIO with Starwind and haven't really seent he performance improvements I was hoping. It seems even with MPIO I can't get past 1gbps, even with multiple VMs!.

Config:
Starwind
win 2008 r2, 6x 3TB drives RAID 6 with SSD cache and 1GB write back on LSI card. 2x intel NIC for iSCSI, 9k jumbo frames. Raw performance:
Image

Switch
Cisco SGE 2000 with jumbo frames enabled
Image

Host
VMWare esxi 5 u1 on new Supermicro Xeon e5 system with dual intel NIC for iSCSI. Connects to single target on Starwind:
Image
Image
Image
Image



So here is my VM performance. Also in the 2nd picture see that the Starwind server is only using 50% of the bandwidth on each connection?
Image
Image


Any ideas?
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Wed Jul 11, 2012 8:58 am

1) Start with dumping your benchmark tool. Use Intel I/O Meter.

2) Please list StarWind config. How many nodes, device type, amount of write back cache allocated etc.

3) Please run I/O Meter against local storage and then again from a few VMs you're using to get combined numbers.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
logicmate
Posts: 29
Joined: Tue Sep 13, 2011 10:36 pm

Wed Jul 11, 2012 4:46 pm

Have you set your IOPS=1?

Ara
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Fri Jul 13, 2012 8:57 am

I'm assuming that you mean Number of Outstanding IOps, correct? The value should be 32 or 64.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
logicmate
Posts: 29
Joined: Tue Sep 13, 2011 10:36 pm

Fri Jul 13, 2012 6:08 pm

No I'm referring to the Round Robin policy in iSCSI initiator and settings IOPS=1, default is IOPS=1000.

http://www.starwindsoftware.com/forums/ ... ops#p12194
Anatoly (staff) wrote:I'm assuming that you mean Number of Outstanding IOps, correct? The value should be 32 or 64.
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Mon Jul 16, 2012 8:39 am

Oh! Good question, logicmate!

Zeon, would you be so kind to answer the question, and probably provide us the screenshot that would showed the value of the corresponding setting?

Thank you
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
Zeon
Posts: 3
Joined: Sat Apr 21, 2012 6:56 am

Tue Jul 24, 2012 3:36 am

Hey guys,
Thanks very much fort he advice so far. I have run some tests using IOmeter with the following settings:

size: 4096
% of size: 100%
% read: 67
% random: 100
delay: 0
burst: 1

This ran 4x tests. I have given the raw performance of the SAN, performance of 1 VM running the test before the IOPS=1, 2x VMs running IOmeter concurrently before the IOPS =1 and a test after changing the IOPS=1 for a single VM.

For random tests the performance drop because of iSCSI doesn't seem to be too huge. I'm wondering if I should use a different ICF for iometer to perhaps measure sequential read/write?

IOPS
Image

Read Performance (MBps)
Image
Image

here are the starwind settings:

Image

Write Performance(MBps)
Image
User avatar
Anatoly (staff)
Staff
Posts: 1675
Joined: Tue Mar 01, 2011 8:28 am
Contact:

Thu Jul 26, 2012 3:53 pm

Well, you still haven't mentioned the Number of Outstanding IOPS that you have used. As you can see in my post above I've recommended to use 32 or 64 value.
Best regards,
Anatoly Vilchinsky
Global Engineering and Support Manager
www.starwind.com
av@starwind.com
Post Reply