HA support of ALUA

Software-based VM-centric and flash-friendly VM storage + free version

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

danisoto
Posts: 27
Joined: Thu Jan 26, 2012 12:21 pm

Mon Jan 30, 2012 3:30 pm

Hi,

StarWind SAN supports "ALUA" semantics in HA?

We need this for Multipath iSCSI with VSphere. Without it I don't know how to enable multipath for primary and set all paths to secondary as standby.

Please, I know how to enable multipathing in VSphere; and how to set fixed path policy for preferred primary. My question is about multiple active paths to "primary", and multiple standby paths to "secondary".

Thank you!
User avatar
lohelle
Posts: 144
Joined: Sun Aug 28, 2011 2:04 pm

Mon Jan 30, 2012 5:25 pm

This is something we want also. I hope this is possible as we have a very fast primary SAN (SSD) and slower SAS SAN as backup.
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Mon Jan 30, 2012 11:56 pm

From my understanding you just need to configure MRE policy (instead of Fixed or Round Robin) and that's all. StarWind really does not care where did particular request came from so pick up faster for read node as preferred path if you use unequal shoulders for cluster (writes should be the same as they touch cache memory and not media).
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
danisoto
Posts: 27
Joined: Thu Jan 26, 2012 12:21 pm

Tue Jan 31, 2012 7:56 am

anton (staff) wrote:From my understanding you just need to configure MRE policy ... StarWind really does not care where did particular request came from so pick up faster for read node as preferred path.
Hi Anton,

This is true with ONE path for each node! And this is right with BALANCED nodes.

But our implementation is with Unbalanced nodes: one node is fast (for writes and reads) and set as PRIMARY. Without ALUA semantics it's impossible to configure VSphere to use multiple paths to primary as preferred, and one or more as a standby for secondary.

In the Windows Inititator, MCS can be configured with the policy "Round Robin with a subset of paths", the one that I like to replicate in VSphere.

Can you provide this in the future?
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Wed Feb 01, 2012 12:12 pm

Do yo have any idea I could find a requirements for what should be done @ target side to support such a scenario? From what I've seen there were either configuration manuals how to enable ALUA on some array or papers describing why other array cannot work in AULA (b/c of deadlocks). So your feedback is appreciated here, we'll be happy to help.
danisoto wrote:
anton (staff) wrote:From my understanding you just need to configure MRE policy ... StarWind really does not care where did particular request came from so pick up faster for read node as preferred path.
Hi Anton,

This is true with ONE path for each node! And this is right with BALANCED nodes.

But our implementation is with Unbalanced nodes: one node is fast (for writes and reads) and set as PRIMARY. Without ALUA semantics it's impossible to configure VSphere to use multiple paths to primary as preferred, and one or more as a standby for secondary.

In the Windows Inititator, MCS can be configured with the policy "Round Robin with a subset of paths", the one that I like to replicate in VSphere.

Can you provide this in the future?
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
danisoto
Posts: 27
Joined: Thu Jan 26, 2012 12:21 pm

Thu Feb 02, 2012 12:50 pm

anton (staff) wrote:Do yo have any idea I could find a requirements for what should be done @ target side to support such a scenario? From what I've seen there were either configuration manuals how to enable ALUA on some array or papers describing why other array cannot work in AULA (b/c of deadlocks). So your feedback is appreciated here, we'll be happy to help.
The best documentation is the LIO target from Linux.
See http://linux-iscsi.org/wiki/Asymmetric_ ... Assignment

The official documentation is the SPC-4 standard. But you may want to see the source code of the ALUA implementation in the LIO targat.

Regards.
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Fri Feb 03, 2012 4:22 pm

We're doing investigation about how soon we could have this one implemented in a proper way.
danisoto wrote:
anton (staff) wrote:Do yo have any idea I could find a requirements for what should be done @ target side to support such a scenario? From what I've seen there were either configuration manuals how to enable ALUA on some array or papers describing why other array cannot work in AULA (b/c of deadlocks). So your feedback is appreciated here, we'll be happy to help.
The best documentation is the LIO target from Linux.
See http://linux-iscsi.org/wiki/Asymmetric_ ... Assignment

The official documentation is the SPC-4 standard. But you may want to see the source code of the ALUA implementation in the LIO targat.

Regards.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
User avatar
lohelle
Posts: 144
Joined: Sun Aug 28, 2011 2:04 pm

Fri Apr 20, 2012 6:26 pm

Testing 5.9 beta. Looks good!
ALUA support seems to work! Great work!!!
Se attachments. When using RR,and partner target selected as non-optimized node when creating the HA-device, only the paths to the optimized node are used. Failover and failback works!
Attachments
non-optimized paths not used
non-optimized paths not used
alua.png (49.57 KiB) Viewed 20755 times
failover.
failover.
alua2.png (45.17 KiB) Viewed 20758 times
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Sat Apr 21, 2012 7:54 am

Good! Please give this one a heavier load to see would it melt or not :) We'll continue to stress it it the lab.

P.S. Super-fast RAM-based disk management is on the way as well :) Stay tuned!
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
User avatar
lohelle
Posts: 144
Joined: Sun Aug 28, 2011 2:04 pm

Sat Apr 21, 2012 8:22 am

I will do some 3-node RAM-disk testing (use standalone ramdrive and create image-based normal HA-devices). Will run in VM's, but on 10G network

Attached is ALUA-test on a 3-node HA-setup. Second and third node set as non-optimized.
The only "problem" I see now is how to handle a 3-way setup when the third node is even slower than the second. :) When the optimized node go down, all the other paths are used (by AULA/VMware design I guess)

ALUA-support was just as cool as I hoped it would be! :)
Attachments
3-way, using all the other paths
3-way, using all the other paths
3wayaluadown.png (52.49 KiB) Viewed 20739 times
3-way, only using the paths to the node I want.
3-way, only using the paths to the node I want.
3wayalua.png (49 KiB) Viewed 20734 times
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Sat Apr 21, 2012 7:40 pm

1) Make sure you use external app for RAM disk management. For now built-in RAM disk inside StarWind is SLOW (uses paged memory so spikes of load and delayes of I/O are possible). We're working on it now.

2) Don't test ALUA and 3-node config for now.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
User avatar
lohelle
Posts: 144
Joined: Sun Aug 28, 2011 2:04 pm

Sat Apr 21, 2012 7:58 pm

2: Alua + 3-node does work for me there. Will do some more testing.
If I need 3 nodes, where ONE is very slow, I think async replication is the way to go..

Is the ALUA-support something that is complicated "inside Starwind", or is this just a "tag/value" that you add to the target so that the initiator see the target as a ALUA-array?
User avatar
Alex (staff)
Staff
Posts: 177
Joined: Sat Jun 26, 2004 8:49 am

Mon Apr 23, 2012 4:39 pm

Is the ALUA-support something that is complicated "inside Starwind", or is this just a "tag/value" that you add to the target so that the initiator see the target as a ALUA-array?
It's additional functionality for processing ALUA-specific commands inside StarWind, not just simple tag on the target.
Best regards,
Alexey.
steveh
Posts: 3
Joined: Fri Jul 06, 2012 10:26 pm

Fri Jul 06, 2012 10:50 pm

When will ALUA feature be available for production?
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:

Sat Jul 07, 2012 6:16 am

In the next upcoming release. It's rock solid so you may apply for beta version now. We don't expect to do any mods so far.
steveh wrote:When will ALUA feature be available for production?
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Post Reply