* RESERVE_OUT: PREEMPT_ABORT is not implemented

Software-based VM-centric and flash-friendly VM storage + free version

Moderators: anton (staff), art (staff), Max (staff), Anatoly (staff)

Post Reply
ArnoldJudasRimmer
Posts: 2
Joined: Mon Jul 21, 2008 2:16 am

Mon Jul 21, 2008 2:27 am

Hi,

I'm running Solaris 10 x86 virtual machine in ESX 3.5. Starwind is running in a Windows 2003 server virtual machine in ESX 3.5. The Solaris 10 x86 virtual machine has Storage Foundation HA 5.0 installed. I'm trying to setup I/O Fencing within the Veritas Cluster Server... Annoyingly the very lst test fails with "Preempt and abort key KeyA using key keyB on node unixs101 failed!"

When I look at the Starwind target logs the following error is logged:
7/20 23:02:34.953 f14 PR: * RESERVE_OUT: PREEMPT_ABORT is not implemented!

7/20 23:02:35.203 a18 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_KEYS.

7/20 23:02:35.281 a18 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_RESERVATIONS.

7/20 23:02:37.218 f14 PR: S[d] LUN 0 is PR reserved with key 4B6579412D2D2D2D

7/20 23:02:37.218 f14 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_KEYS.

7/20 23:02:37.828 f14 PR: S[d] LUN 0 is PR reserved with key 4B6579412D2D2D2D

7/20 23:02:37.828 f14 PR: iqn.2003-06.com.rocketdivision.starwind.microsof-y2ukvd.home.com.diskbridge0 RESERVE_IN: READ_RESERVATIONS.

7/20 23:02:40.140 a18 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)

7/20 23:02:40.140 a18 PR: Unregistering key 4B6579412D2D2D2D owned by iqn.1986-03.com.sun:01:4aeaabf5ffff.487002a4,4000002A0000


Question.....
Is there any chance I can get this working? It doesn't look like this version supports preemptive aborts... this means I can't do I/O fencing with VCS in my cluster... which bites! :(

Thanks in advance for any feedback!
AJR
Top
Val (staff)
Posts: 496
Joined: Tue Jun 29, 2004 8:38 pm

Tue Jul 22, 2008 6:02 am

Hi,

StarWind 3.5.x does not support the feature.

Currently the persistent reservation subset that is implemented in StarWind supports the MS Windows Server 2008 clustering according to the MS specification.

Are there any white-papers on the persistent reservation's features that are needed for your software to run?
Best regards,
Valeriy
Top
ArnoldJudasRimmer
Posts: 2
Joined: Mon Jul 21, 2008 2:16 am

Wed Jul 23, 2008 1:23 pm

Hi Valery,

That's too bad. I was hoping on getting it setup. I think the details you are looking for are not documented in the manuals. Symantec discusses I/O fencing feature .


I'm not sure if Starwind already has a relationship with Symantec, they could probably share the test routines with you.

This is a detailed log of the I/O fencing tests. I think it failed on "SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY" (see down below).

If this could be included in a future release it would surpass OpenFiler and FreeNAS iSCSI capabilities. Right now I'm using OpenFiler, but I would have purchased a copy of Starwind iSCSI if it had this function.


# cat vxfen.log.7239

Starting vxfensthdw...

manual_vxfentsthdw() called for unixs100 and unixs101

manual_vxfentsthdw() serial1 = 4CC75A83F38DDCBA , serial2 = 4CC75A83F38DDCBA

run_tests() called for unixs100 and unixs101

register() passed for /dev/rdsk/c3t12d0s2

chk_registrations() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

reserve() passed for /dev/rdsk/c3t12d0s2

chk_reservations() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

read_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

nowrite_disk() passed for /dev/rdsk/c3t12d0s2

registerignore() passed for /dev/rdsk/c3t12d0s2

chk_registrations() passed for /dev/rdsk/c3t12d0s2

chk_registrations() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

write_disk() passed for /dev/rdsk/c3t12d0s2

preempt_abort() failed for unixs101

SCSI Registration Keys for unixs100 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
SCSI Reservation Keys for unixs100 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t12d0s2
SCSI Registration Keys for unixs101 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
SCSI Reservation Keys for unixs101 are..:-

Device Name: /dev/rdsk/c3t12d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t12d0s2


Thanks again!
AJR
Top
Val (staff)
Posts: 496
Joined: Tue Jun 29, 2004 8:38 pm

Wed Jul 23, 2008 1:57 pm

Hi,

StarWind does support the SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY feature.

Could you send the log files from your StarWind/logs directory to my email?

The log files should shed some light on the problem...
Best regards,
Valeriy
Top
capelink
Posts: 1
Joined: Wed Oct 29, 2008 6:03 pm

Wed Oct 29, 2008 6:16 pm

Hi,

I'm trying to get Veritas I/O fencing working with Solaris 10 on sparc too. When running the Veritas vxfentsthdw test routine I get a similar failure :-

Testing sparc1 /dev/rdsk/c3t5d0s2 sparc2 /dev/rdsk/c3t5d0s2

Evaluate the disk before testing ........................ No Pre-existing keys
Register keys on disk /dev/rdsk/c3t5d0s2 from node sparc1 .............. Passed
Verify registrations for disk /dev/rdsk/c3t5d0s2 on node sparc1 ........ Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc1 ....................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc1 ...................... Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc2 ....................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc2 ...................... Passed
Reserve disk /dev/rdsk/c3t5d0s2 from node sparc1 ....................... Passed
Verify reservation for disk /dev/rdsk/c3t5d0s2 on node sparc1 .......... Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc1 ....................... Passed
Read from disk /dev/rdsk/c3t5d0s2 on node sparc2 ....................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc1 ...................... Passed
Expect no writes for disk /dev/rdsk/c3t5d0s2 on node sparc2 ............ Passed
RegisterIgnoreKeys on disk /dev/rdsk/c3t5d0s2 from node sparc2 ......... Passed
Verify registrations for disk /dev/rdsk/c3t5d0s2 on node sparc1 ........ Passed
Verify registrations for disk /dev/rdsk/c3t5d0s2 on node sparc2 ........ Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc1 ...................... Passed
Write to disk /dev/rdsk/c3t5d0s2 from node sparc2 ...................... Passed
Preempt and abort key KeyA using key KeyB on node sparc2 ............... Failed

The detailed logfile contains :-

Wed Oct 29 17:56:19 GMT 2008 Starting vxfensthdw...

Wed Oct 29 17:56:23 GMT 2008 manual_vxfentsthdw() called for sparc1 and sparc2

Wed Oct 29 17:56:30 GMT 2008 manual_vxfentsthdw() serial1 = F8405644DF168E40 , serial2 = F8405644DF168E40

Wed Oct 29 17:56:30 GMT 2008 run_tests() called for sparc1 and sparc2

Wed Oct 29 17:56:31 GMT 2008 register() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:31 GMT 2008 chk_registrations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:32 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:33 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:34 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:35 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:36 GMT 2008 reserve() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:36 GMT 2008 chk_reservations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:37 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:38 GMT 2008 read_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 nowrite_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 registerignore() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:40 GMT 2008 chk_registrations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:41 GMT 2008 chk_registrations() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:42 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:43 GMT 2008 write_disk() passed for /dev/rdsk/c3t5d0s2

Wed Oct 29 17:56:43 GMT 2008 preempt_abort() failed for sparc2

Wed Oct 29 17:56:43 GMT 2008 SCSI Registration Keys for sparc1 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
Wed Oct 29 17:56:44 GMT 2008 SCSI Reservation Keys for sparc1 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t5d0s2
Wed Oct 29 17:56:44 GMT 2008 SCSI Registration Keys for sparc2 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 2
key[0]:
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
key[1]:
Key Value [Numeric Format]: 75,101,121,66,45,45,45,45
Key Value [Character Format]: KeyB----
Wed Oct 29 17:56:44 GMT 2008 SCSI Reservation Keys for sparc2 are..:-

Device Name: /dev/rdsk/c3t5d0s2
Total Number Of Keys: 1
Key[0]:
Reservation Type: SCSI3_RESV_WRITEEXCLUSIVEREGISTRANTSONLY
Key Value [Numeric Format]: 75,101,121,65,45,45,45,45
Key Value [Character Format]: KeyA----
/dev/rdsk/c3t5d0s2

Looks very familiar to the original post. Anything that has been or can be done with this ?

Starwind Version 3.5.5 20080930

Thanks
Top
Val (staff)
Posts: 496
Joined: Tue Jun 29, 2004 8:38 pm

Wed Oct 29, 2008 6:32 pm

The corresponding StarWind's log files could help to understand what's wrong.

Also a Wireshark's dump of network packets on TCP/IP port 3260 for the same test could give some information...
Best regards,
Valeriy
Top
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:
Contact anton (staff)

Sun Jan 10, 2010 10:10 pm

We've finally managed to have this feature implemented and upcoming V5.5. is going to have Veritas cluster & file system supported.
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Top
donypie
Posts: 10
Joined: Wed Feb 24, 2010 1:49 pm

Wed Feb 24, 2010 1:53 pm

Very good news, I'm also testing StarWind with Veritas and I have also the problem :

Preempt and abort key KeyA using key KeyB on node linsys34 ............. Failed

Can you please tell me when version 5.5 will be available ?

Thanks a lot.
Kind regards.
Pierre.
Top
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:
Contact anton (staff)

Wed Feb 24, 2010 2:31 pm

We don't have release date yet. Had to put this on hold as we're facing other issues here. Sorry...
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Top
donypie
Posts: 10
Joined: Wed Feb 24, 2010 1:49 pm

Mon May 24, 2010 8:26 pm

Hello,

Can you please tell me if this problem is now solved ?

Thanks.
Kind regards
Pierre.
Top
Val (staff)
Posts: 496
Joined: Tue Jun 29, 2004 8:38 pm

Tue May 25, 2010 10:29 am

donypie wrote:Can you please tell me if this problem is now solved ?
Not yet.

We are working on the feature to be included in a future release of StarWind.
Best regards,
Valeriy
Top
donypie
Posts: 10
Joined: Wed Feb 24, 2010 1:49 pm

Tue May 25, 2010 9:02 pm

Ok thanks. Indeed, it is not yet solved, in starwind log, I have still error messages.
When do you plan to implement a solution ?

Thanks a lot.
Kind regards,
Pierre.

*** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:39:52.512 1f0 IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:39:52.932 1ec IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:42:27.785 1e8 IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:42:27.795 1f0 IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:42:27.805 1ec IMG: *** ImageFile_ScsiExec: SCSIOP (0x4D) is not supported.
5/25 22:53:59.840 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:11.307 fb0 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:15.623 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:15.623 f24 PR: Unregistering key 4B6579412D2D2D2D (1) owned by iqn.1994-05.com.redhat:82a161c7eac,00023D030000
5/25 22:54:16.835 fb0 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:16.835 fb0 PR: Unregistering key 4B6579422D2D2D2D (1) owned by iqn.1994-05.com.redhat:bed9b8f28b60,00023D030000
5/25 22:54:20.850 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:45.426 fb0 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:54:54.659 fb0 PR: * RESERVE_OUT: PREEMPT_ABORT is not implemented!
5/25 22:54:54.659 fb0 PR: * RESERVE_OUT: PREEMPT_ABORT is not implemented!
5/25 22:55:18.023 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
5/25 22:55:18.023 f24 PR: * RESERVE_OUT: REGISTER change ReservationKey 4B6579412D2D2D2D -> 4572617365722D2D.
5/25 22:55:18.033 f24 PR: RESERVE_OUT: REGISTER_IGNORE_EXISTING (p = 0)
Top
User avatar
anton (staff)
Site Admin
Posts: 4021
Joined: Fri Jun 18, 2004 12:03 am
Location: British Virgin Islands
Contact:
Contact anton (staff)

Tue May 25, 2010 9:54 pm

Apply for Beta program and get RC with this issue fixed immediately. Or wait for the official release (31st of May estimated).
Regards,
Anton Kolomyeytsev

Chief Technology Officer & Chief Architect, StarWind Software

Image
Top
donypie
Posts: 10
Joined: Wed Feb 24, 2010 1:49 pm

Wed May 26, 2010 7:11 am

Anton,

Thanks for your answer. I will request Beta version.

Kind regards,
Pierre.
Top
donypie
Posts: 10
Joined: Wed Feb 24, 2010 1:49 pm

Wed May 26, 2010 8:06 am

Anton,

Can you please tell me how which Beta version I have to install. When I download the file starwind_beta.exe, I bget the version v5.3.0 20100323, SwSAN Win32.

Is it the version with the preempt_abord problem solved ?

Thanks.
Best regards,
Pierre.
Top
Post Reply

Return to “StarWind Virtual SAN (VSAN) [+Free], HCI Appliance (HCA), Virtual HCI Appliance (VHCA) [+Free], StarWind x Proxmox VE SAN Integration Services”