Diskgroups with Powerpath controlled disks configured as 'foreign devices' fail to import after an upgrade to 5.0MP3

  • Article ID:100004062
  • Modified Date:
  • Product(s):

Problem

Diskgroup will fail to import after an upgrade to 5.0MP3 if containing Powerpath managed devices configured as "foreign" .

Error Message

Disks are listed in error state; diskgroup fails to import and messages logged to syslog

root@hostname:/# vxdisk list

DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            error
emcpower1c   simple          -            -            error
emcpower2c   simple          -            -            error
emcpower3c   simple          -            -            error
emcpower4c   simple          -            -            error
emcpower5c   simple          -            -            error
emcpower6c   simple          -            -            error
emcpower7c   simple          -            -            error
 
 
vxdg import testdg
VxVM vxdg ERROR V-5-1-10978 Disk group testdg: import failed:
No valid disk found containing disk group
 
tail -f /var/adm/messages
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower7c: kernel error 6
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower6c: kernel error 6

Cause

An unexpected interaction caused by the Powerpath library "libvxpp.so" renders the disk to go to "error" state leading to the failure

Solution

4.1 introduced full-fledged support for  Third Party Driver (TPD).  Subsequently , there was no longer a need for TPD controlled devices to be configured as “foreign” devices and support was dropped in 5.0.x versions.

 
The workaround for the above issue is to exclude the library “libvxpp.so” . A documentation bug will be filed to explicitly  indicate the lack of support for TPD controlled devices configured as “foreign” .
 
The 5.0MP3  Installation Guide references the requirement to convert "foreign" devices to 'simple' prior to upgrading to 5.0MP3  on Page 216 of the following document :
 
However this does not explicitly state the lack of support - the documentation bug will be addressed in a future release
 
ILLUSTRATION OF THE WORKAROUND:
 
modinfo | grep vx
 59 7872e000  3e06e 286   1  vxdmp (VxVM 5.0MP3: DMP Driver)
 61 7876e000 218520 287   1  vxio (VxVM 5.0MP3 I/O driver)
 63 786c306e    d10 288   1  vxspec (VxVM 5.0MP3 control/status driv)
298 782eb08d    c6b 289   1  vxportal (VxFS 5.0_REV-5.0A55_sol portal )
299 78de0000 1b9d4f   8   1  vxfs (VxFS 5.0_REV-5.0A55_sol SunOS 5)
 
root@hostname:/# vxdg list
NAME         STATE           ID
testdg       enabled              1289330809.22.sprsv245b4-13
 
root@hostname:/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            error
emcpower1c   simple          -            -            error
emcpower2c   simple          -            -            error
emcpower3c   simple          -            -            error
emcpower4c   simple          disk1        testdg       online
emcpower5c   simple          disk2        testdg       online
emcpower6c   simple          -            -            error
emcpower7c   simple          -            -            error
 
root@hostname:/# vxdisk list emcpower4c
Device:    emcpower4c
devicetag: emcpower4c
type:      simple
hostid:    sprsv245b4-13
disk:      name=disk1 id=1289330752.18.sprsv245b4-13
group:     name=testdg id=1289330809.22.sprsv245b4-13
flags:     online ready private foreign autoimport imported
pubpaths:  block=/dev/dsk/emcpower4c char=/dev/rdsk/emcpower4c
guid:      -
udid:      DGC%5FRAID%205%5FAPM00064800091%5F60060160C6821800721EF93504EBDC11
site:      -
version:   2.1
iosize:    min=512 (bytes) max=2048 (blocks)
public:    slice=0 offset=65537 len=7102143 disk_offset=0
private:   slice=0 offset=1 len=65536 disk_offset=0
update:    time=1290023837 seqno=0.14
ssb:       actual_seqno=0.0
headers:   0 248
configs:   count=1 len=48346
logs:      count=1 len=7325
Defined regions:
 config   priv 000017-000247[000231]: copy=01 offset=000000 enabled
 config   priv 000249-048363[048115]: copy=01 offset=000231 enabled
 log      priv 048364-055688[007325]: copy=01 offset=000000 enabled
Multipathing information:
numpaths:   1
emcpower4c      state=enabled
 
 !! DEPORT DISKGROUP 
root@hostname:/# vxdg deport testdg
 
!! IMPORT DISKGROUP 
root@hostname:/# vxdg import testdg
VxVM vxdg ERROR V-5-1-10978 Disk group testdg: import failed:
No valid disk found containing disk group
 
!! messages file log the errors for the disks
root@hostname:/# tail -f /var/adm/messages
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower7c: kernel error 6
Nov 19 13:55:35 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower6c: kernel error 6
Nov 19 13:55:55 hostname vxio: [ID 689216 kern.notice] NOTICE: VxVM vxio V-5-0-74 Cannot open disk emcpower1c: kernel error 6
 
 
!! Disks are listed in "error" state
 
root@hostname:/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            error
emcpower1c   simple          -            -            error
emcpower2c   simple          -            -            error
emcpower3c   simple          -            -            error
emcpower4c   simple          -            -            error
emcpower5c   simple          -            -            error
emcpower6c   simple          -            -            error
emcpower7c   simple          -            -            error
 
 !! Exclude the Powerpath library
root@hostname:/# vxddladm excludearray libname=libvxpp.so
 
root@hostname:/# vxddladm listexclude
 
The Diskarrays excluded
-----------------------
 
Based on Library names:
-----------------------
                libvxpp.so
 
Based on VID, PID Combination:
------------------------------
 
!! Execute vxdctl enable to scan devices
 
root@hostname:/# vxdctl enable
root@hostname :/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            online invalid
emcpower1c   simple          -            -            online invalid
emcpower2c   simple          -            -            online
emcpower3c   simple          -            -            online
emcpower4c   simple          -            -            online
emcpower5c   simple          -            -            online
emcpower6c   simple          -            -            online
emcpower7c   simple          -            -            online invalid
 
!! Retry import of diskgroup
 
root@hostname:/# vxdg import testdg
 
!! Diskgroup is successfully imported
root@sprsv245b4-13:/# vxdisk list
DEVICE       TYPE            DISK         GROUP        STATUS
c0t0d0s2     auto:none       -            -            online invalid
c0t1d0s2     auto:none       -            -            online invalid
emcpower0c   simple          -            -            online invalid
emcpower1c   simple          -            -            online invalid
emcpower2c   simple          -            -            online
emcpower3c   simple          -            -            online
emcpower4c   simple          disk1        testdg       online
emcpower5c   simple          disk2        testdg       online
emcpower6c   simple          -            -            online
emcpower7c   simple          -            -            online invalid

Applies To

Powerpath + devices configured as "foreign" + SFHA 5.0MP3

An upgrade from either 4.x or 5.0 , 5.0MP1 to  5.0MP3  and above will trigger this problem

Was this content helpful?

Get Support