Enterprise Vault Storage and Task Controller services stop because Message Queue (MQ) messages cannot be sent.

Problem

Enterprise Vault Storage and Task Controller services stop because Message Queue (MQ) messages cannot be sent.

Error Message

Type: Warning
Event: 3249
Source: Enterprise Vault
Category: Agent Client Broker
Description:
Error occurred when sending a MQ message
There are insufficient resources to perform this operation. [0xc00e0027]

Event Type: Error
Event Source: Enterprise Vault
Event Category: Storage File Watch
Event ID: 6502
Description:
Failed to inform the Archiving Service of unsuccessful storage of a Saveset in a Vault Store.
Reason: There are insufficient resources to perform this operation.  [0xc00e0027] 

Cause

MSMQ storage folder size is more than what it's defined in MSMQ properties and we receive the error "There are insufficient resources to perform this operation [0xc00e0027]" because it's not able to process due to larger in size, which in turn generates the Enterprise Vault Event IDs 3249 & 6502.

Solution

There are two scenarios known to cause the above error:

Scenario 1:

Windows Server 2003 SP2 initial Microsoft Message Queuing (MSMQ) message storage size is 1 gigabyte (GB).  When the message queue storage folder is larger than 1 GB no new message queue (MQ) messages can be created.  Additionally, this can occur when MSMQ Storage Folder contains more than the Message Storage size listed in Message Queuing.  This will cause the Enterprise Vault archiving tasks (Mailbox, Journaling, and Public Folder) and Storage service to stop if it is necessary to write MQ messages to the storage folder. It is recommended that the MSMQ storage size is increased to 8 GB.

Note: Due to stability issues, Microsoft requires that the MSMQ storage size does not exceed 4GB on a 32-bit OS, however recommends MSMQ storage to not exceed 1.5GB.  This limitation is not required on a 64-bit OS however it is not commonly required to exceed a storage size of 8GB.

Resolution:

Increase the message queue storage size for MSMQ.

For single instance non-clustered MSMQ:

1. Open Computer Management and expand Services and Applications

2. Right click on Message Queuing and click Properties.
3. On the General tab increase the 'Limit message storage' setting.  
4. Restart the Message Queuing Service.
 
For clustered instance of MSMQ:

1. Open Cluster Computer Management:
   a. From a command prompt window change to the Enterprise Vault installation folder, typically C:\Program Files\Enterprise Vault.
   b. Enter the following command: Clustercompmgmt

2. Expand Services and Applications.
3. Right click on Message Queuing and click Properties.
4. On the General tab increase the 'Limit message storage' setting.  
5. Restart the Message Queuing Service resource in the appropriate cluster management software.



Scenario 2:

The above mentioned error event can also occur if the path for the MSMQ storage location is configured incorrectly. 

1. Open Computer Management and expand Services and Applications
2. Right click on Message Queuing and click Properties.
3. On the Storage tab, verify the paths are correct.  By default, the 3 paths will use: C:\WINDOWS\system32\msmq\storage 
    Note: If the path has been changed, confirm that there are no additional "\" backslash characters at the end of the path.  If so, an Event ID 2085 can be recorded:

 Example of Event details: "The message file 'd:\msmq\storage\\10000005.mq' cannot be created."  
 This error shows that there are additional backslashes which should be removed.

4. If a change is required, restart the Message Queuing service

Alternative method : 

It is possible to edit the values directly in the registry rather than relying on the graphical method
1.      Click Start , click Run , type regedit , and then click OK .
2.      Locate and then click the following key in the registry depending on whether it is a clustered environment:

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\MSMQ\Parameters\MachineCache\MachineQuota
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\MSMQ\Clustered QMs\MSMQ$NAME\Parameters\MachineCache\MachineQuota

3.      On the Edit menu, click Modify .
4.      Type amount of space , and then press ENTER. You must specify the amount of space in kilobytes.  Example: 8GB = 800,000 (hex)
5.   The key MachineJournalQuota can also be added if it is required to be able to change the space reserved for MSMQ journalling
6.      If a change is required, restart the Message Queuing service