Event 2270 - Journal Archiving stops processing when encountering a corrupt Exchange message

Problem

Enterprise Vault (EV) Journal Archiving stops processing when a corrupt exchange item is encountered. An Event ID 2270 is then placed into the Enterprise Vault Event Log indicating a maximum retry count has been exceeded.

Error Message

Event ID: 2270
Task Category: JournalTask
Message:
A queued operation exceeded the retry count and has been discarded.
Exchange Journaling Task for <EV_Server_Name>
Retrieved a [MsgID_ArchiveMailboxEx3 (91)] MSMQ message on queue [<EV_Server_Name> \Private$\Enterprise Vault Exchange Journaling Task for <Exchange_Server_Name> <TaskID> J3], but it's retry count [4] exceeds the maximum retry limit [3]

V-437-2270

Cause

During normal Journal Archiving (JA) operations, the JA task may encounter a message that is corrupt in Exchange. Depending on the level of corruption of the item, the JA task will follow one of two types of error handling.

1. Attempt to move the item to one of the journal mailbox's "Failed to" folders
2. Mark the item with a "Do Not Archive" attribute and move to the next item

In rare circumstances, an Exchange item will become so corrupt/inaccessible that the JA task will receive a MAPI_E_EXTENDED_ERROR (0x80040119). Each time it attempts to process the corrupt message, the JA task stops and restarts the process again; when Journal Grouping is enabled, this can lead to a large backlog of mail in the journal mailbox.

To identify the issue:
1. Run a dtrace of the JournalTask process on the server hosting the JA tasks.
2. Allow the JA task to run until the Event 2270 is logged in the EV event log
3. Stop the dtrace

The following dtrace lines will indicate the issue:

(JournalTask) <14628> EV:L {CJournalPart::MakeJournalPartMsg:#1200} Opening The Message
(JournalTask) <14628> EV:H {CJournalPart::MakeJournalPartMsg} HRXEX fn trace : Error [0x80040119], [.\JournalPart.cpp, lines {1086,1203}, built Dec 11 16:18:53 2012].
(JournalTask) <14628> EV:M {CArchivingAgent::isEligibleForArchive:#4793} An error occured hence this message will be ignored.UserMailbox=[<Journal_Mailbox_LegacyDN>] MsgTitle= [<Email_Subject_Line>] Hr=[0x80040119]
(JournalTask) <14628> EV:M :CArchivingAgent::IsEligibleForArchive() |Exiting routine |
(JournalTask) <14628> EV:H {CArchivingAgent::ProcessInvalidJournalMessage} HRXEX fn trace : Error [0x80040119], [.\ArchivingAgent.cpp, lines {25788,25799,25800,25814}, built Dec 11 16:18:53 2012].
(JournalTask) <14628> EV:M CArchivingAgent::ProcessInvalidJournalMessage - Com Result [0x80040119]
(JournalTask) <14628> EV:M {CArchivingAgent::processMessages:#5141} Could not scan [user mailbox] [<Journal_Mailbox_LegacyDN>]. This problem is commonly fixed on the next scan. Cannot list messages: [0x80040119] [(null)]

This will repeat on the same thread until the following is seen:
(JournalTask) <14628> EV~W Event ID: 2270 A queued operation exceeded the retry count and has been discarded|Exchange Journaling Task for <Exchange_Server_Name>|Retrieved a [MsgID_ArchiveMailboxEx3 (91)] MSMQ message on queue [<EV_Server_Name> \Private$\Enterprise Vault Exchange Journaling Task for <Exchange_Server_Name> <TaskID> J3], but it's retry count [4] exceeds the maximum retry limit [3]. | 

Solution

As the above-mentioned issue is due to an inaccessible/corrupt Exchange item, this KB article explains how to remove the item from the Exchange Journal Mailbox. If the item cannot be moved/deleted according to the aforementioned article, it may be necessary to contact the Exchange administrator or Microsoft Support for assistance in managing corrupt mail messages.

This issue has been addressed in the following releases:

Enterprise Vault 11.0.0 Cumulative Hotfix 3 Release
http://www.veritas.com/docs/000024104

Enterprise Vault 11.0.1 Cumulative Hotfix 1 Release
http://www.veritas.com/docs/000024613

Enterprise Vault 12
http://www.veritas.com/docs/000099905
 
Note: For information on how to obtain Enterprise Vault 12 see: How to obtain the license key and installation download for Veritas products