Problem
Starting with Clearwell V 5.5 SP1 we implemented a mechanism which dynamically compresses case backup data. If the job fails due to a out-of-space condition, the error thrown might be cryptic and/or seem unrelated to a disk space problem. Here is an example of the job status log:
Error Message
12/02/2019 00:13:24 Starting case backup: 0.2.1.0/0.6.49.3497/09361-00031_WAM-GM/Daily Backup
TRACE: 12/02/2019 04:06:26 Case backup failure: 0.2.1.0/0.6.49.3497/09361-00031_WAM-GM/Daily Backup
TRACE: 12/02/2019 04:06:26 Case backup failure: 0.2.1.0/0.6.49.3497/09361-00031_WAM-GM/Daily Backup
TRACE:com.teneo.esa.esacase.CaseManagerException: [#80110] An unexpected error occurred: [#156035] Unable to create backup because of unexpected error
TRACE:com.teneo.esa.esacase.CaseManagerImpl.backupLocalCase(CaseManagerImpl.java:1957)
TRACE:com.teneo.esa.esacase.CaseManagerImpl.backupCase(CaseManagerImpl.java:1762)
TRACE:com.teneo.esa.esacase.CaseManagerImpl.backupCase(CaseManagerImpl.java:1752)
TRACE:com.teneo.esa.esacase.CaseBackupJobDescriptor$1$1.run(CaseBackupJobDescriptor.java:151)
TRACE:com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
TRACE:com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
TRACE:com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
TRACE:com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
TRACE:com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
TRACE:com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:45)
TRACE:com.teneo.esa.common.util.CWThread.run(CWThread.java:70)
TRACE:Caused by: com.teneo.esa.cluster.ClusterException: [#156035] Unable to create backup because of unexpected error
TRACE:com.teneo.esa.cluster.ClusterException.backupError(ClusterException.java:316)
TRACE:com.teneo.esa.cluster.ClusterUpdateService.backupLocator(ClusterUpdateService.java:1093)
TRACE:com.teneo.esa.cluster.ClusterUpdateService.backupLocators(ClusterUpdateService.java:904)
TRACE:com.teneo.esa.cluster.ClusterUpdateService.access$900(ClusterUpdateService.java:94)
TRACE:com.teneo.esa.cluster.ClusterUpdateService$8.call(ClusterUpdateService.java:885)
TRACE:com.teneo.esa.admin.service.AbstractService.ensureReady(AbstractService.java:1428)
TRACE:com.teneo.esa.cluster.ClusterServiceBase.leasedEnsureReady(ClusterServiceBase.java:142)
TRACE:com.teneo.esa.cluster.ClusterUpdateService.backupDataStores(ClusterUpdateService.java:830)
TRACE:com.teneo.esa.cluster.ClusterManager.backupDataStores(ClusterManager.java:267)
TRACE:com.teneo.esa.esacase.CaseManagerImpl.backupLocalCase(CaseManagerImpl.java:1917)
TRACE:com.teneo.esa.esacase.CaseManagerImpl.backupCase(CaseManagerImpl.java:1762)
TRACE:com.teneo.esa.esacase.CaseManagerImpl.backupCase(CaseManagerImpl.java:1752)
TRACE:com.teneo.esa.esacase.CaseBackupJobDescriptor$1$1.run(CaseBackupJobDescriptor.java:151)
TRACE:com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
TRACE:com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
TRACE:com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
TRACE:com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
TRACE:com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
TRACE:com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:45)
TRACE:com.teneo.esa.common.util.CWThread.run(CWThread.java:70)
TRACE:Caused by: java.io.IOException: The operation completed successfully
TRACE:java.io.FileOutputStream.writeBytes(FileOutputStream.java)
TRACE:java.io.FileOutputStream.write(FileOutputStream.java:260)
TRACE:java.io.DataOutputStream.write(DataOutputStream.java:91)
TRACE:java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:118)
TRACE:java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
TRACE:com.teneo.esa.common.backup.FileComponent.serialize(FileComponent.java:160)
TRACE:com.teneo.esa.common.backup.BackupSerializer.exec(BackupSerializer.java:118)
TRACE:com.teneo.esa.common.backup.BackupSerializer.run(BackupSerializer.java:72)
ENDTRACE
The server.log shows the following:
2019-12-02 04:06:17,171 WARN [common.backup.BackupSerializer] (SerialBackup BackupSet_0002NNNN.bak:) [#156035] Unable to create backup because of unexpected error
java.io.IOException: The operation completed successfully
at java.io.FileOutputStream.writeBytes(FileOutputStream.java)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at java.io.DataOutputStream.write(DataOutputStream.java:91)
at java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:118)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at com.teneo.esa.common.backup.FileComponent.serialize(FileComponent.java:160)
at com.teneo.esa.common.backup.BackupSerializer.exec(BackupSerializer.java:118)
at com.teneo.esa.common.backup.BackupSerializer.run(BackupSerializer.java:72)
2019-12-02 04:06:17,171 WARN [common.backup.BackupSerializer] (SerialBackup BackupSet_0005NNNN.bak:) [#156035] Unable to create backup because of unexpected error
java.io.IOException: The operation completed successfully
at java.io.FileOutputStream.writeBytes(FileOutputStream.java)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at java.io.DataOutputStream.write(DataOutputStream.java:91)
at java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:161)
at java.util.zip.DeflaterOutputStream.finish(DeflaterOutputStream.java:134)
at java.util.zip.DeflaterOutputStream.close(DeflaterOutputStream.java:147)
at java.io.FilterOutputStream.close(FilterOutputStream.java:144)
at java.io.FilterOutputStream.close(FilterOutputStream.java:144)
at com.teneo.esa.common.backup.BackupSerializer.exec(BackupSerializer.java:136)
at com.teneo.esa.common.backup.BackupSerializer.run(BackupSerializer.java:72)
2019-12-02 04:06:17,171 WARN [common.backup.BackupSerializer] (SerialBackup BackupSet_0006NNNN.bak:) [#156035] Unable to create backup because of unexpected error
java.io.IOException: The operation completed successfully
at java.io.FileOutputStream.writeBytes(FileOutputStream.java)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at java.io.DataOutputStream.write(DataOutputStream.java:91)
at java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:118)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at com.teneo.esa.common.backup.FileComponent.serialize(FileComponent.java:160)
at com.teneo.esa.common.backup.BackupSerializer.exec(BackupSerializer.java:118)
at com.teneo.esa.common.backup.BackupSerializer.run(BackupSerializer.java:72)
2019-12-02 04:06:26,391 WARN [esa.jobmanager.JobManager] (exception-thpool.jobmanager.4.211619.1.5.2.3028:) job 1.5.2.3028 failed with exception
com.teneo.esa.esacase.CaseManagerException: [#80110] An unexpected error occurred: [#156035] Unable to create backup because of unexpected error
at com.teneo.esa.esacase.CaseManagerImpl.backupLocalCase(CaseManagerImpl.java:1957)
at com.teneo.esa.esacase.CaseManagerImpl.backupCase(CaseManagerImpl.java:1762)
at com.teneo.esa.esacase.CaseManagerImpl.backupCase(CaseManagerImpl.java:1752)
at com.teneo.esa.esacase.CaseBackupJobDescriptor$1$1.run(CaseBackupJobDescriptor.java:151)
at com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
at com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
at com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
at com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
at com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
at com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:45)
at com.teneo.esa.common.util.CWThread.run(CWThread.java:70)
Caused by: com.teneo.esa.cluster.ClusterException: [#156035] Unable to create backup because of unexpected error
at com.teneo.esa.cluster.ClusterException.backupError(ClusterException.java:316)
at com.teneo.esa.cluster.ClusterUpdateService.backupLocator(ClusterUpdateService.java:1093)
at com.teneo.esa.cluster.ClusterUpdateService.backupLocators(ClusterUpdateService.java:904)
at com.teneo.esa.cluster.ClusterUpdateService.access$900(ClusterUpdateService.java:94)
at com.teneo.esa.cluster.ClusterUpdateService$8.call(ClusterUpdateService.java:885)
at com.teneo.esa.admin.service.AbstractService.ensureReady(AbstractService.java:1428)
at com.teneo.esa.cluster.ClusterServiceBase.leasedEnsureReady(ClusterServiceBase.java:142)
at com.teneo.esa.cluster.ClusterUpdateService.backupDataStores(ClusterUpdateService.java:830)
at com.teneo.esa.cluster.ClusterManager.backupDataStores(ClusterManager.java:267)
at com.teneo.esa.esacase.CaseManagerImpl.backupLocalCase(CaseManagerImpl.java:1917)
... 10 more
Caused by: java.io.IOException: The operation completed successfully
at java.io.FileOutputStream.writeBytes(FileOutputStream.java)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at java.io.DataOutputStream.write(DataOutputStream.java:91)
at java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:118)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at com.teneo.esa.common.backup.FileComponent.serialize(FileComponent.java:160)
at com.teneo.esa.common.backup.BackupSerializer.exec(BackupSerializer.java:118)
at com.teneo.esa.common.backup.BackupSerializer.run(BackupSerializer.java:72)
2019-12-02 04:06:47,342 WARN [esa.jobmanager.JobManager] (exception-thpool.jobmanager.1.211487.1.5.2.3022:) job 1.5.2.3022 failed with exception
com.teneo.esa.esacase.CaseManagerException: [#201023] One or more backup jobs failed
at com.teneo.esa.esacase.MultiCaseBackupJobDescriptor$1$1.run(MultiCaseBackupJobDescriptor.java:182)
at com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:152)
at com.teneo.esa.jobmanager.JobRunner.executeJob(JobRunner.java:137)
at com.teneo.esa.jobmanager.JobRunner.access$000(JobRunner.java:59)
at com.teneo.esa.jobmanager.JobRunner$1.call(JobRunner.java:184)
at com.teneo.esa.common.ThreadPool.Task.cwRun(Task.java:288)
at com.teneo.esa.common.util.CWRunnableImpl.run(CWRunnableImpl.java:45)
at com.teneo.esa.common.util.CWThread.run(CWThread.java:70)
Solution
|
The message "The operation completed successfully" is unhelpful but indicative of a Windows JVM defect that's a symptom of a file system failure. There may be other log entries on the appliance, Windows System Event Logs, or the storage device describing what the actual problem was.
Check the case backups are writing to (by viewing the esa.case.backupDir System Property using Property Browser - Support Feature**) and making sure that there is ample space.
** Property Browser technique detailed in related article below.
|
Related Knowledge Base Articles
Was this content helpful?
Translated Content
Please note that this document is a translation from English, and may have been machine-translated. It is possible that updates have been made to the original version after this document was translated and published. Veritas does not guarantee the accuracy regarding the completeness of the translation. You may also refer to the English Version of this knowledge base article for up-to-date information.