Search the VMware Knowledge Base (KB)
View by Article ID

Configuring adapter instances or accessing the Certificates page in VMware vRealize Operations Manager 6.x fails with the error: FileNotFoundException: /data/vcops/blob/Certificate/ (2135750)

  • 0 Ratings

Symptoms

  • Adapter instances are in a failed state
  • Restarting adapter instances result in a failed state
  • An error is thrown when you navigate to Administration > Certificates
  • An adapter instance fails with an error similar to:

    FileNotFoundException: /data/vcops/blob/Certificate/

  • The analytics logs shows errors similar to:

    …java.io.FileNotFoundException: /data/vcops/blob/Certificate/cc1973bc-721d-4eef-bf67-eb23a03650f5 (No such file or directory)..

    For more information, see Collecting diagnostic information from VMware vRealize Operations Manager (vApp) 6.0.x (2074601).

Resolution

  1. Log in to the Admin UI and click Take Offline to bring the cluster offline.
  2. Log in to the Master node at the console or using SSH as the root user.
  3. Run this command to identify all suspect BLOBs:

    grep "java.io.FileNotFoundException: /data/vcops/blob/Certificate" analytics-*.log* |grep -v "Caused by"|awk '{print $7}'|sort -n |uniq

       
    You see output similar to:

    /data/vcops/blob/Certificate/00548133-30a2-4ec4-9235-81cc56e42f2b
    /data/vcops/blob/Certificate/0cf46985-344b-47cc-96f1-3a5ec8958046
    /data/vcops/blob/Certificate/0f285ec0-a143-44aa-960b-c80b41c18079


  4. Use the output from Step 3 to create commands to remove the suspect on-disk blob data similar to:

    rm /data/vcops/blob/Certificate/00548133-30a2-4ec4-9235-81cc56e42f2b
    rm /data/vcops/blob/Certificate/0cf46985-344b-47cc-96f1-3a5ec8958046
    rm /data/vcops/blob/Certificate/0f285ec0-a143-44aa-960b-c80b41c18079


    Note: Some or all of the files being removed might not exist and an error is generated when issuing the rm command. These errors can be ignored.

  5. Run this command to launch the xDB console:

    XDB_PASSWORD=`grep "^db.password" /usr/lib/vmware-vcops/user/conf/persistence/persistence.properties | cut -f2 -d'='`;SSL_KEYSTORE_PASSWORD=`grep sslkeystorePassword /storage/vcops/user/conf/ssl/storePass.properties | cut -f2 -d'='`;export XHIVE_OPTS="-Djavax.net.ssl.keyStore=/storage/vcops/user/conf/ssl/tcserver.keystore -Djavax.net.ssl.keyStorePassword=$SSL_KEYSTORE_PASSWORD  -Djavax.net.ssl.trustStore=/storage/vcops/user/conf/ssl/tcserver.truststore";$ALIVE_BASE/xdb/bin/xdb -f /data/vcops/xdb/vcops.bootstrap -u Administrator -p $XDB_PASSWORD -d alivevm

    Note: The prompt changes to xdb>.

  6. Use the output from Step 3 to create commands to remove the suspect blob data within xDB similar to:

    rm globalpersistence/Certificate/00548133-30a2-4ec4-9235-81cc56e42f2b
    rm globalpersistence/Certificate/0cf46985-344b-47cc-96f1-3a5ec8958046
    rm globalpersistence/Certificate/0f285ec0-a143-44aa-960b-c80b41c18079


    Note: Some of the blobs being removed might not exist and an error is generated when issuing the rm command. These errors can be ignored.

  7. Type exit to get out of the xDB console.
  8. If High Availability (HA) is enabled, repeat Steps 4 through 7 on the Master Replica node.
  9. In the Admin User Interface (UI), click Bring Online to bring the cluster back online.
  10. Launch the Product UI and navigate to Administration > Solutions.
  11. Delete and then recreate any adapter instances that have Certificates associated to them, such as the VMware vSphere adapter instances.
       
    Note: Historical data are not lost. The child objects re-associate to the new adapter instance.

  12. Navigate to Administration > Authentication Sources.
  13. Delete and then then recreate any Authentication Sources that have Certificates associated to them, such as an Active Directory source.

Tags

blob

See Also

Request a Product Feature

To request a new product feature or to provide feedback on a VMware product, please visit the Request a Product Feature page.

Feedback

  • 0 Ratings

Did this article help you?
This article resolved my issue.
This article did not resolve my issue.
This article helped but additional information was required to resolve my issue.

What can we do to improve this information? (4000 or fewer characters)




Please enter the Captcha code before clicking Submit.
  • 0 Ratings
Actions
KB: