VMware Cloud Foundation SP 2.4.0 Bring up fails due to an error creating an User Account
search cancel

VMware Cloud Foundation SP 2.4.0 Bring up fails due to an error creating an User Account

book

Article ID: 336400

calendar_today

Updated On:

Products

VMware Cloud Foundation

Issue/Introduction

Symptoms:
  • Bringup for a VMware Cloud Foundation for Service Providers 2.4.0 implementation fails to successfully complete.
  • You see messages similar to the following in the /opt/vmware/bringup/logs/evosddc-bringup-debug.log file on the Cloud Builder VM:

    2018-05-14 06:33:39.712 [threadPoolExecutor-1] ERROR [c.vmware.evo.sddc.bringup.util.SSOEntityService] <2a205da1-5772-11e8-9b76-e37e7c0d57cc> Error creating admin client
    com.vmware.vim.sso.client.exception.TimeSynchronizationException: Server returned 'request expired' less than 0 seconds after request was issued, but it shouldn't have expired for at least 600 seconds.
            at com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl$RequestResponseProcessor.checkTimeSyncronization(SecurityTokenServiceImpl.java:651)
            at com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl$RequestResponseProcessor.executeRoundtrip(SecurityTokenServiceImpl.java:613)
            at com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl.acquireToken(SecurityTokenServiceImpl.java:120)
            at com.vmware.evo.sddc.bringup.util.SSOEntityService.fetchAdminClientUsernamePassword(SSOEntityService.java:351)
            at com.vmware.evo.sddc.bringup.util.SSOEntityService.buildAdminClientObject(SSOEntityService.java:91)
            at com.vmware.evo.sddc.bringup.util.SSOEntityService.createOldSchoolUsernamePasswordAdministrator(SSOEntityService.java:470)
            at com.vmware.evo.sddc.bringup.plugin.psc.PscService.createSecondaSsoUser(PscService.java:241)
            at com.vmware.evo.sddc.bringup.plugin.psc.PscService65.DeployPsc1(PscService65.java:119)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:498)
            at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:269)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:356)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.processTask(ProcessingTaskSubscriber.java:431)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:97)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:54)
            at reactor.bus.EventBus$3.accept(EventBus.java:317)
            at reactor.bus.EventBus$3.accept(EventBus.java:310)
            at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
            at reactor.bus.EventBus.accept(EventBus.java:591)
            at reactor.bus.EventBus.accept(EventBus.java:63)
            at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
            at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    2018-05-14 06:33:39.712 [threadPoolExecutor-1] ERROR [c.vmware.evo.sddc.bringup.util.SSOEntityService] <2a205da1-5772-11e8-9b76-e37e7c0d57cc> Failed to create user: automationuser-843227-PSC01
    java.lang.NullPointerException: null
            at com.vmware.evo.sddc.bringup.util.SSOEntityService.createOldSchoolUsernamePasswordAdministrator(SSOEntityService.java:474)
            at com.vmware.evo.sddc.bringup.plugin.psc.PscService.createSecondaSsoUser(PscService.java:241)
            at com.vmware.evo.sddc.bringup.plugin.psc.PscService65.DeployPsc1(PscService65.java:119)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:498)
            at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:269)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:356)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.processTask(ProcessingTaskSubscriber.java:431)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:97)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:54)
            at reactor.bus.EventBus$3.accept(EventBus.java:317)
            at reactor.bus.EventBus$3.accept(EventBus.java:310)
            at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
            at reactor.bus.EventBus.accept(EventBus.java:591)
            at reactor.bus.EventBus.accept(EventBus.java:63)
            at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
            at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    2018-05-14 06:33:39.713 [threadPoolExecutor-1] ERROR [c.v.e.sddc.orchestrator.model.error.ErrorFactory]  [OR8MH3] INTERNAL_SERVER_ERROR Invocation of prefix '' part of task DeployPsc1 in plugin com.vmware.evo.sddc.bringup.plugin.spi.PscPlugin65 failed with exception.
    com.vmware.evo.sddc.common.core.error.InternalServerErrorException: Invocation of prefix '' part of task DeployPsc1 in plugin com.vmware.evo.sddc.bringup.plugin.spi.PscPlugin65 failed with exception.
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:375)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.processTask(ProcessingTaskSubscriber.java:431)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:97)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:54)
            at reactor.bus.EventBus$3.accept(EventBus.java:317)
            at reactor.bus.EventBus$3.accept(EventBus.java:310)
            at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
            at reactor.bus.EventBus.accept(EventBus.java:591)
            at reactor.bus.EventBus.accept(EventBus.java:63)
            at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
            at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    Caused by: com.vmware.evo.sddc.orchestrator.exceptions.TaskException: Failed to deploy PSC-1 for Primary region
            at com.vmware.evo.sddc.bringup.plugin.psc.PscService65.DeployPsc1(PscService65.java:120)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:498)
            at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:269)
            at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:356)
            ... 13 common frames omitted
    2018-05-14 06:33:39.713 [threadPoolExecutor-1] DEBUG [c.v.e.s.o.core.ProcessingTaskSubscriber]  Collected the following errors for task with name DeployPsc1 and ID 191fc1f7-5772-11e8-9b76-e37e7c0d57cc: [ExecutionError [errorCode=null, errorResponse=LocalizableErrorResponse [defaultMessage=A problem has occurred on the server. Please retry or contact the service provider and provide the reference token., errorCode=INTERNAL_SERVER_ERROR, arguments=[], messageBundle=com.vmware.evo.sddc.common.core.error.messages, context=null, referenceToken=GA6RMB]]]

    Note: The preceding log excerpts are only examples. Date, time, and environmental variables may vary depending on your environment.


Environment

VMware Cloud Foundation 2.x

Cause

The time on the Cloud Builder VM must be synchronized with the time in the VMware Cloud Foundation SP environment. If the time difference is greater than 5 minutes, it will be unable to create a valid token to manage the deployed PSC.

Resolution

To resolve this issue, implement the following steps:
  1. Revert the Cloud Builder VM to the snapshot taken prior to the bringup attempt and reset the environment.
  2. Synchronize the time on the Cloud Builder VM with the time used in the VMware Cloud Foundation rack.
  3. Retry the bringup attempt.


Powered by Wolken Software