search

spring-attic / spring-cloud-dataflow-server-cloudfoundry

Spring Cloud Data Flow Implementation for Cloud Foundry
http://cloud.spring.io/spring-cloud-dataflow-server-cloudfoundry/
Apache License 2.0
21 stars 42 forks source link

SpringCloud data flow app doesn't start, getting SSL handshare error #60

Closed cloudm9 closed 8 years ago

cloudm9 commented 8 years ago

Pushed admin app as per the below link. but getting ssl handshakes error during the start. we did try with default java build pack.

http://docs.spring.io/spring-cloud-dataflow/docs/1.0.0.M1/reference/html/getting-started-deploying-spring-cloud-dataflow.html

Error: 2016-02-26T16:27:42.07-0700 [App/0] ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with nam e 'taskController' defined in file [/home/vcap/app/org/springframework/cloud/dataflow/admin/controller/TaskController.class]: Unsatisfied dependency e xpressed through constructor argument with index 2 of type [org.springframework.cloud.dataflow.module.deployer.ModuleDeployer]: : Error creating bean with name 'taskModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeplo yerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 1 of type [org.springframework.cloud.dataflow.module .deployer.cloudfoundry.CloudFoundryApplicationOperations]: : Error creating bean with name 'cloudFoundryApplicationOperations' defined in class path r esource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factor y method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.cloud.dataflow.m odule.deployer.cloudfoundry.CloudFoundryApplicationOperations]: Factory method 'cloudFoundryApplicationOperations' threw exception; nested exception i s error="access_denied", error_description="Error requesting access token."; nested exception is org.springframework.beans.factory.BeanCreationExcepti on: Error creating bean with name 'cloudFoundryApplicationOperations' defined in class path resource [org/springframework/cloud/dataflow/module/deploy er/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework. beans.BeanInstantiationException: Failed to instantiate [org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryApplicationOperat ions]: Factory method 'cloudFoundryApplicationOperations' threw exception; nested exception is error="access_denied", error_description="Error request ing access token."; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'taskModuleDep loyer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 1 of type [org.springframework.cloud.dataflow.module.deployer.cloudfoundry.C loudFoundryApplicationOperations]: : Error creating bean with name 'cloudFoundryApplicationOperations' defined in class path resource [org/springframe work/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.cloud.dataflow.module.deployer.cloudfoun dry.CloudFoundryApplicationOperations]: Factory method 'cloudFoundryApplicationOperations' threw exception; nested exception is error="access_denied", error_description="Error requesting access token."; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryApplicationOperations' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFou ndryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationE xception: Failed to instantiate [org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryApplicationOperations]: Factory method 'c loudFoundryApplicationOperations' threw exception; nested exception is error="access_denied", error_description="Error requesting access token." 2016-02-26T16:27:42.07-0700 [App/0] ERR at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolv

cloudm9 commented 8 years ago

Any idea?

sabbyanandan commented 8 years ago

Hi @madhuchiluka: Looks like the docs that you tried is outdated - where did you get the link? (we will update it)

The M1 release of Spring Cloud Data Flow's CF deployment docs are here.

Notice the environment variable CLOUDFOUNDRY_SKIP_SSL_VALIDATION, which if set correctly, you'll be able to bootstrap the application.

markpollack commented 8 years ago

Jeez, these docs we shouldn't have published have been hard to redact. I'll take yet another pass...

cloudm9 commented 8 years ago

I have deployed M1 release jar( from the link you provided). Getting same below error. I have passed all the required env variables as per the doc. 

H:\Pivotal\springcloud-dataflow>cf logs s-c-dataflow-admin --recent
Connected, dumping recent logs for app s-c-dataflow-admin in org mets / space Madhu as admin...

2016-02-28T23:32:07.09-0700 [API/0]      OUT Created app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365
2016-02-28T23:32:07.37-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"route"=>"8f660668-8642-4547-92c8-ee3ef4e5f1
09"})
2016-02-28T23:32:41.18-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"name"=>"s-c-dataflow-admin"})
2016-02-28T23:38:03.40-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:12.74-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:20.50-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:28.38-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:35.46-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:44.27-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:52.31-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:38:59.01-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"environment_json"=>"PRIVATE DATA HIDDEN"})
2016-02-28T23:39:13.04-0700 [DEA/3]      OUT Got staging request for app with id 714185ce-a5b2-4096-b2c6-8fc9838df365
2016-02-28T23:39:14.09-0700 [API/0]      OUT Updated app with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 ({"state"=>"STARTED"})
2016-02-28T23:39:14.26-0700 [STG/3]      OUT -----> Downloaded app package (11M)
2016-02-28T23:39:15.76-0700 [STG/0]      OUT     -----> Java Buildpack Version: v3.3 (offline) | https://github.com/cloudfoundry/java-buildpack#617016
6
2016-02-28T23:39:15.92-0700 [STG/0]      OUT -----> Downloading Open Jdk JRE 1.8.0_60 from https://download.run.pivotal.io/openjdk/trusty/x86_64/openj
dk-1.8.0_60.tar.gz (found in cache)
2016-02-28T23:39:16.97-0700 [STG/0]      OUT        Expanding Open Jdk JRE to .java-buildpack/open_jdk_jre (1.0s)
2016-02-28T23:39:16.97-0700 [STG/0]      OUT -----> Downloading Open JDK Like Memory Calculator 2.0.0_RELEASE from https://download.run.pivotal.io/mem
ory-calculator/trusty/x86_64/memory-calculator-2.0.0_RELEASE.tar.gz (found in cache)
2016-02-28T23:39:17.00-0700 [STG/0]      OUT        Memory Settings: -Xmx768M -XX:MaxMetaspaceSize=104857K -Xss1M -Xms768M -XX:MetaspaceSize=104857K
2016-02-28T23:39:17.00-0700 [STG/0]      OUT -----> Downloading Spring Auto Reconfiguration 1.10.0_RELEASE from https://download.run.pivotal.io/auto-r
econfiguration/auto-reconfiguration-1.10.0_RELEASE.jar (found in cache)
2016-02-28T23:39:18.60-0700 [STG/0]      ERR
2016-02-28T23:39:25.16-0700 [STG/3]      OUT -----> Uploading droplet (56M)
2016-02-28T23:39:29.28-0700 [DEA/3]      OUT Starting app instance (index 0) with guid 714185ce-a5b2-4096-b2c6-8fc9838df365
←[7m←[27;32m  ____                              ____ _                __rsion
2016-02-28T23:39:33.45-0700 [App/0]      OUT  / ___| _ __  _ __(_)_ __   __ _   / ___| | ___  _   _  __| |
2016-02-28T23:39:33.45-0700 [App/0]      OUT  \___ \| '_ \| '__| | '_ \ / _` | | |   | |/ _ \| | | |/ _` |
2016-02-28T23:39:33.45-0700 [App/0]      OUT   ___) | |_) | |  | | | | | (_| | | |___| | (_) | |_| | (_| |
2016-02-28T23:39:33.45-0700 [App/0]      OUT  |____/| .__/|_|  |_|_| |_|\__, |  \____|_|\___/ \__,_|\__,_|
2016-02-28T23:39:33.45-0700 [App/0]      OUT   ____ |_|    _          __|___/                 __________
2016-02-28T23:39:33.45-0700 [App/0]      OUT  |  _ \  __ _| |_ __ _  |  ___| | _____      __  \ \ \ \ \ \
2016-02-28T23:39:33.45-0700 [App/0]      OUT  | | | |/ _` | __/ _` | | |_  | |/ _ \ \ /\ / /   \ \ \ \ \ \
2016-02-28T23:39:33.45-0700 [App/0]      OUT  | |_| | (_| | || (_| | |  _| | | (_) \ V  V /    / / / / / /
2016-02-28T23:39:33.45-0700 [App/0]      OUT  |____/ \__,_|\__\__,_| |_|   |_|\___/ \_/\_/    /_/_/_/_/_/
2016-02-28T23:39:33.45-0700 [App/0]      OUT Unknown Version
←[7m←[27;32mWelcome to the Spring Cloud Data Flow shell. For assistance hit TAB or type "help".
2016-02-28T23:39:33.48-0700 [App/0]      ERR
2016-02-28T23:39:33.48-0700 [App/0]      OUT ←[33mserver-unknown:>←[m
2016-02-28T23:39:33.50-0700 [DEA/3]      ERR Instance (index 0) failed to start accepting connections
2016-02-28T23:39:33.50-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"a76269dd0cf14b4cbe6ddaccfec92257", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456727973}
2016-02-28T23:39:33.51-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"a76269dd0cf14b4cbe6ddaccfec92257", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456727973}
2016-02-28T23:40:19.66-0700 [DEA/4]      OUT Starting app instance (index 0) with guid 714185ce-a5b2-4096-b2c6-8fc9838df365
←[7m←[27;32m  ____                              ____ _                __rsion
2016-02-28T23:40:23.55-0700 [App/0]      OUT  / ___| _ __  _ __(_)_ __   __ _   / ___| | ___  _   _  __| |
2016-02-28T23:40:23.55-0700 [App/0]      OUT  \___ \| '_ \| '__| | '_ \ / _` | | |   | |/ _ \| | | |/ _` |
2016-02-28T23:40:23.55-0700 [App/0]      OUT   ___) | |_) | |  | | | | | (_| | | |___| | (_) | |_| | (_| |
2016-02-28T23:40:23.55-0700 [App/0]      OUT  |____/| .__/|_|  |_|_| |_|\__, |  \____|_|\___/ \__,_|\__,_|
2016-02-28T23:40:23.55-0700 [App/0]      OUT   ____ |_|    _          __|___/                 __________
2016-02-28T23:40:23.55-0700 [App/0]      OUT  |  _ \  __ _| |_ __ _  |  ___| | _____      __  \ \ \ \ \ \
2016-02-28T23:40:23.55-0700 [App/0]      OUT  | | | |/ _` | __/ _` | | |_  | |/ _ \ \ /\ / /   \ \ \ \ \ \
2016-02-28T23:40:23.55-0700 [App/0]      OUT  | |_| | (_| | || (_| | |  _| | | (_) \ V  V /    / / / / / /
2016-02-28T23:40:23.55-0700 [App/0]      OUT  |____/ \__,_|\__\__,_| |_|   |_|\___/ \_/\_/    /_/_/_/_/_/
2016-02-28T23:40:23.55-0700 [App/0]      OUT Unknown Version
←[7m←[27;32mWelcome to the Spring Cloud Data Flow shell. For assistance hit TAB or type "help".
2016-02-28T23:40:23.58-0700 [App/0]      OUT ←[33mserver-unknown:>←[m
2016-02-28T23:40:23.58-0700 [App/0]      ERR
2016-02-28T23:40:23.60-0700 [DEA/4]      ERR Instance (index 0) failed to start accepting connections
2016-02-28T23:40:23.61-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"0c6ee5b0e9464ac0b16d216e00b1120f", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456728023}
2016-02-28T23:40:23.61-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"0c6ee5b0e9464ac0b16d216e00b1120f", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456728023}
2016-02-28T23:40:59.66-0700 [DEA/2]      OUT Starting app instance (index 0) with guid 714185ce-a5b2-4096-b2c6-8fc9838df365
←[7m←[27;32m  ____                              ____ _                __rsion
2016-02-28T23:41:03.54-0700 [App/0]      OUT  / ___| _ __  _ __(_)_ __   __ _   / ___| | ___  _   _  __| |
2016-02-28T23:41:03.54-0700 [App/0]      OUT  \___ \| '_ \| '__| | '_ \ / _` | | |   | |/ _ \| | | |/ _` |
2016-02-28T23:41:03.54-0700 [App/0]      OUT   ___) | |_) | |  | | | | | (_| | | |___| | (_) | |_| | (_| |
2016-02-28T23:41:03.54-0700 [App/0]      OUT  |____/| .__/|_|  |_|_| |_|\__, |  \____|_|\___/ \__,_|\__,_|
2016-02-28T23:41:03.54-0700 [App/0]      OUT   ____ |_|    _          __|___/                 __________
2016-02-28T23:41:03.54-0700 [App/0]      OUT  |  _ \  __ _| |_ __ _  |  ___| | _____      __  \ \ \ \ \ \
2016-02-28T23:41:03.54-0700 [App/0]      OUT  | | | |/ _` | __/ _` | | |_  | |/ _ \ \ /\ / /   \ \ \ \ \ \
2016-02-28T23:41:03.54-0700 [App/0]      OUT  | |_| | (_| | || (_| | |  _| | | (_) \ V  V /    / / / / / /
2016-02-28T23:41:03.54-0700 [App/0]      OUT  |____/ \__,_|\__\__,_| |_|   |_|\___/ \_/\_/    /_/_/_/_/_/
2016-02-28T23:41:03.54-0700 [App/0]      OUT Unknown Version
←[7m←[27;32mWelcome to the Spring Cloud Data Flow shell. For assistance hit TAB or type "help".
2016-02-28T23:41:03.57-0700 [App/0]      ERR
2016-02-28T23:41:03.57-0700 [App/0]      OUT ←[33mserver-unknown:>←[m
2016-02-28T23:41:03.59-0700 [DEA/2]      ERR Instance (index 0) failed to start accepting connections
2016-02-28T23:41:03.59-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"e10f2879bea34f3fbdf3039aa96abf98", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456728063}
2016-02-28T23:41:03.59-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"e10f2879bea34f3fbdf3039aa96abf98", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456728063}
2016-02-28T23:41:39.66-0700 [DEA/5]      OUT Starting app instance (index 0) with guid 714185ce-a5b2-4096-b2c6-8fc9838df365
←[7m←[27;32m  ____                              ____ _                __rsion
2016-02-28T23:41:43.74-0700 [App/0]      OUT  / ___| _ __  _ __(_)_ __   __ _   / ___| | ___  _   _  __| |
2016-02-28T23:41:43.74-0700 [App/0]      OUT  \___ \| '_ \| '__| | '_ \ / _` | | |   | |/ _ \| | | |/ _` |
2016-02-28T23:41:43.74-0700 [App/0]      OUT   ___) | |_) | |  | | | | | (_| | | |___| | (_) | |_| | (_| |
2016-02-28T23:41:43.74-0700 [App/0]      OUT  |____/| .__/|_|  |_|_| |_|\__, |  \____|_|\___/ \__,_|\__,_|
2016-02-28T23:41:43.74-0700 [App/0]      OUT   ____ |_|    _          __|___/                 __________
2016-02-28T23:41:43.74-0700 [App/0]      OUT  |  _ \  __ _| |_ __ _  |  ___| | _____      __  \ \ \ \ \ \
2016-02-28T23:41:43.74-0700 [App/0]      OUT  | | | |/ _` | __/ _` | | |_  | |/ _ \ \ /\ / /   \ \ \ \ \ \
2016-02-28T23:41:43.74-0700 [App/0]      OUT  | |_| | (_| | || (_| | |  _| | | (_) \ V  V /    / / / / / /
2016-02-28T23:41:43.74-0700 [App/0]      OUT  |____/ \__,_|\__\__,_| |_|   |_|\___/ \_/\_/    /_/_/_/_/_/
2016-02-28T23:41:43.74-0700 [App/0]      OUT Unknown Version
←[7m←[27;32mWelcome to the Spring Cloud Data Flow shell. For assistance hit TAB or type "help".
2016-02-28T23:41:43.78-0700 [App/0]      ERR
2016-02-28T23:41:43.78-0700 [App/0]      OUT ←[33mserver-unknown:>←[m
2016-02-28T23:41:43.80-0700 [DEA/5]      ERR Instance (index 0) failed to start accepting connections
2016-02-28T23:41:43.81-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"06b10b2bc1bb4229a512ac53c964271b", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456728103}
2016-02-28T23:41:43.81-0700 [API/0]      OUT App instance exited with guid 714185ce-a5b2-4096-b2c6-8fc9838df365 payload: {"cc_partition"=>"default", "
droplet"=>"714185ce-a5b2-4096-b2c6-8fc9838df365", "version"=>"fbb1c728-7394-477b-872a-e673c5052e81", "instance"=>"06b10b2bc1bb4229a512ac53c964271b", "
index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1
456728103}
ericbottard commented 8 years ago

Hello,

how come the logs read Welcome to the Spring Cloud Data Flow shell. For assistance hit TAB or type "help".? Are you sure you're uploading the server application (aka admin application) and the dataflow shell ?

cloudm9 commented 8 years ago

I'm pushing the admin app "spring-cloud-dataflow-admin-cloudfoundry-1.0.0.M1.jar".

cf push s-c-dataflow-admin --no-start -p spring-cloud-dataflow-admin-cloudfoundry-1.0.0.M1.jar

I haven't used "shell" app at all. do I need to deploy both together?

ericbottard commented 8 years ago

Are you 100% sure you're pushing the correct app? Because NO you should not push the shell app, but the banner you posted in the logs makes me think you did. Also, the fact that the health manager can't connect to it (the shell does not listen over http). This is the kind of banner I have for the admin:

2016-02-29T17:50:57.13+0100 [APP/0]      OUT   ____                              ____ _                __
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  / ___| _ __  _ __(_)_ __   __ _   / ___| | ___  _   _  __| |
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  \___ \| '_ \| '__| | '_ \ / _` | | |   | |/ _ \| | | |/ _` |
2016-02-29T17:50:57.13+0100 [APP/0]      OUT   ___) | |_) | |  | | | | | (_| | | |___| | (_) | |_| | (_| |
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  |____/| .__/|_|  |_|_| |_|\__, |  \____|_|\___/ \__,_|\__,_|
2016-02-29T17:50:57.13+0100 [APP/0]      OUT   ____ |_|    _          __|___/                 __________
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  |  _ \  __ _| |_ __ _  |  ___| | _____      __  \ \ \ \ \ \
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  | | | |/ _` | __/ _` | | |_  | |/ _ \ \ /\ / /   \ \ \ \ \ \
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  | |_| | (_| | || (_| | |  _| | | (_) \ V  V /    / / / / / /
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  |____/ \__,_|\__\__,_| |_|   |_|\___/ \_/\_/    /_/_/_/_/_/
2016-02-29T17:50:57.13+0100 [APP/0]      OUT  1.0.0.BUILD-SNAPSHOT
2016-02-29T17:50:57.20+0100 [APP/0]      OUT 2016-02-29 16:50:57.206  INFO 16 --- [           main] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at: http://localhost:8888
2016-02-29T17:50:57.28+0100 [APP/0]      OUT 2016-02-29 16:50:57.289  WARN 16 --- [           main] c.c.c.ConfigServicePropertySourceLocator : Could not locate PropertySource: I/O error on GET request for "http://localhost:8888/spring-cloud-dataflow-admin/cloud": Connection refused; nested exception is java.net.ConnectException: Connection refused

Yours reads ←[7m←[27;32mWelcome to the Spring Cloud Data Flow shell. For assistance hit TAB or type "help". (which is an ANSI escape code and typical shell output)

cloudm9 commented 8 years ago

Yes, I downloaded admin jar from this page

spring.io/milestone/org/springframework/cloud/spring-cloud-dataflow-admin-cloudfoundry/1.0.0.M1/spring-cloud-dataflow-admin-cloudfoundry-1.0.0.M1.jar

I pushed the app with jar, added redis service then added env variables as per doc and then started the app. Did I miss anything here?

ericbottard commented 8 years ago

Can you point to the actual link (the one above is a 404 and does not point to our repo).

cloudm9 commented 8 years ago

http://repo.spring.io/milestone/org/springframework/cloud/spring-cloud-dataflow-admin-cloudfoundry/1.0.0.M1/spring-cloud-dataflow-admin-cloudfoundry-1.0.0.M1.jar

cloudm9 commented 8 years ago

I got this from sabbyanandan from this same thread

lonnix commented 8 years ago

I'm getting this same problem, and I am definitely not using the shell:

Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT ____ ____ _ __
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT / ___| _ __ _ __(_)_ __ __ _ / ___| | ___ _ _ __| |
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT \___ \| '_ \| '__| | '_ \ / _` | | | | |/ _ \| | | |/ _` |
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT | | | |/ _` | __/ _` | | |_ | |/ _ \ \ /\ / / \ \ \ \ \ \
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT ___) | |_) | | | | | | | (_| | | |___| | (_) | |_| | (_| |
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT |____/| .__/|_| |_|_| |_|\__, | \____|_|\___/ \__,_|\__,_|
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT ____ |_| _ __|___/ __________
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT | _ \ __ _| |_ __ _ | ___| | _____ __ \ \ \ \ \ \
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT | |_| | (_| | || (_| | | _| | | (_) \ V V / / / / / / /
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT |____/ \__,_|\__\__,_| |_| |_|\___/ \_/\_/ /_/_/_/_/_/
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT 1.0.0.BUILD-SNAPSHOT
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT 2016-02-29 21:51:42.590 INFO 34 --- [ main] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at: http://localhost:8888
Mon Feb 29 2016 15:51:42 GMT-0600 (Central Standard Time) [App/0] OUT 2016-02-29 21:51:42.660 WARN 34 --- [ main] c.c.c.ConfigServicePropertySourceLocator : Could not locate PropertySource: I/O error on GET request for "http://localhost:8888/spring-cloud-dataflow-server-cloudfoundry/cloud": Connection refused; nested exception is java.net.ConnectException: Connection refused

I'm following the documentation here: http://docs.spring.io/spring-cloud-dataflow-admin-cloudfoundry/docs/current-SNAPSHOT/reference/htmlsingle/#getting-started

cloudm9 commented 8 years ago

What permissions/scopes this user needs to have? we have tried with uaa admin and created a local user and gave uaa.admin, cc_admin, scim.read and scim.write scopes to it, didn't work. Is there any other special scopes or anything required?

CLOUDFOUNDRY_USERNAME: CLOUDFOUNDRY_PASSWORD:

sabbyanandan commented 8 years ago

@madhuchiluka: I repeated the same exact steps from the docs in the sandbox [PCF ER: v1.6.13-build.1] and I was able to bootstrap the admin successfully.

admin:

requested state: started
instances: 1/1
usage: 1G x 1 instances
urls: s-c-dataflow-admin.navy.springapps.io
last uploaded: Mon Feb 29 23:02:58 UTC 2016
stack: cflinuxfs2
buildpack: java-buildpack=v3.5.1-offline-http://github.com/pivotal-cf/pcf-java-buildpack.git#d6c19f8 java-main open-jdk-like-jre=1.8.0_65 open-jdk-like-memory-calculator=2.0.1_RELEASE spring-auto-reconfiguration=1.10.0_RELEASE

     state     since                    cpu    memory         disk           details
#0   running   2016-02-29 03:05:44 PM   0.0%   366.7M of 1G   208.7M of 1G

logs:

2016-02-29T15:05:44.30-0800 [APP/0]      OUT 2016-02-29 23:05:44.303  INFO 14 --- [           main] o.s.j.e.a.AnnotationMBeanExporter        : Located managed bean 'refreshEndpoint': registering with JMX server as MBean [org.springframework.cloud.endpoint:name=refreshEndpoint,type=RefreshEndpoint]
2016-02-29T15:05:44.50-0800 [APP/0]      OUT 2016-02-29 23:05:44.499  INFO 14 --- [           main] o.s.c.support.DefaultLifecycleProcessor  : Starting beans in phase 0
2016-02-29T15:05:44.71-0800 [APP/0]      OUT 2016-02-29 23:05:44.717  INFO 14 --- [           main] s.b.c.e.t.TomcatEmbeddedServletContainer : Tomcat started on port(s): 8080 (http)
2016-02-29T15:05:44.73-0800 [APP/0]      OUT 2016-02-29 23:05:44.729  INFO 14 --- [           main] o.s.c.dataflow.admin.AdminApplication    : Started AdminApplication in 13.567 seconds (JVM running for 14.447)
2016-02-29T15:05:44.74-0800 [HEALTH/0]   OUT healthcheck passed
2016-02-29T15:05:44.74-0800 [HEALTH/0]   OUT Exit status 0

The user I tried had uaa.admin, scim.read, and scim.write access. I don't see how this would be a problem though.

It is odd to see shell bootstrap messages in your log. I do not see it at all. I'd recommend cleaning up any stale applications from your org/space and retrying it.

sabbyanandan commented 8 years ago

@lonnix: What you see there is an error about local config-server being expected while bootstraping, but it is just a WARN log and it shouldn't cause any issue. We will look into why config-server is in the classpath [cc:/ @ericbottard].

I was able to push the SNAPSHOT version of dataflow-server successfully and I see the same WARN message in the logs, too.

admin:

requested state: started
instances: 1/1
usage: 1G x 1 instances
urls: s-c-dataflow-server.navy.springapps.io
last uploaded: Mon Feb 29 23:24:55 UTC 2016
stack: cflinuxfs2
buildpack: java-buildpack=v3.5.1-offline-http://github.com/pivotal-cf/pcf-java-buildpack.git#d6c19f8 java-main open-jdk-like-jre=1.8.0_65 open-jdk-like-memory-calculator=2.0.1_RELEASE spring-auto-reconfiguration=1.10.0_RELEASE

     state     since                    cpu    memory         disk         details
#0   running   2016-02-29 03:27:12 PM   0.0%   458.6M of 1G   214M of 1G

logs:

2016-02-29T15:26:59.23-0800 [APP/0]      OUT  1.0.0.BUILD-SNAPSHOT
2016-02-29T15:26:59.32-0800 [APP/0]      OUT 2016-02-29 23:26:59.322  INFO 14 --- [           main] c.c.c.ConfigServicePropertySourceLocator : Fetching config from server at: http://localhost:8888
2016-02-29T15:26:59.43-0800 [APP/0]      OUT 2016-02-29 23:26:59.437  WARN 14 --- [           main] c.c.c.ConfigServicePropertySourceLocator : Could not locate PropertySource: I/O error on GET request for "http://localhost:8888/spring-cloud-dataflow-server-cloudfoundry/cloud": Connection refused; nested exception is java.net.ConnectException: Connection refused

...
...
...

2016-02-29T15:27:12.29-0800 [APP/0]      OUT 2016-02-29 23:27:12.290  INFO 14 --- [           main] o.s.i.endpoint.EventDrivenConsumer       : started _org.springframework.integration.errorLogger
2016-02-29T15:27:12.45-0800 [APP/0]      OUT 2016-02-29 23:27:12.449  INFO 14 --- [           main] s.b.c.e.t.TomcatEmbeddedServletContainer : Tomcat started on port(s): 8080 (http)
2016-02-29T15:27:12.45-0800 [HEALTH/0]   OUT healthcheck passed
2016-02-29T15:27:12.45-0800 [HEALTH/0]   OUT Exit status 0
2016-02-29T15:27:12.46-0800 [APP/0]      OUT 2016-02-29 23:27:12.463  INFO 14 --- [           main] o.s.c.d.s.c.CloudFoundryDataFlowServer   : Started CloudFoundryDataFlowServer in 16.214 seconds (JVM running for 17.123)
2016-02-29T15:27:42.48-0800 [HEALTH/0]   OUT healthcheck passed
2016-02-29T15:27:42.48-0800 [HEALTH/0]   OUT Exit status 0

Do you have more logs?

lonnix commented 8 years ago

@sabbyanandan can you post your environment variables and services from the deployment above?

I'm not concerned about that WARN error. You and I are following the same documentation but I'm getting @madhuchiluka 's error about failure to get an access token. There has to be some difference between our env vars, our services or something else (@madhuchiluka mentioned the UAA scopes above). What version of Redis are you using?

sabbyanandan commented 8 years ago

I've the same env-var's listed in the docs with my user credentials. Nothing more.

We use the 1.5.6 version of redis tile.

cloudm9 commented 8 years ago

Hi,

we are still not able to deploy the app. we have tried using same version of jar, redis and buildpack as well. can you send your env variables for your app(I know you have used as per the doc, just to compare)? And Is this app trying to connect to anything outside?

Thanks, Madhu

sabbyanandan commented 8 years ago 
cf set-env s-c-dataflow-server CLOUDFOUNDRY_API_ENDPOINT <API_ENDPOINT>
cf set-env s-c-dataflow-server CLOUDFOUNDRY_ORGANIZATION sabby-dataflow
cf set-env s-c-dataflow-server CLOUDFOUNDRY_SPACE development
cf set-env s-c-dataflow-server CLOUDFOUNDRY_DOMAIN <DOMAIN>
cf set-env s-c-dataflow-server CLOUDFOUNDRY_SERVICES <REDIS_INSTANCE_NAME>
cf set-env s-c-dataflow-server CLOUDFOUNDRY_USERNAME <USER>
cf set-env s-c-dataflow-server CLOUDFOUNDRY_PASSWORD <PASSWORD>
cf set-env s-c-dataflow-server CLOUDFOUNDRY_SKIP_SSL_VALIDATION true
ngngsoftorg commented 8 years ago

I'm using the same PCF instance as Lon and Mahdu. And receiving a similar error. In my case I turned SSL validation off.

I deployed both the "latest" snapshot and build number 20160226.163121-2. Both failed. Binaries I used found here: http://repo.spring.io/snapshot/org/springframework/cloud/spring-cloud-dataflow-server-cloudfoundry/1.0.0.BUILD-SNAPSHOT/

*Note, I also deployed server build 20160226.163121-2 to PWS over the weekend. It worked fine (was able to use the shell create streams, etc.). As such I think this has something to do with our (Lon's Madhu's and my own) deployment of PCF.

Error logs for app during "starting" phase:

2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    ... 39 more
2016-03-01T14:24:42.36-0800 [App/0]      ERR Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    ... 52 more
2016-03-01T14:24:42.36-0800 [App/0]      ERR Caused by: org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerResponseErrorHandler.getException(CloudControllerResponseErrorHandler.java:69)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerResponseErrorHandler.handleError(CloudControllerResponseErrorHandler.java:24)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:641)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:597)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.LoggingRestTemplate.doExecute(LoggingRestTemplate.java:54)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:557)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.getForObject(RestTemplate.java:264)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.getInfoMap(CloudControllerClientFactory.java:101)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.createOauthClient(CloudControllerClientFactory.java:91)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.newCloudController(CloudControllerClientFactory.java:75)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:164)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:151)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration.cloudFoundryClient(CloudFoundryModuleDeployerConfiguration.java:55)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$f8bb7294.CGLIB$cloudFoundryClient$2(<generated>)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$f8bb7294$$FastClassBySpringCGLIB$$aa356e4b.invoke(<generated>)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$f8bb7294.cloudFoundryClient(<generated>)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162)
2016-03-01T14:24:42.36-0800 [App/0]      ERR    ... 53 more
2016-03-01T14:24:42.40-0800 [DEA/4]      ERR Instance (index 0) failed to start accepting connections
2016-03-01T14:24:42.40-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"46a19f5e-0cf1-4a61-95df-bfd34a480423", "instance"=>"37807170797a4ead8265fa5c0963f1a0", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456871082}
2016-03-01T14:24:42.40-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"46a19f5e-0cf1-4a61-95df-bfd34a480423", "instance"=>"37807170797a4ead8265fa5c0963f1a0", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456871082}
2016-03-01T14:25:32.54-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"46a19f5e-0cf1-4a61-95df-bfd34a480423", "instance"=>"4345aa685dd84bec8466f271c76bd791", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456871132}
2016-03-01T14:25:32.54-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"46a19f5e-0cf1-4a61-95df-bfd34a480423", "instance"=>"4345aa685dd84bec8466f271c76bd791", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456871132}
2016-03-01T14:26:01.91-0800 [DEA/2]      OUT Starting app instance (index 0) with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715
2016-03-01T14:26:05.97-0800 [App/0]      ERR Exception in thread "main" java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:62)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at java.lang.Thread.run(Thread.java:745)
2016-03-01T14:26:05.97-0800 [App/0]      ERR Caused by: java.lang.reflect.InvocationTargetException
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:54)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    ... 1 more
2016-03-01T14:26:05.97-0800 [App/0]      ERR Caused by: java.util.ConcurrentModificationException
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:901)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at java.util.ArrayList$Itr.next(ArrayList.java:851)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at ch.qos.logback.classic.Logger.recursiveReset(Logger.java:344)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at ch.qos.logback.classic.Logger.recursiveReset(Logger.java:345)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at ch.qos.logback.classic.Logger.recursiveReset(Logger.java:345)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at ch.qos.logback.classic.Logger.recursiveReset(Logger.java:345)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at ch.qos.logback.classic.Logger.recursiveReset(Logger.java:345)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at ch.qos.logback.classic.LoggerContext.reset(LoggerContext.java:213)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.logback.LogbackLoggingSystem.stopAndReset(LogbackLoggingSystem.java:174)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.logback.LogbackLoggingSystem.loadDefaults(LogbackLoggingSystem.java:118)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.AbstractLoggingSystem.initializeWithConventions(AbstractLoggingSystem.java:74)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.AbstractLoggingSystem.initialize(AbstractLoggingSystem.java:49)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.logback.LogbackLoggingSystem.initialize(LogbackLoggingSystem.java:106)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.LoggingApplicationListener.initializeSystem(LoggingApplicationListener.java:262)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.LoggingApplicationListener.initialize(LoggingApplicationListener.java:233)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.LoggingApplicationListener.onApplicationEnvironmentPreparedEvent(LoggingApplicationListener.java:200)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.logging.LoggingApplicationListener.onApplicationEvent(LoggingApplicationListener.java:176)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:163)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:136)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:119)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.context.event.EventPublishingRunListener.publishEvent(EventPublishingRunListener.java:111)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.context.event.EventPublishingRunListener.environmentPrepared(EventPublishingRunListener.java:65)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplicationRunListeners.environmentPrepared(SpringApplicationRunListeners.java:54)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.createAndRefreshContext(SpringApplication.java:330)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.builder.SpringApplicationBuilder.run(SpringApplicationBuilder.java:134)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.cloud.bootstrap.BootstrapApplicationListener.bootstrapServiceContext(BootstrapApplicationListener.java:138)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.cloud.bootstrap.BootstrapApplicationListener.onApplicationEvent(BootstrapApplicationListener.java:84)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.cloud.bootstrap.BootstrapApplicationListener.onApplicationEvent(BootstrapApplicationListener.java:62)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:163)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:136)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:119)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.context.event.EventPublishingRunListener.publishEvent(EventPublishingRunListener.java:111)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.context.event.EventPublishingRunListener.environmentPrepared(EventPublishingRunListener.java:65)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplicationRunListeners.environmentPrepared(SpringApplicationRunListeners.java:54)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.createAndRefreshContext(SpringApplication.java:330)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1191)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1180)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.server.cloudfoundry.CloudFoundryDataFlowServer.main(CloudFoundryDataFlowServer.java:31)
2016-03-01T14:26:05.97-0800 [App/0]      ERR    ... 6 more
2016-03-01T14:26:06.05-0800 [App/0]      OUT
2016-03-01T14:26:06.07-0800 [DEA/2]      ERR Instance (index 0) failed to start accepting connections
2016-03-01T14:26:52.56-0800 [App/0]      OUT    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_60-]
2016-03-01T14:26:52.56-0800 [App/0]      OUT    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162) ~[spring-beans-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
2016-03-01T14:26:52.56-0800 [App/0]      OUT    ... 53 common frames omitted
2016-03-01T14:26:52.56-0800 [App/0]      OUT 2016-03-01 22:26:52.568  WARN 34 --- [           main] o.s.boot.SpringApplication               : Error handling failed (Error creating bean with name 'delegatingApplicationListener' defined in class path resource [org/springframework/security/config/annotation/web/configuration/WebSecurityConfiguration.class]: Initialization of bean failed; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.transaction.config.internalTransactionAdvisor' defined in class path resource [org/springframework/transaction/annotation/ProxyTransactionManagementConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.transaction.interceptor.BeanFactoryTransactionAttributeSourceAdvisor]: Factory method 'transactionAdvisor' threw exception; nested exception is java.lang.NullPointerException)
2016-03-01T14:26:52.56-0800 [App/0]      ERR Exception in thread "main" java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
2016-03-01T14:26:52.56-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:62)
2016-03-01T14:26:52.56-0800 [App/0]      ERR    at java.lang.Thread.run(Thread.java:745)
2016-03-01T14:26:52.57-0800 [App/0]      ERR Caused by: java.lang.reflect.InvocationTargetException
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:54)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    ... 1 more
2016-03-01T14:26:52.57-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'streamDeploymentController' defined in URL [jar:file:/home/vcap/app/lib/spring-cloud-dataflow-server-core-1.0.0.BUILD-SNAPSHOT.jar!/org/springframework/cloud/dataflow/server/controller/StreamDeploymentController.class]: Unsatisfied dependency expressed through constructor argument with index 2 of type [org.springframework.cloud.dataflow.module.deployer.ModuleDeployer]: : Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error); nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1143)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1046)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:772)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:839)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:538)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:118)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:766)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.createAndRefreshContext(SpringApplication.java:361)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1191)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1180)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.server.cloudfoundry.CloudFoundryDataFlowServer.main(CloudFoundryDataFlowServer.java:31)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    ... 6 more
2016-03-01T14:26:52.57-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:464)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-01T14:26:52.57-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    ... 25 more
2016-03-01T14:26:52.58-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:599)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    ... 39 more
2016-03-01T14:26:52.58-0800 [App/0]      ERR Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    ... 52 more
2016-03-01T14:26:52.58-0800 [App/0]      ERR Caused by: org.cloudfoundry.client.lib.CloudFoundryException: 404 Not Found (Client error)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerResponseErrorHandler.getException(CloudControllerResponseErrorHandler.java:69)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerResponseErrorHandler.handleError(CloudControllerResponseErrorHandler.java:24)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:641)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:597)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.LoggingRestTemplate.doExecute(LoggingRestTemplate.java:54)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:557)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.web.client.RestTemplate.getForObject(RestTemplate.java:264)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.getInfoMap(CloudControllerClientFactory.java:101)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.createOauthClient(CloudControllerClientFactory.java:91)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.newCloudController(CloudControllerClientFactory.java:75)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:164)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:151)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration.cloudFoundryClient(CloudFoundryModuleDeployerConfiguration.java:55)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$ff5044fa.CGLIB$cloudFoundryClient$0(<generated>)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$ff5044fa$$FastClassBySpringCGLIB$$dc0818d9.invoke(<generated>)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
2016-03-01T14:26:52.58-0800 [App/0]      ERR    at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$ff5044fa.cloudFoundryClient(<generated>)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162)
2016-03-01T14:26:52.59-0800 [App/0]      ERR    ... 53 more
2016-03-01T14:26:52.66-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"46a19f5e-0cf1-4a61-95df-bfd34a480423", "instance"=>"693f21b0321641b892cfde34205297ca", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456871212}
2016-03-01T14:26:52.66-0800 [DEA/5]      ERR Instance (index 0) failed to start accepting connections
2016-03-01T14:26:52.66-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"46a19f5e-0cf1-4a61-95df-bfd34a480423", "instance"=>"693f21b0321641b892cfde34205297ca", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456871212}
sabbyanandan commented 8 years ago

@ngngsoftorg: Are you able to push any other app to this instance using the same API endpoint, domain, and user-credentials?

ngngsoftorg commented 8 years ago

let me confirm...

ngngsoftorg commented 8 years ago

Yes, I am


Creating route game-2048.blah...
OK

Binding game-2048.blah to game-2048...
OK

Uploading game-2048...
Uploading app files from: C:\blah\sandbox\2048
Uploading 594.5K, 37 files
Done uploading
OK

Starting app game-2048 in org blah / blah as blah..
-----> Downloaded app package (328K)
-------> Buildpack version 1.2.2
Downloaded [file:///var/vcap/data/dea_next/admin_buildpacks/5686033b-9279-4f55-94f4-af4317a465b0_bb51fb6fc9d65faee893f02d18a8373b18619915/dependencies/https___s3.amazonaws.com_pivotal-buildpacks_nginx_cflinuxfs2_nginx-1.8.0-linux-x64.tgz]
grep: Staticfile: No such file or directory
-----> Using root folder
-----> Copying project files into public/
-----> Setting up nginx
grep: Staticfile: No such file or directory
-----> Uploading droplet (3.1M)

1 of 1 instances running

App started

OK

App game-2048 was started using this command `sh boot.sh`

Showing health and status for app game-2048 in org blah / blah as blah...
OK

requested state: started
instances: 1/1
usage: 1G x 1 instances
urls: game-2048.blah
last uploaded: Tue Mar 1 23:57:58 UTC 2016
stack: cflinuxfs2
buildpack: staticfile_buildpack

     state     since                    cpu    memory       disk         details
#0   running   2016-03-01 03:58:07 PM   0.0%   3.8M of 1G   6.6M of 1G
sabbyanandan commented 8 years ago

Is game-2048 a java application? If not, can you try pushing one? Let's make sure the java-buildpack is used as part of this app push lifecycle, as that'd be a similar situation as deploying SCDF application.

ngngsoftorg commented 8 years ago

We have deployed a Java App as well. I'll send you the "status" info tomorrow. It deployed with no problems.

One distinction I noticed is that, if you are using PWS, you are probably using this java buildpack:

java_buildpack 2 true false java-buildpack-v3.6.zip

We are using an older "offline" version of the buildpack. As a test I will ask our team to deploy the same java buildpack as the one you are testing with (assuming the one above is accurate... I did a "Cf buildpacks" on PWS). Make sense?

ngngsoftorg commented 8 years ago

Here is the "cf app appname" out put for the java app:

requested state: started
instances: 1/1
usage: 1G x 1 instances
urls: blah
last uploaded: Wed Mar 2 00:45:35 UTC 2016
stack: cflinuxfs2
buildpack: blah_java_buildpack_offline

     state     since                    cpu    memory         disk         details
#0   running   2016-03-01 04:59:02 PM   0.0%   514.9M of 1G   134M of 1G

It is using a custom java_buildpack_offline

here is the buildpack info for the scdf server.

requested state: started
instances: 0/1
usage: 1G x 1 instances
urls: blah
last uploaded: Tue Mar 1 22:21:48 UTC 2016
stack: cflinuxfs2
buildpack: java-buildpack=v3.3-offline-https://github.com/cloudfoundry/java-buildpack#6170166 java-main open-jdk-like-jre=1.8.0_60 open-jdk-like-memory-calculator=2.0.0_RELEASE spring-auto-reconfiguration=1.10.0_RELEASE

     state      since                    cpu    memory   disk     details
#0   crashing   2016-03-01 02:25:13 PM   0.0%   0 of 0   0 of 0
sabbyanandan commented 8 years ago

Thanks, @ngngsoftorg.

So, the buildpack may not be a problem.

However, your CLOUDFOUNDRY_API_ENDPOINT token maybe pointing to the wrong endpoint. What do you have there? Is that the same endpoint you used to log into cf-cli prior to pushing the java-app?

It is either the URI or the credentials for Cloud Controller that is wrong.

ngngsoftorg commented 8 years ago

There was a typo in my API _ENDPOINT.

I updated to the correct endpoint ad "cf restage appname"'d

Now I see the following exception. The culprit appears to be "403 Error requesting access token".

2016-03-02T10:27:15.02-0800 [App/0]      OUT    at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355) ~[spring-context-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
2016-03-02T10:27:15.02-0800 [App/0]      OUT    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$cb1de6bd.cloudFoundryClient(<generated>) ~[spring-cloud-dataflow-deployer-cloudfoundry-1.0.0.BUILD-SNAPSHOT.jar!/:1.0.0.BUILD-SNAPSHOT]
2016-03-02T10:27:15.02-0800 [App/0]      OUT    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_60-]
2016-03-02T10:27:15.02-0800 [App/0]      OUT    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_60-]
2016-03-02T10:27:15.02-0800 [App/0]      OUT    at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_60-]
2016-03-02T10:27:15.02-0800 [App/0]      OUT    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162) ~[spring-beans-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
2016-03-02T10:27:15.02-0800 [App/0]      OUT    ... 53 common frames omitted
2016-03-02T10:27:15.04-0800 [App/0]      OUT 2016-03-02 18:27:15.043  WARN 34 --- [           main] o.s.boot.SpringApplication               : Error handling failed (Error creating bean with name 'delegatingApplicationListener' defined in class path resource [org/springframework/security/config/annotation/web/configuration/WebSecurityConfiguration.class]: Initialization of bean failed; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.transaction.config.internalTransactionAdvisor' defined in class path resource [org/springframework/transaction/annotation/ProxyTransactionManagementConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.transaction.interceptor.BeanFactoryTransactionAttributeSourceAdvisor]: Factory method 'transactionAdvisor' threw exception; nested exception is java.lang.NullPointerException)
2016-03-02T10:27:15.04-0800 [App/0]      ERR Exception in thread "main" java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:62)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at java.lang.Thread.run(Thread.java:745)
2016-03-02T10:27:15.04-0800 [App/0]      ERR Caused by: java.lang.reflect.InvocationTargetException
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:54)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    ... 1 more
2016-03-02T10:27:15.04-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'streamDeploymentController' defined in URL [jar:file:/home/vcap/app/lib/spring-cloud-dataflow-server-core-1.0.0.BUILD-SNAPSHOT.jar!/org/springframework/cloud/dataflow/server/controller/StreamDeploymentController.class]: Unsatisfied dependency expressed through constructor argument with index 2 of type [org.springframework.cloud.dataflow.module.deployer.ModuleDeployer]: : Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1143)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1046)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:772)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:839)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:538)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:118)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:766)
2016-03-02T10:27:15.04-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.createAndRefreshContext(SpringApplication.java:361)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1191)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1180)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.server.cloudfoundry.CloudFoundryDataFlowServer.main(CloudFoundryDataFlowServer.java:31)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    ... 6 more
2016-03-02T10:27:15.05-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:464)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    ... 25 more
2016-03-02T10:27:15.05-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:599)
2016-03-02T10:27:15.05-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
2016-03-02T10:27:15.06-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
2016-03-02T10:27:15.06-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-02T10:27:15.06-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-02T10:27:15.06-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    ... 39 more
2016-03-02T10:27:15.07-0800 [App/0]      ERR Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    ... 52 more
2016-03-02T10:27:15.07-0800 [App/0]      ERR Caused by: org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.oauth2.OauthClient.createToken(OauthClient.java:114)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.oauth2.OauthClient.init(OauthClient.java:70)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientImpl.initialize(CloudControllerClientImpl.java:187)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientImpl.<init>(CloudControllerClientImpl.java:176)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.newCloudController(CloudControllerClientFactory.java:78)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:164)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:151)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration.cloudFoundryClient(CloudFoundryModuleDeployerConfiguration.java:55)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$cb1de6bd.CGLIB$cloudFoundryClient$0(<generated>)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$cb1de6bd$$FastClassBySpringCGLIB$$cceb5628.invoke(<generated>)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$cb1de6bd.cloudFoundryClient(<generated>)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162)
2016-03-02T10:27:15.07-0800 [App/0]      ERR    ... 53 more
2016-03-02T10:27:15.12-0800 [DEA/1]      ERR Instance (index 0) failed to start accepting connections
2016-03-02T10:27:15.13-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"979aa2ee-8c65-4212-bd48-84206035ef24", "instance"=>"5d3b847db6ff4f2fa013e84d57cc533b", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456943235}
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355) ~[spring-context-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$84290ade.cloudFoundryClient(<generated>) ~[spring-cloud-dataflow-deployer-cloudfoundry-1.0.0.BUILD-SNAPSHOT.jar!/:1.0.0.BUILD-SNAPSHOT]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_60-]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_60-]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_60-]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_60-]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162) ~[spring-beans-4.2.4.RELEASE.jar!/:4.2.4.RELEASE]
2016-03-02T10:27:54.16-0800 [App/0]      OUT    ... 53 common frames omitted
2016-03-02T10:27:54.16-0800 [App/0]      OUT 2016-03-02 18:27:54.169  WARN 34 --- [           main] o.s.boot.SpringApplication               : Error handling failed (Error creating bean with name 'delegatingApplicationListener' defined in class path resource [org/springframework/security/config/annotation/web/configuration/WebSecurityConfiguration.class]: Initialization of bean failed; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.transaction.config.internalTransactionAdvisor' defined in class path resource [org/springframework/transaction/annotation/ProxyTransactionManagementConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.springframework.transaction.interceptor.BeanFactoryTransactionAttributeSourceAdvisor]: Factory method 'transactionAdvisor' threw exception; nested exception is java.lang.NullPointerException)
2016-03-02T10:27:54.17-0800 [App/0]      ERR Exception in thread "main" java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:62)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at java.lang.Thread.run(Thread.java:745)
2016-03-02T10:27:54.17-0800 [App/0]      ERR Caused by: java.lang.reflect.InvocationTargetException
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:54)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    ... 1 more
2016-03-02T10:27:54.17-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'streamDeploymentController' defined in URL [jar:file:/home/vcap/app/lib/spring-cloud-dataflow-server-core-1.0.0.BUILD-SNAPSHOT.jar!/org/springframework/cloud/dataflow/server/controller/StreamDeploymentController.class]: Unsatisfied dependency expressed through constructor argument with index 2 of type [org.springframework.cloud.dataflow.module.deployer.ModuleDeployer]: : Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:185)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1143)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1046)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:772)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:839)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:538)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.context.embedded.EmbeddedWebApplicationContext.refresh(EmbeddedWebApplicationContext.java:118)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:766)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.createAndRefreshContext(SpringApplication.java:361)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:307)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1191)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1180)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.server.cloudfoundry.CloudFoundryDataFlowServer.main(CloudFoundryDataFlowServer.java:31)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    ... 6 more
2016-03-02T10:27:54.17-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'processModuleDeployer' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Unsatisfied dependency expressed through constructor argument with index 0 of type [org.cloudfoundry.client.lib.CloudFoundryClient]: : Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token."); nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:749)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:464)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    ... 25 more
2016-03-02T10:27:54.17-0800 [App/0]      ERR Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cloudFoundryClient' defined in class path resource [org/springframework/cloud/dataflow/module/deployer/cloudfoundry/CloudFoundryModuleDeployerConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:599)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:813)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:741)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    ... 39 more
2016-03-02T10:27:54.17-0800 [App/0]      ERR Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.cloudfoundry.client.lib.CloudFoundryClient]: Factory method 'cloudFoundryClient' threw exception; nested exception is org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    ... 52 more
2016-03-02T10:27:54.17-0800 [App/0]      ERR Caused by: org.cloudfoundry.client.lib.CloudFoundryException: 403 Error requesting access token. (error="access_denied", error_description="Error requesting access token.")
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.oauth2.OauthClient.createToken(OauthClient.java:114)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.oauth2.OauthClient.init(OauthClient.java:70)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientImpl.initialize(CloudControllerClientImpl.java:187)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientImpl.<init>(CloudControllerClientImpl.java:176)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.newCloudController(CloudControllerClientFactory.java:78)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:164)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:151)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration.cloudFoundryClient(CloudFoundryModuleDeployerConfiguration.java:55)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$84290ade.CGLIB$cloudFoundryClient$2(<generated>)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$84290ade$$FastClassBySpringCGLIB$$d7f996f8.invoke(<generated>)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.cloud.dataflow.module.deployer.cloudfoundry.CloudFoundryModuleDeployerConfiguration$$EnhancerBySpringCGLIB$$84290ade.cloudFoundryClient(<generated>)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at java.lang.reflect.Method.invoke(Method.java:497)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162)
2016-03-02T10:27:54.17-0800 [App/0]      ERR    ... 53 more
2016-03-02T10:27:54.21-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"979aa2ee-8c65-4212-bd48-84206035ef24", "instance"=>"8174f64d16ad44d4816218f2f692e273", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456943274}
2016-03-02T10:27:54.21-0800 [DEA/4]      ERR Instance (index 0) failed to start accepting connections
2016-03-02T10:27:54.22-0800 [API/0]      OUT App instance exited with guid 2a6ba1e1-7578-4721-8c33-b83faaaa5715 payload: {"cc_partition"=>"default", "droplet"=>"2a6ba1e1-7578-4721-8c33-b83faaaa5715", "version"=>"979aa2ee-8c65-4212-bd48-84206035ef24", "instance"=>"8174f64d16ad44d4816218f2f692e273", "index"=>0, "reason"=>"CRASHED", "exit_status"=>0, "exit_description"=>"failed to accept connections within health check timeout", "crash_timestamp"=>1456943274}
ngngsoftorg commented 8 years ago

Sabby

A few questions.

Is it possible to set up PCF in such a way that a user has developer and manager cf access to an org and space, but deny him or her access to login to the cloud controller via the OauthClient? Looking at the OauthClient source suggests that is the case and is in fact what is happening.

Is it possible we need to be cloud controller admins for the OAuthClient to properly function?

Another possibility. We have integrated our PCF instance with our internal LDAP system. Could that configuration, which seems to work fine otherwise, cause an issues for the OAuthClient?

Thanks

cloudm9 commented 8 years ago

Sabby, one more thing, can you please post all scopes for your username? command: uaac user get "your-username"

sabbyanandan commented 8 years ago

@ngngsoftorg: We aren't too familiar with custom security integration in PCF. I've reached out to security SMEs and I've the following suggestions from them.

trial 1:

  1. repeat the push event and make the error happen once again
  2. get the UAA logs bosh logs uaa_z<zone> <job>
  3. attach the logs

trial 2:

  1. simulate the exact request directly to the UAA and see why it is being rejected
  2. attach the logs
ngngsoftorg commented 8 years ago

Thanks Sabby. We will send the logs soon.

ngngsoftorg commented 8 years ago

Sabby, question. How do we "simulate the request"? Are there some log files we can follow or do we use the cf-java-client?

sabbyanandan commented 8 years ago

We use the cf-java-client to interact with Cloud Controller APIs, yes. Perhaps, a simpler test would be to write a sample application similar to this example to simulate the authentication and authorization bits.

[cc:/ @fhanik]

channing-jackson commented 8 years ago

Hi there.

Copied your example to our local environment, and here are the results: 

Mar 03, 2016 1:27:49 PM org.springframework.web.client.RestTemplate handleResponseError
WARNING: POST request for "https://login.blah.blah.com/oauth/token" resulted in 401 (Unauthorized); invoking error handler
Exception in thread "main" org.cloudfoundry.client.lib.CloudFoundryException: 403 Access token denied. (error="access_denied", error_description="Access token denied.")
    at org.cloudfoundry.client.lib.oauth2.OauthClient.createToken(OauthClient.java:114)
    at org.cloudfoundry.client.lib.oauth2.OauthClient.init(OauthClient.java:70)
    at org.cloudfoundry.client.lib.rest.CloudControllerClientImpl.initialize(CloudControllerClientImpl.java:186)
    at org.cloudfoundry.client.lib.rest.CloudControllerClientImpl.<init>(CloudControllerClientImpl.java:162)
    at org.cloudfoundry.client.lib.rest.CloudControllerClientFactory.newCloudController(CloudControllerClientFactory.java:69)
    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:137)
    at org.cloudfoundry.client.lib.CloudFoundryClient.<init>(CloudFoundryClient.java:96)
    at JavaSample.main(JavaSample.java:19)
sabbyanandan commented 8 years ago

@channing-jackson: Looks like we are hitting the same error in the standalone mode, too. This needs to be discussed with CF security team - not much we can help here.

Perhaps it'd be best to open a trouble ticket with CF security team and attach the logs that I had requested on my previous response to @ngngsoftorg. It'd be beneficial to review the logs [bosh logs uaa_z<zone> <job>] from both the trials.

sabbyanandan commented 8 years ago

@channing-jackson: Based on our discussion, since you're now able to successfully push the dataflow-server, can we please close this?

channing-jackson commented 8 years ago

@sabbyanandan Yes, thank you.

sunilchaurha commented 8 years ago

Here I have few points to mention.

  1. Please verify API endpoint url if you get error.
  2. If PCF installation is self signed then you need to set SSL Validation as false or if PCF is installation is associated with CA certs then use SSL Validation as true.
  3. Username and password should be valid credential for PCF account.