Cannot perform more than one GSI creation or deletion in a single update; ConnectionStack failed to update

YikSanChan commented 5 years ago

Which Category is your question related to? graphql transformer

What AWS Services are you utilizing? Amplify

Provide additional details e.g. code snippets I change my annotated schema.graphql:

type Item @model {
   price: Int
   status: String
   measurement: String
+  inventory: Inventory @connection(name: "InventoryItems")
 }

 type Inventory @model {
   id: ID!
   name: String!
-  items: [Item] @connection
+  items: [Item] @connection(name: "InventoryItems")
   users: [InventoryMembership] @connection(name: "InventoryMembership_Inventory")
 }

which causes change to compiled schema.graphql:

type Item {
   price: Int
   status: String
   measurement: String
+  inventory: Inventory
 }

input CreateItemInput {
   price: Int
   status: String
   measurement: String
-  inventoryItemsId: ID
+  itemInventoryId: ID
 }

input UpdateItemInput {
   price: Int
   status: String
   measurement: String
-  inventoryItemsId: ID
+  itemInventoryId: ID
 }

amplify push results in below errors. See full log.

Cannot perform more than one GSI creation or deletion in a single update"

From https://github.com/aws-amplify/amplify-cli/issues/82#issuecomment-434016373, I should be good since my change only involves 1 connection (item-inventory). Why the problem and how to resolve this? @mikeparisstuff Thank you!

YikSanChan commented 5 years ago

As a follow-up, after a failed push attempt, no matter what change I make to the annotated schema.graphql, all pushes fail with below error: https://gist.github.com/YikSanChan/84663256309e9756e4aec1f693870b81.

The following resource(s) failed to update: [ConnectionStack]

Even worse, even though all pushes fail, in which case all cloud resources should remain unchanged, one of my AppSync API stops working which means very likely cloud resources do change :(

query listItems2{
  getInventory(id:"befeb059-712f-4a1a-9999-6759b8fa812b") {
    items {
      items {
        name
      }
    }
  }
}

It returns below null rather than all connected items of the inventory (the previous behavior).

{
  "data": {
    "getInventory": {
      "items": null
    }
  }
}

FYI, this is request/response template mapping for getInventory.

# request template mapping
{
  "version": "2017-02-28",
  "operation": "GetItem",
  "key": {
      "id": $util.dynamodb.toDynamoDBJson($ctx.args.id)
  }
}

# response template mapping
$util.toJson($context.result)

Any help?

YikSanChan commented 5 years ago

Cannot wait too long :( So I simply amplify api remove && amplify push to delete the whole api and its data, and restart from scratch.

This is not ideal but since I am still in dev so it is fine for now. Look forward to having mature solution

iqdev-ca commented 5 years ago

Doing the same as @YikSanChan, encountered issue when went from an Unnamed Connection to a Named Connection. Good that we are just in dev, this would be really frustrating if was encountered later on.

nagey commented 5 years ago

as a follow-up note to this, the GSI which does get created will not delete upon roll back, and then a subsequent push attempt will cause a different failure.

mikeparisstuff commented 5 years ago

This is a limit in DynamoDB that we must work around. In general, we will be providing new ways to customize what indexes exist on a table and enabling you to use these indexes with @connection. This way you can change the name of the connection fields without impacting the underlying GSI itself.

For now, when you making changes to @connection fields that will impact the underlying index, make the changes in two steps. First remove the existing @connection field and push your project. Then add back the connection field with the new configuration and push your project again.

If you are stuck in a situation where a GSI cannot be created nor destroyed via CloudFormation, I would suggest going to the CloudFormation console to manually remove the GSI that you no longer need.

cptflammin commented 5 years ago

@mikeparisstuff I am facing the same problem as described here, may be it possible to detail more how to "manually remove the GSI that you no longer need." ?

tafelito commented 5 years ago

why is this marked as a feature-request and not a bug? I'm having the same issue where I wanted to add a sortField to my connection, and having done a few changes then the push will always failed. I had to to the same as @YikSanChan and remove the api and push it again losing all my data.

hyattdrew11 commented 5 years ago

Having the same problems as well while building out a fairly complex schema. Luckily we have not moved to production yet, but this has slowed development.

jakemitchellxyz commented 5 years ago

same issue. using the amplify api remove && amplify push solution, can we get some eyes on this bug?

mhrisse commented 5 years ago

why is this marked as a feature-request and not a bug?

From our perspective, this is indeed a critical bug. It makes working with more than one person on a real-world project using @connection and CI/CD impossible and rendering the whole framework potentially unfit for production usage. Shame, we really like the general approach.

austinamorusocfc commented 5 years ago

@jordanranz @mikeparisstuff This is a major issue for us this changes our deployment time from 8 minutes to n number of connections times 8 minutes then multiplied by the number of environments we have. This is a massive time sink for us. Is there at least a script we can run to manage the schema deployment without a refactoring on Amplify's end?

ElliottBabb commented 5 years ago

I would vote for this as a critical bug, considering the following use-case I am currently experiencing:

Making the following schema additions:

type Organization{
subscriptions: [Subscription] @connection(name: "OrganizationSubscriptions")
...
}

type Subscription{
organization: Organization @connection(name: "OrganizationSubscriptions")
...
}

If I try and add 1 connection at a time, it fails to compile the schema (missing the associated named-connection on the other object).

If I try and add them both at the same time, I get the Resource is not in the state stackUpdateComplete

I am totally blocked by this bug, with my only other option being deleting and recreating my API.

Update 5-6-2019

After many trial and error amplify pushes, the following order of operations was successful.

Push #1

type Organization{
subscriptions: [Subscription] @connection
...
}

type Subscription{
organization: Organization
...
}

Push #2

type Organization{
subscriptions: [Subscription] @connection(name: "OrganizationSubscriptions")
...
}

type Subscription{
organization: Organization @connection(name: "OrganizationSubscriptions")
...
}

Results in success.

sethkrasnianski commented 5 years ago

If you are stuck in a situation where a GSI cannot be created nor destroyed via CloudFormation, I would suggest going to the CloudFormation console to manually remove the GSI that you no longer need.

@mikeparisstuff Is this as simple as going to the nested stack template for each of the respective models and removing the corresponding item in the GlobalSecondaryIndexes array? I would assume that's accompanied by the removal of the @connection directive for each model within your repository's schema file.

Could you confirm / elaborate on this?

ajhool commented 5 years ago

In agreement with @mhrisse , after having developed our application around Amplify, we are terrified to launch our production environment because the framework is proving to be terribly unreliable, hard to change, underdocumented, and there is a push to add new functionality instead of fixing critical bugs in existing / core functionality. It feels like a beta product that is being presented as production-ready.

Amplify abstracts away a lot of complexity. However, Amplify does not prevent users from making mistakes with respect to underlying aws resources (eg. attempting to add another GSI to a dynamo table) -- so, people who chose Amplify as a way to avoid working with underlying AWS resources end up avoiding AWS resources until something breaks, at which point they need to have a great understanding of the underlying AWS resources that they've been dealing with. Things break frequently. So, it ends up being the dangerous appearance of abstraction, but users still need to have a fairly intimate understanding of the underlying resources being used

If there is a workaround for this issue (and the amplify framework doesn't prevent the user from making this mistake), it should be provided in actual documentation instead of in the issues section of Github, IMO.

kaustavghosh06 commented 5 years ago

@ajhool, we’re aware of the this issue and haven’t been ignoring this. We have been actively discussing & designing short and long term resolutions internally. This issue is tied to the updating of the @connections directive causing Cloudformation Update failures. You would encounter this error because of a limit in the DynamoDB service which doesn’t allow you to create or update or delete more than 1 GSI at a time. It is a difficult problem to workaround, but we’re looking into ways to get around this and will soon be introducing Custom Indexes (#1463) as the first step towards getting around this issue.

As @mikeparisstuff mentioned, the workaround for now is to carefully update your @connections whenever you’re doing so. For now, when you make changes to @connection fields that will impact the underlying index, make the changes in two steps. First remove the existing @connection field and push your project. Then add back the connection field with the new configuration and push your project again.

In addition, as a first step we’ll be adding a note in our official docs around modifying @connections. We are also planning to add additional validations to the CLI push command. These will check your annotated schema before we push the schema to the cloud to prevent situations like this. Lastly, with the upcoming launch of custom indexes (#1463), customers can bypass this issue by managing their indexes (GSIs) themselves instead of the CLI managing it for them.

mhrisse commented 5 years ago

Please do not get me wrong, we really appreciate the effort everyone is puting into Amplify.

From a product management perspective, this @connection workaround (plus 1. missing rock solid @function functionality and 2. a bad taste (especially with a missing 1.) about putting complex if-then-else logic AVT) just adds to the taste that is just not feasible to use this in a real-world team yet.

When you are building a complex product, the last thing you want to worry about is someone removing a connection is trashing everyones environment, while developer are already waiting a lot for the cloud to provision simple tings like adding a field, because of missing offline functionality. (3. offline, think serverless-offline or docker-compose up)

I am confident Amplify is going to be great product or framework, it might just not be ready for prime time for those of us who are betting their business or start-up on this. Good things take time, all frameworks I have worked with in the past 25 years have had this growing up pain.

meetrij commented 5 years ago

I got a long schema definitions out of that one feild 'type' initially set as string, mentioned below with some arrows

type VarietyAttachment @model @searchable {
    varietyAttachmentId: ID!
    variety: VarietyMain @connection(keyField: "varId")
    year: String
    country: MasterLocation @connection(keyField: "locationId")
    report: MasterReport @connection(keyField: "reportId")
>>>>>>  type: String
    description: String
    createdBy: UserMain @connection(keyField: "createdUserId")
    updatedBy: UserMain @connection(keyField: "updatedUserId")
    createdAt: String
    updatedAt: String
    spadAttachment: [String]
}

Now I need to change that to a connection type for that I changed like this

type VarietyAttachment @model @searchable {
    varietyAttachmentId: ID!
    variety: VarietyMain @connection(keyField: "varId")
    year: String
    country: MasterLocation @connection(keyField: "locationId")
    report: MasterReport @connection(keyField: "reportId")
>>>>>>  type: MasterAttachType @connection(keyField: "attachTypeId")
    description: String
    createdBy: UserMain @connection(keyField: "createdUserId")
    updatedBy: UserMain @connection(keyField: "updatedUserId")
    createdAt: String
    updatedAt: String
    spadAttachment: [String]
}

which ended up in error

Following resources failed

× An error occurred when pushing the resources to the cloud

Resource is not in the state stackUpdateComplete

After amplify push following activities happened

- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySpr-194XT2JU1AKYC AWS::CloudFormation::Stack Sat Jun 15 2019
19:40:44 GMT+0530 (India Standard Time) User Initiated
UPDATE_IN_PROGRESS          DeleteVarietySprResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          GetVarietySprResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          ListVarietySprResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          UpdateVarietySprResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          CreateVarietySprResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:48 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             GetVarietySprResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             CreateVarietySprResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             ListVarietySprResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019
19:41:00 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             DeleteVarietySprResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019
19:41:11 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_IN_PROGRESS                           GetMasterStageResolver                                                     AWS::AppSync::Resolver
  Sat Jun 15 2019 19:40:45 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_IN_PROGRESS                  spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterStage-1QEH3WYSKUS4R AWS::CloudFormation::Stack Sat Jun 15 2019 19:40:42 GMT+0530 (India Standard Time) User Initiated
UPDATE_IN_PROGRESS                           DeleteMasterStageResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:40:45 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS                           CreateMasterStageResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:40:45 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS                           UpdateMasterStageResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:40:45 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS                           ListMasterStageResolver                                                    AWS::AppSync::Resolver
  Sat Jun 15 2019 19:40:45 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterStageResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:40:57 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterStageResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:07 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterStageResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetMasterStageResolver                                                     AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterStageResolver                                                    AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterStage-1QEH3WYSKUS4R AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyNote-7M3L6HT5JFZG AWS::CloudFormation::Stack Sat Jun 15 2019
19:40:43 GMT+0530 (India Standard Time) User Initiated
UPDATE_IN_PROGRESS          UpdateVarietyNoteResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          GetVarietyNoteResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          CreateVarietyNoteResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          DeleteVarietyNoteResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          ListVarietyNoteResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019
19:40:47 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             CreateVarietyNoteResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019
19:41:13 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             UpdateVarietyNoteResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019
19:41:13 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             GetVarietyNoteResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019
19:41:18 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterCompProm-198QA3U4AUO8G AWS::CloudFormation::Stack Sat Jun 15 2019 19:40:43 GMT+0530 (India Standard Time) User Initiated
UPDATE_IN_PROGRESS          GetMasterCompPromResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          ListMasterCompPromResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          DeleteMasterCompPromResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          CreateMasterCompPromResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:47 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          UpdateMasterCompPromResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:47 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             DeleteMasterCompPromResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             UpdateMasterCompPromResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             CreateMasterCompPromResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             ListMasterCompPromResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)

UPDATE_COMPLETE DeleteVarietyProfileHistoryResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:40:57 GMT+0530 (India Standard Time)
UPDATE_COMPLETE ListVarietyProfileHistoryResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
UPDATE_COMPLETE GetVarietyProfileHistoryResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE VarietyStageHistory     AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterAdpZone           AWS::CloudFormation::Stack Sat Jun 15 2019 19:40:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterSprPrdCat         AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterCategory          AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyTppAdaptHistory  AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE ParentCharacteristics   AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterGrading           AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterNoteType          AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyPromotionHistory AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterRegScope          AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyValueHistory     AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterTechSegment       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:04 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterMaintenance       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterRegStatus         AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyAttachment       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyTppAdapt         AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyNoteHistory      AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterStage             AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyRegResult        AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterMarketSegment     AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyPromotion        AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:04 GMT+0530 (India Standard Time)
UPDATE_COMPLETE varietySprHistory       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterZone              AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeletevarietySprHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:52 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListvarietySprHistoryResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdatevarietySprHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetvarietySprHistoryResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreatevarietySprHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-varietySprHistory-18O7KG7ZU6915 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE DeleteVarietyProfileResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:01 GMT+0530 (India Standard Time)
UPDATE_COMPLETE CreateVarietyProfileResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE ListVarietyProfileResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE UpdateVarietyProfileResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE ListMasterTraitResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:40:50 GMT+0530 (India Standard Time)
UPDATE_COMPLETE UpdateMasterTraitResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:40:51 GMT+0530 (India Standard Time)
UPDATE_COMPLETE CreateMasterTraitResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE GetMasterTraitResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE ListVarietyRegResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:40:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE GetVarietyRegResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE UpdateVarietyRegResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_COMPLETE CreateVarietyRegResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE GetMasterRegPurposeResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:40:52 GMT+0530 (India Standard Time)
UPDATE_COMPLETE DeleteMasterRegPurposeResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE ListMasterRegPurposeResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE CreateMasterRegPurposeResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterPromotion-XPR1F7J9KY2V AWS::CloudFormation::Stack Sat Jun 15 2019 19:40:43 GMT+0530 (India Standard Time) User Initiated
UPDATE_IN_PROGRESS          UpdateMasterPromotionResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          GetMasterPromotionResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          ListMasterPromotionResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          CreateMasterPromotionResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:46 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS          DeleteMasterPromotionResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:46 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             ListMasterPromotionResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             DeleteMasterPromotionResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:05 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             GetMasterPromotionResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:20 GMT+0530 (India Standard Time)
UPDATE_COMPLETE             CreateMasterPromotionResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:21 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE DeleteVarietyNoteResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:22 GMT+0530 (India Standard Time)
UPDATE_COMPLETE ListVarietyNoteResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:24 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE MasterLocation AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:18 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateVarietyProfileHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:24 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateVarietyProfileHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:26 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyProfileHistory-18LNLYLX3VS2H AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:27 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetVarietyProfileResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyProfile-1WFEO2XN8N8G3 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateVarietySprResolver                                                  AWS::AppSync::Resolver
 Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySpr-194XT2JU1AKYC AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE GetVarietySprLineHistoryResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:41:05 GMT+0530 (India Standard Time)
UPDATE_COMPLETE CreateVarietySprLineHistoryResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_COMPLETE ListVarietySprLineHistoryResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE ListVarietyPromLineResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:08 GMT+0530 (India Standard Time)
UPDATE_COMPLETE GetVarietyPromLineResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE UpdateVarietyPromLineResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE ListVarietyMainResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:02 GMT+0530 (India Standard Time)
UPDATE_COMPLETE GetVarietyMainResolver    AWS::AppSync::Resolver Sat Jun 15 2019 19:41:05 GMT+0530 (India Standard Time)
UPDATE_COMPLETE DeleteVarietyMainResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateSpadAttachmentResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:08 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetSpadAttachmentResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateSpadAttachmentResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-SpadAttachment-1F30VIWEWC07O AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:20 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateVarietyPromLineHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyPromLineHistoryResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteVarietyPromLineHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietyPromLineHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:24 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromLineHistory-1BM5N4SMZSV74 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterVarietyValueTypeResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:04 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterVarietyValueTypeResolver                                               AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterVarietyValueTypeResolver                                               AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:23 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterVarietyValueType-ASV7GOZCX4 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:23 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE ListVarietyAttachmentHistoryResolver   AWS::AppSync::Resolver Sat Jun 15 2019 19:41:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE CreateVarietyAttachmentHistoryResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
UPDATE_COMPLETE UpdateVarietyAttachmentHistoryResolver AWS::AppSync::Resolver Sat Jun 15 2019 19:41:22 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateMasterMaturityGroupResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetMasterMaturityGroupResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:08 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterMaturityGroupResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterMaturityGroupResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:24 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterMaturityGroup-1MUAXO29VIDG0 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:24 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateVarietyValueResolver                                                  AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:05 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyValueResolver                                                     AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteVarietyValueResolver                                                  AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:28 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyValue-1XCEV2LKOBSJV AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:29 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterLocationResolver                                                    AWS::AppSync::Resolver
    Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterLocationResolver                                                 AWS::AppSync::Resolver
    Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterLocation-YSWEDXC3GR7D AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListUserMainResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-UserMain-1OTDY3NJYNI7 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterParentTypeResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterParentTypeResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterParentTypeResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterParentTypeResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterParentTypeResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:21 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterParentType-TDFB8C1K5JH0 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:21 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListVarietyAdaptSubResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietyAdaptSubResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyAdaptSubResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyAdaptSub-1MJ5N77Q2PJ0M AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteMasterAttachTypeResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterAttachType-6V4S1KPHVB2C AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:18 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateMasterTppResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:20 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterTpp-C3TLSYPL7TJ5 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:21 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetVarietyStageResolver                                                    AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteVarietyStageResolver                                                 AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:29 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyStage-ZQVFQPB3VTQ5 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListVarietyCompHistoryResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyCompHistoryResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:27 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyCompHistory-8XXIQK21TUU9 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:28 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetVarietyCompResolver                                                    AWS::AppSync::Resolver
 Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyComp-4QSSE80W5G9G AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:20 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateMasterReportResolver                                                  AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetMasterReportResolver                                                     AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:19 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterReportResolver                                                    AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:24 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterReport-1KMM7974C4FWI AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyNote-7M3L6HT5JFZG AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)

UPDATE_COMPLETE                              UpdateMasterPromotionResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:29 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterPromotion-XPR1F7J9KY2V AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterCompPromResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterCompProm-198QA3U4AUO8G AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:32 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE MasterRegPurpose       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyComp            AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:29 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterVarietyValueType AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterPromotion        AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyPromLineHistory AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyStage           AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyCompHistory     AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyValue           AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyProfileHistory  AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterTrait            AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterParentType       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyProfile         AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietySprLine         AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterReport           AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterMaturityGroup    AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterAttachType       AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterTpp              AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE SpadAttachment         AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyAdaptSub        AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyNote            AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:31 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietySpr             AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:32 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateMasterRegPurposeResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterRegPurpose-1XYPEU556F0OM AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:26 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteVarietySprLineResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietySprLineResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySprLine-1TRA2OI146AA1 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListMasterZoneResolver                                                    AWS::AppSync::Resolver
 Sat Jun 15 2019 19:41:00 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterZoneResolver                                                  AWS::AppSync::Resolver
 Sat Jun 15 2019 19:41:00 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterZoneResolver                                                  AWS::AppSync::Resolver
 Sat Jun 15 2019 19:41:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterZoneResolver                                                  AWS::AppSync::Resolver
 Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterZone-1S1V2TV10Y3UH AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)

UPDATE_COMPLETE                              DeleteMasterTraitResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:25 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterTrait-1UXJY1VY29N0T AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:26 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteVarietyRegResolver                                                 AWS::AppSync::Resolver
Sat Jun 15 2019 19:41:43 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyReg-EO47IHC2Y3TQ AWS::CloudFormation::Stack
Sat Jun 15 2019 19:41:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE VarietyAttachmentHistory AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:44 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietySprLineHistory    AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:44 GMT+0530 (India Standard Time)
UPDATE_COMPLETE UserMain                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:44 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyReg               AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:45 GMT+0530 (India Standard Time)
UPDATE_COMPLETE VarietyPromLine          AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:45 GMT+0530 (India Standard Time)
UPDATE_COMPLETE MasterCompProm           AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:46 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteVarietySprLineHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:30 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietySprLineHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:39 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySprLineHistory-1SR74JQSOASZU AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:40 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteVarietyPromLineResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:34 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromLine-1RWYNPUUVDHD5 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:34 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateVarietyMainResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:38 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietyMainResolver                                                  AWS::AppSync::Resolver
  Sat Jun 15 2019 19:41:47 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyMain-1HM3KZKJWOJWL AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:48 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteVarietyAttachmentHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:40 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyAttachmentHistory-1EVVILBK9IY5D AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:41 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE VarietyMain AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:01 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateVarietyTppAdaptResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyTppAdapt-A01WD6YWIFTV AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_IN_PROGRESS SearchableStack AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE    ConnectionStack AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:03 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterMarketSegmentResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterMarketSegment-1558YHMOK8CCN AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-SearchableStack-IZWY4C23TY9T AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:13 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              SearchableStack                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:15 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:17 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE apispadApp AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:24 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:25 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS                           apispadApp              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:26 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_IN_PROGRESS SearchableStack AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:28 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS ConnectionStack AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:28 GMT+0530 (India Standard Time)
UPDATE_COMPLETE    ConnectionStack AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:29 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetVarietyRegResultResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyRegResult-KXYQ5P3IBSA2 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-SearchableStack-IZWY4C23TY9T AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:30 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE    SearchableStack  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:39 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterParentType AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterParentType-TDFB8C1K5JH0 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)

UPDATE_COMPLETE                              CreateMasterSprPrdCatResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:58 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterSprPrdCatResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:59 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetMasterSprPrdCatResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:01 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterSprPrdCatResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:02 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterSprPrdCatResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterSprPrdCat-GING9VKUGDOD AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterSprPrdCat-GING9VKUGDOD AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyAdaptSub-1MJ5N77Q2PJ0M AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_IN_PROGRESS VarietyPromLineHistory   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterRegScope           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterAdpZone            AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterReport             AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyCompHistory       AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterRegPurpose         AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterSprPrdCat          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyRegResult         AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyPromLine          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterMaintenance        AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyValue             AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyTppAdaptHistory   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterNoteType           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS ParentCharacteristics    AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyValueHistory      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyAttachmentHistory AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterCompProm           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyReg               AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyPromotionHistory  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterVarietyValueType   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyComp              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyProfile           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyAttachment        AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterTechSegment        AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterPromotion          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterMaturityGroup      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterTpp                AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyNoteHistory       AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS varietySprHistory        AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyAdaptSub          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS UserMain                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterLocation           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietySpr               AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterGrading            AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterAttachType         AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyStage             AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyTppAdapt          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterTrait              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterMarketSegment      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterStage              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterCategory           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS SpadAttachment           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyPromotion         AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyStageHistory      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterZone               AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietySprLineHistory    AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyMain              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyNote              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS MasterRegStatus          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:42 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietySprLine           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS VarietyProfileHistory    AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterTpp-C3TLSYPL7TJ5 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterReport-1KMM7974C4FWI AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterRegPurpose-1XYPEU556F0OM AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyProfileHistory-18LNLYLX3VS2H AWS::CloudFormation::Stack Sat Jun
15 2019 19:42:45 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyCompHistory-8XXIQK21TUU9 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromLine-1RWYNPUUVDHD5 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyRegResult-KXYQ5P3IBSA2 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterMaintenanceResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterMaintenance-1WENEGWNHX6RW AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterMaintenance-1WENEGWNHX6RW AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyValue-1XCEV2LKOBSJV AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateMasterNoteTypeResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:57 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetMasterNoteTypeResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:57 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterNoteTypeResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:59 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterNoteTypeResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:05 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterNoteTypeResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterNoteType-10VCLN5VEV05J AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterNoteType-10VCLN5VEV05J AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterCompProm-198QA3U4AUO8G AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListVarietyTppAdaptHistoryResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:03 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateVarietyTppAdaptHistoryResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:04 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyTppAdaptHistoryResolver                                                     AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyTppAdaptHistory-1XJYOD6PX0EEA AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyTppAdaptHistory-1XJYOD6PX0EEA AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetParentCharacteristicsResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:05 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateParentCharacteristicsResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:07 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-ParentCharacteristics-QN6GOJUOL52D AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:08 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-ParentCharacteristics-QN6GOJUOL52D AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyAttachmentHistory-1EVVILBK9IY5D AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyReg-EO47IHC2Y3TQ AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterVarietyValueType-ASV7GOZCX4 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyAttachment-15T4VI9NPPCWF AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListVarietyPromotionHistoryResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:00 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateVarietyPromotionHistoryResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietyPromotionHistoryResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteVarietyPromotionHistoryResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:15 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyPromotionHistoryResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:16 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromotionHistory-KMQVMTYAQTC7 AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:17 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromotionHistory-KMQVMTYAQTC7 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyComp-4QSSE80W5G9G AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyProfile-1WFEO2XN8N8G3 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterTechSegment-KY15YUVDPA24 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromLineHistory-1BM5N4SMZSV74 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterPromotion-XPR1F7J9KY2V AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              ListVarietyNoteHistoryResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:08 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietyNoteHistoryResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyNoteHistory-OJ4R4BPOKI0H AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:10 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyNoteHistory-OJ4R4BPOKI0H AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterAdpZone-1GZXZR6CE1939 AWS::CloudFormation::Stack Sat Jun 15 2019
19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE          apispadApp              AWS::CloudFormation::Stack Sat Jun 15 2019 19:43:01 GMT+0530 (India Standard Time)
UPDATE_IN_PROGRESS       authcognito5435110d     AWS::CloudFormation::Stack Sat Jun 15 2019 19:43:02 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          authcognito5435110d     AWS::CloudFormation::Stack Sat Jun 15 2019 19:43:03 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745 AWS::CloudFormation::Stack Sat Jun 15 2019 19:43:03 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-varietySprHistory-18O7KG7ZU6915 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterLocation-YSWEDXC3GR7D AWS::CloudFormation::Stack Sat Jun 15 2019
19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySpr-194XT2JU1AKYC AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-UserMain-1OTDY3NJYNI7 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterAttachType-6V4S1KPHVB2C AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyStage-ZQVFQPB3VTQ5 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterTrait-1UXJY1VY29N0T AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              GetMasterGradingResolver                                                    AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:00 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              DeleteMasterGradingResolver                                                 AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:06 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterGradingResolver                                                   AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:09 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterGradingResolver                                                 AWS::AppSync::Resolver
   Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterGrading-JGGCUN0RP7SM AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterGrading-JGGCUN0RP7SM AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterMarketSegment-1558YHMOK8CCN AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyTppAdapt-A01WD6YWIFTV AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterStage-1QEH3WYSKUS4R AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-SpadAttachment-1F30VIWEWC07O AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              UpdateMasterCategoryResolver                                                 AWS::AppSync::Resolver
    Sat Jun 15 2019 19:41:02 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListMasterCategoryResolver                                                   AWS::AppSync::Resolver
    Sat Jun 15 2019 19:41:04 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterCategoryResolver                                                 AWS::AppSync::Resolver
    Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterCategory-5PDDMDVTREBD AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterCategory-5PDDMDVTREBD AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyPromotion-1IHJZJZWPX69G AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterZone-1S1V2TV10Y3UH AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySprLineHistory-1SR74JQSOASZU AWS::CloudFormation::Stack Sat Jun
15 2019 19:42:43 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyMain-1HM3KZKJWOJWL AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
- Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              CreateVarietyStageHistoryResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:57 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              ListVarietyStageHistoryResolver                                                   AWS::AppSync::Resolver     Sat Jun 15 2019 19:40:59 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateVarietyStageHistoryResolver                                                 AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:11 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              GetVarietyStageHistoryResolver                                                    AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:12 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyStageHistory-R1LU6OD8767G AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyStageHistory-R1LU6OD8767G AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterMaturityGroup-1MUAXO29VIDG0 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
| Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietyNote-7M3L6HT5JFZG AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:43 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-VarietySprLine-1TRA2OI146AA1 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
\ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE                              DeleteMasterRegStatusResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:04 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              CreateMasterRegStatusResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_COMPLETE                              UpdateMasterRegStatusResolver                                                  AWS::AppSync::Resolver     Sat Jun 15 2019 19:41:13 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE_CLEANUP_IN_PROGRESS spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterRegStatus-17NBZK983BAYU AWS::CloudFormation::Stack Sat Jun 15 2019 19:41:14 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE                     spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM-MasterRegStatus-17NBZK983BAYU AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:44 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...

UPDATE_COMPLETE          MasterStage                                      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterCategory                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyComp                                      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyValueHistory                              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterRegPurpose                                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyValue                                     AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyRegResult                                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterReport                                     AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyCompHistory                               AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyAttachmentHistory                         AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterSprPrdCat                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyPromotionHistory                          AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterTpp                                        AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyAdaptSub                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyProfile                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterNoteType                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterCompProm                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          ParentCharacteristics                            AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterVarietyValueType                           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyAttachment                                AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyNoteHistory                               AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyPromLine                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyTppAdaptHistory                           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterAdpZone                                    AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterMaintenance                                AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterZone                                       AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyMain                                      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietySprLine                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterTechSegment                                AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          SpadAttachment                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyReg                                       AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyStage                                     AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterLocation                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          varietySprHistory                                AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyTppAdapt                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterPromotion                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterRegStatus                                  AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterMarketSegment                              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyPromotion                                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          UserMain                                         AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyPromLineHistory                           AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterParentType                                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterMaturityGroup                              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterAttachType                                 AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyStageHistory                              AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietySprLineHistory                            AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterGrading                                    AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterTrait                                      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyNote                                      AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          MasterRegScope                                   AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietySpr                                       AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:53 GMT+0530 (India Standard Time)
UPDATE_COMPLETE          VarietyProfileHistory                            AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:54 GMT+0530 (India Standard Time)
UPDATE_ROLLBACK_COMPLETE spad-app-20190517170745-apispadApp-1PZDC8K4RJDFM AWS::CloudFormation::Stack Sat Jun 15 2019 19:42:55 GMT+0530 (India Standard Time)
/ Updating resources in the cloud. This may take a few minutes...Error updating cloudformation stack
/ Updating resources in the cloud. This may take a few minutes...

Following resources failed

× An error occurred when pushing the resources to the cloud

Resource is not in the state stackUpdateComplete

Could you please provide a solution for this ASAP

houmark commented 5 years ago

This really needs a solution or better documentation on how to manually work around these types of issues.

I've hit this now twice in a few days and it got me stuck for hours. A simple change becomes a major headache and you just get into this slow death spiral where you feel like deleting the entire project. It takes 10-25 minutes for every attempt you make to do fail and then the rollback.

If it's not simple to solve this in an automated way, then the CLI should either warn (for example when compiling the schema, it could warn and wait for confirmation if a named connection is changed, it's a simple line diff?). And if it fails, more debug information could be provided to know where to go and try a manual fix.

The platform I am working on is not live yet (it will be in a week) and I dread that this will happen once it's live, without really knowing what to do and not having the option to delete. Doing amplify delete api is not that simple anymore as I believe it will stop when it detects that other resources depend on it (which is a good thing) and once you re-create it the dynamic name is changed, which may affect code in the project.

undefobj commented 5 years ago

@houmark we are investigating ways to solve this in an orchestrated manner, as noted earlier this is due to a way that DynamoDB manages GSIs. However your suggestion of "warning" is an area we've decided to look into in the short term and had a couple of design sessions on it last week. @kaustavghosh06 and @mikeparisstuff are looking at the best way to inform you if you're making a change that might cause this issue while we look further into a longer term implementation that could handle this automatically behind the scenes.

houmark commented 5 years ago

@undefobj thanks for your feedback on this. It's nice to know that it's on your radar. Having now worked on a platform for a few weeks in Amplify, this has been my single most concerning experience, and something that makes me doubt if this is a platform I want to commit to. For this project, I am too far in, and I have to stick around, but it really worries me that cloud resources can get to such a corrupted state, by simply changing a field name or tweaking a connection name. At this point, I am not even sure what was the original reason for all my problems.

This is really really bad. I now spent the entire day trying everything and the one thing that I don't get is the resolvers, where they are to start with, in order to change/tweak them.

Even though I am in dev mode and even though I had already pushed a simple schema that deleted my entire dev database, I was still not able to get back to a normal functioning state. So I gave up and decided to delete the entire api, which was a long process in itself, as I had to remove dependencies for all other resources to the api. Since I have a @searchable on one type, the creation is slow. But I should never have to get to here.

So my suggestion is:

1) Short term: You come up with some kind of improved parser that already before the push will warn and be fairly detailed in the warning, so the developer can reconsider this or manually do changes in the cloud before doing the push, in order to prevent things from going into this state where you feel like you completely lost control.

2) Long term: Fix the cloud, so it's more intelligent about these changes. It seems to me that some race situations are happening and maybe some resolvers are not correctly removed, leaving them hanging around and preventing new ones from being attached.

There's no way in my knowledge to list all resolvers, so even though the terminal is telling me that xyzrsolvername is giving problems, I am yet to find a way to go to the UI, find the resolver and delete it. I tried to manually add the field back on the schema, but it did not show up.

I understand that this is complicated and a fully automated solution may be very hard to accomplish, so while I'm sure that is eventually possible, better client-side "validations" and warnings and better documentation on how to manually attempt resolving this is what one could expect on a platform Amazon believes is ready for production projects.

Stefano1990 commented 5 years ago

So the last official update on this was on the 21. May? It is now the 5. July and this is still completely broken? If you ever try to push a wrongly named field or connection your entire API is f**ked and there is no way of fixing it?

kaustavghosh06 commented 5 years ago

We've been actively looking into this issue and will have a short term solution out for it in 1-2 weeks. As @houmark mentioned in his "Short term" solution section, we'll be adding a sanity check parser to check if any changes to your schema (basically a diff between whatever is deployed to the cloud and the changes in your local schema) would cause a cloudformation push error and fail fast - before the cloudformation push. This check would clearly mention why the sanity check failed and what should be your path forward from there. Here are the cases we've identified for the sanity check so far:

You cannot change an existing GSI for a DynamoDB Table
You cannot add and remove a GSI on a DynamoDB table at the same time
Protect against the duplicate resolvers
You cannot add more than one GSI at a time

Please let us know if we've missed any other use-cases/scenarios.

houmark commented 5 years ago

Add to list:

You cannot add more than one GSI at a time (at least that seems to have been what I was fighting with a lot)

kaustavghosh06 commented 5 years ago

@houmark Updated my comment. Thank you.

mikeparisstuff commented 5 years ago

Update: We are adding tooling that will fail prior to the push when you try to push a migration that is known to fail. E.G. changing a GSI, adding and removing a GSI at the same time, changing a key schema, adding LSIs after table creation, etc. We are also adding a suite of tests that cover these migration scenarios that will prevent these issues moving forward. You may track the progress here if interested https://github.com/aws-amplify/amplify-cli/pull/1815.

nagey commented 5 years ago

Doesn't this also mean that any table with >1 GSI keeps you from being able to create a new environment with multienv?

nino-moreton commented 5 years ago

Doesn't this also mean that any table with >1 GSI keeps you from being able to create a new environment with multienv?

This only happens when updating a resource. When you create a new environment, it creates new resources for those.

kaustavghosh06 commented 5 years ago

Hi everyone, wanted to update on this issue. We got the sanity check/validations working as mentioned out here - https://github.com/aws-amplify/amplify-cli/issues/922#issuecomment-509418653 and we merged the PR for it (#1815). We'll be publishing a new version of the CLI (1.8.6) early next week with this change.

kaustavghosh06 commented 5 years ago

Hey guys, we published the sanity check feature out. This would basically prevent pushing of invalid schema changes by giving a reason and provide a way to go around the change.

ohsik commented 5 years ago

I'm still seeing the error message. Reason: Cannot perform more than one GSI creation or deletion in a single update Is this fixed?

lroellin commented 5 years ago

I think this should only prevent it from ever happening. If it's happened, then I think there's still no solution.

stuartz commented 4 years ago

this issue just got me with out any prior warning when pushing updates to the schema...fortunately dev. Amplify v.4.16.1

lukeramsden commented 4 years ago

Same, just got this issue. Added a few @\key's to a couple of different models and tried to push to my dev environment, got this:

UPDATE_FAILED      InformationEntryTable                      AWS::DynamoDB::Table   Mon May 11 2020 12:29:34 GMT+0100 (British Summer Time) Cannot perform more than one GSI creation or deletion in a single update

Amplify 4.18.1

Thankfully I'm not using @\searchable yet so it's not an issue to recreate the API.

@kaustavghosh06 is this a regression, or are me and the previous commenter missing something here?

carlpwilliams commented 4 years ago

My issue is, if I understand that I can only make one change using @key or @connection per update, that's fine. but then I push my feature into a production branch for feature deploy. then my amplify CI is going to try more than one change and it'll get this error.

I think this is unworkable in it's present state!

cristhian-boc commented 4 years ago

This is still failing. It failed when changing my table columns names to camelCase. This should not be closed.

edonadei commented 4 years ago

Is there any news on this issue ? Still having to recreate the whole schema each time you do a simple edit around @connection link between two entities in the graphQL schema.

I'm using Amplify CLI 4.22.0.

GeorgeBellTMH commented 4 years ago

Isn't the solution to this to this is if it happens to a table...then delete them all and then add them back one at a time...doesn't seem complicated to me...it would be nice if there was an amplify push --resetGSI that did this automatically...

houmark commented 4 years ago

Isn't the solution to this to this is if it happens to a table...then delete them all and then add them back one at a time...doesn't seem complicated to me...it would be nice if there was an amplify push --resetGSI that did this automatically...

That would lead to downtime on production where no data can be returned because it's depending on the index, while the indexes are backfilling, and for large setups backfilling can take some time, especially if you have many indexes on that table.

I am still hitting situations where the tooling does not detect the multiple GSI error before starting the push, leading to a rollback and it can be really hard to estimate how many GSI changes a fairly simple change results. In addition, it's normal to make multiple changes in dev and then push all that to production, which then results in the same error on production. This means you manually have to outcomment changes and ensure you do one GSI update per push on production which is a stupid slow process prone to errors and downtime on production.

I don't understand why the CLI can do several passes on GSI's by detecting the amount needed to be done, do one, wait for it to finish, do another and so on... then finish the entire push.

ryanhollander commented 4 years ago

@houmark FWIW: I agree with you I think the tooling should handle this. When I've hit this I edit the graphql and step the change through manually. There is no reason that could not be automated. To that end I've submitted this: https://github.com/aws-amplify/amplify-cli/issues/4885

Please add expand on this.

mkwatson commented 4 years ago

+1

CodySwannGT commented 4 years ago

Hey guys, we published the sanity check feature out. This would basically prevent pushing of invalid schema changes by giving a reason and provide a way to go around the change.

I'm on the latest version and I just got the rollback error... again.

bahroze-alphaSquad commented 3 years ago

+1. Need a alternative way as well since I cannot remove my api

github-actions[bot] commented 3 years ago

This issue has been automatically locked since there hasn't been any recent activity after it was closed. Please open a new issue for related bugs.

Looking for a help forum? We recommend joining the Amplify Community Discord server *-help channels for those types of questions.

aws-amplify / amplify-cli

Cannot perform more than one GSI creation or deletion in a single update; ConnectionStack failed to update #922