cityofaustin / atd-data-tech

Austin Transportation Data & Technology Services
17 stars 2 forks source link

HR BANNER automation is having a weird bug, switched a lot of accounts to "Inactive" #14383

Closed dianamartin closed 10 months ago

dianamartin commented 10 months ago

Kirk S. SMO

Possibly related to #14379

Kirk messaged me 10/24

is the Knack HR Protal for PRs system down? I hit "sign in" and it loops me back to the sign in. Boni tested on his computer and it did the same thing. Thanks,

I said

Oh.. there might be a bug I'm seeing. You guys are all "inactive". Let me get with HR

dianamartin commented 10 months ago

10/24

fyi @ChristinaTremel

When Kirk brought it to my attention, I looked him up in the system and also noticed his direct reports who are still "active" employees were also listed at "inactive".

I messaged Hannah

Hey, new situation

I happened to look Kirk up and it looks like his down line and him are all "inactive". This might be the same thing with Alex's account

  • I'm having Chia look into this, we did a mini deep dive and it looks like something happened at around 8 am and she's looking for any errors in the automation

I synced with Chia and she's looking into it.

Re-messaged Hannah, Chia, and Christina

Hi Hannah, As I was mentioning Chia is looking into it, we did discover some weirdness and about ~400 records were affected. Hang tight while we figure this out.

dianamartin commented 10 months ago

10/24

Found out from Jennifer W.

I've heard that HRD is making department number changes in Banner today. I am positive the Knack issues are tied to this. This is causing a ton of issues on multiple platforms.

and we're sending this out to the department:

The Human Resources Knack application is experience and issue with accounts, there for not allowing users to log in. The Data and Technology Services team is aware of the issue, and we are actively working to resolve it.

We’ll send updates once the issue is resolved. We are sorry for the inconvenience.

dianamartin commented 10 months ago

10/26

Users asking about HR Application access

Coordination with HR

We asked Jennifer

Jennifer if we just make everyone active then we do not need to extend the close out deadline, Are you good with that?

Jennifer replied

WE cant extend the city wide deadline so le'ts make them active

  • [x] Batch update all "Inactive" users to "Active" 720 image

Messaged Jennifer, Hannah, Christina

I have made the 720 inactive accounts "Active" and I was going to sent a department wide message: Re: Human Resources (HR) Knack Application - outage

All, The Human Resources Knack application continues to experience its issue with accounts automation, we’ve escalated to the HRD IT team to assist with resolving the issue. We’ve consulted with TPW Human Resources and decided to take a temporary action.

We are making all user accounts in the system “Active” so that folks can continue to do their SSPR tasks. Users that could not log in, should be able to log in now. Please do not be alarmed if you see separated employees on your SSPR lists, that is the side effect of this temporary action.

The Data and Technology Services division will continue to send updates once the issue is permanently resolved. We are sorry for the inconvenience.

dianamartin commented 10 months ago

10/26

Raul emailed

What is the name of the webservice?

I replied with the webservice information

Raul emailed

62E added to service (no need to change anything). Just Please clear your cache and try again. Let me know if that works for you.

Chia confirmed in slack

I can run the ETL again. ETL came back with all success, it had to update a lot of people as inactive. sorry John, you're back to inactive.

I replied

Thanks Raul, we’ve confirmed that we can run the ETL again.

TPW Outage Resolution email

I emailed Gilda to send this out since Scott was gone by this point of the day.

All, The Human Resources Knack application issue with accounts automation has been resolved. Let us know if you experience any further issues.