UMNLibraries experts_etl issues

UMNLibraries / experts_etl

Moves data from UMN to Pure (Experts@Minnesota), and vice versa.

3 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Project authors typo

#55 mberkowski closed 8 months ago
0
work-in-progress changes to raw json loading to improve performance

#54 nihiliad opened 1 year ago
0
Bump certifi from 2022.5.18.1 to 2022.12.7

#53 dependabot[bot] closed 1 year ago
1
Adds grad student support to the main branch.

#52 nihiliad closed 2 years ago
0
Automatically update stix table queried by pure_eligible_graduate_program when term changes.

#51 nihiliad closed 2 months ago
1
Find, and fix and/or report on, bad data excluded by the pure_eligible_graduate_program view.

#50 nihiliad opened 2 years ago
0
Add options to skip or run only some parts of the ETL process.

#49 nihiliad opened 2 years ago
0
Remove pugsql

#48 johnbarneson opened 2 years ago
0
Replaces home-grown date-parsing with dateutil. Fixes #46.

#47 nihiliad closed 2 years ago
0
Eliminate "Unkown format for datetime string" errors.

#46 nihiliad closed 2 years ago
0
Local existence

#45 nihiliad closed 2 years ago
0
If bulk loading of Pure API JSON records fails, remove the problematic record and retry.

#44 nihiliad opened 2 years ago
0
Update pure_to_edw/collection.py to use improved pure_json.document_exists().

#43 nihiliad opened 2 years ago
0
Improve local existence checks for Pure API data.

#42 nihiliad opened 2 years ago
0
Adds support for sudden & unexecpected changes to Pure API date formats.

#41 nihiliad closed 3 years ago
0
Removes now unnecessary ldap "directory suppression" lookups.

#40 nihiliad closed 3 years ago
0
Bump urllib3 from 1.25.11 to 1.26.5

#39 dependabot[bot] closed 3 years ago
0
Bump py from 1.9.0 to 1.10.0

#38 dependabot[bot] closed 3 years ago
1
Bump jinja2 from 2.11.2 to 2.11.3

#37 dependabot[bot] closed 3 years ago
1
Ldap

#36 nihiliad closed 3 years ago
1
Demog fixes

#35 nihiliad closed 3 years ago
0
Adds syncing of all Pure raw JSON.

#34 nihiliad closed 3 years ago
0
Attempts to remove internal organisations cause exceptions

#33 nihiliad closed 3 years ago
0
Uses pureapi 4.x, with multi-version support.

#32 nihiliad closed 3 years ago
0
Delete multiple, obsolete, primary jobs after generation of person data.

#31 nihiliad closed 3 years ago
0
Remove persons/jobs added due to data entry errors in OIT Data Warehouse?

#30 nihiliad opened 3 years ago
1
Adds insert/update ops for pure_sync* tables from pure_sync*scratch t…

#29 nihiliad closed 4 years ago
0
Do not run during OIT Sunday morning maintenance windows.

#28 nihiliad opened 4 years ago
0
Check for a database connection before attempting a run.

#27 nihiliad opened 4 years ago
0
Don't attempt to loop through items in Pure API Changes if there are no items.

#26 nihiliad closed 4 years ago
1
Re-use old person sync data when errors prevent generation of new data.

#25 nihiliad closed 3 years ago
1
Add handling of D (Desceased) and R (Retired) empl_status values.

#24 nihiliad closed 4 years ago
1
Remove research outputs when types have changed to be unsupported.

#23 nihiliad opened 4 years ago
0
Ensures stale change records are deleted rather than accumulate indef…

#22 nihiliad closed 4 years ago
0
Updates for Pure API 5.16.

#21 nihiliad closed 4 years ago
0
Pure record merges

#20 nihiliad closed 4 years ago
0
Increase space for logs on OIT VMs.

#19 nihiliad opened 4 years ago
0
Postdoc fellows

#18 nihiliad closed 4 years ago
0
Adds correct handling of all Pure research output states.

#17 nihiliad closed 4 years ago
0
Replaces raw dotenv load with dotenv_swtich.auto

#16 mberkowski closed 4 years ago
2
Add internet id to umn data error. Fixes #14.

#15 nihiliad closed 4 years ago
0
Add internet_id to UMN data error reporting.

#14 nihiliad closed 4 years ago
0
Renames tables use explicit _employee names

#13 mberkowski closed 4 years ago
0
Automatically remove UMN data errors whenever possible.

#12 nihiliad opened 4 years ago
1
Improve error handling.

#11 nihiliad opened 4 years ago
0
Source affiliate jobcode attrs from pure_eligible_affiliate_jobcode

#10 mberkowski closed 4 years ago
0
EXPERTS_DB_SERVICE_NAME and tnsnames.ora example

#9 mberkowski closed 4 years ago
0
Ensure that a person has no jobs when all jobs are in unknown departments.

#8 nihiliad opened 4 years ago
0
Upgrade Jinja2 to prevent security vulnerability warnings.

#7 nihiliad closed 5 years ago
0
Ensure that /swadm/var/log/experts_etl/experts_etl.log exists before attempting to instantiate the logger?

#6 nihiliad opened 5 years ago
1