CEDStandards / CEDS-Data-Warehouse

Modeled for longitudinal storage and reporting of P-20W data, the Common Education Data Standards (CEDS) Data Warehouse implements star schema data warehouse normalization techniques for improved query performance.
https://github.com/CEDStandards/CEDS-Data-Warehouse
Apache License 2.0
22 stars 3 forks source link

Remove deprecated IDS Id columns from staging tables #64

Open AEMJohnnyCunningham opened 9 months ago

AEMJohnnyCunningham commented 9 months ago

This is for capturing needs not currently supported by the CEDS model. Please do not send or share actual data as examples in this issue or in attachments.

Author(s) Johnny Cunningham Authoring Organization(s) CEDS Email Address jcunningham@aemcorp.com Remove deprecated IDS Id columns from staging tables

Use Case Overview The columns are no longer used by the migration process and add confusion for anyone using those staging tables.

Pull Request Number(s) (If applicable)

Use Case Background Provide information related to why these changes/additions are needed.

Components Affected Delete everything from the list below except the components affected:

CEDS Data Warehouse (complete DW Design Overview Table)


DATA WAREHOUSE DESIGN OVERVIEW (Includes Dim, Fact, and Report tables) Remove the following columns from the defined staging tables

Assessment.AssessmentId Assessment.AssessmentAdministrationId Assessment.AssessmentSubtestId Assessment.AssessmentFormId Assessment.AssessmentPerformanceLevelId Assessment.DataCollectionId AssessmentResult.DataCollectionId CharterSchoolAuthorizer.CharterSchoolId CharterSchoolAuthorizer.CharterSchoolAuthorizingOrganizationOrganizationId CharterSchoolManagementOrganization.CharterSchoolManagementOrganizationOrganizationId CharterSchoolManagementOrganization.CharterSchoolId Discipline.PersonId Discipline.OrganizationID_LEA Discipline.OrganizationPersonRoleId_LEA Discipline.OrganizationID_School Discipline.OrganizationPersonRoleId_School Discipline.IncidentId_LEA Discipline.IncidentId_School K12Enrollment.PersonId K12Enrollment.OrganizationID_LEA K12Enrollment.OrganizationPersonRoleId_LEA K12Enrollment.OrganizationID_School K12Enrollment.OrganizationPersonRoleId_School K12Enrollment.OrganizationPersonRoleRelationshipId K12Enrollment.DataCollectionId K12PersonRace.DataCollectionId K12PersonRace.PersonId K12PersonRace.PersonDemographicRaceId K12PersonRace.OrganizationID_LEA K12PersonRace.OrganizationID_School K12PersonRace.RefRaceId K12ProgramParticipation.DataCollectionId K12ProgramParticipation.OrganizationId_LEA K12ProgramParticipation.OrganizationId_School K12ProgramParticipation.PersonId K12ProgramParticipation.ProgramOrganizationId_LEA K12ProgramParticipation.ProgramOrganizationId_School K12ProgramParticipation.OrganizationPersonRoleId_LEA K12ProgramParticipation.OrganizationPersonRoleId_School K12SchoolComprehensiveSupportIdentificationType.OrganizationId K12SchoolComprehensiveSupportIdentificationType.K12SchoolId K12StudentAddress.DataCollectionId K12StudentCourseSection.DataCollectionId K12StudentCourseSection.PersonId K12StudentCourseSection.OrganizationID_LEA K12StudentCourseSection.OrganizationPersonRoleId_LEA K12StudentCourseSection.OrganizationID_School K12StudentCourseSection.OrganizationPersonRoleId_School K12StudentCourseSection.OrganizationID_Course K12StudentCourseSection.OrganizationID_CourseSection K12StudentCourseSection.OrganizationPersonRoleId_CourseSection Migrant.PersonID Migrant.OrganizationID_LEA Migrant.OrganizationID_School Migrant.LEAOrganizationPersonRoleID_MigrantProgram Migrant.LEAOrganizationID_MigrantProgram Migrant.SchoolOrganizationPersonRoleID_MigrantProgram Migrant.SchoolOrganizationID_MigrantProgram Migrant.PersonProgramParticipationId Migrant.ProgramParticipationMigrantId OrganizationAddress.RefStateId OrganizationAddress.OrganizationId OrganizationAddress.LocationId OrganizationCalendarSession.DataCollectionId OrganizationCalendarSession.OrganizationId OrganizationCalendarSession.OrganizationCalendarId OrganizationCalendarSession.OrganizationCalendarSessionId OrganizationCustomSchoolIndicatorStatusType.DataCollectionId OrganizationFederalFunding.DataCollectionId OrganizationGradeOffered.DataCollectionId OrganizationGradeOffered.OrganizationId OrganizationGradeOffered.K12SchoolGradeOfferedId OrganizationPhone.OrganizationId OrganizationPhone.LEA_OrganizationTelephoneId OrganizationPhone.School_OrganizationTelephoneId OrganizationProgramType.DataCollectionId OrganizationProgramType.OrganizationId OrganizationProgramType.ProgramOrganizationId OrganizationProgramType.ProgramTypeId OrganizationProgramType.OrganizationProgramTypeId PersonStatus.DataCollectionId ProgramParticipationCTE.DataCollectionID ProgramParticipationCTE.PersonID ProgramParticipationCTE.OrganizationID_School ProgramParticipationCTE.OrganizationPersonRoleID_School ProgramParticipationCTE.OrganizationPersonRoleID_CTEProgram ProgramParticipationCTE.OrganizationID_CTEProgram ProgramParticipationCTE.PersonProgramParticipationId ProgramParticipationNorD.DataCollectionID ProgramParticipationNorD.PersonID ProgramParticipationNorD.OrganizationID_School ProgramParticipationNorD.OrganizationID_LEA ProgramParticipationNorD.LEAOrganizationID_Program ProgramParticipationNorD.SchoolOrganizationID_Program ProgramParticipationNorD.LEAOrganizationPersonRoleId_Program ProgramParticipationNorD.SchoolOrganizationPersonRoleId_Program ProgramParticipationNorD.PersonProgramParticipationID ProgramParticipationSpecialEducation.DataCollectionID ProgramParticipationSpecialEducation.PersonID ProgramParticipationSpecialEducation.OrganizationID_School ProgramParticipationSpecialEducation.OrganizationID_LEA ProgramParticipationSpecialEducation.LEAOrganizationID_Program ProgramParticipationSpecialEducation.SchoolOrganizationID_Program ProgramParticipationSpecialEducation.LEAOrganizationPersonRoleId_Program ProgramParticipationSpecialEducation.SchoolOrganizationPersonRoleId_Program ProgramParticipationSpecialEducation.PersonProgramParticipationID_LEA ProgramParticipationSpecialEducation.PersonProgramParticipationID_School ProgramParticipationTitleI.DataCollectionID ProgramParticipationTitleI.PersonID ProgramParticipationTitleI.OrganizationID_LEA ProgramParticipationTitleI.OrganizationID_School ProgramParticipationTitleI.LEAOrganizationPersonRoleID_TitleIProgram ProgramParticipationTitleI.LEAOrganizationID_TitleIProgram ProgramParticipationTitleI.LEAPersonProgramParticipationId ProgramParticipationTitleI.SchoolOrganizationID_TitleIProgram ProgramParticipationTitleI.SchoolOrganizationPersonRoleID_TitleIProgram ProgramParticipationTitleI.SchoolPersonProgramParticipationId ProgramParticipationTitleI.RefTitleIIndicatorId ProgramParticipationTitleIII.DataCollectionID ProgramParticipationTitleIII.PersonID ProgramParticipationTitleIII.OrganizationID_School ProgramParticipationTitleIII.OrganizationPersonRoleID_TitleIIIProgram ProgramParticipationTitleIII.OrganizationID_TitleIIIProgram ProgramParticipationTitleIII.PersonProgramParticipationId ProgramParticipationTitleIII.ImmigrationPersonStatusId PsInstitution.OrganizationId PsInstitution.OrganizationOperationalStatusId PsInstitution.OperationalStatusId PsInstitution.MostPrevalentLevelOfInstitutionId PsInstitution.PredominantCalendarSystemId PsPersonRace.PersonId PsPersonRace.PersonDemographicRaceId PsPersonRace.OrganizationId PsPersonRace.RefRaceId PsPersonRace.RefAcademicTermDesignatorId PsStudentAcademicAward.OrganizationId PsStudentAcademicAward.PersonId PsStudentAcademicAward.OrganizationPersonRoleId PsStudentAcademicAward.PsStudentAcademicAwardId PsStudentAcademicRecord.DataCollectionID PsStudentAcademicRecord.PersonId PsStudentAcademicRecord.OrganizationId PsStudentAcademicRecord.OrganizationPersonRoleId PsStudentAcademicRecord.PsStudentAcademicRecordId PsStudentEnrollment.DataCollectionId PsStudentEnrollment.PersonId PsStudentEnrollment.OrganizationPersonRoleId PsStudentEnrollment.OrganizationId_PsInstitution StateDetail.DataCollectionId StateDetail.PersonId StateDetail.OrganizationId