Data formatting based on input type

[turnerrainer]

AS AN Architect I WANT all accepted types of input to be re-formatted into a pre-defined one SO THAT different types of input could be used in later stages of data processing

Acceptance Criteria

• [ ] Accepted input can be in format of XLSX, JSON and YAML

  CSV is out of scope due to potential of breaking the data

• [ ] A separate identification map (without GUI) is used to define which fields represent which field types

  E.g. email, user_email and userEmail are all defined as field type email

TBC

• [ ] Different regex rules can be applied on specified field types
• [ ] Different API calls can be applied on specified field types

DSL

• [ ] Provide as a Data Mapper's helper service
• [ ] Data Mapper's REST endpoint /helper/key-mapper
• [ ] Service uses file as input
• [ ] Service stores processed data in a separate file

{
  "source": "/path/to/file/to/be/processed",
  "destination": "/path/to/file/of/processed/output",
}

• [ ] Key mappings defined in a configuration file

{
  "email": ["email", "user_email", "userEmail"]
}