Add option to DataLakeCatalog/DataCatalogDatabase that crawlers use manually defined table

[karnik]

DataLakeCatalog/DataCatalogDatabase should have the option of manually setting the tables for the crawler as parameters. There are several use cases that require a manually created catalog table.

• You want to choose the catalog table name manually and not rely on the catalog table naming algorithm
• Reuse the table later in the stack (e.g., in a lambda to query the table)

See: https://docs.aws.amazon.com/glue/latest/dg/tables-described.html#update-manual-tables

[vgkowski]

Good point! My suggestion is we add a crawler mode parameter with 3 different values:

• Can create tables, update schemas and add partitions
• Can only update schemas and add partitions
• Can only add partitions What do you think?

[karnik]

Sounds great. How do you want to pass the table definition?

[vgkowski]

Do you want to be able to filter tables by S3 prefix?