SchemaCrawler not showing tables on Amazon RDS, only views.

[oskar-j]

Hi,

I have a problem with using your tool with an instance of MySQL 5.6 running on Amazon RDS. It only shows views from some other database, while there are also tables on the django database in which I'm primarily interested.

This is how I lunch the SchemaCrawler on windows:

C:\tools\schemacrawler-14.05.01-main\_schemacrawler>schemacrawler.cmd -server=mysql -host="xxxxx.xxxxxxxxx.eu-west-1.rds.amazonaws.com" 
-port=3306 -database=django 
-user=xxxxx -password=xxXXXXxxxXX 
-c=list -infolevel=standard -loglevel=INFO

It results with:

(sorry for lack of formatting, it's lunched from a windows command prompt)

lis 27, 2015 1:19:58 AM us.fatehi.commandlineparser.CommandLineUtility logSafeAr
guments
INFO: SchemaCrawler, v14.05.01
lis 27, 2015 1:19:58 AM us.fatehi.commandlineparser.CommandLineUtility logSafeAr
guments
INFO: Command line:
-server=mysql
-host=xxxxx.xxXXXxxx.eu-west-1.rds.amazonaws.com
-port=3306
-database=django
-user=xxxx
-password=*****
-c=list
-infolevel=standard
-loglevel=INFO
lis 27, 2015 1:19:58 AM schemacrawler.tools.commandline.SchemaCrawlerCommandLine
 <init>
INFO: Using database plugin, mysql - MySQL
lis 27, 2015 1:19:59 AM schemacrawler.tools.commandline.SchemaCrawlerOptionsPars
er getOptions
WARNING: Please provide a -schemas option for efficient retrieval of database me
tadata
lis 27, 2015 1:19:59 AM schemacrawler.schemacrawler.BaseDatabaseConnectionOption
s getConnection
INFO: Making connection to jdbc:mysql://xxxxx.xxXXXxxx.eu-west-1.rds.amazo
naws.com:3306/django?logger=Jdk14Logger&dumpQueriesOnException=true&dumpMetadata
OnColumnNotFound=true&profileSQL=true&maxQuerySizeToLog=4096
for user 'xxxx', with properties {}
lis 27, 2015 1:19:59 AM schemacrawler.schemacrawler.BaseDatabaseConnectionOption
s getConnection
INFO: Opened database connection, org.mariadb.jdbc.MySQLConnection@60215eee
lis 27, 2015 1:19:59 AM schemacrawler.schemacrawler.BaseDatabaseConnectionOption
s logConnection
INFO: Connected to
MySQL 5.6.23-log
using JDBC driver
MariaDB connector/J 1.2.3
lis 27, 2015 1:19:59 AM schemacrawler.tools.executable.BaseStagedExecutable exec
ute
INFO: Executing SchemaCrawler command, "list"
lis 27, 2015 1:19:59 AM schemacrawler.crawl.SchemaCrawler crawlSchemas
INFO: Crawling schemas
lis 27, 2015 1:19:59 AM schemacrawler.crawl.SchemaRetriever retrieveAllSchemas
INFO: Retrieving all schemas
lis 27, 2015 1:19:59 AM schemacrawler.crawl.SchemaRetriever retrieveAllCatalogs
INFO: Retrieving all catalogs
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlSchemas
INFO: Total time taken for "crawlSchemas" - 00:00:00.055 hours
-  0,0% - 00:00:00.054 - "retrieveSchemas"
-  0,0% - 00:00:00.001 - "sortAndFilterSchemas"

lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlDatabaseInfo
INFO: Crawling SchemaCrawler information
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlDatabaseInfo
INFO: Retrieving database information
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler lambda$crawlDatabaseIn
fo$3
INFO: Not retrieving additional database information, since this was not request
ed
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlDatabaseInfo
INFO: Retrieving JDBC driver information
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler lambda$crawlDatabaseIn
fo$5
INFO: Not retrieving additional JDBC driver information, since this was not requ
ested
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlDatabaseInfo
INFO: Retrieving SchemaCrawler crawl information
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlDatabaseInfo
INFO: Total time taken for "crawlDatabaseInfo" - 00:00:00.018 hours
-  0,0% - 00:00:00.000 - "retrieveDatabaseInfo"
-  0,0% - 00:00:00.002 - "retrieveAdditionalDatabaseInfo"
-  0,0% - 00:00:00.001 - "retrieveJdbcDriverInfo"
-  0,0% - 00:00:00.002 - "retrieveAdditionalJdbcDriverInfo"
-  0,0% - 00:00:00.013 - "retrieveCrawlHeaderInfo"

lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlColumnDataTypes
INFO: Crawling column data types
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler lambda$crawlColumnData
Types$0
INFO: Retrieving system column data types
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler lambda$crawlColumnData
Types$1
INFO: Not retrieving user column data types, since this was not requested
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlColumnDataTypes
INFO: Total time taken for "crawlColumnDataTypes" - 00:00:00.031 hours
-  0,0% - 00:00:00.029 - "retrieveSystemColumnDataTypes"
-  0,0% - 00:00:00.002 - "retrieveUserDefinedColumnDataTypes"

lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlTables
INFO: Crawling tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableRetriever retrieveTables
INFO: Retrieving tables
lis 27, 2015 1:20:00 AM schemacrawler.crawl.TableColumnRetriever retrieveColumns

INFO: Retrieving table columns
lis 27, 2015 1:20:00 AM schemacrawler.crawl.ForeignKeyRetriever retrieveForeignK
eys
INFO: Retrieving foreign keys, using database metadata
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler lambda$crawlTables$21
INFO: Retrieving primary keys and indexes
lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlTables
INFO: Total time taken for "crawlTables" - 00:00:00.674 hours
-  0,0% - 00:00:00.492 - "retrieveTables"
-  0,0% - 00:00:00.172 - "retrieveColumns"
-  0,0% - 00:00:00.002 - "retrieveForeignKeys"
-  0,0% - 00:00:00.007 - "sortAndFilterTables"
-  0,0% - 00:00:00.001 - "retrieveIndexes"
-  0,0% - 00:00:00.000 - "retrieveTableConstraintInformation"
-  0,0% - 00:00:00.000 - "retrieveTriggerInformation"
-  0,0% - 00:00:00.000 - "retrieveViewInformation"
-  0,0% - 00:00:00.000 - "retrieveTableDefinitions"
-  0,0% - 00:00:00.000 - "retrieveIndexInformation"
-  0,0% - 00:00:00.000 - "retrieveAdditionalTableAttributes"
-  0,0% - 00:00:00.000 - "retrieveTablePrivileges"
-  0,0% - 00:00:00.000 - "retrieveAdditionalColumnAttributes"
-  0,0% - 00:00:00.000 - "retrieveTableColumnPrivileges"

lis 27, 2015 1:20:00 AM schemacrawler.crawl.SchemaCrawler crawlRoutines
INFO: Crawling routines
lis 27, 2015 1:20:00 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, bifrost
lis 27, 2015 1:20:00 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, bifrost
lis 27, 2015 1:20:00 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, django
lis 27, 2015 1:20:00 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, django
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, github_selected
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, github_selected
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, information_schema
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, information_schema
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, innodb
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, innodb
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, mysql
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, mysql
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, performance_schema
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, performance_schema
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, stack
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, stack
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveProcedures
INFO: Retrieving procedures for, tmp
lis 27, 2015 1:20:01 AM schemacrawler.crawl.RoutineRetriever retrieveFunctions
INFO: Retrieving functions, tmp
lis 27, 2015 1:20:01 AM schemacrawler.crawl.SchemaCrawler lambda$crawlRoutines$8

INFO: Retrieving routine columns
lis 27, 2015 1:20:03 AM schemacrawler.crawl.SchemaCrawler crawlRoutines
INFO: Total time taken for "crawlRoutines" - 00:00:02.238 hours
-  0,0% - 00:00:00.979 - "retrieveRoutines"
- 50,0% - 00:00:01.255 - "retrieveRoutineColumns"
-  0,0% - 00:00:00.004 - "sortAndFilterRoutines"
-  0,0% - 00:00:00.000 - "retrieveRoutineInformation"

lis 27, 2015 1:20:03 AM schemacrawler.crawl.SchemaCrawler crawlSynonyms
INFO: Not retrieving synonyms, since this was not requested
lis 27, 2015 1:20:03 AM schemacrawler.crawl.SchemaCrawler crawlSequences
INFO: Not retrieving sequences, since this was not requested
lis 27, 2015 1:20:03 AM schemacrawler.tools.executable.SchemaCrawlerExecutable e
xecuteOn
INFO: Executing command "list" using executable schemacrawler.tools.text.schema.
SchemaTextExecutable
lis 27, 2015 1:20:03 AM schemacrawler.tools.iosource.ConsoleOutputResource openN
ewOutputWriter
INFO: Opened output writer to console

System Information
========================================================================

generated by                              SchemaCrawler 14.05.01
generated on                              2015-11-27 01:20:00
database version                          MySQL 5.6.23-log
driver version                            MariaDB connector/J 1.2.3

Tables
========================================================================

github_selected.users_passions_view                               [view]
  VIEW
github_selected.users_tags_view                                   [view]
  VIEW
github_selected.users_wants_learn_view                            [view]
  VIEW

Routines
========================================================================

mysql.rds_collect_global_status_history           [procedure, no result]
mysql.rds_disable_gsh_collector                   [procedure, no result]
mysql.rds_disable_gsh_rotation                    [procedure, no result]
mysql.rds_enable_gsh_collector                    [procedure, no result]
mysql.rds_enable_gsh_rotation                     [procedure, no result]
mysql.rds_external_master                         [procedure, no result]
mysql.rds_innodb_buffer_pool_dump_now             [procedure, no result]
mysql.rds_innodb_buffer_pool_load_abort           [procedure, no result]
mysql.rds_innodb_buffer_pool_load_now             [procedure, no result]
mysql.rds_kill                                    [procedure, no result]
mysql.rds_kill_query                              [procedure, no result]
mysql.rds_next_master_log                         [procedure, no result]
mysql.rds_reset_external_master                   [procedure, no result]
mysql.rds_rotate_general_log                      [procedure, no result]
mysql.rds_rotate_global_status_history            [procedure, no result]
mysql.rds_rotate_slow_log                         [procedure, no result]
mysql.rds_set_configuration                       [procedure, no result]
mysql.rds_set_external_master                     [procedure, no result]
mysql.rds_set_gsh_collector                       [procedure, no result]
mysql.rds_set_gsh_rotation                        [procedure, no result]
mysql.rds_show_configuration                      [procedure, no result]
mysql.rds_skip_repl_error                         [procedure, no result]
mysql.rds_start_replication                       [procedure, no result]
mysql.rds_stop_replication                        [procedure, no result]

lis 27, 2015 1:20:03 AM schemacrawler.tools.iosource.OutputWriter close
INFO: Not closing output writer, since output is to an externally provided write
r

C:\tools\schemacrawler-14.05.01-main\_schemacrawler>

It shows internal rds procedures and views from github_selected (btw, there are also tables in github_selected!), while I'm interested only in tables from the django database.

Help appreciated,

Best Regards, Oskar

[schemacrawler]

• Please delete the MariaDB driver that is included with SchemaCrawler. It is connecting to your database instead of the MySQL driver.
• Please use the -schemas option to limit the tables and routines that you see in the SchemaCrawler report.

Let me know if this fixes the problem.

[oskar-j]

@sualeh It helped. I followed your instructions and everything now works fine. Thanks!

[schemacrawler]

Thanks for letting me know. I will fix the issue with the MariaDB driver in the next release.