seanharr11 / etlalchemy

Extract, Transform, Load: Any SQL Database in 4 lines of Code.
MIT License
556 stars 83 forks source link

sqlalchemy.exc.ProgrammingError: (_mysql_exceptions.ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'max), #47

Open amitasthana opened 5 years ago

amitasthana commented 5 years ago

ETLAlchemySource (INFO) - Transferring data from local file 'HJLMASTER.sql' to target DB ETLAlchemySource (INFO) - Sending data to target MySQL instance...(Fast [mysqlimport]) ETLAlchemySource (INFO) - mysqlimport -v -hlocalhost -utejora -ptejora --compress --local --fields-terminated-by="," --fields-enclosed-by='"' --fields-escaped-by='\' --lines-terminated-by=" " cron /code_path/etlalchemy/HJL____MASTER.sql mysqlimport: [Warning] Using a password on the command line interface can be insecure. Connecting to localhost Selecting database cron Loading data from LOCAL file: /code_path/etlalchemy/HJLMASTER.sql into HJLMASTER cron.HJLMASTER: Records: 102 Deleted: 0 Skipped: 0 Warnings: 0 Disconnecting from localhost ETLAlchemySource (INFO) - Done. ETLAlchemySource (INFO) - Cleaning up 'HJLMASTER'.sql ETLAlchemySource (INFO) - Done ETLAlchemySource (INFO) - Reading Table Schema 'B____INDIES'... ETLAlchemySource (INFO) - Loaded indexes and FKs for table 'BINDIES' ETLAlchemySource (WARNING) - Table 'BINDIES' does not exist in the dst database (we will create this later...) ETLAlchemySource (INFO) - Building query to fetch all rows from BINDIES ETLAlchemySource (INFO) - Done. (462 total rows) ETLAlchemySource (INFO) - Loading all rows into memory... ETLAlchemySource (INFO) - Done ETLAlchemySource (INFO) - (SOME_CODE) NUMERIC ETLAlchemySource (INFO) - Bases: ['NUMERIC'] ETLAlchemySource (INFO) - --> SOME_CODE...{'Decimal': 462} ETLAlchemySource (WARNING) - Column 'SOME_CODE' is of type 'Decimal', but contains no mantissas > 0. (i.e. 3.00, 2.00, etc..)

ETLAlchemySource (WARNING) - Coercing to 'Integer' ETLAlchemySource (INFO) - Checking column for elimination status... ETLAlchemySource (INFO) - (SOME_XName) VARCHAR ETLAlchemySource (INFO) - Bases: ['STRING'] ETLAlchemySource (INFO) - Checking column for elimination status... ETLAlchemySource (INFO) - (SOME_ISIN) VARCHAR ETLAlchemySource (INFO) - Bases: ['STRING'] ETLAlchemySource (INFO) - Checking column for elimination status... ETLAlchemySource (INFO) - (Scheme_id) VARCHAR ETLAlchemySource (INFO) - Bases: ['STRING'] ETLAlchemySource (INFO) - Checking column for elimination status... ETLAlchemySource (INFO) - (GHJ Mapped) NVARCHAR ETLAlchemySource (INFO) - Bases: ['UNICODE'] ETLAlchemySource (INFO) - Checking column for elimination status... ETLAlchemySource (INFO) - --> Creating table 'BINDIES' ETLAlchemySource (ERROR) - Failed to create table 'BINDIES'

(_mysql_exceptions.ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'max), \n\tGHJ Mapped VARCHAR(550)\n)' at line 5") [SQL: u'\nCREATE TABLE B_______INDIES (\n\tSOME_CODE INTEGER NOT NULL, \n\tSOME_XName VARCHAR(100) NOT NULL, \n\tSOME_ISIN VARCHAR(50), \n\tScheme_id VARCHAR(max), \n\tGHJ Mapped VARCHAR(550)\n)\n\n'] Traceback (most recent call last): File "test23.py", line 32, in target.migrate() File "/some_path/python2.7/site-packages/etlalchemy/ETLAlchemyTarget.py", line 86, in migrate migrate_data=migrate_data) File "/some_path/python2.7/site-packages/etlalchemy/ETLAlchemySource.py", line 1073, in migrate tableCreationSuccess = self.create_table(T_dst_exists, T) File "/some_path/python2.7/site-packages/etlalchemy/ETLAlchemySource.py", line 590, in create_table T.create(conn) File "/some_path/python2.7/site-packages/sqlalchemy/sql/schema.py", line 725, in create checkfirst=checkfirst) File "/some_path/python2.7/site-packages/sqlalchemy/engine/base.py", line 1481, in _run_visitor kwargs).traverse_single(element) File "/some_path/python2.7/site-packages/sqlalchemy/sql/visitors.py", line 121, in traverse_single return meth(obj, kw) File "/some_path/python2.7/site-packages/sqlalchemy/sql/ddl.py", line 764, in visit_table include_foreign_key_constraints=include_foreign_key_constraints File "/some_path/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/some_path/python2.7/site-packages/sqlalchemy/sql/ddl.py", line 68, in _execute_on_connection return connection._execute_ddl(self, multiparams, params) File "/some_path/python2.7/site-packages/sqlalchemy/engine/base.py", line 968, in _execute_ddl compiled File "/some_path/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/some_path/python2.7/site-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/some_path/python2.7/site-packages/sqlalchemy/util/compat.py", line 202, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=cause) File "/some_path/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/some_path/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/some_path/python2.7/site-packages/MySQLdb/cursors.py", line 205, in execute self.errorhandler(self, exc, value) File "/some_path/python2.7/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler raise errorclass, errorvalue sqlalchemy.exc.ProgrammingError: (_mysql_exceptions.ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'max), \n\tGHJ Mapped VARCHAR(550)\n)' at line 5") [SQL: u'\nCREATE TABLE B_______INDIES (\n\tSOME_CODE INTEGER NOT NULL, \n\tSOME_XName VARCHAR(100) NOT NULL, \n\tSOME_ISIN VARCHAR(50), \n\tScheme_id VARCHAR(max), \n\tGHJ Mapped VARCHAR(550)\n)\n\n']