Closed saga1015 closed 6 years ago
The query that fails is introspecting the PostgreSQL catalogs to list the Indexes defined in your schema.
It might be that the current master's version of pgloader is good to use though, as the query involved here did change recently: https://github.com/dimitri/pgloader/commit/5119d864f4107f4d4d2e4e850fe4b44dc33a0bbc#diff-c9534ae1cd6968102ad45b324b6184ae. Please build pgloader from current sources and try again.
That said, please report the result in Greenplum from this SQL query, for reference in case we need to add Greenplum as another variant with specific catalog queries.
select version();
@dimitri thank you very much :-)
postgres=# select version();
------------
PostgreSQL 8.3.23 (Greenplum Database 5.11.0 build commit:6f447c24554134df0c1d473e63e0124e7ee6de6b) on x86_64-pc-linux-gnu, compiled by GCC gcc (GCC) 6.2.0, 64-bit compiled on Sep 12 2018 20:17:30
@dimitri i build pgloader from master,but run ./pgloader mysql2gp.load,
[root@tableau bin]# ./pgloader --debug mysql2gp.load
sb-impl::*default-external-format* :UTF-8
tmpdir: #P"/tmp/pgloader/"
2018-09-25T19:49:09.021000+08:00 NOTICE Starting pgloader, log system is ready.
2018-09-25T19:49:09.052000+08:00 INFO Starting monitor
2018-09-25T19:49:09.059000+08:00 INFO Parsed command:
LOAD DATABASE
FROM mysql://palo_load:ttpai@172.16.4.91/ttpai_boss_v1
INTO postgresql://gpadmin:*7n#/ixg@172.16.4.140:5432/boss_v1
;
2018-09-25T19:49:09.097000+08:00 DEBUG CONNECTED TO #<PGLOADER.PGSQL:PGSQL-CONNECTION pgsql://gpadmin@172.16.4.140:5432/boss_v1 {100904A373}>
2018-09-25T19:49:09.097000+08:00 DEBUG SET client_encoding TO 'utf8'
2018-09-25T19:49:09.120000+08:00 DEBUG SET application_name TO 'pgloader'
2018-09-25T19:49:09.178000+08:00 LOG Migrating from #<MYSQL-CONNECTION mysql://palo_load@172.16.4.91:3306/ttpai_boss_v1 {1009048B93}>
2018-09-25T19:49:09.179000+08:00 LOG Migrating into #<PGSQL-CONNECTION pgsql://gpadmin@172.16.4.140:5432/boss_v1 {100904A373}>
2018-09-25T19:49:09.218000+08:00 DEBUG CONNECTED TO #<MYSQL-CONNECTION mysql://palo_load@172.16.4.91:3306/ttpai_boss_v1 {1009048B93}>
2018-09-25T19:49:09.221000+08:00 SQL MySQL: sending query: -- params: db-name
-- table-type-name
-- only-tables
-- only-tables
-- including
-- filter-list-to-where-clause incuding
-- excluding
-- filter-list-to-where-clause excluding
select c.table_name, t.table_comment,
c.column_name, c.column_comment,
c.data_type, c.column_type, c.column_default,
c.is_nullable, c.extra
from information_schema.columns c
join information_schema.tables t using(table_schema, table_name)
where c.table_schema = 'ttpai_boss_v1' and t.table_type = 'BASE TABLE'
order by table_name, ordinal_position;
2018-09-25T19:49:11.318000+08:00 SQL MySQL: sending query: -- params: db-name
-- table-type-name
-- only-tables
-- only-tables
-- including
-- filter-list-to-where-clause incuding
-- excluding
-- filter-list-to-where-clause excluding
SELECT s.table_name, s.constraint_name, s.ft, s.cols, s.fcols,
rc.update_rule, rc.delete_rule
FROM
(
SELECT tc.table_schema, tc.table_name,
tc.constraint_name, k.referenced_table_name ft,
group_concat( k.column_name
order by k.ordinal_position) as cols,
group_concat( k.referenced_column_name
order by k.position_in_unique_constraint) as fcols
FROM information_schema.table_constraints tc
LEFT JOIN information_schema.key_column_usage k
ON k.table_schema = tc.table_schema
AND k.table_name = tc.table_name
AND k.constraint_name = tc.constraint_name
WHERE tc.table_schema = 'ttpai_boss_v1'
AND k.referenced_table_schema = 'ttpai_boss_v1'
AND tc.constraint_type = 'FOREIGN KEY'
GROUP BY tc.table_schema, tc.table_name, tc.constraint_name, ft
) s
JOIN information_schema.referential_constraints rc
ON rc.constraint_schema = s.table_schema
AND rc.constraint_name = s.constraint_name
AND rc.table_name = s.table_name;
2018-09-25T19:49:11.440000+08:00 SQL MySQL: sending query: -- params: db-name
-- table-type-name
-- only-tables
-- only-tables
-- including
-- filter-list-to-where-clause incuding
-- excluding
-- filter-list-to-where-clause excluding
SELECT table_name, index_name, index_type,
sum(non_unique),
cast(GROUP_CONCAT(column_name order by seq_in_index) as char)
FROM information_schema.statistics
WHERE table_schema = 'ttpai_boss_v1'
GROUP BY table_name, index_name, index_type;
2018-09-25T19:49:16.759000+08:00 NOTICE Prepare PostgreSQL database.
2018-09-25T19:49:16.777000+08:00 DEBUG CONNECTED TO #<PGLOADER.PGSQL:PGSQL-CONNECTION pgsql://gpadmin@172.16.4.140:5432/boss_v1 {100801E643}>
2018-09-25T19:49:16.777000+08:00 DEBUG SET client_encoding TO 'utf8'
2018-09-25T19:49:16.803000+08:00 DEBUG SET application_name TO 'pgloader'
2018-09-25T19:49:16.845000+08:00 DEBUG BEGIN
KABOOM!
INFO: Control stack guard page unprotected
Control stack guard page temporarily disabled: proceed with caution
2018-09-25T19:49:17.117000+08:00 INFO Stopping monitor
What I am doing here?
Control stack exhausted (no more space for function call frames).
This is probably due to heavily nested or infinitely recursive function
calls, or a tail call that SBCL cannot or has not optimized away.
PROCEED WITH CAUTION.
Hi @saga1015 ; that's a different error altogether, nothing to do with catalog support. I'm not sure but it looks related to other issues, such as https://github.com/dimitri/pgloader/issues/810 I think. Closing this one then.
mysql version:5.6.32 greenplum version:5.11.0 pgloader version:3.5.1 mysql2gp.load
when i run pgloader mysql2gp.load,i saw:
how to slove it?
thank you very very much!!!!