is00hcw / tungsten-replicator

Automatically exported from code.google.com/p/tungsten-replicator
0 stars 1 forks source link

Deploy Mysql to MongoDB failed #1101

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?

1.shell> ./tools/tpm install alpha \ --datasource-type=mongodb \ 
--install-directory=/opt/continuent \ --master=host1 \ 
--enable-heterogenous-slave=true \ --topology=master-slave \ --start=true
2.
3.

What is the expected output?

...

What do you see instead?

#####################################################################
# There are errors with the values provided in the configuration file
#####################################################################
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Temporary Directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --temp-directory
ERROR >> > Prompt Class: TempDirectoryPrompt
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Ports opened on this server for connector communications
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: HostPortsForConnectors
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Ports opened on this server for manager communications
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: HostPortsForManagers
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Temporary backup storage directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-dump-directory
ERROR >> > Prompt Class: BackupStorageTempDirectory
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Number of backups to retain
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-retention
ERROR >> > Prompt Class: BackupStorageRetention
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: What is the path to the backup 
script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-script
ERROR >> > Prompt Class: BackupScriptPathConfigurePrompt
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Use sudo when running the backup 
script?
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-command-prefix
ERROR >> > Prompt Class: BackupScriptCommandPrefixConfigurePrompt
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Does the backup script support 
backing up a datasource while it is ONLINE
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --backup-online
ERROR >> > Prompt Class: BackupScriptOnlineConfigurePrompt
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: MySQL server ID
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --mysql-server-id
ERROR >> > Prompt Class: MySQLServerID
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Postgres Replication method
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-method
ERROR >> > Prompt Class: PostgresStreamingReplication
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Timeout for sending unfilled WAL 
buffers (data loss window)
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-archive-timeout
ERROR >> > Prompt Class: PostgresArchiveTimeout
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Use PG streaming replication 
(true|false)
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresUseStreaming
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Role for PG WAL shipping
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresWALRole
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Path to the pg_standby script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-standby
ERROR >> > Prompt Class: PostgresStandbyPath
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Path to the pg_ctl script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --pg-ctl
ERROR >> > Prompt Class: PostgresControlPath
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Path to the trigger file for 
pg_standby
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresStandbyTriggerPath
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Path to the pg_archivecleanup 
script
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Prompt Class: PostgresArchiveCleanupPath
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Name of the database to replicate
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-dbname
ERROR >> > Prompt Class: PostgreSQLDatabaseName
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Path to the slonik executable
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-slonik
ERROR >> > Prompt Class: PostgreSQLSlonikPath
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Tables to replicate in form: 
schema1.table1,schema2.table2,...
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-tables
ERROR >> > Prompt Class: PostgreSQLTables
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Enable MySQL -> PostgreSQL DDL 
dialect converting filter placeholder
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --postgresql-enable-mysql2pgddl
ERROR >> > Prompt Class: PostgreSQLDDL
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Name of the database to replicate 
into
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --redshift-dbname
ERROR >> > Prompt Class: RedshiftDatabaseName
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Replication service mongodb - alpha: Name of the database to replicate 
into
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --vertica-dbname
ERROR >> > Prompt Class: VerticaDatabaseName
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: MySQL InnoDB log directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-iblog-directory
ERROR >> > Prompt Class: MySQLInnoDBLogDirectory
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: MySQL SSL CA file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-ssl-ca
ERROR >> > Prompt Class: MySQLSSLCAFile
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: MySQL SSL certificate file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-ssl-cert
ERROR >> > Prompt Class: MySQLSSLCertificateFile
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: MySQL SSL key file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-ssl-key
ERROR >> > Prompt Class: MySQLSSLKeyFile
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: MySQL command
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-command
ERROR >> > Prompt Class: MySQLCommand
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: MySQL config file
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-mysql-conf
ERROR >> > Prompt Class: MySQLConfFile
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Oracle Service
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-oracle-service
ERROR >> > Prompt Class: OracleService
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Oracle SID
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-oracle-sid
ERROR >> > Prompt Class: OracleSID
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Oracle SCAN
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-oracle-scan
ERROR >> > Prompt Class: OracleSCAN
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Oracle Service
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --direct-datasource-oracle-service
ERROR >> > Prompt Class: OracleExtractorService
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Oracle SID
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --direct-datasource-oracle-sid
ERROR >> > Prompt Class: OracleExtractorSID
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Oracle SCAN
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --direct-datasource-oracle-scan
ERROR >> > Prompt Class: OracleExtractorSCAN
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Root directory for postgresql installation
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-root
ERROR >> > Prompt Class: PostgresRootDirectory
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: PostgreSQL data directory
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-home
ERROR >> > Prompt Class: PostgresDataDirectory
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: PostgreSQL archive location
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-archive
ERROR >> > Prompt Class: PostgresArchiveDirectory
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Host mongodb: Location of postgresql.conf
ERROR >> > Message: Cannot allocate memory - hostname 2>/dev/null
ERROR >> > Argument: --datasource-pg-conf
ERROR >> > Prompt Class: PostgresConfFile
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Unknown configuration key
ERROR >> > Message: This is an unknown configuration key
ERROR >> > Argument: --repl-services.alpha-mongodb.deployment-dataservice
ERROR >> > Current Value: alpha
ERROR >> > Prompt Class: ConfigurePrompt
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
-------------------------
ERROR >> Unknown configuration key
ERROR >> > Message: This is an unknown configuration key
ERROR >> > Argument: --repl-services.alpha-mongodb.deployment-host
ERROR >> > Current Value: mongodb
ERROR >> > Prompt Class: ConfigurePrompt

What version of the product are you using?

3.0.0-524

On what operating system?

ubuntu 14.04 64bit

Please provide any additional information below.

Notes:

...

Original issue reported on code.google.com by zhaozhim...@gmail.com on 5 Mar 2015 at 7:30

GoogleCodeExporter commented 9 years ago
Hello,
Can I suggest you install using the ini file method instead, I think it is much 
clearer for heterogenous installs. For this method you install the hosts 
individually and you need to have the software unpacked on each host.  
If either the master or slave got installed, uninstall first. 
To do that: cd to the directory you unpacked the software to and run 
./tools/tpm uninstall --i-am-sure.
Then remove any existing tungsten.cfg (default location would be 
/opt/continuent/software/conf.replicator).
Create a tungsten.ini in /etc/tungsten, make sure your tungsten user has 
permissions on it.
For the master the contents will be (put your password in):
[defaults]
install-directory=/opt/continuent
user=tungsten
replication-password=xxxxx
replication-user=tungsten
start-and-report=true

[alpha]
master=host1
enable-heterogeneous-master
property=replicator.filter.pkey.addColumnsToDeletes=true
property=replicator.filter.pkey.addPkeyToInserts=true

For the slave:
[defaults]
user=tungsten
home-directory=/opt/continuent
replicatione-user=tungsten
replication-password=secret
start-and-report=true

[alpha]
datasource-type=mongodb
enable-heterogeneous-slave=true
master=host1
slaves=host2
topology=master-slave

Then you can cd into the directory containing the unpacked software and run 
./tools/tpm install on the master then the slave.

Please try it that way and let us know how you get on.

Eric

Original comment by eric.har...@continuent.com on 10 Mar 2015 at 2:34

GoogleCodeExporter commented 9 years ago
Just noticed a typo in the above example

enable-heterogeneous-master

Should be 

enable-heterogeneous-master=true

Original comment by eric.har...@continuent.com on 12 Mar 2015 at 12:40