Oracle migration for testdb

[cybersiddhu]

This migration involves pointing all off our testdb application to the new oracle 11g server.

Wednesday(Feb 19th)

• [x] Sync testdb(10g) with prod. Also sync our dev server in nubic. David. Look here for syncing instructions.
• [x] Restart all apps on testdb. Sidd
• [x] Ask our testing team to test out testdb. Petra, Kerry and Bob. Test particularly the stock center ordering, it might cause problem with new 11g server.

  Thursday(Feb 20th)

• [x] Wait for testing feedback from testing team. Keep on testing as much as possible.
• [x] Point all testdb apps to new 11g server and reconfigure all web apps. Sidd
• [ ] Sync testdb(11g) now, just reuse the dump. David
• [x] Restart all apps. Sidd
• [x] Inform testing team to rerun their tests.

  Friday(Feb 21th)

• [x] If something broken, plan for fixes. Sidd
• [x] If everything is fine, inform dong and rocky so that they could turn off the old server. Sidd

cc: @biodavidjm

[cybersiddhu]

Stock center backend rails app is broken after pointing to 11g server.

[cybersiddhu]

Now all the softwares are broken and all seems to have the similar errors. I am getting ORA-03135 error for all the clients. I have tried the following ....

• perl DBI. Also upgraded to a new version (1.44).
• ruby activerecord oracle adapter + oci8
  • Spent quite a bit of time with Frank(NUBIC developer) to diagnose the problem. The problem persisted and ran into rubygem issue with upgrading the oracle_enhanced adapter from activerecord. Have given Frank a tarball of the app offline so he could look at it separately.
• sqlplus plus client(v 10.0)

[cybersiddhu]

• Tried with a newer version (10.2.5) of instantclient from series 10, did not work.
• Tried with various configuration tnsnames.ora particularly short and long names, did not help.

[cybersiddhu]

• Because of OS differences between 11g server(64 bit) and testdb(32 bit), tried with a version compatible instant client(11.2.0.4.0 32 bit). Again did not work.
  • Note: Manual compilation of libaio(0.3.104) is necessary. Download from here.
  • Copy it to /lib folder and create an symlink with libaio.so.1
  • Add instantclient path to /etc/ld.so.conf.
  • Run sudo ldconfig to update the LD_LIBRARY_PATH.

[cybersiddhu]

• Changing the host MTU makes it works through sqlplus client.
• The publication page works.
• Gene page, stock center etc those which has to go through modperl stack seems to be broken.

[cybersiddhu]

• Gene pages works now.
• Stock center, phenotype and strain pages works but extremely slow.
• Yulia's curation tool works.
• Old curation tool does not work, however not sure whether it's due to slowness or it's broken.
• No report for stock center order.

[cybersiddhu]

• Stock center order works.
• Slowness persists.

@biodavidjm please finish the testdb sync by today.

[cybersiddhu]

@biodavidjm you need to run a testdb sync just to make sure everything in place.

[biodavidjm]

export_dicty_prod.bat was run successfully. import_production_to_test.bat was run with NO success. I got this error:

I am assuming that it might be a problem with me username, since I have never connected to testdb. I just emailed system administrators to find out.

[cybersiddhu]

Syncing production to 11g oracle works now after fixing permissions of directory objects.