speaker ID wrong after loading into the database

[mhl]

This is a bit mysterious to me - we had a report from a user that there's a speech that TWFY is displaying as from Johann Lamont, when in the original it's from John Lamont. This seems to be fine in our XML, but wrong in the live database, so I guess there must be a problem with xml2db, unless one of these has changed since the import. The details are below:

• The speech with the wrong attribution is: http://www.theyworkforyou.com/sp/?id=2014-03-04.7.0#g7.11
• This was scraped from: http://www.scottish.parliament.uk/parliamentarybusiness/28862.aspx?r=8997&mode=html (correctly shown as from John Lamont)

• The relevant people IDs from people.xml are:

  <person id="uk.org.publicwhip/person/14025" latestname="Johann Lamont">
    <office id="uk.org.publicwhip/member/80058"/>
    <office id="uk.org.publicwhip/member/80184"/>
    <office id="uk.org.publicwhip/member/80338"/>
    <office id="uk.org.publicwhip/member/80423" current="yes"/>
  </person>
  <person id="uk.org.publicwhip/person/14026" latestname="John Lamont">
    <office id="uk.org.publicwhip/member/80337"/>
    <office id="uk.org.publicwhip/member/80469" current="yes"/>
  </person>

• The scraped HTML file parldata/cmpages/sp/official-reports-new/8997.html has the correct name.

• Our generated XML has the correct speaker ID:

  <speech url="http://www.scottish.parliament.uk/parliamentarybusiness/28862.aspx?r=8997&amp;mode=html#iob_81223" speakername="John Lamont" id="uk.org.publicwhip/spor/2014-03-04.7.11" speakerid="uk.org.publicwhip/member/80469">

• In the database it has the wrong speaker ID:

  mysql> select * from hansard where epobject_id = 22930152;
  +-------------+----------------------------------------+-------+------------+-------+------------+---------------+------+------------+-------+-----------------------------------------------------------------------------------------------+-------+---------------------+---------------------+--------+--------------+
  | epobject_id | gid                                    | htype | speaker_id | major | section_id | subsection_id | hpos | hdate      | htime | source_url                                                                                    | minor | created             | modified            | colnum | video_status |
  +-------------+----------------------------------------+-------+------------+-------+------------+---------------+------+------------+-------+-----------------------------------------------------------------------------------------------+-------+---------------------+---------------------+--------+--------------+
  |    22930152 | uk.org.publicwhip/spor/2014-03-04.7.11 |    12 |      80423 |     7 |   22930141 |      22930141 |  166 | 2014-03-04 | NULL  | http://www.scottish.parliament.uk/parliamentarybusiness/28862.aspx?r=8984&mode=html#iob_81081 |     0 | 2014-03-05 06:24:43 | 2014-03-05 06:24:43 |   NULL |            0 |
  +-------------+----------------------------------------+-------+------------+-------+------------+---------------+------+------------+-------+-----------------------------------------------------------------------------------------------+-------+---------------------+---------------------+--------+--------------+
  1 row in set (0.00 sec)

Obviously I could just update the speaker_id in that row, but this seems mysterious enough that it would be worth getting to the bottom of.

[dracos]

This is related to #468 - it said Johann in 8984.xml, but was fixed to John in 8985.xml (and 8997.xml). The problem is in how the site is/should deal with multiple XML files for the same data - 8984 is what is loaded, and thus is not the latest version, and presumably should never be loaded once 8985/8997 appeared.

[MyfanwyNixon]

This report from a user may be related: "In the course of doing some research on the Law Lords I spotted what I think is an attribution error in your database. Two speeches in the Lords are attributed to Lord (Brian) Hutton that I think from the context and dates must actually have been made by Lord (John) Hutton of Furness. They are the top two, from 2012 and 2013, that appear under the following search for speeches by Lord (Brian) Hutton.

http://www.theyworkforyou.com/search/?pid=13486&pop=1"

[dracos]

This ticket is to do with Scotland and multiple XML files for a particular day, I'm afraid. That problem is because Hansard have referred to "Lord Hutton of Furness" incorrectly as "Lord Hutton" and we can only take what they say as correct. Note they link the wrong Lord Hutton on the official site, e.g. http://www.publications.parliament.uk/pa/ld201314/ldhansrd/ldallfiles/peers/lord_hansard_1097_od.html - the mistake should be reported to Hansard.