roxana-lafuente / MTTT

Machine Translation Training Tool (MTTT): Machine translation made easy for human translators!
GNU General Public License v3.0
3 stars 5 forks source link

In "Evaluation" tab, problem with HTER and GTM #9

Closed roxana-lafuente closed 7 years ago

roxana-lafuente commented 7 years ago

Both metrics are not defined. I think this was working before.

Output:

HTER..... GTM.....

miguelemosreverte commented 7 years ago

HTER was being filtered, GTM was sending its output to the console, even tough no other process could do so, the idea was to catch the output and print it on the program but for some unknown reason GTM can and does circunvent the code the other evaluation scripts cannot, and manages to print its output directly on console.

Given that you showed me the files you were working with I can assure you that there is no more problem than the output one. Because the scripts are performing well, and they do not like when they are given identical data for the source and the reference. Unfiltering the HTER gave this result:

HTER.....Warning, Invalid line: SAN FRANCISCO – It has never been easy to have a rational conversation about the value of gold.
Warning, Invalid line: Lately, with gold prices up more than 300% over the last decade, it is harder than ever.
Warning, Invalid line: Just last December, fellow economists Martin Feldstein and Nouriel Roubini each penned op-eds bravely questioning bullish market sentiment, sensibly pointing out gold’s risks.
Warning, Invalid line: Wouldn’t you know it?
Warning, Invalid line: Since their articles appeared, the price of gold has moved up still further.
Warning, Invalid line: Gold prices even hit a record-high $1,300 recently.
Warning, Invalid line: Last December, many gold bugs were arguing that the price was inevitably headed for $2,000.
Warning, Invalid line: Now, emboldened by continuing appreciation, some are suggesting that gold could be headed even higher than that.
Warning, Invalid line: One successful gold investor recently explained to me that stock prices languished for a more than a decade before the Dow Jones index crossed the 1,000 mark in the early 1980’s.
Warning, Invalid line: Since then, the index has climbed above 10,000.
Warning, Invalid line: Now that gold has crossed the magic $1,000 barrier, why can’t it increase ten-fold, too?
Warning, Invalid line: Admittedly, getting to a much higher price for gold is not quite the leap of imagination that it seems.
Warning, Invalid line: After adjusting for inflation, today’s price is nowhere near the all-time high of January 1980.
Warning, Invalid line: Back then, gold hit $850, or well over $2,000 in today’s dollars.
Warning, Invalid line: But January 1980 was arguably a “freak peak” during a period of heightened geo-political instability.
Warning, Invalid line: At $1,300, today’s price is probably more than double very long-term, inflation-adjusted, average gold prices.
Warning, Invalid line: So what could justify another huge increase in gold prices from here?
Warning, Invalid line: One answer, of course, is a complete collapse of the US dollar.
Warning, Invalid line: With soaring deficits, and a rudderless fiscal policy, one does wonder whether a populist administration might recklessly turn to the printing press.
Warning, Invalid line: And if you are really worried about that, gold might indeed be the most reliable hedge.
Warning, Invalid line: Sure, some might argue that inflation-indexed bonds offer a better and more direct inflation hedge than gold.
Warning, Invalid line: But gold bugs are right to worry about whether the government will honor its commitments under more extreme circumstances.
Warning, Invalid line: In fact, as Carmen Reinhart and I discuss in our recent book on the history of financial crises, This Time is Different, cash-strapped governments will often forcibly convert indexed debt to non-indexed debt, precisely so that its value might be inflated away.
Warning, Invalid line: Even the United States abrogated indexation clauses in bond contracts during the Great Depression of the 1930’s. So it can happen anywhere.
Warning, Invalid line: Even so, the fact that very high inflation is possible does not make it probable, so one should be cautious in arguing that higher gold prices are being driven by inflation expectations.
Warning, Invalid line: Some have argued instead that gold’s long upward march has been partly driven by the development of new financial instruments that make it easier to trade and speculate in gold.
Warning, Invalid line: There is probably some slight truth – and also a certain degree of irony – to this argument.
Warning, Invalid line: After all, medieval alchemists engaged in what we now consider an absurd search for ways to transform base metals into gold.
Warning, Invalid line: Wouldn’t it be paradoxical, then, if financial alchemy could make an ingot of gold worth dramatically more?
Warning, Invalid line: In my view, the most powerful argument to justify today’s high price of gold is the dramatic emergence of Asia, Latin America, and the Middle East into the global economy.
Warning, Invalid line: As legions of new consumers gain purchasing power, demand inevitably rises, driving up the price of scarce commodities.
Warning, Invalid line: At the same time, emerging-market central banks need to accumulate gold reserves, which they still hold in far lower proportion than do rich-country central banks. With the euro looking less appetizing as a diversification play away from the dollar, gold’s appeal has naturally grown.
Warning, Invalid line: So, yes, there are solid fundamentals that arguably support today’s higher gold price, although it is far more debatable whether and to what extent they will continue to support higher prices in the future.
Warning, Invalid line: Indeed, another critical fundamental factor that has been sustaining high gold prices might prove far more ephemeral than globalization.
Warning, Invalid line: Gold prices are extremely sensitive to global interest-rate movements.
Warning, Invalid line: After all, gold pays no interest and even costs something to store.
Warning, Invalid line: Today, with interest rates near or at record lows in many countries, it is relatively cheap to speculate in gold instead of investing in bonds.
Warning, Invalid line: But if real interest rates rise significantly, as well they might someday, gold prices could plummet.
Warning, Invalid line: Most economic research suggests that gold prices are very difficult to predict over the short to medium term, with the odds of gains and losses being roughly in balance.
Warning, Invalid line: It is therefore dangerous to extrapolate from short-term trends.
Warning, Invalid line: Yes, gold has had a great run, but so, too, did worldwide housing prices until a couple of years ago.
Warning, Invalid line: If you are a high-net-worth investor, a sovereign wealth fund, or a central bank, it makes perfect sense to hold a modest proportion of your portfolio in gold as a hedge against extreme events.
Warning, Invalid line: But, despite gold’s heightened allure in the wake of an extraordinary run-up in its price, it remains a very risky bet for most of us.
Warning, Invalid line: Of course, such considerations might have little influence on prices.
Warning, Invalid line: What was true for the alchemists of yore remains true today: gold and reason are often difficult to reconcile.
Warning, Invalid line: Last week Tony Blair, Jacques Chirac, and Gerhard Schroeder met in Berlin.
Warning, Invalid line: They departed pledging to revive Europe's growth.
Warning, Invalid line: We've heard that empty promise before.
Warning, Invalid line: Instead, the European Union needs a new direction.
Warning, Invalid line: I say this as leader of the party which has been at the forefront of Britain's engagement with Europe.
Warning, Invalid line: It was a Conservative government that first applied for membership in the early 1960's.
Warning, Invalid line: A Conservative government took the United Kingdom into the European Economic Community in 1973.
Warning, Invalid line: Margaret Thatcher worked with Jacques Delors to forge the Single Market in 1986.
Warning, Invalid line: So I have no doubt that Britain must remain influential within the Union.
Warning, Invalid line: But British policy towards the EU has often led to worse rather than better relations among member states.
Warning, Invalid line: Faced with a new EU initiative, our traditional response has often been to oppose it, vote against it, lose the vote, then sulkily to adopt it while blaming everyone else.
Warning, Invalid line: Many Europeans are sick of British vetoes.
Warning, Invalid line: So am I.
Warning, Invalid line: Of course there are basic requirements that all member states must accept.
Warning, Invalid line: Foremost are the four freedoms of the single market; free movement of goods, services, people and capital.
Warning, Invalid line: But a single market does not require a single social or industrial policy, far less a common taxation policy.
Warning, Invalid line: Allowing countries to pursue their own policies in these areas encourages competitiveness.
Warning, Invalid line: Forcing common standards means that Europe will fall further behind as member states shuffle their costs onto their neighbours.
Warning, Invalid line: Which areas should be applied to every member state, and which should be optional?
Warning, Invalid line: I believe that every member state should administer those policies that do not directly and significantly affect other member states.
Warning, Invalid line: In areas which serve their national interest, individual members should decide whether to retain wholly national control or whether to co‑operate with others.
Warning, Invalid line: The Union's members should form a series of overlapping circles: different combinations of members should be able to pool their responsibilities in different areas of their own choosing.
Warning, Invalid line: Precedents exist for this.
Warning, Invalid line: NATO has been flexible since its inception.
Warning, Invalid line: France signed up for membership but later refused to submit her armed forces to NATO's central command.
Warning, Invalid line: Similar flexibility exists with the Euro, the Schengen Agreement, and the Social Chapter.
Warning, Invalid line: These precedents can be extended.
Warning, Invalid line: So far, everyone has had to move forward together, with individual countries negotiating specific opt‑outs.
Warning, Invalid line: But since 1998, there has been a procedure within the Treaties - called enhanced co‑operation - that could allow some members to go ahead with further integration in a specific area without involving every other member.
Warning, Invalid line: Instead of individual member states having fraught negotiations to opt‑out of a new initiative, those that support it can simply opt‑in.
Warning, Invalid line: Countries that want to integrate further can do so.
Warning, Invalid line: They don't need to drag Britain and others kicking and screaming in their wake because the others are not compelled to join them.
Warning, Invalid line: In this way we can break free of the institutionalised tug of war that has characterised EU relations.
Warning, Invalid line: I am not talking about a two‑speed Europe.
Warning, Invalid line: That implies that we all agree on the destination and differ only about the speed of the journey.
Warning, Invalid line: I don't want to reach the destination that some of our partners may aspire to.
Warning, Invalid line: But I don't want to block their way.
Warning, Invalid line: There are some who say that this would mean a loss of influence on the part of those countries which choose not to integrate more closely.
Warning, Invalid line: But influence is not an end in itself - it is a means to an end.
Warning, Invalid line: Britain does not need a seat at the table when decisions on the Euro are taken.
Warning, Invalid line: Our economy has not been adversely affected by staying out.
Warning, Invalid line: Keeping the pound does not mean that we oppose the Euro, or hope for its failure.
Warning, Invalid line: The European Union should stop trying to do everything and concentrate on doing fewer things more effectively.
Warning, Invalid line: It should give member states the chance to develop an approach to Europe that suits their national traditions, within the EU framework.
Warning, Invalid line: It is on this basis that British Conservatives oppose the proposed constitution.
Warning, Invalid line: We disagree with many of its contents, of course, but also oppose the idea of having an EU constitution at all.
Warning, Invalid line: There is a world of difference between an association of nation states bound together by treaty, and a single entity, whether you call it a state or not, with its own legal personality, deriving its authority from its own constitution.
Warning, Invalid line: If this constitution were accepted in anything like the proposed form, the EU would gain many attributes and trappings of statehood: its own president and foreign minister, its own legal system.
Warning, Invalid line: The supremacy of EU law would derive not from Acts of national Parliaments but from a supra‑national constitution.
Warning, Invalid line: That is a radical change, not the mere tidying‑up exercise some suggest.
Warning, Invalid line: I do not believe it is right to make a change of such magnitude without specifically consulting the people on whose behalf we govern.
Warning, Invalid line: Elected parliaments do not own our liberties.
Warning, Invalid line: They safeguard them, and should not diminish those liberties without an explicit mandate.
Warning, Invalid line: Any proposal for a new constitution must be put to the British people and to the people in each EU member state.
Warning, Invalid line: BRUSSELS – Austerity alone cannot solve Europe's economic and financial crisis.
"/home/migue/Desktop/1.en" was successfully parsed as Trans text
Warning, Invalid line: SAN FRANCISCO – It has never been easy to have a rational conversation about the value of gold.
Warning, Invalid line: Lately, with gold prices up more than 300% over the last decade, it is harder than ever.
Warning, Invalid line: Just last December, hellow economists Martin Feldstein and Nouriel Roubini each penned op-eds bravely questioning bullish market sentiment, sensibly pointing out gold’s risks.
Warning, Invalid line: Wouldn’t you know it?
Warning, Invalid line: Since their articles appeared, the price of gold has moved up still further.
Warning, Invalid line: Gold prices even hit a record-high $1,300 recently.
Warning, Invalid line: Last December, many gold bugs were arguing that the price was inevitably headed for $2,000.
Warning, Invalid line: Now, emboldened by continuing appreciation, some are suggesting that gold could be headed even higher than that.
Warning, Invalid line: One successful gold investor recently explaijed to me that stock prices languished for a more than a decade before the Dow Jones index crossed the 1,000 mark in the early 1980’s.
Warning, Invalid line: Since then, the index has climbed above 10,000.
Warning, Invalid line: Now that gold has crossed the magic $1,000 barrier, why can’t it insrease ten-fold, too?
Warning, Invalid line: Admittedly, getting to a much higher price for gold is not quite the leap of imagination that it seems.
Warning, Invalid line: After adjusting for inflation, today’s price is nowhere near the all-time high of January 1980.
Warning, Invalid line: Back then, gold hit $850, or well over $2,000 in today’s dollars.
Warning, Invalid line: But January 1980 was arguably a “freak peak” during a period of heightened geo-political instability.
Warning, Invalid line: At $1,300, today’s price is probably more than double very long-term, inflation-adjusted, average gold prices.
Warning, Invalid line: So what could justify another huge increase in gold prices from here?
Warning, Invalid line: One answer, of course, is a complete collapse of the US dollar.
Warning, Invalid line: With soaring deficits, and a rudderless fiscal policy, one does wonder whether a populist administration might recklessly turn to the printing press.
Warning, Invalid line: And if you are really worried about that, gold might indeed be the most reliable hedge.
Warning, Invalid line: Sure, some might argue that inflation-indexed bonds offer a better and more direct inflation hedge than gold.
Warning, Invalid line: But gold bugs are right to worry about whether the government will honor its commitments under more extreme circumstances.
Warning, Invalid line: In fact, as Carmen Reinhart and I discuss in our recent book on the history of financial crises, This Time is Different, cash-strapped governments will often forcibly convert indexed debt to non-indexed debt, precisely so that its value might be inflated away.
Warning, Invalid line: Even the United States abrogated indexation clauses in bond contracts during the Great Depression of the 1930’s. So it can happen anywhere.
Warning, Invalid line: Even so, the fact that very high inflation is possible does not make it probable, so one should be cautious in arguing that higher gold prices are being driven by inflation expectations.
Warning, Invalid line: Some have argued instead that gold’s long upward march has been partly driven by the development of new financial instruments that make it easier to trade and speculate in gold.
Warning, Invalid line: There is probably some slight truth – and also a certain degree of irony – to this argument.
Warning, Invalid line: After all, medieval alchemists engaged in what we now consider an absurd search for ways to transform base metals into gold.
Warning, Invalid line: Wouldn’t it be paradoxical, then, if financial alchemy could make an ingot of gold worth dramatically more?
Warning, Invalid line: In my view, the most powerful argument to justify today’s high price of gold is the dramatic emergence of Asia, Latin America, and the Middle East into the global economy.
Warning, Invalid line: As legions of new consumers gain purchasing power, demand inevitably rises, driving up the price of scarce commodities.
Warning, Invalid line: At the same time, emerging-market central banks need to accumulate gold reserves, which they still hold in far lower proportion than do rich-country central banks. With the euro looking less appetizing as a diversification play away from the dollar, gold’s appeal has naturally grown.
Warning, Invalid line: So, yes, there are solid fundamentals that arguably support today’s higher gold price, although it is far more debatable whether and to what extent they will continue to support higher prices in the future.
Warning, Invalid line: Indeed, another critical fundamental factor that has been sustaining high gold prices might prove far more ephemeral than globalization.
Warning, Invalid line: Gold prices are extremely sensitive to global interest-rate movements.
Warning, Invalid line: After all, gold pays no interest and even costs something to store.
Warning, Invalid line: Today, with interest rates near or at record lows in many countries, it is relatively cheap to speculate in gold instead of investing in bonds.
Warning, Invalid line: But if real interest rates rise significantly, as well they might someday, gold prices could plummet.
Warning, Invalid line: Most economic research suggests that gold prices are very difficult to predict over the short to medium term, with the odds of gains and losses being roughly in balance.
Warning, Invalid line: It is therefore dangerous to extrapolate from short-term trends.
Warning, Invalid line: Yes, gold has had a great run, but so, too, did worldwide housing prices until a couple of years ago.
Warning, Invalid line: If you are a high-net-worth investor, a sovereign wealth fund, or a central bank, it makes perfect sense to hold a modest proportion of your portfolio in gold as a hedge against extreme events.
Warning, Invalid line: But, despite gold’s heightened allure in the wake of an extraordinary run-up in its price, it remains a very risky bet for most of us.
Warning, Invalid line: Of course, such considerations might have little influence on prices.
Warning, Invalid line: What was true for the alchemists of yore remains true today: gold and reason are often difficult to reconcile.
Warning, Invalid line: Last week Tony Blair, Jacques Chirac, and Gerhard Schroeder met in Berlin.
Warning, Invalid line: They departed pledging to revive Europe's growth.
Warning, Invalid line: We've heard that empty promise before.
Warning, Invalid line: Instead, the European Union needs a new direction.
Warning, Invalid line: I say this as leader of the party which has been at the forefront of Britain's engagement with Europe.
Warning, Invalid line: It was a Conservative government that first applied for membership in the early 1960's.
Warning, Invalid line: A Conservative government took the United Kingdom into the European Economic Community in 1973.
Warning, Invalid line: Margaret Thatcher worked with Jacques Delors to forge the Single Market in 1986.
Warning, Invalid line: So I have no doubt that Britain must remain influential within the Union.
Warning, Invalid line: But British policy towards the EU has often led to worse rather than better relations among member states.
Warning, Invalid line: Faced with a new EU initiative, our traditional response has often been to oppose it, vote against it, lose the vote, then sulkily to adopt it while blaming everyone else.
Warning, Invalid line: Many Europeans are sick of British vetoes.
Warning, Invalid line: So am I.
Warning, Invalid line: Of course there are basic requirements that all member states must accept.
Warning, Invalid line: Foremost are the four freedoms of the single market; free movement of goods, services, people and capital.
Warning, Invalid line: But a single market does not require a single social or industrial policy, far less a common taxation policy.
Warning, Invalid line: Allowing countries to pursue their own policies in these areas encourages competitiveness.
Warning, Invalid line: Forcing common standards means that Europe will fall further behind as member states shuffle their costs onto their neighbours.
Warning, Invalid line: Which areas should be applied to every member state, and which should be optional?
Warning, Invalid line: I believe that every member state should administer those policies that do not directly and significantly affect other member states.
Warning, Invalid line: In areas which serve their national interest, individual members should decide whether to retain wholly national control or whether to co‑operate with others.
Warning, Invalid line: The Union's members should form a series of overlapping circles: different combinations of members should be able to pool their responsibilities in different areas of their own choosing.
Warning, Invalid line: Precedents exist for this.
Warning, Invalid line: NATO has been flexible since its inception.
Warning, Invalid line: France signed up for membership but later refused to submit her armed forces to NATO's central command.
Warning, Invalid line: Similar flexibility exists with the Euro, the Schengen Agreement, and the Social Chapter.
Warning, Invalid line: These precedents can be extended.
Warning, Invalid line: So far, everyone has had to move forward together, with individual countries negotiating specific opt‑outs.
Warning, Invalid line: But since 1998, there has been a procedure within the Treaties - called enhanced co‑operation - that could allow some members to go ahead with further integration in a specific area without involving every other member.
Warning, Invalid line: Instead of individual member states having fraught negotiations to opt‑out of a new initiative, those that support it can simply opt‑in.
Warning, Invalid line: Countries that want to integrate further can do so.
Warning, Invalid line: They don't need to drag Britain and others kicking and screaming in their wake because the others are not compelled to join them.
Warning, Invalid line: In this way we can break free of the institutionalised tug of war that has characterised EU relations.
Warning, Invalid line: I am not talking about a two‑speed Europe.
Warning, Invalid line: That implies that we all agree on the destination and differ only about the speed of the journey.
Warning, Invalid line: I don't want to reach the destination that some of our partners may aspire to.
Warning, Invalid line: But I don't want to block their way.
Warning, Invalid line: There are some who say that this would mean a loss of influence on the part of those countries which choose not to integrate more closely.
Warning, Invalid line: But influence is not an end in itself - it is a means to an end.
Warning, Invalid line: Britain does not need a seat at the table when decisions on the Euro are taken.
Warning, Invalid line: Our economy has not been adversely affected by staying out.
Warning, Invalid line: Keeping the pound does not mean that we oppose the Euro, or hope for its failure.
Warning, Invalid line: The European Union should stop trying to do everything and concentrate on doing fewer things more effectively.
Warning, Invalid line: It should give member states the chance to develop an approach to Europe that suits their national traditions, within the EU framework.
Warning, Invalid line: It is on this basis that British Conservatives oppose the proposed constitution.
Warning, Invalid line: We disagree with many of its contents, of course, but also oppose the idea of having an EU constitution at all.
Warning, Invalid line: There is a world of difference between an association of nation states bound together by treaty, and a single entity, whether you call it a state or not, with its own legal personality, deriving its authority from its own constitution.
Warning, Invalid line: If this constitution were accepted in anything like the proposed form, the EU would gain many attributes and trappings of statehood: its own president and foreign minister, its own legal system.
Warning, Invalid line: The supremacy of EU law would derive not from Acts of national Parliaments but from a supra‑national constitution.
Warning, Invalid line: That is a radical change, not the mere tidying‑up exercise some suggest.
Warning, Invalid line: I do not believe it is right to make a change of such magnitude without specifically consulting the people on whose behalf we govern.
Warning, Invalid line: Elected parliaments do not own our liberties.
Warning, Invalid line: They safeguard them, and should not diminish those liberties without an explicit mandate.
Warning, Invalid line: Any proposal for a new constitution must be put to the British people and to the people in each EU member state.
Warning, Invalid line: BRUSSELS – Austerity alone cannot solve Europe's economic and financial crisis.
"/home/migue/Desktop/2.en" was successfully parsed as Trans text
** Warning: XML ouput may not have correct doc id for Trans format inputs
Total TER: NaN (0.0/0.0)
Number of calls to beam search: 0
Number of segments scored: 0
Number of shifts tried: 0

And GTM printed this to console: You should not be comparing equal runs. Exiting ...

miguelemosreverte commented 7 years ago

These where the files you tested, for future reference:

1.txt 2.txt

miguelemosreverte commented 7 years ago

Solved the problem where GTM would just now send the text to subprocess.PIPE. I had to add stderr=subprocess.PIPE. Now it works.