senisioi / NeuralTextSimplification

Exploring Neural Text Simplification
72 stars 23 forks source link

What is considered the best simplification result? #3

Open baragona opened 7 years ago

baragona commented 7 years ago

Which of these is the best general purpose model to use for text simplification? Is there any way to improve the result grammatical quality? Thank you!

Inputs:

A jet aircraft is an aircraft propelled by jet engines.
A jet engine is a reaction engine discharging a fast-moving jet that generates thrust by jet propulsion.
An engine or motor is a machine designed to convert one form of energy into mechanical energy.
An aircraft is a machine that is able to fly by gaining support from the air.

Outputs:

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5
A jet aircraft is an aircraft propelled by jet engines. .
A jet engine is a reaction engine .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. .
An aircraft is a machine that is able to fly by gaining support from the air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h1
A jet aircraft is an aircraft propelled by jet engines. .
A jet engine is a reaction engine .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. .
An aircraft is a machine that is able to fly by gaining support from the air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h2
A jet aircraft is an aircraft by jet aircraft .
A jet engine is a reaction engine that generates thrust by jet engines .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. into mechanical energy. .
An aircraft is a machine that is able to get support from the air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h3
A jet aircraft is an aircraft propelled by jet engines. by jet engines. .
A jet engine is a jet engine that generates thrust by jet engines .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. ( mechanical energy. ) into mechanical energy. .
An aircraft is a machine that is able to fly by gaining support from the air. air. .

/root/NeuralTextSimplification/results_NTS/result_NTS_epoch11_10.19.t7_5_h4
A jet aircraft is an aircraft that is propelled by jet engines. .
A jet engine is a small reaction engine that generates thrust by jet engines .
An engine or motor is a machine designed to convert one form of energy into mechanical energy. ( mechanical energy. ) .
An aircraft is a machine that is able to run by gaining support from the air. .
senisioi commented 6 years ago

I am still looking into ways to generate better output or to aggregate what we already have. From what I've seen the second hypothesis is the best. h1 is very conservative, making small changes, sometimes containing the same content as the input, while h3 and h4 are sometimes ungrammatical.

ankit201 commented 5 years ago

@ojotoxy What is test.en and test.sen used? Did you use the pre-trained model, in that case, what was the torch version used?