mostafa-razavi / TranSFF

0 stars 0 forks source link

Neural Network #24

Open mostafa-razavi opened 4 years ago

mostafa-razavi commented 4 years ago

Hypothesis: If I train a NN with 2000 samples that are normally distributed centered around one reference simulation parameter set, the neural network will adequately represent other reference simulation parameter sets as well, at least for Neff.

Test: 1) Obtain ITIC points for select ITIC points 23DMB at five different parameter sets, i.e. sig_CH3, eps_CH3, sig_CH1, and eps_CH1. 2) Select an ITIC point 3) Determine 2000 normally distributed samples around mean (reference parameter set) with standard deviation of 0.015 A for sigma and 3 K for epsilon. 4) Obtain MBAR predictions for 2000 samples of each reference simulation 5) Construct a neural network for each reference simulation with the difference of sig_CH3, eps_CH3, sig_CH1, and eps_CH1 from reference parameter set as input variables and Neff as output variable. 6) Repeat 2-5 procedure for other ITIC points 7) Test each of the five neural networks using the samples of other four MBAR predictions. 8) Plot the results

mostafa-razavi commented 4 years ago

23DMB 4-10-10-10-1_200-20:

ref1="3.790-120.00_4.680-10.00" (normal distribution) ref2="3.820-120.00_4.720-18.00" (normal distribution) ref3="3.840-118.00_4.740-20.00" (normal distribution) ref4="3.780-123.00_4.730-25.00" (uniform distribution)

uniform and normal distribution comparison

fggf

132 (train: 13, test: 2) 12

1234 (train: 123, test: 4) 12

Notes:

1) When the NN is trained with input samples that are normally distributed, it has a good performance when test data is also normally distributed. If test data is uniformly distributedd, the performance is not good.

2) 1000 data and 2000 data gives similar performance. I need to determine the optimum number of data. 500 data is clearly not enough.

500, 1000, 2000 x

3) I need to train and test NN using uniform data and see if the performance is acceptable.

4) Including data from a second reference, improves the performance.

12 vs. 132

h

mostafa-razavi commented 4 years ago

Relationship between Neff and Zstd and Ustd

There is a strong relationship between Neff and Zstd and between Neff and Ustd, such that having the Neff, these values can be estimated easily using a simple interpolation.

Zstd vs Neff and Ustd vs Neff

hh

mostafa-razavi commented 4 years ago

NN cannot predict Zstd properly

Plot

mostafa-razavi commented 4 years ago

23DMB (Results_uniform_1234-x)

random_type="uniform" ref1="3.790-120.00_4.680-10.00" ref2="3.820-120.00_4.720-18.00" ref3="3.840-118.00_4.740-20.00" ref4="3.780-123.00_4.730-25.00" ref5="3.900-130.00_4.800-10.00" ref6="3.500-100.00_4.400-40.00"

Architecture: 10-10-10

1234-1234

Plot.pdf

Parity_all

1234-5

Plot.pdf

Parity_all

1234-6

Plot.pdf

Parity_all

mostafa-razavi commented 4 years ago

23DMB (Results_uniform_x-6)

random_type="uniform" ref1="3.790-120.00_4.680-10.00" ref2="3.820-120.00_4.720-18.00" ref3="3.840-118.00_4.740-20.00" ref4="3.780-123.00_4.730-25.00" ref5="3.900-130.00_4.800-10.00" ref6="3.500-100.00_4.400-40.00"

Architecture: 10-10-10

1-6

Parity_all Plot.pdf

2-6

Parity_all Plot.pdf

3-6

Parity_all Plot.pdf

4-6

Parity_all Plot.pdf

5-6

Parity_all Plot.pdf

6-6

Parity_all Plot.pdf

mostafa-razavi commented 4 years ago

23DMB (Results_uniform_x-5)

random_type="uniform" ref1="3.790-120.00_4.680-10.00" ref2="3.820-120.00_4.720-18.00" ref3="3.840-118.00_4.740-20.00" ref4="3.780-123.00_4.730-25.00" ref5="3.900-130.00_4.800-10.00" ref6="3.500-100.00_4.400-40.00"

Architecture: 10-10-10

1-5

Parity_all Plot.pdf

2-5

Parity_all Plot.pdf

3-5

Parity_all Plot.pdf

4-5

Parity_all Plot.pdf

5-5

Parity_all Plot.pdf

6-5

Parity_all Plot.pdf

mostafa-razavi commented 4 years ago

23DMB (Results_uniform_x-5 (Z-1)/rho)

random_type="uniform" ref1="3.790-120.00_4.680-10.00" ref2="3.820-120.00_4.720-18.00" ref3="3.840-118.00_4.740-20.00" ref4="3.780-123.00_4.730-25.00" ref5="3.900-130.00_4.800-10.00" ref6="3.500-100.00_4.400-40.00"

Architecture: 10-10-10

1-5

Parity_all

2-5

Parity_all

3-5

Parity_all

4-5

Parity_all

5-5

Parity_all

6-5

Parity_all

mostafa-razavi commented 4 years ago

1-1

Parity_all Plot.pdf

1-2

Parity_all Plot.pdf

1-3

Parity_all Plot.pdf

1-4

Parity_all Plot.pdf