search

GrimSqueaker / remc2

Recode Binary code of game Magic Carpet2 to C/C++ language(remake MC2 for any platform)
6 stars 0 forks source link

Testing regressions #81

Open turican0 opened 3 years ago

turican0 commented 3 years ago

This week I add to engine procedures for regressions testing.

Script will run game compiled with special commands, they will compare data with first 20 frame from begin level1. After exit this game, script will be continue with compare 20 frames from level2, and next.

We can later too add samples from custom levels, too.

We can test x86 and x64 versions.

At now I program only the necessary functions and gradually collect samples of data from the levels.

turican0 commented 3 years ago

I add regression testing (at now for level 1). You can compile game with #define TEST_REGRESSIONS_GAME and run testRegressions.bat or testRegressions_wxcopy.bat. Later I add data for next levels. Tom.

turican0 commented 3 years ago

Level1 x86 - OK Level1 x64 - OK Level2 x86 - OK Level2 x64 - OK Level3 x86 - OK Level3 x64 - OK Level4 x86 - OK Level4 x64 - OK Level5 x86 - OK Level5 x64 - OK Level6 x86 - OK Level6 x64 - OK Level7 x86 - OK Level7 x64 - OK Level8 x86 - OK Level8 x64 - OK Level9 x86 - OK Level9 x64 - OK Level10 x86 - OK Level10 x64 - OK Level11 x86 - OK Level11 x64 - OK Level12 x86 - OK Level12 x64 - OK Level13 x86 - OK Level13 x64 - OK Level14 x86 - OK Level14 x64 - OK Level15 x86 - OK Level15 x64 - OK Level16 x86 - OK Level16 x64 - OK Level17 x86 - OK Level17 x64 - OK Level18 x86 - OK Level18 x64 - OK Level19 x86 - OK Level19 x64 - OK Level20 x86 - OK Level20 x64 - OK Level21 x86 - OK Level21 x64 - OK Level22 x86 - failed(not problem this is random differences) Level22 x64 - failed(not problem this is random differences) Level23 x86 - OK Level23 x64 - OK Level24 x86 - OK Level24 x64 - OK Level25 x86 - OK Level25 x64 - OK HiddenLevel1 x86 - OK HiddenLevel1 x64 - ? HiddenLevel2 x86 - OK HiddenLevel2 x64 - ? HiddenLevel3 x86 - OK HiddenLevel3 x64 - ? HiddenLevel4 x86 - OK HiddenLevel4 x64 - ? HiddenLevel5 x86 - OK HiddenLevel5 x64 - ? MultiplayerLevel1 x86 - OK MultiplayerLevel2 x86 - failed MultiplayerLevel3 x86 - OK MultiplayerLevel4 x86 - OK MultiplayerLevel5 x86 - OK MultiplayerLevel6 x86 - OK MultiplayerLevel7 x86 - OK MultiplayerLevel8 x86 - OK MultiplayerLevel9 x86 - OK MultiplayerLevel10 x86 - OK

turican0 commented 3 years ago

Please when find any error in Level1(x86 or x64) write it.