JocysCom / TextToSpeech

Jocys.com Text To Speech Monitor and WoW Addon - Reads quests and chat messages with text-to-speech voices.
https://www.jocys.com/TTS
GNU Lesser General Public License v3.0
28 stars 11 forks source link

4k Resolution not supported #39

Closed bozio closed 4 years ago

bozio commented 4 years ago

Monitor Display doen't work at the resolution 3840 x 2160

ryankhart commented 4 years ago

I can confirm. This works on my 1440p monitor, but not my 4K TV. I'm happy to provide any diagnostic info if need be, but I'd need some instruction on how to do that.

wobbo commented 4 years ago

I have the same problem. It works in 2560x1440.

EJocys commented 4 years ago

I am wondering if 4K resolution is using Chroma Subsampling other than 4:4:4, which means that actual colours of some pixels are going to differ. We tested this plugin on RGB 8-bit panels with Chroma Subsampling 4:4:4 mode. How many bits (8, 10 or 12) are you using and can you find out Chroma Subsampling (4:4:4, 4:2:2 or 4:2:0) used in 4K mode (must be somewhere in video card settings)?

More about Chroma Subsampling 4:4:4 vs 4:2:2 vs 4:2:0: https://youtu.be/yinOtVTWJFY

ryankhart commented 4 years ago

I'm currently on a break from WoW right now for reasons unrelated to this issue, but I may test out this idea if I end up jumping into Shadowlands. (although Baldur's Gate 3 and Cyberpunk 2077 may keep me away from WoW for some time lol)

wobbo commented 4 years ago

My DUAL-GTX1060-3G offers 32-bit 8bpc 4:4:4, 4:2:2 and RGB.

EJocys commented 4 years ago

@wobbo:

Could you do a test inside the Monitor app:

  1. Open [Options] tab, open [Monitor: Display] tab
  2. Click [Create Image] button
  3. Click [Capture Image] button.
  4. If it works then "Results" text box will show: <message... If it fails then it should display the reason in "Status" text box.

image

Please check if you have these settings:

  1. Set GPU settings to: 8ppc, 4:4:4, RGB
  2. Please check if video card colour settings like contrast, brightness, gamma, etc. are set to defaults (do not distort colours).
  3. In WoW Graphics options, set resolution scaling at 4K to: 100%
  4. To make sure that colour line is not covered, In WoW addon settings, set LEFT and TOP position of colour pixel line to: 10
wobbo commented 4 years ago

Today I have a new set of gear. New monitor 3840x2160. Now offers Highest 32-bit, DisplayPort 1.4, 1.4 cable, 4k, 10bpc, YCbCr 444, 60Hz, HDR. This set did not solve the problem. I'm not going to carry out your assignment until Friday. Thank you for all your time.

_iiyama ProLite XB3288UHSU-B1_

wobbo commented 4 years ago

I tried it. But it didn't. I tried to change the I position. It's weird that the y is set to 200px but shows different:

image

wobbo commented 4 years ago

After a lot of testing I found out that it works until the reach of 3840x1919. If I set 3840x1920 It doesn't work anymore. I also tried the opposite, counting down from step four step 3840x2160 to 1000x2160. But that didn't matter. So it seems the X is not the problem.

Capture 001

EJocys commented 4 years ago

Thank you for testing. I hope to debug this app on 4K monitor on Friday and see if I can fix this issue.

wobbo commented 4 years ago

If you need more info or test, let me know.

EJocys commented 4 years ago

@wobbo

I've made some fixes on the Monitor application. For example: application was failing to capture image from screen at correct location if windows reported more than one screen (PC monitor). Now application looks for all screens and correct coordinates.

I've uploaded updated version here for you to test: https://www.jocys.com/files/other/JocysCom.TextToSpeech.Monitor_3.2.10.zip

I've added extra buttons on "Debug and Test" tab which will help to investigate further if updated version won't fix the problem.

image

wobbo commented 4 years ago

I am sorry, but where is the button "Debug and Test"?

EJocys commented 4 years ago

@wobbo: My mistake, I've meant "Debug and Tests" group box. I've added "Screen:" drop-down list and [Capture Screen & Save] button which captures selected "Screen:" to image file and opens folder in windows explorer. This allows to see what image application tries to analyse wen searching for colour pixels (encoded text message).

wobbo commented 4 years ago

I' m going to check this officer the new big update 14 October. Let's find out if the problem is solved or worse... ;-p

wobbo commented 4 years ago

Very bad news. You probably experience it yourself. A lot aren't working anymore or not even visible. At least the chat is still working.

Let's leave the 4k issue for a while and focus on the new program.

wobbo commented 4 years ago

VJocys solved #43, #44 and #45! Now I'm back with this one #39. Sorry I'm coming with so many issues. I even made a new one #46.

What can I do to help resolve this issue?

VJocys commented 4 years ago

Coloured pixel line In 3840x2160 Wow and TTS Monitor screenshot (TOP line in image below) is distorted.

Coloured pixel line must be single and clean (like BOTTOM one in image below). Correct start of the line - two examples - WoW addon creates second one example with each second pixel black (#000000):

#220000,#002200,#000022...
#220000,#000000,#002200,#000000,#000022,#000000...

Pixels

Because (if) coloured pixel line is distorted, TTS Monitor can't find and read it. Maybe there is something set in Video Card or Windows options... that leads to image distortion, resizing.

wobbo commented 4 years ago

I don't think Nvidia is the causing of this problem. I need to find out if there isn't option to make the UI keep 1:1xp or something. Maybe in the config.wtf?

line

wobbo commented 4 years ago

full windows

It keeps working fine until WoW reaches 3840×1919.

WoW UI Scale https://wow.gamepedia.com/UI_Scale

EJocys commented 4 years ago

@wobbo:

Great findings. It looks like addon have to un-scale frame (if possible) with pixels to a size which will produce pixel perfect image.

EJocys commented 4 years ago

@wobbo I will try to prevent scaling on TTS monitor test form.

wobbo commented 4 years ago

At the same time I want to create a new topic in the WoW forum. Only I have no idea how I can explain this...

VJocys commented 4 years ago

Coloured pixel line is distorted not only in WoW game, but in TTS Monitor too in PNG 3840x2160 screenshot (if screenshot itself is not distorted):

Pixels_TTS_Monitor

That means, that problem reaches beyond WoW game, and affects Windows programs too... at least, when WoW game is running.

wobbo commented 4 years ago

Do you mean it's not possible to solve this?

VJocys commented 4 years ago

My monitor is 2560x1440. I can theorise only, why 4K doesn't work. Both... Fullscreen and Windowed mode (in WoW game Display settings) doesn't work?

EJocys commented 4 years ago

I've tested TTS monitor on 4K. Made version TTS Monitor v3.3.6 DPI aware. Image test works now on scaled layout in Windows. VJocys will upload new version soon.

wobbo commented 4 years ago

Until then the maximum 16:9 aspect ratio is 3412 × 1919.

VJocys commented 4 years ago

New versions of TTS Monitor 3.3.6 (2020-10-25) uploaded.

wobbo commented 4 years ago

I didn't got it working yet. Here it's looking like nothing changed.

wobbo commented 4 years ago

new

wobbo commented 4 years ago

new no button

It seems the button is away.

VJocys commented 4 years ago

You need to enable "Dialogues, books, mail, etc." check-box in WoW Addon for "Stop" and "Play" buttons to be visible in WoW's Log frame.

WoW_Addon_Quests_Enabled

WoW Addon may not work still (because of distorted pixel line). But new version of TTS Monitor 3.3.6 (2020-10-25) may be able to read its own coloured pixel line on 4K monitors now... you can test that...

TTS Monitor > [Options] tab > [Monitor: Display] tab > click on [Create Image] button.

wobbo commented 4 years ago

By the way, thanks for helping me!

EJocys commented 4 years ago

I was able to replicate the problem on 4K monitor with WoW addon. Now it is just a case of finding finding how it could be resolved in the LUA code :).

VJocys commented 4 years ago

Updated WoW Addon to version 9.0.1.5 (2020-10-25)

XML: Fix for 4K monitors - coloured pixel line's "FontHeight" value fixed from "1" pt to "0.75" pt = 1px.

wobbo commented 4 years ago

YES, It works!

EJocys commented 4 years ago

@wobbo Thank you for your help.

Kind regards, Evaldas Jocys

VJocys commented 4 years ago

TTS Monitor and WoW Addon latest versions are always under [ Download ] link on these pages:

https://www.jocys.com/TTS https://github.com/JocysCom/TextToSpeech

https://www.jocys.com/Files/Software/JocysCom-TextToSpeech-WoW.zip