Anti-aliasing not working

[GoogleCodeExporter]

Probably a graphics/windows driver issue, but an issue in 1.0.4 due to the 
removal of the proper fullscreen modes. AA works fine in 1.0.3.

Original issue reported on code.google.com by matbur...@gmail.com on 20 May 2010 at 10:41

[GoogleCodeExporter]

On FPE emulation mode for Z buffer its not possible to use AA due to d3d9s 
limitations. 
Make sure to use some of the other Z handling modes ...

Original comment by drkIIRaziel on 21 May 2010 at 8:16

[GoogleCodeExporter]

I'm using D24S8+FPE in 1.0.3, and AA works.

Original comment by matbur...@gmail.com on 21 May 2010 at 8:55

[GoogleCodeExporter]

Either way the problem does not have to do with how fullscreen switching is 
treated.
The "proper fullscreen" thing you're referring to does not really exist. :p

Original comment by Mr.PsyMan on 21 May 2010 at 9:59

[GoogleCodeExporter]

Fair enough. Proving me wrong doesn't make AA work though :p

Original comment by matbur...@gmail.com on 21 May 2010 at 2:01

[GoogleCodeExporter]

Without knowing the technical details, switching to fullscreen in 1.0.3 gets 
Vsync 
and AA working, whereas in windowed mode they don't.

In 1.0.4, neither work in fullscreen or windowed mode (vsync works if Aero 
theme is 
on in Vista/Win7).

Original comment by matbur...@gmail.com on 21 May 2010 at 2:20

[GoogleCodeExporter]

Did you try 1.0.4 with different Z modes?

Original comment by KrossX3 on 21 May 2010 at 9:24

[GoogleCodeExporter]

I haven't, because they're lower precision. If it works in 1.0.3 then it ought 
to be 
able to work in 1.0.4 really.

Original comment by matbur...@gmail.com on 21 May 2010 at 9:58

[GoogleCodeExporter]

Except, i don't think the FPE mode was in 1.0.3 (was it ?). Anyway, FPE (or 
D24FS8 in 
fallback mode) *disable* AA as part of the direct3d9 specs. If it worked on 
1.0.3 it 
was a bug on your driver, or a different Z mode.

You can read more about it in http://msdn.microsoft.com/en-
us/library/bb172915(VS.85).aspx , in particular: 

"If you are multisampling and write to oDepth, since the pixel shader only runs 
once 
per pixel, your depth value is replicated for all covered sub-sample locations. 
The 
depth test still happens per-sample, but you don't have a per-sample depth 
value 
going into the comparison from the pixel shader like you would have if you 
didn't 
write oDepth."

Thats why i want to move to dx10 hardware that supports floating depth 
natively, but 
psyman has old hardware :|

Original comment by drkIIRaziel on 22 May 2010 at 9:12

[GoogleCodeExporter]

IF you own an nvidia product, use nhancer to create a profile for nulldc and 
enable
one of the Dx9 AA compatibility profiles that end with a 5.

Original comment by danialho...@gmail.com on 22 May 2010 at 3:59

[GoogleCodeExporter]

that said,  do not use any of the xS modes, they will absolutely kill 
performance.

Original comment by danialho...@gmail.com on 22 May 2010 at 4:00

[GoogleCodeExporter]

Thanks for the explanation drkIIRaziel, oddly though D24S8+FPE is an option in 
1.0.3 
(and the one I use) so I'm not sure what's happening there.

Thanks for the tip danialhorton, I'll give that a try.

Original comment by matbur...@gmail.com on 22 May 2010 at 9:38

[GoogleCodeExporter]

It does improve nearly all surfaces, but i can't tell if its the MSAA component 
or
the Coverage Sampling doing it.  Drk thinks its just the coverage sampling, but 
it
does get rid of alot of the jaggies.

Original comment by danialho...@gmail.com on 23 May 2010 at 11:33

Attachments:

• [nullDC 2010-05-23 04-26-20-69.jpg](https://storage.googleapis.com/google-code-attachments/nulldc/issue-65/comment-12/nullDC 2010-05-23 04-26-20-69.jpg)
• [nullDC 2010-05-23 04-28-59-64.jpg](https://storage.googleapis.com/google-code-attachments/nulldc/issue-65/comment-12/nullDC 2010-05-23 04-28-59-64.jpg)

[GoogleCodeExporter]

Just to confirm that. AA doesn't work for me either and it worked back in 1.0.3.

Original comment by rompecal...@gmail.com on 1 Jun 2010 at 10:53

[GoogleCodeExporter]

I have problems with Anti-aliasing too.

I try all Z modes and AA not work for me.

In NullDC 1.0.3 all was fine. ;)

Original comment by Metal.So...@yandex.ru on 1 Jun 2010 at 11:38

[GoogleCodeExporter]

Is anti-aliasing a built-in feature of NullDC or can it only be enabled through 
Nvidia 
CP or nhancer?

Original comment by ravikgup...@gmail.com on 4 Jun 2010 at 11:02

[GoogleCodeExporter]

Same here: I CAN enable AA via nHancer in 1.0.3 (Z buffer D24S8 mode2) But 
can't in 
1.0.4 :(

Original comment by animus...@mail.ru on 5 Jun 2010 at 6:33

[GoogleCodeExporter]

YOU'RE DOING IT WRONG.

'IF you own an nvidia product, use nhancer to create a profile for nulldc and 
enable
one of the Dx9 AA compatibility profiles that end with a 5.'

Or, if thats too high level for you low level beings, JUST ENABLE THE 
FARCRY2/DUNIA AA COMPATIBILITY.

Original comment by danialho...@gmail.com on 14 Jun 2010 at 10:07

[GoogleCodeExporter]

And what if I've got an ATI video card? It's actually a X1950 XTX chipset and 
what worked for me in 1.0.3 (forcing AA in AtiTrayTools) doesn't seem to work 
anymore in 1.0.4 versions.

Original comment by rompecal...@gmail.com on 15 Jun 2010 at 1:47

[GoogleCodeExporter]

then you're fucked because ATI sucks. oh well.

Original comment by danialho...@gmail.com on 18 Jun 2010 at 1:21

[GoogleCodeExporter]

Danial, your opinion does not solve, help, or shed light on anything. I don't 
know what your problem with ATI is or what experiences you've had with it in 
the past (or if you're just a part of an ATI hate bandwagon), but keep it to 
yourself.

Now, I've created a profile for nullDC 1.0.4 r50 and have the Z-Buffer on 
D24FS8, but due to my lack of knowledge with the ATI Catalyst program, I'm 
pretty sure I'm doing something wrong. Perhaps someone can alleviate the matter 
for me and maybe other ATI users?

Original comment by deletion...@gmail.com on 24 Jun 2010 at 4:18

[GoogleCodeExporter]

I've got an Nvidia card and even with nHancer settings, nulldc nullDC 1.0.4 
revisions (even r50) don't allow Anti-aliasing!!
1.0.3 working OK though... is this difficult to fix? I guess I'll stick to 
1.0.3 for now »_«

Original comment by Tuga...@gmail.com on 24 Jun 2010 at 6:50

[GoogleCodeExporter]

I had the same problems with an HD4670. I have AA enabled on the card, but 
doesnt seems to apply on nulldc, already tried every Z-Buffer mode.

Its a shame cause it would look so smooth and nice with AA...but its not that 
bad anyways.

Original comment by alforata@gmail.com on 24 Jun 2010 at 7:46

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

I can confirm what danialhorton said about nHancer (2.5.9) working to enable AA 
in r50. I tried all Z-buffer methods and saw AA in each.

I can't seem to post attachments so here are the pics.

Without AA
http://www.abload.de/img/nulldc_win32_release-nxe9h.png
http://www.abload.de/img/nulldc_win32_release-nld8u.jpg

With 8xMSAA
http://www.abload.de/img/nulldc_win32_release-nbh93.png
http://www.abload.de/img/nulldc2010-07-2504-38-bed4.jpg

With 16xQ
http://www.abload.de/img/nulldc2010-07-2504-21-leob.png
http://www.abload.de/img/nulldc2010-07-2504-21-hflw.png

I took a performance hit with AA in fullscreen mode however with each 
successive AA mode, but got a solid 60fps in windowed mode. I have nVidia 
GeForce 8800GT with Forceware 197.45 drivers.

Original comment by spectref...@gmail.com on 25 Jul 2010 at 11:45

[GoogleCodeExporter]

No AA here either. Radeon HD5750, on Windows 7 x64.

Original comment by vittau%i...@gtempaccount.com on 6 Aug 2010 at 6:05

[GoogleCodeExporter]

Okay this issue has been very fustrating especially for ati owners. I know 
because trial and error i tried using version 1.03 no luck and messing with 
video settings
did not have any luck getting AA to work but maybe a solution i tried using the 
other emulator DEMUL it sucks but it alows me to force AA in the control center 
is there some way nulldc could borrow info from demul on this situation?

hd 4770 
amd 7750
4gb ram
 thx for nulldc keep up the awesome work

Original comment by buritob...@hotmail.com on 11 Aug 2010 at 6:50

[GoogleCodeExporter]

As i have said before, AA only works with some depth modes. A dx10 plugin is in 
the works that will fix the problem, be patient til then, kk ?

Original comment by drkIIRaziel on 12 Aug 2010 at 12:20

[GoogleCodeExporter]

Actually, this might be fixed by r54 using the new Z mode (well, or at least 
worked around)

Original comment by drkIIRaziel on 12 Aug 2010 at 6:48

[GoogleCodeExporter]

...Ok, this cant be good:

http://i34.tinypic.com/1znsfux.png

r54 plugin set to the new magical depth mode (lol), and already tried with the 
texture options and bla bla blah, that's the least "wrong" I got it to look.

This new Depth mode did not fix the FSAA on my HD4670, already tried some 
games, but...also, destroyed the depth on some games like Jet Set Radio. The 
other depth modes still work with minor graphical errors on our ATIs...like the 
cars textures and some random shadows errors on Shibuya.

Original comment by alforata@gmail.com on 13 Aug 2010 at 9:28

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

It's not the videocard driver bug!
I also got lots of  Graphic glitch and Texture missing with the r54 new Z 
buffer mode--- "Magic blue smoke"  (Tested GDI: SOUL CALIBUR and TOKYO HIGHWAY 
CHANLLENGE)
I am using the NVS3100M card with latest driver.

Original comment by ke.chenk...@gmail.com on 13 Aug 2010 at 2:04

[GoogleCodeExporter]

Bad news...I tested r54 and... I have problem too, with the new Z buffer mode 
"Magic blue smoke" many bugs!!!Yes I can confirm it. But maybe we need a new 
issue for that. Who knows?

I deleted my comment. I was not right, sorry. Looks like something wrong with 
the new  Z buffer :(

I use Nvidia9800gt

Original comment by N2008eo...@rambler.ru on 13 Aug 2010 at 2:29

[GoogleCodeExporter]

AA always works for my pc as far as i know.Been using it from the graphics 
driver control panel.My pc specs,win7x64,gtx470(258.96 driver)

Original comment by jinsatoemo@yahoo.com on 15 Aug 2010 at 3:33

[GoogleCodeExporter]

well i already figured that all nvidia users have no problems with AA or AF
but the users that have ATI cards i know for a fact they all dont have anti 
aliasing with this program. I am not really sure but i think its somthing to do 
with the way each brand of cards render shaders like raytracing and steroscopic 
i really hope this problem gets fixed i absoluty love shenmue but i dont want 
to spoil the goodness without AA

Original comment by buritob...@hotmail.com on 15 Aug 2010 at 3:42

[GoogleCodeExporter]

by the way i get 55-60+ fps all the time with this emulator awesome work

Original comment by buritob...@hotmail.com on 15 Aug 2010 at 3:44

[GoogleCodeExporter]

I get no AA in 1.0.4 in any mode with a GTX 275, Win 7 64.

Worked fine in 1.0.3.

Original comment by cstanley...@gmail.com on 8 Sep 2010 at 4:27

[GoogleCodeExporter]

Issue 146 has been merged into this issue.

Original comment by drkIIRaziel on 20 Oct 2010 at 10:52

[GoogleCodeExporter]

I tested both ATI and Nvidia in vista and win7.
No problem about AF.
But about AA in 1.0.4., I could not find way to enable it.

Original comment by iori3...@hanafos.com on 17 Dec 2010 at 5:57

[GoogleCodeExporter]

Still waiting for fix, shenmue critically needs AA )) 

Original comment by Belobruh...@gmail.com on 18 Dec 2010 at 6:46

[GoogleCodeExporter]

get an emulation friendly graphics card.

Original comment by danialho...@gmail.com on 11 Mar 2011 at 2:45

[GoogleCodeExporter]

@danialho

Like that has anything to do with the No AA issue. I bought 3 ati cards for my 
gamming rig in the time it is taking to get back AA in Null. They are more than 
capable of any emulation I wish to throw at my rig. This is just down to poor 
bloody laziness.... nothing more. I apreciate the work on this emualtor but 90% 
of the new svn's do nothing and just cause more problems that previous verions 
didn't even have. How about just sorting the AA issue out first, which is far 
more important than most of the shit people are complaining about. It's a joke 
that it is taking so damn long to be honest.  I'm done with NullDC till it's 
sorted out.

Yes! I get that poeple with nvidia cards can override the AA problem but alot 
of us have ati so sort it out please and fast would be nice

Original comment by braders-...@hotmail.co.uk on 26 Mar 2011 at 6:13

[GoogleCodeExporter]

I have a Geforce and AA doesn't not work for me. Trying to force AA in the 
nVidia control panel doesn't work.

Original comment by gitaroo...@gmail.com on 19 Apr 2011 at 7:21

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

Well i have Ati and i always use antialiasing with nulldc without problem. I 
tested it with radeon 5670 and now i have a radeon 6850 and it works great too. 
I am uploading movies of nulldc emulation with radeon cards and AA enabled on 
youtube, check this one for example: http://www.youtube.com/watch?v=yjK5P0K1x9c

Anyway the latest catlyst control centers have the "morphological filtering" 
option that can be enabled to override AA, it works great (it's similar to a 4X 
maa).

Original comment by MC.DREAM...@gmail.com on 10 Jun 2011 at 1:29

[GoogleCodeExporter]

Btw i am on win7 64 bit and for me AA works in any 1.0.4 revision i tried.

Original comment by MC.DREAM...@gmail.com on 10 Jun 2011 at 4:09

[GoogleCodeExporter]

This issue is not for post processing AA filters, which is what MLAA is. 

Original comment by KrossX3 on 11 Jun 2011 at 12:25

[GoogleCodeExporter]

Yeah this issue is not for post processing AA filters but have you understood 
what i said? For me enabling AA trough CCC works (not morphological) on any 
1.0.4 revision i tried (the movie i linked was made with r119 with 4X adaptive 
multi sample AA).
Then i mentioned morphological filter as a suggestion for users who can't use 
AA, but the point is that on my system it just works. I am attaching 2 pics: 
they are about shenmue 2 running on my system: the first is with 4X 
supersample, the second with morphological filtering, this to prove that AA 
just works fine here.

Original comment by MC.DREAM...@gmail.com on 11 Jun 2011 at 1:34

Attachments:

• 4Xss.jpg
• morphological.jpg

[GoogleCodeExporter]

another method to turn on AA, FXAA

http://www.neogaf.com/forum/showthread.php?t=439293&page=2

I tried it and it works, I think you can get the source code here

http://timothylottes.blogspot.com/

maybe it can be integrated into the emu option.

Original comment by gitaroo...@gmail.com on 1 Aug 2011 at 11:06

[GoogleCodeExporter]

i found the solution for aa working in ATI CARDS under new versions of the emu.
Rename the nulldc exe to  UT3.EXE  ,  now you can aply supersampling aa, or 
multisampling , and with great performance under a hd5850.

now this issue could be closed.

Original comment by heltonsi...@gmail.com on 14 Apr 2012 at 7:23