[Intel][IvyBridge] IMC third timings are wrongly decoded

[cyring]

Memory controller third timings are wrongly decoded on Core i7-3770K

Trying several BIOS values reveals settings are changed in MCHBAR register 0x4008. Unfortunately specs about this register are reserved; and my current bits layout was guessed from setting values

Your bit specifications are welcomed -;)

[cyring]

Results from commit 597c0bbc9c87c9c18cef90771f0f127389d4e548

[cyring]

@svmlegacy Hello,

Could you test the develop branch with your SandyBridge, IvyBridge and check if third timings are same as BIOS settings ?

[svmlegacy]

@svmlegacy Hello,

Could you test the develop branch with your SandyBridge, IvyBridge and check if third timings are same as BIOS settings ? 2600.txt 3770K.txt

All of the BIOS settings on this motheboard match, except for the memory speed. Board is running at 1067, but 1333 is reported (coincidentally that is the maximum module speed, non-XMP.)

I'll be trying the 2600 with a second motherboard which I believe has better reporting of third timings in BIOS, but unfortunately it is a Sandy Bridge only board, B2 stepping P67.

[svmlegacy]

Should have added this picture too. Valid for both processors tested.

[cyring]

@svmlegacy Thank you

It's odd, we're not getting the DIMM geometry. I have tested it also with 3770K same Chipset PCI ID as you can see above.

I have to debug it but I might be slow to answer the next 3 weeks

[cyring]

@svmlegacy

I think the missing DIMM topology is due to a regression I have introduced in this commit 977f36efd70276c7f34e663bc0a4975f1510bc4e

This was pleasing my IVB 3770K setup (to match with the SMBIOS SMB_MEM_1_PARTNUMBER and SMB_MEM_3_PARTNUMBER strings) but not with all the others cases tested so far.

EDIT ~If you could test from the previous commit 2994d49e40c86b39017f6c4205612de9d6449a05~ can you test latest develop branch: your 2600 and 3770K should show the topology again ?

[cyring]

@svmlegacy Hello, Can you test with develop branch and show the IMC output? Thank you

Remark : there's a geometry regression fix in latest commit.

[svmlegacy]

@svmlegacy Hello, Can you test with develop branch and show the IMC output? Thank you

Remark : there's a geometry regression fix in latest commit.

Hello,

Changes are good on my motherboard for Ivy: Develop-3770K-2022-09-25.txt

Still isn't identifying the current clock rate (1067 MHz), but is pulling the maximum module speed in XMP now (2133 MHz).

I'll pull my Haswell board out once we're happy with Ivy & Sandy... Currently in the middle of reorganizing...

[cyring]

Still isn't identifying the current clock rate (1067 MHz), but is pulling the maximum module speed in XMP now (2133 MHz).

Is this what you're expecting ?

                           Panther Point  [ 150]                           
Controller #0                                                Dual Channel  
 Bus Rate  2133 MT/s       Bus Speed 2128 MT/s           DDR3 Speed 1067 MHz

 Cha    CL  RCD   RP  RAS  RRD  RFC   WR RTPr WTPr  FAW  B2B  CWL CMD  REFI
  #0     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160
  #1     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160
      ddWR drWR srWR ddRW drRW srRW ddRR drRR srRR ddWW drWW srWW CKE   ECC
  #0     1    2    3    3    3    3    2    1    4    3    1    0   3    0 
  #1     1    2    3    3    3    3    2    1    4    3    1    0   3    0 

 DIMM Geometry for channel #0                                              
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8   
 DIMM Geometry for channel #1                                              
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8   

To debug, can you add this trace: https://github.com/cyring/CoreFreq/blob/757fc90d04320a9e63da15c84a5a1783914ade5c/corefreqd.c#L3494

    printf( "DMFC[%x]\n", RO(Proc)->Uncore.Bus.SNB_Cap.DMFC );
    switch (RO(Proc)->Uncore.Bus.SNB_Cap.DMFC) {

[cyring]

@svmlegacy To make things easier, I'm providing this attached version with the debug traces I need CoreFreq_develop.tar.gz

This version is also making use of a DIMM A SELECT bit to map correctly the DIMM slots.

Please build, run and post the output of traces and IMC.

Fyi, here's my IvyBrige results where DIMM A is the farthest slot from processor socket

corefreqd -q
[IVB] DMFC[5]
[SNB] FSB_Select[4]

corefreq-cli -M
                           Panther Point  [ 150]                           
Controller #0                                                Dual Channel  
 Bus Rate  1867 MHz       Bus Speed 1867 MHz           DDR3 Speed 1867 MT/s

 Cha    CL  RCD   RP  RAS  RRD  RFC   WR RTPr WTPr  FAW  B2B  CWL CMD  REFI
  #0     9   10    9   27    8  150   16    8    8   36    0    8  2T  7280
  #1     9   10    9   27    8  150   16    8    8   36    0    8  2T  7280
      ddWR drWR srWR ddRW drRW srRW ddRR drRR srRR ddWW drWW srWW CKE   ECC
  #0     1    1    3    3    3    3    3    1    4    3    1    4   5    0 
  #1     1    1    3    3    3    3    3    1    4    3    1    4   5    0 

 DIMM Geometry for channel #0                                              
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                
       #0                                                                  
       #1     8    1     32768      1024           4096  CMZ8GX3M2A1866C9  
 DIMM Geometry for channel #1                                              
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                
       #0                                                                  
       #1     8    1     32768      1024           4096  CMZ8GX3M2A1866C9  

[cyring]

@svmlegacy Hello, Any chance to get results from above request ? Regards

[svmlegacy]

I was able to get this today. Looks like good results!

Is this what you're expecting ?

I'm not sure exactly what the bus rate and bus speed should be, but certainly the DDR3 speed should be 1067 MT/s in my case. While my RAM is capable of 2133, it isn't running at that speed at this time.

CoreFreq Daemon 1.92.1  Copyright (C) 2015-2022 CYRIL INGENIERIE
[IVB] DMFC[5]
[SNB] FSB_Select[3]

corefreq-cli -M
                           Panther Point  [ 150]                           
Controller #0                                                Dual Channel  
 Bus Rate  2133 MHz       Bus Speed 2128 MHz           DDR3 Speed 2133 MT/s

 Cha    CL  RCD   RP  RAS  RRD  RFC   WR RTPr WTPr  FAW  B2B  CWL CMD  REFI
  #0     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160
  #1     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160
      ddWR drWR srWR ddRW drRW srRW ddRR drRR srRR ddWW drWW srWW CKE   ECC
  #0     1    2    3    3    3    3    2    1    4    3    1    0   3    0 
  #1     1    2    3    3    3    3    2    1    4    3    1    0   3    0 

 DIMM Geometry for channel #0                                              
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8   
 DIMM Geometry for channel #1                                              
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8   

[cyring]

@svmlegacy

I'm not sure exactly what the bus rate and bus speed should be, but certainly the DDR3 speed should be 1067 MT/s in my case. While my RAM is capable of 2133, it isn't running at that speed at this time.

So let's try RAM_Select first, FSB_Select second.

Here's the version to test the current DDR speed:

CoreFreq_develop.tar.gz

[cyring]

@svmlegacy FYI, in the latest archive, above, there is no trace. This version just focuses on providing you the right DRAM frequency. So only the IMC output will be enough. Thank you

[cyring]

@svmlegacy latest code is now available in the development branch. Hope there is no regression on your side and it fixes your current DRAM frequency ?

[svmlegacy]

Pulled develop up to date as of this afternoon. Still seeing "maximum" DIMM frequency.

[cyring]

Pulled develop up to date as of this afternoon. Still seeing "maximum" DIMM frequency.

Thank you. EDIT: I'm now able to reproduce the current DRAM frequency issue. I'm not finding a specific register for your frequency. Do you have other software which are able to retrieve 1067 ?

[cyring]

@svmlegacy Hello

Can you pull and test latest develop branch: Register BIOS DDR Mem Clock (0x5e00) which is specified in Haswell is apparently also working on Ivy Bridge:

Remark: I have no SandyBridge, Haswell and Broadwell to test with, in case if you have some ?

[svmlegacy]

Good news! I am now seeing the current DDR3 speed with the 3770K

$ ./corefreq-cli -M

                           Panther Point  [ 150]                                                                                                                                    
Controller #0                                                Dual Channel                                                                                                           
 Bus Rate  1064 MHz       Bus Speed 1061 MHz           DDR3 Speed 1064 MT/s                                                                                                         

 Cha    CL  RCD   RP  RAS  RRD  RFC   WR RTPr WTPr  FAW  B2B  CWL CMD  REFI                                                                                                         
  #0     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160                                                                                                         
  #1     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160                                                                                                         
      ddWR drWR srWR ddRW drRW srRW ddRR drRR srRR ddWW drWW srWW CKE   ECC                                                                                                         
  #0     1    2    3    3    3    3    2    1    4    3    1    0   3    0                                                                                                          
  #1     1    2    3    3    3    3    2    1    4    3    1    0   3    0                                                                                                          

 DIMM Geometry for channel #0                                                                                                                                                       
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                                                                                                                         
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8                                                                                                            
 DIMM Geometry for channel #1                                                                                                                                                       
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                                                                                                                         
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8       

Will test Sandy & Haswell soon.

[svmlegacy]

Also good on Sandy (Intel Core i7-2600):

$ ./corefreq-cli -M
                         P67/Cougar Point  [ 100]                                                                                                                                  
Controller #0                                                Dual Channel                                                                                                           
 Bus Rate  1064 MHz       Bus Speed 1061 MHz           DDR3 Speed 1064 MT/s                                                                                                         

 Cha    CL  RCD   RP  RAS  RRD  RFC   WR RTPr WTPr  FAW  B2B  CWL CMD  REFI                                                                                                         
  #0     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160                                                                                                         
  #1     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160                                                                                                         
      ddWR drWR srWR ddRW drRW srRW ddRR drRR srRR ddWW drWW srWW CKE   ECC                                                                                                         
  #0     1    1    3    3    3    3    2    1    4    3    1    4   3    0                                                                                                          
  #1     1    1    3    3    3    3    2    1    4    3    1    4   3    0                                                                                                          

 DIMM Geometry for channel #0                                                                                                                                                       
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                                                                                                                         
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8                                                                                                            
 DIMM Geometry for channel #1                                                                                                                                                       
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                                                                                                                         
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8                                                                                                            

[cyring]

Also good on Sandy (Intel Core i7-2600):

Thanks for the answer.

Meanwhile, I have found the DRAM PLL bit which means frequency is now computed based on BIOS FSB, DRAM ratio: 100:133 or 100:100

Precision is also improved and unit changed to MHz.

You should now read: DDR3 Speed 1066 MHz

[svmlegacy]

                          P67/Cougar Point  [ 100]                                                                                                                                  
Controller #0                                                Dual Channel                                                                                                           
 Bus Rate  1066 MHz       Bus Speed 1063 MHz           DDR3 Speed 1066 MHz                                                                                                          

 Cha    CL  RCD   RP  RAS  RRD  RFC   WR RTPr WTPr  FAW  B2B  CWL CMD  REFI                                                                                                         
  #0     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160                                                                                                         
  #1     7    7    7   20    4  139    8    4    4   16    0    6  1T  4160                                                                                                         
      ddWR drWR srWR ddRW drRW srRW ddRR drRR srRR ddWW drWW srWW CKE   ECC                                                                                                         
  #0     1    1    3    3    3    3    2    1    4    3    1    4   3    0                                                                                                          
  #1     1    1    3    3    3    3    2    1    4    3    1    4   3    0                                                                                                          

 DIMM Geometry for channel #0                                                                                                                                                       
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                                                                                                                         
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8                                                                                                            
 DIMM Geometry for channel #1                                                                                                                                                       
      Slot Bank Rank     Rows   Columns    Memory Size (MB)                                                                                                                         
       #0     8    2     32768      1024           8192  CM3X8GA2133C9D8                                                                                                            

Changes look good and are valid for my motherboard!

[cyring]

Changes look good and are valid for my motherboard!

Thank you very much helping to improve SNB & IVB. With the new Registers better mastered, I'm now providing same enhancements for HSW & BDW in issue #346

[cyring]

@svmlegacy I have back-ported IMC code from HSW

Using develop branch, you should now read the same geometry on SNB as HSW