[Inductor] [CPU] Accuracy failure in timm model cait_m36_384 on WW03.2

[ESI-SYD]

🐛 Describe the bug

Compare with the ww02.4, there is a accuracy failure on Timm model cait_m36_384 on TorchInductor CPU Performance Dashboard on ww03.2:

WW03.2 SW info:

SW	Nightly commit	Master/Main commit
Pytorch	868797a	d41b5d7
Torchbench	/	bbdc777
torchaudio	ecc2781	4a037b0
torchtext	112d757	c7cc5fc
torchvision	ac06efe	35f68a0
torchdata	049fb62	c0934b9
dynamo_benchmarks	fac4361	/

WW02.4 SW info:

SW	Nightly commit	Master/Main commit
Pytorch	466be3f	364f526
Torchbench	/	bbdc777
torchaudio	ecc2781	4a037b0
torchtext	112d757	c7cc5fc
torchvision	ac06efe	35f68a0
torchdata	049fb62	c0934b9
dynamo_benchmarks	fac4361	/

Error logs

cpu  eval  cait_m36_384                       [2023-01-16 07:57:33,035] torch._dynamo.utils: [ERROR] RMSE (res-fp64): 0.66366, (ref-fp64): 0.00000 and shape=torch.Size([4, 1000])
FAIL

Minified repro

python -m torch.backends.xeon.run_cpu --core_list 0 --ncores_per_instance 1 benchmarks/dynamo/timm_models.py --accuracy --float32 -dcpu -n50 --inductor  --no-skip --dashboard --only cait_m36_384

[Guobing-Chen]

Fixed with PR#92299