search

englianhu / ali-zonghui

🚄东方快车，🚄一带一路。分析财务产品盈亏报告、购物篮分析 https://gitee.com/englianhu
https://englianhu.wordpress.com
GNU General Public License v3.0
2 stars 1 forks source link

I tried to model few linear mixed models... #9

Open englianhu opened 4 years ago

englianhu commented 4 years ago

Video from awesomescreenshot.com

Click the link below to watch the video: https://www.awesomescreenshot.com/video/1547059?key=7be26eec34173b989d245d0d8b3f32ed

Running 3 days for above 3 models, existing hp PC (bought in 2015) unable support desktop visualization and running programming... need to buy a new PC when affort

englianhu commented 4 years ago

Screenshot_1

Best RAM You Can Buy Today Patriot Viper Steel DDR4-4400 (2x 8GB) ... Patriot Viper RGB DDR4-3600 (2x 8GB) ... Patriot Viper 4 DDR4-3400 (2x 8GB) ... Corsair Vengeance RGB Pro DDR4-3200 (4x 8GB) ... Patriot Viper Steel DDR4-3200 (2x 16GB) ... Patriot Viper Steel DDR4-3600 C18 (2x 32GB) ... G. ... Corsair Vengeance LPX DDR4-2666 (2x 8GB) Oct 20, 2020 Best RAM 2020: Fast, Cheap and RGB | Tom's Hardware

Nvidia GeForce RTX 3080. The best graphics card for PC gaming right now. ... Nvidia GeForce RTX 2070 Super. The best 4K graphics card for reasonable money. ... AMD Radeon RX 5700. The best 1440p graphics card… with a little work. ... AMD Radeon RX 5600 XT. ... Nvidia GeForce GTX 1660 Super. ... Nvidia GeForce GTX 1650 Super. Oct 21, 2020 The best graphics cards in 2020 | PC Gamer

Need to upgraded my equipement to enchance the efficiency...

englianhu commented 4 years ago

https://github.com/englianhu/binary.com-interview-question/issues/1 use sparklyr but believe dataset not high-volume, will apply to HFT in https://github.com/englianhu/binary.com-interview-question

> microbenchmark(
+     spark = 
+         smp2_sc %>% 
+             ml_linear_regression(Profit ~ .), 
+     normal = lm(Profit ~., smp2))
Unit: milliseconds
   expr       min         lq       mean    median        uq       max neval
  spark 3213.3874 3416.97000 3620.63197 3558.2209 3774.3810 5413.4950   100
 normal   24.5953   27.57015   29.66484   28.7103   30.0822   87.2707   100
> microbenchmark(
+     spark = 
+         smp2_sc %>% 
+             ml_linear_regression(Profit ~ .), 
+     normal = lm(Profit ~., smp2))
Unit: milliseconds
   expr       min         lq       mean     median         uq       max neval
  spark 3223.9533 3372.34675 3512.10774 3491.44990 3589.48430 4277.6933   100
 normal   25.6651   27.14775   28.81245   28.06895   29.51575   49.0671   100

here's reference to speed up lm:

englianhu commented 4 years ago

1) Upgrade to Win10 : https://www.microsoft.com/en-us/software-download/windows10

2) Wonder what specs use in https://rstudio.cloud

Asked in https://community.rstudio.com/t/specs-of-rstudio-cloud/87295?u=englianhu

3) Current Win10 single language edition need to upgrade to pro edition since unable support non-english.

Screenshot_1 already feedback to Microsoft.