gqqnbig / cs145project

0 stars 2 forks source link

在云端运行任务 #22

Closed gqqnbig closed 5 years ago

gqqnbig commented 5 years ago

决策树的训练和预测时间在30分钟到1小时,浮动范围较大。可能跟当前CPU或硬盘负载有关。

考虑在云端运行,这样可以一边做别的事一边运行。

gqqnbig commented 5 years ago

创建了永久免费的f1-micro实例,但是内存只有 0.6G,直接被out-of-memory killer杀了

guqq0717@data-mining:~/cs145project/src$ ./DecisionTree.py
(131162, 2014, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0)
Killed
guqq0717@data-mining:~/cs145project/src$ egrep -i 'killed process' /var/log/syslog
Nov 16 06:02:36 data-mining kernel: [   98.883425] Killed process 786 (python3) total-vm:928280kB, anon-rss:471436kB, file-rss:100kB, shmem-rss:0kB
Nov 16 06:03:00 data-mining kernel: [  123.479951] Killed process 789 (python3) total-vm:928280kB, anon-rss:471424kB, file-rss:96kB, shmem-rss:0kB
gqqnbig commented 5 years ago
sudo apt update
sudo apt-get install git
sudo apt-get install python3
sudo apt install --yes python3-pip 
sudo pip3 install kaggle
python3 -m pip install sklearn
python3 -m pip install matplotlib

git config --global user.email 'gqqnb2005@gmail.com'
git config --global user.name 'gqqnbig'
#let git remember my password
git config --global credential.helper cache 

git clone https://github.com/magicmonty/bash-git-prompt.git ~/.bash-git-prompt --depth=1
# follow https://github.com/magicmonty/bash-git-prompt#via-git-clone

git clone https://gqqnbig@github.com/gqqnbig/LinuxSetup.git
ln LinuxSetup/.vimrc .vimrc
vim .vimrc
mkdir .kaggle
vim .kaggle/kaggle.json
chmod 600 ~/.kaggle/kaggle.json

git clone https://gqqnbig@github.com/gqqnbig/cs145project.git