udibr / headlines

Automatically generate headlines to short articles
MIT License
525 stars 150 forks source link

Is GPU processing a prerequisite? #4

Open hipoglucido opened 8 years ago

hipoglucido commented 8 years ago

Hi. First of all, thanks a lot for your work. I am about to try your scripts and I wanted to now if I could run everything without using GPUs. I have a server with 40 CPUs. Will it run?

udibr commented 8 years ago

Yes it runs on CPU, especially if you already have a model and just want to do predictions. But I think you will save on your electricity bill by renting a machine with GPU on Amazon with spot price (as low as $0.08/yr) and saving the model after every iteration to S3 (so you can continue your work if you happen to lose the machine because of spot price changes.)

If you are using Theano you can configure it to use CPU for example:

import os
os.environ['THEANO_FLAGS'] = 'device=cpu,floatX=float32'
hipoglucido commented 8 years ago

Hello @udibr, I've reading about AWS using and I have decided to do what you said. Is there any specific AMI with pre-installed dependencies that you would recommend to run your project?

Thanks!

udibr commented 8 years ago

go to "Community AMIs and search for CUDA

hipoglucido commented 8 years ago

thanks for answering @udibr . Do you mean I should search in "shared AMIs"? I just want to be sure (I don't see the word 'Community' there)

udibr commented 8 years ago

https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#LaunchInstanceWizard:

nickrobinson commented 7 years ago

Just in case anyone runs across this issue AWS has launched a new Deep Learning AMI with everything you need to get started running this project.