empty dashboard

[nicolasbriant]

When using ice, my dashboard has no data. ICE is installed on ubuntu server and I access the webpage from my laptop. So it complains about " found 0 in billing bucket ", although the aws billing file exists and is in the correct format. The bucket is accessible as files are copied to it ie:reservation_prices.threeyear I am not sure where to look from here.

Here is the output of the console: Running Grails application 2014-02-20 16:19:37,544 [main] INFO http11.Http11Protocol - Initializing ProtocolHandler ["http-bio-8080"] 2014-02-20 16:19:37,741 [main] INFO core.StandardService - Starting service Tomcat 2014-02-20 16:19:37,779 [main] INFO core.StandardEngine - Starting Servlet Engine: Apache Tomcat/7.0.30 2014-02-20 16:19:39,319 [localhost-startStop-1] INFO startup.ContextConfig - No global web.xml found 2014-02-20 16:19:40,100 [localhost-startStop-1] INFO [localhost].[/ice] - Initializing Spring root WebApplicationContext 2014-02-20 16:19:59,688 [localhost-startStop-1] INFO scaffolding.DefaultGrailsTemplateGenerator - Scaffolding template generator set to use resource loader org.codehaus.groovy.grails.commons.spring.GrailsWebApplicationContext@5d36d1d7: startup date [Thu Feb 20 16:19:55 UTC 2014]; parent: Root WebApplicationContext 2014-02-20 16:20:06,387 [localhost-startStop-1] INFO context.GrailsConfigUtils - [GrailsContextLoader] Grails application loaded. 2014-02-20 16:20:06,763 [localhost-startStop-1] INFO BootStrap - Starting ice... 2014-02-20 16:20:13,455 [localhost-startStop-1] INFO basic.BasicReservationService - poller thread for com.netflix.ice.basic.BasicReservationService started... 2014-02-20 16:20:13,459 [com.netflix.ice.basic.BasicReservationService] INFO basic.BasicReservationService - poller starting... 2014-02-20 16:20:13,465 [localhost-startStop-1] INFO processor.ProcessorConfig - starting up... 2014-02-20 16:20:13,465 [localhost-startStop-1] INFO processor.BillingFileProcessor - poller thread for com.netflix.ice.processor.BillingFileProcessor started... 2014-02-20 16:20:13,467 [com.netflix.ice.processor.BillingFileProcessor] INFO processor.BillingFileProcessor - poller starting... 2014-02-20 16:20:13,467 [com.netflix.ice.processor.BillingFileProcessor] INFO processor.BillingFileProcessor - trying to list objects in billing bucket tpmbilling using assume role, and external id 2014-02-20 16:20:14,247 [localhost-startStop-1] INFO basic.BasicManagers - trying to find new tag group and data managers... 2014-02-20 16:20:17,030 [com.netflix.ice.processor.BillingFileProcessor] INFO processor.BillingFileProcessor - found 0 in billing bucket tpmbilling 2014-02-20 16:20:17,030 [com.netflix.ice.processor.BillingFileProcessor] INFO processor.BillingFileProcessor - AWS usage processed. 2014-02-20 16:20:17,030 [com.netflix.ice.basic.BasicManagers] INFO basic.BasicManagers - poller starting... 2014-02-20 16:20:17,031 [com.netflix.ice.basic.BasicManagers] INFO basic.BasicManagers - trying to find new tag group and data managers... 2014-02-20 16:20:17,030 [localhost-startStop-1] INFO basic.BasicManagers - poller thread for com.netflix.ice.basic.BasicManagers started... 2014-02-20 16:20:18,434 [localhost-startStop-1] INFO [localhost].[/ice] - Initializing Spring FrameworkServlet 'grails' 2014-02-20 16:20:18,859 [main] INFO http11.Http11Protocol - Starting ProtocolHandler ["http-bio-8080"] | Server running. Browse to http://localhost:8080/ice 1392913288854

[nfonrose]

Hi,

On Thu, Feb 20, 2014 at 5:27 PM, nicolasbriant notifications@github.comwrote:

When using ice, my dashboard has no data. ICE is installed on ubuntu server and I access the webpage from my laptop. So it complains about " found 0 in billing bucket ", although the aws billing file exists and is in the correct format. The bucket is accessible as files are copied to it ie:reservation_prices.threeyear

On question regarding the bucket(s). Are you talking about 1 or 2 different buckets here ?

• In the sentence "0 files in billing bucket refers", you are making a reference to the "AWS Programmatic Billing bucket" in which AWS writes the billing files.
• Regarding the "reservation_prices.threeyear" file, it is written in the "Ice working bucket"

Ideally these buckets should be different one from the other (or at least, the working bucket should be in a "sub directory" inside the billing bucket).

So depending on whether you have 1 or 2 buckets, you might want to check the rights (read and write).

I am not sure where to look from here.

A few questions to try to help :

• Do you see Ice complaining about anything in the logs ? It doesn't look like it's having a problem based on the log extract you've copied in the email.
• Are there any files created by Ice in the working bucket ?
• How many files do you have (created by AWS) in the AWS Programmatic Billing Bucket ? Are they large ?
• How long have you waited between starting Ice and looking at the dashboard ? Sometimes the process of loading and processing the data can be a bit long.

Nicolas Fonrose | Teevity | Founder +33.6.61.35.43.31 http://www.teevity.com - Cloud Costs Analytics built on NetflixOSS twitter - @nfonrose / @teevity

[nicolasbriant]

Hi Nicolas

Thanks for getting back to me! I have 2 buckets: tpmbilling which has the AWS billing files, they are all below 1Mb : 279964749469-aws-billing-csv-2014-02.csv 279964749469-aws-billing-detailed-line-items-2014-02.csv.zip 279964749469-aws-billing-detailed-line-items-with-resources-and-tags-2014-02.csv.zip 279964749469-aws-cost-allocation-2014-02.csv

Tpmbilling2 which has these 4 files generated: reservation_prices.threeyear.FIXED reservation_prices.threeyear.FIXED reservation_prices.threeyear.FIXED reservation_prices.threeyear.FIXED

Both buckets have read and right access.

I waited for “Server running. Browse to http://localhost:8080/ice” before login to the webpage. Although, it says to log on to localhost, I use the internal IP to connect from my laptop. Where can I find additional logs?

Nic

[nicolasbriant]

Ah I got it to work. Problem seems to be permissions on the bucket or its files. I moved the files to a new bucket and changed the ice properties. Now it works, I will have to check again permissions on original bucket. Thanks again for your help

[nfonrose]

On Fri, Feb 21, 2014 at 2:44 PM, nicolasbriant notifications@github.comwrote:

Ah I got it to work. Problem seems to be permissions on the bucket or its files. I moved the files to a new bucket and changed the ice properties. Now it works, I will have to check again permissions on original bucket. Thanks again for your help

Great !

Nicolas Fonrose | Teevity | Founder +33.6.61.35.43.31 http://www.teevity.com - Cloud Costs Analytics twitter - @nfonrose / @teevity

Teevity selected as a StartupZone company for Structure Europe 2013 !

http://event.gigaom.com/structureeurope/startupzone/