Code4HR / tasks

Running issue list for our brigade
http://tasks.code4hr.org
3 stars 2 forks source link

Open Budget #25

Closed BretFisher closed 10 years ago

BretFisher commented 10 years ago

Sample Sites: http://lookatcook.com http://openbudgetoakland.org

bschoenfeld commented 10 years ago

:thumbsup:

bschoenfeld commented 10 years ago

Probably should be it's own task, but we should do this for HRT's budget too. It would be interesting to see where funding comes from, how it has changed over the years, and how it stacks up against ridership.

I know that Dave Forster, the transportation reporter for the Pilot, would be interested in having better access to this data for articles like this - http://hamptonroads.com/2013/11/tide-ridership-below-openingyear-numbers

kmcurry commented 10 years ago

:thumbsup:

re: "Probably should be it's own task,"

Yeah and also interesting to consider there are types of distinct, major budgets: city, school division, transportation authority, etc.

Is there published data that we can catalog in the data portal, liberate from PDFs and and hack on tonight?

jalbertbowden commented 10 years ago

published city or hrt data? hrt data i believe is on hrt dash

On Wednesday, November 13, 2013, Kevin Curry wrote:

[image: :thumbsup:]

re: "Probably should be it's own task,"

Yeah and also interesting to consider there are types of distinct, major budgets: city, school division, transportation authority, etc.

Is there published data that we can catalog in the data portal, liberate from PDFs and and hack on tonight?

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-28426479 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

bschoenfeld commented 10 years ago

There is data to be liberated!

Finance Data - details how service in each city is funded.

Operations Data - Daily on time performance by route, daily ridership numbers by transit mode, accidents, maintenance, and customer complaints (2012 data categorizes complaints)

kmcurry commented 10 years ago

We received data from the city in 3 Excel files:

Per @jalbertbowden's comment on a C4HRVA email thread, these files are too big to upload to our CKAN. It looks like OpenBudget Oakland might be using CKAN as the catalog but the data are stored in Socrata. I'll try to check on that. Anyone can ping them to find out.

kmcurry commented 10 years ago

Hmm...I seem to have just uploaded the largest file:

http://data.codeforhamptonroads.org/dataset/city-of-virginia-beach-budget/resource/6f37ffb3-a265-4e26-bb61-318ea0937900

Only there's no handler for xlsx (and also the data are formatted in the file for budget view/print)

jalbertbowden commented 10 years ago

are these uploaded in google drive?

how can i access the big files?

On Tue, Dec 17, 2013 at 9:21 AM, Kevin Curry notifications@github.comwrote:

Hmm...I seem to have just uploaded the largest file:

http://data.codeforhamptonroads.org/dataset/city-of-virginia-beach-budget/resource/6f37ffb3-a265-4e26-bb61-318ea0937900

Only there's no handler for xlsx (and also the data are formatted in the file for budget view/print)

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-30754121 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

qwo commented 10 years ago

I took some of the data that Kevin got and broke them down. https://github.com/stanzheng/openbudgetvb Theres Revenue & Expenditures for 2009-2014 and Position (guessing specific department pay) for 2010-2014.

Trying to find a smartway to parse this info maybe worth while. A lot of the documents are marked up with "Gov Max 5"

Some googling reveals its an OMB standard passed in for city and counties to report at a federal level.

Software: https://max.omb.gov/maxportal/home.do Law: http://www.whitehouse.gov/omb/gils_gils1

Examining other Gov Max reports, they have similar if not identical formatting and export structure.

Taking the current malformed marked up data and being able to parse it correctly could be beneficial to other counties/cities around the US.

My two cents reporting in.

Anyone working on something similar on the national scale?

jalbertbowden commented 10 years ago

where is all of this data? google drive?

i would hesitate doing anything until openbudget people respond. if they ever do. the trick is for me not to inquire, then something will actually happen.

On Fri, Dec 20, 2013 at 5:56 AM, Stanley Zheng notifications@github.comwrote:

I took some of the data that Kevin got and broke them down. https://github.com/stanzheng/openbudgetvb Theres Revenue & Expenditures for 2009-2014 and Position (guessing specific department pay) for 2010-2014.

Trying to find a smartway to parse this info maybe worth while. A lot of the documents are marked up with "Gov Max 5"

Some googling reveals its an OMB standard passed in for city and counties to report at a federal level.

https://max.omb.gov/maxportal/home.do

Examining other Gov Max reports, they have similar if not identical formatting and export structure.

Taking the current malformed marked up data and being able to parse it correctly could be beneficial to other counties/cities around the US.

My two cents reporting in

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31002362 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

BretFisher commented 10 years ago

I would hesitate to hesitate :) Experimentation is key.

On Fri, Dec 20, 2013 at 10:06 AM, albert notifications@github.com wrote:

where is all of this data? google drive?

i would hesitate doing anything until openbudget people respond. if they ever do. the trick is for me not to inquire, then something will actually happen.

On Fri, Dec 20, 2013 at 5:56 AM, Stanley Zheng notifications@github.comwrote:

I took some of the data that Kevin got and broke them down. https://github.com/stanzheng/openbudgetvb Theres Revenue & Expenditures for 2009-2014 and Position (guessing specific department pay) for 2010-2014.

Trying to find a smartway to parse this info maybe worth while. A lot of the documents are marked up with "Gov Max 5"

Some googling reveals its an OMB standard passed in for city and counties to report at a federal level.

https://max.omb.gov/maxportal/home.do

Examining other Gov Max reports, they have similar if not identical formatting and export structure.

Taking the current malformed marked up data and being able to parse it correctly could be beneficial to other counties/cities around the US.

My two cents reporting in

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31002362> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31015347 .

jalbertbowden commented 10 years ago

experimentation is key, but not when you already have a repo you are going to fork and use.

go ahead and experiment....learn something. my point is that i wouldn't waste too much time parsing/displaying any of the data...that's already been done. just needs to be plugged in.

stanley's investigation is following a route similar to mine....there's a method to all of this...we somehow are just not getting the big picture. va beach spits out csv....is that a generic csv or some goverment/accounting/whatever csv format that everyone uses?

vb was spitting out pdfs, kevin got them to convert to csv...the rest of the localities use pdf. can we get them to do the same? not including getting them to buy in, just focusing on converting the data. is this process repeatable or unique for vb?

tons and tons of questions.

On Fri, Dec 20, 2013 at 10:44 AM, Bret Fisher notifications@github.comwrote:

I would hesitate to hesitate :) Experimentation is key.

On Fri, Dec 20, 2013 at 10:06 AM, albert notifications@github.com wrote:

where is all of this data? google drive?

i would hesitate doing anything until openbudget people respond. if they ever do. the trick is for me not to inquire, then something will actually happen.

On Fri, Dec 20, 2013 at 5:56 AM, Stanley Zheng notifications@github.comwrote:

I took some of the data that Kevin got and broke them down. https://github.com/stanzheng/openbudgetvb Theres Revenue & Expenditures for 2009-2014 and Position (guessing specific department pay) for 2010-2014.

Trying to find a smartway to parse this info maybe worth while. A lot of the documents are marked up with "Gov Max 5"

Some googling reveals its an OMB standard passed in for city and counties to report at a federal level.

https://max.omb.gov/maxportal/home.do

Examining other Gov Max reports, they have similar if not identical formatting and export structure.

Taking the current malformed marked up data and being able to parse it correctly could be beneficial to other counties/cities around the US.

My two cents reporting in

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31002362> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31015347> .

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31018217 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

BretFisher commented 10 years ago

the csv's came from a product called govmax. VB Budget office gave us something they thought might be useful. They are new to this to, so it's up to us to decide what we can do with it, and what else we should ask them for. i doubt there is some all wonderful standard here that allows for plug and play. we need to figure out what we want to do with the data, what questions we want to answer, and then VB budget office will help change the way they give us this data to make it easier for us to use.

I doubt there is a manual to all this. If you have the hunger then I recommend keep searching for answers, talking to people, and reporting back here for us all to benefit.

I have no contacts to other city budget managers... but I'd say lets know how to deal with one city's data before we go knocking on others. I bet once we do something interesting with VB budget, others will come knocking.

On Fri, Dec 20, 2013 at 10:53 AM, albert notifications@github.com wrote:

experimentation is key, but not when you already have a repo you are going to fork and use.

go ahead and experiment....learn something. my point is that i wouldn't waste too much time parsing/displaying any of the data...that's already been done. just needs to be plugged in.

stanley's investigation is following a route similar to mine....there's a method to all of this...we somehow are just not getting the big picture. va beach spits out csv....is that a generic csv or some goverment/accounting/whatever csv format that everyone uses?

vb was spitting out pdfs, kevin got them to convert to csv...the rest of the localities use pdf. can we get them to do the same? not including getting them to buy in, just focusing on converting the data. is this process repeatable or unique for vb?

tons and tons of questions.

On Fri, Dec 20, 2013 at 10:44 AM, Bret Fisher notifications@github.comwrote:

I would hesitate to hesitate :) Experimentation is key.

On Fri, Dec 20, 2013 at 10:06 AM, albert notifications@github.com wrote:

where is all of this data? google drive?

i would hesitate doing anything until openbudget people respond. if they ever do. the trick is for me not to inquire, then something will actually happen.

On Fri, Dec 20, 2013 at 5:56 AM, Stanley Zheng < notifications@github.com>wrote:

I took some of the data that Kevin got and broke them down. https://github.com/stanzheng/openbudgetvb Theres Revenue & Expenditures for 2009-2014 and Position (guessing specific department pay) for 2010-2014.

Trying to find a smartway to parse this info maybe worth while. A lot of the documents are marked up with "Gov Max 5"

Some googling reveals its an OMB standard passed in for city and counties to report at a federal level.

https://max.omb.gov/maxportal/home.do

Examining other Gov Max reports, they have similar if not identical formatting and export structure.

Taking the current malformed marked up data and being able to parse it correctly could be beneficial to other counties/cities around the US.

My two cents reporting in

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31002362> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31015347> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31018217> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31018993 .

qwo commented 10 years ago

Hey Albert.

The data currently lies on the data portal. http://data.codeforhamptonroads.org/dataset/city-of-virginia-beach-budget They're in .xlxs and i broke them into single sheet csvs and labeled them.

Oakland's data is @ http://data.openoakland.org/dataset/city-of-oakland-budget/resource/eb483353-7556-4169-859d-4805eb25b2b4 There Tools/Some Documentation is @ http://openbudgetoakland.org/toolsprojects.html

Bret I was interested in how well adopted govmax is in the US. The oakland budget format is not very aligned to the dataset we currently have. And judging from research they spent a day and screen scraped it.

A step maybe to contact the vendor at maxsupport@omb.eop.gov to request if theres a better way to do what we hope to accomplish.

(export budget years stylesly or in a native csv format)

I think any research right now is still valuable since non of us are budget experts. The only investment is my time :)

Anyway lemme know what you folks think I think we're sitting on a better dataset than the folks at oakland got

kmcurry commented 10 years ago

I uploaded the 3 spreadsheets to:

http://data.codeforhamptonroads.org/dataset/city-of-virginia-beach-budget

Stanley also converted them to CSV and put them in github.

But they are both still in a report layout format. That's the real rub.

On Fri, Dec 20, 2013 at 10:06 AM, albert notifications@github.com wrote:

where is all of this data? google drive?

i would hesitate doing anything until openbudget people respond. if they ever do. the trick is for me not to inquire, then something will actually happen.

On Fri, Dec 20, 2013 at 5:56 AM, Stanley Zheng notifications@github.comwrote:

I took some of the data that Kevin got and broke them down. https://github.com/stanzheng/openbudgetvb Theres Revenue & Expenditures for 2009-2014 and Position (guessing specific department pay) for 2010-2014.

Trying to find a smartway to parse this info maybe worth while. A lot of the documents are marked up with "Gov Max 5"

Some googling reveals its an OMB standard passed in for city and counties to report at a federal level.

https://max.omb.gov/maxportal/home.do

Examining other Gov Max reports, they have similar if not identical formatting and export structure.

Taking the current malformed marked up data and being able to parse it correctly could be beneficial to other counties/cities around the US.

My two cents reporting in

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31002362> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31015347 .

Kevin Curry Advisor, Civic Hacker Code for America http://brigade.codeforamerica.org

Couldn't join us at the 2013 Code for America Summit? Watch the videos herehttp://www.youtube.com/user/CodeforAmerica to see what you missed.

qwo commented 10 years ago

@kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

Edit: Misread, thought you meant add them to the dataportal. disregard

jalbertbowden commented 10 years ago

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng notifications@github.comwrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31050377 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

bschoenfeld commented 10 years ago

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng <notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31051500 .

qwo commented 10 years ago

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld notifications@github.comwrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng <notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500> .

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31052581 .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

jalbertbowden commented 10 years ago

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng notifications@github.comwrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld notifications@github.comwrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31054648 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

jalbertbowden commented 10 years ago

i'm setting this email i been working on into my drafts and i'll address other thoughts later.

my primary thought at this moment is that we already have this data. i've said that a million times. so here's a million and one: i have collected all of the available hrva budget data that is online. and i've converted all of it into multiple formats.

we do not need a government connection, an independent study, nor a hackathon to accomplish this. knowing what i know now, i'll have it done before the hackathon. with help, much, much sooner. using oakland's template, all that needs to be done, and has needed to be done, is actually going through the documents to get the proper data.

fyi i forked the repo months ago and its already populated with norfolks and and york countys data.

On Fri, Dec 20, 2013 at 9:38 PM, J. Albert Bowden jalbertbowden@gmail.comwrote:

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng notifications@github.comwrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld notifications@github.comwrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31054648 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

BretFisher commented 10 years ago

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

Hope that helps. Sorry I haven't made time to dive into this project lately.

Bret

On Fri, Dec 20, 2013 at 10:51 PM, albert notifications@github.com wrote:

i'm setting this email i been working on into my drafts and i'll address other thoughts later.

my primary thought at this moment is that we already have this data. i've said that a million times. so here's a million and one: i have collected all of the available hrva budget data that is online. and i've converted all of it into multiple formats.

we do not need a government connection, an independent study, nor a hackathon to accomplish this. knowing what i know now, i'll have it done before the hackathon. with help, much, much sooner. using oakland's template, all that needs to be done, and has needed to be done, is actually going through the documents to get the proper data.

fyi i forked the repo months ago and its already populated with norfolks and and york countys data.

On Fri, Dec 20, 2013 at 9:38 PM, J. Albert Bowden jalbertbowden@gmail.comwrote:

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng notifications@github.comwrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld < notifications@github.com>wrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31054648> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31056075 .

jalbertbowden commented 10 years ago

that only adds to my frustration that you don't have time for the project.

i do. and i have.

you guys couldn't be bothered earlier with open budget. then you can't be bothered to talk to me about it, even though i'm the only one actively involved in it. now you want to make decisions in regards to it. but oh wait, you have no time.

again, i have all the time in the world.

i share everything i do with this group. yet two people had no clue i had done anything.

how is any of this possible?

On Sat, Dec 21, 2013 at 12:44 AM, Bret Fisher notifications@github.comwrote:

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

  • we reverse engineer cook and oakland and match the govmax output we got from VB until we're satisfied with the results. Basically a small site that replicates some if not all of the featureset of those existing apps. Sure we may have their code, but until our data is 1:1 we may not be able to do all they do.
  • We'll likely need to go back for more data with VB Budget Office. If memory serves, cook/oakland had many spreadsheets/pdf's to pull from. We just need to know what to ask for. It could be a working meeting where we all stare at cook/oakland with VB City staff and click around until we stumble on something we're missing from VB. Then Budget Office goes back (they have a data person) and works on creating the data we need.
  • Once we feel like we know how we want the data to be dumped from Budget System X, we document it better and stand it up as the format we like in order to produce our clones of cook/oakland.
  • Other brigades stand in awe of our hard work and persistence, and fork it often.
  • We slowly improve it over time. watching what other cities and brigades do with it.
  • Whatever of these holes aren't filled, we make Code Across Challenges. If it's magically all done in the next two months, then we come up with new challenges for the data and take it to 11 at Code Across.

Hope that helps. Sorry I haven't made time to dive into this project lately.

Bret

On Fri, Dec 20, 2013 at 10:51 PM, albert notifications@github.com wrote:

i'm setting this email i been working on into my drafts and i'll address other thoughts later.

my primary thought at this moment is that we already have this data. i've said that a million times. so here's a million and one: i have collected all of the available hrva budget data that is online. and i've converted all of it into multiple formats.

we do not need a government connection, an independent study, nor a hackathon to accomplish this. knowing what i know now, i'll have it done before the hackathon. with help, much, much sooner. using oakland's template, all that needs to be done, and has needed to be done, is actually going through the documents to get the proper data.

fyi i forked the repo months ago and its already populated with norfolks and and york countys data.

On Fri, Dec 20, 2013 at 9:38 PM, J. Albert Bowden jalbertbowden@gmail.comwrote:

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng < notifications@github.com>wrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld < notifications@github.com>wrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31054648> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31056075> .

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31057448 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

qwo commented 10 years ago

Albert I along with everyone appreciate your enthusiasm and contribution to this project.

As in regards to openoaklands code.

Much of it is similar to mbostock's d3 treemap. I see a lot of the oakland code pointed to a 'treemap.js'.

We talked about a shared tech implementation last night.

Hopefully by the end of the weekend I can get a rudimentary treemap by shaping some of the data we have existing.

https://github.com/mbostock/d3/wiki/Treemap-Layout http://bl.ocks.org/mbostock/4063582

If you'd like to try this with the Norfolk or York County data feel free.

Also if your datas already scraped and formed well, I dunno if you've uploaded it to openspending. https://openspending.org/ some of the sources.

Bests,

On Sat, Dec 21, 2013 at 10:54 AM, albert notifications@github.com wrote:

that only adds to my frustration that you don't have time for the project.

i do. and i have.

you guys couldn't be bothered earlier with open budget. then you can't be bothered to talk to me about it, even though i'm the only one actively involved in it. now you want to make decisions in regards to it. but oh wait, you have no time.

again, i have all the time in the world.

i share everything i do with this group. yet two people had no clue i had done anything.

how is any of this possible?

On Sat, Dec 21, 2013 at 12:44 AM, Bret Fisher notifications@github.comwrote:

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

  • we reverse engineer cook and oakland and match the govmax output we got from VB until we're satisfied with the results. Basically a small site that replicates some if not all of the featureset of those existing apps. Sure we may have their code, but until our data is 1:1 we may not be able to do all they do.
  • We'll likely need to go back for more data with VB Budget Office. If memory serves, cook/oakland had many spreadsheets/pdf's to pull from. We just need to know what to ask for. It could be a working meeting where we all stare at cook/oakland with VB City staff and click around until we stumble on something we're missing from VB. Then Budget Office goes back (they have a data person) and works on creating the data we need.
  • Once we feel like we know how we want the data to be dumped from Budget System X, we document it better and stand it up as the format we like in order to produce our clones of cook/oakland.
  • Other brigades stand in awe of our hard work and persistence, and fork it often.
  • We slowly improve it over time. watching what other cities and brigades do with it.
  • Whatever of these holes aren't filled, we make Code Across Challenges. If it's magically all done in the next two months, then we come up with new challenges for the data and take it to 11 at Code Across.

Hope that helps. Sorry I haven't made time to dive into this project lately.

Bret

On Fri, Dec 20, 2013 at 10:51 PM, albert notifications@github.com wrote:

i'm setting this email i been working on into my drafts and i'll address other thoughts later.

my primary thought at this moment is that we already have this data. i've said that a million times. so here's a million and one: i have collected all of the available hrva budget data that is online. and i've converted all of it into multiple formats.

we do not need a government connection, an independent study, nor a hackathon to accomplish this. knowing what i know now, i'll have it done before the hackathon. with help, much, much sooner. using oakland's template, all that needs to be done, and has needed to be done, is actually going through the documents to get the proper data.

fyi i forked the repo months ago and its already populated with norfolks and and york countys data.

On Fri, Dec 20, 2013 at 9:38 PM, J. Albert Bowden jalbertbowden@gmail.comwrote:

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng < notifications@github.com>wrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld < notifications@github.com>wrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377>

.

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31054648> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31056075> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31057448> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

—

Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31065915 .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

jalbertbowden commented 10 years ago

that addresses nothing i touched on.

thanks for coming out

On Sat, Dec 21, 2013 at 11:24 AM, Stanley Zheng notifications@github.comwrote:

Albert I along with everyone appreciate your enthusiasm and contribution to this project.

As in regards to openoaklands code.

Much of it is similar to mbostock's d3 treemap. I see a lot of the oakland code pointed to a 'treemap.js'.

We talked about a shared tech implementation last night.

Hopefully by the end of the weekend I can get a rudimentary treemap by shaping some of the data we have existing.

https://github.com/mbostock/d3/wiki/Treemap-Layout http://bl.ocks.org/mbostock/4063582

If you'd like to try this with the Norfolk or York County data feel free.

Also if your datas already scraped and formed well, I dunno if you've uploaded it to openspending. https://openspending.org/ some of the sources.

Bests,

On Sat, Dec 21, 2013 at 10:54 AM, albert notifications@github.com wrote:

that only adds to my frustration that you don't have time for the project.

i do. and i have.

you guys couldn't be bothered earlier with open budget. then you can't be bothered to talk to me about it, even though i'm the only one actively involved in it. now you want to make decisions in regards to it. but oh wait, you have no time.

again, i have all the time in the world.

i share everything i do with this group. yet two people had no clue i had done anything.

how is any of this possible?

On Sat, Dec 21, 2013 at 12:44 AM, Bret Fisher notifications@github.comwrote:

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

  • we reverse engineer cook and oakland and match the govmax output we got from VB until we're satisfied with the results. Basically a small site that replicates some if not all of the featureset of those existing apps. Sure we may have their code, but until our data is 1:1 we may not be able to do all they do.
  • We'll likely need to go back for more data with VB Budget Office. If memory serves, cook/oakland had many spreadsheets/pdf's to pull from. We just need to know what to ask for. It could be a working meeting where we all stare at cook/oakland with VB City staff and click around until we stumble on something we're missing from VB. Then Budget Office goes back (they have a data person) and works on creating the data we need.
  • Once we feel like we know how we want the data to be dumped from Budget System X, we document it better and stand it up as the format we like in order to produce our clones of cook/oakland.
  • Other brigades stand in awe of our hard work and persistence, and fork it often.
  • We slowly improve it over time. watching what other cities and brigades do with it.
  • Whatever of these holes aren't filled, we make Code Across Challenges. If it's magically all done in the next two months, then we come up with new challenges for the data and take it to 11 at Code Across.

Hope that helps. Sorry I haven't made time to dive into this project lately.

Bret

On Fri, Dec 20, 2013 at 10:51 PM, albert notifications@github.com wrote:

i'm setting this email i been working on into my drafts and i'll address other thoughts later.

my primary thought at this moment is that we already have this data. i've said that a million times. so here's a million and one: i have collected all of the available hrva budget data that is online. and i've converted all of it into multiple formats.

we do not need a government connection, an independent study, nor a hackathon to accomplish this. knowing what i know now, i'll have it done before the hackathon. with help, much, much sooner. using oakland's template, all that needs to be done, and has needed to be done, is actually going through the documents to get the proper data.

fyi i forked the repo months ago and its already populated with norfolks and and york countys data.

On Fri, Dec 20, 2013 at 9:38 PM, J. Albert Bowden jalbertbowden@gmail.comwrote:

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng < notifications@github.com>wrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld < notifications@github.com>wrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub<

https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377>

.

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500>

.

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31054648> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31056075> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31057448> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

—

Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31065915> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31066452 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

qwo commented 10 years ago

I'm trying to address your search for an open oakland template.

using oakland's template, all that needs to be done, and has needed to be

done

According to this. http://blog.okfn.org/2013/04/29/open-budget-oakland-and-openspending/

I found OpenSpending and realized, with envy and relief, that what we

wanted to build had already been started. The OpenSpending community helped us assess which tools would work best for our particular vision, and developers provided support as we customized code to allow people to comment on and share various views of the budget.

I was suggesting uploading it to openspending and trying to use their dataviz tools, because it seems to me thats a good lead.

Nothing else, thats all.

On Sat, Dec 21, 2013 at 1:02 PM, albert notifications@github.com wrote:

that addresses nothing i touched on.

thanks for coming out

On Sat, Dec 21, 2013 at 11:24 AM, Stanley Zheng notifications@github.comwrote:

Albert I along with everyone appreciate your enthusiasm and contribution to this project.

As in regards to openoaklands code.

Much of it is similar to mbostock's d3 treemap. I see a lot of the oakland code pointed to a 'treemap.js'.

We talked about a shared tech implementation last night.

Hopefully by the end of the weekend I can get a rudimentary treemap by shaping some of the data we have existing.

https://github.com/mbostock/d3/wiki/Treemap-Layout http://bl.ocks.org/mbostock/4063582

If you'd like to try this with the Norfolk or York County data feel free.

Also if your datas already scraped and formed well, I dunno if you've uploaded it to openspending. https://openspending.org/ some of the sources.

Bests,

On Sat, Dec 21, 2013 at 10:54 AM, albert notifications@github.com wrote:

that only adds to my frustration that you don't have time for the project.

i do. and i have.

you guys couldn't be bothered earlier with open budget. then you can't be bothered to talk to me about it, even though i'm the only one actively involved in it. now you want to make decisions in regards to it. but oh wait, you have no time.

again, i have all the time in the world.

i share everything i do with this group. yet two people had no clue i had done anything.

how is any of this possible?

On Sat, Dec 21, 2013 at 12:44 AM, Bret Fisher < notifications@github.com>wrote:

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

  • we reverse engineer cook and oakland and match the govmax output we got from VB until we're satisfied with the results. Basically a small site that replicates some if not all of the featureset of those existing apps. Sure we may have their code, but until our data is 1:1 we may not be able to do all they do.
  • We'll likely need to go back for more data with VB Budget Office. If memory serves, cook/oakland had many spreadsheets/pdf's to pull from. We just need to know what to ask for. It could be a working meeting where we all stare at cook/oakland with VB City staff and click around until we stumble on something we're missing from VB. Then Budget Office goes back (they have a data person) and works on creating the data we need.
  • Once we feel like we know how we want the data to be dumped from Budget System X, we document it better and stand it up as the format we like in order to produce our clones of cook/oakland.
  • Other brigades stand in awe of our hard work and persistence, and fork it often.
  • We slowly improve it over time. watching what other cities and brigades do with it.
  • Whatever of these holes aren't filled, we make Code Across Challenges. If it's magically all done in the next two months, then we come up with new challenges for the data and take it to 11 at Code Across.

Hope that helps. Sorry I haven't made time to dive into this project lately.

Bret

On Fri, Dec 20, 2013 at 10:51 PM, albert notifications@github.com wrote:

i'm setting this email i been working on into my drafts and i'll address other thoughts later.

my primary thought at this moment is that we already have this data. i've said that a million times. so here's a million and one: i have collected all of the available hrva budget data that is online. and i've converted all of it into multiple formats.

we do not need a government connection, an independent study, nor a hackathon to accomplish this. knowing what i know now, i'll have it done before the hackathon. with help, much, much sooner. using oakland's template, all that needs to be done, and has needed to be done, is actually going through the documents to get the proper data.

fyi i forked the repo months ago and its already populated with norfolks and and york countys data.

On Fri, Dec 20, 2013 at 9:38 PM, J. Albert Bowden jalbertbowden@gmail.comwrote:

i was writing a response but i'll put that on hold....

i didn't say that the csv's were an issue, i said there's a csv to api library we could implement, to interact with the static format on the web. i'm sure tie it into d3 thats already in open oakland.

also, has anyone considered the different localities here? openbudgetvb is the repo....we are hrva. so we doing x number of these?

On Fri, Dec 20, 2013 at 9:22 PM, Stanley Zheng < notifications@github.com>wrote:

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

The CSVs aren't the issue, I believe ckan offers some data rest points within the service.

The CSVs are chalked up with irregular formatting because these .xls were formatted to look good on reports (headers, indentations, styling)

The position data looks good,

https://github.com/stanzheng/openbudgetvb/blob/master/position/FY10_Position.csv

It looks almost readable, each office has an associated budget -> (I think each 1 = $10,000)

7 01010 Municipal Council 11.00

So the interpretation is in 2010, the Municipal Council's Proposed Salary was $110,000.

The challenge I was suggesting was, "how to not just screen scrape this data", so possibly somewhere else with govmax could reuse the project easily.

Also, Albert Awesome you have other locality data? throwing it on a repo or the data portal would be cool. You probably have more experience with budget data than I.

PS: The independent study is out, I'm probably going to work on it irregardless. The professor is happy to provide guidance or advice without it being official so study unnecessary.

On Fri, Dec 20, 2013 at 7:52 PM, Ben Schoenfeld < notifications@github.com>wrote:

Re you bringing it in the past, it's coming up now for a few reasons. We got a gov partner, we are thinking about using the topic for a code across challenge, and Stanley is considering doing an independent study around it. I don't think there was anyone who had an cycles to spend on it before now. That being said, I'm glad you've already poured so much work into it. If we do it at code across, i hope you'll be on that challenge team.

On Friday, December 20, 2013, albert wrote:

huh....my bad. i knew those were there. i took a quick glance at stanley's repo and thought i saw different data. i converted all of them into a few formats and threw them up in drive awhile ago, pretty sure i shared it with ya'll

i've been holding out hoping someone in the know in oakland's open budget would point out whatever standard is being used...clearly that ain't the case.

the data i've been sitting on forever is going to be exactly like oakland's then, scraping and pasting them together, without getting the local govs to help.

time is a huge investment...i've probably got 50-75 hours already invested in hrva open budget. also why i this baffled me, because i brought it up on numerous occasions and got no feedback.

to that point, i say we do not wait for one city to lead the way. we've got all the data, all we need to do is agree on a format or three.

having an inside connection in vb via bret is sweet, but if we applied this to every locality, we'd be waiting around forever. plus, since we only have the one city connection, all we'd be doing is virginia beach.

there's a csv to api lib that we could easily implement here, and adapt for each locality. sounds like the best option for the variety of data and help we are going to receive.

On Fri, Dec 20, 2013 at 6:50 PM, Stanley Zheng < notifications@github.com<javascript:_e({}, 'cvml', 'notifications@github.com');>>wrote:

@kmcurry https://github.com/kmcurry I guess you mean the data portal?

It'd be interesting to contact the vendor if appropriate, if it can be exported unstyled/non-report csv's

— Reply to this email directly or view it on GitHub<

https://github.com/c4hrva/tasks/issues/25#issuecomment-31050377>

.

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub<

https://github.com/c4hrva/tasks/issues/25#issuecomment-31051500>

.

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31052581>

.

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31054648> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31056075> .

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31057448> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

—

Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31065915> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31066452> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

—

Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31068450 .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

jalbertbowden commented 10 years ago

im not searching for an open oakland template. but i am repeating myself again. and again. and yet we all know that inevitably somehow you all will magically forget, in unison, that i said anything.

thats not a coincidence and im not paranoid.

On Saturday, December 21, 2013, Stanley Zheng wrote:

I'm trying to address your search for an open oakland template.

using oakland's template, all that needs to be done, and has needed to be

done

According to this. http://blog.okfn.org/2013/04/29/open-budget-oakland-and-openspending/

I found OpenSpending and realized, with envy and relief, that what we

wanted to build had already been started. The OpenSpending community helped us assess which tools would work best for our particular vision, and developers provided support as we customized code to allow people to comment on and share various views of the budget.

I was suggesting uploading it to openspending and trying to use their dataviz tools, because it seems to me thats a good lead.

Nothing else, thats all.

On Sat, Dec 21, 2013 at 1:02 PM, albert notifications@github.com wrote:

that addresses nothing i touched on.

thanks for coming out

On Sat, Dec 21, 2013 at 11:24 AM, Stanley Zheng < notifications@github.com>wrote:

Albert I along with everyone appreciate your enthusiasm and contribution to this project.

As in regards to openoaklands code.

Much of it is similar to mbostock's d3 treemap. I see a lot of the oakland code pointed to a 'treemap.js'.

We talked about a shared tech implementation last night.

Hopefully by the end of the weekend I can get a rudimentary treemap by shaping some of the data we have existing.

https://github.com/mbostock/d3/wiki/Treemap-Layout http://bl.ocks.org/mbostock/4063582

If you'd like to try this with the Norfolk or York County data feel free.

Also if your datas already scraped and formed well, I dunno if you've uploaded it to openspending. https://openspending.org/ some of the sources.

Bests,

On Sat, Dec 21, 2013 at 10:54 AM, albert notifications@github.com wrote:

that only adds to my frustration that you don't have time for the project.

i do. and i have.

you guys couldn't be bothered earlier with open budget. then you can't be bothered to talk to me about it, even though i'm the only one actively involved in it. now you want to make decisions in regards to it. but oh wait, you have no time.

again, i have all the time in the world.

i share everything i do with this group. yet two people had no clue i had done anything.

how is any of this possible?

On Sat, Dec 21, 2013 at 12:44 AM, Bret Fisher < notifications@github.com>wrote:

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

  • we reverse engineer cook and oakland and match the govmax output we got from VB until we're satisfied with the results. Basically a small site that replicates some if not all of the featureset of those existing apps. Sure we may have their code, but until our data is 1:1 we may not be able to do all they do.
  • We'll likely need to go back for more data with VB Budget Office. If memory serves, cook/oakland had many spreadsheets/pdf's to pull from. We just need to know what to ask for. It could be a working meeting where we all stare at cook/oakland with VB City staff and click around until we stumble on something we're missing from VB. Then Budget Office goes back (they have a data person) and works on c > https://github.com/c4hrva/tasks/issues/25#issuecomment-31066452> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31068450> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31068733 .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

BretFisher commented 10 years ago

Albert, I'm not aware that I made any decisions on open budget. My prior post was simply to help give an example of how we might be successful given the current landscape. I'm happy to support others efforts if you feel we need to go in a different direction. My impression was you had lots of effort put into cleaning up data but were looking for a bigger picture of how it all fits together, which is why I threw my hat in the ring. I saw lots of question marks in your post so tried to clear stuff up.

Albert to your post about me not knowing you did work, I regret not keeping up with who's done what. I don't read every email in issues or to the group in general. Between this and the other 4+ distros related to CfA that I'm on I likely read 25% of the 50 daily. Sorry if I seem ignorant to your efforts, but don't take that as me not caring.

Also don't assume I'm "leading" open budget. It sounds like you're doing that. I also don't need to be the "go between" to VB Budget Office. I just helped get our first intro meeting to get the ball rolling.

On Sat, Dec 21, 2013 at 1:37 PM, albert notifications@github.com wrote:

im not searching for an open oakland template. but i am repeating myself again. and again. and yet we all know that inevitably somehow you all will magically forget, in unison, that i said anything.

thats not a coincidence and im not paranoid.

On Saturday, December 21, 2013, Stanley Zheng wrote:

I'm trying to address your search for an open oakland template.

using oakland's template, all that needs to be done, and has needed to be

done

According to this. http://blog.okfn.org/2013/04/29/open-budget-oakland-and-openspending/

I found OpenSpending and realized, with envy and relief, that what we

wanted to build had already been started. The OpenSpending community helped us assess which tools would work best for our particular vision, and developers provided support as we customized code to allow people to comment on and share various views of the budget.

I was suggesting uploading it to openspending and trying to use their dataviz tools, because it seems to me thats a good lead.

Nothing else, thats all.

On Sat, Dec 21, 2013 at 1:02 PM, albert notifications@github.com wrote:

that addresses nothing i touched on.

thanks for coming out

On Sat, Dec 21, 2013 at 11:24 AM, Stanley Zheng < notifications@github.com>wrote:

Albert I along with everyone appreciate your enthusiasm and contribution to this project.

As in regards to openoaklands code.

Much of it is similar to mbostock's d3 treemap. I see a lot of the oakland code pointed to a 'treemap.js'.

We talked about a shared tech implementation last night.

Hopefully by the end of the weekend I can get a rudimentary treemap by shaping some of the data we have existing.

https://github.com/mbostock/d3/wiki/Treemap-Layout http://bl.ocks.org/mbostock/4063582

If you'd like to try this with the Norfolk or York County data feel free.

Also if your datas already scraped and formed well, I dunno if you've uploaded it to openspending. https://openspending.org/ some of the sources.

Bests,

On Sat, Dec 21, 2013 at 10:54 AM, albert notifications@github.com wrote:

that only adds to my frustration that you don't have time for the project.

i do. and i have.

you guys couldn't be bothered earlier with open budget. then you can't be bothered to talk to me about it, even though i'm the only one actively involved in it. now you want to make decisions in regards to it. but oh wait, you have no time.

again, i have all the time in the world.

i share everything i do with this group. yet two people had no clue i had done anything.

how is any of this possible?

On Sat, Dec 21, 2013 at 12:44 AM, Bret Fisher < notifications@github.com>wrote:

This is all great stuff. I didn't realize Albert's level of effort, that's awesome. We should capture that in our next Volunteer Hours report to VB.

I like the idea of just "stumbling" forward until we find guidance from others who have paved the way. In my head I imagined it sort of going down like this:

  • we reverse engineer cook and oakland and match the govmax output we got from VB until we're satisfied with the results. Basically a small site that replicates some if not all of the featureset of those existing apps. Sure we may have their code, but until our data is 1:1 we may not be able to do all they do.
  • We'll likely need to go back for more data with VB Budget Office. If memory serves, cook/oakland had many spreadsheets/pdf's to pull from. We just need to know what to ask for. It could be a working meeting where we all stare at cook/oakland with VB City staff and click around until we stumble on something we're missing from VB. Then Budget Office goes back (they have a data person) and works on c > https://github.com/c4hrva/tasks/issues/25#issuecomment-31066452> .

J. Albert Bowden II

jalbertbowden@gmail.com <javascript:_e({}, 'cvml', 'jalbertbowden@gmail.com');>

http://bowdenweb.com/

Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31068450> .

Stanley Zheng B.S. Comp Sci ODU '14 Cell: (347)-399-3732 @stanzheng

— Reply to this email directly or view it on GitHub< https://github.com/c4hrva/tasks/issues/25#issuecomment-31068733> .

J. Albert Bowden II

jalbertbowden@gmail.com

http://bowdenweb.com/

— Reply to this email directly or view it on GitHubhttps://github.com/c4hrva/tasks/issues/25#issuecomment-31069164 .

BretFisher commented 10 years ago

Budget now has it's own repo https://github.com/c4hrva/look-at-virginiabeach where ideas and thoughts should go.