search

fsharp / fsharp.org

The F# Software Foundation website
https://fsharp.org
291 stars 276 forks source link

F# Big Data Stacks page #42

Closed jasonmccampbell closed 11 years ago

jasonmccampbell commented 11 years ago

Now see https://github.com/fsharp/fsfoundation/pull/53

Jason Twitter: @jasonmccampbell Email: as above but @gmail.com

quasilord commented 11 years ago

Maybe "Big Data" and "Big Compute" could be merged

Some links

jasonmccampbell commented 11 years ago

@quasilord I like that suggestion. I added the links you mentioned that I didn't have already as well as some verbiage talking about "big compute" and a list of distributed messaging packages I am familiar with. I think this "feels" better and will make for a more substantial page. Any other ideas for material that should be included?

@tpetricek @dsyme either of you have a vision for this page along that isn't included here / different?

Comments here or direct edits to the gdoc are welcome.

ghost commented 11 years ago

I'd recommend considerably less verbiage. This is not the right place to explain the (very large and rapidly evolving) universe of big data and big compute nor the techno-social trends around it. Just jump straight in with a condensed, snappy version of para #2 and #4 and then give links to resources. Assume the user is looking for one of "EC2", "Azure", "Hadoop", "ZeroMQ", "No-SQL", "Cassandra", "SQL", "MPI" etc.

Many people's data needs will actually be satisfid by SQL programming (people don't need Hadoop quite as much as they think), and that angle should be covered.

In this vein the title should probably be something like "Data, Compute, Cloud and Messaging Stacks for F#" without the "Big".

Type providers should be mentioned ("F# is the best language for Big Metadata") with specific mention of the SQL and OData type providers in Visual Studio and the FSharpx community type providers (e.g. for JSON, Xml etc.)

Trawling Nuget for related packages would be a good thing.

I suspect there should be specific sections for "Using F# on Azure" and "Using F# on EC2 and Rackspace". The Visual F# team might like to give input for the former. For example, that would cover

EC2 would probably mostly just say the obvious - that the open source release of F# can be installed and used on EC2 VMs.

ghost commented 11 years ago

There's a nice sample of using MongoDB here: https://gist.github.com/4394128

Cheers! don

jasonmccampbell commented 11 years ago

@dsyme I like these suggestions a lot and this will help focus the content a bit. I'll take a look at the gist as well and, kids permitting, hopefully update the content this evening. :)

ghost commented 11 years ago

Hi Jason, have you been able to update this as yet? The Azure guys at Microsoft want to add links to some tutorial material too, so it would be good to integrate what you have (in any state)

jasonmccampbell commented 11 years ago

Hi Don,

What's in the Google doc is what I have. I had a much-delayed beta release to get out at work. Fortunately that is done so I will have time to get back to this page.

Content from the Azure folks would be great. They are welcome to edit the doc directly, email me content, or move the content to an Office doc and share it back if that easier.

I should have time to clean things up this weekend if they would rather have more structure in place first.

Jason On Feb 1, 2013 7:05 AM, "Don Syme" notifications@github.com wrote:

Hi Jason, have you been able to update this as yet? The Azure guys at Microsoft want to add links to some tutorial material too, so it would be good to integrate what you have (in any state)

— Reply to this email directly or view it on GitHubhttps://github.com/fsharp/fsfoundation/issues/42#issuecomment-12993228.

jasonmccampbell commented 11 years ago

Ok, I finally have gotten time to add the Windows Azure and Amazon Web Services sections. Comments on the content, particularly the scope and level of detail, are welcome.

@dsyme , you mentioned that the Azure guys are interested in adding links to additional material. They are welcome to edit the doc directly or they can email me the material (jasonmccampbell @ gmail) and I'll add it.

ghost commented 11 years ago

Hi Jason, I can take a pass over the material, e.g. for Azure, Hadoop, and also for general wording. Can you send a pull request to submit what you have? Thanks!

jasonmccampbell commented 11 years ago

Hi Don, will do. I realized a couple of days ago that I was writing to the wrong audience and cleaned things up a bit. I should have time to add some additional content and submit a PR this weekend.

On Thu, Mar 14, 2013 at 9:07 AM, Don Syme notifications@github.com wrote:

Hi Jason, I can take a pass over the material, e.g. for Azure, Hadoop, and also for general wording. Can you send a pull request to submit what you have? Thanks!

— Reply to this email directly or view it on GitHubhttps://github.com/fsharp/fsfoundation/issues/42#issuecomment-14903878 .

jasonmccampbell commented 11 years ago

Move to PR: https://github.com/fsharp/fsfoundation/pull/53

ghost commented 11 years ago

Closed (though some further work is needed per above discussion)