kseppi / mrs-mapreduce

Automatically exported from code.google.com/p/mrs-mapreduce
Apache License 2.0
0 stars 0 forks source link

Refactor the mrs library into a subdirectory #1

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
Hi there!  Just a friendly Idiot, trying to check out your mrs.  I'd like a
simple MR implementation, since I'll have access to computing resources
with an existing high-performance network filesystem.  So upon hearing
about this project from an SPR friend, I thought I'd give it a look. 
However, when I checked out the git repository, the example wordcount.py
file imports mrs, which doesn't appear to be in the repository.  Was I
supposed to get that somewhere else, or what's going on?

What steps will reproduce the problem?
1. Check out the project via the git command given on the google code
description page (and the mcnabbs.org page)
2. Look for mrs.py anywhere in the checked-out directory structure
3. Fail!

What is the expected output? What do you see instead?
I expect to be able to import mrs from my python script, but I see no
mrs.py to put its containing directory in my PYTHONPATH.

What version of the product are you using? On what operating system?
I have no idea what version this is.  The latest commit I can see is:
ea734f49d17f8c818bba954f5e2f97787c8a302f
I'm using Ubuntu Linux (and Python 2.6.4)

Please provide any additional information below.
Oh, you also mention a verbose wordcount example on your mcnabbs.org page
("Look at wordcount.py and wcverbose.py"), but there is no wcverbose.py in
the examples (just fulton, potato, wordcount, and WordCount.java).

Original issue reported on code.google.com by idiot.jo...@gmail.com on 10 Mar 2010 at 10:37

GoogleCodeExporter commented 9 years ago
At the moment, the repository itself is the module (it has an __init__.py).  So 
the 
directory structure looks like this:

mrs/
  __init__.py
  ...

It would almost certainly be better if it were the following:

mrs/
  docs/
    ...
  mrs/
    __init__.py
    ...
  README
  examples/
    ...

etc.

I'll do this change soon, but it won't happen today.  For now, as a workaround, 
you 
should be able to add the top-level mrs directory to your PYTHONPATH.  Does 
that 
work?

Thanks for your interest, and for your suggestion.  Let me know how things go.

Original comment by amcna...@gmail.com on 10 Mar 2010 at 10:51

GoogleCodeExporter commented 9 years ago
Hey, I just looked at the username.  How are you doing, Clint?

Original comment by amcna...@gmail.com on 10 Mar 2010 at 10:51

GoogleCodeExporter commented 9 years ago
For the record, there are a couple of known weaknesses that I need to address 
to 
improve performance.  It might be good enough for what you need.  If you have 
problems, let me know and we can work on a few of the problematic areas.  For a 
lot of 
applications, everything is great as-is.

Original comment by amcna...@gmail.com on 10 Mar 2010 at 10:53

GoogleCodeExporter commented 9 years ago

Original comment by chmod...@gmail.com on 29 Oct 2011 at 7:18