Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #109766

Re: which library has map reduce and how to use it for this case

Show all headers | View raw

I like using Yelp's mrjob module (https://github.com/Yelp/mrjob) to run
Python on Hadoop.

On Thu, Jun 9, 2016 at 2:56 AM Ho Yeung Lee <davidbenny2000@gmail.com>
wrote:

> [... a bunch of code ...]


If you want to describe a map-reduce problem, start with the data. What
does a record of your input data look like?

Then think about your mapper. What key-value pairs will you extract from
each line of data?

Then think about your reducer. For a single key and its associated values,
what will you calculate?

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

which library has map reduce and how to use it for this case Ho Yeung Lee <davidbenny2000@gmail.com> - 2016-06-08 23:52 -0700
  Re: which library has map reduce and how to use it for this case Michael Selik <michael.selik@gmail.com> - 2016-06-09 22:44 +0000
    Re: which library has map reduce and how to use it for this case Ho Yeung Lee <davidbenny2000@gmail.com> - 2016-06-09 18:07 -0700
      Re: which library has map reduce and how to use it for this case Michael Selik <michael.selik@gmail.com> - 2016-06-10 14:03 +0000
        Re: which library has map reduce and how to use it for this case meInvent bbird <jobmattcon@gmail.com> - 2016-06-10 23:19 -0700
          Re: which library has map reduce and how to use it for this case Michael Selik <michael.selik@gmail.com> - 2016-06-11 16:44 +0000

csiph-web