Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #75397 > unrolled thread

Re: speed up pandas calculation

Back to article view | Back to comp.lang.python

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.

Contents

  Re: speed up pandas calculation Skip Montanaro <skip.montanaro@gmail.com> - 2014-07-30 21:28 -0500
    Re: speed up pandas calculation Rustom Mody <rustompmody@gmail.com> - 2014-07-30 19:55 -0700

#75397 — Re: speed up pandas calculation

On Wed, Jul 30, 2014 at 8:11 PM, Chris Kaynor <ckaynor@zindagigames.com> wrote:
> Another way to write this, using a list expression (untested):
> new_df = [col for col in df if col.value in keep_col]

As I am learning (often painfully) with pandas and JavaScript+(d3 or
jQuery), loops are the enemy. You want to operate on large chunks of
data simultaneously. In pandas, those chunks are thinly disguised
numpy arrays. In JS+(ds or jQuery), those chunks are selections from
the DOM.

I should have paid closer attention to the APL unit of my programming
languages survey class in college.

Skip

[toc] | [next] | [standalone]

#75398

On Thursday, July 31, 2014 7:58:59 AM UTC+5:30, Skip Montanaro wrote:
> As I am learning (often painfully) with pandas and JavaScript+(d3 or
> jQuery), loops are the enemy. You want to operate on large chunks of
> data simultaneously. In pandas, those chunks are thinly disguised
> numpy arrays. In JS+(ds or jQuery), those chunks are selections from
> the DOM.

> I should have paid closer attention to the APL unit of my programming
> languages survey class in college.

Much more within reach than you may imagine
http://baruchel.hd.free.fr/apps/apl/

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web