Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #15680

Re: Using Mathematica for text mining

From Bill Rowe <readnews@sbcglobal.net>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: Using Mathematica for text mining
Date 2011-02-11 09:18 +0000
Organization Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID <ij2utr$7sk$1@smc.vnet.net> (permalink)

Show all headers | View raw


On 2/10/11 at 5:20 AM, cam@byu.edu (Cameron Christiansen) wrote:

>Thank you for the response. It looks like that works well to cluster
>words in a single document together, however I'd like to cluster
>entire documents together based on the words they contain. Is that
>possible?

Yes, it is possible. To do this you need to define a distance
function that provides a measure of how different one file is
from another. For example,

FindClusters[filenameList,
  DistanceFunction -> (Abs[
      Length@FindList[#1, "keyword"] -
       Length@FindList[#2, "keyword"]] &)]

would group file names according to the number of occurrences of
"keyword" in each file.

Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread


Thread

Re: Using Mathematica for text mining Bill Rowe <readnews@sbcglobal.net> - 2011-02-11 09:18 +0000

csiph-web