| |||||||||||
The Natural Language Toolkit (developerWorks)The Natural Language Toolkit (developerWorks)Posted Jun 25, 2004 23:41 UTC (Fri) by cpeterso (guest, #305)In reply to: The Natural Language Toolkit (developerWorks) by iabervon Parent article: The Natural Language Toolkit (developerWorks) Thanks for the explanation! Do you remember an example of any particular email's top 5 words? This is a cool idea, but it sounds like a lot of work (programming and compute-time) to create email summaries. I bet most people don't spend much time reading or relying on their emails' subject lines. :\
(Log in to post comments)
The Natural Language Toolkit (developerWorks) Posted Jun 26, 2004 0:29 UTC (Sat) by iabervon (subscriber, #722) [Link] I don't remember a good example, but the most of the programming work isalready done in the remembrance agent, available (GPL) from http://www.remem.org/, which indexes a corpus and then can efficiently query it. The interface only really supports finding the documents which match best, but the engine has the words and their scores internally. It's not a lot of computation provided you do an initial scan and then update it incrementally; using the stored info is too fast to tell on my machine. (Note that what it displays for a match are what matched, not the top words for the document in general) Querying for one of the emails in the list gives, for it's match with itself: "window, throwing, knife, pizza, stuck". I'm not sure whether this is only completely clear to me due to remembering the email, or whether other people could also figure out what the email was about from that information.
|
|||||||||||