10‎ > ‎


69878913 story Advertising Businesses IT Science Technology Your Rights Online

Test Shows Big Data Text Analysis Inconsistent, Inaccurate 27

Posted by samzenpus on Sunday February 01, 2015 @12:40PM
from the you'll-love-these-links dept. DillyTonto writes The "state of the art" in big-data (text) analysis turns out to use a method of categorizing words and documents that, when tested, offered different results for the same data 20% of the time and was flat wrong another 10%, according to researchers at Northwestern. The Researchers offered a more accurate method, but only as an example of how to use community detection algorithms to improve on the leading method (LDA). Meanwhile, a certain percentage of answers from all those big data installations will continue to be flat wrong until they're re-run, which will make them wrong in a different way.


Subpages (3): 4 c k