At the point you hit >1 GB, you probably want to invest time in setting up an actual database and using programmatic means to analyze the data. I recommend checking out PostgreSQL, which has great features for text search and analysis. --- Alexander Leavitt PhD Candidate USC Annenberg School for Communication & Journalism http://alexleavitt.com Twitter: @alexleavitt On Aug 26, 2014 11:57 PM, "Dave Voelker" <dvoelker@stanford.edu> wrote:
I'd like to know if someone can recommend -- or knows of -- any computer assisted text analysis (CATA) programs capable of applying predefined concept dictionaries (lists of words and phrases representing a concept) to large datasets of tweets. I'm referring here to traditional, conceptual, content analysis (social science), not the bottom-up, data mining methods (computer science) primarily being used to analyze big data. An example of the kind of program I'm talking about is the freeware Yoshikoder (http://sourceforge.net/p/yoshikoder/wiki/Home/), but I'm unable to open a large (~ 3 GB) text file of tweets with it.
- - - - - - - - - - - - - - David Voelker, Ph.D. Department of Communication Stanford University http://comm.stanford.edu/faculty/voelker/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/