software for recording search results?
Dear AoIR-ists, A Master's student is comparing search results on ca. 120 key search terms in two different national locations. The student is building on a considerable body of often quite sophisticated analyses along these lines - but by people with access to programmers and/or who can build the code they want / need themselves. What the student wants to do is simply record the first, e.g., 10 or 20 hits in response to a given key search term. Beyond taking screen shots and pushing the results into a spreadsheet for (relatively simple) analysis - does anyone have recommendations for available software that might be more directly helpful with this sort of data collection and recording? Will look forward to any advice and suggestions you can offer - many thanks in advance, - charles -- Professor in Media Studies Department of Media and Communication University of Oslo <http://www.hf.uio.no/imk/english/people/aca/charlees/index.html> Postboks 1093 Blindern 0317 Oslo, Norway c.m.ess@media.uio.no
Hi Charles — presuming the spreadsheet would be a satisfying outcome, and the primary problem the tediousness of transcription, writing/using a web scraper should automate that. If, as your email implies, your students don’t have a programming background to use e.g. beautifulsoup, Kimono/Portia facilitate this kind of scraping with a friendly GUI. https://blog.scrapinghub.com/2016/02/17/portia-alternative-to-kimono/ https://www.quora.com/Is-there-no-decent-visual-web-scraper-online-to-replac... ___________________________ Sent by the magic of mobile technology
On Feb 20, 2018, at 6:17 AM, Charles M. Ess <c.m.ess@media.uio.no> wrote:
Dear AoIR-ists,
A Master's student is comparing search results on ca. 120 key search terms in two different national locations. The student is building on a considerable body of often quite sophisticated analyses along these lines - but by people with access to programmers and/or who can build the code they want / need themselves.
What the student wants to do is simply record the first, e.g., 10 or 20 hits in response to a given key search term. Beyond taking screen shots and pushing the results into a spreadsheet for (relatively simple) analysis - does anyone have recommendations for available software that might be more directly helpful with this sort of data collection and recording?
Will look forward to any advice and suggestions you can offer - many thanks in advance, - charles -- Professor in Media Studies Department of Media and Communication University of Oslo <http://www.hf.uio.no/imk/english/people/aca/charlees/index.html>
Postboks 1093 Blindern 0317 Oslo, Norway c.m.ess@media.uio.no _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
WebRecorder may be helpful for some of this https://webrecorder.io/ -- Melissa Bliss PhD candidate Cognitive Science Research Group School of Electronic Engineering and Computer Science Queen Mary University of London
On 20 Feb 2018, at 11:17, Charles M. Ess <c.m.ess@media.uio.no> wrote:
Dear AoIR-ists,
A Master's student is comparing search results on ca. 120 key search terms in two different national locations. The student is building on a considerable body of often quite sophisticated analyses along these lines - but by people with access to programmers and/or who can build the code they want / need themselves.
What the student wants to do is simply record the first, e.g., 10 or 20 hits in response to a given key search term. Beyond taking screen shots and pushing the results into a spreadsheet for (relatively simple) analysis - does anyone have recommendations for available software that might be more directly helpful with this sort of data collection and recording?
Will look forward to any advice and suggestions you can offer - many thanks in advance, - charles -- Professor in Media Studies Department of Media and Communication University of Oslo <http://www.hf.uio.no/imk/english/people/aca/charlees/index.html>
Postboks 1093 Blindern 0317 Oslo, Norway c.m.ess@media.uio.no
participants (3)
-
Charles M. Ess -
Chris Peterson -
Melissa Bliss