question about using online comments

4 May 2023

      NVivo has a cool option called NCapture, see https://bit.ly/3NG38k5.
"NCapture is a free web-browser extension for Chrome that enables you to gather web content to import into NVivo... NCapture files (.nvcx) contain your captured content as well as the URLs, capture times and any additional information such as a descriptions, memos and coding that you specified at the time of capture." 

If you are interested in the ethical side of this kind of research, please see this Sage Methodspace post, featuring an interview with Wyke Stommel (https://bit.ly/3AY3lYu) and the open-access article she discusses: " Ethical approval: none sought. How discourse analysts report ethical issues around publicly available online data."

Another post, "Methods in Action: The Ethics of Studying Online Comments" includes an open-access research case and a discussion with the researcher: https://bit.ly/3LJv3y7.

All the best,
Janet

Janet Salmons, PhD (She/her/hers)
Research Community Manager, SAGE MethodSpace.com
Boulder, Colorado USA
jsalmons@vision2lead.com

Now available! Doing Qualitative Research Online, 2nd edition
(720) 507-3965

-----Original Message-----
From: Air-L <air-l-bounces@listserv.aoir.org> On Behalf Of air-l-request@listserv.aoir.org
Sent: Thursday, May 04, 2023 2:01 PM
To: air-l@listserv.aoir.org
Subject: Air-L Digest, Vol 226, Issue 4

Send Air-L mailing list submissions to
	air-l@listserv.aoir.org

To subscribe or unsubscribe via the World Wide Web, visit
	http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
or, via email, send a message with subject or body 'help' to
	air-l-request@listserv.aoir.org

You can reach the person managing the list at
	air-l-owner@listserv.aoir.org

When replying, please edit your Subject line so it is more specific than "Re: Contents of Air-L digest..."

Today's Topics:

   1. question about using online comments (Wiley, Chris)
   2. Re: question about using online comments (Peter Timusk)
   3. Re: question about using online comments (Avner Kantor)
   4. Re: question about using online comments (Deena Abul-Fottouh)

----------------------------------------------------------------------

Message: 1
Date: Wed, 3 May 2023 20:39:31 +0000
From: "Wiley, Chris" <cawiley@illinois.edu>
To: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org>
Subject: [Air-L] question about using online comments
Message-ID:
	<MW5PR11MB5787B7F6804C0FC69084DCF2D76C9@MW5PR11MB5787.namprd11.prod.outlook.com>

Content-Type: text/plain; charset="iso-8859-1"

Hi
I've been doing research using online comments on news websites.  I was wondering are there any tools to extract the comments outside of copying and pasting?

Chris Wiley

------------------------------

Message: 2
Date: Wed, 3 May 2023 19:11:52 -0400
From: Peter Timusk <peterotimusk@gmail.com>
To: "Wiley, Chris" <cawiley@illinois.edu>
Cc: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org>
Subject: Re: [Air-L] question about using online comments
Message-ID:
	<CACdrEbYgFq94qMVqOpGFKQvbCa7rHsbXj-LOj4P1qTYrvPLDGQ@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"

You can use some softwares like R or SAS or Python to request web pages as data or text files. This may have varying degrees of success.  You can put these requests in loops to make multiple requests across says dates of news reporting. Then you have to clean up the data and isolate the comments from inside the text files.

On Wed, May 3, 2023 at 4:49?PM Wiley, Chris via Air-L < air-l@listserv.aoir.org> wrote:
...
Hi
I've been doing research using online comments on news websites.  I 
was wondering are there any tools to extract the comments outside of 
copying and pasting?
Chris Wiley
_______________________________________________
The Air-L@listserv.aoir.org mailing list is provided by the 
Association of Internet Researchers http://aoir.org Subscribe, change 
options or unsubscribe at:
http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers:
http://www.aoir.org/
------------------------------

Message: 3
Date: Thu, 4 May 2023 12:20:44 +0300
From: Avner Kantor <avnerkantor@gmail.com>
To: Peter Timusk <peterotimusk@gmail.com>
Cc: "Wiley, Chris" <cawiley@illinois.edu>,  "air-l@listserv.aoir.org"
	<air-l@listserv.aoir.org>
Subject: Re: [Air-L] question about using online comments
Message-ID:
	<CAGz-SeDABtp-rhfYtaa-52bwiCdPvkD_ooSdpea5xCxhasrEAA@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"

A lot of news websites offer an API that makes extracting comments easiest.

On Thu, May 4, 2023 at 2:23?AM Peter Timusk via Air-L < air-l@listserv.aoir.org> wrote:
...
You can use some softwares like R or SAS or Python to request web 
pages as data or text files. This may have varying degrees of success.  
You can put these requests in loops to make multiple requests across 
says dates of news reporting. Then you have to clean up the data and 
isolate the comments from inside the text files.
On Wed, May 3, 2023 at 4:49?PM Wiley, Chris via Air-L < 
air-l@listserv.aoir.org> wrote:
...
Hi
I've been doing research using online comments on news websites.  I 
was wondering are there any tools to extract the comments outside of 
copying and pasting?
Chris Wiley
_______________________________________________
The Air-L@listserv.aoir.org mailing list is provided by the 
Association of Internet Researchers http://aoir.org Subscribe, 
change options or unsubscribe at:
http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers:
http://www.aoir.org/
_______________________________________________
The Air-L@listserv.aoir.org mailing list is provided by the 
Association of Internet Researchers http://aoir.org Subscribe, change 
options or unsubscribe at:
http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers:
http://www.aoir.org/
------------------------------

Message: 4
Date: Thu, 4 May 2023 14:49:47 +0000
From: Deena Abul-Fottouh <abulfodm@mcmaster.ca>
To: Peter Timusk <peterotimusk@gmail.com>, "avnerkantor@gmail.com"
	<avnerkantor@gmail.com>
Cc: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org>
Subject: Re: [Air-L] question about using online comments
Message-ID:
	<YQBPR01MB10382ADAE2C1B7B6F591FD21DDE6D9@YQBPR01MB10382.CANPRD01.PROD.OUTLOOK.COM>

Content-Type: text/plain; charset="utf-8"

   Hi,

   This tutorial video might be useful

   [1]https://www.youtube.com/watch?v=v8Yh_4oE-Fs
   [2]Web Scrape Text from ANY Website - Web Scraping in R (Part 1)
   Web Scraping in R is super easy and useful, and in this video I scrape
   movies from IMDb into a data frame in R using the rvest library and
   then export the data frame as a csv, all in a few lines of code. This
   method works across many sites -- typically those that show static
   content -- such as Yelp, Amazon, Wikipedia, Google, and more. Part 2
   ...
   www.youtube.com
   Best,
   Deena

   ____________________________

   Deena Abul-Fottouh, PhD.

   Postdoctoral Research Fellow

   Digital Society Lab

   Political Science Department

   Phone icon t??phone: [3](905) 525-9140
   Envelope icon ?email: [4]abulfodm@mcmaster.ca

   McMaster University

   1280 Main Street West

   Hamilton, ON L8S 4M4
      McMaster University Brighter World logo
     __________________________________________________________________

   From: Air-L <air-l-bounces@listserv.aoir.org> on behalf of Avner Kantor
   via Air-L <air-l@listserv.aoir.org>
   Sent: May 4, 2023 5:20 AM
   To: Peter Timusk <peterotimusk@gmail.com>
   Cc: air-l@listserv.aoir.org <air-l@listserv.aoir.org>
   Subject: Re: [Air-L] question about using online comments

   A lot of news websites offer an API that makes extracting comments
   easiest.
   On Thu, May 4, 2023 at 2:23?AM Peter Timusk via Air-L <
   air-l@listserv.aoir.org> wrote:
...
You can use some softwares like R or SAS or Python to request web
   pages as
data or text files. This may have varying degrees of success.  You
   can put
these requests in loops to make multiple requests across says dates
   of news
reporting. Then you have to clean up the data and isolate the
   comments from
inside the text files.
On Wed, May 3, 2023 at 4:49?PM Wiley, Chris via Air-L <
air-l@listserv.aoir.org> wrote:
...
Hi
I've been doing research using online comments on news websites.  I
   was
wondering are there any tools to extract the comments outside of
   copying
and pasting?
Chris Wiley
_______________________________________________
The Air-L@listserv.aoir.org mailing list
is provided by the Association of Internet Researchers
   [5]http://aoir.org
Subscribe, change options or unsubscribe at:
[6]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers:
[7]http://www.aoir.org/
_______________________________________________
The Air-L@listserv.aoir.org mailing list
is provided by the Association of Internet Researchers
   [8]http://aoir.org
Subscribe, change options or unsubscribe at:
[9]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers:
[10]http://www.aoir.org/
_______________________________________________
   The Air-L@listserv.aoir.org mailing list
   is provided by the Association of Internet Researchers
   [11]http://aoir.org
   Subscribe, change options or unsubscribe at:
   [12]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
   Join the Association of Internet Researchers:
   [13]http://www.aoir.org/

References

   Visible links:
   1. https://www.youtube.com/watch?v=v8Yh_4oE-Fs
   2. https://www.youtube.com/watch?v=v8Yh_4oE-Fs
   3. tel:+19055259140
   4. mailto:abulfodm@mcmaster.ca
   5. http://aoir.org/
   6. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
   7. http://www.aoir.org/
   8. http://aoir.org/
   9. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
  10. http://www.aoir.org/
  11. http://aoir.org/
  12. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
  13. http://www.aoir.org/

   Hidden links:
  15. https://www.youtube.com/watch?v=v8Yh_4oE-Fs

------------------------------

Subject: Digest Footer

_______________________________________________
The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org

Join the Association of Internet Researchers:
http://www.aoir.org/

------------------------------

End of Air-L Digest, Vol 226, Issue 4
*************************************

Janet Salmons

tags

participants (1)