Looking for Right Wing and Extremist Forums for Web Scraping
Does anyone know of a web forum (or even an open-to-the-public Facebook or Reddit page) where Right and Far-Right politics are being discussed? These are remarkably hard to find! I am looking for spaces that have been in operation for at least a few years so I can chart changes over time. Roderick Graham
Hi Rod, Have you tried Gab? I have scraped data from there. Not a huge amount due to the fringe nature of the site. But I'm not sure how far you can trace back. Cheers, Li Sent from my iPhone
On Jul 28, 2023, at 9:58 PM, Rod Graham via Air-L <air-l@listserv.aoir.org> wrote:
Does anyone know of a web forum (or even an open-to-the-public Facebook or Reddit page) where Right and Far-Right politics are being discussed? These are remarkably hard to find! I am looking for spaces that have been in operation for at least a few years so I can chart changes over time.
Roderick Graham _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
Hey, There’s also the classic: stormfront. If you don’t care too much about how old the data is, you could look at the /pol/ datasets that exist? Like https://arxiv.org/abs/2001.07487 On Jul 29, 2023, 3:36 AM +0100, Li Zhang via Air-L <air-l@listserv.aoir.org>, wrote: Hi Rod, Have you tried Gab? I have scraped data from there. Not a huge amount due to the fringe nature of the site. But I'm not sure how far you can trace back. Cheers, Li Sent from my iPhone On Jul 28, 2023, at 9:58 PM, Rod Graham via Air-L <air-l@listserv.aoir.org> wrote: Does anyone know of a web forum (or even an open-to-the-public Facebook or Reddit page) where Right and Far-Right politics are being discussed? These are remarkably hard to find! I am looking for spaces that have been in operation for at least a few years so I can chart changes over time. Roderick Graham _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/
Hi Rod I'd also suggest Gettr, which has an undocumented API surprisingly easy to tap into. For example, here is a random user's posts: https://api.gettr.com/u/user/dleeb/posts?offset=0&max=20 The same user's followers: https://api.gettr.com/u/user/dleeb/followers?max=20&offset=0 You can retreive only 20 posts/users per call, changing the offset to 20, 40 etc. allows you to go down the list. Hope this helps JHR ---------------------------------------- Jean-Hugues Roy Journaliste et professeur Bac en communication (journalisme<https://journalisme.uqam.ca/>) École des médias<https://edm.uqam.ca/> Université du Québec à Montréal 514/778-6102 | Github<https://github.com/jhroy/> | ORCID<https://orcid.org/my-orcid?orcid=0000-0001-9471-8491> ________________________________ De : Air-L <air-l-bounces@listserv.aoir.org> de la part de Rod Graham via Air-L <air-l@listserv.aoir.org> Envoyé : 28 juillet 2023 21:57 À : air-l@listserv.aoir.org <air-l@listserv.aoir.org> Objet : [Air-L] Looking for Right Wing and Extremist Forums for Web Scraping Does anyone know of a web forum (or even an open-to-the-public Facebook or Reddit page) where Right and Far-Right politics are being discussed? These are remarkably hard to find! I am looking for spaces that have been in operation for at least a few years so I can chart changes over time. Roderick Graham _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/
Seconding Jean-Hugues about Gettr and Li about Gab. Both platforms are actively promoted by Twitter/X users, which provides an access point for thinking about cross-platform radicalization networks. It may also explain why the owner of X has no concerns about losing billions if he can mainstream or accelerate access to these alt-right threat-generation sites. Among the problems in this data are open threats to kill doctors who promote vaccine use. Gettr https://vimeo.com/showcase/9113601 Gab https://vimeo.com/showcase/8704426 On Fri, Jul 28, 2023 at 11:13 PM Roy, Jean-Hugues via Air-L < air-l@listserv.aoir.org> wrote:
Hi Rod
I'd also suggest Gettr, which has an undocumented API surprisingly easy to tap into. For example, here is a random user's posts: https://api.gettr.com/u/user/dleeb/posts?offset=0&max=20
The same user's followers: https://api.gettr.com/u/user/dleeb/followers?max=20&offset=0
You can retreive only 20 posts/users per call, changing the offset to 20, 40 etc. allows you to go down the list.
Hope this helps
JHR
---------------------------------------- Jean-Hugues Roy Journaliste et professeur Bac en communication (journalisme<https://journalisme.uqam.ca/>) École des médias<https://edm.uqam.ca/> Université du Québec à Montréal 514/778-6102 | Github<https://github.com/jhroy/> | ORCID< https://orcid.org/my-orcid?orcid=0000-0001-9471-8491> ________________________________ De : Air-L <air-l-bounces@listserv.aoir.org> de la part de Rod Graham via Air-L <air-l@listserv.aoir.org> Envoyé : 28 juillet 2023 21:57 À : air-l@listserv.aoir.org <air-l@listserv.aoir.org> Objet : [Air-L] Looking for Right Wing and Extremist Forums for Web Scraping
Does anyone know of a web forum (or even an open-to-the-public Facebook or Reddit page) where Right and Far-Right politics are being discussed? These are remarkably hard to find! I am looking for spaces that have been in operation for at least a few years so I can chart changes over time.
Roderick Graham _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/ _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Dr. Stuart W. Shulman Founder and CEO, Texifter Editor Emeritus, *Journal of Information Technology & Politics*
participants (5)
-
Li Zhang -
Rod Graham -
Roy, Jean-Hugues -
Shulman, Stu -
Zeerak Talat