Facebook scraper for qualitative analysis
Hi to all, I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well. I was wondering if you knew about other ways or ressources to make such a gathering possible. Best, Alexandra
NodeXL might help. Check nodexl.codeplex.com On Mon, Jul 16, 2018, 12:17 Alexandra Bahary <alexandra.bahary@gmail.com> wrote:
Hi to all,
I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well.
I was wondering if you knew about other ways or ressources to make such a gathering possible.
Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
Hi Alexandra, I don't know if it helps but you can take a look at this: http://thinktostart.com/analyzing-facebook-with-r/. R can be used also for text analysis and networks. Best, Paolo. Il lun 16 lug 2018, 19:17 Alexandra Bahary <alexandra.bahary@gmail.com> ha scritto:
Hi to all,
I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well.
I was wondering if you knew about other ways or ressources to make such a gathering possible.
Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
Hi Alexandra, I have a lecture slide and R-tutorial for downloading and Text analysis of Facebook data that I used for teaching. Please check the following link of my website: Slides: https://www.seonghoan.net/single-post/2017/11/30/Mining-and-analyzing-Facebo... R tutorial: http://rpubs.com/luanpao82/Facebook_sentiment Best, Seongho On 18 Jul 2018, at 1:39 AM, Paolo Eusebi <paoloeusebi@gmail.com<mailto:paoloeusebi@gmail.com>> wrote: Hi Alexandra, I don't know if it helps but you can take a look at this: http://thinktostart.com/analyzing-facebook-with-r/. R can be used also for text analysis and networks. Best, Paolo. Il lun 16 lug 2018, 19:17 Alexandra Bahary <alexandra.bahary@gmail.com<mailto:alexandra.bahary@gmail.com>> ha scritto: Hi to all, I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well. I was wondering if you knew about other ways or ressources to make such a gathering possible. Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ Seongho An, MSW Ph.D. Candidate in Social Welfare School of Social Policy & Practice University of Pennsylvania Phone: 267.271.8722 E-mail: anseong@upenn.edu<mailto:anseong@sp2.upenn.edu>
Good Day Alexandra, this python code (a GitHub site <https://github.com/minimaxir/facebook-page-post-scraper>) had helped a year ago, but am not fully sure if it runs after many FB API updates; this code might not export the content of comment (and I have to double-check some relevant historical threads regarding this in this mailing list). What is needed here is to set up a facebook developer app, as well as to have the target facebook group ID, then to create an "app_secret" to iterate the call without pause. For the desired timeframe, the code specifies too for you to just fill in. Just drop me a line and I can send you the python code we have modified. best regards, Shih-Hsuan On 18 July 2018 at 07:39, Paolo Eusebi <paoloeusebi@gmail.com> wrote:
Hi Alexandra, I don't know if it helps but you can take a look at this: http://thinktostart.com/analyzing-facebook-with-r/. R can be used also for text analysis and networks. Best, Paolo.
Il lun 16 lug 2018, 19:17 Alexandra Bahary <alexandra.bahary@gmail.com> ha scritto:
Hi to all,
I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well.
I was wondering if you knew about other ways or ressources to make such a gathering possible.
Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/ listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Universität Bremen Universität Heidelberg National Taiwan University
Hi there, so you can check it out here <https://github.com/schuen/facebook-page-post-scraper/tree/patch-1> in the /branch/modified, there I have uploaded the one I have used (but not sure it still runs.) best, Shuen On 18 July 2018 at 16:37, S.H. Yu <yu.shih.hsuan@gmail.com> wrote:
Good Day Alexandra,
this python code (a GitHub site <https://github.com/minimaxir/facebook-page-post-scraper>) had helped a year ago, but am not fully sure if it runs after many FB API updates; this code might not export the content of comment (and I have to double-check some relevant historical threads regarding this in this mailing list). What is needed here is to set up a facebook developer app, as well as to have the target facebook group ID, then to create an "app_secret" to iterate the call without pause. For the desired timeframe, the code specifies too for you to just fill in. Just drop me a line and I can send you the python code we have modified.
best regards, Shih-Hsuan
On 18 July 2018 at 07:39, Paolo Eusebi <paoloeusebi@gmail.com> wrote:
Hi Alexandra, I don't know if it helps but you can take a look at this: http://thinktostart.com/analyzing-facebook-with-r/. R can be used also for text analysis and networks. Best, Paolo.
Il lun 16 lug 2018, 19:17 Alexandra Bahary <alexandra.bahary@gmail.com> ha scritto:
Hi to all,
I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well.
I was wondering if you knew about other ways or ressources to make such a gathering possible.
Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Universität Bremen Universität Heidelberg National Taiwan University
-- Universität Bremen Universität Heidelberg National Taiwan University
Hi everyone, I am afraid the above suggestions that require an access token (eg the R and Python scripts) will not work anymore after the recent API changes. To use them, you need to create an App and pass the App Review. I am not sure if it would be possible for R and Python scripts. Best regards, Justin On Wed, 18 Jul 2018 at 15:37, S.H. Yu <yu.shih.hsuan@gmail.com> wrote:
Good Day Alexandra,
this python code (a GitHub site <https://github.com/minimaxir/facebook-page-post-scraper>) had helped a year ago, but am not fully sure if it runs after many FB API updates; this code might not export the content of comment (and I have to double-check some relevant historical threads regarding this in this mailing list). What is needed here is to set up a facebook developer app, as well as to have the target facebook group ID, then to create an "app_secret" to iterate the call without pause. For the desired timeframe, the code specifies too for you to just fill in. Just drop me a line and I can send you the python code we have modified.
best regards, Shih-Hsuan
On 18 July 2018 at 07:39, Paolo Eusebi <paoloeusebi@gmail.com> wrote:
Hi Alexandra, I don't know if it helps but you can take a look at this: http://thinktostart.com/analyzing-facebook-with-r/. R can be used also for text analysis and networks. Best, Paolo.
Il lun 16 lug 2018, 19:17 Alexandra Bahary <alexandra.bahary@gmail.com> ha scritto:
Hi to all,
I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well.
I was wondering if you knew about other ways or ressources to make such a gathering possible.
Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/ listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Universität Bremen Universität Heidelberg National Taiwan University _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
Hi all - picking up on this really late (was finishing up another big writing project and now returning to this issue)- sorry - did anyway find any solutions for this - particularly in Python? ___ Radhika Gajjala Co-editor of Ada: Journal of Gender and New Media (adanewmedia.org) Professor, School of Media and Communication and American Culture Studies Program Bowling Green State University, Bowling Green Ohio http://www.radhikagajjala.org On Tue, Jul 24, 2018 at 4:08 PM Justin Ho <Justin.Ho@ed.ac.uk> wrote:
Hi everyone,
I am afraid the above suggestions that require an access token (eg the R and Python scripts) will not work anymore after the recent API changes. To use them, you need to create an App and pass the App Review. I am not sure if it would be possible for R and Python scripts.
Best regards, Justin
On Wed, 18 Jul 2018 at 15:37, S.H. Yu <yu.shih.hsuan@gmail.com> wrote:
Good Day Alexandra,
this python code (a GitHub site <https://github.com/minimaxir/facebook-page-post-scraper>) had helped a year ago, but am not fully sure if it runs after many FB API updates; this code might not export the content of comment (and I have to double-check some relevant historical threads regarding this in this mailing list). What is needed here is to set up a facebook developer app, as well as to have the target facebook group ID, then to create an "app_secret" to iterate the call without pause. For the desired timeframe, the code specifies too for you to just fill in. Just drop me a line and I can send you the python code we have modified.
best regards, Shih-Hsuan
On 18 July 2018 at 07:39, Paolo Eusebi <paoloeusebi@gmail.com> wrote:
Hi Alexandra, I don't know if it helps but you can take a look at this: http://thinktostart.com/analyzing-facebook-with-r/. R can be used also for text analysis and networks. Best, Paolo.
Il lun 16 lug 2018, 19:17 Alexandra Bahary <alexandra.bahary@gmail.com
ha
scritto:
Hi to all,
I've been trying to import data form a public Facebook group as dataset, mainly for qualitative analysis. The group includes substantial amounts of data with thousands of users. I would need to extract data (posts and comments) for at least a two months period. I was previously using a NVivo extension (NCapture) to do so, but Facebook recently changes its API, which implies restrictions for dataset import. Tools such as Netvizz don't seem to work at the moment as well.
I was wondering if you knew about other ways or ressources to make such a gathering possible.
Best, Alexandra _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/ listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Universität Bremen Universität Heidelberg National Taiwan University _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/ The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
participants (7)
-
Alexandra Bahary -
An, Seongho -
f hodgkins -
Justin Ho -
Paolo Eusebi -
Radhika G -
S.H. Yu