Re: [Air-L] Please assist a grad student on using SNA to study pre- and post-disaster social networks? (Yosem Companys)
1. What is the best method for collecting pre- and post-disaster data on social media? 2. Is it possible to collect data not just on Twitter but also on all social media platforms (e.g., Facebook, Instagram, LinkedIn)? These two sort of go tot 3. Which social network analysis (SNA) tool has the easiest learning curve and is the easiest to use to analyze relational structures on social media? I truly appreciate your help and advice, and I look forward to hearing from you. Thanks, Yosem ------------------------------ Message: 2 Date: Thu, 21 Feb 2019 17:54:28 -0300 From: Cristhian Daniel <cdparra@gmail.com> To: Tatiana Silva <tatianamssilva@gmail.com> Cc: Katherine Sullivan <kathern.sullivan@gmail.com>, "air-l@listserv.aoir.org" <air-l@listserv.aoir.org> Subject: Re: [Air-L] Searching for Mentor: Twitter API//Data Collection Message-ID: <CAHao0HdGRCygMPt5jKSDOvKM8180cqWmwcv5UmXXprMpXP0RuA@mail.gmail.com> Content-Type: text/plain; charset="UTF-8" Hi Heather, We have used Tweepy <https://github.com/tweepy/tweepy> last year to collect tweets before, during and after primaries and presidential elections in Paraguay. Our basic tweet collector, based on Tweepy, and which worked pretty well for us, is available here <https://github.com/ParticipaPY/politic-bots/blob/master/src/tweet_collector/twitter_api_manager.py>. You can learn more about the whole project and our approach to collect data in the project README and docs: https://github.com/ParticipaPY/politic-bots/. I am also happy to help you out if you have any questions. We also have a few informal publications about the role of Twitter in Paraguayan Elections, but they are in Spanish (primaries [1 <https://medium.com/@jorgesaldivar/redes-sociales-en-procesos-electorales-89f2925966b6> ][2 <https://medium.com/@jorgesaldivar/la-importancia-de-perfiles-influyentes-en-procesos-electorales-5b3fcf7614cd>], general elections[3 <https://medium.com/@laconich1991/el-rol-de-twitter-en-las-elecciones-generales-de-paraguay-2018-93df1750c244>]). We are currently in the process of writing up our work, including our methodological approach and tools, to be published later on a journal TBD (BTW, suggestions are welcomed). Hope it helps! On Thu, Feb 21, 2019 at 5:20 PM Tatiana Silva <tatianamssilva@gmail.com> wrote:
Hello!
I would really like to keep up with whatever group that might be formed from this conversation. My main research is about the use of Twitter by museum visitors but I am also interested in studying controversies.
Thanks!
Tatiana M. S. Silva
Em qui, 21 de fev de 2019 ?s 13:30, Katherine Sullivan < kathern.sullivan@gmail.com> escreveu:
Good morning,
I would love to join the subgroup as well! I'm currently working on my doctoral thesis pertaining to the use of social media by Canadian mayors and am attempting to use TwitteR, RFacebook and InstaR packages in R, but am having some issues with authentication.
Thank you so much for this initiative!
Katherine Sullivan
On Thu, Feb 21, 2019 at 8:40 AM Radhika G <gradhika2012@gmail.com> wrote:
Yay! I will
Because I already went to github etc
Thankyou!
On Thu, Feb 21, 2019 at 8:37 AM Isabel Galvis < galvisi@uni.coventry.ac.uk> wrote:
Go to GitHub - download the code you need =)
Email me if you need help =)
Best regards,
ISABEL GALVIS, M.A. Google Certified Professional | Yahoo! Search Marketing Ambassador Microsoft adExcellence Member | Bing Advertisement Professional E: isabelgalvis@gmail.com | LI: Linkedin.com/isabelgalvis | T: @isabelgalvis
-----Original Message----- From: Air-L <air-l-bounces@listserv.aoir.org> On Behalf Of isioma chiluwa Sent: 21 February 2019 13:33 To: Heather Walker <hgabel3@uic.edu> Cc: air-l@listserv.aoir.org Subject: Re: [Air-L] Searching for Mentor: Twitter API//Data Collection
Dear all
I am also interested in joining this group. I am a PhD student with research interest in language of identity in online social movements. I also have problems with retrieving and analysing data. I would also need this mentorship.
Regards
On Feb 20, 2019 17:32, "Heather Walker" <hgabel3@uic.edu> wrote:
Hello Esteemed Internet Researchers,
My name is Heather Walker and I am a PhD candidate at the University of Illinois at Chicago. For my dissertation project, I am taking a netnographic approach looking at Twitter and Instagram data. I applied for access to the Twitter API via their developer site, was approved, and now have an access key. I've been trying to learn Python by taking free online courses and watching a million youtube videos. However, I hit a snag every time and usually can't figure out how to fix it.
I also have been using DiscoverText (incredible tool), but have already exceeded the data limit, making continued data collection there impossible.
I am reaching out via this listserv to see if there are any lovely researchers with experience using the Twitter API to aggregate data who may be willing to mentor me? I am working on several manuscripts right now using Twitter data, so can offer co-authorship through the partnership. My interests and collected data thus far revolve around disability, rights, access, and civic participation, diabetes cultural groups, social movements using hashtags, and social movement hijacking.
I am also hoping some of you might know about any potential United-States based workshops that provide hands-on training using big-data digital methods?
Thank you for your consideration and shared resources.
Cheers!
Heather Walker
-- *Heather Walker (Gabel), MS* Disability Studies Ph.D. Candidate (ABD) College of Applied Health Sciences University of Illinois, Chicago hgabel3@uic.edu : 503.755.7673 1919 W. Taylor Street, Chicago IL <
https://maps.google.com/?q=1919+W.+Taylor+Street,+Chicago+IL&entry=gmail&sou...
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the
Association
of Internet Researchers
Subscribe, change options or unsubscribe at:
Join the Association of Internet Researchers:
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers
Subscribe, change options or unsubscribe at:
Join the Association of Internet Researchers:
University of the Year for Student Experience The Times and Sunday Times Good University Guide 2019
2nd for Teaching Excellence Times Higher Education UK (TEF) metrics ranking 2017 ? Gold winner
5th UK Student City QS Best Student Cities Index 2018
13th in Guardian University Guide 2019 of 121 UK institutions ranked
NOTICE
This message and any files transmitted with it is intended for the addressee only and may contain information that is confidential or privileged. Unauthorised use is strictly prohibited. If you are not the addressee, you should not read, copy, disclose or otherwise use this message, except for the purpose of delivery to the addressee.
Any views or opinions expressed within this e-mail are those of the author and do not necessarily represent those of Coventry University. _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- ___ Radhika Gajjala Managing Editor: Fembot Collective Co-editor of Ada: Journal of Gender and New Media (adanewmedia.org)
Professor, School of Media and Communication and American Culture Studies Program
Bowling Green State University, Bowling Green Ohio http://www.radhikagajjala.org _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Katherine V.R. Sullivan Candidate au doctorat / PhD Candidate D?partement de science politique - Universit? de Montr?al Centre for the Study of Democratic Citizenship Groupe de recherche en communication politique de l'Universit? Laval katherine.sullivan@umontreal.ca _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- *Cristhian Parra* Principal Investigator / Investigador Principal @ TopaDengue <https://www.facebook.com/topadengue/> Associate Researcher / Docente Investigador @ DEI-LED, Universidad Cat?lica de Asunci?n, Paraguay Lead Design Researcher & Engineer / Director de Dise?o y Desarrollo @ AppCivist <https://www.appcivist.org/> Postdoctoral Alumni @ UC Berkeley, California & Inria, Paris / PhD Alumni @ UniTN, Trento, Italy ------------------------------ Subject: Digest Footer _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ ------------------------------ End of Air-L Digest, Vol 175, Issue 17 **************************************
It depends on the disaster. There are big collections of Twitter data on some and this is one of the few areas historically where Twitter has (minimally) sponsored research by making a handful of data grants, though that era may now be over. We may have specific disaster Tweet collections in DiscoverText that are notable and open for collaboration, but I am unclear what pre-disaster data would consist of. Is that 100% of geolocated Tweets in the hours before a disaster? That would be an interesting idea, but a tough one to execute. You can write to help@discovertext.com if you have specific disasters in mind; we will hunt for some sample data. DiscoverText has sponsored many hundreds of academic research projects over the last 9 years and disaster research is something we are more than happy to sponsor in the future. There are disaster research examples here: https://discovertext.com/publications As for platform data access, LinkedIn never was and probably never will be an option for data. Facebook collections may exist on the hard drives of academics, but they are not necessarily easy to access or share. The two main options for social network visualizations that I am familiar with use .graphml formatted exports of Twitter data. NodeXL and Gephi offer two quite different yet similar options. NodeXL is a lighter learning curve and Gephi is a more powerful, open source tool. With respect to using NodeXL or Gephi, we advise that users clean the data first, removing all extraneous content, otherwise the confounding factors in the visualization are potentially barriers to valid inferences. DiscoverText enables data cleaning, search, n-grams, human labeling, measurement tools, and machine-learning, among other options, all of which which are all the most basic (minimal) steps you should take take to clean the data before generating a .graphml file from Twitter data for a network visualization. Raw Twitter data in a network viz is invariably misleading and overwhelming. Clean and focused data makes the visualizations more likely to support valid inferences. ~Stu Stu Shulman <https://twitter.com/StuartWShulman>US Soccer C-Licensed Coach On Thu, Feb 21, 2019 at 6:36 PM Sugar, Benjamin N <bsugar@gatech.edu> wrote:
1.
What is the best method for collecting pre- and post-disaster data on social media? 2. Is it possible to collect data not just on Twitter but also on all social media platforms (e.g., Facebook, Instagram, LinkedIn)?
These two sort of go tot
3. Which social network analysis (SNA) tool has the easiest learning curve and is the easiest to use to analyze relational structures on social media?
I truly appreciate your help and advice, and I look forward to hearing from you.
Thanks, Yosem
------------------------------
Message: 2 Date: Thu, 21 Feb 2019 17:54:28 -0300 From: Cristhian Daniel <cdparra@gmail.com> To: Tatiana Silva <tatianamssilva@gmail.com> Cc: Katherine Sullivan <kathern.sullivan@gmail.com>, "air-l@listserv.aoir.org" <air-l@listserv.aoir.org> Subject: Re: [Air-L] Searching for Mentor: Twitter API//Data Collection Message-ID: <CAHao0HdGRCygMPt5jKSDOvKM8180cqWmwcv5UmXXprMpXP0RuA@mail.gmail.com> Content-Type: text/plain; charset="UTF-8"
Hi Heather,
We have used Tweepy <https://github.com/tweepy/tweepy> last year to collect tweets before, during and after primaries and presidential elections in Paraguay. Our basic tweet collector, based on Tweepy, and which worked pretty well for us, is available here < https://github.com/ParticipaPY/politic-bots/blob/master/src/tweet_collector/...
. You can learn more about the whole project and our approach to collect data in the project README and docs: https://github.com/ParticipaPY/politic-bots/. I am also happy to help you out if you have any questions.
We also have a few informal publications about the role of Twitter in Paraguayan Elections, but they are in Spanish (primaries [1 < https://medium.com/@jorgesaldivar/redes-sociales-en-procesos-electorales-89f...
][2 < https://medium.com/@jorgesaldivar/la-importancia-de-perfiles-influyentes-en-...
], general elections[3 < https://medium.com/@laconich1991/el-rol-de-twitter-en-las-elecciones-general... ]). We are currently in the process of writing up our work, including our methodological approach and tools, to be published later on a journal TBD (BTW, suggestions are welcomed).
Hope it helps!
On Thu, Feb 21, 2019 at 5:20 PM Tatiana Silva <tatianamssilva@gmail.com> wrote:
Hello!
I would really like to keep up with whatever group that might be formed from this conversation. My main research is about the use of Twitter by museum visitors but I am also interested in studying controversies.
Thanks!
Tatiana M. S. Silva
Em qui, 21 de fev de 2019 ?s 13:30, Katherine Sullivan < kathern.sullivan@gmail.com> escreveu:
Good morning,
I would love to join the subgroup as well! I'm currently working on my doctoral thesis pertaining to the use of social media by Canadian mayors and am attempting to use TwitteR, RFacebook and InstaR packages in R, but am having some issues with authentication.
Thank you so much for this initiative!
Katherine Sullivan
On Thu, Feb 21, 2019 at 8:40 AM Radhika G <gradhika2012@gmail.com> wrote:
Yay! I will
Because I already went to github etc
Thankyou!
On Thu, Feb 21, 2019 at 8:37 AM Isabel Galvis < galvisi@uni.coventry.ac.uk> wrote:
Go to GitHub - download the code you need =)
Email me if you need help =)
Best regards,
ISABEL GALVIS, M.A. Google Certified Professional | Yahoo! Search Marketing Ambassador Microsoft adExcellence Member | Bing Advertisement Professional E: isabelgalvis@gmail.com | LI: Linkedin.com/isabelgalvis | T: @isabelgalvis
-----Original Message----- From: Air-L <air-l-bounces@listserv.aoir.org> On Behalf Of isioma chiluwa Sent: 21 February 2019 13:33 To: Heather Walker <hgabel3@uic.edu> Cc: air-l@listserv.aoir.org Subject: Re: [Air-L] Searching for Mentor: Twitter API//Data Collection
Dear all
I am also interested in joining this group. I am a PhD student with research interest in language of identity in online social movements. I also have problems with retrieving and analysing data. I would also need this mentorship.
Regards
On Feb 20, 2019 17:32, "Heather Walker" <hgabel3@uic.edu> wrote:
Hello Esteemed Internet Researchers,
My name is Heather Walker and I am a PhD candidate at the University of Illinois at Chicago. For my dissertation project, I am taking a netnographic approach looking at Twitter and Instagram data. I applied for access to the Twitter API via their developer site, was approved, and now have an access key. I've been trying to learn Python by taking free online courses and watching a million youtube videos. However, I hit a snag every time and usually can't figure out how to fix it.
I also have been using DiscoverText (incredible tool), but have already exceeded the data limit, making continued data collection there impossible.
I am reaching out via this listserv to see if there are any lovely researchers with experience using the Twitter API to aggregate data who may be willing to mentor me? I am working on several manuscripts right now using Twitter data, so can offer co-authorship through the partnership. My interests and collected data thus far revolve around disability, rights, access, and civic participation, diabetes cultural groups, social movements using hashtags, and social movement hijacking.
I am also hoping some of you might know about any potential United-States based workshops that provide hands-on training using big-data digital methods?
Thank you for your consideration and shared resources.
Cheers!
Heather Walker
-- *Heather Walker (Gabel), MS* Disability Studies Ph.D. Candidate (ABD) College of Applied Health Sciences University of Illinois, Chicago hgabel3@uic.edu : 503.755.7673 1919 W. Taylor Street, Chicago IL <
https://maps.google.com/?q=1919+W.+Taylor+Street,+Chicago+IL&entry=gmail&sou...
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the
Association
of Internet Researchers
Subscribe, change options or unsubscribe at:
Join the Association of Internet Researchers:
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers
Subscribe, change options or unsubscribe at:
Join the Association of Internet Researchers:
University of the Year for Student Experience The Times and Sunday Times Good University Guide 2019
2nd for Teaching Excellence Times Higher Education UK (TEF) metrics ranking 2017 ? Gold winner
5th UK Student City QS Best Student Cities Index 2018
13th in Guardian University Guide 2019 of 121 UK institutions ranked
NOTICE
This message and any files transmitted with it is intended for the addressee only and may contain information that is confidential or privileged. Unauthorised use is strictly prohibited. If you are not the addressee, you should not read, copy, disclose or otherwise use this message, except for the purpose of delivery to the addressee.
Any views or opinions expressed within this e-mail are those of the author and do not necessarily represent those of Coventry University. _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- ___ Radhika Gajjala Managing Editor: Fembot Collective Co-editor of Ada: Journal of Gender and New Media (adanewmedia.org)
Professor, School of Media and Communication and American Culture Studies Program
Bowling Green State University, Bowling Green Ohio http://www.radhikagajjala.org _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Katherine V.R. Sullivan Candidate au doctorat / PhD Candidate D?partement de science politique - Universit? de Montr?al Centre for the Study of Democratic Citizenship Groupe de recherche en communication politique de l'Universit? Laval katherine.sullivan@umontreal.ca _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- *Cristhian Parra* Principal Investigator / Investigador Principal @ TopaDengue <https://www.facebook.com/topadengue/> Associate Researcher / Docente Investigador @ DEI-LED, Universidad Cat?lica de Asunci?n, Paraguay Lead Design Researcher & Engineer / Director de Dise?o y Desarrollo @ AppCivist <https://www.appcivist.org/> Postdoctoral Alumni @ UC Berkeley, California & Inria, Paris / PhD Alumni @ UniTN, Trento, Italy
------------------------------
Subject: Digest Footer
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
------------------------------
End of Air-L Digest, Vol 175, Issue 17 ************************************** _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
Is that 100% of geolocated Tweets in the hours before a disaster? That would be an interesting idea, but a tough one to execute. Stu’s point is very true. When the GPS data was not available in the Tweet, we used the location field of the Twitter user’s profile and OpenStreetMap’s Nominatim which gives (or used to give) you a probability of where your query was located. Of course, not all users have an accurate location field,some are jokes or fictitious places (e.g. Hogwarts) but we got enough state level data for a paper out of it. https://github.com/openstreetmap/Nominatim https://wiki.openstreetmap.org/wiki/Nominatim
Hi all, Anyone who's interested in converting free-text location fields into standardized location data might want to look at a Python module I designed to do just that: https://github.com/dfreelon/geostring You simply feed it a list of locations and it tries to guess where each one is at the country, sub-country (state/province), and city levels. I'm interested to see how people might use it. Best, /DEEN On 2/22/2019 10:23 AM, Sugar, Benjamin N wrote:
Is that 100% of geolocated Tweets in the hours before a disaster? That would be an interesting idea, but a tough one to execute.
Stu’s point is very true. When the GPS data was not available in the Tweet, we used the location field of the Twitter user’s profile and OpenStreetMap’s Nominatim which gives (or used to give) you a probability of where your query was located.
Of course, not all users have an accurate location field,some are jokes or fictitious places (e.g. Hogwarts) but we got enough state level data for a paper out of it.
https://github.com/openstreetmap/Nominatim
https://wiki.openstreetmap.org/wiki/Nominatim _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Deen Freelon, Ph.D. Associate Professor School of Media and Journalism, UNC-Chapel Hill http://dfreelon.org | @dfreelon <https://twitter.com/dfreelon> | https://github.com/dfreelon
participants (3)
-
Deen Freelon -
Stuart Shulman -
Sugar, Benjamin N