- Air-L - lists.aoir.org

Netflix open-sources some data tools
by Richard Forno 28 Aug '14

28 Aug '14

FYI, Netflix released (open-source) some data-mining tools that its security team uses for Internet monitoring. They may have some applicability for internet researchers, so I'm passing the link along as an FYI. See more @ Announcing Scumblr and Sketchy - Search, Screenshot, and Reclaim the Internet http://techblog.netflix.com/2014/08/announcing-scumblr-and-sketchy-search.h… --- Just because i'm near the punchbowl doesn't mean I'm also drinking from it.

1 0

Reminder - CFP: Special Issue of the Journal of Faculty Development on Social Media
by Carpenter, Russell 28 Aug '14

28 Aug '14

Colleagues, I hope you$B!G(Bll consider submitting to the special issue below. There$B!G(Bs still time! Call for Papers May 2015 Special Issue of Journal of Faculty Development Guest Edited by: Russell Carpenter, Eastern Kentucky University Theme: Social Media in Pedagogy and Practice: Networked Teaching and Learning While many forms of social media are no longer considered $B!H(Bnew,$B!I(B their instructional uses continue to both inspire and challenge faculty and students. A variety of social media permeate the classroom whether used for pedagogical or personal purposes. Many instructors also use social media in their personal lives, but its role and potential in the classroom are still evolving. While the dynamic nature of social media provides a number of pedagogical opportunities to engage students in productive ways, integrating social media into class sessions and projects also presents new challenges not faced with other instructional technologies. This special issue invites scholars to highlight the most successful and promising strategies for integrating social media into the classroom while also considering the challenges these technologies present for teaching and learning. Authors might consider the best practices for integrating social media into the classroom for instructional purposes, theories and principles that support the decision to incorporate social media into classroom settings, challenges faced and approaches for overcoming these challenges, and projects that incorporate social media along with learning outcomes. Submissions might also explore, theorize, and assess innovative concepts, approaches, and strategies for classroom instruction using social media. Framing questions can include but are not limited to: $B!|(B What classroom activities are best suited for implementing social media? What specific projects might incorporate social media and how were these projects assessed? $B!|(B What are the best practices for using social media for instruction? $B!|(B How might various forms of social media engage student learning outcomes? What factors should instructors consider when deciding whether to employ social media? $B!|(B What are the theoretical frameworks for teaching with social media and how might they inform instruction? What training or professional development might benefit instructors exploring social media for classroom instruction? $B!|(B What issues and challenges arise when incorporating social media into the classroom, including political, social, and institutional contexts and expectations? What boundaries, parameters, or guidelines are necessary for classroom use of social media and how might they present challenges, if at all? $B!|(B What are the goals for incorporating social media into the classroom and how were these goals achieved, adapted, or revised? How might students contribute to these goals as they use social media in their own learning? Please send 500-word proposals and questions to Russell Carpenter at [1]russell.carpenter(a)eku.edu. Authors of accepted proposals will receive detailed guidelines for manuscript submission. Deadlines September 1, 2014: 500-word proposals due November 15, 2014: Authors notified of review results January 15, 2015: Full articles of 3,000 - 5,000 words returned to guest editor February 15, 2015: Article revisions sent to authors March 30, 2015: Final submissions due to guest editor -- Russell G. Carpenter, Ph.D. Director, Noel Studio for Academic Creativity Program Director, Minor in Applied Creative Thinking Assistant Professor of English Eastern Kentucky University 859.622.7403 russell.carpenter(a)eku.edu www.studio.eku.edu | @noelstudio References 1. mailto:atrussell.carpenter@eku.edu

1 0

Aberystwyth Internet Jurisdiction Symposium - Sep 10-11
by Joly MacFie 28 Aug '14

28 Aug '14

It has come to my attention that Aberystwith U. (Wales) are holding an Internet Jurisdiction Symposium on Sep 10-11 http://www.aber.ac.uk/en/internet-jurisdiction/ They are going to stream it live to a couple of other Universities, and are actively recruiting more locations. http://www.aber.ac.uk/en/internet-jurisdiction/participation/. -- --------------------------------------------------------------- Joly MacFie 218 565 9365 Skype:punkcast WWWhatsup NYC - http://wwwhatsup.com http://pinstand.com - http://punkcast.com VP (Admin) - ISOC-NY - http://isoc-ny.org -------------------------------------------------------------- -

1 0

Internet Rights and Principles Coalition Panels @IGF
by Burcu Bakioglu 28 Aug '14

28 Aug '14

Hi all, I would like to alert those of you who are attending the Internet Governance Forum 2014 in Istanbul to the following IRP panels/events. Human Rights for the Internet: From Principles to Action Sept 2, 11:00-12:30PM, WS83 http://igf2014.sched.org/event/3e25d63b87b9c4dd41bb3000026b806b#.U_7UdEj-SYo Anonymity by Design: Protecting While Connecting Sept 4, 11:00-12:30PM, WS146 http://igf2014.sched.org/event/b78a96b68de216dd4eb856751658c729?iframe=no&w… Online Freedoms and Access to Information Online Sept 5, 9:00-10:30AM, WS225 http://igf2014.sched.org/event/108673c90f772a94e889c94a72651104?iframe=no&w… Dynamic Coalition on Internet Rights and Principles: The IRPC Charter of Human rights and Principles for the Internet: 5 years on Sept 4, 4:30-6:00PM http://igf2014.sched.org/event/6351f1d8c02523edc26c9274e6bb82ff?iframe=no&w… Thank you. -- Thanks, Burcu S. Bakioglu, Ph.D. Postdoctoral Fellow in New Media Lawrence University http://www.palefirer.com -- "There is nothing more frightening than a clown after midnight." Lon Chaney

2 1

Book Announcement: Beyond Imported Magic: Essays on Science, Technology and Society in Latin America
by Eden Medina 28 Aug '14

28 Aug '14

Dear all, This publication may be of interest to list readers, especially the two chapters by Anita Chan and Morgan Ames on the XO laptop created by the One Laptop per Child program. The book has been structured so that each chapter stands alone and can be used for teaching. More information about the book is available at: http://mitpress.mit.edu/books/beyond-imported-magic. Apologies for cross postings. Beyond Imported Magic: Essays on Science, Technology and Society in Latin America Edited by Eden Medina, Ivan da Costa Marques, and Christina Holmes Foreword by Marcos Cueto MIT Press, 2014, 396 pp. ISBN: 9780262526203 (paperback) Also available in hardback and Kindle Amazon URL: http://www.amazon.com/Beyond-Magic-Science-Technology-Society/dp/0262526204… The essays in this volume study the creation, adaptation, and use of science and technology in Latin America. They challenge the view that scientific ideas and technology travel unchanged from the global North to the global South -- the view of technology as "imported magic." They describe not only alternate pathways for innovation, invention, and discovery but also how ideas and technologies circulate in Latin American contexts and transnationally. The contributors’ explorations of these issues, and their examination of specific Latin American experiences with science and technology, offer a broader, more nuanced understanding of how science, technology, politics, and power interact in the past and present. The essays in this book use methods from history and the social sciences to investigate forms of local creation and use of technologies; the circulation of ideas, people, and artifacts in local and global networks; and hybrid technologies and forms of knowledge production. They address such topics as the work of female forensic geneticists in Colombia; the pioneering Argentinean use of fingerprinting technology in the late nineteenth century; the design, use, and meaning of the XO Laptops created and distributed by the One Laptop per Child Program; and the development of nuclear energy in Argentina, Mexico, and Chile. Contributors: Pedro Ignacio Alonso, Morgan G. Ames, Javiera Barandiarán, João Biehl, Anita Say Chan, Amy Cox Hall, Henrique Cukierman, Ana Delgado, Rafael Dias, Adriana Díaz del Castillo H., Mariano Fressoli, Jonathan Hagood, Christina Holmes, Matthieu Hubert, Noela Invernizzi, Michael Lemon, Ivan da Costa Marques, Gisela Mateos, Eden Medina, María Fernanda Olarte Sierra, Hugo Palmarola, Tania Pérez-Bustos, Julia Rodriguez, Israel Rodríguez-Giralt, Edna Suárez Díaz, Hernán Thomas, Manuel Tironi, Dominique Vinck Table of Contents 1 Introduction: Beyond Imported Magic// Eden Medina, Ivan da Costa Marques, and Christina Holmes SECTION I: Latin American Perspectives on Science, Technology, and Society 2 Who Invented Brazil? // Henrique Cukierman 3 Innovation and Inclusive Development in the South: A Critical Perspective // Mariano Fressoli, Rafael Dias, and Hernán Thomas 4 Working with Care: Experiences of Invisible Women Scientists Practicing Forensic Genetics in Colombia // Tania Pérez-Bustos, María Fernanda Olarte Sierra, and Adriana Díaz del Castillo H. 5 Ontological Politics and Latin American Local Knowledges // Ivan da Costa Marques 6 Technology in an Expanded Field: A Review of History of Technology Scholarship on Latin America in Select English-Language Journals // Michael Lemon and Eden Medina SECTION II: Local and Global Networks of Innovation 7 South Atlantic Crossings: Fingerprints, Science, and the State In Turn of the Twentieth Century Argentina // Julia Rodriguez 8 Tropical Assemblage: The Soviet Large Panel in Cuba // Hugo Palmarola and Pedro Alonso 9 Balancing Design: OLPC Engineers and ICT Translations at the Periphery // Anita Chan 10 Translating Magic: The Charisma of OLPC's XO Laptop in Paraguay // Morgan G. Ames 11 Nanoscience and Nanotechnology: How has an Emerging Area on the Scientific Agenda of the Core Countries been Adopted and Transformed in Latin America? // Noela Invernizzi, Matthieu Hubert, and Dominique Vinck 12 Latin America as Laboratory: The Camera and the Yale Peruvian Expeditions // Amy Cox Hall SECTION III: Science, Technology and Latin American Politics 13 Bottling Atomic Energy: Technology, Politics, and the State in Peronist Argentina // Jonathan Hagood 14 Peaceful Atoms in Mexico // Gisela Mateos and Edna Suárez Díaz 15 Neoliberalism as Political Technology: Expertise, Energy and Democracy in Chile // Manuel Tironi and Javiera Barandiarán 16 Creole Interferences: A Conflict on Biodiversity and Ownership in the South of Brazil // Ana Delgado and Israel Rodriguez-Giralt 17 The Juridical Hospital: Patient-Citizen-Consumers Claiming the Right to Health in Brazilian Courts // João Biehl Endorsements: At one level the term 'beyond imported magic' situates this collection as a contribution to the critique of the traditional North-South diffusionist stories of science and technology, but at another level the essays take the reader beyond the 'imported magic' of Northern theories of STS. By connecting us with the reflexive and critical voices of Latin American STS scholarship, this book is a great introduction to contemporary modes of rethinking STS from Latin American perspectives." -David J. Hess, Sociology, Vanderbilt University This astonishing collection provides for both science and technology studies and postcolonial students and scholars valuable new pathways for thinking and illuminatingly different conceptual approaches. These authors usher in a much-needed expansive era for historians, philosophers, sociologists, political theorists, and ethnographers of science as well as for readers in other fields. I can't wait to teach it. -Sandra Harding, Distinguished Professor, Departments of Education and Gender Studies, University of California, Los Angeles; Distinguished Affiliate Professor, Department of Philosophy, Michigan State University; and author of Sciences from Below In this enchanting book, leading scholars conjure up surprising and gripping new configurations of science and technology in Latin America. These essays reveal brilliantly how local and regional histories haunt so-called global scientific projects. Beyond Imported Magic brings Latin America into contemporary conversations about what makes technoscience appear so worldly and cosmopolitan, even as it is experienced as situated and place-bound in practice. This book will cast a spell on anyone who wants to understand the multiple ways in which we try, and often fail, to be both modern and global. -Warwick Anderson, University of Sydney, author of The Collectors of Lost Souls This exciting and thought-provoking volume shows how analyzing Latin America through an STS lens allows us to peer more closely at known histories and uncover new and in some cases existing but understudied connections. Once we divest ourselves of outdated adjectives such as 'peripheral' to explain the role of Latin America in science we invariably begin to see the region as a center with a long history of scientific production and with the many complexities that this entails. By placing Latin America into longer narratives of (redefined or reemphasized) scientific research, the authors crucially demonstrate science as ever-present and not a relatively new, imported phenomena of the nineteenth/twentieth centuries. -Gabriela Soto Laveaga, author of Jungle Laboratories: Mexican Peasants, National Projects, and the Making of the Pill

1 0

Two positions at the University of Toronto Mississauga — Culture and New Media, Media Theory
by Nicole Cohen 28 Aug '14

28 Aug '14

We would like to bring your attention to a new Assistant Professor of Culture and New Media position in the Institute of Communication, Culture, Information & Technology at the University of Toronto Mississauga. You will find the posting below and online at: https://utoronto.taleo.net/careersection/10050/jobdetail.ftl?lang=en&job=14… Assistant Professor – Culture and New Media Institute of Communication, Culture, Information and Technology (ICCIT) The Institute of Communication, Culture, Information and Technology (ICCIT) at the University of Toronto Mississauga invites applications for a tenure-stream position in the area of Culture and New Media at the rank of Assistant Professor. The appointment will commence on July 1, 2015. We seek a candidate to build on the strengths of the Institute through research that examines the intersection of culture and new media in relation to the social, political, and economic dimensions of life in both Canada and abroad. We are particularly interested in individuals doing work in areas like digital culture, surveillance studies, and globalization. Applicants must have earned a Ph.D. degree by the appointment start date (or shortly thereafter) in a related field and have a demonstrated record of excellence in teaching and research. The successful candidate will teach undergraduate and graduate courses focusing on culture and new media and s/he will have a graduate appointment in one of the University’s tri-campus graduate departments. Salary will be commensurate with qualifications and experience. The Institute of Communication, Culture, Information and Technology at the University of Toronto Mississauga focuses on teaching and research excellence in its four undergraduate programs: Communication, Culture and Information Technology (CCIT), Interactive Digital Media (IDM), Digital Enterprise Management (DEM), and Professional Writing and Communication (PWC). Currently, ICCIT is building a research complement in social networking and communication, interactive and immersive digital media and culture, and the theory and practice of design, with an emphasis on all aspects of digital media. ICCIT is also actively engaged with the community and profit and non-profit organizations. All qualified candidates are invited to apply online by clicking on the link below. Submission guidelines can be found at: http://<http://uoft.me/how-to-apply>uoft.me/how-to-apply<http://uoft.me/how-to-apply>. We recommend combining attached documents into one or two files in PDF/MS Word files in the following format: 1) Letter, CV, and research & teaching statements 2) Publications Applicants must have three referees send signed letters directly to Professor Anthony Wensley, Director, ICCIT, University of Toronto Mississauga via email to iccit.utm(a)utoronto.ca<mailto:iccit.utm@utoronto.ca> by the closing date, November 21, 2014. For more information on the Institute of Communication, Culture, Information and Technology, please visit our website: http://<http://www.utm.utoronto.ca/iccit>www.utm.utoronto.ca/iccit<http://www.utm.utoronto.ca/iccit> To apply online please click: https://utoronto.taleo.net/careersection/10050/jobdetail.ftl?lang=en&job=14… All qualified candidates are encouraged to apply; however, Canadians and permanent residents will be given priority. The University of Toronto is strongly committed to diversity within its community and especially welcomes applications from visible minority group members, women, Aboriginal persons, persons with disabilities, members of sexual minority groups, and others who may contribute to the further diversification of ideas. --- We would like to bring your attention to a new Associate Professor of Media Theory position in the Institute of Communication, Culture, Information & Technology at the University of Toronto Mississauga. You will find the posting below and online at: https://utoronto.taleo.net/careersection/10050/jobdetail.ftl?lang=en&job=14… Associate Professor – Media Theory Institute of Communication, Culture, Information and Technology (ICCIT) The Institute of Communication, Culture, Information and Technology (ICCIT) at the University of Toronto Mississauga invites applications in the area of Media Theory at the rank of Associate Professor. The appointment will commence on July 1, 2015. Applicants must have a Ph.D. in a relevant field and must demonstrate a record of excellence in research and teaching, have an established reputation in the field, and have an active record of publication in the area of critical communication studies. We seek scholars from a wide range of analytical approaches to media theory, including communication studies, information studies, science and technology studies, cultural studies, queer/feminist theory, political economy, political science, and policy studies. The successful candidate will teach undergraduate and graduate courses in her/his area of specialization and must be experienced in educating and mentoring graduate students, junior researchers and/or professionals. The successful candidate’s graduate appointment will be in one of the University’s tri-campus graduate departments. Previous administrative experience, and experience in developing new curricula at both the graduate and undergraduate levels, would be assets. Salary will be commensurate with qualifications and experience. The Institute of Communication, Culture, Information and Technology at the University of Toronto Mississauga focuses on teaching and research excellence in its four undergraduate programs: Communication, Culture, Information and Technology (CCIT), Interactive Digital Media (IDM), Digital Enterprise Management (DEM), and Professional Writing and Communication (PWC). Currently, the ICCIT is building a research complement in social networking and communication, interactive and immersive digital media and culture, and the theory and practice of design, with an emphasis on all aspects of digital media. ICCIT is also actively engaged with the community and profit and non-profit organizations. All qualified candidates are invited to apply online by clicking on the link below. Submission guidelines can be found at: http://<http://uoft.me/how-to-apply>uoft.me/how-to-apply<http://uoft.me/how-to-apply>. We recommend combining attached documents into one or two files in PDF/MS Word files in the following format: 1) Letter, CV, and research & teaching statements 2) Publications Applicants should also provide the names and contact details of three referees in their application. All application materials must be submitted online by the closing date, October 17, 2014. For more information on the Institute of Communication, Culture, Information and Technology, please visit our website: http://<http://www.utm.utoronto.ca/iccit>www.utm.utoronto.ca/iccit<http://www.utm.utoronto.ca/iccit> To apply online please click: https://utoronto.taleo.net/careersection/10050/jobdetail.ftl?lang=en&job=14… All qualified candidates are encouraged to apply; however, Canadians and permanent residents will be given priority. The University of Toronto is strongly committed to diversity within its community and especially welcomes applications from visible minority group members, women, Aboriginal persons, persons with disabilities, members of sexual minority groups, and others who may contribute to the further diversification of ideas. Nicole S. Cohen, PhD Assistant Professor, University of Toronto Institute of Communication, Culture and Information Technology (UTM) & Faculty of Information nicole.cohen(a)utoronto.ca || 905-828-3906 || CCT 3004

1 0

iConference Deadline Reminder
by Ingrid Erickson 28 Aug '14

28 Aug '14

Deadline Alert: iConference 2015// iConference 2015: Create-Collaborate-Celebrate Newport Beach, CA, USA; March 24-27, 2015 Conference Site: http://ischools.org/the-iconference/ Conference Submission System: https://www.conftool.com/iConference2015/__ */ALERT: Submission deadlines for iConference 2015 are approaching fast, with papers due September 5./* The following submissions are invited: Papers <http://ischools.org/the-iconference/program/papers/>: Due Friday, September 5, 2014, midnight PDT Workshops <http://ischools.org/the-iconference/program/workshops/>_:_Due Friday, September 26, 2014, midnight PDT Doctoral Colloquium <http://ischools.org/the-iconference/program/doctoral-colloquium/>_:_Due Friday, September 26, 2014, midnight PDT__ Posters <http://ischools.org/the-iconference/program/posters/>_:_Due Friday, October 10, 2014, midnight PDT__ Interactive Sessions <http://ischools.org/the-iconference/program/sessions-for-interaction-and-en…>_:_Due Friday, October 10, 2014, midnight PDT__ Social Media Expo <http://ischools.org/the-iconference/program/social-media-expo/>_:_Commitment letter due October 14, 2014; student team submissions due December 15, 2014.__ Dissertation Award <http://ischools.org/the-iconference/program/dissertation-award/>_:_Due Wednesday, October 15, 2014, midnight PDT iConference 2015 <http://ischools.org/the-iconference/>takes place March 24-27 in Newport Beach, CA. It is presented by the iSchools organization <http://ischools.org>and hosted by The Donald Bren School of Information and Computer Sciences at University of California, Irvine. The Champion Sponsor is Microsoft Research. All information researchers and scholars are welcome---affiliation with an iSchool is not required. IMPORTANT LINKS Conference Home: http://ischools.org/the-iconference/ Call for Participation: http://ischools.org/the-iconference/call-for-participation/__ Submissions: https://www.conftool.com/iConference2015/__ Facebook: iConference Twitter: @iConf | #iconf15

1 0

Software to extract content of Facebook & Twitter (some conclusions)
by Cristina Aced 28 Aug '14

28 Aug '14

Hi everyone! and thank you for your suggestions!! Many thanks José Manuel, Noha, Tijana, Stu, Tobias, Patricia, Harju, Craig, Tim & Bernhard! As promised, here you have my first impressions of the options you have suggested to extract data from Facebook. As I explained in previous messages, I need to gather the content published by companies on blogs, Twitter and Facebook (posts, tweets, status) with their date information and all the feedback received: number of comments/ RT/ mentions/ likes /shares and so on. After considering all your suggestions and trying some of them: • I'm using *OutWit Hub* <http://www.outwit.com/> (the free version is very complete) to scrape blogs and Twitter accounts. It is necessary to create scrapers to gather the data you want but it is easy to learn how it works and you can personalize the scraping. It's a great tool but it doesn't work properly with Facebook due to Facebook's API limitations :( • *NodeXL* is a useful tool specially for analyzing connections between users/ contents on social media and for creating amazing graphs. It also downloads status updates but the way it shows the information is a little bit chaotic (i.e. it is not easy to connect the status update with the comments it has received). Another interesting option: it is possible to get demographic information about FB's users (genre, location...). • *NVivo* is fantastic to work with Facebook and Twitter. Very easy to extract FB's status updates, date & time, comments and number of likes. To sum up: I have decided to use OutWit Hub to work with blogs and Twitter and NVivo to work with Facebook. If you have any doubt about this topic, maybe I can help you, so feel free to send your doubts and I'll try to answer them! *Cristina Aced * PhD Candidate Doctoral Programme in Knowledge and Information Society Universitat Oberta de Catalunya | caced(a)uoc.edu www.cristinaaced.com/blog | Twitter: @blogocorp

1 0

Re: [Air-L] Software to extract content of Facebook & Twitter
by Tim Libert 28 Aug '14

28 Aug '14

I’d quickly point out two additional considerations when ingesting fb/twitter data: 1) APIs generally exclude ads (which are ‘targeted’) - so depending on what you want to study and/or model an API will never give you an accurate view of what users really see. APIs are easy, but incomplete. 2) The trick with scraping content directly from the web is accounting for processing/executing javascript as that is how many pages pull content dynamically (there may also be other factors: redirects, iframes, canvas, etc). If your tool (e.g. Python urllib,etc). can only access static HTML you will not be able to pull the content you want as you will be accessing instruction sets of how to dynamically render content rather than the actual content. I am not sure how your tool in R works, but I imagine this is a likely issue you may be facing. I have developed some software that solves problem #2 by leveraging http://phantomjs.org/, but it’s not ready for public release quite yet; however, you may want to consider using an automation framework like selenium (http://www.seleniumhq.org/) - tim, phd student, upenn

5 5

Re: [Air-L] Software to extract content of Facebook & Twitter
by Tim Libert 27 Aug '14

27 Aug '14

I once figured out a way to get the youtube to spit out all of the comments at once by tweaking an ajax request, but I can’t figure out how to do it again on quick inspection. it was possible though, you may have to bribe your coder friend with some club mate. ;-) shawn is totally on the mark re: rate-limiting, google in particular is strict on scraping/botishness; anything you set against their properties needs some built-in politeness, I think a random interval of 5-15 seconds was working for me at one time. another way is to just pay somebody on amazon turk to copy/paste for you - could be the cheapest route time- and resource-wise and not requiring new tools. - t On Aug 27, 2014, at 5:41 PM, Shawn Walker <stw3(a)uw.edu> wrote: > Hi Anu, > > To extract YouTube comments, consider TubeKit (http://tubekit.org/) I've used it in a few projects to extract YouTube video metadata, videos, and comment data with great success. > > Another consideration with respect to the discussion of these tools for FB or Twitter data collection is to evaluate what APIs each tool uses. Depending on the API, you might only receive a small sample of data or may be rate limited with others. So, it's important to understand how any tool you use works and what implications or limitations that might have on your research. Historical data is notoriously difficult to get -- purchasing historical data is an option, but adds in a new set of limitations too (deleted accounts, posts, URL decay, etc.). > > These issues need to be discussed more openly and critically addressed. :) > > -- > Shawn Walker > PhD Candidate > Information School > University of Washington > stw3(a)uw.edu — students.washington.edu/stw3 > SoMe Lab @ UW - somelab.net > > ________________________________________ > From: Air-L <air-l-bounces(a)listserv.aoir.org> on behalf of Harju Anu <anu.harju(a)aalto.fi> > Sent: Wednesday, August 27, 2014 11:26 AM > To: Tim Libert > Cc: air-l(a)listserv.aoir.org > Subject: Re: [Air-L] Software to extract content of Facebook & Twitter > > Hi everyone, > > and I'm also grateful for all these suggestions for various tools. For a paper for my PhD I'm looking at YouTube comment threads and I was wondering if any one of you might know a tool that can extract those? It's a very laborious process to do manually and it drives me insane. I once asked a coder friend of mine, but he said it was more complicated than he initially thought, and we left it at that. > > Thank you in advance, and thanks for a great list! I've been a lurker for quite some time now and find it very useful. > > Best, > Anu > > > Anu Harju > Doctoral Candidate > Aalto University > Helsinki > Finland > > Sent from my iPhone > > On 27.8.2014, at 18.06, "Tim Libert" <tlibert(a)asc.upenn.edu> wrote: > >> I’d quickly point out two additional considerations when ingesting fb/twitter data: 1) APIs generally exclude ads (which are ‘targeted’) - so depending on what you want to study and/or model an API will never give you an accurate view of what users really see. APIs are easy, but incomplete. 2) The trick with scraping content directly from the web is accounting for processing/executing javascript as that is how many pages pull content dynamically (there may also be other factors: redirects, iframes, canvas, etc). If your tool (e.g. Python urllib,etc). can only access static HTML you will not be able to pull the content you want as you will be accessing instruction sets of how to dynamically render content rather than the actual content. I am not sure how your tool in R works, but I imagine this is a likely issue you may be facing. I have developed some software that solves problem #2 by leveraging http://phantomjs.org/, but it’s not ready for public release quite yet; however, you may want to consider using an automation framework like selenium (http://www.seleniumhq.org/) >> >> - tim, phd student, upenn >> _______________________________________________ >> The Air-L(a)listserv.aoir.org mailing list >> is provided by the Association of Internet Researchers http://aoir.org >> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org >> >> Join the Association of Internet Researchers: >> http://www.aoir.org/ > _______________________________________________ > The Air-L(a)listserv.aoir.org mailing list > is provided by the Association of Internet Researchers http://aoir.org > Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org > > Join the Association of Internet Researchers: > http://www.aoir.org/

1 0