Re: [Air-L] Have Instagram data
For long term benefits, open source and for free learn R. In the short term it won't help you because the learning curve it quite steep. But, if you like to code and tinker with data in general and want to be productive and independent of commercial enterprises, R is the way to go. Sorry if this almost sounds like a sales pitch. But as I said, it's for free and open source. For scraping rvest is the main package. Other relevant packages for internet-research goals can be found here: https://cran.r-project.org/web/views/WebTechnologies.html hope this helps Maurice On Fri, Nov 17, 2017 at 12:31 PM, Aysenur Ataman < aataman@gradcenter.cuny.edu> wrote:
I’m not sure what is it you are interested in blogs and sites but with Netlytic, I believe you can scrape comments written under blog post. You may want to play with it to see.
Best, Aysenur
On Nov 15, 2017, at 10:34 AM, bartira lins <bartiralins@hotmail.com> wrote:
Dear Aysenur,
Thanks too for Sharring the Netlytic. Im interested in comments about politics. Im researching electoral behavior in Brazil and Instagram is growing fastly here.
Do you have a indication for blogs and sites?
Best,
Bartira Lins +55 (81) 98991.5062
Em 15 de nov de 2017, às 15:48, Aysenur Ataman < aataman@gradcenter.cuny.edu> escreveu:
Dear Anne,
Thanks for sharing the scraping tool! Instagram’s API change in 2016 was an unfortunate event for many researchers, in my opinion. I have struggled finding a work around for a very long time.
Dear Bartira, I used Netlytic <https://netlytic.org/> .It is not as robust as the method Anne suggested because I don’t know how do they do the scraping and if there is anything left out. There is a bit of a learning curve and effort you need to put to clean csv file it gives. What kind of data are you interested in? If you want to download photos please do write back. I have used medialinks Netlytic gave me to scrape photos with a script.
Best,
--------------------------------------------------- Ayşenur Ataman
Ph.D. Candidate in Developmental Psychology The Graduate Center, City University of New York
Research Associate with Children’s Environment Research Group< http://cergnyc.org/>
www.aysenurataman.com<http://www.aysenurataman.com>
On Nov 15, 2017, at 8:00 AM, Anne Helmond <anne@digitalmethods.net< mailto:anne@digitalmethods.net>> wrote:
Hi Bartira,
I recently used the following Instagram tool/scraper: https://github. com/rarcega/instagram-scraper It allows for scraping photos for a single or multiple users, but also for hashtags. You can also retrieve metadata such as comments. It requires a bit of a technical setup to use, so if you are unfamiliar with running scripts you might need to ask someone for help. In general these are the installation instructions (which I tested and worked and which my students successfully replicated):
1. Install pip https://pip.pypa.io/en/stable/installing/ 2. Install Python 2.7x https://www.python.org/do wnloads/release/python-2713/ 3. Then follow install instructions on https://github.com/rarcega/ instagram-scraper <https://github.com/rarcega/instagram-scraper> 4. If you follow the steps on the page it should work
Hope this helps.
Best regards, Anne Helmond
---
Dr. Anne Helmond | Assistant Professor of New Media and Digital Culture University of Amsterdam | Turfdraagsterpad 9 | 1012 XT Amsterdam | The Netherlands http://www.uva.nl/profile/a.helmond | http://www.annehelmond.nl/ | @silvertje
Highlighted publication:
Helmond, Anne. 2015. “The Platformization of the Web: Making Web Data Platform Ready.” Social Media + Society 1 (2). doi:10.1177/2056305115603080.
On 15 November 2017 at 13:39, <air-l-request@listserv.aoir.org<mailto: air-l-request@listserv.aoir.org>> wrote:
Send Air-L mailing list submissions to air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org>
To subscribe or unsubscribe via the World Wide Web, visit http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org or, via email, send a message with subject or body 'help' to air-l-request@listserv.aoir.org<mailto:air-l-request@ listserv.aoir.org>
You can reach the person managing the list at air-l-owner@listserv.aoir.org<mailto:air-l-owner@listserv.aoir.org
Message: 2 Date: Wed, 15 Nov 2017 03:46:35 +0000 From: bartira lins <bartiralins@hotmail.com<mailto:
bartiralins@hotmail.com>>
To: "air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org>" < air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org>> Subject: [Air-L] Have Instagram data Message-ID: <FR1P152MB147760AA1975BBA160A311EEA8290@FR1P152MB1477. LAMP152.PROD.OUTLOOK.COM<http://lamp152.prod.outlook.com>>
Content-Type: text/plain; charset="utf-8"
Hello,
Il Will need to take data from Instagram and blogs for my research. I use nodexl, tags, R, but i dont know how to take th?se data. Some idea?
Many thanks,
Bartira Lins Doctoral student - Political Science UFPE
_______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/ listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/ listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/ listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- ________________________________________________ Maurice Vergeer To contact me, see http://mauricevergeer.nl/node/5 For yesterday's news in perspective: http://www.echovannl.nl/ To see my publications, see http://mauricevergeer.nl/node/1 PGP public key: https://keys.mailvelope.com/pks/lookup?op=get&search=0xE7BF24D19BE34017 ________________________________________________
Thank you Maurice, I use R for twitter, And i really need to be independent of commercial entreprises to do my research. Bests, Bartira Lins (81) 98991.5062 Em 17 de nov de 2017, às 04:43, Maurice Vergeer <m.vergeer@maw.ru.nl<mailto:m.vergeer@maw.ru.nl>> escreveu: For long term benefits, open source and for free learn R. In the short term it won't help you because the learning curve it quite steep. But, if you like to code and tinker with data in general and want to be productive and independent of commercial enterprises, R is the way to go. Sorry if this almost sounds like a sales pitch. But as I said, it's for free and open source. For scraping rvest is the main package. Other relevant packages for internet-research goals can be found here: https://cran.r-project.org/web/views/WebTechnologies.html hope this helps Maurice On Fri, Nov 17, 2017 at 12:31 PM, Aysenur Ataman <aataman@gradcenter.cuny.edu<mailto:aataman@gradcenter.cuny.edu>> wrote: I’m not sure what is it you are interested in blogs and sites but with Netlytic, I believe you can scrape comments written under blog post. You may want to play with it to see. Best, Aysenur
On Nov 15, 2017, at 10:34 AM, bartira lins <bartiralins@hotmail.com<mailto:bartiralins@hotmail.com>> wrote:
Dear Aysenur,
Thanks too for Sharring the Netlytic. Im interested in comments about politics. Im researching electoral behavior in Brazil and Instagram is growing fastly here.
Do you have a indication for blogs and sites?
Best,
Bartira Lins +55 (81) 98991.5062<tel:%2B55%20%2881%29%2098991.5062>
Em 15 de nov de 2017, às 15:48, Aysenur Ataman <aataman@gradcenter.cuny.edu<mailto:aataman@gradcenter.cuny.edu>> escreveu:
Dear Anne,
Thanks for sharing the scraping tool! Instagram’s API change in 2016 was an unfortunate event for many researchers, in my opinion. I have struggled finding a work around for a very long time.
Dear Bartira, I used Netlytic <https://netlytic.org/> .It is not as robust as the method Anne suggested because I don’t know how do they do the scraping and if there is anything left out. There is a bit of a learning curve and effort you need to put to clean csv file it gives. What kind of data are you interested in? If you want to download photos please do write back. I have used medialinks Netlytic gave me to scrape photos with a script.
Best,
--------------------------------------------------- Ayşenur Ataman
Ph.D. Candidate in Developmental Psychology The Graduate Center, City University of New York
Research Associate with Children’s Environment Research Group<http://cergnyc.org/>
www.aysenurataman.com<http://www.aysenurataman.com><http://www.aysenurataman.com>
On Nov 15, 2017, at 8:00 AM, Anne Helmond <anne@digitalmethods.net<mailto:anne@digitalmethods.net><mailto:anne@digitalmethods.net<mailto:anne@digitalmethods.net>>> wrote:
Hi Bartira,
I recently used the following Instagram tool/scraper: https://github. com/rarcega/instagram-scraper It allows for scraping photos for a single or multiple users, but also for hashtags. You can also retrieve metadata such as comments. It requires a bit of a technical setup to use, so if you are unfamiliar with running scripts you might need to ask someone for help. In general these are the installation instructions (which I tested and worked and which my students successfully replicated):
1. Install pip https://pip.pypa.io/en/stable/installing/ 2. Install Python 2.7x https://www.python.org/do wnloads/release/python-2713/ 3. Then follow install instructions on https://github.com/rarcega/ instagram-scraper <https://github.com/rarcega/instagram-scraper> 4. If you follow the steps on the page it should work
Hope this helps.
Best regards, Anne Helmond
---
Dr. Anne Helmond | Assistant Professor of New Media and Digital Culture University of Amsterdam | Turfdraagsterpad 9 | 1012 XT Amsterdam | The Netherlands http://www.uva.nl/profile/a.helmond | http://www.annehelmond.nl/ | @silvertje
Highlighted publication:
Helmond, Anne. 2015. “The Platformization of the Web: Making Web Data Platform Ready.” Social Media + Society 1 (2). doi:10.1177/2056305115603080.
On 15 November 2017 at 13:39, <air-l-request@listserv.aoir.org<mailto:air-l-request@listserv.aoir.org><mailto:air-l-request@listserv.aoir.org<mailto:air-l-request@listserv.aoir.org>>> wrote:
Send Air-L mailing list submissions to air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org><mailto:air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org>>
To subscribe or unsubscribe via the World Wide Web, visit http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org or, via email, send a message with subject or body 'help' to air-l-request@listserv.aoir.org<mailto:air-l-request@listserv.aoir.org><mailto:air-l-request@listserv.aoir.org<mailto:air-l-request@listserv.aoir.org>>
You can reach the person managing the list at air-l-owner@listserv.aoir.org<mailto:air-l-owner@listserv.aoir.org><mailto:air-l-owner@listserv.aoir.org<mailto:air-l-owner@listserv.aoir.org>>
Message: 2 Date: Wed, 15 Nov 2017 03:46:35 +0000 From: bartira lins <bartiralins@hotmail.com<mailto:bartiralins@hotmail.com><mailto:bartiralins@hotmail.com<mailto:bartiralins@hotmail.com>>> To: "air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org><mailto:air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org>>" <air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org><mailto:air-l@listserv.aoir.org<mailto:air-l@listserv.aoir.org>>> Subject: [Air-L] Have Instagram data Message-ID: <FR1P152MB147760AA1975BBA160A311EEA8290@FR1P152MB1477. LAMP152.PROD.OUTLOOK.COM<http://LAMP152.PROD.OUTLOOK.COM><http://lamp152.prod.outlook.com>>
Content-Type: text/plain; charset="utf-8"
Hello,
Il Will need to take data from Instagram and blogs for my research. I use nodexl, tags, R, but i dont know how to take th?se data. Some idea?
Many thanks,
Bartira Lins Doctoral student - Political Science UFPE
_______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org><mailto:Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org>> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ -- ________________________________________________ Maurice Vergeer To contact me, see http://mauricevergeer.nl/node/5 For yesterday's news in perspective: http://www.echovannl.nl/ To see my publications, see http://mauricevergeer.nl/node/1 PGP public key: https://keys.mailvelope.com/pks/lookup?op=get&search=0xE7BF24D19BE34017 ________________________________________________
participants (2)
-
bartira lins -
Maurice Vergeer