Hi all - I'm doing a research project at Bowdoin College and trying to use ScraperWiki to gather tweets. ScraperWiki makes it very easy to gather tweets from all users on Twitter, but I'm looking to limit the data set to specific users. Is there a simple way to do this? If not - is there another program that will collect the data in a more streamlined way? Thanks, Roya Moussapour
Hello Roya, Accessing Twitter feeds is now much harder than it used to be when the Search API required no authentication. Anyway, there's a set of tools using the Streaming API that you may want to look at: The Digital Methods Initiative at the University of Amsterdam has developed a tool called TCAT that you can download on your computer and install from their GitHub archive https://github.com/digitalmethodsinitiative/dmi-tcat/wiki Otherwise, it seems that the TwapperKeeper tools have now been integrated in HootSuite https://hootsuite.com/ If you know the basics of Ruby programming, you can also use TweetStream https://github.com/tweetstream/tweetstream which is quite powerful Regards, Raphaël Velt PhD Student - Industrial Case "Understanding Media Trajectories" Mixed Reality Lab - University of Nottingham In partnership with BBC Research & Development, MediaCityUK -----Original Message----- From: Air-L [mailto:air-l-bounces@listserv.aoir.org] On Behalf Of Roya M. Moussapour Sent: 03 June 2014 21:18 To: air-l@listserv.aoir.org Subject: [Air-L] ScraperWiki Hi all - I'm doing a research project at Bowdoin College and trying to use ScraperWiki to gather tweets. ScraperWiki makes it very easy to gather tweets from all users on Twitter, but I'm looking to limit the data set to specific users. Is there a simple way to do this? If not - is there another program that will collect the data in a more streamlined way? Thanks, Roya Moussapour _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ This message and any attachment are intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to me, and immediately delete it. Please do not use, copy or disclose the information contained in this message or in any attachment. Any views or opinions expressed by the author of this email do not necessarily reflect the views of the University of Nottingham. This message has been checked for viruses but the contents of an attachment may still contain software viruses which could damage your computer system, you are advised to perform your own checks. Email communications with the University of Nottingham may be monitored as permitted by UK legislation.
The tool you want is NodeXL. You may have to subsample the users though. Sent from phone. - Alex Leavitt On Jun 4, 2014 2:39 AM, "Raphael Velt" <psxrv@nottingham.ac.uk> wrote:
Hello Roya,
Accessing Twitter feeds is now much harder than it used to be when the Search API required no authentication. Anyway, there's a set of tools using the Streaming API that you may want to look at:
The Digital Methods Initiative at the University of Amsterdam has developed a tool called TCAT that you can download on your computer and install from their GitHub archive https://github.com/digitalmethodsinitiative/dmi-tcat/wiki
Otherwise, it seems that the TwapperKeeper tools have now been integrated in HootSuite https://hootsuite.com/
If you know the basics of Ruby programming, you can also use TweetStream https://github.com/tweetstream/tweetstream which is quite powerful
Regards,
Raphaël Velt
PhD Student - Industrial Case "Understanding Media Trajectories" Mixed Reality Lab - University of Nottingham In partnership with BBC Research & Development, MediaCityUK
-----Original Message----- From: Air-L [mailto:air-l-bounces@listserv.aoir.org] On Behalf Of Roya M. Moussapour Sent: 03 June 2014 21:18 To: air-l@listserv.aoir.org Subject: [Air-L] ScraperWiki
Hi all -
I'm doing a research project at Bowdoin College and trying to use ScraperWiki to gather tweets. ScraperWiki makes it very easy to gather tweets from all users on Twitter, but I'm looking to limit the data set to specific users. Is there a simple way to do this? If not - is there another program that will collect the data in a more streamlined way?
Thanks,
Roya Moussapour _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/ This message and any attachment are intended solely for the addressee and may contain confidential information. If you have received this message in error, please send it back to me, and immediately delete it. Please do not use, copy or disclose the information contained in this message or in any attachment. Any views or opinions expressed by the author of this email do not necessarily reflect the views of the University of Nottingham.
This message has been checked for viruses but the contents of an attachment may still contain software viruses which could damage your computer system, you are advised to perform your own checks. Email communications with the University of Nottingham may be monitored as permitted by UK legislation.
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
DiscoverText.com 30-day free trial Gnip and Twitter API access Sifter.texifter.com Free estimates Full history of Twitter #datagrants for academics ~Stu On Tuesday, June 3, 2014, Roya M. Moussapour <rmoussap@bowdoin.edu> wrote:
Hi all -
I'm doing a research project at Bowdoin College and trying to use ScraperWiki to gather tweets. ScraperWiki makes it very easy to gather tweets from all users on Twitter, but I'm looking to limit the data set to specific users. Is there a simple way to do this? If not - is there another program that will collect the data in a more streamlined way?
Thanks,
Roya Moussapour _______________________________________________ The Air-L@listserv.aoir.org <javascript:;> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Dr. Stuart W. Shulman http://people.umass.edu/stu Founder and CEO, Texifter http://texifter.com LinkedIn http://www.linkedin.com/in/stuartwshulman Twitter https://twitter.com/StuartWShulman
Hi all, I would recommend also checking out TAGS by Martin Hawksey. http://mashe.hawksey.info/2012/01/twitter-archive-tagsv3/ http://mashe.hawksey.info/2013/02/twitter-archive-tagsv5/ We've used it a couple of times to scrape tweets and do some analytics on specific hashtags. It worked well for us. Enjoy, -Ian _________________________ W. Ian O'Byrne, Ph.D. wiobyrne.com University of New Haven Department of Education *"Feet on the Ground and Eyes to the Sky"* 300 Boston Post Road West Haven, CT 06516 (203) 479-4272 On Wed, Jun 4, 2014 at 11:32 AM, Shulman, Stu <stu@texifter.com> wrote:
DiscoverText.com
30-day free trial Gnip and Twitter API access
Sifter.texifter.com
Free estimates Full history of Twitter #datagrants for academics
~Stu
On Tuesday, June 3, 2014, Roya M. Moussapour <rmoussap@bowdoin.edu> wrote:
Hi all -
I'm doing a research project at Bowdoin College and trying to use ScraperWiki to gather tweets. ScraperWiki makes it very easy to gather tweets from all users on Twitter, but I'm looking to limit the data set to specific users. Is there a simple way to do this? If not - is there another program that will collect the data in a more streamlined way?
Thanks,
Roya Moussapour _______________________________________________ The Air-L@listserv.aoir.org <javascript:;> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Dr. Stuart W. Shulman http://people.umass.edu/stu
Founder and CEO, Texifter http://texifter.com
LinkedIn http://www.linkedin.com/in/stuartwshulman
Twitter https://twitter.com/StuartWShulman _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
participants (5)
-
Alex Leavitt -
Ian O'Byrne -
Raphael Velt -
Roya M. Moussapour -
Shulman, Stu