Absolutely not. Deleted and private Tweets are not accessible via Sifter. Sifter is a Twitter-compliant tool and not strictly speaking a scraper. It is Twitter-approved app for generating free estimates. It is used primarily by academics who need 1,000-1,000,000 Tweets on a tight budget. ~Stu On Saturday, April 16, 2016, Heinz, Lisa <ls144009@ohio.edu> wrote:
Thanks for trying, Stu! I wonder, though, does the scraper you used have the ability to access data behind a privacy lock?
~~~~~~~~~~~~~~ Lisa M. Heinz PhD Student E.W. Scripps School of Journalism Ohio University, Scripps College of Communication
@LivingRural on Twitter
Sent from my iPhone
On Apr 16, 2016, at 9:32 PM, Shulman, Stu <stu@texifter.com <javascript:_e(%7B%7D,'cvml','stu@texifter.com');>> wrote:
Update
from:TayandYou March 23-24: 0 Tweets available
TayandYou March 23-24 (not from @TayandYou, but which mention TayandYou): ~122,000 Tweets.
I suppose the folks at Microsoft decided to delete everything on that somewhat misguided experiment...
On Sat, Apr 16, 2016 at 8:39 PM, Heinz, Lisa <ls144009@ohio.edu <javascript:_e(%7B%7D,'cvml','ls144009@ohio.edu');>> wrote:
Cory, you bring up some very good points I also thought about as I've searched for the dataset.
Screenshots (and news articles) are one source, but they would contain the most inflammatory of the tweets and still represent only a fraction of a fraction of the entire dataset of more than 90,000 tweets from Tay itself. Also, this figure does not include all the mentions that are critical to an analysis of the devolution of this bot, which may at least double that number considering much (all?) of Tay's tweets were responses to questions and comments.
Last summer, Twitter finished the process of archiving tweets clear back to when it launched to make them accessible to researchers/enterprise customers beginning last fall (go here for a short list of providers: http://www.pcmag.com/article2/0,2817,2489442,00.asp). We don't have access at our SMART lab, yet, but if the tweets exist, they are hiding behind a now-private account so the usual scrapers won't find them. Unless someone out there has a few tricks up their sleeves...
~~Lisa
~~~~~~~~~~~~~~~~~~~ Lisa Heinz PhD Student in Mass Communication E.W. Scripps School of Journalism Ohio University, Scripps College of Communication Twitter<http://twitter.com/livingrural> LinkedIn<http://linkedin.com/in/lisaheinz>
________________________________ From: Cory Salveson <corysalveson@gmail.com <javascript:_e(%7B%7D,'cvml','corysalveson@gmail.com');>> Sent: Saturday, April 16, 2016 4:50:50 PM To: Kishonna Gray Cc: Heinz, Lisa; air-l@listserv.aoir.org <javascript:_e(%7B%7D,'cvml','air-l@listserv.aoir.org');> Subject: Re: [Air-L] TayTweets Dataset?
It's not much, but Archive.org <http://archive.org> has multiple snapshots of tweets here< https://web.archive.org/web/20160324022856*/https://mobile.twitter.com/TayandYou> starting March 24. It lacks the extended metadata available via the API, but it's better than nothing.
In case someone out there did do a more complete capture, I put out a request on the "datasets" subreddit here< https://www.reddit.com/r/datasets/comments/4f3hmx/request_taytweets_tayandyou_archive/>, and there's also a Quora question (from somebody else) here< https://www.quora.com/Have-TayTweetss-tweets-been-archived>. If anything surfaces, maybe one or both of these spots will get updated.
If nothing else, the unavailability of these tweets is itself interesting. Others can advance a more nuanced analysis than me here, but for example, I wonder: on what basis are we as researchers "blocked" from accessing the tweets? I assume Twitter still technically has them in their databases somewhere, so isn't this essentially Twitter respecting Microsoft's -- maybe even Tay's -- right to privacy under the Twitter TOS, like any other user? If so, then are all Twitter users really created equally with respect to privacy, or should some actors, as is the case for public figures generally, enjoy less? In other words, should the public be allowed to request these tweets directly from Twitter? Etc.
Cory Salveson http://corysalveson.com
On Fri, Apr 15, 2016 at 3:47 PM, Kishonna Gray <kishonnagray@gmail.com <javascript:_e(%7B%7D,'cvml','kishonnagray@gmail.com');><mailto: kishonnagray@gmail.com <javascript:_e(%7B%7D,'cvml','kishonnagray@gmail.com');>>> wrote: this would have been great to capture them. i have archived some from the associated hashtags. so if anyone did, that would be amazing. "meltdown" is an understatement.
On Fri, Apr 15, 2016 at 2:34 PM, Heinz, Lisa <ls144009@ohio.edu <javascript:_e(%7B%7D,'cvml','ls144009@ohio.edu');><mailto: ls144009@ohio.edu <javascript:_e(%7B%7D,'cvml','ls144009@ohio.edu');>>> wrote:
Hello... I wondered if someone on this list was able to capture all of Microsoft's Tay bot's tweets and mentions from the time it went live until it was shut down, March 23-24? I did not get my collector setup in time, so I am looking for someone who collected Tay's original tweets and mentions, and who would be willing to share them. I am primarily interested in the avatar's meltdown as an historical marker in the adoption of this technology.
~~Lisa
~~~~~~~~~~~~~~~~~~~ Lisa Heinz PhD Student in Mass Communication E.W. Scripps School of Journalism Ohio University, Scripps College of Communication Twitter<http://twitter.com/livingrural> LinkedIn<http://linkedin.com/in/lisaheinz>
_______________________________________________ The Air-L@listserv.aoir.org <javascript:_e(%7B%7D,'cvml','Air-L@listserv.aoir.org');><mailto: Air-L@listserv.aoir.org <javascript:_e(%7B%7D,'cvml','Air-L@listserv.aoir.org');>> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
The Air-L@listserv.aoir.org <javascript:_e(%7B%7D,'cvml','Air-L@listserv.aoir.org');><mailto: Air-L@listserv.aoir.org <javascript:_e(%7B%7D,'cvml','Air-L@listserv.aoir.org');>> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
_______________________________________________ The Air-L@listserv.aoir.org <javascript:_e(%7B%7D,'cvml','Air-L@listserv.aoir.org');> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Dr. Stuart W. Shulman Founder and CEO, Texifter LinkedIn: http://www.linkedin.com/in/stuartwshulman
-- Dr. Stuart W. Shulman Founder and CEO, Texifter LinkedIn: http://www.linkedin.com/in/stuartwshulman