Anonymizing qual interview data?
HI all, Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis. (I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹ The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained). What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!) Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson<http://colostate.academia.edu/StephenCoryRobinson> Founder, Nordic Privacy Center (nordicprivacy.org<https://nordicprivacy.org/>)
Hi Cory, Your question seems to go beyond attributing quotes in theses, and more about protecting the underlying data. Does your university have an institutional review board (IRB) or equivalent? Did these studies go through any kind of review process? Universities commonly have their own internal requirements for protecting participants and maintaining anonymity with qual research. On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se> wrote:
HI all,
Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson<; http://colostate.academia.edu/StephenCoryRobinson> Founder, Nordic Privacy Center (nordicprivacy.org< https://nordicprivacy.org/>)
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Douglas Zytko, PhD Assistant Professor of Human-Computer Interaction Director of Oakland HCI Lab Oakland University Department of Computer Science and Engineering dougzytko.com Engineering Center 544 115 Library Drive, <https://maps.google.com/?q=115+Library+Drive,%C2%A0+Rochester,+MI+48309&entry=gmail&source=g> Rochester, MI 48309 <https://maps.google.com/?q=115+Library+Drive,%C2%A0+Rochester,+MI+48309&entry=gmail&source=g>
Hi, Cory and All, For the reporting part, your students may simply provide the demographic information that describes the participants, instead of mentioning their names, when they write the research reports with quotes. For example, your students may say a female business professional said “...”. By doing so, your students can protect the participants’ privacy and not specify their names. However, to be safe, you may double check with your university’s institutional review board (IRB) officer and see whether it is fine to do so. To my understanding, we need to get IRB approval for academic research projects first before collecting primary data in the U.S. If you are in other countries, there might be different regulations. But, it’s always important to check the data collection and reporting policies first. Hope this helps! Best, Ming-Yi Ming-Yi Wu, Ph.D Graduate Faculty Northeastern University Sent from my iPhone
On Apr 7, 2021, at 10:51 AM, Douglas Zytko <zytko@oakland.edu> wrote:
Hi Cory,
Your question seems to go beyond attributing quotes in theses, and more about protecting the underlying data. Does your university have an institutional review board (IRB) or equivalent? Did these studies go through any kind of review process? Universities commonly have their own internal requirements for protecting participants and maintaining anonymity with qual research.
On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se> wrote:
HI all,
Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson<; http://colostate.academia.edu/StephenCoryRobinson> Founder, Nordic Privacy Center (nordicprivacy.org< https://nordicprivacy.org/>)
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
-- Douglas Zytko, PhD Assistant Professor of Human-Computer Interaction Director of Oakland HCI Lab Oakland University Department of Computer Science and Engineering dougzytko.com
Engineering Center 544 115 Library Drive, <https://maps.google.com/?q=115+Library+Drive,%C2%A0+Rochester,+MI+48309&entry=gmail&source=g> Rochester, MI 48309 <https://maps.google.com/?q=115+Library+Drive,%C2%A0+Rochester,+MI+48309&entry=gmail&source=g> _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
Hi Douglas, Sadly, we don’t’ have an IRB at my institution. They are not as common in Sweden, and is usually the supervisor and/or supervision team to determine the ethical legitimacy of a study. (We have an “official” ethics board in what you might consider my “state” within Sweden, but it seems that more STEM or medical applications are sent that way – which also requires a considerable fee. And that fee, unfortunately, might dissuade some from using.) Thanks again for your input! Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson<http://colostate.academia.edu/StephenCoryRobinson> Founder, Nordic Privacy Center (nordicprivacy.org<https://nordicprivacy.org/>) From: Douglas Zytko <zytko@oakland.edu> Date: Wednesday, 7 April 2021 at 16:50 To: Cory Robinson <cory.robinson@liu.se> Cc: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org> Subject: Re: [Air-L] Anonymizing qual interview data? Hi Cory, Your question seems to go beyond attributing quotes in theses, and more about protecting the underlying data. Does your university have an institutional review board (IRB) or equivalent? Did these studies go through any kind of review process? Universities commonly have their own internal requirements for protecting participants and maintaining anonymity with qual research. On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se<mailto:cory.robinson@liu.se>> wrote: HI all, Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis. (I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹ The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained). What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!) Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se><mailto:cory.robinson@liu.se<mailto:cory.robinson@liu.se>> http://liu-se.academia.edu/StephenCoryRobinson<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fliu-se.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582661449%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ULXQYq81gcsTYTkcYPjDW%2B%2FOp7lfq7iyZZrHJGyEGEQ%3D&reserved=0><http://colostate.academia.edu/StephenCoryRobinson<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcolostate.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582671405%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=5nIRRHkxdk8QXqbuLz9A1V5gRrPSIzF6hgUzEblGaI8%3D&reserved=0>> Founder, Nordic Privacy Center (nordicprivacy.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=4KQ9IMKCOKtKNs2BLeOFBE7RogIOKv7qQGd8CtvCdA0%3D&reserved=0><https://nordicprivacy.org/<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=o8sgeK1j585Jc%2FKg0YfJJUhyiOdp1TQYsYuHOvznFjU%3D&reserved=0>>) _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Faoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=2KNEIpQu%2F3lvh%2FradJXnzeH8Ov1IazTqOKxUaIxdMqk%3D&reserved=0> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flistserv.aoir.org%2Flistinfo.cgi%2Fair-l-aoir.org&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=M1gmGR8QG6VN%2FBvPdHGQzQCbCuBXAPaoCEs7jbW62Zw%3D&reserved=0> Join the Association of Internet Researchers: http://www.aoir.org/<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.aoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Sz%2F7skjIj97%2Fy0Hzqf1ttA3AQQXXehsZALqioofs2aQ%3D&reserved=0> -- Douglas Zytko, PhD Assistant Professor of Human-Computer Interaction Director of Oakland HCI Lab Oakland University Department of Computer Science and Engineering dougzytko.com<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdougzytko.com%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=pH5I2r1usJHF0ROv7A5HE0p1tXCOI%2FfuFwPBq4GP8zY%3D&reserved=0> Engineering Center 544 115 Library Drive, <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=6KqGtw%2BGjlFtjKRwJCfYJ6LxtHxB4pRFF5Zhjn%2B4KcE%3D&reserved=0> Rochester, MI 48309<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582711227%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=byIPRTu65RV6Pg3mSGo9ZryXYkA1eby7UpZcu7Vz%2FBc%3D&reserved=0>
Hi Cory, Market researchers have much the same concern about keeping private all that is disclosed by research participants. Possibly their rules may be of some assistance - at least to formulate some standards for the students? FYC, https://www.esomar.org/uploads/public/knowledge-and-standards/codes-and-guid... With best wishes, Philip Derham, DIRECTOR. Email: derhamp@derhamresearch.com.au Web: www.derhamresearch.com.au Telephone: (61) 0414 543 765 Latest post: Office: https://tinyurl.com/better-staff-performance 6 Everton Grove, SURREY HILLS, VIC. AU., 3127 Skype: philipderhamdmr Facebook: www.facebook.com/DerhamInsightsResearch Twitter: www.twitter.com/betterresponses LinkedIn: https://au.linkedin.com/in/philipderham/ YouTube: Mail: Philip Derham (Derham Insights Research) PO Box 51, SURREY HILLS, VICTORIA, AU., 3127 -----Original Message----- From: Air-L <air-l-bounces@listserv.aoir.org> On Behalf Of Cory Robinson Sent: Friday, 9 April 2021 5:58 PM To: Douglas Zytko <zytko@oakland.edu> Cc: air-l@listserv.aoir.org Subject: Re: [Air-L] Anonymizing qual interview data? Hi Douglas, Sadly, we don’t’ have an IRB at my institution. They are not as common in Sweden, and is usually the supervisor and/or supervision team to determine the ethical legitimacy of a study. (We have an “official” ethics board in what you might consider my “state” within Sweden, but it seems that more STEM or medical applications are sent that way – which also requires a considerable fee. And that fee, unfortunately, might dissuade some from using.) Thanks again for your input! Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson<http://colostate.academia.edu/StephenCoryRobinson> Founder, Nordic Privacy Center (nordicprivacy.org<https://nordicprivacy.org/>) From: Douglas Zytko <zytko@oakland.edu> Date: Wednesday, 7 April 2021 at 16:50 To: Cory Robinson <cory.robinson@liu.se> Cc: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org> Subject: Re: [Air-L] Anonymizing qual interview data? Hi Cory, Your question seems to go beyond attributing quotes in theses, and more about protecting the underlying data. Does your university have an institutional review board (IRB) or equivalent? Did these studies go through any kind of review process? Universities commonly have their own internal requirements for protecting participants and maintaining anonymity with qual research. On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se<mailto:cory.robinson@liu.se>> wrote: HI all, Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis. (I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹ The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained). What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!) Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se><mailto:cory.robinson@liu.se<mailto:cory.robinson@liu.se>> http://liu-se.academia.edu/StephenCoryRobinson<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fliu-se.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582661449%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ULXQYq81gcsTYTkcYPjDW%2B%2FOp7lfq7iyZZrHJGyEGEQ%3D&reserved=0><http://colostate.academia.edu/StephenCoryRobinson<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcolostate.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582671405%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=5nIRRHkxdk8QXqbuLz9A1V5gRrPSIzF6hgUzEblGaI8%3D&reserved=0>> Founder, Nordic Privacy Center (nordicprivacy.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=4KQ9IMKCOKtKNs2BLeOFBE7RogIOKv7qQGd8CtvCdA0%3D&reserved=0><https://nordicprivacy.org/<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=o8sgeK1j585Jc%2FKg0YfJJUhyiOdp1TQYsYuHOvznFjU%3D&reserved=0>>) _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Faoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=2KNEIpQu%2F3lvh%2FradJXnzeH8Ov1IazTqOKxUaIxdMqk%3D&reserved=0> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flistserv.aoir.org%2Flistinfo.cgi%2Fair-l-aoir.org&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=M1gmGR8QG6VN%2FBvPdHGQzQCbCuBXAPaoCEs7jbW62Zw%3D&reserved=0> Join the Association of Internet Researchers: http://www.aoir.org/<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.aoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Sz%2F7skjIj97%2Fy0Hzqf1ttA3AQQXXehsZALqioofs2aQ%3D&reserved=0> -- Douglas Zytko, PhD Assistant Professor of Human-Computer Interaction Director of Oakland HCI Lab Oakland University Department of Computer Science and Engineering dougzytko.com<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdougzytko.com%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=pH5I2r1usJHF0ROv7A5HE0p1tXCOI%2FfuFwPBq4GP8zY%3D&reserved=0> Engineering Center 544 115 Library Drive, <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=6KqGtw%2BGjlFtjKRwJCfYJ6LxtHxB4pRFF5Zhjn%2B4KcE%3D&reserved=0> Rochester, MI 48309<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582711227%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=byIPRTu65RV6Pg3mSGo9ZryXYkA1eby7UpZcu7Vz%2FBc%3D&reserved=0> _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/
Hi, Cory, You are very welcome! Good luck with the project! Best, Ming-Yi Sent from my iPhone
On Apr 9, 2021, at 4:16 AM, Philip Derham <derhamp@derhamresearch.com.au> wrote:
Hi Cory,
Market researchers have much the same concern about keeping private all that is disclosed by research participants.
Possibly their rules may be of some assistance - at least to formulate some standards for the students? FYC,
https://www.esomar.org/uploads/public/knowledge-and-standards/codes-and-guid...
With best wishes,
Philip Derham, DIRECTOR.
Email: derhamp@derhamresearch.com.au Web: www.derhamresearch.com.au Telephone: (61) 0414 543 765 Latest post: Office: https://tinyurl.com/better-staff-performance 6 Everton Grove, SURREY HILLS, VIC. AU., 3127 Skype: philipderhamdmr Facebook: www.facebook.com/DerhamInsightsResearch Twitter: www.twitter.com/betterresponses LinkedIn: https://au.linkedin.com/in/philipderham/ YouTube: Mail: Philip Derham (Derham Insights Research) PO Box 51, SURREY HILLS, VICTORIA, AU., 3127
-----Original Message----- From: Air-L <air-l-bounces@listserv.aoir.org> On Behalf Of Cory Robinson Sent: Friday, 9 April 2021 5:58 PM To: Douglas Zytko <zytko@oakland.edu> Cc: air-l@listserv.aoir.org Subject: Re: [Air-L] Anonymizing qual interview data?
Hi Douglas,
Sadly, we don’t’ have an IRB at my institution. They are not as common in Sweden, and is usually the supervisor and/or supervision team to determine the ethical legitimacy of a study.
(We have an “official” ethics board in what you might consider my “state” within Sweden, but it seems that more STEM or medical applications are sent that way – which also requires a considerable fee. And that fee, unfortunately, might dissuade some from using.)
Thanks again for your input!
Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson<http://colostate.academia.edu/StephenCoryRobinson> Founder, Nordic Privacy Center (nordicprivacy.org<https://nordicprivacy.org/>)
From: Douglas Zytko <zytko@oakland.edu> Date: Wednesday, 7 April 2021 at 16:50 To: Cory Robinson <cory.robinson@liu.se> Cc: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org> Subject: Re: [Air-L] Anonymizing qual interview data?
Hi Cory,
Your question seems to go beyond attributing quotes in theses, and more about protecting the underlying data. Does your university have an institutional review board (IRB) or equivalent? Did these studies go through any kind of review process? Universities commonly have their own internal requirements for protecting participants and maintaining anonymity with qual research.
On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se<mailto:cory.robinson@liu.se>> wrote: HI all,
Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se><mailto:cory.robinson@liu.se<mailto:cory.robinson@liu.se>> http://liu-se.academia.edu/StephenCoryRobinson<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fliu-se.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582661449%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ULXQYq81gcsTYTkcYPjDW%2B%2FOp7lfq7iyZZrHJGyEGEQ%3D&reserved=0><http://colostate.academia.edu/StephenCoryRobinson<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcolostate.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582671405%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=5nIRRHkxdk8QXqbuLz9A1V5gRrPSIzF6hgUzEblGaI8%3D&reserved=0>> Founder, Nordic Privacy Center (nordicprivacy.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=4KQ9IMKCOKtKNs2BLeOFBE7RogIOKv7qQGd8CtvCdA0%3D&reserved=0><https://nordicprivacy.org/<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=o8sgeK1j585Jc%2FKg0YfJJUhyiOdp1TQYsYuHOvznFjU%3D&reserved=0>>)
_______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Faoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=2KNEIpQu%2F3lvh%2FradJXnzeH8Ov1IazTqOKxUaIxdMqk%3D&reserved=0> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flistserv.aoir.org%2Flistinfo.cgi%2Fair-l-aoir.org&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=M1gmGR8QG6VN%2FBvPdHGQzQCbCuBXAPaoCEs7jbW62Zw%3D&reserved=0>
Join the Association of Internet Researchers: http://www.aoir.org/<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.aoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Sz%2F7skjIj97%2Fy0Hzqf1ttA3AQQXXehsZALqioofs2aQ%3D&reserved=0>
-- Douglas Zytko, PhD Assistant Professor of Human-Computer Interaction Director of Oakland HCI Lab Oakland University Department of Computer Science and Engineering dougzytko.com<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdougzytko.com%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=pH5I2r1usJHF0ROv7A5HE0p1tXCOI%2FfuFwPBq4GP8zY%3D&reserved=0>
Engineering Center 544 115 Library Drive, <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=6KqGtw%2BGjlFtjKRwJCfYJ6LxtHxB4pRFF5Zhjn%2B4KcE%3D&reserved=0> Rochester, MI 48309<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582711227%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=byIPRTu65RV6Pg3mSGo9ZryXYkA1eby7UpZcu7Vz%2FBc%3D&reserved=0> _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/ _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org
Join the Association of Internet Researchers: http://www.aoir.org/
Hi Cory, The best way that I know is to create a randomic code for each respondent and remove any timestamp that indicates the order the response was given. You can use the spreadsheet random() function to do that. It is ideal that it be random, just to increase confidentiality a bit, in case the answers' sequential order might identify the respondent in some way. About your concern to "reidentify" if research data was obtained: if someone has the original research data, she/he will always have the means to identify the original respondents, no matter the method you use to anonymize. Good luck on your research! Josir Em sex., 9 de abr. de 2021 às 05:16, Philip Derham < derhamp@derhamresearch.com.au> escreveu:
Hi Cory,
Market researchers have much the same concern about keeping private all that is disclosed by research participants.
Possibly their rules may be of some assistance - at least to formulate some standards for the students? FYC,
https://www.esomar.org/uploads/public/knowledge-and-standards/codes-and-guid...
With best wishes,
Philip Derham, DIRECTOR.
Email: derhamp@derhamresearch.com.au Web: www.derhamresearch.com.au Telephone: (61) 0414 543 765 Latest post: Office: https://tinyurl.com/better-staff-performance 6 Everton Grove, SURREY HILLS, VIC. AU., 3127 Skype: philipderhamdmr Facebook: www.facebook.com/DerhamInsightsResearch Twitter: www.twitter.com/betterresponses LinkedIn: https://au.linkedin.com/in/philipderham/ YouTube: Mail: Philip Derham (Derham Insights Research) PO Box 51, SURREY HILLS, VICTORIA, AU., 3127
On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se<mailto: cory.robinson@liu.se>> wrote: HI all,
Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory
I think part of the thinking-process might be: How easily can someone figure out the identity of the informant? If I were to say that I interviewed people in our 8-person team, and if I report that one person was working from the Pacific timezone, then it's easy to determine which of us I am referring to. Or if I were to write that a disabled member of the team said... then that's me. I know that seems obvious for a tiny group, but these kinds of intersectional identities can operate in larger groups, too. A second way-of-thinking may involve a focus on the risk of disclosure to the informant. However, this criterion often becomes a matter of the researcher's imagination regarding the Other. It's been shown again and again that people in a position of privilege and safety may not understand the very real risks that are experienced by people who have fewer safeguards - e.g., men writing about women's safety (how easily can a stalker act on the information?), or straight people writing about risk of identification of someone in one of the LGBTQIA+ spectra, or citizens making assumptions about legal protections (or lack of protections) for non-citizens. Of course, it's a good idea to discuss these matters with people who are not ourselves, and who are not like ourselves. It's also a good idea not to put the burden of explaining bias on the person who is the target of that bias. Yes, I know that I said two things that somewhat contradict each other. There are no easy answers here. A third possibility is to ask each informant to state what information about themself would be safe to share. This is sensible only if the informants understand publications and readerships, etc. But it may be a more radically democratic approach to demographic description. I'm suggesting these ideas as among a larger number of *starting points* for thinking about difficult research questions. Please think of them as heuristic questions - not as authoritative questions, and certainly not as answers! best wishes, --michael ----- Michael Muller, PhD, IBM Research, Cambridge MA USA pronouns: he/him/his ACM Distinguished Scientist ACM SIGCHI Academy ----- Original message ----- From: Josir Gomes <josircg@gmail.com> Sent by: "Air-L" <air-l-bounces@listserv.aoir.org> To: Cory Robinson <cory.robinson@liu.se> Cc: "air-l@listserv.aoir.org" <air-l@listserv.aoir.org> Subject: [EXTERNAL] Re: [Air-L] Anonymizing qual interview data? Date: Fri, Apr 9, 2021 08:58 Hi Cory, The best way that I know is to create a randomic code for each respondent and remove any timestamp that indicates the order the response was given. You can use the spreadsheet random() function to do that. It is ideal that it be random, just to increase confidentiality a bit, in case the answers' sequential order might identify the respondent in some way. About your concern to "reidentify" if research data was obtained: if someone has the original research data, she/he will always have the means to identify the original respondents, no matter the method you use to anonymize. Good luck on your research! Josir Em sex., 9 de abr. de 2021 � s 05:16, Philip Derham < derhamp@derhamresearch.com.au> escreveu:
Hi Cory,
Market researchers have much the same concern about keeping private all that is disclosed by research participants.
Possibly their rules may be of some assistance - at least to formulate some standards for the students? FYC,
[1]https://www.esomar.org/uploads/public/knowledge-and-standards/codes- and-guidelines/ICCESOMAR_Code_English_.pdf
With best wishes,
Philip Derham, DIRECTOR.
Email: derhamp@derhamresearch.com.au Web: www.derhamresearch.com.au Telephone: (61) 0414 543 765 Latest post: Office: [2]https://tinyurl.com/better-staff-performance 6 Everton Grove, SURREY HILLS, VIC. AU., 3127 Skype: philipderhamdmr Facebook: www.facebook.com/DerhamInsightsResearch Twitter: www.twitter.com/betterresponses LinkedIn: [3]https://au.linkedin.com/in/philipderham/ YouTube: Mail: Philip Derham (Derham Insights Research) PO Box 51, SURREY HILLS, VICTORIA, AU., 3127
On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson
<cory.robinson@liu.se<mailto:
cory.robinson@liu.se>> wrote: HI all,
Two Master�s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). �
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It�s indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers [4]http://aoir.org Subscribe, change options or unsubscribe at: [5]http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: [6]http://www.aoir.org/ References 1. https://www.esomar.org/uploads/public/knowledge-and-standards/codes-and-guid... 2. https://tinyurl.com/better-staff-performance 3. https://au.linkedin.com/in/philipderham/ 4. http://aoir.org/ 5. http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org 6. http://www.aoir.org/
Cory, thanks for asking this important question, and Michael, thank you for pointing out some issues of intersectional re-identification in qualitative research, particularly for marginalized participants. This is a huge social justice issue where more research needs to be done. As a member of multiple underrepresented groups, I've frequently been asked to be a participant in qualitative research. I've found that many very well-meaning and intelligent people, including both researchers and IRBs, are unaware of the risks to vulnerable populations, particularly when intersectionality is involved. Researchers often apply naïve techniques for anonymity, and IRBs assume they are sufficient. Some IRB-approved projects clearly re-identified me and put me at risk, e.g. "anonymous participant X is a female computer science PhD student who is also an aerobatic pilot" (in a department where a professor had told me "women don't have the intellectual ability for computer science"). So I started requiring researchers to let me approve and/or edit the final text to go into published reports (and yes, it was a lot of labor for me). Some of the techniques I ended up asking researchers to use: - Apply a qualitative analog of differential privacy: add "noise" by obfuscating parts of the quotes and identifiers. For example, change the above description to "anonymous participant X is a female computer science PhD student who is also a competitive skier." This maintains the contextual integrity of the quote but obfuscates an easily identifiable characteristic. - Don't retain identifiers throughout the document for the same individual. It can be easy to re-identify an individual from a series of quotes, particularly if they have intersectional identities. Instead, you can attribute some of the quotes to "participant X, a female computer science student" and the rest to "participant Y, a Latinx computer science student." I'd love to see more research on this topic and would be happy to collaborate on projects! Cecilia -- Cecilia R. Aragon, Professor Director, Human-Centered Data Science Lab Department of Human Centered Design & Engineering, University of Washington, Seattle http://faculty.washington.edu/aragon | @craragon <https://twitter.com/craragon> New memoir *Flying Free <https://www.blackstonepublishing.com/flying-free-cecilia-aragon>: My Victory over Fear to Become the First Latina Pilot on the US Aerobatic Team* On Fri, Apr 9, 2021 at 6:43 AM Michael Muller <michael_muller@us.ibm.com> wrote:
I think part of the thinking-process might be: How easily can someone figure out the identity of the informant? If I were to say that I interviewed people in our 8-person team, and if I report that one person was working from the Pacific timezone, then it's easy to determine which of us I am referring to. Or if I were to write that a disabled member of the team said... then that's me. I know that seems obvious for a tiny group, but these kinds of intersectional identities can operate in larger groups, too. A second way-of-thinking may involve a focus on the risk of disclosure to the informant. However, this criterion often becomes a matter of the researcher's imagination regarding the Other. It's been shown again and again that people in a position of privilege and safety may not understand the very real risks that are experienced by people who have fewer safeguards - e.g., men writing about women's safety (how easily can a stalker act on the information?), or straight people writing about risk of identification of someone in one of the LGBTQIA+ spectra, or citizens making assumptions about legal protections (or lack of protections) for non-citizens. Of course, it's a good idea to discuss these matters with people who are not ourselves, and who are not like ourselves. It's also a good idea not to put the burden of explaining bias on the person who is the target of that bias. Yes, I know that I said two things that somewhat contradict each other. There are no easy answers here. A third possibility is to ask each informant to state what information about themself would be safe to share. This is sensible only if the informants understand publications and readerships, etc. But it may be a more radically democratic approach to demographic description. I'm suggesting these ideas as among a larger number of *starting points* for thinking about difficult research questions. Please think of them as heuristic questions - not as authoritative questions, and certainly not as answers! best wishes, --michael ----- Michael Muller, PhD, IBM Research, Cambridge MA USA pronouns: he/him/his ACM Distinguished Scientist ACM SIGCHI Academy
On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson
<cory.robinson@liu.se<mailto:
cory.robinson@liu.se>> wrote: HI all,
Two Masterâs students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). â¹
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (Itâs indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory
Hi all, Thanks for this really insightful discussion. Prof. Aragon, your very on-point comment reminded me of a short paper I wrote a few years ago on vulnerable populations in qualitative research, that might also be of interest to the group. I was focusing specifically on this question of how quotations and other identifying data is reproduced in text, and looked at a small sample of published articles as mini-case studies to illustrate some of the strategies that have been employed by others. Gorwa, R., and P.N. Howard. “Studying Politically Vulnerable Communities Online: Ethical Dilemmas, Questions, and Solutions.” 13th International Conference on Web and Social Media (ICWSM), Workshop on Exploring Ethical Trade-offs in Social Media Research. Palo Alto, USA (June 25). https://arxiv.org/abs/1806.00830 With digital interviewing or observation in online forums/on platforms the issue is, in my opinion, compounded by the fact that exact quotations, even if anonymized, could be dug up via search engines or interfaces. I think I landed on Annette Markham’s concept of ‘bricolage’ — which others have hinted at, in terms of making changes to the text or even fusing multiple participants together in terms of responses — as probably the best practice for fully ensuring anonymity. Cheers, Rob Robert Gorwa Fellow, Weizenbaum Institute for the Networked Society, Berlin --------------------------------------------------------- Doctoral Candidate, Department of Politics and International Relations, University of Oxford --------------------------------------------------------- <http://gorwa.co.uk> | @rgorwa On Apr 9, 2021, at 7:41 PM, Cecilia Aragon <aragon@uw.edu<mailto:aragon@uw.edu>> wrote: Cory, thanks for asking this important question, and Michael, thank you for pointing out some issues of intersectional re-identification in qualitative research, particularly for marginalized participants. This is a huge social justice issue where more research needs to be done. As a member of multiple underrepresented groups, I've frequently been asked to be a participant in qualitative research. I've found that many very well-meaning and intelligent people, including both researchers and IRBs, are unaware of the risks to vulnerable populations, particularly when intersectionality is involved. Researchers often apply naïve techniques for anonymity, and IRBs assume they are sufficient. Some IRB-approved projects clearly re-identified me and put me at risk, e.g. "anonymous participant X is a female computer science PhD student who is also an aerobatic pilot" (in a department where a professor had told me "women don't have the intellectual ability for computer science"). So I started requiring researchers to let me approve and/or edit the final text to go into published reports (and yes, it was a lot of labor for me). Some of the techniques I ended up asking researchers to use: - Apply a qualitative analog of differential privacy: add "noise" by obfuscating parts of the quotes and identifiers. For example, change the above description to "anonymous participant X is a female computer science PhD student who is also a competitive skier." This maintains the contextual integrity of the quote but obfuscates an easily identifiable characteristic. - Don't retain identifiers throughout the document for the same individual. It can be easy to re-identify an individual from a series of quotes, particularly if they have intersectional identities. Instead, you can attribute some of the quotes to "participant X, a female computer science student" and the rest to "participant Y, a Latinx computer science student." I'd love to see more research on this topic and would be happy to collaborate on projects! Cecilia -- Cecilia R. Aragon, Professor Director, Human-Centered Data Science Lab Department of Human Centered Design & Engineering, University of Washington, Seattle http://faculty.washington.edu/aragon | @craragon <https://twitter.com/craragon> New memoir *Flying Free <https://www.blackstonepublishing.com/flying-free-cecilia-aragon>: My Victory over Fear to Become the First Latina Pilot on the US Aerobatic Team* On Fri, Apr 9, 2021 at 6:43 AM Michael Muller <michael_muller@us.ibm.com<mailto:michael_muller@us.ibm.com>> wrote: I think part of the thinking-process might be: How easily can someone figure out the identity of the informant? If I were to say that I interviewed people in our 8-person team, and if I report that one person was working from the Pacific timezone, then it's easy to determine which of us I am referring to. Or if I were to write that a disabled member of the team said... then that's me. I know that seems obvious for a tiny group, but these kinds of intersectional identities can operate in larger groups, too. A second way-of-thinking may involve a focus on the risk of disclosure to the informant. However, this criterion often becomes a matter of the researcher's imagination regarding the Other. It's been shown again and again that people in a position of privilege and safety may not understand the very real risks that are experienced by people who have fewer safeguards - e.g., men writing about women's safety (how easily can a stalker act on the information?), or straight people writing about risk of identification of someone in one of the LGBTQIA+ spectra, or citizens making assumptions about legal protections (or lack of protections) for non-citizens. Of course, it's a good idea to discuss these matters with people who are not ourselves, and who are not like ourselves. It's also a good idea not to put the burden of explaining bias on the person who is the target of that bias. Yes, I know that I said two things that somewhat contradict each other. There are no easy answers here. A third possibility is to ask each informant to state what information about themself would be safe to share. This is sensible only if the informants understand publications and readerships, etc. But it may be a more radically democratic approach to demographic description. I'm suggesting these ideas as among a larger number of *starting points* for thinking about difficult research questions. Please think of them as heuristic questions - not as authoritative questions, and certainly not as answers! best wishes, --michael ----- Michael Muller, PhD, IBM Research, Cambridge MA USA pronouns: he/him/his ACM Distinguished Scientist ACM SIGCHI Academy On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se<mailto:cory.robinson@liu.se><mailto: cory.robinson@liu.se<mailto:cory.robinson@liu.se>>> wrote: HI all, Two Masterâs students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis. (I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). â¹ The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained). What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (Itâs indeed a failure of universities, as well as unequipped supervisors!) Best, Cory _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org<http://aoir.org/> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/
Ah, thank you for educating me Cory. :) Some very quick suggestions: save the interview recordings in a password-protected device or virtual drive that is separate from transcripts and any other data that could be used to deduce identity. Entire transcripts, not just quotes selected for the theses, should be anonymized if not done already; random identifiers and fake names are common choices. Be mindful of references to locations and other people in quotes as well. Delete the recordings at project completion. -Doug On Fri, Apr 9, 2021 at 3:57 AM Cory Robinson <cory.robinson@liu.se> wrote:
Hi Douglas,
Sadly, we don’t’ have an IRB at my institution. They are not as common in Sweden, and is usually the supervisor and/or supervision team to determine the ethical legitimacy of a study.
(We have an “official” ethics board in what you might consider my “state” within Sweden, but it seems that more STEM or medical applications are sent that way – which also requires a considerable fee. And that fee, unfortunately, might dissuade some from using.)
Thanks again for your input!
Best,
Cory
--
Senior Lecturer/Assistant Professor in Communication Design
Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se
http://liu-se.academia.edu/StephenCoryRobinson <http://colostate.academia.edu/StephenCoryRobinson>
Founder, Nordic Privacy Center (nordicprivacy.org)
*From: *Douglas Zytko <zytko@oakland.edu> *Date: *Wednesday, 7 April 2021 at 16:50 *To: *Cory Robinson <cory.robinson@liu.se> *Cc: *"air-l@listserv.aoir.org" <air-l@listserv.aoir.org> *Subject: *Re: [Air-L] Anonymizing qual interview data?
Hi Cory,
Your question seems to go beyond attributing quotes in theses, and more about protecting the underlying data. Does your university have an institutional review board (IRB) or equivalent? Did these studies go through any kind of review process? Universities commonly have their own internal requirements for protecting participants and maintaining anonymity with qual research.
On Wed, Apr 7, 2021 at 3:47 AM Cory Robinson <cory.robinson@liu.se> wrote:
HI all,
Two Master’s students I recently met are conducting recorded interviews resulting in texts they will code and quote within their theses. I have given input about how to protect the recorded interviews (encrypted, password protected, not stored in the cloud). I do not work with qual data, so I need help recommending methodology or help for anonymizing quotes in their thesis.
(I am inquiring about this for a student, that unfortunately, has not received helpful advice from their supervisor). ☹
The students assumed they would assign each participating an identification number, and then attribute the quote and ID # in their thesis. However, I feel there is surely a better way to ensure anonymity? (Too easy to reidentify if research data was obtained).
What methods do you utilize for anonymizing individual interview data? Or manuscripts/books helpful for this? Sadly, the students are nearing the end of the study, but late is better than never. (It’s indeed a failure of universities, as well as unequipped supervisors!)
Best, Cory -- Senior Lecturer/Assistant Professor in Communication Design Linköping University P: +46 (0)11 36 36 38 E: cory.robinson@liu.se<mailto:cory.robinson@liu.se> http://liu-se.academia.edu/StephenCoryRobinson <https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fliu-se.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582661449%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=ULXQYq81gcsTYTkcYPjDW%2B%2FOp7lfq7iyZZrHJGyEGEQ%3D&reserved=0> <http://colostate.academia.edu/StephenCoryRobinson <https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fcolostate.academia.edu%2FStephenCoryRobinson&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582671405%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=5nIRRHkxdk8QXqbuLz9A1V5gRrPSIzF6hgUzEblGaI8%3D&reserved=0>
Founder, Nordic Privacy Center (nordicprivacy.org <https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=4KQ9IMKCOKtKNs2BLeOFBE7RogIOKv7qQGd8CtvCdA0%3D&reserved=0> <https://nordicprivacy.org/ <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnordicprivacy.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=o8sgeK1j585Jc%2FKg0YfJJUhyiOdp1TQYsYuHOvznFjU%3D&reserved=0>
)
_______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org <https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Faoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582681360%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=2KNEIpQu%2F3lvh%2FradJXnzeH8Ov1IazTqOKxUaIxdMqk%3D&reserved=0> Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org <https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flistserv.aoir.org%2Flistinfo.cgi%2Fair-l-aoir.org&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=M1gmGR8QG6VN%2FBvPdHGQzQCbCuBXAPaoCEs7jbW62Zw%3D&reserved=0>
Join the Association of Internet Researchers: http://www.aoir.org/ <https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.aoir.org%2F&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582691313%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=Sz%2F7skjIj97%2Fy0Hzqf1ttA3AQQXXehsZALqioofs2aQ%3D&reserved=0>
--
Douglas Zytko, PhD
Assistant Professor of Human-Computer Interaction
Director of Oakland HCI Lab
Oakland University
Department of Computer Science and Engineering
Engineering Center 544
115 Library Drive, <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582701271%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=6KqGtw%2BGjlFtjKRwJCfYJ6LxtHxB4pRFF5Zhjn%2B4KcE%3D&reserved=0> Rochester, MI 48309 <https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmaps.google.com%2F%3Fq%3D115%2BLibrary%2BDrive%2C%25C2%25A0%2BRochester%2C%2BMI%2B48309%26entry%3Dgmail%26source%3Dg&data=04%7C01%7Ccory.robinson%40liu.se%7C1c694220a3a0449c5a1708d8f9d48c9c%7C913f18ec7f264c5fa816784fe9a58edd%7C0%7C0%7C637534038582711227%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&sdata=byIPRTu65RV6Pg3mSGo9ZryXYkA1eby7UpZcu7Vz%2FBc%3D&reserved=0>
-- Douglas Zytko, PhD Assistant Professor of Human-Computer Interaction Director of Oakland HCI Lab Oakland University Department of Computer Science and Engineering dougzytko.com Engineering Center 544 115 Library Drive, <https://maps.google.com/?q=115+Library+Drive,%C2%A0+Rochester,+MI+48309&entry=gmail&source=g> Rochester, MI 48309 <https://maps.google.com/?q=115+Library+Drive,%C2%A0+Rochester,+MI+48309&entry=gmail&source=g>
participants (8)
-
Cecilia Aragon -
Cory Robinson -
Douglas Zytko -
Josir Gomes -
Michael Muller -
Ming-Yi Wu -
Philip Derham -
Robert Gorwa