Re: [Air-L] Let's talk about AoIR
Hi, all. Let me preface this by saying I’m a pretty newly minted PhD and am not yet wise in the ways of conference organizing. So, my ideas might be logistically unfeasible or outright naïve. I was thinking about Lori’s point that tracks might discourage interaction among people from different fields. It’s a valid point. At the same time, different disciplines and approaches have different “needs” (which have been discussed at length, so I won’t reiterate them here). Is it possible to use tracks for the submission and reviewing process, but not for assembling the program? There could be a variety of tracks that allowed for more flexible submission processes and more targeted reviewing. These could be crafted to insure space for less “straight” research, performances, activist work, etc. that we want to have a home at AoIR (and that many, including myself, feel that the most recent CFP seems to have disadvantaged). But, there could also be a track for the kind of completed, full papers Nichole is talking about. Then, when it came time to put the program together, the tracks could be jettisoned. The panels would be assembled by a non-track centric logic. So, you might have a panel about X and it might be made up of a completed quantitative study what was submitted as a full paper, a theoretical piece, an ethnographic work in progress, and someone doing activist work. (I’m just randomly naming possibilities.) That way the selection process was more targeted to meet different needs. But, then when we actually got to the conference, those disciplinary (and pragmatic needs) didn’t dictate the interactions. Also, I would love to see more discussion on the list. I, personally, haven’t really participated much until now because that didn’t seem to be the way people were using the list. Having this or some other space for discussion would be great. I really like the idea of webinars. I would be down for some webinars. Best, Sarah
I think that this is a fantastic idea Sarah. It seems like it would overcome many of the problems that have been mentioned throughout this discussion. It would also fit with the ideas people have already shared about improving the review process. As Program Chair last year I found it difficult to get enough experienced people to volunteer to review. Inexperienced reviewers were quite often very harsh in the way they approached contributions, or unsure about how to assess papers that didn’t fit with their own experiences/disciplinary backgrounds (making the sorts of comments that people in this thread have commented on and going on to mark contributors down for not having ‘findings’ or talking about ‘samples’ when that wouldn’t have been appropriate anyway for example). It was a lot of work trying to manage that. What would have worked better would have been to have a much smaller team of reviewers, working to detailed guidelines and cross-checking with each other across the whole process. That would require a group of people who would be prepared to do a lot of work in a fairly short space of time but it would transform the reviewing process and would also result in a group who were spectacularly well informed about reviewing across disciplines and with real expertise in helping to manage the way AoIR conferences might develop in future. I’d be happy to get involved in something like that and maybe others would too? Feona On 2 Jun 2013, at 02:11, Sarah Florini wrote: Hi, all. Let me preface this by saying I’m a pretty newly minted PhD and am not yet wise in the ways of conference organizing. So, my ideas might be logistically unfeasible or outright naïve. I was thinking about Lori’s point that tracks might discourage interaction among people from different fields. It’s a valid point. At the same time, different disciplines and approaches have different “needs” (which have been discussed at length, so I won’t reiterate them here). Is it possible to use tracks for the submission and reviewing process, but not for assembling the program? There could be a variety of tracks that allowed for more flexible submission processes and more targeted reviewing. These could be crafted to insure space for less “straight” research, performances, activist work, etc. that we want to have a home at AoIR (and that many, including myself, feel that the most recent CFP seems to have disadvantaged). But, there could also be a track for the kind of completed, full papers Nichole is talking about. Then, when it came time to put the program together, the tracks could be jettisoned. The panels would be assembled by a non-track centric logic. So, you might have a panel about X and it might be made up of a completed quantitative study what was submitted as a full paper, a theoretical piece, an ethnographic work in progress, and someone doing activist work. (I’m just randomly naming possibilities.) That way the selection process was more targeted to meet different needs. But, then when we actually got to the conference, those disciplinary (and pragmatic needs) didn’t dictate the interactions. Also, I would love to see more discussion on the list. I, personally, haven’t really participated much until now because that didn’t seem to be the way people were using the list. Having this or some other space for discussion would be great. I really like the idea of webinars. I would be down for some webinars. Best, Sarah _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ --------------------------------------------------------------------------- Please note that Middlesex University's preferred way of receiving all correspondence is via email in line with our Environmental Policy. All incoming post to Middlesex University is opened and scanned by our digital document handler, CDS, and then emailed to the recipient. If you do not want your correspondence to Middlesex University processed in this way please email the recipient directly. Parcels, couriered items and recorded delivery items will not be opened or scanned by CDS. There are items which are "exceptions" which will be opened by CDS but will not be scanned a full list of these can be obtained by contacting the University.
Firstly - thanks to Nicole for answering my question and clarifying her position - much appreciated - and secondly, I think Sarah's idea has a lot of merit and is certainly very interesting as something to consider. The idea of a reviewing panel (or overseeing panel) that Feona and a few others have mooted is a good one and I think there's also some merit in 'choose what you want to review' although there are SO MANY reviews that there would need to be a substantial reviewing period and we'd need to think about how many reviews each person can realistically do, not to mention how much work co-ordinating the process might be for the programme chair. And webinars! That would be good as a way of using the internet and facilitating the sharing of research, ideas, discussion etc outside of the conferences I think - I've not had much experience with those but will check out the links people sent to others to see how they work. Ruth ________________________________________ From: air-l-bounces@listserv.aoir.org [air-l-bounces@listserv.aoir.org] on behalf of Feona Attwood [f.attwood@mdx.ac.uk] Sent: 02 June 2013 10:11 To: Sarah Florini Cc: air-l@listserv.aoir.org Subject: Re: [Air-L] Let's talk about AoIR I think that this is a fantastic idea Sarah. It seems like it would overcome many of the problems that have been mentioned throughout this discussion. It would also fit with the ideas people have already shared about improving the review process. As Program Chair last year I found it difficult to get enough experienced people to volunteer to review. Inexperienced reviewers were quite often very harsh in the way they approached contributions, or unsure about how to assess papers that didn’t fit with their own experiences/disciplinary backgrounds (making the sorts of comments that people in this thread have commented on and going on to mark contributors down for not having ‘findings’ or talking about ‘samples’ when that wouldn’t have been appropriate anyway for example). It was a lot of work trying to manage that. What would have worked better would have been to have a much smaller team of reviewers, working to detailed guidelines and cross-checking with each other across the whole process. That would require a group of people who would be prepared to do a lot of work in a fairly short space of time but it would transform the reviewing process and would also result in a group who were spectacularly well informed about reviewing across disciplines and with real expertise in helping to manage the way AoIR conferences might develop in future. I’d be happy to get involved in something like that and maybe others would too? Feona On 2 Jun 2013, at 02:11, Sarah Florini wrote: Hi, all. Let me preface this by saying I’m a pretty newly minted PhD and am not yet wise in the ways of conference organizing. So, my ideas might be logistically unfeasible or outright naïve. I was thinking about Lori’s point that tracks might discourage interaction among people from different fields. It’s a valid point. At the same time, different disciplines and approaches have different “needs” (which have been discussed at length, so I won’t reiterate them here). Is it possible to use tracks for the submission and reviewing process, but not for assembling the program? There could be a variety of tracks that allowed for more flexible submission processes and more targeted reviewing. These could be crafted to insure space for less “straight” research, performances, activist work, etc. that we want to have a home at AoIR (and that many, including myself, feel that the most recent CFP seems to have disadvantaged). But, there could also be a track for the kind of completed, full papers Nichole is talking about. Then, when it came time to put the program together, the tracks could be jettisoned. The panels would be assembled by a non-track centric logic. So, you might have a panel about X and it might be made up of a completed quantitative study what was submitted as a full paper, a theoretical piece, an ethnographic work in progress, and someone doing activist work. (I’m just randomly naming possibilities.) That way the selection process was more targeted to meet different needs. But, then when we actually got to the conference, those disciplinary (and pragmatic needs) didn’t dictate the interactions. Also, I would love to see more discussion on the list. I, personally, haven’t really participated much until now because that didn’t seem to be the way people were using the list. Having this or some other space for discussion would be great. I really like the idea of webinars. I would be down for some webinars. Best, Sarah _______________________________________________ The Air-L@listserv.aoir.org<mailto:Air-L@listserv.aoir.org> mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/ --------------------------------------------------------------------------- Please note that Middlesex University's preferred way of receiving all correspondence is via email in line with our Environmental Policy. All incoming post to Middlesex University is opened and scanned by our digital document handler, CDS, and then emailed to the recipient. If you do not want your correspondence to Middlesex University processed in this way please email the recipient directly. Parcels, couriered items and recorded delivery items will not be opened or scanned by CDS. There are items which are "exceptions" which will be opened by CDS but will not be scanned a full list of these can be obtained by contacting the University. _______________________________________________ The Air-L@listserv.aoir.org mailing list is provided by the Association of Internet Researchers http://aoir.org Subscribe, change options or unsubscribe at: http://listserv.aoir.org/listinfo.cgi/air-l-aoir.org Join the Association of Internet Researchers: http://www.aoir.org/
Wow! I go away for a long weekend (without access to email, hooray!), and come back to see the AoIR list has exploded with posts. As one who objected to the change in the list many moons ago to shift to a reply-to-individual rather than a reply-to-list, and have seen the list go from one of lively discussion to one of posting announcements, I love to see the dialogue and debate happening here now. (Not that I am declaring causation, mind you, but it is food for thought.) I just want to toss out a few thoughts. First, as others note, our conference organizers and reviewers are the worker bees of this organization, engaging in often thankless, challenging work. So, I just want to say thanks, thanks, thanks, for giving your time, insight, and care to this community of Internet scholars. Second, there is no magically correct formula to conference submissions and reviews. There are better processes and worse processes. Each conference organization seems to do theirs a bit differently and for different reasons. The key is thinking for us what it is we want our IR conference to be. The shift that happened this year was, as I understand it, an effort to introduce a bit more regularity to the submissions to help reviewers to make sense of what they were evaluating and to help improve the overall quality of the ultimate presentations at the conference, by forcing a bit more depth and detail to the submission. I fully support these goals. We want the AoIR conference to present the best of shiny research and theorizing about the Internet, and we want a submission process that helps reviewers to shift the shiny bits from those that are dull (or half-baked to mix metaphors). I also want AoIR to remain interdisciplinary. For me, that is our strength -- and paradoxically it also seems to be the crux of the problem we are experiencing currently. So, I second suggestions to better tune the process introduced this year: a) give reviewers more information and guidelines to help them judge what they are reviewing in terms of the type of submission; b) suggest a template that people can follow and invite creativity and flexibility for submissions; c) establish a committee to help oversee and provide guidance for reviewers; d) try to cultivate a larger bank of reviewers. I think it would be helpful, if logistics allow, for reviewers to see what other reviewers wrote. Because many of our reviewers are junior scholars, turning the review process into a teaching one by sharing with the reviewers what each wrote can help improve the reviewing process in future conferences. And, count me in as someone who is willing to help in thinking about this in some sort of organized way. ~Jenny
Call for Proposals - PATCH’2014 – The Future of Experiencing Cultural Heritage, Haifa, Israel. February 24, 2014 The 7th International Workshop on Personalized Access to Cultural Heritage (PATCH 2014) will be this year co-located with the Intelligent User Interfaces Conference (http://www.iuiconf.org/). IUI is the annual meeting of the intelligent interfaces community and serves as the principal international forum for reporting outstanding research and development on intelligent user interfaces. It takes place in Haifa, Israel on 24 February 2014. Next to the full research papers, we also encourage submissions of position papers, short papers and demonstrations to enable active discussion of the open challenges and issues in this area of research. For more details check PATCH2014 webpage: http://patch2014.wordpress.com/. The PATCH workshop series (http://patchworkshopseries.wordpress.com/) is the meeting point between state of the art cultural heritage and personalization research – using technology to enhance the personal experience in cultural heritage applications. We aim at building a research agenda for personalization in cultural heritage in order to make the individual cultural heritage experience a link in a chain of a lifelong cultural heritage experience which builds on past experience, is linked to daily life and provides the foundation for future experiences. The workshop aims to be multi-disciplinary. It is intended for researchers, practitioners, developers and students of information and communication technologies (ICT), cultural heritage domains, e.g. museums, archives, libraries, and more, and personalization. Topics Multimedia information systems, such as interactive tours, visualizations and search engines, are now positioned centrally in a shared information space consisting of (1) digitized artifacts (2) the social web (3) and links between them. Personalization in multimedia information systems can improve the experience of visitors by assisting them in finding appropriate starting points, and in discovering new relevant information. Critically, these systems must become smart, so that they are able to adaptively act, react, respond and learn intelligently from user interactions. This workshop investigates three timely and interrelated issues relevant to the domains of both intelligent user interaction and cultural heritage: Mobile, personalized and context-aware cultural heritage information delivery – using mobile devices, large displays, projectors embedded in the environment and new technologies including Google Glass. Grow existing knowledge with new knowledge – Explore methods and tools to capture knowledge resulting from interactions between users (collective intelligence), professionals and collection artifacts, and interaction between users and different (intelligent systems) collecting information about them Extend contexts of use – Appropriation of digitized artifacts from memory organizations outside the traditional museum and research context for both visitors and professionals Call for papers Besides the full research papers, we also encourage submissions of position papers, short papers and demonstrations to enable active discussion of the open challenges and issues in this area of research. We invite submissions of work at all stages of development that address any aspects of personalization in the cultural heritage domain, e.g., papers which describe work in progress, empirical results, position statements, and demonstrations of existing systems. An extended abstract of the workshop will be included in the ACM Digital Library for IUI 2014. Submissions Paper submissions should follow the general ACM Multimedia submission guidelines and must comply with the formatting instructions: Full papers: max. 10 pages Position papers: max. 4 pages Short papers: max. 4 pages Demo papers: max. 4 pages All papers should be submitted in PDF format via the online submission system. (https://www.easychair.org/conferences/?conf=patch2014iui2014). An international panel of experts will review all submissions. Demos need to provide links to the systems presented. Work that has already been published should not be submitted unless it introduces a significant addition to the previously published work. Important dates Paper Submission: Dec 14, 2013 Author Notification: Jan 17, 2014 Camera-ready Version: Feb 10, 2014 Workshop: Feb 24, 2014 Organizers Cristina Gena - Università di Torino, Italy Alan J. Wecker - University of Haifa, Israel Johan Oomen - Netherlands Institute for Sound and Vision, Netherlands Lora Aroyo - VU University Amsterdam, Netherlands Contact Contact chairs at: joomen@beeldengeluid.nl Website: http://patch2014.wordpress.com/ Twitter: @PATCH_Workshop, #patch2014 Programme committee Alan J. Wecker (University of Haifa) Cristina Gena (Università di Torino) Eero Hyvönen (Helsinki University of Technology) Ivan Cantador (Universidad Autónoma de Madrid) Johan Oomen (Netherlands Institute for Sound and Vision) Joris Pekel (Europeana Foundation) Dick van Dijk (Waag Society) Liliana Ardissono (Università di Torino) Lora Aroyo (VU University Amsterdam) Otmar Moritsch (Technisches Museum Wien) Raffaella Santucci (Università di Roma “La Sapienza”) Susan Hazan (Israel Museum) Tsvi Kuflik (University of Haifa)
participants (5)
-
Deller, Ruth A -
Feona Attwood -
Jennifer Stromer-Galley -
Johan Oomen -
Sarah Florini