Need advice on webcrawler
Hello all, I'm hoping that some of you expert data miners can give me some advice on software (preferably shareware) that can be used to search online news sites for specific topic-related keywords. These will not be limited to English language although at this time we are limiting to western alphabets. (We plan to expand once we fine-tune retrieval methods.) We've used Google alerts in the past, for testing purposes though there are limitations as to what we can retrieve due to Google's built-in "parameters". We want to pull in everything related to physical and mental disabilities from tv & news sites, news-related blogs, health agency websites, etc. We'll filter out the "junk" later. Any suggestions would be very much appreciated. As I mentioned "free" would be ideal but I'll consider reasonably priced commercial products as well. (I'm a librarian, not a hedge fund manager, after all ;-) ) Thanks in advance for your help. -Brenda -- Brenda L. Battleson University at Buffalo Central Technical Services 134 Lockwood Library Buffalo, NY 14260-2210 USA Ph: +1-716-645-2305 ext.225 Fax: +1-716-645-5955 Email: blb@buffalo.edu * *
Brenda et al. - I haven't used this crawler personally, but I have seen it demonstrated by the absolutely fabulous Pro Mike Thelwall at the University of Wolverhampton. I would not hesitate to recommend it and also his many papers and a new book on Webometrics. http://socscibot.wlv.ac.uk/ Cheers, Denise Denise N. Rall, PhD. Special Projects, Faculty of Arts & Science, Southern Cross University, Lismore NSW 2480 AUSTRALIA Mobile +(61) (0)438 233 344 http://www.scu.edu.au/schools/esm/staff/pages/drall/ Join the Association of Internet Researchers http://aoir.org Internet Research 10.0, October 7-11, Milwaukee, WI, USA ____________________________________________________________________________________ Access Yahoo!7 Mail on your mobile. Anytime. Anywhere. Show me how: http://au.mobile.yahoo.com/mail
participants (2)
-
Brenda L Battleson -
Denise N. Rall