Fuelled by the popularity and uptake of the World Wide Web since the 1990s, many researchers and commercial vendors have focussed on Adaptive Hypermedia Systems as an effective mechanism for disseminating personalised information and services. Such systems store information about the user, such as their goals, interests and background, and use this to provide a personalised response to the user. This technology has been applied to a number of contexts such as educational systems, e-commerce applications, information search and retrieval systems.
As an increasing number of systems collect and store personal information about their users to provide a personalised service, legislation around the world increasingly requires that users have access to view and modify their personal data. The spirit of such legislation is that the user should be able to understand how personal information about them is used. The literature has reported benefits of allowing users to access and understand data collected about them, particularly in the context of supporting learning through reflection. Although researchers have experimented with open user models, typically the personalisation is inscrutable: the user has little or no access to the adaptation process. When the adaptation produces unexpected results, the user may be left confused with no mechanism for understanding why the system did what it did or how to correct it.
This thesis is the next step, giving users the ability to see what has been personalised and why. In the context of personalised hypermedia, this thesis describes the first research to go beyond open, or even scrutable user models; it makes the adaptivity and associated processes open to the user and controllable. The novelty of this work is that a user of an adaptive hypertext system might ask How was this page personalised to me? and is able to see just how their user model affected what they saw in the hypertext document. With an understanding of the personalisation process and the ability to control it, the user is able to steer the personalisation to suit their changing needs, and help improve the accuracy of the user model.
Developing an interface to support the scrutinisation of an adaptive hypertext is difficult. Users may not scrutinise often as it is a distraction from their main task. But when users need to scrutinise, perhaps to correct a system misconception, they need to easily find and access the tools that enable scrutinisation of the personalisation. Ideally, the tools should not require any training and users should be able to use them effectively without prior experience or if have not used them for a long time, since this is how users are likely to scrutinise in practice.
The contributions of thesis are: (1) SASY/ATML, a domain independent, reusable framework for creation and delivery of scrutable adaptive hypertext; (2) a toolkit of graphical tools that allow the user to scrutinise, or inspect and understand what personalisation occurred and control it; (3) evaluation of the scrutinisation tools and (4) a set of guidelines for providing support for the scrutinisation of an adaptive hypertext through the exploration of several forms of scrutinisation tools.
Keywords: Open user modelling, adaptive hypertext, scrutinisation.
| SASY | a Scrutably Adaptive SYstem
|
| 2006 |
| Czarkowski, M. (2006) A Scrutable Adaptive Hypertext. PhD Thesis (submitted March 2006). |
|
Czarkowski, M., Kay, J. (2006) Giving learners a real sense of control over adaptivity, even if they are not quite ready for it yet, Chen S and G Magoulas (eds), Advances in Web-based Education: Personalized Learning Environments, IDEA Publishing, Chapter 5, pp. 93-105.
- Book chapter describing Tutor 3 and qualitative evaluation. |
| 2005 |
|
Czarkowski, M., Kay, J. and Potts, S. (2005a) Web Framework for Scrutable Adaptation. In: Proceedings of Workshop on Learner Modelling for Reflection, to Support Learner Control, Metacognition and Improved Communication between Teachers and Learners at 12th International Conference on Artificial Intelligence in Education, AIED'2005, Amsterdam, July 19, 2005, IOS Press, pp. 11-18.
- Workshop paper describing Cell-Tutor and qualitative evaluation. |
|
Czarkowski, M., Kay, J. and Potts, S. (2005b) Scrutability as a core interface
Poster in Proceedings of 12th International Conference on Artificial Intelligence in Education, AIED'2005, Amsterdam, July 19, 2005, IOS Press, pp. 783-786.
- Workshop paper describing Cell-Tutor and qualitative evaluation. |
|
Czarkowski, M. (2005c) Evaluating Scrutable Adaptive Hypertext. Workshop on Evaluation of Adaptive Systems, held in conjunction with the 10th International conference on User Modelling, Edinburgh, UK, 24th-29th July 2005. Available online at http://www.easy-hub.org/hub/workshops
- Workshop paper describing SASY 1 qualitative evaluation design. |
| 2003 |
|
Czarkowski, M., Kay, J. (2003a). How to give the user a sense of control over the personalization of adaptive hypertext? Workshop on Adaptive Hypermedia and Adaptive Web-Based Systems, User Modeling 2003, pp. 121-132.
- Workshop paper describing Tutor 3 and qualitative evaluation. |
|
Czarkowski, M., Kay, J. (2003b). Challenges of Scrutable Adaptivity. Poster in: AIED 2003: proceedings from the 11th International Conference in Artificial Intelligence in Education; Sydney, Australia, July 20-24, Ulrich Hoppe, Felisa Verdejo, Judy Kay, IOS Press, pp. 404 - 407.
- Poster paper describing Tutor 3 and qualitative evaluation. |
| 2002 |
|
Czarkowski, M. and Kay, J. (2002) A scrutable adaptive hypertext. In: P. De Bra, P. Brusilovsky and R. Conejo (eds.) Proceedings of Second International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH'2002) Proceedings, M laga, Spain, May 29-31, 2002, Springer-Verlag, pp. 384-387.
- Conference paper describing Tutor 2. |
| 2001 |
|
Czarkowski, M., Kay, J. (2001) Tutor: support for scrutably personalised documents. ADCS 2001 Proceedings of the Sixth Australasian Document Computing Symposium, Volume 1, pp.29-36, Vercoustre, AM & Kay, J, Basse. 2001. ISBN 1-86487-440-6.
- Conference paper describing Tutor 2. |
| 2000 |
|
Czarkowski, M. and Kay, J. (2000) Bringing scrutability to adaptive hypertext teaching. In: G. Gauthier, C. Frasson and K. VanLehn (eds.) Intelligent Tutoring Systems. Lecture Notes in Computer Science, Vol. 1839, (Proceedings of 5th International Conference on Intelligent Tutoring Systems (ITS'2000), Montreal, Canada, June 21-23, 2000) Berlin: Springer-Verlag, pp. 421-432.
- Conference paper describing Tutor 1 and quantitative evaluation. |
| 1998 |
|
Czarkowski, M. (1998) ATML, Tutor and ADAPT: an adaptive hypertext teaching system. Technical Report, TR 519. University of Sydney Australia. ISBN 1 86487 044 3.
Download XML-tech-report.doc (54K)
- Technical report describing Tutor 1. |
| Czarkowski, M. (1998) Honours Thesis, Basser Department of Computer Science, University of Sydney (1998). Download hons-thesis.zip (863K) |
| June 2000 | ITS (Intelligent Tutoring Systems) June 2000 Download the slides from the presentation: ITS2000-pres.ppt (312K) Intelligent Tutoring Systems: 5th international conference (ITS 2000), Montreal, Canada, June 19-23 2000. |
| July 2005 | UM2005 Fourth Workshop on the Evaluation of Adaptive Systems Download the slides from the presentation: Czarkowski_Evaluating_SASY.ppt (382K) The 10th International Conference on User Modeling (UM'2005), 24 to 29 of July 2005, Edinburgh. |