The SINS trial (Controlled Clinical Trials ISRCTN48755084; Eudract No. 2004-004506-24) is a randomised controlled trial evaluating long term success of excisional surgery vs. imiquimod 5% cream for low risk nodular and superficial basal cell carcinoma (BCC). The trial included a discrete choice experiment questionnaire to explore patient preferences of a cream versus surgery for the treatment of their skin cancer.
The self-completed questionnaire was administered at baseline to 183 participants, measuring patients’ strength of preferences when choosing either alternative ‘surgery’ or ‘imiquimod cream’ instead of a fixed ‘current situation’ option (of surgical excision as standard practice in UK). The treatments were described according to: cost, chance of complete clearance, side effects and appearance. Participants had to choose between various scenarios. Analysis was performed using a mixed logit model, which took into account the impact of previous BCC treatment and sample preference variability.
The analysis showed that respondents preferred ‘imiquimod cream’ to their ‘current situation’ or ‘surgery’, regardless of previous experience of BCC symptoms and treatment. Respondents were more likely to be worried about their cosmetic outcomes and side effects they might experience over and above their chance of clearance and cost. Those with no experience of surgery (compared with experience) valued more the choice of ‘imiquimod cream’ (£1013 vs £781). All treatment characteristics were significant determinants of treatment choice, and there was significant variability in the population preferences for all of them.
Patients with BCC valued more ‘imiquimod cream’ than alternative ‘surgery’ options, and all treatment characteristics were important for their choice of care. Understanding how people with a BCC value alternative interventions may better inform the development of health care interventions.
Patient preferencesDiscrete choiceWillingness to payNodular and superficial basal cell carcinomaSurgeryImiquimod cream
To make an informed choice when choosing between surgery and imiquimod cream treatments for low risk basal cell carcinomas (BCCs) such as superficial BCC or small nodular BCC not located on the central face (as specified by the British Association of Dermatology BCC treatment guidelines ), patients need to balance trade-offs between different aspects (e.g. risk of scarring, clearance, and out-of-pocket costs) attached to these alternative treatments (Weston and Fitzgerald ; Essers et al. ). Our aim was to investigate patient preferences for ‘surgery’ or ‘imiquimod cream’ for the treatment of BCC using a discrete choice experiment (DCE; Ryan et al. ) approach in a sample of patients participating in a randomised controlled trial of surgery vs. imiquimod for low risk nodular and superficial BCC (Ozolins et al. ). We chose the Discrete Choice Experiments (DCEs) technique as it has been previously used in health care to evaluate different cancer screening strategies (Wordsworth et al. ; Marshall et al. ; Kruijshaar et al. ; van Dam et al. ; Hol et al. ); and willingness to pay (WTP) for methyl aminolevulinate photodynamic therapy vs surgery in BCC (Weston and Fitzgerald ) and for Mohs micrographic surgery vs surgery (Essers et al. ). Patient experience with previous treatment has been shown to influence the utility (benefit) patients derive from health care interventions (Salkeld et al. ; Ryan and Ubach ; Cheraghi-Sohi et al. ). We are also aware that information from such experiments can help health professionals to understand individual preferences for treatment, and, indeed, inform policy (Eberth et al. ; De Bekker-Grob et al. ). To our knowledge there is no evidence of research investigating: i) how patients with a BCC value alternative treatments on offer ii) the extent of preference variability or heterogeneity in the sample and iii) bearing in mind that BCCs are often asymptomatic and multiple, whether patients with experience of tumour symptoms and previous treatments may have better informed preferences. This study investigates how patients with a low risk BCC participating in a randomized controlled trial of excisional surgery versus topical imiquimod value the choice between the two treatment modalities.
The Discrete Choice Experiment (DCE) questionnaire
The Discrete Choice Experiment (DCE) technique is an attribute based approach that quantifies strength of patients’ preferences for the health care services or interventions. Respondents choose between alternative hypothetical interventions described in terms of their characteristics and associated levels. Results from the regression model identify which attributes, such as chance of clearance, side effects or convenience, are significant in the decision to choose, and their relative importance across treatments (i.e. magnitude of the attributes). Money as an attribute can also be used to estimate trade-off or Willingness To Pay (WTP, a monetary measure of benefit) for changes in attribute levels (e.g. WTP for improving by 1% their chance of clearance). The DCE technique, and its application to health care, is extensively discussed elsewhere (Ryan et al. ; de Bekker-Grob et al. ).
In this experiment, a list of attributes, their levels, and status quo alternative (see below) were derived from a previous DCE exercise applied to BCC (Weston et al. ), and from systematic discussion with the research team plus advice provided by a panel of experts. They were chosen to be general aspects of treatment that best described the alternative interventions on offer within the SINS trial i.e. ‘surgery’ vs. ‘imiquimod cream’ (Table 1). The “cost to you” attribute was added to find out how much patients valued the treatment. How the treatments and attributes were presented to the participants can be seen in the questionnaire (see Additional file 1).
Summary of coding for discrete choice experiment attributes and their levels
1) Cost [cost to you]
2) Chance [Chance ofcomplete clearance]
3) Side effects
MILD SIDE EFFECTS
(mild pain that doesnot disturb sleep)
(Mild irritation,burning or redness)
(mild pain that doesnot disturb sleep)
MODERATE SIDE EFFECTS
(pain that sometimesmight disturb sleep)
(Moderate irritation, burning,redness or weeping)
(compared with severe)
(pain that disturbs sleep)
(Severe irritation, burning,redness or ulceration)
(Barely visible scar)
(Not discoloured skin)
MODERATE CHANGE IN APPEARANCE
(Slight lightening skin)
(compared with severe change)
(Slightly raised scar)
(fixed surgery option fromtheir experience alternativeto an hypothetical ‘surgery’)
CREAM(compared withcurrent situation)
A DCE labelled (‘surgery’ vs. ‘imiquimod cream’) experiment was created from design catalogues  using a fold-over approach (Louviere et al. ; Rose and Bliemer ), as a commonly used technique to inform experimental design creation (de Bekker-Grob et al. ). Employing such a design minimised the number of choices for each respondent, from 135 (51*33) to 16 choices. To the 16-choice design, a third status quo alternative was added, representing surgical excision as current (standard) practice in UK hospitals (i.e. ‘current situation’). It defined an average surgical excision in a hospital setting with a 4 mm clear excision margin, use of a local anaesthetic injection, closure with sutures and removal of sutures on a separate visit. The ‘current situation’ was characterised by the following fixed levels: 96% chance of complete clearance; mild pain (that does not disturb sleep); a noticeable (but easy to cover) scar after treatment; and £0 cost to the patient (the procedure was undertaken free at the point of care in the UK National Health Service). An example of a choice is reported in Figure 1.
Participants, sample size, setting and data collection
Our study sample included men and women of any age with low risk  nodular or superficial BCC participating in the SINS (Surgery vs Imiquimod in Nodular and Superficial basal cell carcinoma) study . The SINS study is a randomized controlled trial to compare excision ‘surgery’ and ‘imiquimod cream’ for nodular and superficial basal cell carcinoma presenting in low risk areas. The study (ISRCTN48755084) received full ethical and hospital approval, and is conducted according to the declaration of Helsinki; all participants gave informed written consent.
Since size, type of experimental design, and the number of independent variables were unknown in advance, a minimum estimate of 50–100 responses per subgroup of interest was stipulated. The questionnaire was distributed to 183 of 501 consecutive patients participating in the trial (18th to 200th), during their baseline visit (August 2003-January 2005). A minimum target response of 170 (response rate of 85%), allowing for comparison between two subgroups with experience and with no experience of BCC and treatment, was felt appropriate compared with similar studies (Pearmain et al. ).
Response rates, patient characteristics, and questionnaire completion: Descriptive statistics were presented as frequencies and percentages (binary variables) and median and inter-quartile range (continuous variables). Differences in patient characteristics between subgroups with experience and with no experience were reported and tested using the non parametric Mann–Whitney test and Chi square tests (where appropriate). SPSS software version 16  was used to analyse the data.
Patient preferences: DCE modelling, its theoretical validity and subgroup analysis. Patient preference data were analysed using the mixed logit model (MLM, largely applied to multiple choice health care data, de Bekker-Grob et al. ). The Biogeme package  was used to support this analysis. Theoretical validity of responses was checked by testing the direction and significance of the model attributes. A priori we expected respondents to prefer: a decreased cost (a negative sign for ‘COST’); an increased chance of complete clearance (positive sign for ‘CHANCE’); a decreased severity of side effects (positive signs for ‘MILD SIDE EFFECTS’ and ‘MODERATE SIDE EFFECTS’); and improved appearance (positive signs for ‘NORMAL APPEARANCE’, and ‘MODERATE CHANGE IN APPEARANCE’). No a-priori assumptions were made concerning their preferred alternative (represented by the alternative specific constants (ASCs) for ‘surgery’ and ‘imiquimod cream’ options, ‘ASCSURGERY‘and ‘ASCCREAM’).
Subgroup analysis was undertaken to test whether different choices may result if respondents had experience of BCC and treatment. This follows current evidence in health care, reporting that respondents usually ascribe more value to the things they have experienced, (i.e. status quo bias: see Salkeld et al. ). The MLM model was presented considering all valid respondents (whole sample) and subgroups of those with experience and with no experience of BCC and treatment.
Estimated preferences were compared between experience subgroups. Difference in i) incremental WTP or ii) in proportion of respondents with preferences for a particular change in treatment characteristics (described by their mean and standard deviation) were reported and tested using independent t test statistics.
Results and discussion
Response rates, patient characteristics, and questionnaire completion
The DCE questionnaire was completed by 174/183 (95%) consecutive SINS trial participants. Overall 22% considered the questionnaire difficult/very difficult to complete (Table 2). The median age of the respondents was 65 years, 61% were men, 80% had a weekly income less than £300, and about 32% had previous experience of symptoms and treatment for BCC. Both subgroups with experience and with no experience presented socioeconomic characteristics similar to the whole DCE sample (See Table 2).
Patient characteristics (whole sampleand subgroups relating to experience of BCC symptoms and treatment)
With no experienceN=118
With no vs.with experience
(Not recorded to beexcluded from analysis)
Previous experience of BCC symptoms and treatment
Difficulties in completing the questionnaire
1 Cells have expected count less than 5. 2Some respondents presented not recorded data, as the question was not asked (dropped from assessments) or they did not complete it.
Specifications of the MLM model, its output for analysing the whole sample and subgroups with and without previous BCC are presented in Tables 3, 4. Figures 2, 3 display mean utility values and marginal WTP attached to the alternative treatments and their characteristics. The proportion of respondents for whom a particular characteristic had a positive effect is illustrated in Figure 4.
Patient preferences for thewhole sample(n=174)
Their preference is for:
Surgery (compared with current situation)
Imiquimod cream (comparedwith current situation)
increased chance, 82% of respondents
MILD SIDE EFFECTS
mild side effects (comparedwith severe, 79% of respondents)
MODERATE SIDE EFFECTS
moderate side effects (compared withsevere, 91% of respondents)
normal appearance (compared withsevere change, 89% of respondents)
MODERATE CHANGEIN APPEARANCE
moderate change (compared withsevere change, 62% of respondents)
1The preferred model is a MLM and presents all characteristics (apart from ‘COST’, ‘ASCSURGERY’, ‘ASCCREAM’) as random and independently normally distributed. The simulation process is based on 500 draws. All coefficients (either fixed or random) and the standard deviations of the random coefficients are statistically significant at 95%. 2WTP estimates are based on the regression results in column 3 and rounded to 2 decimal places. The standard deviations are in parentheses. Marginal WTP for a unit change in a treatment characteristic = (mean coefficient of characteristic)/-(coefficient ‘COST’), with SD = (SD of characteristic coefficient)/-(coefficient ‘COST’).
Note: Alternative specific constants (ASC) for surgery (ASC SURGERY) and for cream (ASC CREAM) show the preferences of these alternatives relative to the current situation, everything else being equal.
Key: SD = standard deviation, WTP = Willingness to Pay, LR = Likelihood Ratio.
Patient preferences according to experience of BCC and treatment
Note: Alternative specific constants (ASC) for surgery (ASCSURGERY) and for cream (ASCCREAM) show the preferences of these alternatives relative to the current situation, everything else being equal. WTP estimates are based on the regression results in column 3 and rounded to 2 decimal places. The standard deviations are in parentheses. 1 The preferred model is a MLM and presents all characteristics (apart from ‘COST’, ‘ASCSURGERY’, ‘ASCCREAM’) as random and independently normally distributed. The simulation process is based on 500 draws. All coefficients (either fixed or random) and the standard deviations of the random coefficients are statistically significant at 95% 2 Differences in marginal WTP between groups are significant at the 95% level. 3Differences in preference distribution between groups are significant at the 99% level.
Key: SD = standard deviation, WTP = Willingness to Pay, LR = Likelihood Ratio, No. = Number of.
In the whole group and subgroups with and without previous BCC, all treatment choice attributes are statistically significant at 95% and therefore significant in the decision to choose. There is also evidence that individuals valued these characteristics differently. Overall, all characteristics have the expected directions supporting theoretical validity of the findings (see above). The positive signs on the alternative specific constants (ASCs) indicate that, everything else being equal, respondents preferred alternative treatments to their ‘current situation’, and, when choosing an alternative to their ‘current situation’, the ‘imiquimod cream’ was preferred overall to the ‘surgery’ (as indicated by the higher positive value). See Tables 3, 4 for further details.
Across all treatment characteristics choosing mild instead of severe side effects was the most valued aspect (as indicated by the largest significant coefficient of ‘MILD SIDE EFFECTS’ with a mean value of 1.38), whilst an increase in cost was the least preferred (‘COST’ with a mean value of −0.0031; see Figure 2).
Figure 3 and Table 3 also show respondents’ marginal WTP for a unit change in each treatment characteristic. For example, marginal WTP for choosing mild instead of severe side effects is £445.16 (standard deviation £541.94).
The proportion of respondents for whom a particular characteristic had a positive effect is reported in Figure 4, Table 3. For example, 79% of the sample preferred a change from severe to mild side effects, while the others did not value this change so highly.
Subgroup with experience of BCC and treatment
For those with previous BCC experience, the movement from severe change to normal appearance was the most important marginal change in an attribute (having the largest significant coefficient with a mean value of 1.31), and ‘COST’ remained the least preferred characteristic (see Figure 2, Table 4). The marginal WTP for choosing normal instead of severe change to appearance is £392.22 (standard deviation £377.25; Figure 3, Table 4). Ninety seven percent of the sample preferred normal appearance where as the others did not value this change so highly (Figure 4, Table 4).
Subgroup with no experience of a previous BCC and treatment
With no BCC experience, the movement from severe to mild side effects was the most important marginal change in an attribute (having largest significant coefficient with a mean value of 1.37), and ‘COST’ remained the least preferred characteristic (see Figure 2, Table 4). The marginal WTP when choosing mild instead of severe side effects was £455.15 (Figure 3, Table 4). Of the sample 80% preferred mild instead of severe side effects, while the others did not value this change so highly (Figure 1, Table 4).
Comparison between subgroups
Respondents preferred a change from the ‘current situation’ to alternative treatments and they mostly preferred moving to the ‘imiquimod cream’, regardless of their experience of a previous BCC and treatment. The subgroup with no experience valued more such change compared with the subgroup with experience (‘ASCCREAM’; £1013 vs. £781). The subgroup with no experience valued best choosing mild instead of severe side effects, and their willingness to pay for this choice was similar to the other subgroup (‘MILD SIDE EFFECTS’; £455 vs. £344, p=0.23). In the subgroups with experience the most valued characteristic was an improvement in their appearance from severe changes to normal appearance and they valued it more than the subgroup with no experience (‘NORMAL APPEARANCE’; £392 vs. £299, p=0.02). More details are presented in Figure 3 and Table 4.
When considering the difference in preference distribution across groups a greater proportion of participants with experience compared with no experience preferred the idea of a change from severe to moderate side effects (‘MODERATE SIDE EFFECTS’; 99% vs. 87%, p<0.01), or from severe change to normal appearance (‘NORMAL APPEARANCE’; 97% vs. 85%, p<0.01; see Table 4). Other random coefficient distributions did not present statistically significant differences between groups (‘CHANCE’ p=0.13; ‘MILD SIDE EFFECTS’ p=0.45; ‘MODERATE CHANGE IN APPEARANCE’ p=0.11).
Summary of preference findings
This Discrete Choice Experiment (DCE) exercise was embedded within a wider randomised controlled trial. This provided the main trial with new empirical evidence of strength of patient preferences for alternative treatments on offer for low risk BCC, the impact of previous experience of a BCC and treatment on their preferences, and a measure of the spread or heterogeneity of preferences in the sample.
To our surprise, respondents preferred the ‘imiquimod cream’ treatment to their ‘current situation’ or alternative ‘surgery’, regardless of their experience of a previous BCC and treatment, though it might be questioned whether respondents with no experience of a condition or treatment are in a position to inform decision making (Gafni ).
Our study showed that regardless of their experience, respondents valued all aspects of treatment, but they were more likely to be worried about their cosmetic outcomes and side effects they might experience over and above their chance of clearance and cost. A cream option with better cosmetic outcomes was more appealing to them than a surgery intervention with better clearance outcomes.
Respondents with experience of a previous BCC and treatment (usually surgical) valued the ‘imiquimod cream’ option less than those without such experience, a finding supported in the literature of status quo bias, where people are more likely to adopt a conservative response to health services innovations (Salkeld et al. ; Ryan and Ubach ; Tinelli et al. ). In this particular case respondents’ experience for a surgery intervention might have limited their shift of preferences from their status quo to an innovative ‘imiquimod cream’ intervention on offer.
With experience of a previous BCC and surgical intervention (with risk of permanent scar), the movement from severe change to normal appearance was the most important marginal change; this subgroup were more likely to value a treatment with the best cosmetic outcomes, regardless of other characteristics, compared with those with no previous BCC.
How people differed
Evidence of significant variation (heterogeneity) of preferences was found in the chance of clearance, side effects and appearance characteristics. Preferences for treatment characteristics were not specific to one particular improvement in their cosmetic outcomes or chance of clearance, though some changes might be regarded as not sufficient e.g. only 62% preferring moderate change vs. severe change. The distributions of preference were statistically different across experience subgroups. Results confirmed that respondents with experience of a BCC were more likely to value a treatment with the best cosmetic outcomes, whilst respondents with no past BCC might value less highly such improved characteristics.
Study strengths and limitations
A particular strength was using a multiple choice design with inclusion of a status quo option; forcing a choice i.e. no status quo alternative when this reflects the reality may result in an overestimation of responses (Boyle et al. ).
Other strengths included exploring heterogeneity of responses, and the mixed logit model (MLM) allowed statistical investigation of how preferences varied across groups. Information on variation (heterogeneity) of preferences is recognised as an important aspect when integrating patient views into decision making (de Bekker-Grob et al. ). A MLM was applied to the data as it is commonly used to analyse multiple choice health care data (de Bekker-Grob et al. ), although alternative models, such as the latent class model, could also be adopted (Hensher et al.  Hensher and Greene ). Our modelling study also confirmed the importance of exploring preference variation across groups to better understand and implement innovative services on offer. Patient knowledge of the condition and treatment experience might provide more informed choice.
A limitation is that participants in this study are unlikely to have experienced topical imiquimod, thus we could not assess how previous imiquimod experience influenced their preferences (including the risk of possible reactions/side effects to the treatment), whereas we could at least partly with surgical excision as some had already experienced it for a previous BCC. It would have been informative to analyse the DCE further, for example, comparing any changes in patient preferences later in the study after experiencing surgery or imiquimod cream. Also, patients with both nodular and superficial BCC were included in the current analysis. Future studies could aim to collect larger sample sizes to perform a subgroup analysis according to the type of BCC affecting the patients. Time constraints did not allow us to further inform the decision on the choice of the attributes and their levels with patient interviews and focus groups. Other attribute levels (e.g. different levels for the cost attributes pending on the specific treatment compared) could be considered for future exercises and informed by trial economic evaluation.
Although our 95% overall response rate was high, respondents in this DCE survey might not have been representative of all BCC patients because they are all participants in the SINS trial, who by definition are more equipoise and willing to consider both options of ‘imiquimod cream’ and alternative ‘surgery’ intervention; also it is not a random sample. Most patients (with or without previous surgical experience) who had a strong preference for a status quo approach with surgical excision would probably not have chosen to participate in the SINS trial, and therefore their preferences were not captured by this DCE survey. Of those choosing not to take part in the study 48% (126/265) gave the reason as wanting to have surgery. A further seven dropped out of the study after randomisation because they did not want surgery.
The DCE can provide very useful information, but the completion difficulties and time taken in this elderly population (median age 68, up to a maximum of 92 years) are not to be underestimated – many found it difficult to understand the concept of choosing between hypothetical situations and hence took up to an hour to complete. The research nurse helped them to understand what they had to do. The results showed, however, consistency of answers, suggesting that participants were not just making random choices. DCE surveys will benefit from providing participants with help and support from experienced research staff during questionnaire completion if needed.
Although this research refers to a representative group of mainly elderly patients in the UK with low risk BCC, our findings of attitudes and preference to treatment options may not be generalisable to other countries and ethnic groups. It is also important to emphasise the low risk nature of this BCC population. The trade-off between clearance and cosmetic results in recurrences of aggressive tumours for example is likely to be different from those observed in this study population.
Understanding how people with BCC value alternative interventions using the DCE technique may better inform the development of health care interventions, although this particular application proved data collection to be challenging and time consuming; elderly participants are likely to need help and support.
Alternative specific constant
Basal cell carcinoma
Discrete choice experiment
Mixed logit model
Surgery vs. imiquimod in nodular and superficial basal cell carcinoma
Willingness to pay
Versus or compared with.
Many thanks to Cancer Research UK for providing the grant (C7484/A2869) from which the DCE was funded. Cancer Research UK did not have any part in study design or the writing of the manuscript, or the decision to submit the manuscript for publication.
We wish to thank Prof. Mandy Ryan for her initial advice on the Discrete Choice Experiment (DCE) approach, and providing our contact with Dr Tinelli. Thanks also to Dr Paul Miller for the idea of evaluating patient treatment preferences in BCC using conjoint analysis (later changed to the DCE approach), and to the SINS team for their input to the SINS clinical trial which this experiment was part of.
Centre of Academic Primary Care and Health Economics Research Unit, University of Aberdeen
Centre of Evidence Based Dermatology, University of Nottingham
Telfer N, Colver G, Morton C: Guidelines for the management of basal cell carcinoma.Br J Dermatol 2008, 159: 35–48. 10.1111/j.1365-2133.2008.08666.xPubMedView Article
Weston A, FitzGerald P: Discrete choice experiment to derive willingness-to-pay for methyl aminolevulinate photodynamic therapy versus simple excision surgery in the treatment of basal cell carcinoma.PharmacoEconomics 2004, 22: 1195–1208. 10.2165/00019053-200422180-00004PubMedView Article
Essers BAB, Van Helvoort-Postulart D, Prins MH, et al.: Does the Inclusion of a Cost Attribute Result in Different Preferences for the Surgical Treatment of Primary Basal Cell Carcinoma?: A Comparison of Two Discrete-Choice Experiments.PharmacoEconomics 2010, 28: 507–520. 10.2165/11532240-000000000-00000PubMedView Article
Ryan M, Gerard K, Amaya-Amaya M: Using Discrete Choice Experiments to Value Health and Health Care. New York: Springer Berlin Heidelberg; 2008.View Article
Ozolins M, Williams HC, Armstrong SJ, Bath-Hextall FJ: The SINS trial: A randomised controlled trial of excisional surgery versus imiquimod 5% cream for nodular and superficial basal cell carcinoma.Trials 2010, 11: 42. 10.1186/1745-6215-11-42PubMedPubMed CentralView Article
Wordsworth S, Ryan M, Skåtun D, Waugh N: Women's preferences for cervical cancer screening: A study using a discrete choice experiment.Int J of Technol Assess in Health Care 2006,22(3):344–350.View Article
Marshall DA, Johnson FR, Phillips KA, et al.: Measuring Patient Preferences for Colorectal Cancer Screening Using a Choice-Format Survey.Value in Health 2007, 10: 415–430. 10.1111/j.1524-4733.2007.00196.xPubMedView Article
Kruijshaar ME, Essink-Bot ML, Donkers B, et al.: A labelled discrete choice experiment adds realism to the choices presented: preferences for surveillance tests for Barrett esophagus.BMC Medical Research Methodology 2009, 9: 31. 10.1186/1471-2288-9-31PubMedPubMed CentralView Article
Van Dam L, Hol L, De Bekker-Grob EW, et al.: What determines individuals' preferences for colorectal cancer screening programmes? A discrete choice experiment.Eur J Cancer 2010, 46: 150–159. 10.1016/j.ejca.2009.07.014PubMedView Article
Hol L, De Bekker-Grob EW, vanDam L, et al.: Preferences for colorectal cancer screening strategies: a discrete choice experiment.Br J Cancer 2010, 102: 972–980. 10.1038/sj.bjc.6605566PubMedPubMed CentralView Article
Salkeld G, Ryan M, Short L: The veil of experience: do consumers prefer what they know best?Health Econ Letters 2000, 9: 267–270. 10.1002/(SICI)1099-1050(200004)9:3<267::AID-HEC511>3.0.CO;2-HView Article
Ryan M, Ubach C: Testing for an experience endowment effect in health care.Appl Econ Letters 2003, 10: 407–410. 10.1080/1350485032000056864View Article
Cheraghi-Sohi S, Bower PJ, Mead NJ, et al.: Making sense of patient priorities: applying discrete choice methods in primary care using ‘think aloud’ technique.Fam Pract 2007, 24: 276–282. 10.1093/fampra/cmm007PubMedView Article
Eberth B, Watson V, Ryan M, et al.: Does one size fit all? Investigating heterogeneity in men's preferences for benign prostatic hyperplasia treatment using mixed logit analysis.Med Decis Making 2009, 29: 707–717. 10.1177/0272989X09341754PubMedView Article
De Bekker-Grob EW, Ryan M, Gerard K: Discrete choice experiments in health economics: a review of the literature. In Health Economics. published online in Wiley online library (wileyonlinelibrary.com); 2010. 10.1002/hec.1697.
Gafni A: Willingness-to-pay as a measure of benefits: relevant questions in the context of public decision making about health care programs.Med Care 1991, 29: 1246–1252. 10.1097/00005650-199112000-00007PubMedView Article
Tinelli M, Ryan M, Bond C: Patient preferences for an increased pharmacist role in the management of drug therapy.Int J Pharm Pract 2009, 17: 275–282. 10.1211/ijpp.17.05.0004PubMedView Article
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.