Consumer access to health information on the internet: health policy implications
© Scott et al; licensee BioMed Central Ltd. 2005
Received: 30 March 2005
Accepted: 28 June 2005
Published: 28 June 2005
Providers of health care usually have much better information about health and health care interventions than do consumers. The internet is an important and rapidly evolving source of global health-related information and could provide a means of correcting for asymmetric information. However, little is known about who accesses this information and how it is used in New Zealand.
The aims of this research were to: determine the nature of the health information sought, how respondents use the information, how helpful they perceive the information to be, and the self-assessed value of such information.
The researchers conducted an anonymous five minute telephone and mall intercept survey of randomly selected Wellington residents who had searched for health-related information on the internet. Investigators entered the data into an Excel spreadsheet and transferred it to SPSS for data cleaning, data exploration and statistical analysis. Search time costs were based on the opportunity cost of income foregone and respondents were asked to provide a money value for the information found.
Eighty-three percent of respondents accessed the internet from home, and 87% conducted the search for themselves. Forty-five percent of people were looking for general health and nutrition information, 42% for data about a specific illness and 40% for a medicine.
After finding the information, 58% discussed it with a family member/ friend/ workmate, 36% consulted a general practitioner, 33% changed their eating or drinking habits, and 13% did nothing. Respondents found the information very quick to find and useful. It took them on average 0.47 hours and cost $12 (opportunity cost of time) to find the information. The average value of the data found was $60 and the net benefit to the consumer was $48 ($60 – $12).
The results of this research could assist providers of health information via the internet to tailor their websites to better suit users' needs. Given the high perceived value of internet health information (greater than the average general practitioner fee) and the fact that some of the information found may be unreliable or even unsafe a valuable public health policy initiative would be to provide an improved New Zealand health information website containing information on how to evaluate data sourced from the world-wide-web and links to a range of useful and trustworthy health information sites.
Asymmetric information is the term used to describe a situation where different decision makers have different information. Providers of health care usually have much better information about health and health care interventions than do consumers. Health care is frequently provided under asymmetric information conditions [1–3] and providers may capture the market and disadvantage consumers. Asymmetric information is a serious cause of market failure and has attracted the attention of some of the world's leading economists .
Uncontrolled and unregulated free markets may fail to yield the optimal outcome for society (with respect to society's goal of allocative efficiency). If markets are not efficient and if markets do not exist for all goods, the "invisible hand"  of the market place will not maximise social welfare. Welfare is maximised only when marginal social benefit and marginal social cost are equated in all markets.
Correcting for market failure caused by imperfect information is a common reason for government intervention in markets. However, frequently the costs of government regulation and control outweigh the benefits and there is a danger that in attempting to fix one problem others may be created or magnified . In addition, some government intervention may be justified but too much is inefficient (as government intervention increases the marginal costs of intervention will eventually become greater than the marginal benefits).
The internet is an important and rapidly evolving source of global health-related information. Health information is one of the most commonly searched topics on the internet  but little is known about who accesses this information in New Zealand and how it is used.
New Zealand has a high proportion of internet users. At the end of 2004, 60% of the population were internet users [8, 9]. Fifty-three percent of households in Wellington City have access to the internet compared with 34% for New Zealand as a whole . International comparisons in 2003 show New Zealand had 5263 internet users per 10,000 population compared with 5667 in Australia, 5514 in the US, 5128 in Canada and 4231 in UK .
If the quality of information provided on the internet could be evaluated and if consumers found such information useful the internet could provide a partial low cost solution to the problems of asymmetric information. Accordingly, the aims of this research were to; determine the nature of the health information sought, how respondents use the information, how helpful they perceive the information to be, and the self-assessed value of such information.
A pilot questionnaire was developed, tested and refined using a small number of respondents. Quantitative data was collected using a mix of telephone and face-to-face mall intercept interviews . Mall intercept interviews were conducted in the central city business district and in a range of large suburban shopping centres. Two data collection modalities were adopted to reduce bias and widen the target audience. Both methods enabled the interviewer to discuss and elaborate on the questions and to probe for clear answers. The survey was conducted in Wellington, New Zealand during November and December 2004. Selection criteria for the survey were that respondents must be over the age of 15 years and have searched the internet for health-related information.
The questionnaire asked who would use the information, the type of data sought, actions taken as a result of the search, health professionals recommending an internet search, search time, usefulness, value of the information, search location and demographics (gender, age and income). Age and gender breakdowns for the Wellington region were obtained from Statistics New Zealand . Income classifications were the current New Zealand personal income tax brackets.
Usefulness of information found was assessed on a five point rating scale (1 no use at all, 2 somewhat useful, 3 useful, 4 very useful, and 5 extremely useful) and although reference or tie points were described, respondents were not restricted to whole numbers. The perceived benefits of the information found were quantified by asking respondents to provide a money value for the data uncovered. Search costs were assessed from the income of each respondent and search time (cost = search time multiplied by annual income divided by 47 working weeks divided by 40 hours per week). Costs concerned with ownership of computing equipment and access to the internet were regarded as sunk and thus not relevant to the incremental cost of obtaining information. It was assumed that respondents would have 47 working weeks (New Zealand employment legislation provides for 3 weeks annual leave and 2 weeks statutory holidays) and would work 40 hours per working week. Income for the group under $38,000 was assumed to be $18,999 (mid point of range), income group $38,000 to $60,000 was $49,000 (mid point of band), and income for group over $60,000 was assigned $80,000.
After editing and coding, data were entered into an Excel  spreadsheet and transferred to SPSS 12.0.1 for Windows  for detailed statistical analysis. Descriptive statistics were calculated for all variables and where appropriate, confidence intervals were estimated and F, t, and Chi-square tests applied to the data.
Sensitivity analysis was conducted by altering the magnitude of the perceived value, annual income and search time, and recording the effect on net benefits. This was necessary because some respondents may not have been able to accurately estimate search time and value, and income estimates were subject to error as income data was collected in the form of taxation income brackets rather than specific values.
Sample demographics of those who had searched the internet for health information
16 to 25 years
26 to 45 years
46 to 65 years
Over 65 years
Chi-square value 1.03, probability that the population and sample are the same 0.79.
Chi-square value 0.9, probability that the population and sample are the same 0.34.
$38,000 to $60,000
Person for whom search undertaken
Friend/ neighbour/ workmate
Type of health information sought by search time, value and usefulness
General health and nutrition
A specific illness
Health product other than a medicine
Alternative medical treatment
Sports/ fitness related health
A second opinion
There were no statistically significant differences between income groups and genders for the mean values of search time and usefulness score. However, with respect to age there was a highly statistically significant difference for the mean search time (p < 0.001 analysis of variance F value 18.1). Search time increased with age: the over 65 years age group took 0.75 of an hour compared with 0.3 hours for the 16 to 25 years group. Usefulness scores were not statistically different between age groups. In only 22% of cases did a health professional (general medical practitioner, medical specialist, pharmacist, nurse, midwife, physiotherapist, osteopath, chiropractor, dentist or alternative health practitioner) suggest an internet website (general practitioner 9% and all others combined 13%).
Action taken by search time, value and usefulness
Number taking action
Talked to family member, friend, neighbour, or workmate
Contacted general medical practitioner
Changed eating and/or drinking habits
Bookmarked the website for future reference
Bought a health product from a health store
Bought a medicine or medical product from a pharmacist
Contacted medical specialist
Gave up smoking
Contacted alternative health practitioner
Contacted osteopath or chiropractor
Advice of health professional more likely to be followed
Contacted support group
Bought a medicine or medical product over the internet
Contacted nurse/ midwife
Net benefit of the information found
Results from the survey
N = 92
95% confidence interval
Value score (# 1 to 5)
Search time (hours)
Cost ($) (b)
Net benefits change from base case
Each of the following increased by 10% holding all else constant
Search time (hours)
Changing the valuation of benefits by 10% (holding all else constant) produced a 12% change in net benefits, while changing either of the cost components (search time and annual income) by 10% resulted in a 2% change in net benefits (table 6).
As almost all households have a telephone  random dialling should have produced a representative sample. However, the growth in telephone marketing and requests to support charities has increased citizen resistance to participation in a telephone survey which will have added some non-respondent bias. The survey was undertaken in Wellington and although the sample appeared to be over-represented by females and those people in the 26 to 45 years age group compared with Wellington data the differences did not indicate serious bias in the sample as they were not statistically significant (at the p = 0.05 level, Chi-square test). However, this does not prove that the sample is unbiased. We have no statistical data on those who refused to take part in the survey or those who had not searched the internet for health information.
The telephoned group had greater numbers than expected in the older age groups than the mall intercept respondents (Chi-square p < 0.05). Early evening (between 6 PM and 9 PM and Sunday afternoons were the best periods for the telephone survey, while the mall intercept interviews were conducted during the day. We consider the two data collection modes combined, captured a more representative sample than one mode alone. No other statistically significant differences between survey modes were found.
Although unavailability of data precluded an investigation of differences in income and educational status between the sample and the general population, international studies suggest that users of the internet have higher incomes and are younger than the general population. US and Australian researchers have found that those using the internet to find health information tended to be younger, were better educated, and had higher incomes than non-users [18–22].
The Wellington study sample is not necessarily representative of New Zealand as a whole. Wellington has higher income levels, lower unemployment, younger average age and higher levels of education than the rest of the country. Households in Wellington have greater access to the internet than other households in New Zealand . The cost of a GP consultation in Wellington is probably higher than the New Zealand average but this was unable to be quantified as Wellington specific data were not available.
Most of our sample (83%) searched for information at home compared with 33% at work. A British survey  also found that most people (66%) searched the internet at home for health information and 28% from work. As personal use of the internet is discouraged in most work places and given the sensitive nature of some of the information sought it was not unexpected that most searches were conducted in the privacy of the home and that the information was for either themselves or a family member. The American Medical Association  note that personal privacy is the most important concern of users of medical information websites.
The top scoring search topic was general health and nutrition followed by information on a specific illness. Broadly similar results are reported in the international literature [7, 24–27]. Very few health professionals had suggested a website to respondents.
Respondents valued the information highly (more than a general practitioner consultation), generally found it useful, and most took some action as a result of the knowledge gained. The three most frequent actions taken after finding the relevant information related to, talking with someone, changing some aspect of lifestyle or consulting a mainstream medical or health professional. A low proportion of searchers (13%) did nothing. A US study found that 59% of users of the internet for health information did not discuss the findings with their doctor, but those that did valued the information more highly than those that did not . Australian research  found that 19% of searchers used the information as a second opinion, 16% discussed it with their doctor or pharmacist and 11% changed the way in which they managed their healthcare. Research in the UK  found that 93% of searchers found the information useful, 57% took some action to improve their health (mainly lifestyle changes), and 51% found information not provided by their doctor.
Our study is unique in that we asked Wellington respondents to assign a money value to the information found. The main limitations of our research are that respondents could have had difficulty in accurately recalling and estimating search times and values. Other limitations of the study were our inability to obtain precise income information (rather that income tax bands) and uncertainty that the sample was representative of the population that has used the internet to search for health information. We assumed that the value respondents assigned to information found could be used as a proxy for willingness to pay, and that the time costs of a search could be estimated from income levels. Sensitivity analysis revealed that net benefits of the information were sensitive to changes in the value of benefits but not to cost changes.
Although respondents stated that as a result of the information found they had made lifestyle or health related changes it is not known if these actions resulted in improved health outcomes and quality of life . With the exception of clearly beneficial lifestyle changes such as reduced consumption of alcohol and tobacco, more information would be necessary to evaluate the health impact of the actions taken.
The internet is rapidly evolving, transcends national borders, and is not owned and cannot be controlled by any one country or individual. Dissemination of information via the internet is potentially lower cost than through traditional media. Content can be quickly updated and instantaneously published to the world-wide-web. However, the quality and unbiased nature of the information accessible on the world-wide-web cannot be guaranteed, and consumers may be unable to make an informed choice based on this information alone.
Poor quality information and advice on the world-wide-web, if followed, could be deleterious to health. Harm to individuals and wastage of health care resources may be caused through non compliance with health care professionals' advice, inappropriate/over/under treatment. Good quality information may however improve understanding of illness, increase compliance and reduce waste.
Internet health information: characteristics, consequences of information quality and suggested criteria for an "official" health information website
Characteristics of internet information
• Rapidly evolving and uncontrolled growth of information
• Transcends international borders
• Is not owned and cannot be controlled by any individual, organisation or country
• Inability to restrict consumer access
• Quality of information is varied and cannot be guarantied
• High cost of constructing and maintaining a comprehensive and user friendly government health information website
• Potentially lower cost of information dissemination in comparison with traditional media
• Timeliness, in that information can be updated, inserted or deleted quickly
Poor quality information may result in:
• Non compliance with treatment recommendations of healthcare professionals that may incur additional costs of wasted healthcare resources and harm to consumers
• Inappropriate / over/ under treatment any of which could lead to additional cost and/ or harm
• Possible misinformation through lack of quality assurance
Quality information should result in:
• Improved understanding
• Improved compliance
• Reduced waste
Criteria for a country wide "official" health information website:
• Should provide:
• Up to date information on treatment options and prevention for common illnesses
• Links to useful and reputable websites irrespective of website owner
• Guidelines for evaluating information quality
• Contact for support groups
• Should not:
• Be all embracing and contain too much information
• Contain jargon and unfamiliar language
• Be biased towards a particular provider or funding agency
Our research has shown that consumers value the internet as a health information source and use the information found to formulate future health and lifestyle strategies. An improved national health information website should be developed. However, more data on the information needs and Website preferences of stakeholders in the health care system (providers, funders and consumers) and impact on health outcomes are required to provide the information necessary to design such a website. Ideally this needs assessment should be publicly funded and not be conducted by any of the providers or funding agencies.
Note on exchange rates
Mid rates end December 2004, Reserve Bank of New Zealand, NZ$1 = A$0.9315 and USA$0.7142
We are grateful to Massey University for funding the study, Patrick Rennell for interviewing and data entry and a number of our colleagues for encouragement and comments on drafts of this paper.
- Stiglitz JE: Economics of the public sector. Economics of the public sector. Edited by: Stiglitz JE. 1999, NY , NortonGoogle Scholar
- Arrow KJ: Uncertainty and the welfare economics of medical care. American Economic Review. 1963, 53: 941-973.Google Scholar
- Scott WG: Public policy failure in health care. The Journal of American Academy of Business, Cambridge, Fl. 2004, 5 (1&2): 88-94.Google Scholar
- The Royal Swedish Academy of Sciences: The 2001 Bank of Sweden Prize in Economic Sciences in memory of Alfred Nobel - information for the public. [http://nobelprize.org]
- Smith A: The wealth of nations. Edited by: . 1991, London , Everyman
- Shmanske S: Information asymmetrics in health services the market can cope. The Independent Review. 1966, 1 (2): 191-200.Google Scholar
- Nicholas D, Huntington P, Gunter B, Russel C, Withey R: The British and their use of the Web for health information and advice: a survey. Aslib Proceedings: new information perspectives. 2003, 55 (5): 261-276. 10.1108/00012530310498842.View ArticleGoogle Scholar
- Research and Markets: NZ Net users on the rise. The Dominion Post. 2005, c2-Google Scholar
- Statistics New Zealand: New Zealand population clock. [http://www.stats.govt.nz/people/default.htm]
- Statistics New Zealand: Wellington City Census 2001. [http://www.stats.govt.nz]
- International Telecommunication Union: Internet indicators: Hosts, Users and Number of PCs. p 1-3. [http://www.itu.int/ITU-D/ict/statistics/]
- Zikmund WG: Business research methods. 2000, Fort West , Harcourt Brace College PublishersGoogle Scholar
- Statistics New Zealand: 2001 Census: Regional Summary . [http://www.stats.govt.nz]
- Microsoft Corporation: Microsoft Excel. [http://www.microsoft.com]
- SPSS Inc: Statistical Package for the Social Sciences. [http://www.spss.com]
- Statistics New Zealand: Consumers price index, GP services - consultation, adult without community services card. Hot Off the Press. 2004Google Scholar
- Statistics New Zealand: Household access to the internet. Key Statistics. 2004Google Scholar
- Smith-Barbaro PA, Licciardone JC, Clarke HF, Coleridge ST: Factors associated with intended use of a Web site among family practice patients. J Med Internet Res. 2001, 3 (2): E17-10.2196/jmir.3.2.e17.PubMed CentralView ArticlePubMedGoogle Scholar
- Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, Moulton AW: Patients' use of the Internet for medical information. J Gen Intern Med. 2002, 17 (3): 180-185. 10.1046/j.1525-1497.2002.10603.x.PubMed CentralView ArticlePubMedGoogle Scholar
- Salo D, Perez C, Lavery R, Malankar A, Borenstein M, Bernstein S: Patient education and the Internet: do patients want us to provide them with medical web sites to learn more about their medical problems?. J Emerg Med. 2004, 26 (3): 293-300. 10.1016/j.jemermed.2003.09.008.View ArticlePubMedGoogle Scholar
- Cotten SR, Gupta SS: Characteristics of online and offline health information seekers and factors that discriminate between them. Soc Sci Med. 2004, 59 (9): 1795-1806. 10.1016/j.socscimed.2004.02.020.View ArticlePubMedGoogle Scholar
- Bessell TL, McDonald S, Silagy CA, Anderson JN, Hiller JE, Sansom LN: Do Internet interventions for consumers cause more harm than good? A systematic review. Health Expect. 2002, 5 (1): 28-37. 10.1046/j.1369-6513.2002.00156.x.View ArticlePubMedGoogle Scholar
- American Medical Association: Guidelines for medical and health information sites on the internet. [http://www.ama-assn.org/ama/pub/category/1905.html]
- Dickerson S, Reinhart AM, Feeley TH, Bidani R, Rich E, Garg VK, Hershey CO: Patient Internet use for health information at three urban primary care clinics. J Am Med Inform Assoc. 2004, 11 (6): 499-504. 10.1197/jamia.M1460.PubMed CentralView ArticlePubMedGoogle Scholar
- Escoffery C, Miner KR, Adame DD, Butler S, McCormic L, Mendell E: Internet use for health information among college students. Journal of American College Health. 2005, 53 (4): 183-188.View ArticlePubMedGoogle Scholar
- Hanauer D, Dibble E, Fortin J, Col NF: Internet use among community college students: implications in designing healthcare interventions. J Am Coll Health. 2004, 52 (5): 197-202.View ArticlePubMedGoogle Scholar
- Spink A, Yang Y, Jansen J, Nykanen P, Lorence DP, Ozmutlu S, Ozmutlu HC: A study of medical and health queries to web search engines. Health Info Libr J. 2004, 21 (1): 44-51. 10.1111/j.1471-1842.2004.00481.x.View ArticlePubMedGoogle Scholar
- Thompson KM: Health insight: a consumer's guide to taking charge of health information. [http://www.health-insight.com]
- Kim P, Eng TR, Deering MJ, Maxfield A: Published criteria for evaluating health related websites: review. British Medical Journal. 1999, 318: 647-649.PubMed CentralView ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.