You are here

  • Home
  • Archive
  • Volume 25, Issue 1
  • Completeness and accuracy of anthropometric measurements in electronic medical records for children attending primary care

Article Text

Article menu

Download PDFPDF

XML
Research article
Completeness and accuracy of anthropometric measurements in electronic medical records for children attending primary care
  1. Sarah Carsley,
  2. Catherine S. Birken,
  3. Patricia C. Parkin,
  4. Eleanor Pullenayegum and
  5. Karen Tu
  1. Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada and Child Health Evaluative Sciences, Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada
  2. Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada, Child Health Evaluative Sciences, Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada and Department of Paediatrics Medicine, University of Toronto, Toronto, ON, Canada
  3. Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada, Child Health Evaluative Sciences, Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada and Department of Paediatrics Medicine, University of Toronto, Toronto, ON, Canada
  4. Child Health Evaluative Sciences, Hospital for Sick Children, Peter Gilgan Centre for Research and Learning, Toronto, ON, Canada
  5. Department of Family and Community Medicine, University of Toronto, Toronto, ON, Canada, Institute for Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada, and Toronto Western Hospital Family Health Team, University Health Network, Toronto, ON, Canada
  1. Author address for correspondence: Sarah Carsley Child Health Evaluative Sciences Hospital for Sick Children Peter Gilgan Centre for Research and Learning Toronto, ON M5G 0A4, Canada sarah.carsley{at}sickkids.ca

Abstract

Background Electronic medical records (EMRs) from primary care may be a feasible source of height and weight data. However, the use of EMRs in research has been impeded by lack of standardisation of EMRs systems, data access and concerns about the quality of the data.

Objectives The study objectives were to determine the data completeness and accuracy of child heights and weights collected in primary care EMRs, and to identify factors associated with these data quality attributes.

Methods A cross-sectional study examining height and weight data for children <19 years from EMRs through the Electronic Medical Record Administrative data Linked Database (EMRALD), a network of family practices across the province of Ontario. Body mass index z-scores were calculated using the World Health Organization Growth Standards and Reference.

Results A total of 54,964 children were identified from EMRALD. Overall, 93% had at least one complete set of growth measurements to calculate a body mass index (BMI) z-score. 66.2% of all primary care visits had complete BMI z-score data. After stratifying by visit type 89.9% of well-child visits and 33.9% of sick visits had complete BMI z-score data; incomplete BMI z-score was mainly due to missing height measurements. Only 2.7% of BMI z-score data were excluded due to implausible values.

Conclusions Data completeness at well-child visits and overall data accuracy were greater than 90%. EMRs may be a valid source of data to provide estimates of obesity in children who attend primary care.

  • electronic health records
  • child
  • body mass index
  • data accuracy
  • obesity

Commons license http://creativecommons.org/licenses/by/4.0/

https://doi.org/10.14236/jhi.v25i1.963

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    INTRODUCTION

    The use of electronic medical records (EMRs) in primary health care has recently improved in Canada with estimates of physician uptake increasing from 37% in 2009 to 75% in 2015.1,2 Using primary care EMRs to measure, track and evaluate childhood obesity have been proposed for multiple reasons. First, children attend primary health care for well-child visits frequently in the first years of life.3 This time period has also been proposed as a critical period when prevention and early intervention strategies may be most effective.4 Second, it is a long-standing standard of care to measure children’s weight and height (or length for children younger than 2 years) at these visits, offering a potentially robust source of growth data.5,6 Finally, leveraging data from a previously established clinical infrastructure may be cost-effective7 and has been proposed in previous health policy recommendations.8

    To date, the use of primary care EMRs in research has been impeded by lack of standardisation of EMRs systems, data access and concerns about the quality of the data.9,10 However, research networks, such as the Canadian Primary Care Sentinel Surveillance Network11 and the Electronic Medical Record Administrative data Linked Database (EMRALD)12 in Canada, and the Electronic Pediatric Research in Office Settings (ePROS) network in the United States, have attempted to move EMR research forward by acting as an intermediary between primary care providers and researchers. Multiple studies have been published using these data sources to estimate both child and adult obesity rates.13–15 However, descriptions of data cleaning techniques are often insufficient to be reproduced, or are not reported.16 As well, height and weight data are often subject to error because of multiple units that may be used to record the measurement (centimeters, meters, inches, feet, kilograms and pounds), multiple decimal places and reversal of measurements (recorded weight as height and vice versa). Therefore, methods for determining data quality within these EMR networks are necessary to ensure that the derived prevalence estimates are accurate. The overarching goal of this study was to assess the feasibility of using anthropometric data from primary care EMRs to generate prevalence estimates of childhood obesity. The primary objective of this study was to assess data quality by examining data completeness and accuracy. The secondary objective was to examine factors that may be associated with these data quality attributes in order to develop recommendations on best practices for using routine EMR data.

    METHODS

    Data source/study population

    A cohort of children 0 to <19 years of age was identified from EMRALD, containing data from primary care family medicine practices in the province of Ontario.17 As of 2016, 355 physicians within 41 practices using PS Suite, the largest market share vendor of EMR in the province, contributed data to this study.18 EMRALD is housed at the Institute for Clinical Evaluative Sciences (ICES) which allows this research to comply with the Ontario Personal Health Information and Protection Act. This study was approved by the Sunnybrook Health Sciences and the Hospital for Sick Children research ethics boards.

    All EMRALD pediatric patient records as of March 31, 2016 were included based on two levels of inclusion criteria: 1) physicians had to be using their EMR for a minimum of 2 years and 2) patients had to be rostered to an active EMRALD physician, be less than 19 years old as of March 2016 and have a valid identification number to link with the administrative databases at ICES. Exclusion criteria included patients in the newborn period (<28 days old) where potential complications from birth could increase the number of growth measurements. Variables extracted from the EMR were height/length, weight, date of measurement, sex, age at measurement and the number of years the physician has been using EMR.

    Completeness

    The primary outcome for this study was the presence of a complete set of data required to calculate age- and sex-standardised body mass index (BMI) z-score (zBMI) per primary care visit, including age at measurement, sex, height/length and weight. The presence of all four data points was recoded as a binary variable, representing a complete record. Data completeness was assessed for all visits as well as stratified by visit type, either well-child, sick visit or unknown.

    Accuracy

    Data accuracy was determined using two methods: 1) the proportion of biologically implausible values (BIVs) and 2) assessing potential invalid inliers using repeated measurements on the study subsample with ≥3 zBMI measurements. BIVs were defined by a validated algorithm19 and the World Health Organization (WHO) Expert Committee20 as z-scores for BMI-for-age < −5.0 to > +5.0, height-for-age < −6.0 to > +6.0, weight-for-age < −6.0 to > +5.0 (0–10 years of age), weight-for-length < −5.0 to > +5.0 (0–5 years of age).21 Measurement data extracted from EMRALD are numeric values with up to two decimal places and no associated units. Weight is stored by default in kilograms and height in centimeters. If the physician enters units in the EMR as pounds or feet/inches, the value is automatically converted to kilograms and centimetres when the data is extracted from the EMR. If no unit is written, it is assumed that the data are recorded as kilograms and centimetres.

    To identify invalid inliers, defined as potential data errors within the clinically acceptable range, we investigated those subjects with ≥3 zBMI measurements. The mean and standard deviation of zBMI were calculated for each subject as well as the time interval between measurements. Standardised differences (SD) were calculated by subtracting the mean zBMI per subject from each measurement divided by the standard deviation. For children <12 months, we used a rule if one measurement was more than ±2.5 SDs (where SD is the SD of the individual’s measurements) of a measurement within 3 months, or for children ≥12 months more than ±3 SD of a measurement within 6 months, it would be flagged as implausible. This rule, henceforth referred to as the ‘invalid inlier rule’, was tested on a subsample of patients with known correct and incorrect zBMI values (verified through chart review), and found a sensitivity to detect true errors of 100% and a specificity of 28.3%. Previous studies have applied similar rules to their study populations with repeated measurements.16,22

    Factors associated with data quality

    We assessed clinic, physician and patient level factors to determine what characteristics may have affected completeness or accuracy of data. Clinic level factors examined included the size of practice (number of rostered patients) and proportion of pediatric patients (number of pediatric patients divided by practice size). The physician level factor is years the physician has been using EMRs. It was previously shown that it takes approximately 2 years for a physician to adequately populate the EMR records for their practice.12 Patient level factors examined were age and sex. Visit type was determined by linking growth data to the Ontario Health Insurance Plan (OHIP) database to determine the visit-code billed on the corresponding date of measurement. Well-child visits were coded using fee codes and diagnostic codes defined by ICES3 and are available in Supplementary Table 1. Since standard of care is to measure children for both height and weight during well-child visits, the factors affecting data completeness analysis were modelled only for well-child visits.

    View this table:
    Table 1 Baseline characteristics of EMRALD patients

    Statistical analysis

    Descriptive statistics were performed for all variables to determine distributions and to create the main outcome variables. Baseline characteristics between children in EMRALD and all Ontario children, from administrative data holdings at ICES, were compared. The data completeness variable was first created by identifying each record with a missing height, weight, age or sex. This data were then linked to the OHIP database to identify which measurement records were taken at a well-child visit, sick visit or unknown. A large number of well-child visits occur during the first years of life due to scheduled immunisations;23 therefore, the age by visit type interaction terms for data completeness were tested using a p-value for statistical significance of <0.05. Previously published rules to identify BIVs in EMRs19 were applied, followed by the WHO flags for weight-for-age, height-for-age or BMI-for-age. All those patients with three or more zBMI measurements within −5 and +5 SD were assessed using the ‘invalid inlier rule’. All records identified using these rules were recoded as inaccurate values. Proportions and 95% confidence intervals (CIs) were calculated for data completeness and accuracy.

    A generalised linear mixed model (GLMM) was used to examine the effect of patient, physician and practice factors on the data completeness and accuracy. The multiple repeated measurements of patients (level 3) were clustered within physician (level 2), within practice (level 1) required the use of a multilevel model to account for correlated data, which was specified as unstructured. A null model with random intercept was run initially to determine the amount of level-1 error variation attributable to the multiple practices providing data and an inter-class correlation coefficient was calculated.24 A full model was run with all patient, physician and practice variables. All potential explanatory variables were selected a priori based on the literature and expert advice. All statistical calculations were performed using SAS Enterprise version 7.1 (SAS Institute, Cary, NC, USA).

    RESULTS

    A total of 54,694 children 0 to <19 years of age were identified from the EMRALD database contributing a total of 385,767 visits. Table 1 presents baseline characteristics of the patient, physician and practice level characteristics. The number of years physicians used the EMR ranged from 3 months to 25 years and the proportion of pediatric patients in a family practice ranged from 8% to 29%. Group practice size was categorised into small (<5000 patients), medium (5000–10,000) and large (>10,000) and accounted for 15 (36.6%), 14 (34.2%) and 12 (29.3%) practices, respectively. The EMRALD pediatric patients in this study were slightly younger than the overall Ontario pediatric population and were similar in sex distribution and neighbourhood income quintile. In total, 70.7% of visits were from children aged 0–4 years and 29.3% from children and adolescents aged 5 to <19 years. 38,694 visits were excluded due to age <28 days old which included birth weights and children requiring multiple weight checks in the first month of life. However, only 201 patients did not have any visits after 1 month of age and were excluded.

    Completeness

    Overall, 66.2% (95% CI 66.1%–66.4%) of all primary care visits had a complete set of measurements to calculate a zBMI on 51,385 (93.5%) patients. Table 2 breaks down the missing data by variable type and age group for all visits. Missing height measurements accounted for the majority of incomplete data with 111,188 visits (32.0%, 95% CI 31.9%–32.2%) missing height; only 6044 (1.7%, 95% CI 1.7%–1.8%) visits were missing weight. When measurements were stratified by visit type 50.1% of growth measurements occurred at well-child visits, 35.2% occurred at sick visits, and 14.7% of records were at an unknown visit type. The proportion of complete data from well-child visits was 89% and 34% for sick visits.

    View this table:
    Table 2 Data completeness by variable and age group

    Accuracy

    Table 3 shows the proportion of inaccurate data based on each method to assess accuracy. In total, 6261 (2.72%) observations were determined to be likely inaccurate values. The first BIV identification using previously published cut-offs found 0.3% of weights and 0.2% of heights outside the biologically plausible range. The number of BIVs based on the WHO for BMI-for-age was 5661, 90.4% of all errors. The second examination of the data for invalid inliers included 31,495 patients that had ≥3 measurements contributing 196,327 observations. After applying the invalid inlier rule, only 86 (0.04%) additional errors were found.

    View this table:
    Table 3 Data accuracy by each BIV method and age group

    Factors associated with data quality

    Interaction terms for age and visit type were statistically significant (p < 0.01). Therefore, models assessing factors associated with completeness were restricted to well-child visits and stratified into age <5 years and ≥5 years. In children 0 to <5 years of age attending well-child visits, for every 1 year increase in age the odds for having both a height and a weight were 33% (95% CI: 30%–36%) higher (see Table 4). Conversely, in children 5–19 years for every 1 year increase in age, the odds of having a complete height and weight was 2% (95% CI: 1%–4%) lower. Physicians that had been using the EMR longer had a marginally higher proportion of complete data. Larger clinics had 9% more complete data for every increase in 5000 patients in practice volume for younger children, however, 3% less complete data in older children. There was no significant difference between boys and girls. As well, examining the variation explained by practice cluster [level 1 null model inter-class correlation coefficient (ICC) = 14%–21%], there was significant variation in data completeness between practices for both age groups. Only the proportion of pediatric patients was statistically significant in the younger age group; however, clinical significance is debatable.

    View this table:
    Table 4 Factors associated with data completeness (probability modelled is complete data point = yes)

    Due to the size of the data set and the number of random effects, the clustered data models lost stability and failed to converge when using the entire sample. Therefore, a subset of 10,000 patients was randomly selected in each age group and used to examine the effects of the covariates. In young children <5 years, for every additional year of age, the odds of having accurate data were 15% (95% CI: 11%–19%) less likely (see Table 5). On the other hand, in children 5–19 years for every year of additional age, the odds of having accurate data was 11% (95% CI: 8%–13%) more likely. Physicians that had been using EMR longer had a marginally lower proportion of accurate data points in the young age group, and no significant difference in the older age group. Larger practices had 8% increased data accuracy for every increase in 5000 patients in practice volume for both age groups. Practice variation explained a similar amount of the variance (level 1 null model ICC = 14.5%–19.9%) as the models examining data completeness.

    View this table:
    Table 5 Factors associated with data accuracy (probability modelled is accurate data point = yes)

    DISCUSSION

    This study examined the data quality of anthropometric measurements extracted from primary care EMRs in Ontario. Overall, data completeness was 66.2% and accuracy was 97.3%. Incompleteness was predominantly due to the high proportion of missing height data (32%). When we examined data completeness for measurements collected only at well-child visits, the proportion of complete records increased to 89%.

    These results were similar to previous work on data completeness in EMRs. A study from Kaiser Permanente Colorado examined EMR data on children 3–17 years of age and reported 64% of patients had a BMI measurement at any primary care visit and >95% at well-child visits.25 Accuracy of data recorded in EMRs was also consistent with the previous literature. One study in children 3–5 years of age used a similar multi-step data cleaning strategy and only found 2% of data to be erroneous.22 Another study replicated 11 different methods for identification of potential errors and found the prevalence of data errors ranged from 0.3% to 2.1%.16

    The main factor that influenced data completeness and accuracy was child age. The direction and magnitude of the effect of age on data completeness at well-child visits changed when examining children separately by age group. This is likely due to the high number of well-child visits that occur in the first 2 years of life.23 Primary care providers who see young infants more often in the early years may not complete both a length and weight if the child had been seen recently. Moreover, measuring length of a child less than 2 years requires appropriate equipment, such as a length board, which may be a barrier to a complete growth assessment.26 Older children attending well-child visits in the 5–19 year age group had marginally higher data completeness. One reason may be because older children are less likely to attend well-child visits, height and weight measurements may be completed more often if the primary care provider had not seen the child in a longer time interval. Until recently the recommendations for growth monitoring applied to well-child visits only.5,6 In 2015, the Canadian Task Force on Preventive Health Care changed the recommendation to performing both height and weight measurements at all visits for primary and secondary prevention of obesity.27 Future analyses of EMR data will be able to assess the uptake of this recommendation.

    Similar to the findings on data completeness, the effect of age on data accuracy was highly significant and differed by age group. One possible reason for this discrepancy is the tendency of measuring infants in pounds and ounces instead of kilograms. Identifying age as a determinant of data accuracy is important for future uses of EMR to develop new data cleaning algorithms that capture multiple unit conversions, especially for the youngest age group where data is most abundant. Despite the differences in age, the high proportion of accurate data was encouraging. One advantage of using EMR data is the ability to examine multiple measurements on the same child.16,28 This not only aids the data cleaning process by being able to examine measurements before and after a suspect value, but it allows researchers to examine how the same population of children can change over time, including into adulthood.

    There were several limitations to this study. There may have been misclassification of the data accuracy outcome for several reasons. The lack of units for each numeric value for height and weight was problematic. Although most imperial system values were excluded in the assessment of BIVs, the prevalence of invalid inliers for subjects contributing only one or two measurements is unknown. In the WHO computer program, weight-for-age is not calculated beyond 10 years of age, making it harder to determine which outliers for zBMI data are from weight data in adolescents. The BIV cut-offs suggested by the WHO for calculation of zBMI may be too conservative and be incorrectly excluding those patients with extremely high zBMIs.29 One previous study demonstrated the BIV cut-offs from the WHO underestimated obesity prevalence30 and recently, the Center for Disease Control (CDC) changed their upper limit for BIVs from >+5 to >+8.31 To the best of our knowledge, there are no validated or standardised rules on plausible changes over time to differentiate true errors from correct values.32 More research is required to determine valid BIV cut-offs that can be used for large data sets that are becoming more available with improved health information databases. Lastly, the clinic size variable may have been underestimated for 13% of observations because in eight clinics not all physicians contribute data to the EMRALD network.

    The results from this study raise important considerations of the feasibility of using growth data from EMRs for public health and surveillance purposes. Visit type and age were important determinants for whether or not measurements were complete, specifically height. Previous research has shown a difference in zBMI between well-child and sick visits15; we found mean zBMI from sick visits to be significantly higher than well-child visits. It may also be likely that children who attend regular well-child care are systematically different than those who only attend when sick. Therefore, it is important to acknowledge possible selection biases that may be introduced when using data collected in routine primary care. Finally, our study population was skewed to be younger than Ontario rostered patients due to examining visits with growth data which are concentrated in children 0–4 years.

    The next step to improving the quality of this EMR data should include developing more sophisticated data cleaning for efficiently maximizing the available data. This includes determining visit type through machine learning text classification of physicians’ common ‘short-hand’ for indicating well-child visits in patient progress notes, validating correct BIVs for patients with severe obesity and determining implausible changes in height and weight over specific time intervals. Future research should develop and validate these data cleaning algorithms for large study populations in order for researchers to standardise techniques. However, despite the need for continuous evaluation of data quality, the current state of growth data was highly complete and accurate. EMRs are a good data source to characterise weight status in a large population of young children and may be useful in assessing uptake of recommendations or interventions related to childhood growth monitoring or obesity.

    Acknowledgements

    This study was supported by the Institute for Clinical Evaluative Sciences (ICES), which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care (MOHLTC). The opinions, results and conclusions reported in this paper are those of the authors and are independent from the funding sources. No endorsement by ICES or the Ontario MOHLTC is intended or should be inferred. Karen Tu is supported by a Research Scholar Award from the Department of Family and Community Medicine at the University of Toronto.

    References

    1. 1.↵
      1. Collier R
      . National physician survey: EMR use at 75%. Canadian Medical Association Journal de l’Association Medicale Canadienne 2015;187(1):E17–18.
      OpenUrl
    2. 2.↵
      1. Terry AL,
      2. Stewart M,
      3. Fortin M,
      4. Wong ST,
      5. Kennedy M,
      6. Burge F, et al
      . How does Canada stack up? A bibliometric analysis of the primary healthcare electronic medical record literature. Informatics in Primary Care 2012;20(4):233–40. doi:10.14236/jhi.v20i4.2pmid:23890334
      OpenUrlCrossRefPubMed
    3. 3.↵
      1. Guttman A,
      2. Schultz SE,
      3. Jaakkimainen L
      . Primary Care for Children. Toronto, ON: Institute for Clinical Evaluative Sciences, 2006
    4. 4.↵
      1. Woo Baidal JA,
      2. Locks LM,
      3. Cheng ER,
      4. Blake-Lamb TL,
      5. Perkins ME,
      6. Taveras EM
      . Risk factors for childhood obesity in the first 1,000 days: a systematic review. American Journal of Preventive Medicine 2016;50(6):761–79. Epub 2016 Feb 1022. doi:10.1093/j.amepre.2015.1011.1012
      OpenUrlCrossRefPubMed
    5. 5.↵
      1. Greig A,
      2. Constantin E,
      3. Carsley S,
      4. Cummings C
      . Preventive health care visits for children and adolescents aged six to 17 years: The Greig Health Record – Executive Summary. Paediatrics & Child Health 2010;15(3):157–62. doi:10.1093/pch/15.3.157pmid:21358896; pmcid:PMC2865953
      OpenUrlCrossRefPubMed
    6. 6.↵
      1. Rourke L,
      2. Leduc D,
      3. Constantin E,
      4. Carsley S,
      5. Rourke J
      . Update on well-baby and well-child care from 0 to 5 years: What’s new in the Rourke Baby Record?. Canadian Family Physician 2010;56(12):1285–90. pmid:21156890; pmcid:PMC3001919
      OpenUrlAbstract/FREE Full Text
    7. 7.↵
      1. Wood GC,
      2. Chu X,
      3. Manney C,
      4. Strodel W,
      5. Petrick A,
      6. Gabrielsen J, et al
      . An electronic health record-enabled obesity database. BMC Medical Informatics and Decision Making 2012;12:45. doi:10.1186/1472-6947-12-45pmid:22640398; pmcid:PMC3508953
      OpenUrlCrossRefPubMed
    8. 8.↵
      Healthy Kids Panel. No Time to Wait: The Healthy Kids Strategy 2013. Toronto, ON: Ministry of Health and Long-Term Care.
    9. 9.↵
      1. Greenhalgh T,
      2. Potts HW,
      3. Wong G,
      4. Bark P,
      5. Swinglehurst D
      . Tensions and paradoxes in electronic patient record research: a systematic literature review using the meta-narrative method. Milbank Quarterly 2009;87(4):729–88. doi:10.1111/j.1468-0009.2009.00578.xpmid:20021585; pmcid:PMC2888022
      OpenUrlCrossRefPubMedWeb of Science
    10. 10.↵
      1. Jensen RE,
      2. Chan KS,
      3. Weiner JP,
      4. Fowles JB,
      5. Neale SM
      . Implementing electronic health record-based quality measures for developmental screening. Pediatrics 2009;124(4):e648–54. doi:10.1542/peds.2008-3091pmid:19786425
      OpenUrlAbstract/FREE Full Text
    11. 11.↵
      1. Keshavjee K,
      2. Williamson T,
      3. Martin K,
      4. Truant R,
      5. Aliarzadeh B,
      6. Ghany A, et al
      . Getting to usable EMR data. Canadian Family Physician 2014;60(4):392. pmid:24733333; pmcid:PMC4046531
      OpenUrlFREE Full Text
    12. 12.↵
      1. Tu K,
      2. Widdifield J,
      3. Young J,
      4. Oud W,
      5. Ivers NM,
      6. Butt DA, et al
      . Are family physicians comprehensively using electronic medical records such that the data can be used for secondary purposes? A Canadian perspective. BMC Medical Informatics and Decision Making 2015;15:67. doi:10.1186/s12911-015-0195-xpmid:26268511; pmcid:PMC4535372
      OpenUrlCrossRefPubMed
    13. 13.↵
      1. Biro S,
      2. Williamson T,
      3. Leggett JA,
      4. Barber D,
      5. Morkem R,
      6. Moore K, et al
      . Utility of linking primary care electronic medical records with Canadian census data to study the determinants of chronic disease: an example based on socioeconomic status and obesity. BMC Medical Informatics and Decision Making 2016;16:32. doi:10.1186/s12911-12016-10272-12919
      OpenUrlCrossRef
    14. 14.
      1. Rigobon AV,
      2. Birtwhistle R,
      3. Khan S,
      4. Barber D,
      5. Biro S,
      6. Morkem R, et al
      . Adult obesity prevalence in primary care users: an exploration using Canadian Primary Care Sentinel Surveillance Network (CPCSSN) data. Canadian Journal of Public Health 2015;106(5):e283–89. doi:10.1093/cjph.17106.14508
      OpenUrlCrossRefPubMed
    15. 15.↵
      1. Birken CS,
      2. Tu K,
      3. Oud W,
      4. Carsley S,
      5. Hanna M,
      6. Lebovic G, et al
      . Determining rates of overweight and obese status in children using electronic medical records: cross-sectional study. Canadian Family Physician 2017;63(2):e114–22. pmid:28209703; pmcid:PMC5395409
      OpenUrlAbstract/FREE Full Text
    16. 16.↵
      1. Lawman HG,
      2. Ogden CL,
      3. Hassink S,
      4. Mallya G,
      5. Vander Veur S,
      6. Foster GD
      . Comparing methods for identifying biologically implausible values in height, weight, and body mass index among youth. American Journal of Epidemiology 2015;182(4):359–65. doi:10.1093/aje/kwv057pmid:26182944; pmcid:PMC4528955
      OpenUrlCrossRefPubMed
    17. 17.↵
      1. Tu K,
      2. Mitiku TF,
      3. Ivers NM,
      4. Guo H,
      5. Lu H,
      6. Jaakkimainen L, et al
      . Evaluation of Electronic Medical Record Administrative data Linked Database (EMRALD). The American Journal of Managed Care 2014;20(1):e15–21. pmid:24669409
      OpenUrlPubMedWeb of Science
    18. 18.↵
      OntarioMDCore EMR specifications, 2015. Available from: https://www.ontariomd.ca/portal/server.pt/community/ontario_emr_specifications/current_emr_specifications/. Accessed 31 January 2017.
    19. 19.↵
      1. Smith N,
      2. Coleman KJ,
      3. Lawrence JM,
      4. Quinn VP,
      5. Getahun D,
      6. Reynolds K, et al
      . Body weight and height data in electronic medical records of children. International Journal of Pediatric Obesity: An Official Journal of the International Association for the Study of Obesity 2010;5(3):237–42.
      OpenUrl
    20. 20.↵
      Physical status: the use and interpretation of anthropometry. World Health Organization Technical Teport Series 1995;854:1–452. Report of a WHO Expert Committeepmid:8594834
      OpenUrlPubMed
    21. 21.↵
      WHO. AnthroPlus for Personal Computers Manual: Software for Assessing Growth of the World’s Children and Adolescents. Geneva, Switzerland: WHO, 2009. Available from: http://www.who.int/growthref/tools/readme_sas.pdf?ua=1. Accessed 31 March 2016.
    22. 22.↵
      1. Lo JC,
      2. Maring B,
      3. Chandra M,
      4. Daniels SR,
      5. Sinaiko A,
      6. Daley MF
      . Prevalence of obesity and extreme obesity in children aged 3–5 years. Pediatric Obesity 2014;9(3):167–75. doi:10.1111/j.2047-6310.2013.00154.xpmid:23677690; pmcid:PMC3830709
      OpenUrlCrossRefPubMed
    23. 23.↵
      1. Guttmann A,
      2. Manuel D,
      3. Dick PT,
      4. To T,
      5. Lam K,
      6. Stukel TA
      . Volume matters: physician practice characteristics and immunization coverage among young children insured through a universal health plan. Pediatrics 2006;117(3):595–602. doi:10.1542/peds.2004-2784pmid:16510636
      OpenUrlAbstract/FREE Full Text
    24. 24.↵
      1. Snijders TA,
      2. Bosker RJ
      . Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling 20122ndLos Angeles, CA: Sage.
    25. 25.↵
      1. Estabrooks PA,
      2. Shetterly S
      . The prevalence and health care use of overweight children in an integrated health care system. Archives of Pediatrics & Adolescent Medicine 2007;161(3):222–7. doi:10.1001/archpedi.161.3.222pmid:17339502
      OpenUrlCrossRefPubMedWeb of Science
    26. 26.↵
      1. Wood AJ,
      2. Raynes-Greenow CH,
      3. Carberry AE,
      4. Jeffery HE
      . Neonatal length inaccuracies in clinical practice and related percentile discrepancies detected by a simple length-board. Journal of Paediatrics and Child Health 2013;49(3):199–203. doi:10.1111/jpc.12119pmid:23432733
      OpenUrlCrossRefPubMedWeb of Science
    27. 27.↵
      Canadian Task Force on Preventive Health CareRecommendations for growth monitoring, and prevention and management of overweight and obesity in children and youth in primary care. Canadian Medical Association Journal 2015;187(6):411–21.
      OpenUrlFREE Full Text
    28. 28.↵
      1. Nader PR,
      2. O’Brien M,
      3. Houts R,
      4. Bradley R,
      5. Belsky J,
      6. Crosnoe R, et al
      . Identifying risk for obesity in early childhood. Pediatrics 2006;118(3):e594–601. doi:10.1542/peds.2005-2801pmid:16950951
      OpenUrlAbstract/FREE Full Text
    29. 29.↵
      1. Ratcliff MB,
      2. Jenkins TM,
      3. Reiter-Purtill J,
      4. Noll JG,
      5. Zeller MH
      . Risk-taking behaviors of adolescents with extreme obesity: normative or not?. Pediatrics 2011;127(5):827–34. doi:10.1542/peds.2010-2742
      OpenUrlAbstract/FREE Full Text
    30. 30.↵
      1. Freedman DS,
      2. Lawman HG,
      3. Pan L,
      4. Skinner AC,
      5. Allison D,
      6. McGuire LC, et al
      . The prevalence and validity of high, biologically implausible values of weight, height, and BMI among 8.8 million children. Obesity 2016;24(5):1132–9. doi:10.1002/oby.21446pmid:26991694; pmcid:PMC4846478
      OpenUrlCrossRefPubMed
    31. 31.↵
      CDCA SAS Program for the 2000 CDC Growth Charts (ages 0 to <20 years). Available from: https://www.cdc.gov/nccdphp/dnpao/growthcharts/resources/sas.htm. Accessed 31 January 2017.
    32. 32.↵
      1. Zemel BS
      . A commentary on the construction of weight velocity charts. Nutrition in Clinical Practice: Official Publication of the American Society for Parenteral and Enteral Nutrition 2009;24(5):651–53.
      OpenUrl

    Footnotes

    • Funding This research was supported by a Team Grant in Bariatric Care (Team to Address Bariatric Care in Canadian Children – Team ABC3) from the Canadian Institutes of Health Research (Institute of Nutrition, Metabolism and Diabetes). Partnership funding was also provided generously by Alberta Health Services, Alberta Innovates - Health Solutions, Canadian Obesity Network, and The Ontario Ministry of Health and Long-Term Care. Funding agencies had no role in the design, collection, analyses or interpretation of the results of this study or in the preparation, review or approval of this article.