Verifying the Accuracy of Measurements-Introduction
In my last post on tracking rowing data, I received a comment regarding the accuracy and measurement of observations—heart rate, in particular. This provided me with an idea to evaluate the best way I know how: take some measurements and compare to establish an estimate of data integrity. One of the best ways of accomplishing this is to take independent measurements from different sources while performing the same activity. The logic behind this is that independent, blind sources will provide the best chance for uncorrelated measurement corroboration.
Experimentation using the Garmin Vivoactive HR and Polar H10
Experimentation needs to be conducted carefully and variables controlled for in order to ensure that what is being measured is truly accurate. The results I present here are not conducted under laboratory conditions so are not perfectly designed. Yet, the results do provide a semblance of “laymen” scientific method, based on the tools and methods available to the average rower. I detail my analysis on my own blog site here at johnrzaleski.com. As was described in my first posting, I have used the Garmin Vivoactive HR smart watch, shown in Figure 1 below. The Garmin unit is able to be used with a number of sports, including rowing, and provides measurements of heart rate, stroke rate, distance per stroke, split times, and also provides for location tracking during the workout. Data can be uploaded to Connect.garmin.com and are also available for download in TCX (an XML format) as well as splits downloads in CSV format. The Polar H10 is strapped around the chest just below the level of the breast bone. This unit, too, can upload data to the flow.polar.com web site, where data can be downloaded in TCX format, as well.
Figure 1: Polar h10 chest strap and Garmin vivoactive hr smart watch were used in the comparison.
In order to provide some variety, I considered three different activities:
- General workout, involving weight lifting, sit-ups, squats;
- Walking for 1 mile; and,
- Indoor rowing for 15 minutes.
In all cases, both the Vivoactive HR and the H10 were attached, with the Vivoactive HR snuggly affixed to the left wrist. Both watch and chest strap were properly attached with no movement between these devices and the skin. Data were collected and then downloaded and processed through a Microsoft Excel spreadsheet. The data were time-synchronized so that corresponding data points from each device were associated in time. Plots of the measurements were made and, as I wrote earlier, details of the analysis are on my web site. A summary of the analysis is provided here.
Heart Rate Comparison: Walking
Measurements of heart rate were taken during a one mile walk. The heart rates were plotted against one another and the correlation coefficient was computed between the two sets of measurements. In the case of the comparison shown in Figure 2, the correlation among measurements was rather poor: the correlation coefficient was determined to be -0.54. Perfect correlation is given by the diagonal line in the figure. Interesting to note is that the data points taken from the Vivoactive HR time variance. In the case of the Vivoactive HR, in some instances, the time between measurements was as high as 47 seconds with 62 measurements in the 12-14 second interval range, whereas in the case of the Polar H10, all measurements were 1 second interval. Thus, the number (quantity) of measurements taken by the Polar H10 were far denser than those of the Vivoactive HR.
Heart Rate Comparison: General Activity
In the case of general activity, which included some weight lifting, sit-ups, leg raises and standing exercises, the heart rate comparison is as shown in Figure 3. The correlation coefficient among these measurements is a bit higher at 0.60. The variation in measurement collection time associated with the Garmin HR was even higher here, with one measurement interval as high as 88 seconds!
This Post Has 3 Comments
Interesting that it is the data collection time on the optical HR monitor in the watch that causes the issue. I would have thought that the HR data was every second, but obviously it only records HR when it gets a decent consistent reading. Not good that it can be so long between decent readings.
I have a friend that has been using an optical HR in a wrist watch and I have been struggling to understand why his HR has been staying flat during running intervals. The watch (top of the range only recently released) is supposed to store data every second but this obviously is not happening when he bumps the intensity up and his HR stays flat.
If rowers are using watches with Optical HR I think to have any usable HR data they must therefore use a HR strap.
Richard — exactly. The watch still captures stroke rate accurately as well as lat-lon. But, the Polar strap has been consistent even in the harshest of workouts.
I have created an update to the analysis with some new information related to the variation. I will submit a new post with this information.