CURRENT PROJECTS

 
 

I. NSF CAREER ADAPTIVE BIOFEEDBACK TO IMPROVE BALANCE DURING EVERYDAY MOBILITY

Sonified biofeedback conveys biomechanics metrics via sound. We are developing systems with which people can interactively “tune” music biofeedback to tune their movement strategies. Recently, our lab has been awarded with an NSF CAREER award titled “Adaptive Biofeedback to Improve Balance during Everyday Mobility” to advance this mission.

There are two major objectives associated with this grant. One is to understand balance during turns of varied environmental contexts and the second is to use real-time sonified biofeedback to improve balance.

I.1 Balance during turns

In the first objective of the CAREER project, we are focused on understanding person-specific balance strategies used during turns of varied environmental contexts. For our first study, we selected the everyday mobility context of turning into an aisle in a store when the item of interest is known to be in a specific aisle (pre-planned), or when a visual cue is received by looking into the aisle while walking by the aisle (late-cued).

 

First-person point of view in the two turn conditions and one “catch trial” where the cue to turn was not present, so the participant continued walking straight.

In the late-cued task, participants did not know ahead of time whether to turn, as though they were unfamiliar with this grocery store. They knew that there was a 50% chance that the monitor displayed the grocery item of interest (green broccoli), to cue to turn, or a “NO” symbol (red circle with a line through it), to cue continuing to walk straight. The monitor switched from black to always display one of the two symbols when the person reached the closer tripod, mimicking a grocery store aisle coming into view.

The videos below are from the same exemplar participant during pre-planned and late-cued turns. Each participant either started walking with their left or right foot (e.g., “Start Left”) which led to different footfall strategies adopted when they reached the aisle.

During the pre-planned turns, we can observe that the turn occurs over multiple footfalls. The participant does not demonstrate the traditional “step” or “spin” turn strategies. These strategies would be demonstrated if there were one footfall that accomplishes most of the change in linear trajectory and body facing direction.

  • A spin turn is marked by the most rotation occurring during a footfall of the foot on the side of the body in the desired direction of travel (interior to the turn).

  • A step turn is marked by the most rotation occurring during a footfall of the foot on the side of the body opposite of the desired direction of travel (exterior to the turn).

Instead, this participant, and others used multiple footfalls to gradually change their body’s horizontal trajectory and facing direction. The overhead view demonstrates the curved horizontal center of mass trajectory with the body gradually reorienting to the desired facing direction.

During these late-cued turn examples, we observe that when the participant started the trial with a left foot step, they use a small half-step to redirect their center of mass translation and rotate their body suddenly with a footfall that facilitated ground reaction forces in the desired direction of travel and a widened base of support (vs. turning when supported only by the previous footfall). In contrast, during the late-cued turns performed when the participant started the trial with a right foot step, they were able to complete the turn without this half-step. This was accomplished due to a combination of factors, one of which may be that the cue was received with enough time for the right foot fall’s role to quickly switch to accommodate the turn’s mechanical objectives.

These trials demonstrate a few strategies that young adults can use to turn during pre-planned and late-cued conditions. The fact that behavior was similar across trials started with each foot implies the importance of the footfall context relative to the location of the turn in strategy selection (strategies used depend partially on spatial configurations).

During these different turn strategies, we are starting to understand the coordination between changing linear momentum and angular momentum about different body axes. The newest analysis we are undertaking is to understand the coupling of the body’s mediolateral margin of stability (distance from the center of mass to the mediolateral edge of the base of support) along with whole body angular momenta in the frontal plane (body rotation side-to-side about a forward axis) and transverse plane (body rotation about vertical axes).

We are finding that during pre-planned turns, the mediolateral margin of stability is at its lowest in the mid-range of frontal and transverse plane angular momenta. However, during late-cued turns, the margin of stability is negative (meaning the center of mass is outside of the mediolateral bounds of the base of support) at times that the angular momenta are at rapidly changing or at their greatest values. This is suggesting that during the late-cued turns, people are challenged in ways that impose the need to rotate about multiple axes while barely supported by the base of support.

 

I.2 Real-Time Sonified Balance Biofeedback

Our sound biofeedback design is currently in redesign phase. Please see below for preliminary studies of balance using our original sound design prototype.

Our Ph.D. student Mitchell Tillman recently presented a preliminary study related to this research virtually at ASB2020! Please click here for a pdf of Mitchell’s poster and watch the video by clicking the picture of the poster.

Methods Details for initial study of stationary single leg balance:

The current sonification design sound generation consists of two oscillators whose outputs are each sent through a band-pass filter, then summed and followed by a gain. The sound can be varied according to three parameters: pulse speed, brightness, and dissonance. Pulse speed varies the periodic rate at which the gain and filters are modulated; brightness controls the average center frequency of the filters; dissonance controls the relative tuning of the two oscillators. Pulse speed and brightness mappings were scaled from 0 to 1 such that the entire range was achievable during the single leg stance task.

Margin of stability (MOS) is mapped to pulse speed such that as the total body center of mass (TBCM) moved closer to the Base of Support (BOS) convex hull edge (lower MOS) the pulse speed increases closer to 1 (faster pulse speed). This mapping aims to impart a sense of urgency about moving away from the BOS boundaries, while the very slow pulses when the TBCM was at the center of the BOS indicates relative safety from falling.

Next, BOS convex hull area is mapped inversely to brightness; larger BOS areas resulted in lower brightness, smaller BOS areas resulted in higher brightness (Fig. 2). Higher brightness is less pleasant to listen to, therefore the sound emphasized maintaining a larger base of support, which we think will be more conducive to balance in static tasks.  Finally, the Boolean value of whether TBCM was within (1) or outside (0) of the BOS convex hull was mapped to the dissonance of the system. If the Boolean is 0, there is no dissonance. But if TBCM is outside the BOS boundary (Boolean=1), dissonance is introduced to the audio.

audiovisual examples:

 

We are working on more mobile ways to sonify balance metrics. Summer 2020 Pinnacle Scholar, Paul Brellis, created this system to calculate the base of support and body’s center of mass using a Microsoft Kinect. In the future, we can connect this system with our sonification system to provide sonification to people outside of the lab. Check out the video!

Video Details: On the left, you see the stick figure generated by Kinect. The middle you see the XYZ coordinates of the Body’s Center of Mass that uses assumptions about body segment parameter parameters (as function of Sex). On the right, you can see the purple outline of the base of support along with the light blue dot as the projection of the body center of mass onto the ground.


II. Sports Biomechanics Projects (Please check for updates periodically!)

Pitching Biomechanics

Among many research questions, we are interested in understanding how each leg contributes to whole body angular and linear momentum during the baseball pitch. We have many other research questions, but we are eager to share preliminary findings on this page! Our doctoral student, Sam Liu, has uncovered how each leg works to generate linear and angular impulse, which initiate the linear and angular momenta respectively.

Professional pitchers (n=4) volunteered for the study and pitched six to eleven fastballs from the stretch position on an instrumented mound while kinematic and kinetic data were collected . We excluded pitching trials that were rated unrepresentative/poor by the pitchers. The variables of interest were “X GRF”, the forward directed GRF, and “My”, the moment applied about the Y-axis passing through the TBCM (forward rotating moment) (see next Figure). These two variables were integrated to find the X Linear Impulse and Y Angular Impulse, respectively, for each leg and both legs (net) from the beginning of the push phase until ball release. The push phase began the last time Z GRF decreased before increasing to its peak.

 

The back leg generated positive X Linear Impulse, and the front leg generated negative X Linear Impulse, resulting in a net positive X Linear Impulse before ball release (see next figure, part A). This led to forward momentum of the body. Both legs generated positive Y Angular Impulse, which led to forward rotation of the body towards accelerating the ball (see next figure, part B).

Surprisingly, the back leg generated more positive Y Angular Impulse than the front leg did. We found that the role of the back leg transitioned from linear propulsion to forward angular rotation before double support. We also found that the front leg initially generated negative Y Angular Impulse, slowing the forward rotation. To maximize forward rotation, it may be helpful to increase the back leg’s contribution to rotation and reduce the front leg’s negative Y Angular Impulse. Our future research will enroll more pitchers to better understand the role of each leg towards linear and angular momentum control.

Volleyball spike biomechanics

We are interested in understanding the multi-joint control and sequential rotation of the body during flight of the volleyball attack (also known as “spike). We completed a study that used a four-axis humerothoracic angular velocity parameterization to reveal person-specific arm swing techniques used during cross-court and straight-ahead spikes. The paper also reveals segmental rotational patterns of the pelvis, trunk, and upper extremity relative to the flight trajectory direction and vertical axes.

 

III. Shoulder Orthopaedic Research

Reverse total shoulder arthroplasty

In collaboration with Rush University Medical Center and other Orthopaedic surgeons, we are studying how Reverse Total Shoulder Arthroplasty (RTSA) affects movement and muscle activation patterns used during range of motion activities and activities of daily living.

One step towards this is to better understand the methods of non-invasive measurement and reporting of scapulothoracic (scapula, or shoulder blade, vs. thorax/trunk) angles. The figure to the right (or below on mobile) demonstrates that the calibration pose used to associate tracking markers with the scapula could have very large effects on the estimation of scapulothoracic angular displacement, depending on the person and direction of angular rotation. This research was published (Zaferiou, A.M., Knowlton, C.B., Suk-Hwan Jang, Verma, N., Forsythe, B., Saltzman, B., Nicholson, G., Romeo, A.A. (2020) Patient-specific effects on scapular orientation measurements using an acromion marker cluster with multiple calibration poses, Journal of Biomechanics https://doi.org/10.1016/j.jbiomech.2020.109889 ).

Our recent manuscript about the scapulohumeral coordination or “scapulohumeral rhythm” used before vs. after RTSA has been published (https://doi.org/10.1016/j.jbiomech.2021.110550 ) . We are proud that this study is the first (or among the first) to measure kinematics of the same participants before and after RTSA. We found participant-specific differences with some participants increasing and others decreasing scapulothoracic upward rotation angular displacement post-RTSA vs. pre-RTSA. As a group, during arm elevation with internal rotation the mean (SD) scapulohumeral rhythm significantly increased post-RTSA so that glenohumeral motion increased relative to scapulohumeral motion.

Check back soon for more results related to the comparison of muscle activation before vs. after RTSA.

 

Difference in the estimation of scapulothoracic (scapula vs. thorax) angular displacements (angular difference from initial starting position) across calibration poses used to associate tracking motion capture markers with anatomic landmarks of the scapula. These measures vary greatly across people and across the directions of angular estimation (i.e., the upward rotation angular displacement is the least affected).