Award Abstract # 1845490
CAREER: Bridging the Digital Accessibility Gap in STEM Using Multisensory Haptic Platforms

NSF Org: DRL
Division Of Research On Learning
Recipient: SAINT LOUIS UNIVERSITY
Initial Amendment Date: February 12, 2019
Latest Amendment Date: July 25, 2023
Award Number: 1845490
Award Instrument: Continuing Grant
Program Manager: Robert Ochsendorf
rochsend@nsf.gov
 (703)292-2760
DRL
 Division Of Research On Learning
EDU
 Directorate for STEM Education
Start Date: August 1, 2019
End Date: July 31, 2025 (Estimated)
Total Intended Award Amount: $991,992.00
Total Awarded Amount to Date: $991,992.00
Funds Obligated to Date: FY 2019 = $185,698.00
FY 2020 = $192,132.00

FY 2021 = $201,923.00

FY 2022 = $203,286.00

FY 2023 = $208,953.00
History of Investigator:
  • Jenna Gorlewicz (Principal Investigator)
    jenna.gorlewicz@slu.edu
Recipient Sponsored Research Office: Saint Louis University
221 N GRAND BLVD
SAINT LOUIS
MO  US  63103-2006
(314)977-3925
Sponsor Congressional District: 01
Primary Place of Performance: Saint Louis University
3450 Lindell Blvd
St. Louis
MO  US  63103-1110
Primary Place of Performance
Congressional District:
01
Unique Entity Identifier (UEI): JNBLLTBTLLD8
Parent UEI: JNBLLTBTLLD8
NSF Program(s): Discovery Research K-12
Primary Program Source: 04002122DB NSF Education & Human Resource
04002324DB NSF STEM Education

04002223DB NSF Education & Human Resource

04002021DB NSF Education & Human Resource

04001920DB NSF Education & Human Resource
Program Reference Code(s): 1045, 1545
Program Element Code(s): 764500
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.076

ABSTRACT

Consider learning visual subjects such as math, engineering, or science without being able to see. Suddenly, the graphs, charts, and diagrams that provide a quick way to gather information are no longer effective. This is a challenge that students with visual impairments face in classrooms today as educational materials are most often presented electronically. The current way that individuals with visual impairments "read" graphics is through touch, feeling raised dots and patterns on paper that represent images. Creating these touch-based graphics requires extensive time and resources, and the output provides a static, hard-copy image. Lack of access to graphics in STEM subjects is one of the most pressing challenges currently facing individuals with visual impairments. This is a concern given the low representation of students with these disabilities in STEM fields and professions.

This project investigates how to use new touch technologies, like touchscreens, to create graphics and simulations that can be felt, heard, and seen. Using readily available, low-cost systems, the principal investigator will investigate how to map visual information to touch and sound. This research builds on prior research focused on representing the building blocks of graphics (points, lines, and shapes) nonvisually. In this project, the investigator will determine how to represent more challenging graphics such as charts, plots, and diagrams, nonvisually. The project will then explore the role of touch feedback in interactive simulations, which have moving elements that change with user input, making nonvisual access challenging. Finally, the projects extends the research to students with other disabilities, toward understanding the benefits and changes necessary for touch technologies to have broad impact. The project involves group and single-subject designs with approximately 65 students with visual impairments and focuses on the following outcomes of interest: students' graph literacy, percent correct on task assessments, time of exploration, response time, number of revisits to particular areas of the graphic, and number of switches between layers. Working closely with individuals with disabilities and their teachers, this work seeks to bridge the current graphical accessibility gap in STEM and raise awareness of universal design in technology use and development.

The CAREER program is a National Science Foundation (NSF)-wide activity that offers awards in support of junior faculty who exemplify the role of teacher-scholars through outstanding research, excellent education, and the integration of education and research within the context of the mission of their organizations. This project is supported by NSF's Discovery Research PreK-12 (DRK-12) program. DRK-12 seeks to significantly enhance the learning and teaching of science, technology, engineering and mathematics (STEM) by preK-12 students and teachers through research and development of innovative resources, models and tools. Projects in the DRK-12 program build on fundamental research in STEM education and prior research and development efforts that provide theoretical and empirical justification for proposed projects.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

Lambert, S. G. and Tancredi, S. and Fiedler, B. L. and Moore, E. B. and Gorlewicz, J. L. and Abrahamson, D. and Paloma, F. G. "Getting a Grip on Geometry: Developing a Tangible Manipulative for Inclusive Quadrilateral Learning" Giornale italiano di educazione alla salute sport e didattica inclusiva , 2022 Citation Details
MacGavin, Bryan and Tennison, Jennifer and Condoor, Sridhar and Gorlewicz, Jenna "The HapConnect: Teaching about Haptics and Inclusive Design with Modular, Wearable Technology" American Society for Engineering Education , 2023 Citation Details
Gorlewicz, J. L. and Tennison, J. L. and Uesbeck, P. M. and Richard, M. E. and Palani, H. P. and Stefik, A. and Smith, D. W. and Giudice, N. A. "Design Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics." ACM transactions on accessible computing , v.13 , 2020 https://doi.org/10.1145/3403933 Citation Details
Pasquesi, John and Gorlewicz, Jenna L. "Investigating Multi-Touch Vibrations on Mobile Touchscreens" 2021 IEEE World Haptics Conference , 2021 https://doi.org/10.1109/WHC49131.2021.9517131 Citation Details
Lambert, S. G. and Fiedler, B. L. and Hershenow, C. S. and Abrahamson, D. and Gorlewicz, J. L. "A Tangible Manipulative for Inclusive Quadrilateral Learning" Journal on technology and persons with disabilities , v.10 , 2022 Citation Details
10) Tennison, J. L. and Greenberg, J. and Moore, E. B. and & Gorlewicz, J. L. "Haptic Paradigms for Multimodal Interactive Simulations" Journal on technology and persons with disabilities , v.9 , 2021 Citation Details

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page