RESNA Annual Conference - 2023

myAccessTools: Validation of Impairment-Weighted Scores

Mason D. Drake1,2, Steven C. Sizer2, Sayeda F. Aktar2,3, Nina Gutmanis4, Roger O. Smith1,2 

1University of Wisconsin-Milwaukee, 2Rehabilitation Research Design & Disability (R2D2) Center, 3Marquette University, 4Independence First 

ABSTRACT 

Introduction: The myAccessTools accessibility application allows evaluators to conduct thorough building assessments to obtain valuable accessibility information without prior accessibility knowledge. A primary feature of the app is the ability to provide individual impairment scoring for 16 different types of disabilities. In addition, these scores possess weighted items based on the significance to an impairment. Although, the functionality of this feature requires validation for its intended purpose. Methods: Sixteen impairments were identified and examined using the myAccessTools app. Researchers completed two evaluations for a specific restaurant with a particular impairment. One evaluation required testers to examine the selected restaurant as fully accessible to an individual with no impairment and somewhat accessible to an individual with the impairment being investigated. The second evaluation would examine the restaurant as accessible for an individual without the impairment and not accessible for an individual with the impairment. Results: Expected findings are impairment-weighted scores function as designed and provide reliable and valid results to users. Discussion: While the functionality of the impairment-weighted scores is anticipated to work properly, further development should direct its attention to the inclusion of comorbid impairment-weighted score. Conclusion: The myAccessTools application has undergone validation testing that is expected to lead to the capability of providing individuals with reliable impairment-specific building accessibility information.

INTRODUCTION 

In 1990, the United State government passed the American with Disabilities Act (ADA) and the ADA Standards for Accessible Design in 2010, to decrease discrimination encountered by people with disabilities (PWD) [1,2]. Despite the implementation of these legislations, environmental barriers remain a challenge for PWD due to buildings satisfying numeric standards over being functionally accessible [3]. Although, many buildings or restaurants can be labeled as "accessible", while still being inaccessible due to not adhering ADA regulations since they were constructed before 1990 [4]. This can potentially create frustrating situations for PWD when they visit at a restaurant because they may not be able to access the building or the features it possesses [5]. Through interviews conducted by the Rehabilitation Research Design & Disability (R2D2) Center at the University of Wisconsin-Milwaukee, it was discovered PWD would like information regarding a restaurant's accessibly prior to visiting [6]. To assist with this issue, the Access Ratings for Building (ARB) project was introduced as a solution to provide accessibility information for restaurants to PWD with the intention they would use this knowledge to determine if a restaurant was accessible for them prior to visiting the establishment. 

myAccessTools 

Brief Description: Figure 1 is a screenshot of the myAccessTools application.
Essential Description: Figure 1 is a screenshot of the primary evaluation interface for myAccessTools that displays scoring items, their descriptions, scoring options, a comments section and optional MiniTools.
Figure 1: myAccessTools application 

myAccessTools is an app within the ARB project that provides accurate building accessibility information without requiring prior accessibility knowledge or training. myAccessTools (Figure 1) is a measurement instrument that centers around of two elements, functions and features [8]. The functions section examines what actions are required by an individual to utilize a building feature. The feature section investigates what features are present at the building being assessed. Having these two elements emphasizes the PEO model, utilized in occupational therapy, that the ARB project has incorporated since its inception. The individual evaluating symbolizes the "Person", the feature represents the "Environment", and the function signifies the "Occupation". Item descriptions are provided and guide the evaluator in appropriately allocating the correct score to the item. The scoring utilizes a Trichotomous Tailored Sub-Branching Scoring (TTSS) system that includes the options Yes [2], Maybe/Unsure [1] and No [0] with questions branching if more information is needed by the evaluation. Upon completion of an evaluation, total accessibility score and individual impairment scores of the building are provided. In addition, myAccessTools enables evaluators to include photos, videos and measurements during the evaluation by collecting data using the MiniTools. These MiniTools are AccessRuler, AccessSlope and AccessSound and all gather data utilizing measurement system hardware within an iOS device.

METHODS 

The myAccessTools app impairment-weighted scores were investigating by requiring testers to examine 16 different impairments. Matrices were created containing every item within the app taxonomy and assigned weighted scoring for each of the sixteen impairments (Figure 2) examined based on how much the impairment is impacted by the item. Researchers were assigned a restaurant with a known accessibility score and completed two different evaluations for a specific impairment. The first evaluations were evaluating the restaurant as fully accessible for an individual without the impairment and only somewhat accessible for an individual with the impairment. The second evaluation was executed by assessing the restaurant as fully accessible to an individual without the impairment and not accessible to an individual with the impairment. The scoring for these evaluations was done using a trichotomous scoring technique that consisted of answer options of Yes [2], Maybe/Unsure [1] and No [0]. For fully accessible scoring with individuals without the impairment, Yes [1] was used. Scoring for somewhat accessible in the first assessment were completed using Maybe/Unsure [1] and not accessible scoring utilized the No [0] option. Once evaluations were complete, impairment-weighted scores are to e input into a scoring algorithm and compared to one another to ensure a differentiation. For example, the scores for lower limb impairment will be compared to the score for the mild to moderate visual impairment to confirm impairment-weighted scores were different. Evaluations will also be compared to each other in the same impairment category to certify a difference between somewhat accessible and not accessible scoring.

Figure 2: Impairment categories examined when validating the myAccessTools impairment-weighted scores.

Categories of Impairment Types

Hard of Hearing Expressive Communication Sensitivity Impairment Upper Limb Impairment
Deaf Comprehension Disorders Lower Limb Impairment Total Upper Limb Impairment
Mild to Moderate Visual Impairment Other Cognitive Disorders (Memory, Executive Functioning) Total Lower Limb Impairment Systemic Body Impairment
Blind Behavioral Impairment Head/Neck/Trunk Impairment No Impairment

RESULTS 

Data collection has been completed and accessibility results are currently being implemented into a scoring algorithm that will provide impairment scores for buildings. These scores will account for the weighting of specific building features and combine them to provide a comprehensive impairment-weighted accessibility rating. It is expected the applied algorithm will function as intended and result in reliable and valid impairment-specific accessibility scoring within the myAccessTools app.

DISCUSSION 

While development of the impairment-weighted scores for myAccessTools is in progress, it is anticipated the application will provide the targeted results. This would validate the myAccessTools app as a robust measurement instrument for collecting, interpreting and providing accessibility data that can be used by any individual. Upon confirmation the assessment provides the desired functions, further development of the app should be conducted, specifically advancement of impairment scoring and including comorbidities. This will allow users to have an even more personalized accessibility rating of a building if they have the capability of seeing multiple impairments scores averaged together.

CONCLUSION 

The validation methodology of the impairment-weighted scoring was conducted and is expected to have myAccessTools operate as projected once results are input into the app's algorithm. This enables the app to be utilized by all individuals regardless of prior accessibility knowledge and provide comprehensive impairment-specific results. Due to the extensive taxonomy and features included, the impairment-weighted scores are expected to be reliable and valid positioning myAccessTools at the forefront of building accessibility measurements instruments.

REFERENCES 

[1] Department of Justice (DOJ). (1991). Nondiscrimination on the begin self-education. basis of disability by public accommodations and in commercial facilities; final rule (DOJ Publication No. 1513–91). Washington, DC: U.S. Government Printing Office. 

[2] Access-Board. (2005). ADA Accessibility Guidelines for Buildings and Facilities (ADAAG). Retrieved from https://www.access-board.gov/attachments/article/1350/adaag.pdf 

[4] Matthews, H., Beale, L., Picton, P. & Briggs, D. (2003). Modelling access with GIS in urban systems (MAGUS): capturing the experience of wheelchair users. Area, 35 (1), 34–45. 

[3] Smith, R.O., Tomashek, D. & Wilson, C. (2019). Perspectives on Building Accessibility: Survey responses by people with disabilities on accessibility experiences and the need for information. [Conference Presentation]. Rehabilitation Engineering and Assistive Technology Society of North America (RESNA) Annual Conference, Toronto, Canada.  

[5] Volkel, T., Kuhn, R., and Weber, G. (2008). Mobility impaired pedestrians are not cars: Requirements for the annotation of geographical data, In: K. Miesenberger, J. Klaus, W. Zagler and A. Karshmer, eds. Proceedings of the 11th International Conference, ICCHP 2008. Linz, Austria: Springer, 1085–1092. 

[6] O'Donnell, L., Drake, M.A.D. & Smith, R.O. (2020). AccessPlace App Needs Assessment: Ascertaining Stakeholder Perspectives Through Customer Discovery. ACRM Conference, Virtual Conference. 

[7] Schwartz, J., O'Brien, C., Edyburn, K., Ahamed, S. I., & Smith, R. O. (2013). Smartphone based solutions to measure the built environment & enable participation. Proceedings of the RESNA 36th International Conference on Technology and Disability: Research, Design, Practice, & Policy. Bellevue, WA. Retrieved from http://www.resna.org/sites/default/files/legacy/conference/proceedings/2013/CAC/Schwartz.html  

[8] Drake, M.D., Sizer, S. & Smith, R.O. (2022). myAccessTools Development for Novice Raters to Accurately Assess Accessibility of Buildings. Proceedings of the RESNA Annual Conference-2022. Online Conference. Retrieved from https://www.resna.org/sites/default/files/conference/2022/ServiceDeliveryandOutcomes/StudentScientific/111_Drake.html

ACKNOWLEDGEMENTS 

This work was developed in part under grants from the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR grant number H133G100211 and 90IFDV0006). NIDILRR is a Center within the Administration for Community Living (ACL), Department of Health and Human Services (HHS). The content of this work does not necessarily represent the policy of NIDILRR, ACL, HHS, and you should not assume endorsement by the Federal Government.