Tactile Visualization

Tom Way

[Ebola Virus]

Department of Computing Sciences
Villanova University
Independent Study Project

Advisor:  Dr. Mot Yaw

Description

Much of the sciences involve visualization of materials and concepts. This can present an extra challenge to persons who are blind and visually impaired because materials used to convey these concepts are often images and are not readily accessible to them. To date there is no simple and efficient way of interpreting or producing models of images conveyed in texts, and on the computer. Three dimensional models may be generated through casting or stereo lithography techniques. Two dimensional raised line drawings can be produced through similar techniques. In general, these methods along with Braille transcriptions require much lead time, and can be very expensive.

This project develops a composite software/hardware system for automatic translation of electronic images into tactile form. In this system, an aggregate process comprised of a sequence of image processing algorithms is applied to an image to produce a simplified version of the original. This caricaturized image is subsequently output in a raised tactile graphic from on microcapsule paper, suitable for display to a blind person.

The technique in which the tactile graphic is produced is optional. The software developed is intended to provide a way to generate tactile images quickly and easily. To produce the physical tactile model, we use the microcapsule paper. In this manner the process of rendering a meaningful tactile image of a picture, from filtering an electronic image to producing a hard copy in tactile form on microcapsule paper, takes only a matter of minutes. The process is illustrated below.

The image is filtered with our software, and Xeroxed onto microcapsule paper. The microcapsule paper is then fed through the Image Enhancer (Reprotronics, Inc.) to produce the raised image. The image being tactilely rendered is that of an Ebola virus.

[Illustrates the process of tactile rendering. Three pictures are indicated. The first


As the bandwidth of the visual sense is orders of magnitude higher than the tactual sense, the tactile rendering software is being designed to produce detail of the image in varying levels. Multiple tactile versions of the image in question can be generated, allowing one to feel the most prominent features and then hone into more of the subtler details.

[1 of 3 filtered images of the Ebola virus.] [Ebola virus picture][Ebola virus 
image]

Considerable research has been done over many years toward the development of a refreshable dynamic tactile graphics display, using technologies such as electrorheological fluids and nickel-titanium shape-memory wire. However, none of the efforts have produced a viable display to date. Ultimately, this tactile rendering software in conjunction with a dynamic tactile display would allow for the visually impaired much improved access to tactile interpretations of image based information.


Project Schedule

Date Description Status

August

Meet with advisor, finalize topic, prepare paperwork, register for independent study complete
8/25 Create project web site (email link to advisor) complete
September Research topic online and in library, gather notes, make list of references complete
9/15 Create paper outline complete
9/15 Meet with advisor met via email
10/01 Finish finding topic background information, rough writing complete
10/01 Meet with advisor (11:30am, during ofc hours) complete
October work on implementation and experiment design complete
10/15 Meet with advisor via email, IM, tried prototype
10/27 Meet with advisor (ofc hours) complete
11/05 write chapter 1 (introduction) complete
11/10 write chapter 2 (background) complete
11/15 write chapter 4 (description of experiments), meet with advisor complete
11/20 write chapter 5 (results of experiments) complete
11/30 write chapter 3 (description of implementation, tool, etc.), meet with advisor complete
12/06 finish rewrite of whole thing in progress (need to meet again)
12/06 Email final version of report to advisor  
12/10 revise using notes from advisor, email back  
12/12 one more pass with notes  
12/16 Deadline for submission of 2 copies of report  
12/16 Two copies to Dr. Joyce (make sure advisor submits evaluation)  

References


updated 12/27/04