See, hear, move: Interactive and multimedia patient data

Dr. Alexander Ziegler of the Institut für Immungenetik of the Charité and his co-workers expect a substantial improvement of the transparency and the interdisciplinary communication of scientific 3-D, video and audio data from this new approach.

As the researchers report in the journal BMC Medicine, this new form of medical publication offers the exciting opportunity to integrate multimedia content directly into electronic documents. For this purpose, the scientists made full use of the advanced capabilities of the popular PDF file type, which allow the incorporation of multimedia formats such as MP3 files into a document. The free online article includes a short ultrasound video sequence of a beating human heart and an audio sequence of a patient with severe sleep apnea as well as two interactive 3-D models, that of a face and that of a human brain. The freely available Adobe Reader software from version 9 onwards, installed on millions of computers worldwide, is sufficient to activate the interactive multimedia contents.

In their article, the scientists stress that the possibility of merging text and multimedia content in a single document will promote not only the digitization of the medical publication system, but also that of research and teaching. "There is an enormous potential for this approach when it comes to designing teaching or lecturing materials," says Alexander Ziegler. "The possibility to embed an interactive 3-D model of a complex biological structure into PDF documents that can be intuitively manipulated will certainly play an important role in teaching in the future."