TEEVE Project


CyPhy: Cyber Physiotherapy in Home Environment through 3DTI

Related Publication(s)

Introduction

As the population continues to age, the need for physical therapy (physiotherapy) services increases accordingly. However, study shows that providers (clinics, hospitals, personal trainers) of physiotherapy still largely concentrates in only urban areas. Thus, although new physiotherapy workforce is expected because of the growing need, the demand in rural areas is still unlikely to be fulfilled. In the foreseeable future, the massive growth of elderly patients who suffered from physical conditions will become a great challenge for current physiotherapy providers due to their highly uneven geographical distribution. With the advance of communication technology in regular households, Telehealth is proposed to bring medical care to remote districts. However, conventional video-chat-like Telehealth medium is inadequate. Physiotherapy involves wide-range body movement of patient, and accordingly, dynamic perspective changing of the therapist. Thus, new cyber medium, with more comprehensive representation, more dynamic interest point changing, and more sophisticated controllability, must be provided to prepare physiotherapy providers for upcoming challenges from the aging population. 3D Tele-immersion (3DTI) technology allows full-body, multimodal interaction among geographically dispersed users, which opens a variety of possibilities for cyber-collaborative activities. Physiotherapy and rehabilitation are advanced Telehealth applications that can benefit greatly from the 3DTI framework due to its 360 degree coverage of user’s body. For example, we can enable preliminary remote injury assessment while the patient is at home and the therapist is at the clinic; or a patient can do tele-rehabilitation with an online trainer while a therapist follows up offline on the patient’s progress. To achieve these capabilities, we present the CyPhy (Cyber-Physiotherapy) system which exploits the richness of healthcare semantics, encompassed in correlated multimodal information, and health-related users’ attention focus to deliver high quality real-time content between therapist and patient sites to enable a virtual-reality experience in remote healthcare.

Project At a Glance


User-centric Resource Adaptation in 3DTI

Related Publication(s)

Introduction

Resource, content, and satisfaction are the three intertwined factors in adaptation. Depending on the type of activity users are conducting in the 3DTI environment, the required computational resource can be very different in order to sustain the same perceptual satisfaction. We propose a morphing-based frame synthesis compression which contains different versions that are tailored to online/offline delivery and user activities with varying motion intensities. Via subjective user studies, we are able to find the equilibrium that balance between cost and quality of the compression.

Project At a Glance


Manageable Environment for Large-Scale 3D Tele-immersion Broadcasting

Related Publication(s)

Introduction

Traditional TV program and the free-viewpoint 3DTI (3D Tele-immersion) stand in the two extremes of broadcasting services. While the former consumes much less bandwidth due to its content uniformity, the latter grant the freedom of audience-initiated view changing without the intervention of cameramen and program producers. Standing at an equilibrium point of this tradeoff, we propose the 3DTI Amphitheater, a virtual environment which magnifies the effectiveness of content sharing in the P2P delivery network while preserving the semi-free view experience.

Project at A Glance