Challenges Leveraging the Burgeoning Power of Mobile Multimedia Architectures for Innovative Commercial Multimedia Applications
Mobile architectures targeted at today's smartphones and tablet devices offer an increasingly powerful combination of video, camera, compute, and graphics capabilities which enable a new array of sophisticated multimedia applications. Developers are migrating high definition video conferencing, premium content delivery, and video editing software, once restricted to the domain of tethered set top boxes and personal computers , to commercial mobile platforms. Furthermore, the inherent mobility of these devices and usage model (they go where we go and can see what we see) coupled with its processing horsepower creates the opportunity for rich camera solutions leveraging computational photography and innovative, environment aware, mixed media interfaces leveraging computer vision and augmented reality. In practice, however, enabling even a moderately sized software vendor to implement an advanced multimedia application on powerful mobile architecture represents a herculean challenge for all members of the ecosystem: those that provide the silicon, operating system, middleware, and the application itself. It requires designing a multimedia system with an intelligent, use case cognizant division of labor between the architecture's components cast in the native frameworks of the operating system, optimizing internal data and control paths between those components, and tempering application interfaces with both the appropriate amount of flexibility and abstraction. This talk discusses both these challenges of delivering sophisticated mobile multimedia applications and the approaches used in practice to surmount them.
Jim van Welzen is the Director of Multimedia Software for NVIDIA's Mobile business unit where he leads an international team in delivering multimedia solutions into smartphones, tablets, and other mobile devices. His disciplines include multimedia system software architecture, performance and power optimizations, and application enablement. Jim is active in the Khronos international standards group particularly the OpenMAX multimedia standards where he has served both as chair and specification editor. He holds several patents in multimedia and graphics and is published in IEEE proceedings. Jim received his Masters degree in Computer Science from the University of North Carolina, Chapel Hill and his Bachelors from North Carolina State University.