Open Source Projects

This section lists multimedia open source projects. Feel free to contribute to this list!

  • Advene: aims at providing a model and a format to share annotations about digital video documents
  • Ambulant: an open-source media player with support for SMIL 3.0
  • Bob: a free signal processing and machine learning toolbox
  • Caliph & Emir: are MPEG-7 based Java prototypes for digital photo and image annotation and retrieval supporting graph like annotation for semantic metadata and content based image retrieval using MPEG-7 descriptors
  • Clam: is a full-fledged software framework for research and application development in the Audio and Music Domain
  • ClassX: is an interactive lecture streaming system developed by the Image, Video, and Multimedia Systems (IVMS) research group at Stanford University
  • ChucK:  is a new audio programming language for real-time synthesis, composition, performance, and analysis
  • CUDA Surf: a GPU implementation of the SURF algorithm
  • DisplayCast: a high-performance screen sharing system for intranets
  • DASH: MPEG-DASH (Dynamic Adaptive Streaming over HTTP) implementation incl. DASHEncoder, DASHPlayer (VLC Plugin and library 'libdash'), and dataset
  • DirectFB: a thin library that provides hardware graphics acceleration, input device handling and abstraction, integrated windowing system with support for translucent windows and multiple display layers, not only on top of the Linux Framebuffer Device
  • ESSENTIA: is an open-source C++ library for audio analysis and audio-based music information retrieval. It contains an extensive collection of reusable algorithms
  • FALCON: an open source tool for music identification, written in Java and based on the popular search engine library Lucene
  • FCam: an open-source C++ API for easy and precise control of digital cameras.
  • FLANN: a library for performing fast approximate nearest neighbor searches in high dimensional spaces
  • Flavor: is an object-oriented media representation language designed for simplifying the development of applications that involve a significant media processing component 
  • Fobs (inactive): is a set of object oriented APIs to deal with media. It relies in the ffmpeg library, but provides developers with a much simpler programming interface
  • GamingAnywhere: is an open-source clouding gaming platform, highly extensible, portable, and reconfigurable. It currently supports Windows and Linux, and can be ported to other OS's including OS X and Android
  • Ginga: the middleware of the Japanese-Brazilian Digital TV System (ISDB-TB) and ITU-T Recommendation for IPTV services. Ginga is made up by a set of standardized technologies and Brazilian innovations that make it the most advanced middleware specification
  • GoalBit: a free open source video streaming platform capable of distributing high-bandwidth live video content to everyone preserving its quality
  • Golden Retriever: is a light-weight but complete framework for implementing CBIR (Content Based Image Retrieval) methods
  • GPAC: an Open Source multimedia framework for research and academic purposes. The project covers different aspects of multimedia, with a focus on presentation technologies (graphics, animation and interactivity)
  • GpuCV: is an open-source GPU-accelerated image processing and Computer Vision library
  • Hop: is a multi-tier programming language for the Web 2.0 and the so-called diffuse Web
  • ImageTerrier: is an open-source, scalable, high-performance search engine platform for content-based image retrieval applications
  • ImproveMyCity: ImproveMyCityMobile is an open source smartphone application for Android devices that allows citizens to report all types of issues related to their neighborhood
  • IRRLICHT: an open source high performance realtime 3D engine written and usable in C++ and also available for .NET languages
  • ITK: an open-source, cross-platform system that provides developers with an extensive suite of software tools for image analysis
  • jReality:  is a Java based, open-source, full-featured 3D scene graph package designed for 3D visualization and specialized in mathematical visualization
  • Kaltura: open source video solutions
  • libdash: libdash is a C++ library that provides an object oriented (OO) interface to the MPEG-DASH standard. It’s the official reference software of the ISO/IEC MPEG-DASH standard and supports the full range of DASH264 test vectors of the DASH Industry Forum.
  • LibPMK: a C++ implementation of Grauman and Darrell's Pyramid Match algorithm. This toolkit provides a flexible framework with which you can quickly match sets of image features and run experiments
  • Lire: provides a simple way to retrieve images and photos based on their color and texture characteristics.
  • Live555: Internet streaming media, wireless, and multicast technology, services, & standards
  • LVL: small, fast, extensible C library for early computer vision. Not using opencv
  • Miro: open source music and video player
  • Mixare: is a free open source augmented reality browser, which is published under the GPLv3
  • MNM: Network-Integrated Multimedia Middleware
  • MPEG-7 Library: is a set of C++ classes, implementing the MPEG-7 standard (ISO/IEC 15938:2001 and 15938:2004)
  • MXM: the purpose of the MPEG eXtensible Middleware (MXM) standard is to promote the extended use of digital media content through increased interoperability and accelerated development of components, solutions and applications
  • openBliSSART: is a C++ framework and toolbox that provides Blind Source Separation for Audio Recognition Tasks
  • OpenCast Matterhorn: is a free, open-source platform to support the management of educational audio and video content
  • OpenCV: has > 500 algorithms, documentation and sample code for real time computer vision
  • openFrameworks: is an open source C++ toolkit for creative coding
  • OpenIMAJ: is a collection of libraries for multimedia analysis written in the Java programming language
  • OpenIP: is an open source project to create a C++ library providing the most common methods and algorithms in the field of image processing and computer vision
  • Open Media Foundation: Putting the power of the media and technology in the hands of the people
  • OpenMusic: http://repmus.ircam.fr/openmusic/home
  • OpenNI:  is an industry-led, not-for-profit organization formed to certify and promote the compatibility and interoperability of Natural Interaction (NI) devices, applications and middleware
  • OpenSim: is an open source multi-platform, multi-user 3D application server. It can be used to create a virtual environment (or world)
  • OpenSMILE: is a feature extraction tool that enables to extract large audio feature spaces in realtime
  • OpenSURF: aims to find salient regions in images which can be found under a variety of image transformations. SURF is a faster alternative to SIFT
  • Open SVC Decoder: is the name given to an extension of the H.264/MPEG-4 AVC video compression standard which has been developed jointly by ITU-T and ISO/IEC JTC 1.
  • Open Video Alliance: is the movement to promote free expression and innovation in online video
  • Orcc: the Open RVC-CAL Compiler (Orcc) can generate code for any platform, including hardware (Verilog, VHDL), software (C, Java), heterogeneous platforms (mixed hardware/software), and multi-softcore platforms, from a platform-agnostic, high-level description
  • Popcorn.js: is an HTML5 media framework written in JavaScript for filmmakers, web developers, and anyone who wants to create time-based interactive media on the web
  • Processing: is an open source programming language and environment for people who want to create images, animations, and interactions
  • PyCVF: Python computer vision framework
  • Rainbow (inactive): provide native audio and video recording capabilities in the browser through a JavaScript API
  • realXtend: offers a free open source virtual world platform
  • SCRAPE: is an open source project that enables transferring 3D worlds developed in Processing to a CAVE Automatic Virtual Environment (CAVE
  • SDL: is a cross-platform multimedia library designed to provide low level access to audio, keyboard, mouse, joystick, 3D hardware via OpenGL, and 2D video framebuffe
  • Sirannon (inactive): aims at being a modular multimedia streamer and receiver
  • SELab: Sensory Experience Lab including SEVino, SESim, SEMP, and AmbientLib for creating, parsing, and rendering sensory effects compliant to MPEG-V
  • SemAuth: s an xslt script which translates a freemind mindmap into a website (i.e. set of xhtml pages)
  • SIFT: is a method to detect distinctive, invariant image feature points, which easily can be matched between images to perform tasks such as object detection and recognition, or to compute geometrical transformations between images
  • SiftGPU: a GPU implementation of the SIFT algorithm
  • Social Signal Interpretation (SSI): it is a framework that offers tools to record, analyse and recognize human behavior in real-time, such as gestures, mimics, head nods, and emotional speech
  • Sonic Visualizer: its aim is to be the first program you reach for when want to study a musical recording rather than simply listen to it
  • Srikata: is a BSD-licensed open source platform for virtual worlds. We aim to provide a set of open libraries and protocols which anyone can use to deploy a virtual world
  • Stage Framework: is an open source project that uses a web application to deliver HTML5 based magazine content. Each published magazine consists of HTML resources which represent the magazine pages
  • Streeme: helps to turn your home computer into a full featured music server with minimal effort
  • SWFmil: is a tool for processing Adobe Flash files. It allows to transform the binary Flash files into an XML-based representation (swf2xml) for further processing. In addition, XML files adhering to the swfmill format can be turned back into the binary Flash format.
  • TAPESTREA: is a unified framework for interactively analyzing, transforming and synthesizing complex sounds 
  • TimeSheets: relies on declarative W3C standards (SMIL Timing and SMIL Timesheets) to synchronize HTML content
  • TOP-SURF: is an image descriptor that combines interest points with visual words, resulting in a high performance yet compact descriptor that is designed with a wide range of content-based image retrieval applications in mind
  • Torch 3 Vision: It's a machine vision library, written in simple C++ and based on the Torch machine-learning library
  • Torch 5: provides a Matlab-like environment for state-of-the-art machine learning algorithms. Torch5 is the official successor of Torch3
  • Trackmate: is an open source initiative to create an inexpensive, do-it-yourself tangible tracking system, allowing any computer to recognize tagged objects when placed on a surface
  • Tribler: is an application that enables its users to find, enjoy and share content. With content we mean video, audio, pictures, and much more
  • UltraGrid: is a software implementation of high-quality low-latency video and audio transmissions using commodity PC and Mac hardware
  • Video LAN (VLC): is a free and open source cross-platform multimedia player and framework that plays most multimedia files as well as DVD, Audio CD, VCD, and various streaming protocols
  • VideoJS: HTML5 video player
  • Vireo-VH: Video Hyperlinking provides end-to-end support for threading and visualizing large video collections. It includes components for near-duplicate keyframe retrieval, partial near-duplicate video alignment, and Galaxy visualization
  • VLFeat:  is an open source library that implements popular computer vision algorithms including SIFT, MSER, k-means, hierarchical k-means, agglomerative information bottleneck, and quick shift
  • XFace: is a set of open source tools for creation of MPEG-4 and keyframe based 3D talking heads
  • Xkin: is an open source library that enables users to build hand gesture based applications employing Kinect sensor 
  • Waisda?: is a video labeling game in the cultural heritage field. The goal is to collect user tags that can help bridge the semantic gap, to collect time-related metadata, and to offer people a new way of interacting with television programs