Vireo is a lightweight and versatile video processing library that powers our video transcoding service, deep learning recognition systems and more. It is written in C++11 and built with functional programming principles. It also optionally comes with Scala wrappers that enable us to build scalable video processing applications within our backend services.
Vireo is built on top of best of class open source libraries (we did not reinvent the wheel), and defines a unified and modular interface for these libraries to communicate easily and efficiently. Thanks to a unified interface, it is easy to write new modules (e.g. new codec) or swap out the existing ones in favor of others (e.g. proprietary or hardware H.264 decoder).
Performance was a strong focus, as well as memory consumption: only the strictly required objects are kept in memory at all times, and we pick the fastest code, with negligible overhead. Some operations, such as trimming or remuxing, are blazing fast even on mobile!
Vireo caters to both high level engineers who want to focus on building products as well as lower level engineers focused on developing video technology. It is released under the MIT license and aims to make it easy for developers to do media processing and create both commercial and non-commercial (see Legal Disclaimer for details) applications.
Included are a number of additional command-line tools built with Vireo for common video processing tasks, such as inspecting a video or transcoding.
Included Tools:
# within the main repository directory
$ cd vireo
$ export PREFIX=/path/to/install/dir
$ ./configure --prefix=$PREFIX
$ make
$ make installOnce built, you can find
$PREFIX/include$PREFIX/lib$PREFIX/binTo run a tool and see their usage, simply execute:
$ $PREFIX/bin/<tool_name>An exception to this rule is the validate tool which requires validate -h to show its usage as it uses STDIN for input.
Please note that some of the tools listed in List of Tools may not be built based on the availability of optional third-party libraries listed under Dependencies.
When compiling you can also optionally turn on C++ to Scala bindings by passing --enable-scala flag to configure. After you successfully build Vireo with these bindings, you can build the Scala wrappers by executing:
# within the main repository directory
$ cd vireo
$ ./build_scala.shThis will place the built jar file under $PREFIX/lib.
The following libraries are automatically enabled if present in your system
The following libraries are disabled by default. To enable GPL licensed components, they have to be present in your system and --enable-gpl flag have to be explicitly passed to configure
This installer allows you to select various third-party, pre-installed components to build with the Vireo platform. Some of these components are provided under licenses that may be incompatible with each other, so it may not be compliant to build all of the optional components together. You are responsible to determine what components to use for your build, and for complying with the applicable licenses. In addition, the use of some of the components of the Vireo platform, including those that implement the H.264, AAC, or MPEG-4 formats, may require licenses from third party patent holders. You are responsible for determining whether your contemplated use requires such a license.
To give you an idea on what you can build using Vireo, we provide 3 simple code snippets below.
Remuxing an input file to mp4
/*
* This function works without GPL dependencies
*/
void remux(string in, string out) {
// setup the demux -> mux pipeline
demux::Movie movie(in);
mux::MP4 muxer(movie.video_track);
// nothing is executed until muxer() is called
auto binary = muxer();
// save to file
util::save(out, binary);
}Remuxing keyframes of an input file to mp4
/*
* This function works without GPL dependencies
*/
void keyframes(string in, string out) {
demux::Movie movie(in);
// extract keyframes using .filter operator
auto keyframes = movie.video_track.filter([](decode::Sample& sample) {
return sample.keyframe;
});
mux::MP4 muxer(keyframes);
// nothing is executed until muxer() is called
auto binary = muxer();
util::save(out, binary);
}Transcoding an input file to mp4
/*
* This function requires vireo to be built with --enable-gpl flag
*/
void transcode(string in, string out) {
// setup the demux -> decode -> encode -> mux pipeline
demux::Movie movie(in);
decode::Video decoder(movie.video_track);
encode::H264 encoder(decoder, 30.0f, 3, movie.video_track.fps());
mux::MP4 muxer(encoder);
// nothing is executed until muxer() is called
auto binary = muxer();
// save to file
util::save(out, binary);
}You can build your own application simply by using pkg-config. Just make sure you add the Vireo install directory to your PKG_CONFIG_PATH if you did not install Vireo to a path where pkg-config is already looking at.
To build the examples provided in Code Examples section, simply execute the following:
# within the main repository directory
$ export PKG_CONFIG_PATH=$PREFIX/lib/pkgconfig
$ cd vireo/helloworld
$ g++ `pkg-config --cflags --libs vireo` -std=c++14 -o helloworld helloworld.cpp
$ ./helloworldTHROW_IF(..., Unsupported, "reason") (or CHECK(...)) and ideally in comments as well.remux, transcode etc.) are also updated.