dlib/examples/ffmpeg_video_demuxing_ex.cpp
pfeatherstone decdef12f5
[FFmpeg] decoding and demuxing improvements (#2784)
* typo

* - added compile time information to audio object. Not convinced this is needed actually. I'm perfectly happy just using the ffmpeg::frame object. I'm pretty sure I'm the only user who cares about audio.
- created resizing_args and resampling_args

* smaller videos for unit tests

* shorter videos for unit tests

* - decoder and demuxer: you now resize or resample at the time of read. therefore you don't set resizing or resampling parameters in constructor, but you pass them to read()
- added templated read() function
- simplified load_frame()

* inherit from resizing_args and resampling_args

* reorganised the tests to segragate decoding, demuxing, encoding and muxing as much as possible

* much more basic example

* demxing examples split

* examples

* fixing examples

* wip

* Fix load_frame()

* added frame - specific tests

* - makes sense to have a set_params() method rather than constructing a new object and moving. I mean, it works and it absolutely does the right thing, and in fact the same thing as calling set_params() now, but it can look a bit weird.

* notes on defaults and good pairings

* Update ffmpeg_demuxer.h

Watch out for `DLIB_ASSERT` statements. Maybe one of the unit tests should build with asserts enabled.

* Update ffmpeg_details.h

* Update ffmpeg_muxer.h

* WIP

* WIP

* - simplified details::resizer
- added frame::set_params()
- added frame::clear()
- forward packet directly into correct queue

* pick best codec if not specified

* added image data

* warn when we're choosing an appropriate codec

* test load_frame()

* - for some reason, you sometimes get warning messages about too many b-frames. Resetting pict_type suppresses this.
- you can move freshly decoded frames directly out.

* callback passed to push()

* I think it's prettier this way

* WIP

* full callback API for decoder

* updated tests

* updated example

* check the template parameter is callable and has 1 argument first before getting it's first argument

* Potential bug fix

* - write out the enable_if's explictly. It's fine. I think it's clear what's going on if someone cares
- guard push() with a boolean which asserts when recursion is detected

* pre-conditions on callbacks: no recursion

---------

Co-authored-by: pf <pf@me>
Co-authored-by: Your name <you@example.com>
2023-05-15 21:24:47 -04:00

108 lines
3.7 KiB
C++

// The contents of this file are in the public domain. See LICENSE_FOR_EXAMPLE_PROGRAMS.txt
/*
This is an example illustrating the use of the ffmpeg wrappers,
in this case the demuxer API.
This is a pretty simple example. It loads a video file, and plots
the image frames on a GUI window.
*/
#include <cstdio>
#include <dlib/media.h>
#include <dlib/gui_widgets.h>
#include <dlib/cmd_line_parser.h>
using namespace std;
using namespace dlib;
using namespace dlib::ffmpeg;
void print_properties(const demuxer& cap)
{
printf("Video properties:\n\n");
printf("Estimated duration : %f\n", cap.duration());
printf("Video contains images : %i\n", cap.video_enabled());
if (cap.video_enabled())
{
printf(" height : %i\n", cap.height());
printf(" width : %i\n", cap.width());
printf(" pixel format : %s\n", get_pixel_fmt_str(cap.pixel_fmt()).c_str());
printf(" fps : %f\n", cap.fps());
printf(" nframes : %d\n", cap.estimated_nframes());
printf(" codec : %s\n", cap.get_video_codec_name().c_str());
}
printf("Video contains audio : %i\n", cap.audio_enabled());
if (cap.audio_enabled())
{
printf(" sample rate : %i\n", cap.sample_rate());
printf(" channel layout : %s\n", get_channel_layout_str(cap.channel_layout()).c_str());
printf(" sample format : %s\n", get_audio_fmt_str(cap.sample_fmt()).c_str());
printf(" nchannels : %i\n", cap.nchannels());
printf(" estimated samples : %i\n", cap.estimated_total_samples());
printf(" codec : %s\n", cap.get_audio_codec_name().c_str());
}
printf("\n\n");
printf("Video metadata:\n");
for (auto&& metadata : cap.get_metadata())
printf(" key : %-32s ; val : %-32s\n", metadata.first.c_str(), metadata.second.c_str());
}
int main(const int argc, const char** argv)
try
{
command_line_parser parser;
parser.add_option("i", "input video", 1);
parser.add_option("verbose", "enable all internal ffmpeg logging");
parser.set_group_name("Help Options");
parser.add_option("h", "alias of --help");
parser.add_option("help", "display this message and exit");
parser.parse(argc, argv);
const char* one_time_opts[] = {"i"};
parser.check_one_time_options(one_time_opts);
if (parser.option("h") || parser.option("help"))
{
parser.print_options();
return 0;
}
if (parser.option("verbose"))
{
// You can set the verbosity of some global loggers:
// - logger_dlib_wrapper() is the global logger used by dlib's wrappers
// - logger_ffmpeg() is the global logger used by the internal ffmpeg libraries (Nice that we are able to do that!)
ffmpeg::logger_dlib_wrapper().set_level(LALL);
ffmpeg::logger_ffmpeg().set_level(LALL);
}
const std::string filepath = parser.option("i").argument();
// In this example, we only read images.
// This constructor allows you to concisely enabled images and disable audio frames.
demuxer cap({filepath, video_enabled, audio_disabled});
if (!cap.is_open())
{
printf("%s is not a valid video file\n", filepath.c_str());
return EXIT_FAILURE;
}
// Print all the demuxer's properties for fun
print_properties(cap);
// Read all images and plot
array2d<rgb_pixel> img;
image_window win;
while (cap.read(img))
win.set_image(img);
return EXIT_SUCCESS;
}
catch (const std::exception& e)
{
printf("%s\n", e.what());
return EXIT_FAILURE;
}