ThreadedInferenceInterface.h File Reference

This manages multiple threads for running inference. This requires a subclass to define run_thread, which is what each individual thread should do. All threads can then be called with run(Control, Args... args), which copies the control for each thread (setting threads=1) and then passes the args arguments onward. More...

#include <atomic>
#include <mutex>
#include <thread>
#include "Control.h"
#include "SampleStreams.h"
#include "ConcurrentQueue.h"

Include dependency graph for ThreadedInferenceInterface.h:

This graph shows which files directly or indirectly include this file:

Go to the source code of this file.

Classes
class	ThreadedInferenceInterface< X, Args >

Detailed Description

This manages multiple threads for running inference. This requires a subclass to define run_thread, which is what each individual thread should do. All threads can then be called with run(Control, Args... args), which copies the control for each thread (setting threads=1) and then passes the args arguments onward.