Namespace for data structures. More...

Classes
struct	AlgoThreadProperties
	Properties of an algorithm thread. More...

struct	ConfigItem
	Configuration item containing its category, name, and JSON value. More...

struct	ConfigProperties
	Configuration properties containing its module, name, and JSON string. More...

struct	CorpusProperties
	Corpus properties containing the type, table, and column name of its source. More...

struct	CrawlStatsTick
	Statistics for crawling tick. More...

struct	CrawlTimersContent
	Timers for crawling content. More...

struct	CrawlTimersTick
	Timers for crawling tick. More...

struct	DatabaseSettings
	Database settings containing its host, port, user, password, schema, and compression. More...

struct	DataEntry
	A data entry containing either parsed or extracted data. More...

struct	ModuleOptions
	Module options containing the thread ID, as well as ID and namespace of website and URL list used by the thread. More...

struct	NetworkSettings
	Network settings containing the default proxy as well as host, port, and password of the TOR control server. More...

struct	QueryProperties
	Query properties containing its name, text, type, and result type(s). More...

struct	QueryStruct
	Structure to identify a query including its type and result type(s). More...

struct	ServerCommandResponse
	Response from the command-and-control server. More...

struct	ServerSettings
	Server settings containing its port, as well as allowed clients, origins, and actions. More...

struct	StatusSetter
	Structure containing all the data needed to keep the status of a thread updated. More...

struct	TableColumn
	Structure for table columns containing its name, type, reference, and indexing. More...

struct	TableProperties
	Table properties containing its name, columns, data directory, and compression. More...

struct	TargetTableProperties
	Target table properties containing its type, website, URL list, table names, columns, and compression. More...

struct	TextMapEntry
	Text map entry. More...

struct	ThreadDatabaseEntry
	Information about a thread as stored in the database, containing both the options for and the status of the thread. More...

struct	ThreadOptions
	Thread options containing the name of the module run, as well as the IDs of the website, URL list, and configuration used. More...

struct	ThreadStatus
	Thread status containing its ID, status message, pause state, and progress. More...

struct	TopicModelInfo
	Structure containing information about the currently trained Hierarchical Dirichlet Process (HDP) model. More...

struct	UrlListProperties
	Properties of a URL list containing its namespace and name. More...

struct	WebsiteProperties
	Website properties containing its domain, namespace, name, and data directory. More...

Typedefs
using	TextMap = std::vector< TextMapEntry >
	A text map is defined as a vector of text map entries. More...

Constants
constexpr auto	serverSleepOnSqlErrorDefault {60}

constexpr auto	precisionProgress {2}
	The precision (number of fractal digits) when showing the progress in percent. More...

constexpr auto	percentageFactor {100}
	The factor for converting a fractal into a percentage. More...

Detailed Description

Namespace for data structures.

Typedef Documentation

◆ TextMap

using crawlservpp::Struct::TextMap = typedef std::vector<TextMapEntry>

A text map is defined as a vector of text map entries.

Variable Documentation

◆ percentageFactor

constexpr auto crawlservpp::Struct::percentageFactor {100}

inline

The factor for converting a fractal into a percentage.

Referenced by crawlservpp::Struct::StatusSetter::update().

◆ precisionProgress

constexpr auto crawlservpp::Struct::precisionProgress {2}

inline

The precision (number of fractal digits) when showing the progress in percent.

Referenced by crawlservpp::Struct::StatusSetter::update().

◆ serverSleepOnSqlErrorDefault

constexpr auto crawlservpp::Struct::serverSleepOnSqlErrorDefault {60}

Classes

Typedefs