openvino.runtime

openvino module namespace, exposing factory functions for all ops and other classes.

Functions

compile_model(model[, device_name, config])	Compact method to compile model with AUTO plugin.
get_batch(arg0)
get_version()
save_model(model, output_model, compress_to_fp16)	Save model into IR files (xml and bin).
serialize(model, xml_path, bin_path, version)	Serialize given model into IR. The generated .xml and .bin files will be saved into provided paths. This method serializes model "as-is" that means no weights compression is applied. It is recommended to use ov::save_model function instead of ov::serialize in all cases when it is not related to debugging. :param model: model which will be converted to IR representation :type model: openvino.runtime.Model :param xml_path: path where .xml file will be saved :type xml_path: Union[str, bytes, pathlib.Path] :param bin_path: path where .bin file will be saved (optional), the same name as for xml_path will be used by default. :type bin_path: Union[str, bytes, pathlib.Path] :param version: version of the generated IR (optional). Supported versions are: - "UNSPECIFIED" (default) : Use the latest or model version - "IR_V10" : v10 IR - "IR_V11" : v11 IR.
set_batch(*args, **kwargs)	Overloaded function.
shutdown()	Shut down the OpenVINO by deleting all static-duration objects allocated by the library and releasing dependent resources
tensor_from_file(path)	Create Tensor from file.

Classes

AsyncInferQueue	AsyncInferQueue with a pool of asynchronous requests.
AxisSet	openvino.runtime.AxisSet wraps ov::AxisSet
AxisVector	openvino.runtime.AxisVector wraps ov::AxisVector
CompiledModel(other)	CompiledModel class.
ConstOutput	openvino.runtime.ConstOutput represents port/node output.
Coordinate	openvino.runtime.Coordinate wraps ov::Coordinate
CoordinateDiff	openvino.runtime.CoordinateDiff wraps ov::CoordinateDiff
Core	Core class represents OpenVINO runtime Core entity.
Dimension	openvino.runtime.Dimension wraps ov::Dimension
DiscreteTypeInfo	openvino.runtime.DiscreteTypeInfo wraps ov::DiscreteTypeInfo
Extension	openvino.runtime.Extension provides the base interface for OpenVINO extensions.
InferRequest(other)	InferRequest class represents infer request which can be run in asynchronous or synchronous manners.
Input	openvino.runtime.Input wraps ov::Input<Node>
Layout	openvino.runtime.Layout wraps ov::Layout
Model(*args, **kwargs)
Node	openvino.runtime.Node wraps ov::Node
OVAny	openvino.runtime.OVAny provides object wrapper for OpenVINOov::Any class.
Output	openvino.runtime.Output represents port/node output.
PartialShape	openvino.runtime.PartialShape wraps ov::PartialShape
ProfilingInfo	openvino.runtime.ProfilingInfo contains performance metrics for single node.
RTMap	openvino.runtime.RTMap makes bindings for std::map<std::string, ov::Any>, which can later be used as ov::Node::RTMap
Shape	openvino.runtime.Shape wraps ov::Shape
Strides	openvino.runtime.Strides wraps ov::Strides
Tensor	openvino.runtime.Tensor holding either copy of memory or shared host memory.
Type	openvino.runtime.Type wraps ov::element::Type
Version	openvino.runtime.Version represents version information that describes plugins and the OpenVINO library.