deepview_tensorflow

TensorFlow extensions of DeepView.

class deepview_tensorflow.TFDatasetExamples[source]

Bases: object

Example TF Datasets, each bundled as a DeepView Producer. Loaded from tf.keras.dataset.

class CIFAR10(split_dataset=None, attach_metadata=True, max_samples=-1, write_to_folder=False)

Bases: _KerasDatasetWithStrLabels

The CIFAR10 dataset, loaded from tf.keras.dataset, that produces Batches.

Metadata labels for this dataset:

['airplane', 'automobile', 'bird', 'cat', 'deer', 'dog', 'frog', 'horse', 'ship', 'truck']

Parameters:
class CIFAR100(split_dataset=None, attach_metadata=True, max_samples=-1, label_mode='fine')

Bases: _KerasDatasetWithStrLabels

Load CIFAR100 dataset, loaded from tf.keras.dataset, that produces Batches.

Metadata labels for this dataset (fine):

['apple', 'aquarium_fish', 'baby', 'bear', 'beaver', 'bed', 'bee', 'beetle', 'bicycle', 'bottle', 'bowl', 'boy', 'bridge', 'bus', 'butterfly', 'camel', 'can', 'castle', 'caterpillar', 'cattle', 'chair', 'chimpanzee', 'clock', 'cloud', 'cockroach', 'couch', 'crab', 'crocodile', 'cup', 'dinosaur', 'dolphin', 'elephant', 'flatfish', 'forest', 'fox', 'girl', 'hamster', 'house', 'kangaroo', 'keyboard', 'lamp', 'lawn_mower', 'leopard', 'lion', 'lizard', 'lobster', 'man', 'maple_tree', 'motorcycle', 'mountain', 'mouse', 'mushroom', 'oak_tree', 'orange', 'orchid', 'otter', 'palm_tree', 'pear', 'pickup_truck', 'pine_tree', 'plain', 'plate', 'poppy', 'porcupine', 'possum', 'rabbit', 'raccoon', 'ray', 'road', 'rocket', 'rose', 'sea', 'seal', 'shark', 'shrew', 'skunk', 'skyscraper', 'snail', 'snake', 'spider', 'squirrel', 'streetcar', 'sunflower', 'sweet_pepper', 'table', 'tank', 'telephone', 'television', 'tiger', 'tractor', 'train', 'trout', 'tulip', 'turtle', 'wardrobe', 'whale', 'willow_tree', 'wolf', 'woman', 'worm']

Metadata labels for this dataset (coarse):

['aquatic_mammals', 'fish', 'flowers', 'food_containers', 'fruit_and_vegetables', 'household_electrical_devices', 'household_furniture', 'insects', 'large_carnivores', 'large_man-made_outdoor_things', 'large_natural_outdoor_scenes', 'large_omnivores_and_herbivores', 'medium_mammals', 'non-insect_invertebrates', 'people', 'reptiles', 'small_mammals', 'trees', 'vehicles_1', 'vehicles_2']

Parameters:
class FashionMNIST(split_dataset=None, attach_metadata=True, max_samples=-1, write_to_folder=False)

Bases: _KerasDatasetWithStrLabels

Load FashionMNIST dataset, loaded from tf.keras.dataset, that produces Batches.

Metadata labels for this dataset:

['T-shirt/top', 'Trouser', 'Pullover', 'Dress', 'Coat', 'Sandal', 'Shirt', 'Sneaker', 'Bag', 'Ankle boot']

Parameters:
class MNIST(split_dataset=None, attach_metadata=True, max_samples=-1, write_to_folder=False)

Bases: _KerasDatasetLoader

Load MNIST dataset, loaded from tf.keras.dataset, that produces Batches.

Metadata labels for this dataset:

[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]

Parameters:
class deepview_tensorflow.TFModelExamples[source]

Bases: object

Out-of-the-box TF and Keras models with pre- and post-processing.

EfficientNetB0()

Load the EfficientNetB0 model and processing stages from Keras into DeepView.

EfficientNetB1()

Load the EfficientNetB1 model and processing stages from Keras into DeepView.

EfficientNetB7()

Load the EfficientNetB7 model and processing stages from Keras into DeepView.

EfficientNetV2B0()

Load the EfficientNetV2B0 model and processing stages from Keras into DeepView.

EfficientNetV2B3()

Load the EfficientNetV2B3 model and processing stages from Keras into DeepView.

EfficientNetV2L()

Load the EfficientNetV2L model and processing stages from Keras into DeepView.

MobileNet()

Load the MobileNet model and processing stages from Keras into DeepView.

MobileNetV2()

Load the MobileNetV2 model and processing stages from Keras into DeepView.

MobileNetV3Large()

Load the MobileNetV3Large model and processing stages from Keras into DeepView.

MobileNetV3Small()

Load the MobileNetV3Small model and processing stages from Keras into DeepView.

ResNet50()

Load the ResNet50 model and processing stages from Keras into DeepView.

ResNetV250()

Load the ResNet50V2 model and processing stages from Keras into DeepView.

classmethod list_supported_models()[source]

Returns a dictionary of all supported models keyed by their names.

Returns:

Dictionary mapping model names to their corresponding model factory functions.

Return type:

Dict[str, Callable[[…], TFModelWrapper]]

class deepview_tensorflow.TFModelWrapper(model, preprocessing=None, postprocessing=None)[source]

Bases: object

A wrapper for loading TensorFlow models into DeepView Models and PipelineStages, with their pre- and post-processing functions built-in.

Parameters:
__call__(requested_responses=None)[source]

Generate a PipelineStage that preprocesses Batches for the Model, runs the model with the requested responses, and postprocesses responses before returning them.

Note

If the instance’s postprocessing or preprocessing properties are None, it will ignore those steps`.

Parameters:

requested_responses (None | str | Collection[str]) – passed to the DeepView Model. Determines which outputs from the model will be present in the Batch output by the resulting PipelineStage.

Returns:

a single PipelineStage or list of PipelineStages

Return type:

PipelineStage | Collection[PipelineStage] | Sequence[PipelineStage | Collection[PipelineStage]]

classmethod from_keras(model, preprocessing)[source]

Convenience method for loading as TFModelWrapper from Keras models and preprocessors.

Note

When subclassing TFModelWrapper and there are additional pre-postprocessing steps to run outside of Keras’s preprocessing, modify the respective attribute of the return object to add those steps as PipelineStages.

Parameters:

  • model (Model) – TensorFlow Keras model

  • preprocessing (Callable[[ndarray], ndarray]) – keras preprocessing function to transform data

Return type:

TFModelWrapper

static load_keras_model(model)[source]

Saves TF Keras model to disk and reloads it as a DeepView Model.

Parameters:

model (Model) – TF Keras model

Return type:

Model

model: Model

DeepView Model to put into DeepView pipeline

postprocessing: None | PipelineStage | Collection[PipelineStage] = None

One or many DeepView PipelineStages for post-processing batches after model output

preprocessing: None | PipelineStage | Collection[PipelineStage] = None

One or many DeepView PipelineStages for pre-processing batches for this model

property response_infos: Mapping[str, ResponseInfo]

Get all possible responses in a model. Result is returned as a mapping between response names and the corresponding ResponseInfo.

deepview_tensorflow.load_tf_model_from_memory(*, model=None)[source]

Initialize a TensorFlow Model from a model loaded in memory. This function is supported for TF2, but different parameters are required. For TF2, only pass parameter model.

Parameters:

model (Model | None) – Pass only this parameter when running TensorFlow 2. This is the TF Keras model.

Returns:

A TensorFlow Model.

Return type:

Model

deepview_tensorflow.load_tf_model_from_path(path)[source]

Initialize a TensorFlow Model from a model serialized in path

Currently accepted serialized model formats, depending on if TF 1 or TF 2 is running.

TF2 Supported formats:

  • TensorFlow Keras

  • Keras whole models (h5)

  • Keras models with separate architecture and weights files

Note

The keras loaders are currently using tf.keras instead of keras natively, and so issues might appear when trying to load models saved with native keras (not tf.keras). In this case, load the model outside of DeepView with keras and pass it to load with load_tf_model_from_memory.

Parameters:

path (str | Path) – Model path (for single model file) or directory that contains all the model files.

Returns:

A DeepView TensorFlow Model.

Return type:

Model