Performance

Below are performance measurements of each augmenter for image augmentation (augment_images()), heatmap augmentation (augment_heatmaps()) and keypoint/landmark augmentation (augment_keypoints()). (Last updated for 0.3.0)

System: The numbers were computed based on a haswell-generation i7 3.2Ghz CPU with DDR3 memory. That is a rather dated system by today’s standards. A modern, high-end system should achieve higher bandwidths.

All experiments were conducted using python 3.7 and numpy 1.17.0. Note that the precise python/numpy version can have significant impact on your performance.

Experiments Settings: All augmenters were run with reasonable parameter choices that should reflect expected real-world usage, while avoiding too simple parameter values that would lead to inflated scores. Some parameter choices are listed below, the remaining ones can be looked up in measure_performance.py. Kernel sizes were all set to 3x3, unless otherwise mentioned. The inputs focused on a small and large image-size setting, using 64x64x3 and 224x224x3 as the respective sizes. The base image was taken from skimage.data.astronaut, which should be a representative real-world image. Batch sizes of 1 and 128 were tested. Each augmenter was run at least 40 times on the generated input and the average of the measured runtimes was computed to derive bandwidth in mbit per second and th raw number of augmented items (e.g. images) per second.

Results Overview

From the results, the following points can be derived.

Inputs:

  • Use large batch sizes whenever possible. Many augmenters are significantly faster with these.
  • Large image sizes lead to higher throughput based on mbit/sec. Smaller images lead to lower throughput, but significantly more items/sec (roughly 4-10x more). Use small images whenever possible.
  • For keypoint-based and heatmap-based augmentation, try to increase the number of items per augmented instance. E.g. augment_keypoints() accepts a list of KeypointsOnImage instances, with each such instance representing the keypoints on an image. Try to place for each image all keypoints in the respective KeypointsOnImage instance instead of splitting them into multiple such instances (which would be more work anyways). The same is true for bounding boxes, heatmaps and segmentation maps.
  • Keypoint- and heatmap-based inputs are only affected by augmenters that change the geometry of the image (e.g. Crop or Affine). Other augmenters are essentially free to execute as they do not perform any changes.
  • Keypoint-based augmentation is very fast for almost all augmenters, reaching several 100k keypoints per second. Slower augmenters are ElasticTransformation and PiecewiseAffine, as these currently have to fall back to image-based algorithms.

Parameter choices:

  • When possible, nearest neighbour interpolation or linear interpolation should be used as these are significantly faster than other options. Most augmenters that use interpolation offer either an order parameter (0=nearest neighbour, 1=linear) or an interpolation parameter (“nearest”, “linear”).
  • Using keep_size=True is the default setting in all augmenters that change image sizes. It is convenient, as it ensures that image sizes are not altered by the augmentation. It does however incur a significant performance penalty, often more than halving the bandwidth. Try keep_size=False when possible. You can still resize images manually after augmentation or by using KeepSizeByResize(Sequential(<augmenters>)).
  • When augmenters offer modes to fill newly created pixels in user-defined ways (e.g. pad_mode=constant in Pad to fill up all padded pixels with a specified constant color), using edge instead of constant will usually not incur a significant performance penalty.

Specific Augmenter suggestions:

  • For augmenters where an elementwise sibling exists (e.g. Multiply and MultiplyElementwise), the elementwise augmenter is usually significantly slower than the non-elementwise one.
  • If blurring is required, AverageBlur is the fastest choice, followed by GaussianBlur.
  • Augmenters that operate on coarser images (e.g. CoarseDropout vs Dropout) can be significantly faster than their non-coarse siblings.
  • Contrast normalizing augmenters are all comparable in performance, except for histogram-based ones, which are significantly slower.
  • PiecewiseAffine is a very slow augmenter and should usually be replaced by ElasticTransformation, which achieves similar outputs and is quite a bit faster.
  • Superpixels is a fairly slow augmenter and should usually be wrapped in e.g. Sometimes to not apply it very often and reduce its performance impact.
  • Weather augmenters other than FastSnowyLandscape are rather slow and should only be used when sensible.

Images

Numbers below are for small images (64x64x3) and large images (224x224x3). B=1 denotes a batch size of 1, B=128 one of 128.

In mbit/sec:

  64x64x3, uint8 224x224x3, uint8
Augmenter B=1 B=128 B=1 B=128
Sequential (2xIdentity) 1114.3 24601.3 9815.7 41557.9
Sequential (2xIdentity, random_order) 903.3 25450.9 8697.9 44898.0
SomeOf (1-3, 3xIdentity) 226.2 3800.6 2114.2 5298.8
SomeOf (1-3, 3xIdentity, random_order) 220.9 3717.7 2037.7 6109.3
OneOf (3xIdentity) 533.9 7941.3 4486.2 9188.2
Sometimes (Identity) 367.3 12894.4 3763.7 16674.9
WithChannels ([1,2], Identity) 541.2 4932.7 3668.9 5067.2
Identity 1364.5 26741.2 11791.9 41261.7
Noop 1341.4 27020.1 11611.5 43892.6
Lambda (return input) 1262.1 24919.0 10837.8 45355.8
AssertLambda (return True) 1244.8 26346.3 10864.2 41681.0
AssertShape (None, H, W, None) 1068.8 14590.1 9860.2 39299.2
ChannelShuffle (0.5) 418.4 3159.3 3285.1 6240.3
Add 137.7 595.5 1972.4 3917.6
AddElementwise 201.3 307.5 909.8 1038.9
AdditiveGaussianNoise 167.5 218.5 695.9 764.6
AdditiveLaplaceNoise 147.2 185.2 419.3 446.9
AdditivePoissonNoise 122.5 151.0 294.5 305.2
Multiply 240.3 770.4 2156.3 4443.5
MultiplyElementwise 188.0 276.9 876.7 972.0
Cutout (1 iter, constant fill) 151.0 1288.6 1723.9 11726.9
Dropout (1-5%) 225.9 353.6 995.3 1155.3
CoarseDropout (1-5%, size=1-10%) 133.4 172.6 1039.0 1219.8
Dropout2d (10%) 324.1 5696.8 3569.2 23901.3
TotalDropout (10%) 450.4 19944.9 4948.5 39754.0
ReplaceElementwise 129.9 161.9 676.8 760.5
ImpulseNoise 112.4 135.2 469.9 499.1
SaltAndPepper 118.9 141.1 643.7 711.4
CoarseSaltAndPepper 86.9 98.6 666.4 725.9
Salt 99.8 114.2 590.8 639.7
CoarseSalt 78.6 86.5 606.6 659.1
Pepper 97.9 105.7 589.5 640.8
CoarsePepper 78.7 86.1 605.5 660.8
Invert (10%) 266.5 5468.8 2992.8 22669.1
JpegCompression (50-99%) 81.9 103.7 420.6 458.5
Cartoon 6.0 5.8 7.1 6.6
BlendAlpha (Identity) 128.7 402.0 810.2 993.7
BlendAlphaElementwise (Identity) 130.7 207.0 450.3 453.7
BlendAlphaSimplexNoise (Identity) 24.7 28.3 175.4 186.9
BlendAlphaFrequencyNoise (Identity) 33.2 36.5 210.8 221.4
BlendAlphaSomeColors (Identity) 64.2 161.0 330.7 450.6
BlendAlphaHorizontalL.Grad. (Identity) 87.5 238.1 416.3 533.4
BlendAlphaVerticalL.Grad. (Identity) 87.9 231.9 407.5 508.0
BlendAlphaRegularGrid (Identity) 85.0 230.2 398.7 503.6
BlendAlphaCheckerboard (Identity) 86.0 200.2 399.0 487.2
GaussianBlur (sigma=(1,5)) 191.7 532.7 1528.9 2530.2
AverageBlur 245.4 1474.4 2021.4 4530.9
MedianBlur 129.8 257.4 267.7 304.9
BilateralBlur 101.3 269.3 281.9 346.3
MotionBlur 56.2 64.1 541.7 579.6
MeanShiftBlur 1.4 1.4 1.3 1.1
RandAugment (n=2, m=(6,12)) 24.0 128.1 222.4 488.9
WithColorspace (HSV, Identity) 291.6 974.1 1691.5 2141.7
WithBrightnessChannels (Identity) 43.5 736.9 1097.9 1605.2
MultiplyAndAddToBrightness 71.4 251.4 665.1 1043.4
MultiplyBrightness 113.4 396.8 850.6 1237.8
AddToBrightness 109.3 347.8 841.2 1200.0
WithHueAndSaturation 168.1 334.5 687.6 719.3
MultiplyHueAndSaturation 82.5 152.1 440.5 481.0
MultiplyHue 74.3 150.1 438.3 489.6
MultiplySaturation 57.6 150.4 442.1 498.4
RemoveSaturation 70.9 150.6 433.1 509.1
AddToHueAndSaturation 131.1 443.1 828.5 1151.9
AddToHue 150.2 455.8 858.3 1153.3
AddToSaturation 139.9 460.5 865.3 1151.9
ChangeColorspace (HSV) 257.9 923.8 2258.6 3962.7
Grayscale 143.1 308.5 632.4 759.7
KMeansColorQuantization (2-16 colors) 30.3 37.5 183.5 197.3
UniformColorQuantization (2-16 colors) 127.9 354.5 1512.0 2601.1
UniformColorQuant.NBits (1-7 bits) 142.7 357.3 1508.6 2575.1
Posterize (1-7 bits) 136.4 356.7 1506.4 2579.3
GammaContrast 169.9 304.3 1832.4 2471.9
SigmoidContrast 153.9 234.2 1551.7 2046.2
LogContrast 183.9 303.1 1819.4 2455.2
LinearContrast 214.2 391.9 2048.0 2965.7
AllChannelsHistogramEqualization 519.5 1559.9 1858.7 2271.9
HistogramEqualization 268.5 892.9 1470.4 1801.0
AllChannelsCLAHE 112.9 326.2 878.5 1475.8
CLAHE 112.7 442.1 824.7 1446.8
Convolve (3x3) 430.6 1442.0 2833.3 4043.5
Sharpen 176.7 261.5 1282.2 1542.9
Emboss 176.9 262.5 1334.3 1604.0
EdgeDetect 234.2 392.3 1696.6 2056.0
DirectedEdgeDetect 90.3 107.5 827.8 886.4
Canny 54.6 103.9 280.3 349.6
Fliplr (p=100%) 446.1 2507.3 3359.3 6261.2
Flipud (p=100%) 564.7 9721.4 5475.0 13807.5
Affine (order=0, constant) 75.8 255.3 856.4 1934.4
Affine (order=1, constant) 75.5 236.2 773.5 1539.2
Affine (order=3, constant) 69.3 194.6 473.5 680.5
Affine (order=1, edge) 68.1 229.4 744.3 1493.8
Affine (order=1, constant, skimage) 39.2 73.6 180.0 203.1
PiecewiseAffine (4x4, order=1, constant) 3.9 4.3 25.6 25.4
PiecewiseAffine (4x4, order=0, constant) 4.3 4.5 30.6 30.4
PiecewiseAffine (4x4, order=1, edge) 4.1 4.4 25.4 25.3
PiecewiseAffine (8x8, order=1, constant) 0.9 0.9 8.4 8.2
PerspectiveTransform 96.5 473.9 885.5 1789.6
PerspectiveTransform (keep_size) 92.5 313.1 688.3 1144.2
ElasticTransformation (order=0, constant) 82.5 158.3 543.1 668.8
ElasticTransformation (order=1, constant) 80.6 149.2 499.7 606.4
ElasticTransformation (order=1, nearest) 80.5 150.1 494.4 606.1
ElasticTransformation (order=1, reflect) 81.5 149.1 500.4 604.1
Rot90 273.5 3981.3 3416.2 23912.1
Rot90 (keep_size) 265.8 2193.9 1983.7 3528.7
WithPolarWarping (Identity) 259.1 639.9 948.2 1076.6
Jigsaw (rows/cols=(3,8), 1 step) 62.5 107.0 728.7 1119.5
AveragePooling 97.1 175.8 434.7 506.6
AveragePooling (keep_size) 91.1 148.5 392.8 461.7
MaxPooling 100.7 187.6 460.6 545.0
MaxPooling (keep_size) 92.7 158.6 431.4 493.4
MinPooling 102.7 187.6 467.5 549.5
MinPooling (keep_size) 95.1 157.5 426.1 501.6
MedianPooling 94.3 171.6 557.5 690.0
MedianPooling (keep_size) 90.1 146.4 513.8 612.0
imgcorruptlike.GaussianNoise((1,5)) 70.9 130.5 180.7 191.7
imgcorruptlike.ShotNoise((1,5)) 52.0 68.0 83.9 85.6
imgcorruptlike.ImpulseNoise((1,5)) 62.6 89.1 143.0 150.0
imgcorruptlike.SpeckleNoise((1,5)) 81.5 130.8 175.4 187.9
imgcorruptlike.GaussianBlur((1,5)) 72.0 114.9 195.8 215.4
imgcorruptlike.GlassBlur((1,5)) 2.0 2.3 2.1 2.2
imgcorruptlike.DefocusBlur((1,5)) 56.8 82.6 134.5 136.4
imgcorruptlike.MotionBlur((1,5)) 19.2 22.6 62.5 62.6
imgcorruptlike.ZoomBlur((1,5)) 8.0 9.1 11.6 11.3
imgcorruptlike.Fog((1,5)) 33.1 50.9 171.0 178.4
imgcorruptlike.Frost((1,5)) 10.0 11.2 113.2 116.8
imgcorruptlike.Snow((1,5)) 26.1 29.3 68.9 67.8
imgcorruptlike.Spatter((1,5)) 54.2 69.0 135.7 141.3
imgcorruptlike.Contrast((1,5)) 113.7 206.4 364.7 420.1
imgcorruptlike.Brightness((1,5)) 38.1 46.2 48.1 54.2
imgcorruptlike.Saturate((1,5)) 34.7 46.0 48.4 54.0
imgcorruptlike.JpegCompression((1,5)) 82.7 165.2 473.9 549.1
imgcorruptlike.Pixelate((1,5)) 141.5 321.1 1013.5 1443.7
imgcorruptlike.ElasticTransform((1,5)) 36.1 44.1 56.2 58.6
pillike.Solarize (p=1.0) 183.2 843.5 1801.5 4531.2
pillike.Posterize (1-7 bits) 120.7 360.9 1449.0 2578.7
pillike.Equalize 163.9 288.2 1349.4 1651.2
pillike.Autocontrast 69.5 98.6 748.8 860.6
pillike.EnhanceColor 190.3 587.5 937.4 1223.3
pillike.EnhanceContrast 164.2 370.0 842.4 1048.7
pillike.EnhanceBrightness 212.9 630.2 1017.1 1318.0
pillike.EnhanceSharpness 178.8 422.3 590.4 685.5
pillike.FilterBlur 233.6 375.4 459.2 484.6
pillike.FilterSmooth 327.7 588.8 911.2 1006.7
pillike.FilterSmoothMore 250.2 374.5 465.4 483.8
pillike.FilterEdgeEnhance 288.4 530.9 817.9 890.3
pillike.FilterEdgeEnhanceMore 293.1 523.0 791.9 854.0
pillike.FilterFindEdges 297.9 530.3 756.3 817.9
pillike.FilterContour 285.2 523.1 746.7 803.2
pillike.FilterEmboss 282.2 586.0 910.7 1000.1
pillike.FilterSharpen 256.6 579.5 868.7 945.4
pillike.FilterDetail 304.5 586.4 880.1 970.5
pillike.Affine 66.3 302.8 709.5 1787.3
Superpixels (max_size=64, cubic) 9.4 10.4 118.4 121.8
Superpixels (max_size=64, linear) 9.9 10.4 118.7 122.6
Superpixels (max_size=128, linear) 8.0 10.6 49.5 49.2
Superpixels (max_size=224, linear) 7.6 10.6 19.5 19.1
UniformVoronoi (250-1000k points, linear) 2.7 3.6 12.1 12.0
RegularGridVoronoi (16-31 rows/cols) 3.5 3.6 12.0 12.1
RelativeRegularGridVoronoi (7%-14% rows/cols) 3.7 3.7 4.0 4.0
Resize (nearest) 186.3 735.5 1988.3 4347.1
Resize (linear) 176.0 629.9 1537.8 2701.5
Resize (cubic) 177.0 559.4 1187.7 1804.3
CropAndPad 118.9 700.3 1422.4 5080.6
CropAndPad (edge) 118.9 705.6 1449.5 5085.0
CropAndPad (keep_size) 104.7 376.3 1018.1 1863.5
Crop 153.0 1293.5 1974.8 8596.2
Crop (keep_size) 130.8 501.6 1275.2 2401.9
Pad 122.2 678.8 1384.0 4678.5
Pad (edge) 118.7 683.5 1390.6 4572.7
Pad (keep_size) 101.6 371.7 954.2 1708.9
PadToFixedSize 130.8 916.5 1653.7 5908.8
CropToFixedSize 228.9 3102.1 2756.7 11098.3
KeepSizeByResize (CropToFixedSize(nearest)) 139.8 880.7 1471.7 3604.7
KeepSizeByResize (CropToFixedSize(linear)) 134.2 761.3 1230.6 2456.9
KeepSizeByResize (CropToFixedSize(cubic)) 133.0 660.3 1002.8 1682.4
FastSnowyLandscape 116.8 243.5 483.0 542.8
Clouds 16.9 20.3 61.7 61.1
Fog 31.3 33.9 98.3 99.5
CloudLayer 30.7 33.0 99.1 98.9
Snowflakes 14.2 15.1 91.3 85.5
SnowflakesLayer 28.5 30.3 173.5 173.2
Rain 11.1 11.6 58.5 54.2
RainLayer 22.0 23.5 110.4 112.1

In images/sec:

  64x64x3, uint8 224x224x3, uint8
Augmenter B=1 B=128 B=1 B=128
Sequential (2xIdentity) 11885.5 262413.9 8547.0 36186.5
Sequential (2xIdentity, random_order) 9635.6 271476.0 7573.7 39094.8
SomeOf (1-3, 3xIdentity) 2412.6 40539.6 1840.9 4613.9
SomeOf (1-3, 3xIdentity, random_order) 2356.3 39655.4 1774.3 5319.7
OneOf (3xIdentity) 5695.0 84707.6 3906.3 8000.6
Sometimes (Identity) 3917.9 137540.7 3277.2 14519.7
WithChannels ([1,2], Identity) 5772.9 52615.6 3194.7 4412.2
Identity 14554.8 285239.9 10267.7 35928.5
Noop 14308.5 288214.7 10110.7 38219.4
Lambda (return input) 13462.3 265802.2 9437.0 39493.5
AssertLambda (return True) 13277.6 281027.4 9460.0 36293.6
AssertShape (None, H, W, None) 11400.9 155628.0 8585.7 34219.7
ChannelShuffle (0.5) 4462.7 33699.4 2860.5 5433.8
Add 1468.7 6351.5 1717.5 3411.2
AddElementwise 2147.0 3279.9 792.2 904.6
AdditiveGaussianNoise 1787.2 2330.6 605.9 665.8
AdditiveLaplaceNoise 1570.5 1975.4 365.1 389.2
AdditivePoissonNoise 1306.5 1610.3 256.5 265.7
Multiply 2563.5 8217.8 1877.6 3869.2
MultiplyElementwise 2005.8 2953.5 763.4 846.4
Cutout (1 iter, constant fill) 1611.1 13745.5 1501.1 10211.1
Dropout (1-5%) 2409.4 3771.3 866.7 1006.0
CoarseDropout (1-5%, size=1-10%) 1423.1 1840.8 904.7 1062.1
Dropout2d (10%) 3457.4 60765.5 3107.9 20812.0
TotalDropout (10%) 4804.7 212745.7 4308.9 34615.7
ReplaceElementwise 1385.7 1727.3 589.3 662.2
ImpulseNoise 1199.5 1442.0 409.2 434.6
SaltAndPepper 1267.9 1504.9 560.5 619.4
CoarseSaltAndPepper 926.8 1051.4 580.3 632.1
Salt 1064.4 1218.0 514.5 557.0
CoarseSalt 838.3 923.2 528.2 573.9
Pepper 1043.9 1127.7 513.3 558.0
CoarsePepper 839.9 918.5 527.3 575.4
Invert (10%) 2842.5 58334.2 2606.0 19739.1
JpegCompression (50-99%) 873.3 1106.0 366.2 399.3
Cartoon 64.0 61.6 6.2 5.8
BlendAlpha (Identity) 1373.3 4288.0 705.5 865.3
BlendAlphaElementwise (Identity) 1393.6 2207.6 392.1 395.1
BlendAlphaSimplexNoise (Identity) 263.7 302.2 152.8 162.7
BlendAlphaFrequencyNoise (Identity) 354.2 389.8 183.6 192.8
BlendAlphaSomeColors (Identity) 684.8 1717.7 288.0 392.4
BlendAlphaHorizontalL.Grad. (Identity) 933.1 2539.4 362.5 464.4
BlendAlphaVerticalL.Grad. (Identity) 937.3 2473.5 354.8 442.3
BlendAlphaRegularGrid (Identity) 906.5 2455.6 347.2 438.5
BlendAlphaCheckerboard (Identity) 917.6 2135.5 347.4 424.2
GaussianBlur (sigma=(1,5)) 2045.3 5681.7 1331.3 2203.2
AverageBlur 2617.3 15727.3 1760.1 3945.2
MedianBlur 1384.8 2745.8 233.1 265.5
BilateralBlur 1080.3 2872.0 245.5 301.5
MotionBlur 599.6 683.8 471.6 504.7
MeanShiftBlur 15.3 14.5 1.1 1.0
RandAugment (n=2, m=(6,12)) 255.7 1366.3 193.7 425.7
WithColorspace (HSV, Identity) 3110.5 10389.9 1472.9 1864.8
WithBrightnessChannels (Identity) 464.3 7860.5 956.0 1397.7
MultiplyAndAddToBrightness 761.1 2682.0 579.1 908.5
MultiplyBrightness 1209.1 4232.3 740.7 1077.8
AddToBrightness 1165.7 3710.0 732.5 1044.9
WithHueAndSaturation 1793.2 3568.3 598.7 626.3
MultiplyHueAndSaturation 880.0 1622.2 383.5 418.8
MultiplyHue 792.7 1601.0 381.6 426.3
MultiplySaturation 614.6 1604.2 384.9 434.0
RemoveSaturation 756.1 1606.7 377.1 443.3
AddToHueAndSaturation 1398.0 4726.3 721.5 1003.0
AddToHue 1602.0 4862.4 747.3 1004.3
AddToSaturation 1491.8 4912.4 753.4 1003.0
ChangeColorspace (HSV) 2750.6 9853.8 1966.7 3450.5
Grayscale 1526.8 3290.8 550.6 661.5
KMeansColorQuantization (2-16 colors) 323.3 400.4 159.7 171.8
UniformColorQuantization (2-16 colors) 1364.2 3781.6 1316.6 2264.9
UniformColorQuant.NBits (1-7 bits) 1521.9 3811.1 1313.6 2242.3
Posterize (1-7 bits) 1455.0 3805.0 1311.7 2245.9
GammaContrast 1812.4 3245.3 1595.6 2152.4
SigmoidContrast 1641.5 2498.6 1351.1 1781.8
LogContrast 1962.1 3233.2 1584.2 2137.8
LinearContrast 2285.2 4180.7 1783.3 2582.4
AllChannelsHistogramEqualization 5540.9 16639.1 1618.4 1978.2
HistogramEqualization 2863.9 9524.3 1280.3 1568.2
AllChannelsCLAHE 1204.0 3480.0 765.0 1285.1
CLAHE 1202.2 4716.2 718.1 1259.8
Convolve (3x3) 4593.4 15381.1 2467.1 3520.9
Sharpen 1885.1 2789.7 1116.5 1343.5
Emboss 1887.4 2799.9 1161.9 1396.6
EdgeDetect 2497.6 4184.9 1477.3 1790.2
DirectedEdgeDetect 963.3 1146.6 720.8 771.8
Canny 582.2 1108.6 244.0 304.4
Fliplr (p=100%) 4758.0 26744.7 2925.1 5452.0
Flipud (p=100%) 6023.3 103695.3 4767.3 12022.8
Affine (order=0, constant) 808.8 2723.2 745.7 1684.4
Affine (order=1, constant) 805.8 2519.9 673.5 1340.2
Affine (order=3, constant) 739.2 2075.6 412.3 592.5
Affine (order=1, edge) 726.5 2447.5 648.1 1300.7
Affine (order=1, constant, skimage) 417.8 785.3 156.7 176.8
PiecewiseAffine (4x4, order=1, constant) 41.9 46.4 22.3 22.1
PiecewiseAffine (4x4, order=0, constant) 45.4 47.9 26.7 26.5
PiecewiseAffine (4x4, order=1, edge) 43.6 46.4 22.1 22.1
PiecewiseAffine (8x8, order=1, constant) 9.6 10.0 7.3 7.2
PerspectiveTransform 1029.6 5054.7 771.1 1558.3
PerspectiveTransform (keep_size) 986.5 3340.2 599.4 996.3
ElasticTransformation (order=0, constant) 880.3 1688.1 472.9 582.4
ElasticTransformation (order=1, constant) 859.3 1591.7 435.1 528.0
ElasticTransformation (order=1, nearest) 858.2 1601.2 430.5 527.7
ElasticTransformation (order=1, reflect) 868.9 1590.0 435.7 526.0
Rot90 2917.1 42467.5 2974.6 20821.4
Rot90 (keep_size) 2835.5 23402.1 1727.3 3072.6
WithPolarWarping (Identity) 2764.2 6825.5 825.7 937.4
Jigsaw (rows/cols=(3,8), 1 step) 666.4 1141.2 634.5 974.8
AveragePooling 1035.7 1875.7 378.5 441.2
AveragePooling (keep_size) 971.3 1584.3 342.0 402.0
MaxPooling 1074.4 2000.8 401.1 474.5
MaxPooling (keep_size) 988.8 1691.9 375.7 429.7
MinPooling 1095.3 2000.8 407.1 478.5
MinPooling (keep_size) 1014.9 1679.8 371.0 436.7
MedianPooling 1006.0 1830.6 485.5 600.8
MedianPooling (keep_size) 961.1 1561.4 447.4 532.9
imgcorruptlike.GaussianNoise((1,5)) 756.7 1391.8 157.4 166.9
imgcorruptlike.ShotNoise((1,5)) 554.9 725.7 73.0 74.5
imgcorruptlike.ImpulseNoise((1,5)) 667.6 950.0 124.5 130.6
imgcorruptlike.SpeckleNoise((1,5)) 869.7 1395.3 152.7 163.6
imgcorruptlike.GaussianBlur((1,5)) 768.0 1225.9 170.5 187.6
imgcorruptlike.GlassBlur((1,5)) 21.7 25.0 1.8 1.9
imgcorruptlike.DefocusBlur((1,5)) 606.1 881.0 117.1 118.8
imgcorruptlike.MotionBlur((1,5)) 204.5 241.3 54.5 54.6
imgcorruptlike.ZoomBlur((1,5)) 85.7 97.2 10.1 9.9
imgcorruptlike.Fog((1,5)) 352.7 543.3 148.9 155.3
imgcorruptlike.Frost((1,5)) 107.0 120.0 98.6 101.7
imgcorruptlike.Snow((1,5)) 278.7 312.6 60.0 59.1
imgcorruptlike.Spatter((1,5)) 578.1 735.7 118.1 123.0
imgcorruptlike.Contrast((1,5)) 1212.6 2201.8 317.5 365.8
imgcorruptlike.Brightness((1,5)) 406.3 493.3 41.9 47.2
imgcorruptlike.Saturate((1,5)) 369.8 490.8 42.1 47.1
imgcorruptlike.JpegCompression((1,5)) 882.6 1761.9 412.6 478.1
imgcorruptlike.Pixelate((1,5)) 1509.0 3425.1 882.5 1257.1
imgcorruptlike.ElasticTransform((1,5)) 384.6 470.0 48.9 51.0
pillike.Solarize (p=1.0) 1954.2 8997.3 1568.6 3945.5
pillike.Posterize (1-7 bits) 1288.0 3849.2 1261.7 2245.4
pillike.Equalize 1748.5 3074.6 1175.0 1437.8
pillike.Autocontrast 741.4 1052.1 652.0 749.3
pillike.EnhanceColor 2029.5 6266.6 816.2 1065.2
pillike.EnhanceContrast 1751.2 3946.7 733.6 913.2
pillike.EnhanceBrightness 2271.3 6722.4 885.6 1147.7
pillike.EnhanceSharpness 1907.0 4504.8 514.1 596.9
pillike.FilterBlur 2491.3 4004.4 399.8 422.0
pillike.FilterSmooth 3495.0 6280.4 793.5 876.6
pillike.FilterSmoothMore 2669.2 3995.1 405.2 421.2
pillike.FilterEdgeEnhance 3076.8 5662.9 712.2 775.2
pillike.FilterEdgeEnhanceMore 3126.6 5579.1 689.6 743.6
pillike.FilterFindEdges 3177.4 5656.8 658.6 712.2
pillike.FilterContour 3042.2 5580.0 650.2 699.4
pillike.FilterEmboss 3010.1 6251.0 793.0 870.8
pillike.FilterSharpen 2737.3 6181.6 756.4 823.2
pillike.FilterDetail 3248.1 6255.5 766.3 845.1
pillike.Affine 707.5 3229.4 617.8 1556.3
Superpixels (max_size=64, cubic) 100.2 111.0 103.1 106.1
Superpixels (max_size=64, linear) 106.0 111.4 103.4 106.7
Superpixels (max_size=128, linear) 84.9 112.9 43.1 42.8
Superpixels (max_size=224, linear) 81.6 113.1 17.0 16.7
UniformVoronoi (250-1000k points, linear) 28.4 38.8 10.5 10.4
RegularGridVoronoi (16-31 rows/cols) 37.7 38.7 10.4 10.5
RelativeRegularGridVoronoi (7%-14% rows/cols) 39.2 39.0 3.4 3.5
Resize (nearest) 1987.7 7844.9 1731.3 3785.2
Resize (linear) 1877.8 6718.6 1339.0 2352.3
Resize (cubic) 1887.5 5966.6 1034.2 1571.1
CropAndPad 1268.3 7470.3 1238.6 4423.9
CropAndPad (edge) 1268.3 7526.5 1262.1 4427.7
CropAndPad (keep_size) 1117.2 4013.7 886.5 1622.6
Crop 1632.5 13797.2 1719.6 7485.2
Crop (keep_size) 1395.5 5350.3 1110.3 2091.5
Pad 1303.7 7240.5 1205.1 4073.8
Pad (edge) 1266.5 7290.4 1210.8 3981.6
Pad (keep_size) 1084.1 3964.9 830.9 1488.0
PadToFixedSize 1394.9 9776.5 1439.9 5145.1
CropToFixedSize 2441.5 33089.5 2400.4 9663.8
KeepSizeByResize (CropToFixedSize(nearest)) 1491.3 9393.7 1281.5 3138.8
KeepSizeByResize (CropToFixedSize(linear)) 1431.7 8121.0 1071.5 2139.3
KeepSizeByResize (CropToFixedSize(cubic)) 1418.5 7043.0 873.2 1464.9
FastSnowyLandscape 1246.1 2597.6 420.6 472.6
Clouds 180.6 216.2 53.7 53.2
Fog 334.1 361.5 85.6 86.7
CloudLayer 327.1 352.4 86.3 86.2
Snowflakes 151.5 161.2 79.5 74.5
SnowflakesLayer 304.2 323.6 151.1 150.8
Rain 118.4 123.9 50.9 47.2
RainLayer 234.6 251.1 96.1 97.6

Heatmaps

Numbers below are for heatmaps on large images, i.e. 224x224x3. Smaller images were skipped for brevity. The heatmaps themselves can be small (64x64xN) or large (224x224xN), with N denoting the number of heatmaps per HeatmapsOnImage instance (i.e. the number of channels in the heatmaps array), for which below 1 and 5 are used. B=1 denotes a batch size of 1 , B=128 one of 128.

mbit/sec for 64x64x5 or 224x224x5 heatmaps on 224x224x3 images:

  64x64x5 on 224x224x3 224x224x5 on 224x224x3
Augmenter B=1 B=128 B=1 B=128
Sequential (2xIdentity) 1184.9 5580.5 10238.2 18880.1
Sequential (2xIdentity, random_order) 1104.8 5543.8 9429.3 18711.0
SomeOf (1-3, 3xIdentity) 720.2 5165.0 6854.4 18491.2
SomeOf (1-3, 3xIdentity, random_order) 706.3 5160.3 6742.9 18378.7
OneOf (3xIdentity) 1025.9 5388.7 9095.4 18752.7
Sometimes (Identity) 831.1 5479.9 7836.0 18087.9
WithChannels ([1,2], Identity) 901.2 2622.7 6464.3 7555.7
Identity 1329.3 5606.5 10585.6 18165.5
Noop 1351.5 5611.4 10479.4 18100.9
Lambda (return input) 1297.5 5567.3 10284.4 18183.9
AssertLambda (return True) 1300.8 5567.1 10235.6 18390.9
AssertShape (None, H, W, None) 1271.6 5431.1 10001.8 18122.9
ChannelShuffle (0.5) 1351.2 5589.4 10447.6 18398.7
Add 1360.6 5590.4 10432.7 18313.5
AddElementwise 1361.6 5640.5 10443.3 18461.2
AdditiveGaussianNoise 1351.0 5616.6 10528.6 18322.0
AdditiveLaplaceNoise 1362.5 5568.4 10364.0 18428.9
AdditivePoissonNoise 1359.3 5620.1 10447.9 18302.7
Multiply 1349.5 5619.9 10354.5 18464.5
MultiplyElementwise 1351.1 5580.9 10203.0 18475.7
Cutout (1 iter, constant fill) 1349.3 5584.4 10434.1 18855.2
Dropout (1-5%) 1371.0 5635.7 10357.0 18710.0
CoarseDropout (1-5%, size=1-10%) 1344.5 5618.2 10530.4 18843.6
Dropout2d (10%) 859.7 5068.6 7527.2 18211.5
TotalDropout (10%) 965.1 5453.2 8083.1 17953.0
ReplaceElementwise 1359.0 5603.3 10451.3 18728.0
ImpulseNoise 1359.5 5602.0 10516.4 18677.8
SaltAndPepper 1352.8 5635.6 10447.3 18837.6
CoarseSaltAndPepper 1356.7 5614.1 10310.9 18774.5
Salt 1348.9 5576.4 10497.3 18706.0
CoarseSalt 1339.5 5584.0 10521.0 18413.7
Pepper 1365.9 5583.9 10475.6 18299.0
CoarsePepper 1352.6 6526.4 10546.9 18453.0
Invert (10%) 1364.9 6532.4 10436.1 18373.2
JpegCompression (50-99%) 1366.4 6563.1 10513.6 18392.1
Cartoon 1340.7 6543.2 10352.2 18300.8
BlendAlpha (Identity) 662.3 2880.4 5086.3 11840.4
BlendAlphaElementwise (Identity) 298.6 451.2 1251.4 1356.3
BlendAlphaSimplexNoise (Identity) 100.7 122.9 800.4 890.9
BlendAlphaFrequencyNoise (Identity) 125.3 147.0 882.5 973.2
BlendAlphaSomeColors (Identity) n/a n/a n/a n/a
BlendAlphaHorizontalL.Grad. (Identity) 259.0 534.5 1243.2 1467.4
BlendAlphaVerticalL.Grad. (Identity) 253.6 491.5 1219.2 1435.7
BlendAlphaRegularGrid (Identity) 242.7 479.7 1200.4 1430.1
BlendAlphaCheckerboard (Identity) 246.2 461.2 1212.2 1406.5
GaussianBlur (sigma=(1,5)) 1274.8 6491.3 10490.6 26259.7
AverageBlur 1266.5 6470.4 10485.1 26336.5
MedianBlur 1274.3 6516.3 10496.8 26060.9
BilateralBlur 1277.1 6503.2 10455.4 26262.4
MotionBlur 1261.7 6515.3 10305.2 26288.1
MeanShiftBlur 1285.3 6645.9 10363.5 26386.9
RandAugment (n=2, m=(6,12)) n/a n/a n/a n/a
WithColorspace (HSV, Identity) 1185.0 6766.3 10008.5 26301.1
WithBrightnessChannels (Identity) 1192.7 6776.9 10012.8 26110.1
MultiplyAndAddToBrightness 1072.6 6750.4 9290.9 26234.2
MultiplyBrightness 1176.3 6767.6 9863.5 26148.5
AddToBrightness 1117.8 6759.0 9902.6 26310.4
WithHueAndSaturation 1152.0 6768.5 10050.7 26305.8
MultiplyHueAndSaturation 1170.8 6808.5 9967.6 26312.0
MultiplyHue 868.0 3343.3 6367.6 9554.2
MultiplySaturation 861.3 3353.0 6426.9 9911.0
RemoveSaturation 875.9 3337.8 6363.9 10280.3
AddToHueAndSaturation 1304.3 6766.2 10446.2 18294.3
AddToHue 1339.0 6785.4 10526.2 18075.2
AddToSaturation 1336.5 6799.2 10456.1 18036.2
ChangeColorspace (HSV) 1278.9 6776.7 10554.9 17845.5
Grayscale 1298.5 6832.6 10475.2 17750.9
KMeansColorQuantization (2-16 colors) 1285.0 6794.2 10472.9 17924.0
UniformColorQuantization (2-16 colors) 1286.6 6813.7 10553.4 17893.7
UniformColorQuant.NBits (1-7 bits) 1309.5 6819.9 10343.9 18027.2
Posterize (1-7 bits) 1357.7 6843.1 10515.6 17936.6
GammaContrast 1337.8 6800.4 10495.7 18009.0
SigmoidContrast 1337.0 6806.4 10466.6 17873.3
LogContrast 1344.0 6762.3 10463.7 17979.1
LinearContrast 1349.4 6793.7 10413.8 17880.6
AllChannelsHistogramEqualization 1365.5 6783.6 10488.7 17966.1
HistogramEqualization 1364.7 6801.1 10477.2 18043.7
AllChannelsCLAHE 1330.2 6800.5 10415.1 18008.3
CLAHE 1372.3 6833.8 10539.7 18011.7
Convolve (3x3) 1356.2 6806.5 10419.5 17923.5
Sharpen 1339.8 6799.7 10392.9 17963.2
Emboss 1354.7 6767.9 10413.8 17964.7
EdgeDetect 1368.3 6769.3 10518.3 18015.8
DirectedEdgeDetect 1358.6 6795.3 10466.6 17960.0
Canny 1344.4 6789.5 10480.2 17991.9
Fliplr (p=100%) 1064.6 6145.1 8835.8 17531.4
Flipud (p=100%) 1080.3 6538.2 8888.0 17864.5
Affine (order=0, constant) 255.7 654.9 1134.6 1380.3
Affine (order=1, constant) 264.3 654.2 1139.9 1380.2
Affine (order=3, constant) 262.5 654.2 1129.1 1379.6
Affine (order=1, edge) 260.1 654.5 1137.4 1382.3
Affine (order=1, constant, skimage) 161.4 267.1 372.0 396.9
PiecewiseAffine (4x4, order=1, constant) 19.3 20.6 51.5 51.9
PiecewiseAffine (4x4, order=0, constant) 19.5 20.4 51.0 51.9
PiecewiseAffine (4x4, order=1, edge) 19.4 20.4 51.3 52.1
PiecewiseAffine (8x8, order=1, constant) 5.6 5.6 31.3 31.8
PerspectiveTransform 258.5 925.1 1411.7 2010.3
PerspectiveTransform (keep_size) 225.5 603.7 1094.5 1435.9
ElasticTransformation (order=0, constant) 69.4 97.6 1217.6 1466.5
ElasticTransformation (order=1, constant) 70.5 97.6 1204.3 1469.5
ElasticTransformation (order=1, nearest) 70.0 96.1 1211.0 1471.5
ElasticTransformation (order=1, reflect) 70.3 96.0 1215.7 1442.0
Rot90 748.1 5247.6 7075.9 24324.3
Rot90 (keep_size) 574.6 2012.9 3971.2 6407.7
WithPolarWarping (Identity) 622.5 1869.3 2621.8 2846.1
Jigsaw (rows/cols=(3,8), 1 step) 117.7 171.8 1500.0 1745.7
AveragePooling 516.2 1850.0 4782.4 11003.4
AveragePooling (keep_size) 1243.4 6670.4 10415.7 18658.7
MaxPooling 528.5 1844.9 4879.3 11378.2
MaxPooling (keep_size) 1274.8 6704.8 10582.7 18947.4
MinPooling 521.7 1871.9 4895.7 11346.4
MinPooling (keep_size) 1273.7 6721.3 10444.5 18924.3
MedianPooling 523.9 1870.4 4888.3 11389.8
MedianPooling (keep_size) 1265.8 6728.4 10477.3 19011.2
imgcorruptlike.GaussianNoise((1,5)) 1279.1 6750.4 10470.0 19034.0
imgcorruptlike.ShotNoise((1,5)) 1277.7 6764.5 10524.5 19094.6
imgcorruptlike.ImpulseNoise((1,5)) 1252.8 6745.3 10458.3 18995.2
imgcorruptlike.SpeckleNoise((1,5)) 1262.7 6708.5 10519.9 19177.5
imgcorruptlike.GaussianBlur((1,5)) 1271.5 6695.1 10375.6 19022.0
imgcorruptlike.GlassBlur((1,5)) 1279.0 6740.8 10482.6 19049.7
imgcorruptlike.DefocusBlur((1,5)) 1264.1 6725.7 10457.5 19217.5
imgcorruptlike.MotionBlur((1,5)) 1285.1 6735.1 10389.7 19075.6
imgcorruptlike.ZoomBlur((1,5)) 1281.2 6754.2 10308.4 19113.0
imgcorruptlike.Fog((1,5)) 1277.6 6663.9 10386.9 19102.4
imgcorruptlike.Frost((1,5)) 1280.2 6737.7 10449.3 19018.7
imgcorruptlike.Snow((1,5)) 1264.4 6732.5 10613.1 19058.9
imgcorruptlike.Spatter((1,5)) 1248.5 6735.6 10394.4 19034.4
imgcorruptlike.Contrast((1,5)) 1251.7 6737.4 10483.9 19127.2
imgcorruptlike.Brightness((1,5)) 1266.7 6748.6 10519.9 19071.4
imgcorruptlike.Saturate((1,5)) 1270.4 6771.8 10566.0 19137.2
imgcorruptlike.JpegCompression((1,5)) 1256.7 6735.9 10589.2 19063.4
imgcorruptlike.Pixelate((1,5)) 1282.2 6739.7 10463.6 19135.8
imgcorruptlike.ElasticTransform((1,5)) 1255.9 6715.8 10436.7 19070.7
pillike.Solarize (p=1.0) 1274.0 6747.8 10415.5 19055.4
pillike.Posterize (1-7 bits) 1278.4 6738.6 10475.7 19121.8
pillike.Equalize 1274.1 6758.1 10450.9 18984.7
pillike.Autocontrast 1259.0 6723.7 10419.1 19153.8
pillike.EnhanceColor 1272.0 6719.8 10397.4 19100.6
pillike.EnhanceContrast 1257.2 6720.5 10479.4 19114.6
pillike.EnhanceBrightness 1267.2 6732.6 10512.5 19060.7
pillike.EnhanceSharpness 1241.9 6735.0 10433.6 19169.2
pillike.FilterBlur 1259.5 6661.7 10495.7 19037.5
pillike.FilterSmooth 1247.8 6718.1 10483.4 19175.0
pillike.FilterSmoothMore 1240.1 6690.4 10318.6 19040.7
pillike.FilterEdgeEnhance 1265.3 6717.4 10390.9 19204.5
pillike.FilterEdgeEnhanceMore 1270.1 6728.4 10098.6 19124.4
pillike.FilterFindEdges 1266.7 6751.5 10353.5 19197.6
pillike.FilterContour 1249.3 6694.9 10333.1 19034.4
pillike.FilterEmboss 1267.5 6767.2 10476.8 19171.0
pillike.FilterSharpen 1271.6 6737.6 10398.5 19048.9
pillike.FilterDetail 1281.0 6780.6 10496.7 19178.6
pillike.Affine n/a n/a n/a n/a
Superpixels (max_size=64, cubic) 1295.0 6561.1 10527.2 19141.9
Superpixels (max_size=64, linear) 1257.2 6569.5 10486.4 19180.4
Superpixels (max_size=128, linear) 1260.1 6512.3 10486.7 19117.8
Superpixels (max_size=224, linear) 1280.0 6589.3 10361.3 19276.4
UniformVoronoi (250-1000k points, linear) 1289.5 6565.9 10375.7 19086.6
RegularGridVoronoi (16-31 rows/cols) 1284.1 6565.6 10567.1 19060.5
RelativeRegularGridVoronoi (7%-14% rows/cols) 1282.7 6580.6 10424.6 19091.2
Resize (nearest) 485.9 1426.2 3312.5 5714.1
Resize (linear) 500.5 1344.2 3064.6 5086.9
Resize (cubic) 492.0 1267.1 2730.4 4282.9
CropAndPad 417.4 1488.9 2927.0 5460.7
CropAndPad (edge) 414.1 1486.4 2919.0 5424.1
CropAndPad (keep_size) 337.4 855.3 1956.8 2668.5
Crop 529.6 2379.2 5026.1 13314.0
Crop (keep_size) 406.8 1097.0 2568.4 4182.3
Pad 405.3 1367.0 2601.9 4112.4
Pad (edge) 402.4 1365.7 2615.3 4084.5
Pad (keep_size) 329.1 801.9 1703.2 2199.6
PadToFixedSize 441.9 1683.2 2947.0 5516.7
CropToFixedSize 630.4 2987.1 5543.8 14467.0
KeepSizeByResize (CropToFixedSize(nearest)) 402.9 1293.7 2947.5 5232.6
KeepSizeByResize (CropToFixedSize(linear)) 398.9 1223.9 2707.1 4705.7
KeepSizeByResize (CropToFixedSize(cubic)) 395.7 1160.9 2440.0 4000.6
FastSnowyLandscape 1266.6 6468.7 10481.2 27221.8
Clouds 719.1 5982.0 6979.2 26382.3
Fog 1284.1 6527.3 10390.2 27196.8
CloudLayer 1268.0 6527.0 10328.0 27134.4
Snowflakes 717.6 5974.3 6852.2 26335.0
SnowflakesLayer 1282.2 6503.1 10732.7 27190.9
Rain 723.3 5951.5 6901.8 26338.2
RainLayer 1189.0 6438.2 10457.1 26940.0

Number of heatmap instances per sec for 64x64x5 or 224x224x5 heatmaps on 224x224x3 images:

  64x64x5 on 224x224x3 224x224x5 on 224x224x3
Augmenter B=1 B=128 B=1 B=128
Sequential (2xIdentity) 9479.6 44643.9 6686.2 12329.9
Sequential (2xIdentity, random_order) 8838.1 44350.4 6157.9 12219.4
SomeOf (1-3, 3xIdentity) 5761.4 41319.8 4476.3 12075.9
SomeOf (1-3, 3xIdentity, random_order) 5650.8 41282.8 4403.5 12002.4
OneOf (3xIdentity) 8207.1 43109.2 5939.9 12246.6
Sometimes (Identity) 6648.8 43839.3 5117.4 11812.5
WithChannels ([1,2], Identity) 7209.9 20981.2 4221.6 4934.3
Identity 10634.7 44851.8 6913.0 11863.2
Noop 10812.0 44891.4 6843.7 11821.0
Lambda (return input) 10379.6 44538.3 6716.4 11875.2
AssertLambda (return True) 10406.7 44536.9 6684.5 12010.4
AssertShape (None, H, W, None) 10172.8 43448.8 6531.8 11835.3
ChannelShuffle (0.5) 10809.8 44715.3 6822.9 12015.4
Add 10884.9 44723.0 6813.2 11959.8
AddElementwise 10892.6 45124.3 6820.1 12056.3
AdditiveGaussianNoise 10807.8 44932.5 6875.8 11965.4
AdditiveLaplaceNoise 10899.7 44547.2 6768.3 12035.2
AdditivePoissonNoise 10874.6 44960.6 6823.1 11952.8
Multiply 10796.3 44959.0 6762.1 12058.5
MultiplyElementwise 10808.7 44647.6 6663.2 12065.8
Cutout (1 iter, constant fill) 10794.6 44675.1 6814.1 12313.6
Dropout (1-5%) 10967.9 45085.7 6763.8 12218.8
CoarseDropout (1-5%, size=1-10%) 10756.2 44945.9 6877.0 12306.0
Dropout2d (10%) 6877.6 40548.7 4915.7 11893.2
TotalDropout (10%) 7721.0 43625.5 5278.8 11724.4
ReplaceElementwise 10871.7 44826.6 6825.3 12230.5
ImpulseNoise 10875.7 44816.0 6867.9 12197.7
SaltAndPepper 10822.3 45085.0 6822.7 12302.1
CoarseSaltAndPepper 10853.6 44912.4 6733.7 12260.9
Salt 10791.0 44611.6 6855.3 12216.2
CoarseSalt 10716.2 44671.6 6870.8 12025.3
Pepper 10927.1 44671.0 6841.2 11950.4
CoarsePepper 10821.1 52210.9 6887.8 12050.9
Invert (10%) 10919.3 52259.6 6815.4 11998.8
JpegCompression (50-99%) 10931.5 52505.0 6866.0 12011.2
Cartoon 10725.2 52345.4 6760.6 11951.6
BlendAlpha (Identity) 5298.2 23043.2 3321.7 7732.5
BlendAlphaElementwise (Identity) 2388.4 3609.9 817.2 885.7
BlendAlphaSimplexNoise (Identity) 805.7 983.0 522.7 581.8
BlendAlphaFrequencyNoise (Identity) 1002.4 1175.6 576.3 635.6
BlendAlphaSomeColors (Identity) n/a n/a n/a n/a
BlendAlphaHorizontalL.Grad. (Identity) 2072.0 4275.7 811.9 958.3
BlendAlphaVerticalL.Grad. (Identity) 2029.2 3931.6 796.2 937.6
BlendAlphaRegularGrid (Identity) 1941.8 3837.9 784.0 933.9
BlendAlphaCheckerboard (Identity) 1969.7 3689.2 791.6 918.6
GaussianBlur (sigma=(1,5)) 10198.4 51930.5 6851.0 17149.2
AverageBlur 10132.1 51763.5 6847.4 17199.4
MedianBlur 10194.0 52130.6 6855.1 17019.4
BilateralBlur 10216.7 52025.7 6828.0 17151.0
MotionBlur 10093.6 52122.1 6730.0 17167.8
MeanShiftBlur 10282.4 53167.2 6768.0 17232.3
RandAugment (n=2, m=(6,12)) n/a n/a n/a n/a
WithColorspace (HSV, Identity) 9479.7 54130.4 6536.1 17176.2
WithBrightnessChannels (Identity) 9541.3 54215.5 6539.0 17051.5
MultiplyAndAddToBrightness 8581.1 54003.0 6067.5 17132.6
MultiplyBrightness 9410.6 54140.9 6441.5 17076.6
AddToBrightness 8942.4 54072.0 6467.0 17182.3
WithHueAndSaturation 9215.7 54148.2 6563.7 17179.3
MultiplyHueAndSaturation 9366.5 54467.8 6509.5 17183.4
MultiplyHue 6943.9 26746.8 4158.4 6239.5
MultiplySaturation 6890.2 26823.7 4197.1 6472.5
RemoveSaturation 7006.9 26702.7 4156.0 6713.7
AddToHueAndSaturation 10434.8 54129.4 6822.0 11947.3
AddToHue 10711.8 54283.0 6874.2 11804.2
AddToSaturation 10692.0 54393.9 6828.5 11778.8
ChangeColorspace (HSV) 10231.2 54213.2 6893.0 11654.2
Grayscale 10387.7 54661.1 6841.0 11592.4
KMeansColorQuantization (2-16 colors) 10280.3 54353.4 6839.4 11705.5
UniformColorQuantization (2-16 colors) 10292.9 54509.9 6892.0 11685.7
UniformColorQuant.NBits (1-7 bits) 10476.1 54559.5 6755.2 11772.9
Posterize (1-7 bits) 10861.3 54744.7 6867.4 11713.7
GammaContrast 10702.7 54403.1 6854.3 11761.0
SigmoidContrast 10696.1 54451.1 6835.3 11672.4
LogContrast 10751.8 54098.5 6833.4 11741.5
LinearContrast 10795.1 54349.9 6800.9 11677.1
AllChannelsHistogramEqualization 10924.1 54268.6 6849.7 11733.0
HistogramEqualization 10917.2 54409.1 6842.2 11783.6
AllChannelsCLAHE 10641.3 54403.8 6801.7 11760.6
CLAHE 10978.3 54670.0 6883.1 11762.7
Convolve (3x3) 10849.8 54451.7 6804.5 11705.1
Sharpen 10718.5 54397.6 6787.2 11731.0
Emboss 10838.0 54143.0 6800.8 11732.0
EdgeDetect 10946.7 54154.6 6869.1 11765.4
DirectedEdgeDetect 10868.6 54362.6 6835.3 11729.0
Canny 10755.1 54316.1 6844.2 11749.8
Fliplr (p=100%) 8516.7 49161.0 5770.3 11449.1
Flipud (p=100%) 8642.8 52305.2 5804.4 11666.6
Affine (order=0, constant) 2045.6 5238.8 741.0 901.4
Affine (order=1, constant) 2114.6 5233.6 744.4 901.3
Affine (order=3, constant) 2100.4 5233.6 737.4 901.0
Affine (order=1, edge) 2080.8 5236.2 742.8 902.7
Affine (order=1, constant, skimage) 1291.6 2137.1 242.9 259.2
PiecewiseAffine (4x4, order=1, constant) 154.3 164.8 33.6 33.9
PiecewiseAffine (4x4, order=0, constant) 155.8 163.5 33.3 33.9
PiecewiseAffine (4x4, order=1, edge) 155.2 163.4 33.5 34.0
PiecewiseAffine (8x8, order=1, constant) 44.8 44.9 20.4 20.7
PerspectiveTransform 2068.0 7401.0 921.9 1312.8
PerspectiveTransform (keep_size) 1804.2 4829.3 714.8 937.7
ElasticTransformation (order=0, constant) 555.2 780.9 795.2 957.7
ElasticTransformation (order=1, constant) 564.2 780.9 786.5 959.7
ElasticTransformation (order=1, nearest) 559.9 769.1 790.9 961.0
ElasticTransformation (order=1, reflect) 562.3 768.3 793.9 941.7
Rot90 5985.0 41980.6 4621.0 15885.2
Rot90 (keep_size) 4596.8 16103.2 2593.4 4184.6
WithPolarWarping (Identity) 4979.9 14954.7 1712.2 1858.7
Jigsaw (rows/cols=(3,8), 1 step) 941.8 1374.1 979.6 1140.1
AveragePooling 4129.7 14799.8 3123.2 7185.9
AveragePooling (keep_size) 9947.3 53363.1 6802.1 12185.3
MaxPooling 4227.7 14759.2 3186.5 7430.7
MaxPooling (keep_size) 10198.2 53638.1 6911.1 12373.8
MinPooling 4173.4 14975.5 3197.2 7409.9
MinPooling (keep_size) 10189.7 53770.8 6820.9 12358.7
MedianPooling 4191.0 14963.4 3192.3 7438.3
MedianPooling (keep_size) 10126.2 53827.5 6842.3 12415.4
imgcorruptlike.GaussianNoise((1,5)) 10233.1 54003.5 6837.6 12430.4
imgcorruptlike.ShotNoise((1,5)) 10221.4 54116.1 6873.2 12469.9
imgcorruptlike.ImpulseNoise((1,5)) 10022.6 53962.0 6829.9 12405.0
imgcorruptlike.SpeckleNoise((1,5)) 10101.6 53668.1 6870.1 12524.1
imgcorruptlike.GaussianBlur((1,5)) 10172.3 53560.8 6775.9 12422.5
imgcorruptlike.GlassBlur((1,5)) 10231.6 53926.2 6845.8 12440.6
imgcorruptlike.DefocusBlur((1,5)) 10112.5 53805.7 6829.4 12550.2
imgcorruptlike.MotionBlur((1,5)) 10280.8 53881.1 6785.1 12457.6
imgcorruptlike.ZoomBlur((1,5)) 10249.5 54033.7 6732.0 12481.9
imgcorruptlike.Fog((1,5)) 10220.8 53311.2 6783.3 12475.1
imgcorruptlike.Frost((1,5)) 10241.5 53901.9 6824.1 12420.4
imgcorruptlike.Snow((1,5)) 10115.0 53859.8 6931.0 12446.7
imgcorruptlike.Spatter((1,5)) 9988.2 53884.5 6788.2 12430.6
imgcorruptlike.Contrast((1,5)) 10013.3 53899.3 6846.6 12491.3
imgcorruptlike.Brightness((1,5)) 10133.9 53989.0 6870.2 12454.8
imgcorruptlike.Saturate((1,5)) 10163.1 54174.7 6900.2 12497.8
imgcorruptlike.JpegCompression((1,5)) 10053.6 53886.8 6915.4 12449.6
imgcorruptlike.Pixelate((1,5)) 10257.9 53917.3 6833.4 12496.9
imgcorruptlike.ElasticTransform((1,5)) n/a n/a n/a n/a
pillike.Solarize (p=1.0) 10192.1 53982.3 6802.0 12444.3
pillike.Posterize (1-7 bits) 10227.5 53909.2 6841.3 12487.7
pillike.Equalize 10192.7 54064.7 6825.1 12398.2
pillike.Autocontrast 10071.7 53789.6 6804.3 12508.6
pillike.EnhanceColor 10176.0 53758.3 6790.1 12473.9
pillike.EnhanceContrast 10057.3 53764.1 6843.7 12483.0
pillike.EnhanceBrightness 10137.6 53860.6 6865.3 12447.8
pillike.EnhanceSharpness 9935.5 53879.9 6813.8 12518.6
pillike.FilterBlur 10075.9 53293.9 6854.4 12432.7
pillike.FilterSmooth 9982.0 53744.7 6846.3 12522.5
pillike.FilterSmoothMore 9920.8 53523.5 6738.7 12434.8
pillike.FilterEdgeEnhance 10122.4 53739.0 6785.9 12541.7
pillike.FilterEdgeEnhanceMore 10161.0 53826.9 6595.0 12489.4
pillike.FilterFindEdges 10133.6 54011.7 6761.5 12537.2
pillike.FilterContour 9994.2 53559.4 6748.1 12430.6
pillike.FilterEmboss 10139.8 54137.7 6842.0 12519.8
pillike.FilterSharpen 10172.6 53900.8 6790.9 12440.1
pillike.FilterDetail 10248.3 54244.5 6855.0 12524.8
pillike.Affine n/a n/a n/a n/a
Superpixels (max_size=64, cubic) 10359.8 52488.8 6874.9 12500.8
Superpixels (max_size=64, linear) 10057.4 52556.2 6848.3 12526.0
Superpixels (max_size=128, linear) 10080.4 52098.7 6848.5 12485.1
Superpixels (max_size=224, linear) 10239.8 52714.2 6766.6 12588.7
UniformVoronoi (250-1000k points, linear) 10315.7 52527.3 6775.9 12464.7
RegularGridVoronoi (16-31 rows/cols) 10273.0 52524.5 6901.0 12447.7
RelativeRegularGridVoronoi (7%-14% rows/cols) 10261.5 52644.6 6807.9 12467.7
Resize (nearest) 3887.2 11409.5 2163.3 3731.6
Resize (linear) 4004.2 10753.6 2001.4 3322.1
Resize (cubic) 3936.0 10136.8 1783.1 2797.0
CropAndPad 3339.4 11911.4 1911.5 3566.2
CropAndPad (edge) 3312.9 11891.2 1906.3 3542.2
CropAndPad (keep_size) 2699.4 6842.7 1277.9 1742.7
Crop 4236.7 19033.3 3282.4 8694.9
Crop (keep_size) 3254.2 8776.2 1677.3 2731.3
Pad 3242.5 10935.9 1699.2 2685.6
Pad (edge) 3219.3 10925.4 1708.0 2667.4
Pad (keep_size) 2633.0 6415.0 1112.3 1436.5
PadToFixedSize 3535.1 13465.6 1924.5 3602.7
CropToFixedSize 5043.4 23896.6 3620.4 9447.9
KeepSizeByResize (CropToFixedSize(nearest)) 3223.5 10349.5 1924.9 3417.2
KeepSizeByResize (CropToFixedSize(linear)) 3191.6 9791.4 1767.9 3073.1
KeepSizeByResize (CropToFixedSize(cubic)) 3165.5 9287.2 1593.5 2612.6
FastSnowyLandscape 10132.9 51749.5 6844.8 17777.5
Clouds 5753.1 47856.2 4557.8 17229.3
Fog 10272.6 52218.0 6785.4 17761.2
CloudLayer 10143.9 52216.4 6744.8 17720.4
Snowflakes 5740.8 47794.5 4474.9 17198.4
SnowflakesLayer 10257.8 52025.2 7009.1 17757.3
Rain 5786.5 47612.3 4507.3 17200.5
RainLayer 9512.3 51505.4 6829.1 17593.5

Keypoints and Bounding Boxes

Numbers below are for keypoints on small and large images. Each KeypointsOnImage instance contained 10 Keypoint instances. B=1 denotes a batch size of 1 , B=128 one of 128.

The numbers for bounding boxes can be derived by dividing each value by 4.

Number of augmented Keypoint instances per sec (divide by 10 for KeypointsOnImage instances):

  10 KPs on 224x224x3
Augmenter B=1 B=128
Sequential (2xIdentity) 37012.5 1082118.9
Sequential (2xIdentity, random_order) 29576.2 1018050.4
SomeOf (1-3, 3xIdentity) 14592.0 524940.8
SomeOf (1-3, 3xIdentity, random_order) 14223.8 518189.2
OneOf (3xIdentity) 26817.8 734837.0
Sometimes (Identity) 18553.2 818134.7
WithChannels ([1,2], Identity) 33973.0 569703.3
Identity 42157.2 1072697.7
Noop 42000.7 1069077.8
Lambda (return input) 38945.8 1036321.0
AssertLambda (return True) 37957.5 1032700.9
AssertShape (None, H, W, None) 34536.2 805366.0
ChannelShuffle (0.5) 41079.3 1064524.5
Add 41118.5 1065848.9
AddElementwise 40655.1 1059295.9
AdditiveGaussianNoise 40977.6 1048931.1
AdditiveLaplaceNoise 40870.1 1064200.9
AdditivePoissonNoise 40427.3 1056247.5
Multiply 40921.6 1054364.0
MultiplyElementwise 40417.9 1065871.4
Cutout (1 iter, constant fill) 41902.8 1063992.8
Dropout (1-5%) 40515.3 1052003.2
CoarseDropout (1-5%, size=1-10%) 40723.5 1057345.9
Dropout2d (10%) 15761.6 460892.5
TotalDropout (10%) 19089.1 817259.6
ReplaceElementwise 40863.7 996760.1
ImpulseNoise 41210.6 983126.4
SaltAndPepper 42135.2 993933.0
CoarseSaltAndPepper 41175.5 1003854.8
Salt 41061.6 1001330.9
CoarseSalt 40894.0 988559.6
Pepper 41267.4 1006313.5
CoarsePepper 41782.6 1005808.2
Invert (10%) 41179.3 1013027.7
JpegCompression (50-99%) 41222.5 1002183.3
Cartoon 41742.7 1016170.7
BlendAlpha (Identity) 13638.3 231006.1
BlendAlphaElementwise (Identity) 7628.0 15529.5
BlendAlphaSimplexNoise (Identity) 1805.8 2281.7
BlendAlphaFrequencyNoise (Identity) 2417.1 2942.4
BlendAlphaSomeColors (Identity) n/a n/a
BlendAlphaHorizontalL.Grad. (Identity) 6762.3 24122.5
BlendAlphaVerticalL.Grad. (Identity) 6420.3 19841.8
BlendAlphaRegularGrid (Identity) 6007.6 18590.6
BlendAlphaCheckerboard (Identity) 6039.8 16668.2
GaussianBlur (sigma=(1,5)) 40927.0 1086402.0
AverageBlur 41359.6 1067578.3
MedianBlur 41554.1 1071704.2
BilateralBlur 41461.5 1077808.8
MotionBlur 41110.4 1076676.1
MeanShiftBlur 41129.7 1062169.5
RandAugment (n=2, m=(6,12)) n/a n/a
WithColorspace (HSV, Identity) 36815.8 1046132.3
WithBrightnessChannels (Identity) 36561.2 1039062.1
MultiplyAndAddToBrightness 28022.1 964196.3
MultiplyBrightness 35559.8 1017404.7
AddToBrightness 35527.7 1022234.8
WithHueAndSaturation 35777.0 1024870.5
MultiplyHueAndSaturation 35910.5 1021646.0
MultiplyHue 29659.9 592502.1
MultiplySaturation 28923.3 600158.0
RemoveSaturation 29378.7 598766.6
AddToHueAndSaturation 40986.2 1119725.2
AddToHue 41381.9 1103111.1
AddToSaturation 41058.4 1114935.0
ChangeColorspace (HSV) 40768.4 1117990.4
Grayscale 41099.1 1100846.1
KMeansColorQuantization (2-16 colors) 42215.3 1103010.2
UniformColorQuantization (2-16 colors) 41109.3 1112418.4
UniformColorQuant.NBits (1-7 bits) 41959.8 1096977.3
Posterize (1-7 bits) 41053.5 1095550.6
GammaContrast 41231.7 1080049.3
SigmoidContrast 40382.1 1100256.5
LogContrast 40291.1 1106150.6
LinearContrast 41104.0 1107891.5
AllChannelsHistogramEqualization 40714.5 1080249.2
HistogramEqualization 41734.9 1090530.2
AllChannelsCLAHE 41319.9 1100346.7
CLAHE 41405.8 1114551.1
Convolve (3x3) 41350.9 1102244.4
Sharpen 40292.7 1104893.9
Emboss 41969.9 1100852.1
EdgeDetect 40670.9 1103836.8
DirectedEdgeDetect 40743.0 1106445.4
Canny 40905.1 1091215.8
Fliplr (p=100%) 23140.1 706230.7
Flipud (p=100%) 23031.6 699545.0
Affine (order=0, constant) 6562.1 33646.8
Affine (order=1, constant) 6531.6 33854.2
Affine (order=3, constant) 6551.7 33967.8
Affine (order=1, edge) 6539.0 34790.0
Affine (order=1, constant, skimage) 6545.8 34800.9
PiecewiseAffine (4x4, order=1, constant) 124.5 128.0
PiecewiseAffine (4x4, order=0, constant) 124.9 125.9
PiecewiseAffine (4x4, order=1, edge) 124.5 126.0
PiecewiseAffine (8x8, order=1, constant) 56.8 57.1
PerspectiveTransform 7538.8 65378.6
PerspectiveTransform (keep_size) 6866.2 34643.2
ElasticTransformation (order=0, constant) 1443.7 1698.9
ElasticTransformation (order=1, constant) 1403.2 1699.2
ElasticTransformation (order=1, nearest) 1387.6 1703.0
ElasticTransformation (order=1, reflect) 1438.2 1724.1
Rot90 15168.5 332321.6
Rot90 (keep_size) 14909.9 326491.3
WithPolarWarping (Identity) 15354.0 103429.7
Jigsaw (rows/cols=(3,8), 1 step) 5414.4 11859.6
AveragePooling 10527.7 58352.0
AveragePooling (keep_size) 40770.0 1077687.6
MaxPooling 10744.3 57821.0
MaxPooling (keep_size) 40547.7 1083825.7
MinPooling 10595.1 57142.4
MinPooling (keep_size) 40991.0 1081313.9
MedianPooling 10725.2 57799.0
MedianPooling (keep_size) 40305.6 1084803.9
imgcorruptlike.GaussianNoise((1,5)) 40730.9 1087593.4
imgcorruptlike.ShotNoise((1,5)) 41105.6 1074974.5
imgcorruptlike.ImpulseNoise((1,5)) 40888.7 1092987.1
imgcorruptlike.SpeckleNoise((1,5)) 40711.9 1070581.5
imgcorruptlike.GaussianBlur((1,5)) 40999.5 1082354.5
imgcorruptlike.GlassBlur((1,5)) 41458.0 1080668.9
imgcorruptlike.DefocusBlur((1,5)) 40992.6 1078547.8
imgcorruptlike.MotionBlur((1,5)) 42025.0 1043556.9
imgcorruptlike.ZoomBlur((1,5)) 40322.1 1090790.9
imgcorruptlike.Fog((1,5)) 41586.4 1074558.5
imgcorruptlike.Frost((1,5)) 40853.3 1090004.7
imgcorruptlike.Snow((1,5)) 40003.9 1086178.6
imgcorruptlike.Spatter((1,5)) 41532.1 1076336.5
imgcorruptlike.Contrast((1,5)) 40690.3 1089199.7
imgcorruptlike.Brightness((1,5)) 41673.2 1078498.0
imgcorruptlike.Saturate((1,5)) 40142.6 1082613.8
imgcorruptlike.JpegCompression((1,5)) 41298.2 1090813.8
imgcorruptlike.Pixelate((1,5)) 40576.9 1078943.8
imgcorruptlike.ElasticTransform((1,5)) n/a n/a
pillike.Solarize (p=1.0) 40884.9 1050872.0
pillike.Posterize (1-7 bits) 41180.4 1079403.7
pillike.Equalize 40595.3 1093551.1
pillike.Autocontrast 40986.2 1083557.4
pillike.EnhanceColor 41340.6 1095687.7
pillike.EnhanceContrast 41217.6 1082945.4
pillike.EnhanceBrightness 41036.4 1084161.3
pillike.EnhanceSharpness 41666.4 1102461.7
pillike.FilterBlur 40530.9 1093928.5
pillike.FilterSmooth 41571.7 1092077.1
pillike.FilterSmoothMore 40467.9 1099664.6
pillike.FilterEdgeEnhance 40796.9 1084941.3
pillike.FilterEdgeEnhanceMore 41247.9 1092474.1
pillike.FilterFindEdges 41696.2 1096042.6
pillike.FilterContour 40493.4 1092456.3
pillike.FilterEmboss 41637.7 1099112.3
pillike.FilterSharpen 41646.0 1098764.4
pillike.FilterDetail 40681.9 1104490.8
pillike.Affine n/a n/a
Superpixels (max_size=64, cubic) 42058.7 1086970.3
Superpixels (max_size=64, linear) 40705.6 1090370.0
Superpixels (max_size=128, linear) 41916.8 1093384.5
Superpixels (max_size=224, linear) 41026.1 1056588.1
UniformVoronoi (250-1000k points, linear) 41827.0 1070845.2
RegularGridVoronoi (16-31 rows/cols) 40995.0 1074150.0
RelativeRegularGridVoronoi (7%-14% rows/cols) 41378.2 1109759.1
Resize (nearest) 11282.7 53402.6
Resize (linear) 11297.8 53518.4
Resize (cubic) 11210.7 52994.5
CropAndPad 8939.7 79988.7
CropAndPad (edge) 8870.1 79660.3
CropAndPad (keep_size) 7565.8 33852.5
Crop 10042.0 80279.6
Crop (keep_size) 8376.0 34519.8
Pad 8946.2 79155.3
Pad (edge) 8950.1 79899.8
Pad (keep_size) 7589.9 34261.0
PadToFixedSize 10459.6 255851.2
CropToFixedSize 13165.0 269638.4
KeepSizeByResize (CropToFixedSize(nearest)) 8923.0 55861.6
KeepSizeByResize (CropToFixedSize(linear)) 8876.8 55959.4
KeepSizeByResize (CropToFixedSize(cubic)) 8877.9 56122.5
FastSnowyLandscape 39966.1 1080643.5
Clouds 14326.3 548492.1
Fog 41600.9 1069986.2
CloudLayer 40820.5 1085618.5
Snowflakes 14110.5 536123.0
SnowflakesLayer 40336.6 1086376.4
Rain 13720.2 533951.5
RainLayer 40263.1 1086607.3