In order to speed up evaluation and testing times automatic batching is supported out of the box.
batch: max_size: 10 image_size: [1920, 1080]
max_size(optional): max size of the batch to run inference on. Set to 1 if not provided.
image_size(optional): resize images to a fixed size before batching. This is useful if your datasets has images of various sizes. If not provded images are not resized.