Keras iterator with augmented images and other features

[lamba92]

Say you have a dataset that has images and some data in a .csv for each image.
Your goal is to create a NN that has a convolution branch and an other one (in my case an MLP).

Now, there are plenty of guides (one here, another one) on how to create the network, that's not the problem.

The issue here is how do I create an iterator in the form of [[convolution_input, other_features], target] when the convolution_input is from a Keras ImageDataGenerator flow that adds augmented images.

More specifically, when the nth image (that may be an augmented one or not) is fed to the NN, I want it's original features inside other_features.

I found few attempts (here and here, the second one looked promising but I wasn't able to figure out how to handle augmented images) in doing exactly that but they do not seems to take into account the possible dataset manipulation that the Keras generator does.

[lamba92]

Answered here:
https://stackoverflow.com/questions/60513146/keras-iterator-with-augmented-images-and-other-features