-
Notifications
You must be signed in to change notification settings - Fork 179
New issue
Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? # to your account
Provide Stream output for transformers #1176
Comments
partially covered with #1177 |
Do I understand correctly that this proposal suggests implementing a solution similar to the one used for JsonTransformer, but also for:
|
yes you are right |
My PR covers the SQL transformer support #1264 |
Also a PR for JavaObjectTransformer #1313 |
# for free
to join this conversation on GitHub.
Already have an account?
# to comment
The problem with current method like
net.datafaker.transformations.JsonTransformer#generate(net.datafaker.transformations.Schema<IN,?>, int)
it generates the whole
String
and then returns it. As a result for bigger numbers it consumes larger amount of memory and e.g.such test fails with OutOfMemory
There is not so much we can do about this method since anyway with such approach we need somehow to store that giant string value.
Another approach is instead of generation the final string value we could generate a stream of values and return it.
The text was updated successfully, but these errors were encountered: