Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Streams not flushed for timePerObject if tuples not flowing #101

Closed
jms90h5 opened this issue Jun 27, 2018 · 1 comment
Closed

Streams not flushed for timePerObject if tuples not flowing #101

jms90h5 opened this issue Jun 27, 2018 · 1 comment
Labels

Comments

@jms90h5
Copy link

jms90h5 commented Jun 27, 2018

When the timePerTuples parameter is set tuples that arrive during the current period are not flushed at the time the period ends. The operator appears to be waiting until the next tuple arrives that is outside the specified time period to flush the tuples and close the file. For slow streams where there can be extended periods with no tuple flow that means the application needs to use some other mechanism, such as closeOnPunct. In that situation, if we have to do our own period/object-closure triggering it defeats the benefit of the timePerObject feature.

@markheger markheger added the bug label Jun 27, 2018
markheger pushed a commit that referenced this issue Jun 28, 2018
@joemirizio
Copy link

@markheger I'm not seeing the active object getting closed after timePerObject seconds. It isn't until the operator receives another message outside of the window that it gets closed. I am using version 2.2.6.

Looking at the trace logs, I can see ScheduledExecutorService - trigger object expiry in cache printing every 3 seconds. The nActiveObjects stays at 1, and the nClosedObjects is not increased.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants