Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refresh_interval defaults to 60s #81

Open
nvtkaszpir opened this issue May 14, 2021 · 0 comments
Open

refresh_interval defaults to 60s #81

nvtkaszpir opened this issue May 14, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@nvtkaszpir
Copy link
Contributor

Is your feature request related to a problem? Please describe.
How about both?
Sometimes we get very short living pods/containers, and seems like fluentd is not picking logs from them.

In fluend logs I can sometime see:

2021-05-13 13:25:41.729347863 +0000 fluent.warn: {"message":"[fluentd-containers.log] /var/log/containers/REDACTED-integration-tests-2_wait-for-postgres-6b84d958cbd73c933bc63757c224c9e73d4d385e190ba3345c4920e09d9bb9a7.log unreadable. It is excluded and would be examined next time."}
2021-05-13 13:54:41 +0000 [warn]: [fluentd-containers.log] /var/log/containers/REDACTED_wait-for-postgres-3be0321565f050b34a9cdf078e2e67fe8b7c827f0d946534bb14b9ddee53b883.log unreadable. It is excluded and would be examined next time.
2021

and I know those init containers can live very shortly (like seconds).

Describe the solution you'd like
in_tail plugin has option refresh_interval which is default 60s

Describe alternatives you've considered
refresh_interval 1s (kind'a mental, would keep it around 5s)

Additional context
In theory inotify should be sufficient, but looks like not?

Anyone experienced this, or experimented with setting refresh_interval to value lower than 60s?

@nvtkaszpir nvtkaszpir added the enhancement New feature or request label May 14, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Development

No branches or pull requests

1 participant