Process compressed log files stored on aws s3

[ColinSu20240311]

Can BindPlane Agent directly process compressed log files stored on aws s3?

[BinaryFissionGames]

Hey @ColinSu20240311 - I don't think there's currently a way to accomplish reading compressed files out of an AWS S3 bucket. The AWS Rehydration receiver we have is specifically for loading logs/metrics/traces generated from the S3 exporter.

I think it's probably worthwhile to file an issue and ask upstream in the collector-contrib repository if you haven't yet - it's possible someone has a workaround I'm just not familiar with.

If you have any future questions, feel free to ask again here, or if you need a faster response I'd recommend asking in our slack channel!