Skip to content

[Feature][History Server] Implement compression with history server and collector #4827

Description

@chiayi

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

From benchmarking: #4736 we found that compression greatly cuts down the amount of storage used while not impacting the latency. We saw ~70% to ~90% in reduction for file sizes while only barely increasing the processing time by less than a few seconds.
Add compression for history server and collector when downloading event files and uploading event files respectively.

Use case

History server will be able to download and read compressed files.
Collector will be able to compress file and upload compress files.

Related issues

N/A

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions