HDDS-7715. Implement a lightweight listStatus API

[tanvipenumudy]

What changes were proposed in this pull request?

To introduce a newer listStatus API (we have chosen to introduce a newer API over modifying the existing API as it would break compatibility for older ozone clients) which uses a trimmed KeyInfo [BasicKeyInfo] proto message for excluding fields such as KeyLocations which are not very useful on the client side:

The new lightweight listStatus API would be used for:

• o3 CLI: (ozone sh key list)
• S3 ListObject requests

The existing listStatus API will continue being used for:

• ofs commands

message BasicKeyInfo {
    optional string keyName = 1;
    optional uint64 dataSize = 2;
    optional uint64 creationTime = 3;
    optional uint64 modificationTime = 4;
    optional hadoop.hdds.ReplicationType type = 5;
    optional hadoop.hdds.ReplicationFactor factor = 6;
    optional hadoop.hdds.ECReplicationConfig ecReplicationConfig = 7;
}

This patch shall utilize the server-side Ozone key encapsulations and proto messages introduced as part of HDDS-9079. Implement a lightweight listKeys API (PR #5115).

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-7715

How was this patch tested?

• Existing test cases should cover the code changes.
• Green Git CI/CD: https://github.com/tanvipenumudy/ozone/actions/runs/6114935211/

[kerneltime]

@tanvipenumudy can you please update rebase this PR?

[tanvipenumudy]

Rebased the patch. @kerneltime, @duongkame, @adoroszlai could you please take a look at the changes? Thanks!

[adoroszlai]

Thanks @tanvipenumudy for the patch.

[adoroszlai]

Thanks @tanvipenumudy for updating the patch. I have one more question on second look.

[adoroszlai]

Thanks @tanvipenumudy for iterating on the patch. I'm fine with the current version. Let's see if others have any comments.