Skip to content
This repository has been archived by the owner on Apr 1, 2024. It is now read-only.

ISSUE-19342: [Discussion] How to query the decompressed metadata from znode ? #5466

Open
2 tasks done
sijie opened this issue Jan 29, 2023 · 1 comment
Open
2 tasks done

Comments

@sijie
Copy link
Member

sijie commented Jan 29, 2023

Original Issue: apache#19342


Search before asking

  • I searched in the issues and found nothing similar.

Motivation

Hi community. I'm targeting PIP-123 interest. I spent two weeks at work doing some tuning research.

Solution

The mechanism I understand that needs to be modified is this: call the java program in the zookeeper-shell to pass in some command line parameters, and then put it into the managed-ledger cursor through the zk client server such as curator,
However, since the managed-ledger here may touch multiple copies of the bk node metadata when reading and writing zk,
Now there are options such as rocksdb, so it needs to be unified and compatible in the underlying logic of AdminCli.

Pulsar's internal protocol serialization data (xxxxmessage.proto) in the znode needs to download metadata without breaking the existing internal internal protocol. How should I do? Because in my opinion need to do a layer of decompression abstraction

Alternatives

none

Anything else?

none

Are you willing to submit a PR?

  • I'm willing to submit a PR!
@rfyiamcool
Copy link

👍

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants