Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

todo of floyd #2768

Open
wangshao1 opened this issue Jun 28, 2024 · 8 comments
Open

todo of floyd #2768

wangshao1 opened this issue Jun 28, 2024 · 8 comments
Labels
✏️ Feature New feature or request

Comments

@wangshao1
Copy link
Collaborator

wangshao1 commented Jun 28, 2024

Which PikiwiDB functionalities are relevant/related to the feature request?

No response

Description

  1. 使用无锁队列替换当前的队列实现。

  2. rocksdb kv分离的优化,减少Compaction过程中对blob文件的随机IO。https://github.com/pikiwidb/rocksdb/pull/2/files

  3. pika对应工具的更新,如pika-port。

  4. binlog和wal重复,只保留一份。

  5. rocksdb env,现在是所有rocksdb公用同一个bgthreadpool线程池,是否进行拆分,每个rocksdb使用独立的bgthreadpool。

  6. benchmark_client支持更多接口。

Proposed solution

同上

Alternatives considered

同上

@wangshao1 wangshao1 added the ✏️ Feature New feature or request label Jun 28, 2024
@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: pika 4.0 all

@AlexStocks AlexStocks changed the title pika 4.0 todo todo of floyd Jun 28, 2024
@sprappcom
Copy link

@wangshao1 @AlexStocks this sounds amazing, anyone has any eta on this?

@AlexStocks
Copy link
Collaborator

@wangshao1 @AlexStocks this sounds amazing, anyone has any eta on this?

there is some todos for the third generation storage engine floyd.

@sprappcom
Copy link

@AlexStocks eta?

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


@AlexStocks and what?

@AlexStocks
Copy link
Collaborator

2 rocksdb kv 分离的优化,减少 Compaction 过程中对 blob 文件的随机 IO。

这个工作暂不推进,防止已经开启 blob 的 RocksDB 数据无法向前兼容。

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


2 Optimization of rocksdb kv separation to reduce random IO to blob files during the compaction process.

This work is not being advanced for the time being to prevent RocksDB data that has blobs enabled from being forward-compatible.

@sprappcom
Copy link

@AlexStocks the old pika is holding back a lot of new developments. possible to do an X version without considering the current technical debt?

  1. doesnt need forward compatibility.
  2. when performing slot migrate in future can have the X version immediately.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
✏️ Feature New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants