Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement bulk insert on create #6

Open
declanvk opened this issue Apr 2, 2022 · 0 comments
Open

Implement bulk insert on create #6

declanvk opened this issue Apr 2, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@declanvk
Copy link
Owner

declanvk commented Apr 2, 2022

Problem

  • When creating a tree from an existing source of key-value pairs, the method of inserting one at a time can be slow.

Solution Sketch

When an index is created for an existing relation, the following recursive algorithm can be used to speed up index construction: Using the first byte of each key the key/value pairs are radix partitioned into 256 partitions and an inner node of the appropriate type is created. Before returning that inner node, its children are created by recursively applying the bulk loading procedure for each partition using the next byte of each key.

  • This algorithm is only applicable when constructing the tree for the first time, this isn't a bulk loading algorithm for an existing tree.
@declanvk declanvk added the enhancement New feature or request label Apr 2, 2022
@declanvk declanvk self-assigned this Apr 2, 2022
@declanvk declanvk removed their assignment Oct 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant