Open
Conversation
- Add a fixed size binary set generator (from rdb's bigset work)
For testing CRDT sets we often want to generate a set of elements of
elements of a certain size. In the past we used int generators, but
sets of 32bit elements aren't realistic enough. We want to know how
many elements of size X before performance degrades. To that end this
commit adds a generator `{fixed_bin_set, ElemSize, Cardinality}` where
`ElemSize` is the size of a random binary element and `Cardinality` is
the size of the set. It makes use of the existing binary block
generation code in valgen.
(cherry picked from commit 3471aaf)
- Add poisson_bin valgen w/ workaround to approx poisson via normal dist
when over a threshold size (cause it could be too slow!)
- Add variable size binary set generator to create bins within
(minsize/maxsize, poisson dist, exp dist) params over a specified
cardinality
- basho_bench driver for riak datatypes over pb, focused on sets right
now for current benchmark needs (and comparisons to bigsets)
- driver allows for benches over preloaded sets, a single set, and
normal-stylings (creating sets via keygen) and contains calls for
batch_inserts via rdb's work
- new distributions/valgens for bins and gen'ing/using them w/ var_bin_sets
- cleaner examples
- add maps benchies & examples
- add more sets bench operations & examples
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Note: This needs another round of runs to make sure it's still working, as I've not used it in some months. Also, it could use a bit of cleanup as @russelldb and I were working through some ideas :). Nonetheless, tons of good work here that we don't want to lose; e.g. so many new, interesting, variable generators!
Add a fixed size binary set generator (from rdb's bigset work)
For testing CRDT sets we often want to generate a set of elements of
elements of a certain size. In the past we used int generators, but
sets of 32bit elements aren't realistic enough. We want to know how
many elements of size X before performance degrades. To that end this
commit adds a generator
{fixed_bin_set, ElemSize, Cardinality}whereElemSizeis the size of a random binary element andCardinalityisthe size of the set. It makes use of the existing binary block
generation code in valgen.
(cherry picked from commit 3471aaf)
Add poisson_bin valgen w/ workaround to approx poisson via normal dist
when over a threshold size (cause it could be too slow!)
Add variable size binary set generator to create bins within
(minsize/maxsize, poisson dist, exp dist) params over a specified
cardinality
basho_bench driver for riak datatypes over pb, focused on sets right
now for current benchmark needs (and comparisons to bigsets)
driver allows for benches over preloaded sets, a single set, and
normal-stylings (creating sets via keygen) and contains calls for
batch_inserts via rdb's work
new distributions/valgens for bins and gen'ing/using them w/ var_bin_sets
cleaner examples
add maps benchies & examples
add more sets bench operations & examples