Commit graph

4285 commits

Author SHA1 Message Date
Travis Turner
08d7f65667
increase the translate file size for tests/benchmarks 2018-11-16 13:01:21 -06:00
seebs
377abb22c2
Merge pull request #1743 from seebs/seebs/stats
add some stat tracking to roaring/ implementation.
2018-11-16 10:02:00 -06:00
Seebs
8e270f9201 provide commented-out test case for bug in dead code
bitmapEquals isn't currently being called ever, but it has
an arcane edge-case bug, so I've made the test case for it
and commented it out for future reference.
2018-11-15 15:11:08 -06:00
Seebs
33add4f1e0 proof of concept for stats
This commit adds some trivial stat-tracking which can be
observed at localhost:10101/debug/vars. However, writes to
a locking data structure aren't cheap, so the stat-tracking
is by default not compiled. To build it, add the build
tag `roaringstats`, which will cause the `statsHit` function
to actually do something. Otherwise, it's an empty and
inlineable function, meaning the compiler throws it away
entirely.

This would, in principle, let us get additional visibility
into edge cases and which code paths are hot. This is not
the same thing as profiling for overall performance; the
stat counts aren't affected by whether a particular code path
is using a large amount of CPU time, just reporting how
often it happens at all.
2018-11-15 15:10:48 -06:00
Seebs
a203313143 move Logger and Stats to their own packages
I'd like to add stat tracking to Roaring, which means it
has to be able to import the stats package, which means
stats has to be a package rather than part of the pilosa
package. If stats stops being in pilosa, it still needs
a way to import logger, so logger also has to leave the
pilosa package. Then everything using them needs to import
them and use package selectors on their names.

This doesn't actually add the stats support to roaring,
it just makes it so there's a way to import the stats
code from something in the roaring package.
2018-11-15 15:10:44 -06:00
Yuce Tekol
84148d4ee6
Merge pull request #1742 from yuce/fix-unmarshal-bitmap-with-empty-data
Prevent panic in Bitmap.UnmarshalBinary when there is no data
2018-11-15 22:21:38 +03:00
Yuce Tekol
70f85211d9
prevent panic in Bitmap.UnmarshalBinary when there is no data 2018-11-15 22:06:21 +03:00
Cody Soyland
faac64dc99
Merge pull request #1740 from codysoyland/circleci-shield
Remove TravisCI, add CircleCI shield
2018-11-13 13:28:45 -06:00
Cody Soyland
1cd7ebdd2c Remove TravisCI, add CircleCI shield 2018-11-13 12:34:44 -06:00
Matthew Jaffee
49b75aef69
Merge pull request #1717 from jaffee/cluster-tests
Cluster tests
2018-11-13 12:10:54 -06:00
Matt Jaffee
a9d108200b
update circle ci config with cody's feedback 2018-11-13 11:52:08 -06:00
Matt Jaffee
08431f6e76
iterate on ci config 2018-11-13 09:53:44 -06:00
Matt Jaffee
26cd503393
try to run clustertests in CI 2018-11-13 09:51:22 -06:00
Matt Jaffee
bc8b991220
rename Dockerfile-withgo to Dockerfile-clustertests 2018-11-13 09:31:16 -06:00
Matt Jaffee
0d4a46af97
use internal client instead of go-pilosa, use ADD instead of wget 2018-11-13 09:24:35 -06:00
Matt Jaffee
37ac8b7a93
better use of docker-compose opts per code review 2018-11-12 17:44:23 -06:00
Matt Jaffee
90c5f64b19
filter memberlist debug and info logs, use t.Log instead of fmt in cluster tests 2018-11-12 14:01:57 -06:00
Matt Jaffee
9c9b1c5afe
Merge branch 'master' into cluster-tests 2018-11-09 12:23:21 -06:00
Matt Jaffee
8cd53bf2c2
Revert "msg type stringer"
This reverts commit dd4685d43b.
2018-11-09 11:34:32 -06:00
Matt Jaffee
dd4685d43b
msg type stringer 2018-11-09 11:28:53 -06:00
Matt Jaffee
deae8ce7c0
improvements to clustertests and fix cluster pause bug by state sharing 2018-11-09 11:28:19 -06:00
Yuce Tekol
8c99bd7a15
Merge pull request #1737 from yuce/remove-unused-rule-from-peg
Removed unused rule from peg grammar
2018-11-09 16:34:02 +03:00
Yuce Tekol
44e436f571
removed unused rule from peg grammar 2018-11-09 08:08:43 +03:00
Yuce Tekol
8e58fe3541
Merge pull request #1729 from yuce/1697-internal-client-error-report
Improve Internal Client errors. Fixes #1697
2018-11-08 16:23:35 +03:00
Yuce Tekol
f2394f6d93
lowercase error msg 2018-11-08 08:25:43 +03:00
Yuce Tekol
7b7e96bdee
Trivial 2018-11-07 18:47:15 +03:00
Yuce Tekol
8d5f76d4f4
Fixes #1697 2018-11-07 18:37:28 +03:00
Yuce Tekol
2416d7a4c0
Merge pull request #1727 from yuce/allow-backslash-cr-in-pql-strings
fix double escapes
2018-11-07 01:25:59 +03:00
Yuce Tekol
cad9d83c40
fix double escapes 2018-11-07 01:10:58 +03:00
Yuce Tekol
997f448ef5
Merge pull request #1713 from yuce/allow-backslash-cr-in-pql-strings
Allow backslash, carriage return in PQL strings
2018-11-06 23:58:49 +03:00
Yuce Tekol
0c0709eb20
Merge branch 'master' into allow-backslash-cr-in-pql-strings 2018-11-06 23:28:57 +03:00
Travis Turner
0dbd8738df
Merge pull request #1725 from travisturner/upgrade-peg
upgrade peg at: github.com/pointlander/peg
2018-11-06 14:16:19 -06:00
Yuce Tekol
6cdfafc257
Merge branch 'master' into allow-backslash-cr-in-pql-strings 2018-11-06 23:16:13 +03:00
Travis Turner
5b30393bc9
upgrade peg at: github.com/pointlander/peg 2018-11-06 14:12:06 -06:00
Travis Turner
89f0c82e01
Merge pull request #1724 from travisturner/upgrade-protoc
upgrade to protoc 3.6.1. (also updated protoc-gen-gofast).
2018-11-06 14:11:28 -06:00
Travis Turner
be202a61a7
upgrade to protoc 3.6.1. (also updated protoc-gen-gofast). 2018-11-06 14:01:09 -06:00
Yuce Tekol
1e30a9372d
Disabled unquoting for single quoted attribute values; updated test 2018-11-06 22:58:37 +03:00
Yuce Tekol
e9c1606a9d
Merge branch 'master' into allow-backslash-cr-in-pql-strings 2018-11-06 22:49:28 +03:00
Yuce Tekol
b158f1c378
unquote attribute values 2018-11-06 22:47:09 +03:00
alanbernstein
2e7d44ba29
Merge pull request #1722 from pilosa/minor-docs-updates
Minor docs updates
2018-11-06 11:43:29 -06:00
alanbernstein
7e6a2e41f6
Merge branch 'master' into minor-docs-updates 2018-11-06 11:30:13 -06:00
Yuce Tekol
56ee728724
Merge branch 'master' into allow-backslash-cr-in-pql-strings 2018-11-06 14:12:36 +03:00
Yuce Tekol
2a8f2c2026
minor grammar fix 2018-11-06 14:09:32 +03:00
Travis Turner
2ddde5fac6
Merge pull request #1719 from travisturner/import-shard-forward
forward imports to non-coordinator shards
2018-11-05 21:49:06 -06:00
Travis Turner
063caed8d1
forward imports to non-coordinator shards 2018-11-05 17:39:42 -06:00
Alan Bernstein
be5f8c923d Remove 'view' from nav 2018-11-05 12:34:08 -06:00
seebs
dde7551b88
Merge pull request #1712 from seebs/seebs/btree
Ensure btree comparison doesn't fail for smallish N

(Which is to say, differences between values exceeding the max value
of int.)
2018-11-05 11:53:41 -06:00
Alan Bernstein
497c541aff Remove outdated anchor link 2018-11-05 11:37:03 -06:00
Alan Bernstein
100c780704 Switch data model diagrams to png 2018-11-05 11:36:55 -06:00
Seebs
456c092930 enterprise/b: Ensure 64-bit range for btree keys.
The cmp() function used to compare btree keys was using the
trick of comparing unsigned values by coercing the result
of subtraction to a signed type. This is fine as long as
the range of differences never actually exceeds the limits
of the signed type. For instance, with int64, as long as
the magnitude of the difference is under 2^63 or so, it
works reasonably well.

Plain int, however, can be a 32-bit type, at which point
the magnitude of difference needed to break it is only
2^31 or so.

Subtraction and type conversion is enough cheaper than
branches that this is worth preserving, but it's worth
preserving by switching to an explicit int64 for the
operation and return type. This will not actually affect
performance except for people using the btree code on
32-bit machines, so it probably won't ever matter.
Which may also be true of the potential wrong answers,
but "might be slower" is a better risk than "might
crash".
2018-11-05 10:45:17 -06:00