Commit graph

5531 commits

Author SHA1 Message Date
Ben Johnson
11882b4577 Merge pull request #449 from benbjohnson/remove-ranked-suffix
Add cacheType to frame options.
2017-04-18 09:14:40 -06:00
Ben Johnson
d32edb5329 Add cacheType to frame options.
Previously the cache type (`lru` or `ranked`) was determined by
checking the ending suffix of the frame. If it ended with a `.n`
then it was ranked. Otherwise it was an LRU.

This commit changes frames so that a `cacheType` option can be
passed in during creation to set either `lru` or `ranked`.
2017-04-18 08:24:58 -06:00
Linh Vo
0e92b5af85 Merge pull request #456 from linhvo/rename-file
correct file's name
2017-04-17 22:16:17 -05:00
Travis Turner
acb12881af Merge pull request #452 from travisturner/proto-public-private
split `internal.proto` into `public.proto` and `private.proto`.
2017-04-17 18:03:51 -05:00
Linh Vo
b33c5a20fd correct file's name 2017-04-17 15:50:22 -05:00
Ben Johnson
9cbc786376 Consolidate Bitmap() & Profile() calls.
This commit changes the executor to select a bitmap from the
standard view or the inverse view based on whether the row label
or column label is specified.
2017-04-17 13:48:56 -06:00
Travis
4c16101a5a split internal.proto into public.proto and private.proto.
this allows us to share `public.proto` with the client libraries without needing to share
those that we only use internally.
2017-04-17 10:27:36 -05:00
Travis
9c1603318c adjustments to CONTRIBUTING.md instructions 2017-04-17 08:01:49 -05:00
Ben Johnson
a302521968 Merge pull request #447 from benbjohnson/inverse-opt-in
Opt-in to inverse storage.
2017-04-13 10:04:25 -06:00
Linh Vo
8f5a00ffe9 Merge pull request #414 from linhvo/364-argument-validation
364 argument validation
2017-04-12 13:20:13 -05:00
Linh Vo
172f7490f6 fixed conflicts 2017-04-12 12:31:56 -05:00
Ben Johnson
306cc0b64e Opt-in to inverse storage. 2017-04-12 08:34:31 -06:00
Ben Johnson
32f82ef8e1 Merge pull request #439 from benbjohnson/default-frame-time-quantum
Default time quantum on new frames.
2017-04-10 11:37:35 -06:00
Ben Johnson
6487da01a6 Default time quantum on new frames.
Sets the frame time quantum to the quantum on the parent database
when creating a new frame.
2017-04-07 16:28:03 -06:00
Travis
5259d5ae70 basic outline for CONTRIBUTING.md 2017-04-07 16:28:39 -05:00
Linh Vo
9abdb29269 remove duplicate code, move ValidateName out of validateOptions 2017-04-06 23:28:16 -05:00
Linh Vo
b2db339741 remove comment code 2017-04-06 16:20:08 -05:00
Linh Vo
37ffcd4ed9 refactor validateOptions 2017-04-06 16:03:35 -05:00
Ben Johnson
6ce4621eba Merge pull request #415 from benbjohnson/view-refactor
Refactor higher level view interface.
2017-04-05 17:01:01 -06:00
Ben Johnson
2731311378 Refactor higher level view interface. 2017-04-05 17:00:31 -06:00
Linh Vo
07e689ed58 custom UnmarshalJSON unit test 2017-04-05 15:40:02 -05:00
Yuce Tekol
5b790550d0 Merge pull request #416 from yuce/375-log-path-2
Adds log-path config
2017-04-05 21:57:33 +03:00
Matthew Jaffee
e743330605 Merge pull request #401 from jaffee/cleanup-cmd-tests
add docs for cmd tests
2017-04-05 13:55:12 -05:00
Yuce Tekol
6c7b1b513a return log err too 2017-04-05 21:35:30 +03:00
Yuce Tekol
2a87c6783a Check log file size > 0 2017-04-05 19:10:41 +03:00
Linh Vo
22475df035 revise unmarshalJSON 2017-04-05 10:50:56 -05:00
Yuce Tekol
63aadd9b5e Simplified log path test 2017-04-05 18:26:55 +03:00
Yuce Tekol
5353448a92 Adds log-path config 2017-04-05 16:09:43 +03:00
Linh Vo
1be7a42d14 custom Unmarshal JSON 2017-04-04 14:50:43 -05:00
Linh Vo
abd696ca56 rm govalidation phase 2017-04-03 10:50:19 -05:00
Linh Vo
c034293967 validate db and frame 2017-04-02 22:26:36 -05:00
Ben Johnson
261e327014 Merge pull request #412 from benbjohnson/max-inverse-slices
Separate max slices for standard and inverse views.
2017-03-29 14:53:41 -06:00
Ben Johnson
912fcb3464 Separate max slices for standard and inverse views.
Previously only the standard max slice was available. This commit
changes it so that the inverse max can be retrieved separately
through the `DB` and `Frame` types as well as through the
`HTTP` API and `Client`.
2017-03-28 13:01:04 -06:00
Linh Vo
07ce417f55 Merge pull request #410 from linhvo/378-set-profile-attr
SetProfilesAttrs with option column
2017-03-27 10:29:07 -05:00
Ben Johnson
ed09d0474f Merge pull request #400 from benbjohnson/views
Separate physical data layout with views.
2017-03-24 16:33:29 -06:00
Ben Johnson
071f1f2652 Fix rebase. 2017-03-24 14:01:01 -06:00
Ben Johnson
3a71003240 Re-sort inverted bits on import. 2017-03-24 13:57:02 -06:00
Ben Johnson
eff08af112 Separate physical data layout with views.
Previously, multiple frames with different prefixes were used to separate
different data layouts. This included separating standard row/column
layouts from inverted column/row layouts as well as storing aggregate
information for timestamp data.

Unfortunately, this caused frame meta data to be copied between multiple
frames and it made it difficult to keep these frames in sync.

This commit separates these different physical layouts into `Views`.
A `Frame` now has one or more views which represent each layout.
Fragments have been moved from under the `Frame` to be contained
within the `View`.

There are two primary views:

- `standard`
- `inverse`

If a frame has a time quantum, then views are generated for these
each of the standard/inverse views. For example a time quantum
of `YMDH` for the date `2000-01-02T00:00:00Z` would create the
following views:

- `standard_2000`
- `inverse_2000`
- `standard_200001`
- `inverse_200001`
- `standard_20000102`
- `inverse_20000102`

From the user's perspective, nothing should change in PQL. Different
PQL statements will handle the appropriate view automatically. For
example, `Bitmap()` and `Profile()` will fetch using the `standard`
view or the `inverse` view, respectively. The `Range()` statement
will lookup the appropriate time-based views automatically.
2017-03-24 13:57:02 -06:00
Linh Vo
292302f60b fix test 2017-03-24 13:45:00 -05:00
Linh Vo
22bac56dc5 test setProfileAttrs with option column 2017-03-24 12:26:49 -05:00
Linh Vo
7979b4d69b set profile attr for columnLabel 2017-03-24 12:18:59 -05:00
Linh Vo
74b5f99e15 Merge pull request #409 from linhvo/fix-instructions
fix README
2017-03-24 10:17:09 -05:00
Linh Vo
318a8a9f19 fix README 2017-03-24 09:56:14 -05:00
Linh Vo
b0c2c08b2a Merge pull request #407 from linhvo/311-topn-return-id
use id instead of key in topN results
2017-03-23 14:01:46 -05:00
Linh Vo
ac8018c4f3 change Pair struct Key to ID 2017-03-23 12:38:09 -05:00
Linh Vo
67a691dfe0 use id instead of key in topN results 2017-03-23 12:02:57 -05:00
Linh Vo
d93abb8d07 Merge pull request #369 from linhvo/tanimoto
add tanimoto option to pilosa
2017-03-23 10:45:44 -05:00
Matt Jaffee
6f27930f89 add docs for cmd tests 2017-03-21 13:45:06 -05:00
Matthew Jaffee
6e082df9e5 Merge pull request #397 from jaffee/config-readme-tweaks
some more readme fixes for the new config style.
2017-03-20 11:23:05 -05:00
Matthew Jaffee
49efc558e6 fix single dash config flag in readme 2017-03-20 11:16:30 -05:00