Commit graph

151 commits

Author SHA1 Message Date
Travis
9110d52573
Add tests for ImportFieldValue 2017-09-27 11:43:11 -05:00
Travis
01fa368c6a
Import FieldValues
This PR adds the ability to import field values into RangeEnabled frames
using the `pilosa import` command.

Example:
```
pilosa import -i i -f f --field foo sample-vals.csv
```
imports data from sample-vals.csv, which contains data in the format:
```
[ColumnID, Value]
```

Also fixes a bug where `frame.rangeEnabled` was not being set on frame creation.
2017-09-27 11:43:10 -05:00
Yuce Tekol
ad05938a5e
Enables auto-creating the schema on imports; Resolves #765 2017-09-22 14:56:36 +03:00
Matthew Jaffee
3d6dbcfc7b
use context everywhere instead of golang.org version 2017-08-30 10:36:28 -05:00
Todd Gruben
728308a5bb Merge branch 'master' into 16bitcontainer 2017-08-08 10:17:44 -05:00
Travis
a3b1b2ee1a
DefaultClusterType = ClusterGossip
This commit removes the `httpbroadcast` NodeSet, sets the default cluster type
to `gossip`, and uses the `static` cluster type for most test cases.
2017-08-07 08:25:35 -05:00
Travis
b6896482b9
move InternalPort config option out from under cluster and up to the root of Config 2017-07-24 17:28:23 -05:00
Linh Vo
6a50427629 rename Config's fields 2017-07-10 13:34:10 -05:00
Linh Vo
308ea8e993 revert to poll-interval 2017-07-10 11:31:43 -05:00
Linh Vo
95166fd0ee revert config and fix json tag 2017-07-10 11:28:32 -05:00
Linh Vo
e3090cb0c3 update doc for configuration 2017-07-07 15:12:16 -05:00
Linh Vo
cda46245d8 update config to match with json tag 2017-07-07 12:04:49 -05:00
Cody Soyland
85b1a73b73 Refactor test utilities into importable package.
Remove duplicate instances of test utilities from pilosa.ctl.
Now subpackages such as pilosa.ctl may import test utilities.
2017-06-23 09:10:15 -05:00
Matt Jaffee
057be3703e a few tweaks after rebasing 334-rle onto master 2017-06-19 11:19:27 -05:00
Ben Johnson
1c34ea7f8f
Add sorting flag to import command. 2017-06-08 11:00:02 -06:00
Linh Vo
f066d1e125 Merge pull request #586 from linhvo/improve-test-coverage
Improve test coverage for ctl package
2017-06-05 11:03:51 -05:00
Michael Baird
f0c3fdcdda Merge remote-tracking branch 'origin/master' into metrics 2017-05-30 15:36:19 -05:00
Linh Vo
a79e170256 more ctl tests 2017-05-29 13:41:23 -10:00
Linh Vo
bcc71b316a Merge branch 'master' of github.com:pilosa/pilosa into improve-test-coverage 2017-05-25 21:46:17 -05:00
Linh Vo
e34e9f9789 fixed comment, update validQueryArgs 2017-05-25 11:48:08 -05:00
Linh Vo
45acf3c9b9 backup test 2017-05-25 11:31:36 -05:00
Michael Baird
8df329da3f add metrics to sample config 2017-05-23 10:45:07 -05:00
Michael Baird
57da86dd8e cleanup merge conflict 2017-05-23 10:33:35 -05:00
Ben Johnson
788386b49a
Implement 'config' CLI command.
Renames `config` to `generate-config` and implements a new `config`
command that generates the configuration file based on the current
state instead of printing a static string.
2017-05-22 09:30:14 -06:00
Linh Vo
f392853134 update sliceMaxByIndex by view 2017-05-16 11:11:11 -05:00
Linh Vo
5de9a7d0d0 refactor view validator 2017-05-15 14:56:47 -05:00
Linh Vo
384329bc91 fix view always return error 2017-05-15 13:33:44 -05:00
Linh Vo
b635bdf970 #413 add tests and remove redundant word 2017-05-15 12:54:49 -05:00
Linh Vo
e20b9075e2 #413 set standard view as default for export command 2017-05-15 11:17:48 -05:00
Ben Johnson
e3d6f96657
Add max-writes-per-requests limit.
A configurable limit has been added to restrict the number of
mutating calls in a `pql.Query`. This is to prevents requests from
timing out from large queries.

The default is set to 5000 writes per request and is configurable
through the configuration file and the command line flags.
2017-05-03 08:53:20 -06:00
Cody Soyland
3996b56b88 Apply Apache License 2.0 2017-04-28 14:22:03 -05:00
Travis
2ad322c2c7
Rename DB to Index
Rename `db.go` to `index.go` and `db_test.go` to `index_test.go`
2017-04-23 21:49:27 -05:00
Ben Johnson
d34687121f
Rename bitmap/profile to row/column. 2017-04-21 21:23:24 -06:00
Travis
dcaf7617de
changed some json tag names to Lower Camel Case to be consistent with the rest 2017-04-19 14:01:46 -05:00
Matt Jaffee
0a324d14a5 add fix all package level docs 2017-04-18 14:11:42 -05:00
Ben Johnson
eff08af112 Separate physical data layout with views.
Previously, multiple frames with different prefixes were used to separate
different data layouts. This included separating standard row/column
layouts from inverted column/row layouts as well as storing aggregate
information for timestamp data.

Unfortunately, this caused frame meta data to be copied between multiple
frames and it made it difficult to keep these frames in sync.

This commit separates these different physical layouts into `Views`.
A `Frame` now has one or more views which represent each layout.
Fragments have been moved from under the `Frame` to be contained
within the `View`.

There are two primary views:

- `standard`
- `inverse`

If a frame has a time quantum, then views are generated for these
each of the standard/inverse views. For example a time quantum
of `YMDH` for the date `2000-01-02T00:00:00Z` would create the
following views:

- `standard_2000`
- `inverse_2000`
- `standard_200001`
- `inverse_200001`
- `standard_20000102`
- `inverse_20000102`

From the user's perspective, nothing should change in PQL. Different
PQL statements will handle the appropriate view automatically. For
example, `Bitmap()` and `Profile()` will fetch using the `standard`
view or the `inverse` view, respectively. The `Range()` statement
will lookup the appropriate time-based views automatically.
2017-03-24 13:57:02 -06:00
Matt Jaffee
77c25eeb06 fix readme and config command for new config style
still need to update readme to include info about environment variables, but at
least it isn't wrong anymore.
2017-03-17 20:42:41 -05:00
Matt Jaffee
60805d7f3e change port 15000 to 10101 everywhere 2017-03-17 16:43:04 -05:00
Matt Jaffee
176861d702 add embedded struct to contain io for commands
per @tgruben's suggestion
2017-03-17 16:43:04 -05:00
Matt Jaffee
59bbd583d7 Merge branch '273-use-subcommands' 2017-03-07 13:19:18 -06:00
Matt Jaffee
320110f011 tweak comments and remove dead code 2017-03-07 11:35:58 -06:00
Matt Jaffee
555a514e37 code review tweaks 2017-03-07 11:30:31 -06:00
Matt Jaffee
64f007547e move bench to subcommand 2017-03-03 15:14:02 -06:00
Matt Jaffee
01020d06a8 mvoe check to subcommand 2017-03-03 15:05:59 -06:00
Matt Jaffee
2c1929a063 move inspect to subcommand 2017-03-03 15:00:54 -06:00
Matt Jaffee
21478cb852 move restore to subcommand 2017-03-03 14:53:35 -06:00
Matt Jaffee
f20e6c193d move backup to subcommand 2017-03-03 14:46:45 -06:00
Matt Jaffee
312a9a5334 move sort to subcommand 2017-03-03 14:38:44 -06:00
Matt Jaffee
362539fe2d make export a subcommand 2017-03-03 14:21:17 -06:00
Matt Jaffee
e349dca06a move import to subcommand 2017-03-03 14:11:12 -06:00