No description
Find a file
Nia Weiss 6f421dad69
handle translation errors when using keys against an unkeyed index
This also adds tests for our error outputs.
2021-03-17 12:02:29 -04:00
.circleci Merge branch 'master' into disco 2021-03-04 16:56:35 -06:00
.github Add changelog steps to PR template 2019-04-12 13:47:40 -05:00
api/client add support for inspecting with a query 2020-07-09 13:29:15 -04:00
boltdb use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
cmd Revert "Basic pilosa changes for oracle support" 2021-03-14 22:17:26 -05:00
ctl use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
debugstats introduce storage.Config 2021-01-20 22:05:38 -06:00
disco Requested changes 2021-03-02 13:46:37 +01:00
encoding/proto Merge branch 'master' into disco 2021-03-02 22:11:04 -06:00
etcd report errors more clearly when trying to recreate leases 2021-03-11 19:42:10 -06:00
gcnotify v2.0.0 2019-10-08 14:56:17 -06:00
generator Address TODOs in roaring tests 2020-05-21 13:28:54 -05:00
gopsutil Upgrade gopsutil 2020-12-14 10:58:28 -06:00
hash [hash] Remove duplicated blake3 code 2020-09-07 12:24:22 +02:00
http don't reuse sync.Mutex between translate readers 2021-03-08 17:04:52 -06:00
internal Comment Status function 2021-03-03 23:47:47 +01:00
lattice@7871b74dbe upgrade UI for final Molecula 3.x/Pilosa 2.x release 2021-03-04 14:44:38 -06:00
logger use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
lru so much lint 2019-04-16 12:07:18 -05:00
mock remove code related to pilosa-chk 2021-02-05 16:13:43 -06:00
net add subpackages: topology, net 2021-01-15 11:47:35 -06:00
pg remove port_mapper because it can't work with our unrestartable server 2021-02-24 11:25:46 -06:00
pql Add helper function FirstStringArg 2021-03-16 16:32:35 +01:00
prometheus Revert "Add tags to MaxRow metric" 2020-04-10 20:59:19 -05:00
proto Remove TrackExistence configuration from gRPC CreateIndex 2021-01-07 15:19:08 -06:00
rbf Merge branch 'master' into rbf-typos 2021-03-12 20:16:17 -07:00
roaring doc comment 2021-02-22 11:50:01 -06:00
scripts Merge branch 'master' into disco 2021-03-02 22:11:04 -06:00
server Revert "Basic pilosa changes for oracle support" 2021-03-14 22:17:26 -05:00
shardwidth Fix enterprise license header and add shardwidth files to license header check 2019-04-12 11:57:28 -05:00
short_txkey pilosa: only open views with data 2020-12-19 00:03:31 +00:00
sql add withViews argument to api.Schema() method 2021-02-08 10:42:55 -06:00
statik Add missing file 2020-08-31 09:02:46 -05:00
stats query translation WIP 2020-10-22 10:47:29 -04:00
statsd v2.0.0 2019-10-08 14:56:17 -06:00
storage change default backend to RBF, remove separate RBF race target 2021-03-02 17:50:56 -06:00
synthload blue_green migration. holdbkg.go holder goroutine. 2020-09-11 14:24:15 -05:00
syswrap avoid race on max count reads and writes 2020-02-21 16:38:36 -06:00
test use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
testdata Test cases for Store(Distinct) 2020-09-14 14:15:29 -05:00
testhook use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
toml Add license headers to files missing them and CI check to verify they are present. Fixes #1633 2019-04-12 11:30:41 -05:00
topology Check state in shardsByNode once stator is implemented 2021-02-17 16:02:28 +01:00
tracing add trivial execution-time profiling 2019-10-29 15:23:37 -05:00
txkey pilosa: only open views with data 2020-12-19 00:03:31 +00:00
.dockerignore Add new Docker build process and continuous delivery 2021-02-26 14:34:14 -06:00
.gitignore Add git-submodule to manage lattice version 2021-01-22 15:05:19 -06:00
.gitmodules Add git-submodule to manage lattice version 2021-01-22 15:05:19 -06:00
.golangci.yml fix golangci-lint complaints 2019-11-10 17:58:46 -06:00
api.go fix ID allocation API after disco 2021-03-13 07:41:00 -06:00
api_test.go fix ID allocation API after disco 2021-03-13 07:41:00 -06:00
apimethod_string.go Apply resizer interface (remove and add node) 2021-02-04 20:26:41 +01:00
attr.go v2.0.0 2019-10-08 14:56:17 -06:00
attr_test.go use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
audit.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
audit_internal_test.go FragProxy reduces string memory consumption drastically 2020-12-11 21:01:15 +00:00
audit_test.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
barrier.go Remove lmdb dependency and references, vendor Barrier 2020-12-09 08:43:23 -06:00
barrier_test.go Remove lmdb dependency and references, vendor Barrier 2020-12-09 08:43:23 -06:00
bluegreentx.go Include roaring field and key details in usage endpoint 2021-01-29 17:48:24 -06:00
bluegreentx_test.go blue_green migration. holdbkg.go holder goroutine. 2020-09-11 14:24:15 -05:00
bolt.go Remove stutter and suffix from backend files 2021-03-07 22:11:51 -06:00
bolt_test.go Remove stutter and suffix from backend files 2021-03-07 22:11:51 -06:00
broadcast.go remove Field.loadMeta() 2021-02-23 10:09:55 -06:00
bsi.go clarify bsi-building preconditions 2020-11-20 12:38:53 -05:00
bsi_test.go introduce "fields" directory between index and field 2021-03-05 16:56:44 -06:00
cache.go Revert "Basic pilosa changes for oracle support" 2021-03-14 22:17:26 -05:00
cache_test.go force ranked cache recalculation in Top after a skipped invalidation 2020-08-27 11:05:18 -04:00
catcher.go Include roaring field and key details in usage endpoint 2021-01-29 17:48:24 -06:00
CHANGELOG.md Fix typo 2019-09-17 16:01:21 -05:00
client.go Apply resizer interface (remove and add node) 2021-02-04 20:26:41 +01:00
cluster.go handle translation errors when using keys against an unkeyed index 2021-03-17 12:02:29 -04:00
cluster_internal_test.go remove port_mapper because it can't work with our unrestartable server 2021-02-24 11:25:46 -06:00
cmd.go Copy dependency into project and use pilosa's logger 2019-10-03 09:44:48 -05:00
const_amd64.go remove lmdb as a Tx backend 2020-12-04 23:17:59 +00:00
const_other.go remove lmdb as a Tx backend 2020-12-04 23:17:59 +00:00
CONTRIBUTING.md simplify contributing instructions by removing weird upstream thing 2019-05-01 17:37:52 -05:00
dbshard.go Remove stutter and suffix from backend files 2021-03-07 22:11:51 -06:00
dbshard_internal_test.go use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
dbshard_test.go remove remaining references to "coordinator" 2021-02-23 17:23:09 -06:00
diagnostics.go Move disk capacity lookup to gopsutil wrapper package 2020-10-14 12:20:05 -05:00
diagnostics_internal_test.go disco/etcd work: fix lots of races, start all cluster nodes at once. 2021-01-12 21:06:12 -06:00
doc.go Apply Apache License 2.0 2017-04-28 14:22:03 -05:00
Dockerfile Fix incorrect build flags 2021-03-01 17:01:06 -06:00
Dockerfile-clustertests add lmdb, Tx call stats, and prep for db/shard. 2020-08-17 18:26:58 -05:00
event.go change all references to use subpackages: topology, net 2021-01-15 11:47:36 -06:00
executor.go Add helper function FirstStringArg 2021-03-16 16:32:35 +01:00
executor_internal_test.go handling aggregate types: add to protobuf, etc 2021-01-19 16:23:15 -06:00
executor_test.go handle translation errors when using keys against an unkeyed index 2021-03-17 12:02:29 -04:00
field.go Cache BitDepth on bsiGroup during index.Open. 2021-03-14 22:51:24 -05:00
field_internal_test.go Cache BitDepth on bsiGroup during index.Open. 2021-03-14 22:51:24 -05:00
field_test.go blue_green migration. holdbkg.go holder goroutine. 2020-09-11 14:24:15 -05:00
filesystem.go Add missing file 2020-08-31 09:02:46 -05:00
fragment.go fix logic in fragment.bitDepth() 2021-02-23 10:09:56 -06:00
fragment_internal_test.go use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
gc.go fix some lint warnings raised in VS-Code 2019-04-17 18:10:05 -05:00
gendebug_test.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
generation.go Tx integration milestone 2020-07-27 19:29:46 -04:00
generation_debug.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
generation_nodebug.go Sources and Generations: tracking mmapped files 2019-11-12 12:14:29 -06:00
generation_test.go Tx integration milestone 2020-07-27 19:29:46 -04:00
gid.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
go.mod Revert "Basic pilosa changes for oracle support" 2021-03-14 22:17:26 -05:00
go.sum Revert "Basic pilosa changes for oracle support" 2021-03-14 22:17:26 -05:00
handler.go Revert "Basic pilosa changes for oracle support" 2021-03-14 22:17:26 -05:00
holder.go go mod tidy 2021-03-12 12:48:53 +01:00
holder_internal_test.go WIP: load schema from etcd on holder open; validate indexes, fields, views 2021-02-12 20:32:31 -06:00
holder_test.go change attributes file ".data" to "column/row-attributes" 2021-03-05 16:56:44 -06:00
idalloc.go add ID auto-generation on the coordinator 2020-12-03 13:04:14 -05:00
idalloc_test.go use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
index.go Cache BitDepth on bsiGroup during index.Open. 2021-03-14 22:51:24 -05:00
index_internal_test.go remove Index.saveMeta(). remove support for deleing existence field. 2021-02-23 10:09:55 -06:00
index_test.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
iterator.go v2.0.0 2019-10-08 14:56:17 -06:00
iterator_internal_test.go rename internal_tests. fix license header 2018-07-04 10:59:08 -05:00
LICENSE Apply Apache License 2.0 2017-04-28 14:22:03 -05:00
license.exceptions Remove lmdb dependency and references, vendor Barrier 2020-12-09 08:43:23 -06:00
like.go add executor tests and license headers for like & UnionRows 2020-07-08 12:55:18 -04:00
like_test.go rbf: OffsetRange, ImportRoaringBits, CountRange work 2020-07-30 20:20:38 -04:00
main_test.go remove port_mapper because it can't work with our unrestartable server 2021-02-24 11:25:46 -06:00
Makefile Merge branch 'master' into disco 2021-03-02 22:11:04 -06:00
metrics.go Merge branch 'master' into metric-typos 2020-09-14 17:20:49 -05:00
mmap_test.go Fix endpoint tests + change BitDepth type to uint64 2021-02-12 20:35:36 -06:00
NOTES rename slice to shard 2018-06-28 14:07:07 -05:00
NOTICE Remove a few more enterprise references 2020-06-26 15:57:21 -05:00
pilosa.go fix SaveMeta test; ensure storage backend env is used 2021-03-02 17:19:45 -06:00
pilosa_internal_test.go mixed row test 2021-02-22 15:06:45 -06:00
pilosa_test.go Fix RBF/pilosa hanging tests 2020-08-06 11:43:41 -06:00
pjobs.go run migration in parallel 2020-11-05 18:31:27 +00:00
pjobs_test.go run migration in parallel 2020-11-05 18:31:27 +00:00
pprof.go remove all instances of txsrc 2021-01-21 21:59:51 -06:00
rbf.go replace error with wrap 2021-03-12 13:27:28 -06:00
README.md Add lattice submodule upgrade instructions 2021-01-22 16:51:17 -06:00
row.go Add /schema/details endpoint, which includes field cardinality computed via Count(Distinct()) 2021-02-11 16:42:30 -06:00
row_test.go fix differenceInPlace test 2020-01-30 13:38:31 -06:00
rrtx.go reorganize the storage backends directory 2021-03-05 16:56:44 -06:00
rrtx_internal_test.go remove instances of os.Getenv("PILOSA_TXSRC") 2021-01-21 21:18:46 -06:00
serializer.go add a gob-encoding Serializer implementation for tests 2021-02-23 10:09:55 -06:00
server.go fix issue where restarting a cluster logged "invalid pilosa.Message" 2021-03-05 12:51:39 -06:00
server_internal_test.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
snapshotqueue.go change f.path to f.path() 2021-01-06 15:58:01 -06:00
stattx.go Merge branch 'master' into disco 2021-02-05 15:58:36 -06:00
time.go Add parsing for partial time inputs 2021-02-15 22:55:35 +03:00
time_internal_test.go Add parsing for partial time inputs 2021-02-15 22:55:35 +03:00
tournament.sh remove instances of os.Getenv("PILOSA_TXSRC") 2021-01-21 21:18:46 -06:00
tracker.go Pass SQL query string from mapper to tracker 2021-01-20 10:48:35 -06:00
tracker_test.go Update tests 2021-01-20 10:48:35 -06:00
transaction.go transactions as a list endpoint; added Transaction.CreatedAt 2020-08-12 23:11:54 -05:00
transaction_test.go TestTransactionManager: raise transaction timeouts to avoid sporadic failures 2020-06-29 13:44:20 -04:00
translate.go combine field and index translation readers 2021-03-09 13:37:51 -06:00
translator_test.go handle translation errors when using keys against an unkeyed index 2021-03-17 12:02:29 -04:00
tx.go Include roaring field and key details in usage endpoint 2021-01-29 17:48:24 -06:00
tx_internal_test.go Merge master into disco 2021-01-28 18:03:38 -06:00
tx_test.go change default backend to RBF, remove separate RBF race target 2021-03-02 17:50:56 -06:00
txfactory.go Remove stutter and suffix from backend files 2021-03-07 22:11:51 -06:00
txfactory_internal_test.go remove instances of os.Getenv("PILOSA_TXSRC") 2021-01-21 21:18:46 -06:00
util.go go mod tidy and linter 2021-01-15 17:48:44 -06:00
utils_internal_test.go remove type Topology 2021-02-05 16:13:43 -06:00
version.go change wording 2021-02-11 11:01:16 -06:00
view.go defer cluster messages until startup 2021-02-25 16:01:49 -05:00
view_internal_test.go change IndexOptions to reference by value 2021-02-23 10:09:54 -06:00
vprint.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
vprint_test.go remove lmdb as a Tx backend 2020-12-04 23:17:59 +00:00

CircleCI GoDoc Go Report Card license CLA Assistant GitHub release

An open source, distributed bitmap index.

Want to contribute? One of the easiest ways is to tell us how you're using (or want to use) Pilosa. We learn from every discussion!

Docs

See our Documentation for information about installing and working with Pilosa.

Getting Started

  1. Install Pilosa.

Optionally, to include Lattice, the in-browser UI, follow the "Build from source" instructions, and run make generate-statik before make install. When you run a local Pilosa server on the default host, for example, you can access Lattice at localhost:10101.

  1. Start Pilosa with the default configuration:

    pilosa server
    

    and verify that it's running:

    curl localhost:10101/status
    
  2. Follow along with the Sample Project to get a better understanding of Pilosa's capabilities.

Data Model

Check out how the Pilosa Data Model works.

Query Language

You can interact with Pilosa directly in the console using the Pilosa Query Language (PQL).

Upgrading UI

Lattice is now a submodule of Pilosa, for the purpose of keeping the frontend and backend components of the UI system synchronized. When making a change to the UI that requires changing both the backend and frontend, follow steps in this order:

  1. merge frontend (Lattice) PR
  2. run make upgrade-lattice
  3. run git add lattice, git commit -m"Upgrade Lattice", git push
  4. merge backend (Pilosa) PR

Client Libraries

There are supported libraries for the following languages:

License

Pilosa is licensed under the Apache License, Version 2.0.

A copy of the license is located in github.com/pilosa/pilosa/LICENSE. More details about licensing are found in github.com/pilosa/pilosa/NOTICE.

Get Support

There are several channels available for you to reach out to us for support.

Contributing

Pilosa is an open source project. Please see our Contributing Guide for information about how to get involved.