scriptoriumadmin/featurebase
1
0
Fork 0
mirror of https://github.com/featurebasedb/featurebase.git synced 2026-08-28 10:54:59 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
No description
7465 commits 45 branches 174 tags 85 MiB
Find a file
Samir Patel 52418df4ba start periodic cache recalculation at startup
2021-06-01 10:47:08 -05:00
.circleci Avoid early exit in 'bash -eo pipefail' script 2021-05-26 11:55:44 -05:00
.github Add changelog steps to PR template 2019-04-12 13:47:40 -05:00
api/client Add log prefix levels 2021-04-12 20:33:39 -05:00
boltdb execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
client remove attributes 2021-05-14 10:28:08 -04:00
cmd tls config bug and arge handling 2021-05-24 11:00:37 -05:00
ctl add server flag 2021-06-01 10:47:08 -05:00
debugstats introduce storage.Config 2021-01-20 22:05:38 -06:00
disco replace roaring.Bitmap by [][]byte 2021-05-10 18:45:23 +02:00
encoding/proto remove attributes 2021-05-14 10:28:08 -04:00
etcd replace roaring.Bitmap by [][]byte 2021-05-10 18:45:23 +02:00
gcnotify v2.0.0 2019-10-08 14:56:17 -06:00
generator Address TODOs in roaring tests 2020-05-21 13:28:54 -05:00
gopsutil Upgrade gopsutil 2020-12-14 10:58:28 -06:00
hash [hash] Remove duplicated blake3 code 2020-09-07 12:24:22 +02:00
http added node partition endpoint;cluster aware key restore 2021-05-28 09:27:42 -05:00
internal Review skipped tests, and try to execute them again. 2021-03-30 13:37:33 +02:00
lattice remove prodpad integration 2021-05-26 12:09:56 -05:00
logger Apply review suggestion 2021-04-12 22:25:26 -05:00
lru so much lint 2019-04-16 12:07:18 -05:00
mock remove code related to pilosa-chk 2021-02-05 16:13:43 -06:00
net Address PR comments 2021-03-24 18:09:01 +01:00
pb remove attributes 2021-05-14 10:28:08 -04:00
pg Add log prefix levels 2021-04-12 20:33:39 -05:00
pql add an option to open a postgres transaction in lookup so it isnt actually a lookup 2021-05-26 14:07:52 -04:00
prometheus Add log prefix levels 2021-04-12 20:33:39 -05:00
proto Fix timestamp Extract() 2021-04-12 13:58:46 -06:00
rbf Merge branch 'master' into backup-poc 2021-05-07 13:37:11 -05:00
roaring gratuitously fancy logic for array/array callbacks 2021-05-10 11:58:18 -05:00
scripts Fix benchmark file naming 2021-05-21 14:51:08 -06:00
server start periodic cache recalculation at startup 2021-06-01 10:47:08 -05:00
shardwidth Fix enterprise license header and add shardwidth files to license header check 2019-04-12 11:57:28 -05:00
short_txkey pilosa: only open views with data 2020-12-19 00:03:31 +00:00
sql remove attributes 2021-05-14 10:28:08 -04:00
statik Add missing file 2020-08-31 09:02:46 -05:00
stats remove attributes 2021-05-14 10:28:08 -04:00
statsd Add log prefix levels 2021-04-12 20:33:39 -05:00
storage change default backend to RBF, remove separate RBF race target 2021-03-02 17:50:56 -06:00
synthload Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
syswrap avoid race on max count reads and writes 2020-02-21 16:38:36 -06:00
test remove attributes 2021-05-14 10:28:08 -04:00
testdata Test cases for Store(Distinct) 2020-09-14 14:15:29 -05:00
testhook use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
toml Add license headers to files missing them and CI check to verify they are present. Fixes #1633 2019-04-12 11:30:41 -05:00
topology Check state in shardsByNode once stator is implemented 2021-02-17 16:02:28 +01:00
tracing Add log prefix levels 2021-04-12 20:33:39 -05:00
txkey pilosa: only open views with data 2020-12-19 00:03:31 +00:00
vprint Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
.dockerignore Add new Docker build process and continuous delivery 2021-02-26 14:34:14 -06:00
.gitignore add .idea to .gitignore 2021-05-24 12:18:56 -07:00
.golangci.yml fix golangci-lint complaints 2019-11-10 17:58:46 -06:00
api.go set lastUpdated after cache calculation 2021-06-01 10:47:08 -05:00
api_test.go remove attributes 2021-05-14 10:28:08 -04:00
apimethod_string.go remove attributes 2021-05-14 10:28:08 -04:00
audit.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
audit_internal_test.go FragProxy reduces string memory consumption drastically 2020-12-11 21:01:15 +00:00
audit_test.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
barrier.go Remove lmdb dependency and references, vendor Barrier 2020-12-09 08:43:23 -06:00
barrier_test.go Remove lmdb dependency and references, vendor Barrier 2020-12-09 08:43:23 -06:00
bluegreentx.go drop "batched" flag from Add operation 2021-04-20 12:03:25 -05:00
bluegreentx_test.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
bolt.go wired in restore command 2021-05-21 09:27:08 -05:00
bolt_test.go drop "batched" flag from Add operation 2021-04-20 12:03:25 -05:00
broadcast.go remove Field.loadMeta() 2021-02-23 10:09:55 -06:00
bsi.go clarify bsi-building preconditions 2020-11-20 12:38:53 -05:00
bsi_test.go introduce "fields" directory between index and field 2021-03-05 16:56:44 -06:00
cache.go remove attributes 2021-05-14 10:28:08 -04:00
cache_test.go force ranked cache recalculation in Top after a skipped invalidation 2020-08-27 11:05:18 -04:00
catcher.go drop "batched" flag from Add operation 2021-04-20 12:03:25 -05:00
CHANGELOG.md Fix typo 2019-09-17 16:01:21 -05:00
client.go added node partition endpoint;cluster aware key restore 2021-05-28 09:27:42 -05:00
cluster.go execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
cluster_internal_test.go avoid nil pointer exception when failing to get listener 2021-05-04 15:17:41 -05:00
cmd.go Add log prefix levels 2021-04-12 20:33:39 -05:00
const_amd64.go remove lmdb as a Tx backend 2020-12-04 23:17:59 +00:00
const_other.go remove lmdb as a Tx backend 2020-12-04 23:17:59 +00:00
CONTRIBUTING.md simplify contributing instructions by removing weird upstream thing 2019-05-01 17:37:52 -05:00
dbshard.go wired in restore command 2021-05-21 09:27:08 -05:00
dbshard_internal_test.go drop "batched" flag from Add operation 2021-04-20 12:03:25 -05:00
dbshard_test.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
delete_test.go Update delete_test.go 2021-04-12 13:38:58 -05:00
diagnostics.go Add log prefix levels 2021-04-12 20:33:39 -05:00
diagnostics_internal_test.go Review skipped tests, and try to execute them again. 2021-03-30 13:37:33 +02:00
doc.go Apply Apache License 2.0 2017-04-28 14:22:03 -05:00
Dockerfile Fix incorrect build flags 2021-03-01 17:01:06 -06:00
Dockerfile-clustertests add lmdb, Tx call stats, and prep for db/shard. 2020-08-17 18:26:58 -05:00
event.go change all references to use subpackages: topology, net 2021-01-06 16:09:24 -06:00
executor.go execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
executor_internal_test.go handling aggregate types: add to protobuf, etc 2021-01-19 16:23:15 -06:00
executor_test.go add an option to open a postgres transaction in lookup so it isnt actually a lookup 2021-05-26 14:07:52 -04:00
field.go restore without restart 2021-05-21 09:27:08 -05:00
field_internal_test.go drop "another shard" test as it's probably not valid 2021-05-20 12:39:27 -05:00
field_test.go write shards per node 2021-05-10 13:54:18 +02:00
filesystem.go Add missing file 2020-08-31 09:02:46 -05:00
fragment.go execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
fragment_internal_test.go drop unused TxBitmap 2021-05-20 16:28:19 -05:00
gc.go fix some lint warnings raised in VS-Code 2019-04-17 18:10:05 -05:00
gendebug_test.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
generation.go Add log prefix levels 2021-04-12 20:33:39 -05:00
generation_debug.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
generation_nodebug.go Sources and Generations: tracking mmapped files 2019-11-12 12:14:29 -06:00
generation_test.go Tx integration milestone 2020-07-27 19:29:46 -04:00
gid.go database per shard, HolderConfig, rbf bit-wise import speedups. 2020-09-04 13:00:33 -05:00
go.mod add time based cache 2021-06-01 10:47:08 -05:00
go.sum add time based cache 2021-06-01 10:47:08 -05:00
handler.go sort import values stably without using sort.Stable 2021-05-20 12:39:27 -05:00
holder.go Add return to handleCommitIDs 2021-05-26 15:43:21 +02:00
holder_internal_test.go Write remote available shards to etcd, instead of local file. 2021-05-07 15:33:18 +02:00
holder_test.go remove attributes 2021-05-14 10:28:08 -04:00
idalloc.go restore idalloc 2021-05-21 09:27:08 -05:00
idalloc_test.go use testhook to ensure temporary files and directories are cleaned up 2021-03-11 19:42:10 -06:00
index.go applied ben's suggestions 2021-05-23 10:27:50 -05:00
index_internal_test.go remove Index.saveMeta(). remove support for deleing existence field. 2021-02-23 10:09:55 -06:00
index_test.go Switch timestamp field to use epoch instead of min/max 2021-04-14 08:46:37 -06:00
iterator.go v2.0.0 2019-10-08 14:56:17 -06:00
iterator_internal_test.go rename internal_tests. fix license header 2018-07-04 10:59:08 -05:00
LICENSE Apply Apache License 2.0 2017-04-28 14:22:03 -05:00
license.exceptions update license header check exceptions 2021-05-14 10:45:46 -04:00
like.go execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
like_test.go execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
main_test.go remove port_mapper because it can't work with our unrestartable server 2021-02-24 11:25:46 -06:00
Makefile go version set to 1.16.3 in makefile 2021-05-24 12:17:19 -07:00
metrics.go remove attributes 2021-05-14 10:28:08 -04:00
mmap_test.go Fix endpoint tests + change BitDepth type to uint64 2021-02-12 20:35:36 -06:00
NOTES rename slice to shard 2018-06-28 14:07:07 -05:00
NOTICE Remove a few more enterprise references 2020-06-26 15:57:21 -05:00
pilosa.go remove attributes 2021-05-14 10:28:08 -04:00
pilosa_internal_test.go remove attributes 2021-05-14 10:28:08 -04:00
pilosa_test.go Add client package with go-pilosa implementation 2021-03-22 20:22:38 +01:00
pjobs.go run migration in parallel 2020-11-05 18:31:27 +00:00
pjobs_test.go run migration in parallel 2020-11-05 18:31:27 +00:00
pprof.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
rbf.go wired in restore command 2021-05-21 09:27:08 -05:00
README.md Remove readme content that only applies to the open-source fork 2021-05-26 17:13:05 -05:00
row.go remove attributes 2021-05-14 10:28:08 -04:00
row_test.go fix differenceInPlace test 2020-01-30 13:38:31 -06:00
rrtx.go wired in restore command 2021-05-21 09:27:08 -05:00
rrtx_internal_test.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
serializer.go add a gob-encoding Serializer implementation for tests 2021-02-23 10:09:55 -06:00
server.go restore without restart 2021-05-21 09:27:08 -05:00
server_internal_test.go testhook: leak auditing infrastructure 2020-08-24 11:26:39 -05:00
snapshotqueue.go Add log prefix levels 2021-04-12 20:33:39 -05:00
stattx.go drop "batched" flag from Add operation 2021-04-20 12:03:25 -05:00
time.go Add parsing for partial time inputs 2021-02-15 22:55:35 +03:00
time_internal_test.go Add parsing for partial time inputs 2021-02-15 22:55:35 +03:00
tournament.sh remove instances of os.Getenv("PILOSA_TXSRC") 2021-01-21 21:18:46 -06:00
tracker.go Add 'ns' units to query history runtime json 2021-04-22 15:26:15 -05:00
tracker_test.go Update tests 2021-01-20 10:48:35 -06:00
transaction.go Add log prefix levels 2021-04-12 20:33:39 -05:00
transaction_test.go Add log prefix levels 2021-04-12 20:33:39 -05:00
translate.go execute like queries on the primary's key translation database 2021-05-27 14:45:10 -04:00
translator_test.go Review skipped tests, and try to execute them again. 2021-03-30 13:37:33 +02:00
tx.go drop unused TxBitmap 2021-05-20 16:28:19 -05:00
tx_internal_test.go Merge master into disco 2021-01-28 18:03:38 -06:00
tx_test.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
txfactory.go undo changes to IndexUsageDetails 2021-06-01 10:47:08 -05:00
txfactory_internal_test.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
util.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
utils_internal_test.go Move vprint to separate pakage 2021-03-29 14:29:19 +02:00
version.go Remove leftovers from lattice submodule 2021-05-26 10:04:46 -05:00
view.go remove attributes 2021-05-14 10:28:08 -04:00
view_internal_test.go remove attributes 2021-05-14 10:28:08 -04:00

README.md

Our private fork of Pilosa, a distributed bitmap index

Docs

See our internal documentation, which includes all external documentation, plus many internal-only pages, listed under the "Internal" heading in the main navigation bar.

The documentation for the open source fork is also available, but is outdated for most technical details. Conceptual explanations and technical blog posts may still be informative.

Getting Started

  1. Install Pilosa.

Optionally, to include Lattice, the in-browser UI, follow the "Build from source" instructions, and run make generate-statik before make install. When you run a local Pilosa server on the default host, for example, you can access Lattice at localhost:10101.

  1. Start Pilosa with the default configuration:

    pilosa server

    and verify that it's running:

    curl localhost:10101/status

  2. Follow along with the Sample Project to get a better understanding of Pilosa's capabilities.

Data Model

Check out how the Pilosa Data Model works.

Query Language

You can interact with Pilosa directly in the console using the Pilosa Query Language (PQL).

Client Libraries

Three client libraries were supported for the open source fork: Go, (https://www.pilosa.com/docs/client-libraries/#java), (https://www.pilosa.com/docs/client-libraries/#python). Of these, only the Go client has seen significant use and development in the private fork, and it has now been incorporated into this repository, in the client directory

License

Pilosa is licensed under the Apache License, Version 2.0.

A copy of the license is located in github.com/molecula/pilosa/LICENSE. More details about licensing are found in github.com/molecula/pilosa/NOTICE.