Commit graph

763 commits

Author SHA1 Message Date
AlteredCoder b81c735d81 remove debug while fixing test 2020-08-30 16:04:51 +02:00
AlteredCoder 7f45c43eb1 change github workflow to get latest release 2020-08-28 16:37:35 +02:00
Thibault "bui" Koechlin b2ef6a555c
add support for 'prometheus_mode' configuration directive that can be set to 'aggregation' to limit the cardinality of prometheus metrics (#192) 2020-08-24 11:51:50 +02:00
erenJag 6624fce66a
fix tests (#191)
* fix leakybucket test
2020-08-24 10:25:52 +02:00
AlteredCoder a6fabcf481 fix CI in leakybuckets 2020-08-23 23:42:24 +02:00
AlteredCoder 3801dcc277 fix parser tests 2020-08-23 23:34:12 +02:00
erenJag 25dfcebf4c
improve fileInit func by not loading unspecified data (#189)
* improve fileInit func by not loading unsepcified data
2020-08-21 14:20:44 +02:00
Thibault "bui" Koechlin 5595070e67
handle multiple plugins for now (append results rather than taking the 'last one' (#185) 2020-08-21 12:28:59 +02:00
Thibault "bui" Koechlin 1956f52be5
add a warning when a grok pattern ends with \n (#183) 2020-08-20 15:07:50 +02:00
Thibault "bui" Koechlin 742435f178
Acquisition extra tests (#188)
* acquisition testing
2020-08-20 13:55:52 +02:00
Thibault "bui" Koechlin 1398a74c6d
add extra tests for exprlib visitors (#187)
* add extra tests for exprlib visitors
2020-08-20 11:53:47 +02:00
Thibault "bui" Koechlin ceb69f0cef
documentation improvment (#182) 2020-08-07 09:40:43 +02:00
AlteredCoder 747065229e
fix expr debugger (#178)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-08-05 16:27:16 +02:00
Thibault "bui" Koechlin 7525f11975
improve tests in pkg/leakybuckets (#171) 2020-08-05 11:39:54 +02:00
Thibault "bui" Koechlin 8128dcf61b
add more tests for pkg/parser (config loading) (#172) 2020-08-05 11:20:03 +02:00
AlteredCoder b10c7e9bef
fix expr debugger when no variable is present (#174)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-08-04 16:44:03 +02:00
AlteredCoder d8f0f5a3a9
Add debug expr (#168)
* debug expr in node.go
* update documentation

Co-authored-by: AlteredCoder <AlteredCoder>
Co-authored-by: Thibault bui Koechlin <thibault@crowdsec.net>
2020-08-03 12:21:15 +02:00
Thibault "bui" Koechlin 085dcc5eb6
add a basic functional tests in the CI (#169) 2020-07-31 16:16:23 +02:00
AlteredCoder b7096be6e6
fix message to verbose in expr helper (#166)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-30 17:12:47 +02:00
Thibault "bui" Koechlin 0356f8404b
add tests for pkg/database (#151) 2020-07-30 15:58:06 +02:00
AlteredCoder d23512e9c6
improve logging (#164)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-30 15:30:02 +02:00
Thibault "bui" Koechlin b19046939c
sqlite set busy timeout to 10s rather than 1s (#162) 2020-07-30 11:39:06 +02:00
Thibault "bui" Koechlin d2ffb190f9
add a default configuration file if none is specified (#159) 2020-07-29 16:58:25 +02:00
AlteredCoder 5e561e30bd
fix cwapi bug with new sling usage (#157)
* fix sling usage

Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-29 15:15:33 +02:00
erenJag 89c8d1a527
rename metrics and update metrics helps (#152)
* rename metrics and update metrics helps

* add meta info about crowdsec

Co-authored-by: erenJag <erenJag>
2020-07-29 15:03:15 +02:00
Thibault "bui" Koechlin acc0960c17
match the hashes version in reverse order (#156) 2020-07-29 15:02:52 +02:00
AlteredCoder 794d3221d0
add tests in pkg/csconfig and improve pkg/exprhelpers tests (#150)
* add tests for csconfig & improve exprhelpers tests
2020-07-28 15:38:48 +02:00
AlteredCoder e6cb7f3a79 fix 2020-07-27 18:52:00 +02:00
AlteredCoder 55d5b6842c fix 2020-07-27 18:35:31 +02:00
Thibault "bui" Koechlin 056c7801c6
add unitest in cwhub package (#144) 2020-07-27 13:47:32 +02:00
Thibault "bui" Koechlin 151af2d0d8
No sql transaction + proper time-machine wait (#148) 2020-07-27 13:42:30 +02:00
AlteredCoder 851ad300cb
Add unitest in pkg/acquisition and pkg/cwapi (#145)
* ci for acquisition and cwapi

* update README


Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-27 12:18:55 +02:00
Thibault "bui" Koechlin a104e6d053
fix ban deduplication (#143) 2020-07-21 10:48:06 +02:00
AlteredCoder 40b7bfaf69
fix (#142)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-20 17:44:45 +02:00
Thibault "bui" Koechlin 66161bc8ae
fix auto-delete (#140) 2020-07-20 11:52:00 +02:00
AlteredCoder 0864f13cb8
fix post merge (#138)
* fix post merge (#138)
2020-07-17 15:26:46 +02:00
Thibault "bui" Koechlin 177480cff7
updated mysql plugin support (#135)
* add support for plugin, support mysql & so on

* fix queries

Co-authored-by: erenJag <erenJag>
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-16 16:05:03 +02:00
Thibault "bui" Koechlin 7fe6741df3
Simulation support (#136)
* support simulation mode
2020-07-16 15:59:09 +02:00
AlteredCoder 87a90583fe
Fix#80 (#133)
* fix #80 

Co-authored-by: AlteredCoder <AlteredCoder>
Co-authored-by: Thibault bui Koechlin <thibault@crowdsec.net>
2020-07-16 15:48:46 +02:00
Thibault "bui" Koechlin bc2566f3e5
support multiple args for all cscli upgrade/install/remove commands (#132) 2020-07-10 10:43:22 +02:00
erenJag 44304a30e7
fix #124 (#127)
* fix #124
2020-07-09 12:41:18 +02:00
Thibault "bui" Koechlin a0c1ca49d0
Doc : fix whitelists documentation + document data for parsers/scenarios + document expr helpers + link taxonomy (#126) 2020-07-08 10:58:20 +02:00
AlteredCoder d0ac43b00f
Allow comments with # in expr wordlists
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-07 16:26:00 +02:00
Thibault "bui" Koechlin a62bac0ca0
verbosity (#121) 2020-07-03 18:26:23 +02:00
Thibault "bui" Koechlin 7691e5b663
re-enable postoverflows (#117)
* re-enable postoverflows

* debug

* yoloooo

* remove debug

* remove error print

* fix test

* fix leakybucket test

* fix

Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-02 17:56:39 +02:00
AlteredCoder eef1847873
add whitelisted flag in signal occurence (#114) 2020-07-02 11:44:27 +02:00
erenJag f6826c7e47
add expr helper to check if IP is in ipRange (#113)
* add expr helper to check if IP is in ipRange

* update helper name

Co-authored-by: erenJag <erenJag>
2020-07-02 11:09:40 +02:00
Thibault "bui" Koechlin b9ae94b874
Sqlite : Support automatic db flushing (#91)
* add support for sqlite retention : max_records, max_records_age

* reduce verbosity of cwhub
2020-07-01 17:04:29 +02:00
Thibault "bui" Koechlin e4993996a5
exclude fields so that they are not serialized when we're rewritting api.yaml file (#103) 2020-06-29 17:47:57 +02:00
Thibault "bui" Koechlin 02b2193d64
fix collection dependencies : install subparts of collection, even if the collec file itself exists (#101) 2020-06-29 17:31:37 +02:00
Thibault "bui" Koechlin 652b54ee81
SignalOccurence can't lead to BanApplication if there is no source in the Event (#96) 2020-06-29 13:22:56 +02:00
AlteredCoder 2e30793188
Allow CrowdSec to start if geoip data are not downloaded (#92)
* Allow CrowdSec to start if `geoip` data are not downloaded
2020-06-25 12:36:01 +02:00
Thibault "bui" Koechlin 5446857377
Add crowdsec reload + cscli metrics minor improvements (#79) 2020-06-19 13:57:44 +02:00
Thibault "bui" Koechlin 8651a1aefc
skip ~ files #69 (#71)
* skip ~ files

* only keep .yaml et .yml files
2020-06-12 17:55:35 +02:00
Thibault "bui" Koechlin 26f77bed88
CI: provide makefile for CI and fixe types.Event (#70) 2020-06-11 15:03:43 +02:00
Thibault "bui" Koechlin 64c5fa7360
CI: add a CI to test parsers (#67) 2020-06-10 12:14:27 +02:00
AlteredCoder fc05a49cc3
Fix API push (#62)
* add debug

* debug

* remove debug

* remove typo

* fix linter

Co-authored-by: AlteredCoder <AlteredCoder>
2020-06-03 14:24:07 +02:00
Thibault "bui" Koechlin f9a4ae2b3f
fix #60 - sqlite lock + badges (#61)
* don't fatal is DB is locked + Fix #60
2020-06-03 14:18:00 +02:00
AlteredCoder 08c0167f15
fix debug (#58)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-06-02 16:17:30 +02:00
AlteredCoder 72d1fe4c3b
fix (#51)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-06-01 18:32:01 +02:00
Thibault "bui" Koechlin 430b7cd90d
add a 'Upper' expr helper (#50)
* add a 'Upper' expr helper

* remove redundant startsWith and endsWith
2020-06-01 16:12:48 +02:00
Thibault "bui" Koechlin f2e38b0d28
fix #47 #35 (#49) 2020-06-01 12:56:32 +02:00
AlteredCoder 82d6e6938a
Fix expr helpers "StartsWith" and "EndsWith" (#48)
* fix

* fix typo

Co-authored-by: AlteredCoder <AlteredCoder>
2020-05-29 17:25:09 +02:00
Thibault "bui" Koechlin 4e8aa19c09
bump version 0.0.4 + typo (#46)
* fix typo in history rewrite
* and bump version
2020-05-28 12:03:29 +02:00
AlteredCoder ea4e4153af fix review 2020-05-28 11:32:00 +02:00
AlteredCoder 937bd20c18 fix 2020-05-28 11:32:00 +02:00
AlteredCoder 083b9897d8 fix 2020-05-28 11:32:00 +02:00
Thibault "bui" Koechlin cda7beddbf add support in cscli to switch branches of hub (#43) 2020-05-28 11:32:00 +02:00
Thibault bui Koechlin b51d666dcb type 2020-05-28 11:32:00 +02:00
Thibault bui Koechlin 7563975eef only set if non-nil, avoid crash on unconfigured logger 2020-05-28 11:32:00 +02:00
Thibault bui Koechlin 80387fe66e simplify the code 2020-05-28 11:32:00 +02:00
Thibault bui Koechlin 87ff0883cf lower verbosity for this, give context to that 2020-05-28 11:32:00 +02:00
Thibault bui Koechlin 372d8680c3 unify loggers and improve the log message about groks when they're not called by name 2020-05-28 11:31:55 +02:00
Thibault bui Koechlin a06f8373ae move the setLogger config and ConfigureLogger to be part of types for reuse accross modules 2020-05-28 11:28:49 +02:00
Thibault bui Koechlin 3fa5122db7 only test directories 2020-05-28 11:28:49 +02:00
AlteredCoder 8d43abbf4c add context in log 2020-05-28 11:28:49 +02:00
AlteredCoder ed919a55be fiw review 2020-05-28 11:28:49 +02:00
AlteredCoder fd6ecd25df fix review 2020-05-28 11:28:49 +02:00
Thibault bui Koechlin 7657a0cc37 fix non unique grok name 2020-05-28 11:28:49 +02:00
Thibault bui Koechlin a199cd8b36 unify paths 2020-05-28 11:28:49 +02:00
Thibault bui Koechlin 7557ce8156 add 'in File(...)' tests for parsers and leakybuckets 2020-05-28 11:28:49 +02:00
Thibault bui Koechlin 6cb5ec0460 add a parser unit test using the 'in File(...)' construct 2020-05-28 11:28:49 +02:00
AlteredCoder 160478b419 add test for exprhelpers 2020-05-28 11:28:49 +02:00
Thibault "bui" Koechlin 1abdfc9b10 make message better 2020-05-28 11:28:49 +02:00
erenJag c020ff8c64
Merge pull request #22 from crowdsecurity/add_expr_helpers
add new expr helpers
2020-05-25 12:12:49 +02:00
Thibault "bui" Koechlin d9a37683e7
Merge pull request #27 from crowdsecurity/add_custom_error
Adding custom error.
2020-05-25 12:12:03 +02:00
FaricaUnknown 060a595244
Merge pull request #25 from crowdsecurity/json_extractor
add json support via expr helpers
2020-05-25 11:47:47 +02:00
Thibault bui Koechlin ed24638200 fix remark 2020-05-25 11:37:52 +02:00
Thibault bui Koechlin aad2e1421e fix printf 2020-05-25 11:35:32 +02:00
erenJag 34a6156097 add custom error to be able to ignore or fatalF when reference is missing in collection 2020-05-25 10:55:05 +02:00
AlteredCoder 1b54bbb909 add data folder parameter to hubMgmt 2020-05-24 19:53:05 +02:00
AlteredCoder 1f91bd8af0 make var public 2020-05-24 19:17:03 +02:00
AlteredCoder 6757fa3cee merge 2020-05-24 18:15:59 +02:00
Thibault bui Koechlin 1970a90813 debug is false in benchmark 2020-05-24 12:59:26 +02:00
Thibault bui Koechlin 88c72340e3 unique pattern names 2020-05-24 12:44:33 +02:00
Thibault bui Koechlin aa9badc70c reset stages 2020-05-24 12:41:45 +02:00
Thibault bui Koechlin d601e21afb working tests for json 2020-05-23 13:22:43 +02:00
AlteredCoder 74dd723ebf fix 2020-05-22 18:24:54 +02:00
AlteredCoder f8821b8982 fix dev config 2020-05-22 18:22:43 +02:00
Thibault bui Koechlin 32f32b41c7 add json support via expr helpers 2020-05-22 18:12:33 +02:00
AlteredCoder 019c8d3e18 fix package config name 2020-05-22 17:45:08 +02:00
AlteredCoder 62daa98bf3 add new helpers 2020-05-22 13:55:48 +02:00
Thibault bui Koechlin ada5d3fcfe explain linter bypasses 2020-05-22 10:12:35 +02:00
Thibault bui Koechlin e86b163ba5 linter fixes 2020-05-20 18:05:05 +02:00
Thibault bui Koechlin e643bb5b31 linter fixes, inefficient assignments 2020-05-20 17:50:56 +02:00
Thibault bui Koechlin e6cad40ac4 more linting fixes 2020-05-20 11:26:21 +02:00
Thibault bui Koechlin fe68914628 more linter fixes (simplicity mostly) 2020-05-20 11:00:25 +02:00
Thibault bui Koechlin db9e1e280d fix linter warnings : dead code, simplification 2020-05-20 10:49:17 +02:00
Thibault bui Koechlin 604b97a519 LGMT fixes + avoid capitalizing fmt.Errorf strings 2020-05-19 21:31:06 +02:00
Thibault bui Koechlin 3d2d39e77d up 2020-05-15 12:13:57 +02:00
Thibault bui Koechlin eb0b49cbbc up 2020-05-15 11:49:17 +02:00
Thibault bui Koechlin 58a9bb0bc0 rename 2020-05-15 11:42:56 +02:00
Thibault bui Koechlin 2016167654 initial import 2020-05-15 11:39:16 +02:00