Commit graph

248 commits

Author SHA1 Message Date
mmetc 8fecc2c00b
enable staticcheck linter; fixes (#1806)
- explicitly ignore returned parameters
 - replace Walk with faster WalkDir
 - log path error during hub dir sync
 - colorize static unit tests
 - removed duplicate import in crowdsec/main.go
 - typos
 - func tests: default datasource in tests/var/log instead of /tmp
 - action setup-go v3
2022-10-14 16:12:21 +02:00
AlteredCoder b95a67751e
Update ent and grokky package (#1772)
* Update ent and grokky package
2022-10-06 14:55:42 +02:00
mmetc af30ba0e3b
tests/bin cleanup (#1760) 2022-10-04 15:58:10 +02:00
blotus bfbe180101
Tighten windows sqlite database permissions (#1769) 2022-09-28 16:18:00 +02:00
mmetc 52fbda1a5e
simpler makefiles for static targets (#1744) 2022-09-14 14:22:57 +02:00
mmetc 414282a2c9
golangci-lint 1.49 and related fixes (#1736) 2022-09-06 13:55:03 +02:00
mmetc c4652d60a7
hardcode db password in CI to allow tests from third parties (#1729) 2022-09-01 16:49:12 +02:00
he2ss ea40ffd655
Datasource/kafka (#1698)
* add Kafka datasource
2022-08-30 17:03:45 +02:00
blotus 1f5224b74b
switch to go 1.19 (#1709) 2022-08-26 13:31:49 +02:00
mmetc eea07b7a1a
golangci-lint v1.48 and fixes for "usestdlibvars" (#1711) 2022-08-16 09:46:10 +02:00
blotus 3adb90e7b7
do not hide unit test failure (#1677) 2022-07-22 10:59:23 +02:00
Thibault "bui" Koechlin 0a372d83b9
fix again (#1641) 2022-07-06 14:34:39 +02:00
Thibault "bui" Koechlin 5e80bf3043
up (#1640) 2022-07-06 14:04:33 +02:00
Thibault "bui" Koechlin 9739de61b0
rename (#1639) 2022-07-06 13:58:03 +02:00
Thibault "bui" Koechlin 134ac2e68c
Issues templates improvements (#1629)
* add security.md
* add metrics and config show
2022-07-06 13:53:30 +02:00
mmetc b1cbf2e2e5
fix build/test badge (#1626) 2022-07-01 12:19:21 +02:00
mmetc 8e7e799304
[wip] serve metrics only after agent and/or lapi are ready; fixed some func tests (#1613) 2022-06-24 15:55:21 +02:00
mmetc c78c833400
CI: colored test output, colored crowdsec and crowdsec-api logs, full final db dump for mysql and sqlite (#1596)
* github-ci: color unit test output and logs
* new config option: force_color_logs (useful in CI)
* bats: show sqlite/mysql dump at the end
* removed "-v" (print package names) from "go build"
* general workflow cleanup
2022-06-17 16:12:49 +02:00
Thibault "bui" Koechlin 1c0fe09576
Add support for certificate authentication for agents and bouncers (#1428) 2022-06-08 16:05:52 +02:00
mmetc 799cc82bb5
functional tests, minor refactoring and lint/cleanup (#1570)
* cmd/crowdsec: removed log.Fatal()s, added tests and print error for unrecognized argument
* updated golangci-lint to v1.46
* lint/deadcode: fix existing issues
* tests: cscli config backup/restore
* tests: cscli completion powershell/fish
* err check: pflags MarkHidden()
* empty .dockerignore (and explain the reason)
* tests, errors.Wrap
* test for CS_LAPI_SECRET and minor refactoring
* minor style changes
* log cleanup
2022-06-06 15:24:48 +02:00
mmetc 1fc9587919
fix #1283: update and enable error reports from golangci (#1523) 2022-05-25 22:27:50 +02:00
mmetc d199223be0
update codeql actions (v1 is going to be deprecated) (#1563) 2022-05-25 10:06:22 +02:00
mmetc 8ea9e83798
Codecov (#1561)
* fix coverage report (#1553)

* codecov
2022-05-24 17:22:08 +02:00
mmetc f1cfcfe7cc
fix coverage report (#1553) 2022-05-23 09:50:35 +02:00
mmetc a7c7ea5712
increase lint timeout for windows (#1543) 2022-05-23 09:45:32 +02:00
mmetc afbdcd520b
update docker docs: filter on github.repository_owner == 'crowdsecurity' (#1511) 2022-05-17 12:49:25 +02:00
blotus 0449ec1868
Windows Support (#1159) 2022-05-17 12:14:59 +02:00
he2ss 2169dc674f
publish docker image to ghcr also (#1467) 2022-04-20 16:02:20 +02:00
mmetc d6d9bdd2ec
db tests CI: skip jobs by default; fix pg dump; check client requirements (#1454) 2022-04-19 11:41:50 +02:00
mmetc 5f2797c83c
more func test coverage; capture exit code for bincover (#1425) 2022-04-13 15:44:23 +02:00
mmetc 0190614342
show crowdsec logs after the tests (#1439) 2022-04-13 15:03:37 +02:00
mmetc bf4bc0c9fc
single workflow for all tests, with bats coverage (#1413) 2022-04-05 11:00:11 +02:00
mmetc 7e36432bf5
use golangci-lint 1.45.2 (#1420) 2022-04-04 21:16:18 +02:00
mmetc c54c9f2951
skip broken tests (w/ postgres and test coverage) (#1410) 2022-04-01 15:03:17 +02:00
mmetc 058237c9dd
install *.cover binaries in $BIN_DIR; minor workflow changes (#1408) 2022-04-01 14:12:03 +02:00
Thibault "bui" Koechlin cea793fc3a
cleanup mess (#1401) 2022-03-30 16:11:27 +02:00
Thibault "bui" Koechlin ec5587a734
Merge branch 'master' into master 2022-03-30 16:05:32 +02:00
Thibault "bui" Koechlin d8dc01cd94
Revamp unit tests (#1368)
* Revamp unit tests
* Increase coverage
* Use go-acc to get cross packages coverage

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2022-03-29 14:20:26 +02:00
mmetc 3f24bcdbcf
pg tests: pass now, waiting for fix (#1393)
* PG* variable names
* take DB_BACKEND from file name; reduce duplicated code; configure db_type=sqlite
2022-03-28 10:41:32 +02:00
mmetc 2f18808d68
print db logs after tests (#1390) 2022-03-25 12:17:28 +01:00
mmetc 7baa5d623b
pgx driver tests (#1379) 2022-03-23 11:13:23 +01:00
mmetc 8df58df757
use secret for db passwords in tests (#1381) 2022-03-23 09:40:23 +01:00
mmetc 9d337bfb0e
fake machine-id in CI (#1380) 2022-03-22 12:33:36 +01:00
mmetc 0667552132
bats: postgres tests (#1377)
* split CI/bats in sqlite+mysql+mariadb+hub
* renamed db and user 'crowdsec' to 'crowdsec-test'; moved backend-specific scripts to lib/db, etc.
* postgres tests
* force delay between ipv6 tests (for myisam)
* force delay after pg_restore to ensure data is written
2022-03-21 15:51:05 +01:00
Manuel Sabban b792c45921
Mysql enabled tests (#1372)
* add msyql backend test

Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2022-03-18 17:36:51 +01:00
mmetc b050d27e20
bats changes to allow bouncer testing (#1345) 2022-03-15 10:40:01 +01:00
mmetc c077668511
restore test_env.sh (#1332)
* restore test_env.sh, test 'make package' in CI
2022-03-10 09:28:42 +01:00
mmetc 59ad91a8ca
functional tests with bats-core (#1266) 2022-03-09 14:45:36 +01:00
he2ss 45c1075ae0
docker image: add multi arch platforms (#1270)
* docker image: add multi arch platforms
2022-02-28 12:04:31 +01:00
Andreas Krüger d18620858e
Create debian docker package including journalctl/systemd (#1233)
* Create debian docker package with journalctl

Co-authored-by: he2ss <hamza.essahely@gmail.com>
2022-02-15 17:10:15 +01:00
blotus 4a11060930
Kinesis datasource (#1147) 2022-01-11 14:19:43 +01:00
Manuel Sabban 51824d3bb8
add arg to hub func test (#1103)
* add arg to hub func test

* switch to go 1.17


Co-authored-by: sabban <15465465+sabban@users.noreply.github.com>
2021-12-16 11:06:31 +01:00
Kavin 0ffbbbec61
Add ARM docker images. (#1051) 2021-11-15 12:09:19 +01:00
alteredCoder 6bd80dbb86 update hubtest workflow 2021-10-07 16:45:28 +02:00
AlteredCoder 3b4c773890
fix hubtest CI (#1000) 2021-10-05 12:13:57 +02:00
AlteredCoder 0ccc69696b
Break on success when alert already has decision (#997) (#999)
* Break on success when alert already has decision (#997)

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-10-05 11:30:34 +02:00
alteredCoder 079172568a fix the CI coverage generation 2021-10-05 10:19:19 +02:00
alteredCoder 5c7f873e18 fix the coverage badge generation 2021-10-05 10:15:12 +02:00
alteredCoder 1e200d99d8 fix hubtest CI for coverage 2021-10-05 10:02:59 +02:00
alteredCoder 285351f4f9 fix hubtest CI for coverage 2021-10-05 09:56:18 +02:00
AlteredCoder 37eedce72e
add functionnal test for hubtest (#996)
* add hubtest in functionnal test
2021-10-05 09:52:55 +02:00
alteredCoder de87d0d951 fix badge coverage generation 2021-10-04 18:07:36 +02:00
Thibault "bui" Koechlin af4bb350c0
hubtests revamp + cscli explain (#988)
* New hubtest CI for scenarios/parsers from the hub
 * New `cscli explain` command to visualize parsers/scenarios pipeline

Co-authored-by: alteredCoder <kevin@crowdsec.net>
Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
Co-authored-by: he2ss <hamza.essahely@gmail.com>
Co-authored-by: Cristian Nitescu <cristian@crowdsec.net>
2021-10-04 17:14:52 +02:00
blotus e92862213e
allow coveralls job to fail, as it is down :( (#984) 2021-09-21 12:45:38 +02:00
Thibault "bui" Koechlin f5e54083c7
fix static build (#971)
* fix static build
2021-09-14 15:32:35 +02:00
Thibault "bui" Koechlin 055a0f08cb
up drafter fix typo (#955) 2021-09-09 16:40:22 +02:00
Shivam Sandbhor e89543f725
Add functional tests for plugins (#941)
* Add functional tests for plugins

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
(cherry picked from commit 1a11c87296454aac1ebbc95c06b813ae67c91819)

* Update plugin dir in functional tests

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>

* Update plugin process config in func tests

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>

* Robust config replacement

Signed-off-by: Shivam Sandbhor <shivam.sandbhor@gmail.com>
2021-09-08 15:22:34 +02:00
Thibault "bui" Koechlin 0ad6165ed2
fix release drafter + readme + remove dead readme for acquis (#933) 2021-09-03 09:07:24 +02:00
Thibault "bui" Koechlin 950759f6d6
Output plugins (#878)
* Add plugin system for notifications (#857)
2021-08-25 11:43:29 +02:00
Sofian Brabez 6a08e4ed7f
Remove non POSIX sed usage (#855)
`sed -r` is not compatible with POSIX. Replace it by `sed -E` which is
supported by either GNU sed or BSD sed
2021-07-08 08:50:40 +02:00
blotus 73e0bbaf93
remove arm docker image for now, as buildx is half-broken on ubuntu (#856) 2021-07-07 16:49:16 +02:00
Thibault "bui" Koechlin 204fa88e4d
add codeQL CI (#853)
* add codeQL
2021-07-06 11:55:45 +02:00
blotus e55e177baf
remove dispatch to packaging repo (#852) 2021-07-05 14:15:16 +02:00
Thibault "bui" Koechlin 3ecbb5a662
Create codeql-analysis.yml 2021-07-03 11:18:30 +02:00
blotus c026fc7f16
Build docker image for both amd64 and arm64 (#829) 2021-06-11 11:50:05 +02:00
Thibault "bui" Koechlin ce6a61df1c
Refactor Acquisition Interface (#773)
* Add new acquisition interface + new modules (cloudwatch, syslog)

Co-authored-by: Sebastien Blot <sebastien@crowdsec.net>
2021-06-11 09:53:53 +02:00
he2ss 2aee7be628
ignore CI when it concern documentation (#815) 2021-05-28 13:37:11 +02:00
he2ss eb0bd70046
fix #787 : load simulation config at startup (#793)
* fix #787 : load simulation config at startup
2021-05-17 11:54:28 +02:00
registergoofy e82ad5704d
fix (#768) 2021-04-27 11:20:20 +02:00
registergoofy 9102d37f27
Functional tests staticbuild (#767)
* try out func tests on uploaded tarball
* fix url of tarball
* fix tarball and uncompress

Co-authored-by: bui <thibault@crowdsec.net>
2021-04-27 10:23:45 +02:00
blotus 430b4bafbc
Update CI (#760)
* Force machine-id when running tests

* Use the source branch instead of master when dispatching to packaging repo
2021-04-20 11:07:13 +02:00
registergoofy 01c557e209
get rid of tmp stuff (#738) 2021-04-07 14:23:48 +02:00
registergoofy 10c98b6547
Static release (#737)
* dispatch on tag creation

* add static build to release

* fix static release tarball name

* This should be removed once merged and static release file built
2021-04-07 10:14:39 +02:00
Manuel Sabban e45cb167bd
dispatch on tag creation (#734)
Co-authored-by: registergoofy <70151212+registergoofy@users.noreply.github.com>
2021-04-06 16:24:34 +02:00
Thibault "bui" Koechlin 190fa112dd
Debian package auto-testing (#701)
* add dispatch to debian CI

* test dispatch

* keep only master

* push+mr

* document the functional tests
2021-03-19 16:28:55 +01:00
Thibault "bui" Koechlin f1b0414c89
Unified functional tests (#696)
* remove dead / not needed code & scripts

* don't rely on /dev/urandom in wizard

* unified functional tests
2021-03-18 13:59:41 +01:00
he2ss ccec56c1a6
Automatically update docker hub readme (github action) (#679)
* add new github action : update docker hub readme
2021-03-12 10:29:57 +01:00
AlteredCoder f2d14c8ca2
update the config.yaml file (#674) 2021-03-11 11:18:09 +01:00
Thibault "bui" Koechlin 986a0be812
fix wizard behaviour when detecting appropriate action (#573)
* fix wizard behaviour when detecting appropriate action

* fix filter handling with cscli

* add ipv6 tests

Co-authored-by: AlteredCoder <AlteredCoder>
2021-01-15 09:48:39 +01:00
AlteredCoder 5544000d38
lapi: fix ipv6 operations (#567) 2021-01-14 16:27:45 +01:00
AlteredCoder bd7bcff2fd
Add upgrade tests (#545) 2020-12-17 10:50:34 +01:00
Thibault "bui" Koechlin 825f8f83b2
up doc (#543) 2020-12-15 17:02:24 +01:00
AlteredCoder 79080d4e36
Fix cscli hub (#534) 2020-12-14 11:53:30 +01:00
Thibault "bui" Koechlin fd8c23eb09 Update issue templates 2020-12-08 22:37:46 +01:00
registergoofy 23a8707fad
first try at fixing the CI (#521) 2020-12-08 10:51:01 +01:00
erenJag 674630f7b1
trying to fix docker push ci (#519) 2020-12-07 15:44:24 +01:00
erenJag da5ca5f0ba
fix docker push CI ep3 (#518)
Co-authored-by: erenJag <erenJag>
2020-12-07 12:53:32 +01:00
AlteredCoder 6f4c72776a
remove debug for docker CI (#517)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-12-07 12:39:58 +01:00
AlteredCoder f8054e1f32
debug CI (#516)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-12-07 12:31:46 +01:00
erenJag bd69c8042a
fix docker CI (#515)
Co-authored-by: erenJag <erenJag>
2020-12-07 12:20:13 +01:00
erenJag 89f1c92d7e
fix docker ci (#514)
Co-authored-by: erenJag <erenJag>
2020-12-07 12:05:32 +01:00
erenJag 28c1ea1e23
Add ci docker push (#504) 2020-12-04 10:05:33 +01:00
Thibault "bui" Koechlin dbb420f79e
local api (#482)
Co-authored-by: AlteredCoder
Co-authored-by: erenJag
2020-11-30 10:37:17 +01:00
AlteredCoder 5f339ab312
fix hub tests CI (#469)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-11-25 16:54:15 +01:00
registergoofy dccd6ebb40
remove blank lines (#462)
*removel blank lines
* fix the ci looking for the last tag
2020-11-23 17:30:13 +01:00
registergoofy a6f3d49e46
fix the fuck*** CI (#451) 2020-11-19 15:49:29 +01:00
AlteredCoder b7286d6a85
make cscli use crowdsec version for hub (#194) 2020-09-01 14:32:45 +02:00
AlteredCoder 7f45c43eb1 change github workflow to get latest release 2020-08-28 16:37:35 +02:00
AlteredCoder 2db6882202
add new workflows to create/delete branch on hub (#193) 2020-08-28 15:24:10 +02:00
Thibault "bui" Koechlin 1398a74c6d
add extra tests for exprlib visitors (#187)
* add extra tests for exprlib visitors
2020-08-20 11:53:47 +02:00
Thibault "bui" Koechlin fbebee01d3
Doc improvement v0.3.0 (#173) 2020-08-05 11:24:34 +02:00
Thibault "bui" Koechlin 085dcc5eb6
add a basic functional tests in the CI (#169) 2020-07-31 16:16:23 +02:00
AlteredCoder 8dc8d2c81d fix typo in release drafter 2020-07-30 15:59:05 +02:00
AlteredCoder daf2a350ea
improve release-drafter configuration (#165)
Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-30 15:42:48 +02:00
AlteredCoder 773d0f4d84 fix workflow trigger for dispatch 2020-07-29 13:20:20 +02:00
AlteredCoder b9ba2ffb55 fix workflow trigger for dispatch 2020-07-29 13:16:12 +02:00
AlteredCoder 7ba1ab4a66 fix workflow trigger for dispatch 2020-07-29 13:13:06 +02:00
AlteredCoder a2b6b31a26
Add new workflow to create tag in hub-tests (#153) 2020-07-29 12:36:02 +02:00
AlteredCoder 00ee2d0fdc fix typo in README 2020-07-27 13:48:25 +02:00
AlteredCoder 851ad300cb
Add unitest in pkg/acquisition and pkg/cwapi (#145)
* ci for acquisition and cwapi

* update README


Co-authored-by: AlteredCoder <AlteredCoder>
2020-07-27 12:18:55 +02:00
AlteredCoder 68c749bc9c Update issue templates 2020-06-24 17:02:52 +02:00
erenJag bdda08223e
Fix hub CI (#86) 2020-06-24 15:00:30 +02:00
AlteredCoder c63d1153a3 Update issue templates 2020-06-23 12:46:05 +02:00
AlteredCoder 9545ba87e6 Update issue templates 2020-06-23 12:42:04 +02:00
AlteredCoder e93a8b0c39 Update issue templates 2020-06-23 12:36:53 +02:00
AlteredCoder be0e1cd79f Update issue templates 2020-06-23 12:32:57 +02:00
Thibault "bui" Koechlin e3525f970b
Ci improvements (#68) 2020-06-10 14:24:02 +02:00
Thibault "bui" Koechlin 64c5fa7360
CI: add a CI to test parsers (#67) 2020-06-10 12:14:27 +02:00
Thibault "bui" Koechlin 051a1b427a
remove requirement for version in RELEASE.json, the version is guessed from the git tag (#64) 2020-06-03 15:59:13 +02:00
Thibault bui Koechlin 68d8ec73f7 don't make action fail if there is warnings, it's not flawless yet 2020-05-22 11:49:54 +02:00
Thibault bui Koechlin 356ce3e7f9 yep all good 2020-05-22 09:59:35 +02:00
Thibault bui Koechlin 14c6ce1353 try fixed version of golangci-lint 2020-05-22 09:50:15 +02:00
Thibault bui Koechlin 7035622146 fetch master 2020-05-21 10:31:42 +02:00
Thibault bui Koechlin 060ceb0dc7 git diff 2020-05-21 10:28:06 +02:00
Thibault bui Koechlin 7e61c809f7 try to mimic golangci-lint git behaviour 2020-05-21 10:09:25 +02:00
Thibault bui Koechlin 7a2e8dfacd try to mimic golangci-lint git behaviour 2020-05-21 10:08:17 +02:00
Thibault bui Koechlin 026bb223e0 check git present 2020-05-21 09:20:37 +02:00
Thibault bui Koechlin dc2b350b04 add verbose output 2020-05-20 19:25:34 +02:00
Thibault bui Koechlin 4804ba567c add key for diff 2020-05-20 18:21:54 +02:00
Thibault bui Koechlin 4d4993b75e only lint new code 2020-05-20 18:17:09 +02:00
Thibault bui Koechlin 181dfa41b3 only lint new code 2020-05-20 18:12:28 +02:00
Thibault bui Koechlin 307f1c0e9e add again now that actions are working 2020-05-20 17:31:38 +02:00
Thibault bui Koechlin a827f795d6 remove 2020-05-20 16:53:16 +02:00
Thibault bui Koechlin d00e0c5f38 comment golangci-lint action 2020-05-20 16:50:28 +02:00
Thibault bui Koechlin c3ed78805b use latest version 2020-05-20 16:43:19 +02:00
Thibault bui Koechlin 37caed0159 golangci-lint action 2020-05-20 16:29:51 +02:00
Thibault "bui" Koechlin 2d1db70d3e
update the release draft body for CI (#12) 2020-05-18 16:39:03 +02:00
Thibault bui Koechlin 68b12161b2 actions 2020-05-15 11:41:18 +02:00