Commit graph

345 commits

Author SHA1 Message Date
Alexander
bfe14db353
[DB] added last quickwit changes (#950)
* feat(backend): added last quickwit changes
2023-01-20 16:18:00 +01:00
Alexander
43b042aef8
[Sink] new message iterator (#945)
* feat(backend): implemented new version of sink message iterator
2023-01-20 09:49:49 +01:00
Alexander
861302bba7
[Ender] new message iterator (#929)
* feat(backend): added new message iterator especially for ender
2023-01-18 14:43:24 +01:00
Alexander
da7d2038ef
[DB] added url field for click rage issues (#925)
* feat(backend): added url field for click rage issues
2023-01-18 13:38:10 +01:00
Alexander
a6e4779652
[HTTP] added custom project beacon size (#926)
* feat(backend): added project beacon size select on each sessionStart request
2023-01-18 12:36:34 +01:00
Alexander
286b0b25f8
Kafka library upgrade (#932)
* feat(backend): upgrade go modules

* upgrade alpine version in dockerfile
2023-01-17 16:03:40 +01:00
Alex Kaminskii
50b2bd17f4 fix(backend/assets):add asp.NET extension for caching; strip #fragment suffix on baseURL when resolving 2023-01-13 12:58:52 +01:00
Mehdi Osman
572971b7fc
Update Dockerfile 2023-01-12 12:09:20 +01:00
Alexander Zavorotynskiy
d88896d649 feat(backend): added 503 error for assets retrier 2023-01-11 17:53:36 +01:00
Alexander Zavorotynskiy
6972f84275 feat(backend): added batch and compression configuration for kafka producer 2023-01-11 16:52:32 +01:00
Alexander
44f9e4c120
[Storage] added sort operation for session messages (#921)
* feat(backend): added sort operation for session messages
2023-01-11 16:23:10 +01:00
rjshrjndrn
361010448a chore(build): Adding container signing support
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-01-03 12:42:53 +01:00
rjshrjndrn
4042ad9406 build(docker): Adding gitsha as env
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-12-28 12:54:04 +01:00
Alexander Zavorotynskiy
ee64d91a7e feat(backend): added metrics for postgres bulks (size and insert duration) 2022-12-27 18:58:46 +01:00
Alexander Zavorotynskiy
d151c20ed8 feat(backend): new metrics for storage (uploading_duration) 2022-12-27 17:03:48 +01:00
Alexander
f1d852abb4
[DB] moved click events to bulks (#892)
* feat(backend): moved click events to bulks
* feat(backend): insert click event with host + path
2022-12-26 15:59:32 +01:00
Alexander Zavorotynskiy
efe1ae1dd7 feat(backend): removed old queue logger 2022-12-20 13:51:53 +01:00
Alexander
c54e23386a
[DB] removed pg transactions (#889)
* feat(backend): removed pg transactions for webErrors and issueEvents
2022-12-20 13:32:32 +01:00
Alexander Zavorotynskiy
1be50a4b5b feat(backend): fixed storage metrics 2022-12-19 14:45:27 +01:00
Alexander
cce7a7bdad
feat(backend): added black list for assets in sink service (#885) 2022-12-19 11:29:49 +01:00
Rajesh Rajendran
8e7198a4eb
Adding profile variable to Dockerfile (#881) 2022-12-13 17:50:20 +01:00
Alexander
09adccf4be
feat(backend): added env variable for enabling pprof (#880) 2022-12-13 17:48:00 +01:00
Alexander Zavorotynskiy
19b6c896b9 feat(backend): fixed big file log in storage 2022-12-13 17:28:52 +01:00
Alex K
b3cbf74deb
Merge branch 'dev' into network-request-messahe 2022-12-13 17:12:15 +01:00
Alexander
bab5a81959
[Storage] added workers perf improvements (#877)
* feat(backend): added workers for storage service
2022-12-13 14:35:41 +01:00
Mehdi Osman
2372008248
Turning failover to false by default 2022-12-12 22:12:39 +01:00
Alex Kaminskii
e6ad085f2e refactor(mobs/backend):write ResourceTiming to devtools.mob 2022-12-12 15:47:11 +01:00
Alex Kaminskii
ff80386aff feat(backend,mobs):replace Fetch with NetworkRequest 2022-12-09 15:48:47 +01:00
Alex K
e861bd9641
refactor(backend):remove legacy message wrapping (#854)
* refactor(backend):remove legacy message wrapping & few backend-only messages
2022-12-06 11:54:36 +01:00
Alexander
17d9a4a116
[Iterator] batch pre-decoding (#852)
* feat(backend): batch pre-decoding implementation
2022-12-05 11:21:26 +01:00
Alexander Zavorotynskiy
065ecf9e03 feat(backend/ender): logs improvements 2022-12-01 12:47:08 +01:00
Alexander Zavorotynskiy
37c31db69d feat(backend/ender): logs clean up 2022-12-01 12:33:28 +01:00
Alexander Zavorotynskiy
2dc8af998c feat(backend/ender): remove from memory sessions with wrong duration 2022-11-30 17:44:35 +01:00
Alexander
08b47991aa
feat(backend/mobs): clean up ruby templates and final generated code (#851) 2022-11-29 17:17:01 +01:00
Alexander Zavorotynskiy
5e8111e5d4 feat(backend): added rebalancing handler to all services 2022-11-29 13:21:16 +01:00
Alexander Zavorotynskiy
90f88abdb4 feat(backend): fix vulnerability in /x/net 2022-11-29 11:44:58 +01:00
Alexander
8a8cf4d938
feat(backend/sink): manually sync all files on partitions rebalanced event (#847) 2022-11-29 11:34:39 +01:00
Alexander Zavorotynskiy
70d7210e9a feat(backend/sink): write big messages directly to file 2022-11-28 14:58:18 +01:00
Jorgen Evens
e0a88666af feat(redis): add suppport for credentials and TLS
By using `ParseURL` it is now possible to
- Supply login credentials for the redis instance
- Use an encrypted TLS connection by setting the scheme to `rediss://`
2022-11-25 19:16:01 +01:00
Alexander
9e319ed27c
[Sink] Improved files sync algo (#831)
* feat(backend): use channel of changed sessions instead of sync.Map

* feat(backend): avoid memory alloc for message body in message iterator

* feat(backend): removed unnecessary locks in file syncer

* feat(backend): sync.Map with prev updates

* feat(backend): improved write algorith (added bufio.Writer)

* feat(backend): session writer refactoring

* feat(backend): removed unnecessary type definition

* feat(backend): added write retrier to avoid data losing

* feat(backend): refactoring

* feat(backend): added session file implementation
2022-11-25 17:25:55 +01:00
Rajesh Rajendran
4698075aa0
Make helm installation namespaces customizable (#836)
* chore(helm): Better configurability.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(init): Adding sleep 10 for resources to be up

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(helm): Updated env vars

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(helm): Derive namespace from minio endpoint

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(helm): Update namespace for chalice env vars

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(init): random secret for assist jwt secret

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(backend): Removing unnecessary files

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2022-11-25 10:27:12 +00:00
Dayan Graham
5d37d2da1e
feat(backend): enable Kerberos authentication for Kafka communication… (#807)
* feat(backend): enable Kerberos authentication for Kafka communications between services for EnterpriseEdition

* feat(backend): put default value for KAFKA_USE_KERBEROS

* feat(backend): Add Kerberos auth for Kafka - Update with comments for the envvars that configure the Kerberos auth
2022-11-22 12:10:01 +01:00
Alexander
e67c3ec876
[Sink] Zombie session killer feature (#829)
* feat(backend): added zombie session killer feature
2022-11-22 11:53:21 +01:00
Alexander
5a1cd27ebc
[Sink] Async session writer (#826)
* feat(backend): implemented async session writer module
2022-11-21 19:22:10 +01:00
Alexander Zavorotynskiy
c33279c141 fix(backend): fixed wrong error check 2022-11-21 11:02:00 +01:00
Alexander Zavorotynskiy
4865ee42d1 feat(backend): updated golang text lib 2022-11-17 17:10:37 +01:00
Alex Kaminskii
1e17c5d2f9 fix(backend):hash payload to ID only in js-sourced errors 2022-11-17 16:48:15 +01:00
Alexander
91709ac909
[Sink] splitting mob files without folders (#824)
* feat(backend): split mob file into 2 without folders
2022-11-17 16:15:25 +01:00
Taha Yassine Kraiem
b452d88265 Merge remote-tracking branch 'origin/api-v1.8.2' into dev 2022-11-14 16:10:31 +01:00
Taha Yassine Kraiem
a30a9a29ed chore(build): allow full parallel build 2022-11-14 16:10:13 +01:00