Commit graph

92 commits

Author SHA1 Message Date
Alexander
8e58c367dd
Fixed issue with wrong expiration timeout for projects (#1300)
* fix(backend): fixed issue with wrong expiration timeout for projects in cache layer

* fix(backend): removed direct call db.GetProject()

* feat(backend): set default PROJECT_EXPIRATION to 10 minutes
2023-06-08 18:08:53 +02:00
Alexander
f89d84232a
[DB] Added support for city/state autocomplete (#1317)
* feat(backend): added support for city/state autocomplete

* fix(backend): removed unused http handlers
2023-06-08 15:59:53 +02:00
Alexander
111d6a1b54
Azure support (#1270)
* feat(backend): implemented azure blob storage support

* feat(backend): added azure implementation to backend services

* feat(backend): added azure blob storage support to chalice service

* fix(backend): removed prev version of s3

* feat(backend): moved azure support to ee subfolder

* feat(backend): prepared ee code for new utils.objects package

* feat(backend): added missed modules to go.mod

* feat(backend): added missed modules to go.sum

* feat(backend): go mod tidy

* feat(backend): temporary made s3 vars are not required

* feat(backend): added azure lib to ee chalice

* feat(api): changed azure env var name

* feat(api): added new object store and extra methods to chalice ee

* fix(api): added azure blob lib to alerts

* fix(api): fixed incorrect call in sessions_devtool

* fix(crons): added azure blob storage library to requirements list

* chore(build): Error message for not providing flag.

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(backend): removed ios headers and object store for ios messages

* feat(backend): object config refactoring

* chore(helm): Update BUCKET_NAME

* fix(backend): removed object storage usage in http

* feat(backend): added debug logs to azure upload method

* fix(backend): fixed empty folder issue

* fix(backend): removed extra debug log

* chore(helm): Adding global variables for crons

* chore(helm): Remove clickhouse resource limit

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(backend): removed assets debug log

* feat(api): use ABC class instead of empty interface

* feat(api): renamed helpers to generators

* feat(api): changed prep/clean dev scripts

* feat(api): changed name obj_store -> StorageClient

* feat(api): some changes after code review

* fix(api): removed unnecesery packages in oss api

* feat(backend): moved azure implementation to ee folder

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-06-08 13:31:54 +02:00
Alexander
691c84d5f4
[HTTP] added city and state support for geo extractor (#1312)
* feat(backend/http): added city and state support for geo extractor

* feat(backend): use new GeoLite db in Dockerfile

* feat(backend/http): added unit test
2023-06-08 09:07:08 +02:00
Alexander
fe0840ee84
feat(backend): added support for new env variable to enable/disable Access-Control-* headers (#1308) 2023-06-06 16:54:56 +02:00
Alexander Zavorotynskiy
72ccac1aed fix(backend): added COMPRESSION_THRESHOLD env variable to Dockerfile 2023-05-09 17:50:16 +02:00
Alexander Zavorotynskiy
2c6f9a15ab fix(backend): added Content-Encoding to CORS for http service 2023-05-09 17:35:17 +02:00
Alexander Zavorotynskiy
b111cb55c7 fix(backend): correct compression ratio value 2023-05-05 09:45:39 +02:00
Alexander
528d1af173
Compression worker (#1233)
* feat(backend): added extra worker for session compression

* feat(backend): debug logs

* feat(backend): added compression ratio metric

* feat(backend): reduced number of duplicate logs

* feat(backend): rewrite workers managment
2023-05-04 17:46:43 +02:00
Alexander
742c038ecd
New env variable CLOUD (aws by default) (#1232)
* feat(backend): added new env variable CLOUD (aws by default)

* chore(backend): Adding env variable for CLOUD

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-04 16:48:48 +02:00
Alexander Zavorotynskiy
8aa14a68c9 fix(backend): disabled debug log in http handler 2023-05-02 16:59:57 +02:00
Alexander
19fc925462
Improved session compression (#1200)
* feat(backend): implemented new compression
2023-04-25 10:25:25 +02:00
Alexander
ef9fed8bf8
[Storage] different order to compress and encrypt (#1182)
* feat(backend): try to compress and encrypt in a new way
2023-04-19 11:04:35 +02:00
Alexander
e09396eaa3
Encryption metrics (#1151)
* feat(backend): added metric to measure the duration of session encryption

* feat(backend): enabled ecnryption

* feat(backend): fixed typo issue in packSession method
2023-04-12 15:00:55 +02:00
Alexander
d74ed000fa
Enable session encryption (#1121)
* feat(backend): enable session encryption

* feat(backend): fixed updated method name in failover algo

* feat(backend): disable encryption by default
2023-04-11 16:44:26 +02:00
Alexander Zavorotynskiy
e22845049d feat(backend): removed debug logs in http methods 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
f465d16110 feat(backend): removed debug logs in http methods 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
2a9c64ef16 feat(backend): debug log for body content 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
05e47e978b feat(backend): added compression threshold to start request 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
33fbdb149f feat(backend): more debug logs 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
cb0743cc1e feat(backend): added extra logs 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
12e4a5b59c feat(backend): using custom library for unzipping request body 2023-04-11 16:19:35 +02:00
Alexander Zavorotynskiy
6b665848bb feat(backend): implemented unzipping for http requests with gzip content-type 2023-04-11 16:19:35 +02:00
Alexander
f561593b1a
Memory control manager (#1067)
* feat(backend): added a mechanism to control memory consumption

* feat(backend): extra log for system allocation

* feat(backend): implemented new memory manager in db and heuristics service
2023-04-11 16:01:37 +02:00
Alexander Zavorotynskiy
517b98197a feat(backend/assets): skip text/html content type files 2023-03-22 12:54:27 +01:00
Alexander Zavorotynskiy
9110e9cd6d feat(backend): removed debug logs 2023-03-17 12:17:14 +01:00
Alexander Zavorotynskiy
181756ae59 feat(backend): added unbindNodes event to db filter 2023-03-17 12:17:14 +01:00
Alexander Zavorotynskiy
570662ca7a feat(backend): debug log for unbindNodes event 2023-03-17 12:17:14 +01:00
nick-delirium
fcf4d1bc7e Merge branch 'dev' into new-frustrations 2023-03-16 17:27:19 +01:00
Alexander Zavorotynskiy
89d45d2247 feat(backend): added skipped session metric for storage service 2023-03-14 11:53:20 +01:00
Alexander Zavorotynskiy
9e59d5e1ab feat(backend): added heuristics metric 2023-03-14 11:12:46 +01:00
Dayan Graham
0fe47eee48
feat(assets): Add support for mutual TLS to allow the assets service to fetch files behind authentication walls (#1034) 2023-03-13 17:58:39 +01:00
Alexander Zavorotynskiy
ded9a88fe9 feat(backend): implemented db inserts for InputDuration and MouseThrashing 2023-03-10 09:56:31 +01:00
Alexander
c6aac11cbf
Heuristics refactoring (#987)
* feat(backend): refactored heuristics service

* feat(backend): refactored db service (moved several events to heuristics)
2023-03-09 09:54:12 +01:00
Alexander
fdd28dbc4a
Draft: New metrics module (#982)
* feat(backend): created new metrics module
2023-02-20 16:37:55 +01:00
Alexander
a40ce7c376
[DB] async db inserts for PG and CH (#967)
* feat(backend): added async workers for db service
2023-02-13 13:58:03 +01:00
Shekar Siri
2db466e4fa remote main pull and resolved conflcits 2023-01-23 18:09:35 +01:00
Kraiem Taha Yassine
767d2f6f0c
V1.8.2 workers app name (#772)
* feat(backend): added application name to postgres connection

Co-authored-by: Alexander Zavorotynskiy <zavorotynskiy@pm.me>
2023-01-23 09:08:14 +01:00
Alexander
bfe14db353
[DB] added last quickwit changes (#950)
* feat(backend): added last quickwit changes
2023-01-20 16:18:00 +01:00
Mehdi Osman
576c06f090
Update bugsnag.json 2023-01-20 12:46:04 +01:00
Alexander
43b042aef8
[Sink] new message iterator (#945)
* feat(backend): implemented new version of sink message iterator
2023-01-20 09:49:49 +01:00
Alexander
a6e4779652
[HTTP] added custom project beacon size (#926)
* feat(backend): added project beacon size select on each sessionStart request
2023-01-18 12:36:34 +01:00
Alexander Zavorotynskiy
d88896d649 feat(backend): added 503 error for assets retrier 2023-01-11 17:53:36 +01:00
Alexander
44f9e4c120
[Storage] added sort operation for session messages (#921)
* feat(backend): added sort operation for session messages
2023-01-11 16:23:10 +01:00
Alexander Zavorotynskiy
d151c20ed8 feat(backend): new metrics for storage (uploading_duration) 2022-12-27 17:03:48 +01:00
Alexander Zavorotynskiy
efe1ae1dd7 feat(backend): removed old queue logger 2022-12-20 13:51:53 +01:00
Alexander Zavorotynskiy
1be50a4b5b feat(backend): fixed storage metrics 2022-12-19 14:45:27 +01:00
Alexander
cce7a7bdad
feat(backend): added black list for assets in sink service (#885) 2022-12-19 11:29:49 +01:00
Alexander
09adccf4be
feat(backend): added env variable for enabling pprof (#880) 2022-12-13 17:48:00 +01:00
Alexander Zavorotynskiy
19b6c896b9 feat(backend): fixed big file log in storage 2022-12-13 17:28:52 +01:00