Commit graph

6717 commits

Author SHA1 Message Date
Alexander
d22e4e138e
Backend for mobile tracker support (#1456)
* feat(backend): handlers for mobile messages

* feat(backend): new service template

* feat(backend): save mobile session start and send batches to kafka

* feat(backend): added mobile support to sink, ender and storage

* helm(videostorage): added helm chart for a new service videostorage

* fix(backend): added pointer to streing for userBrowser (because it's null for mobile sessions)

* feat(backend): added MsgIOSBatchMeta handler to message iterator's logic

* feat(backend): added ios ts parser to ender

* feat(backend): enabled producing batch of messages to queue

* feat(backend): removed iosstart from mob files

* feat(backend): added new ios message types

* feat(backend): added iosStart and iosEnd

* fix(backend): fixed log issue

* feat(backend): send tar.gz archives to special queue topic

* feat(backend): read raw archives from kafka

* fix(backend): added missing file

* fix(backend): removed the second file reading

* fix(backend): fixed wrong queue topic name

* fix(backend): fixed mobile trigger topic name

* feat(backend): added tar.gz extractor and iOSSessionEnd handler

* feat(backend): debug logs on message uploading

* fix(backend): added raw-images topic consumption

* feat(backend): now sink send iosSessionEnd to video-storage

* feat(backend): added dir creator for new sessions

* feat(backend): added correct command to execute

* feat(backend): added overwrite option

* feat(backend): added s3 uploader for video session replays

* feat(backend): new consumer group for mobile sessions

* feat(backend): debug logs for uploader

* feat(backend): removed unused log

* feat(backend): fixed s3 key for video replays

* feat(backend): removed debug code

* feat(backend): fixed video-storage message filter

* fix(backend): added mobileSessionEnd to SessionEnd converter

* feat(backend): added first version if db support for mobile events

* fix(backend): added swipe events to mob file

* feat(backend): added swipe event to pg

* feat(backend): split logic into 2 services: image-storage and video-storage

* feat(backend): added helm chart for image-storage service

* fix(backend): fixed table name for mobile taps

* feat(backend): added metadata handler for mobile message parser + fix message filters

* feat(backend): added iosRawTopic to DB message consumer

* fix(backend): removed value from mobile inputs

* feat(backend): removed debug log from iterator

* feat(backend): added new apple devices to iOS device parser

* fix(backend): added real projectID instead of 0

* feat(backend): extended a list of simulators for device detector

* feat(backend): updated networkCall mobile message

* fix(backend): added new way to define is network call successed or not

* feat(backend): added timezone support for mobile start request

* feat(backend): added 2 mobile events Input and Click to mob file

* feat(backend): refactored image storage

* feat(backend): video storage with 2 workers

* feat(backend): added project's platform support

* feat(backend): added memory size field for mobile start request

* feat(backend): changed video preset for ultrafast

* feat(backend): added debug log to http /late handler

* feat(backend): added debug log to db service for iosCrash messages

* feat(backend): added tapRage event handler to heuristics

* feat(backend): changed table and field names for ios crashes

* feat(backend): added payload for tapRage events

* feat(backend): added TapRage events insert to DB

* feat(backend): added fps value to /mobile/start response

* feat(backend): added image quality parameter to /mobile/start response

* feat(backend): added ScreenLeave handler

* feat(backend): removed screenEnter and screenLeave events, added new viewComponent event

---------

Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-09 15:02:20 +02:00
Alexander
bb7c086c5b
Performance patch (#1508)
* feat(backend): removed legacy InputEvent builder from heuristics service

* feat(backend): removed InputEvent handler from DB service

* feat(backend): removed InputEvent from ClickHouse connector

* feat(backend): added extra env variable for brotli compression algorithm
2023-10-09 13:54:53 +02:00
Kraiem Taha Yassine
662e5299c1
Api v1.15.0 (#1506)
* feat(chalice): upgraded dependencies

* feat(chalice): changed path analysis schema

* feat(DB): click coordinate support

* feat(chalice): changed path analysis issues schema
feat(chalice): upgraded dependencies

* fix(chalice): fixed pydantic issue

* refactor(chalice): refresh token validator

* feat(chalice): role restrictions

* feat(chalice): EE path analysis changes

* refactor(DB): changed creation queries
refactor(DB): changed delte queries
feat(DB): support new path analysis payload

* feat(chalice): save path analysis card

* feat(chalice): restrict access

* feat(chalice): restrict access

* feat(chalice): EE save new path analysis card

* refactor(chalice): path analysis

* feat(chalice): path analysis new query

* fix(chalice): configurable CH config

* fix(chalice): assist autocomplete

* refactor(chalice): refactored permissions

* refactor(chalice): changed log level

* refactor(chalice): upgraded dependencies

* refactor(chalice): changed path analysis query

* refactor(chalice): changed path analysis query

* refactor(chalice): upgraded dependencies
refactor(alerts): upgraded dependencies
refactor(crons): upgraded dependencies

* feat(chalice): path analysis ignore start point

* feat(chalice): path analysis in progress
2023-10-09 12:52:44 +02:00
Kraiem Taha Yassine
5ebe5719ac
Api v1.15.0 (#1505)
* feat(chalice): upgraded dependencies

* feat(chalice): changed path analysis schema

* feat(DB): click coordinate support

* feat(chalice): changed path analysis issues schema
feat(chalice): upgraded dependencies

* fix(chalice): fixed pydantic issue

* refactor(chalice): refresh token validator

* feat(chalice): role restrictions

* feat(chalice): EE path analysis changes

* refactor(DB): changed creation queries
refactor(DB): changed delte queries
feat(DB): support new path analysis payload

* feat(chalice): save path analysis card

* feat(chalice): restrict access

* feat(chalice): restrict access

* feat(chalice): EE save new path analysis card
2023-10-09 12:43:28 +02:00
Shekar Siri
dcfbb7de18 feat(api): top-members data 2023-10-09 12:24:55 +02:00
Shekar Siri
7d8b25e6f8 feat(api): top-members data 2023-10-09 11:50:59 +02:00
Shekar Siri
d0d3e87642 fix(api): page params 2023-10-09 11:43:33 +02:00
Shekar Siri
7f9d91a8d1 fix(api): sort order 2023-10-09 11:39:50 +02:00
Shekar Siri
9ed6a5151e fix(ui): pref audit check for ee 2023-10-09 10:55:49 +02:00
Shekar Siri
860cb93b3d
feat(api): assist stats (#1504)
* feat(api): assist stats - api - swagger

* feat(api): assist stats - api - swagger

* feat(api): assist stats - api - swagger

* feat(api): assist stats - sort options and date updates

* feat(api): assist stats - sort options and date updates

* feat(api): api assist stats

* feat(api): api assist stats - schema validation and sort options

* feat(api): assist stats - top members updated

* feat(api): assist stats - top members updated and avg

* feat(api): assist stats - averages

* feat(api): assist stats - averages

* feat(api): assist stats - unique team members

* feat(api): assist stats - aggregate assist stats periodically

* feat(api): assist stats - sql
2023-10-09 10:55:02 +02:00
Shekar Siri
54286f906d feat(ui): side menu collpase and theme updates 2023-10-09 09:38:20 +02:00
Rajesh Rajendran
5bb0e8bc82 Changes for clickhouse compression (#1500)
* feat(helm): Update clickhouse image

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* chore(helm): disabling ch_compression for chalice

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-04 19:51:45 +02:00
nick-delirium
8bc28c4796 fix(ui): fixing messages for remote control 2023-10-04 16:49:00 +02:00
nick-delirium
0477ba615c fix(ui): fixing messages for remote control 2023-10-04 16:34:52 +02:00
rjshrjndrn
aa40945597 feat(helm): enable minio init, only if enabled or forceInit
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-04 15:53:50 +02:00
nick-delirium
5b9d63cb55 fix(tracker): some fixes for assist 2023-10-04 10:39:11 +02:00
Shekar Siri
8216f0108f feat(api): service assist stats - agentid integer 2023-10-03 19:11:20 +02:00
Shekar Siri
e65950fe97 feat(api): service assist stats - health check 2023-10-03 17:16:22 +02:00
rjshrjndrn
83e6276770 refactor(docker): cleanup non used stuff
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-03 16:37:21 +02:00
rjshrjndrn
e02a9407fe fix(assist-stats): docker build
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-03 16:34:20 +02:00
Rajesh Rajendran
989612ea70
fix(build): assist-stats (#1490)
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-03 16:24:33 +02:00
Shekar Siri
4c237d5188 feat(api): service assist stats - udpated event structure 2023-10-03 13:15:50 +02:00
nick-delirium
a9c2aa4c92 fix(ui): fix cypress general test 2023-10-03 11:49:53 +02:00
nick-delirium
a2322e6eb5 feat(ui): remove assist tabs for header 2023-10-03 10:40:10 +02:00
Shekar Siri
4dd6914120 feat(api): service assist stats - added project id 2023-10-03 10:29:15 +02:00
nick-delirium
21e3170b72 feat(ui): remove assist tabs for header 2023-10-03 09:53:49 +02:00
rjshrjndrn
6289fa8503 fix(action): fix deletion path
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-02 18:07:49 +02:00
Shekar Siri
d6ed6c4347 feat(api): assist stats - dependencie 2023-10-02 16:48:36 +02:00
rjshrjndrn
950bb381ee fix(actions): kube apply
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-02 16:46:29 +02:00
nick-delirium
2eb3a39491 fix(tracker): some fixes for call event 2023-10-02 15:58:36 +02:00
rjshrjndrn
2d73439523 fix(build): image name
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-02 15:40:51 +02:00
Shekar Siri
8cd6b6216e
feat(api): assist stats (#1488)
* feat(api): assist stats

* refactor(helm): Updating helm code

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* fix(actions): build

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* feat(actions): deploy image to ee also

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-10-02 15:20:49 +02:00
nick-delirium
80b7a5a006 fix(ui): fix call stop ev 2023-10-02 15:01:28 +02:00
nick-delirium
b46e929ad5 fix(ui): fix control stop ev 2023-10-02 14:46:07 +02:00
nick-delirium
c5f115affa fix(ui): fix control stop ev 2023-10-02 14:32:27 +02:00
nick-delirium
3ca7737b71 fix(ui): fix remote control event 2023-10-02 14:21:45 +02:00
nick-delirium
85cc45889b fix(ui): fix remote control event 2023-10-02 14:01:23 +02:00
nick-delirium
cf20ac2b04 fix(ui): cy version 2023-10-02 12:09:13 +02:00
nick-delirium
184dea26b4 feat(player): add agent id to assist con query 2023-10-02 11:51:05 +02:00
nick-delirium
44b4db1b38 feat(player): add agent id to assist con query 2023-10-02 11:17:46 +02:00
nick-delirium
aecfe00c33 feat(player): add agent id to assist con query 2023-10-02 11:15:51 +02:00
Kraiem Taha Yassine
0f2945fd3f
Api v1.15.0 (#1483)
* feat(chalice): upgraded dependencies

* feat(chalice): changed path analysis schema

* feat(DB): click coordinate support

* feat(chalice): changed path analysis issues schema
feat(chalice): upgraded dependencies

* fix(chalice): fixed pydantic issue

* refactor(chalice): refresh token validator

* feat(chalice): role restrictions

* feat(chalice): EE path analysis changes

* refactor(DB): changed creation queries
refactor(DB): changed delte queries
feat(DB): support new path analysis payload

* feat(chalice): save path analysis card

* feat(chalice): restrict access

* feat(chalice): restrict access

* feat(chalice): EE save new path analysis card
2023-09-29 11:14:11 +01:00
Kraiem Taha Yassine
33f5d078dd
Api v1.15.0 (#1481)
* feat(chalice): upgraded dependencies

* feat(chalice): changed path analysis schema

* feat(DB): click coordinate support

* feat(chalice): changed path analysis issues schema
feat(chalice): upgraded dependencies

* fix(chalice): fixed pydantic issue

* refactor(chalice): refresh token validator

* feat(chalice): role restrictions
2023-09-28 09:59:31 +01:00
Kraiem Taha Yassine
1e198c9731
Api v1.15.0 (#1480)
* refactor(chalice): upgraded dependencies
refactor(crons): upgraded dependencies
refactor(alerts): upgraded dependencies

* fix(chalice): return error when updating inexistant webhook

* feat(chalice): fixed delete webhook response

* feat(chalice): limit webhooks name length

* feat(chalice): upgraded dependencies
feat(alerts): upgraded dependencies
feat(crons): upgraded dependencies

* fix(chalice): remove urllib3 dependency

* feat(chalice): remove FOSS to pydantic v2

* fix(chalice): freeze urllib3 to not have conflicts between boto3 and requests

* feat(chalice): refactoring schema in progress

* feat(chalice): refactoring schema in progress

* feat(chalice): refactoring schema in progress

* feat(chalice): refactoring schema in progress
feat(chalice): upgraded dependencies

* feat(chalice): refactored schema

* feat(DB): transfer size support

* feat(chalice): support service account

* feat(chalice): support service account

* fix(chalice): fixed refactored PayloadSchema-name

* feat(chalice): path analysis

* feat(chalice): support service account 1/2

* feat(DB): timezone support

* feat(chalice): upgraded dependencies
feat(alerts): upgraded dependencies
feat(crons): upgraded dependencies
feat(assist): upgraded dependencies
feat(sourcemaps): upgraded dependencies

* feat(chalice): path analysis schema changes

* feat(chalice): path analysis query change

* feat(chalice): path analysis query change

* feat(chalice): ios replay support

* feat(chalice): ios replay support

* feat(chalice): path analysis changes

* feat(DB): ios events

* feat(chalice): upgraded dependencies

* feat(chalice): simple hide minor paths

* feat(chalice): path analysis density

* feat(chalice): session's replay ios events

* feat(chalice): fixed typo

* feat(chalice): support project's platform

* feat(DB): support project's platform

* feat(chalice): path analysis EE in progress

* feat(chalice): project's platform API

* feat(chalice): fixed create project

* feat(chalice): EE path analysis in progress

* feat(chalice): EE path analysis
refactor(chalice): support specific database name for clickhouse-client

* feat(chalice): upgraded dependencies
feat(chalice): path analysis specific event type for startPoint
feat(chalice): path analysis specific event type for endPoint
feat(chalice): path analysis specific event type for exclude

* refactoring(chalice): changed IOS click event type

* refactoring(chalice): upgraded dependencies
refactoring(alerts): upgraded dependencies
refactoring(crons): upgraded dependencies
refactoring(peers): upgraded dependencies
refactoring(assist): upgraded dependencies
refactoring(sourcemaps-reader): upgraded dependencies

* refactoring(chalice): upgraded dependencies
refactoring(alerts): upgraded dependencies
refactoring(crons): upgraded dependencies
refactoring(peers): upgraded dependencies
refactoring(assist): upgraded dependencies
refactoring(sourcemaps-reader): upgraded dependencies

* feat(chalice): upgraded dependencies
feat(alerts): upgraded dependencies
feat(crons): upgraded dependencies

* refactoring(chalice): refactored cards
refactoring(chalice): upgraded dependencies

* feat(chalice): get path-analysis issues list

* feat(chalice): changed crash_ios
feat(DB): changed crash_ios

* fix(chalice): fix crashlooping

* feat(chalice): support tap-rage
feat(DB): support tap-rage

* feat(chalice): Exp search support click-selector
feat(DB): CH support click-selector

* feat(chalice): refresh token
feat(DB): refresh token

* feat(chalice): refresh token changes

* feat(chalice): fixed authorizer context attribute changes

* feat(chalice): fixed refresh token path&age

* feat(chalice): fixed refresh token RTR

* feat(chalice): EE refresh token
feat(DB): EE refresh token

* feat(chalice): migrated EE refresh token

* feat(chalice): fixed crashing changes

* feat(chalice): fixed instant expiration

* feat(chalice): fix

* feat(chalice): fix

* feat(chalice): fix

* feat(chalice): refresh token debug

* feat(chalice): refresh token debug

* feat(chalice): refresh token debug

* feat(chalice): fix refresh token path

* feat(chalice): refresh token on signup

* feat(DB): refresh token

* fix(ui): support source and sourceOperator in condition.filters

---------

Co-authored-by: Shekar Siri <sshekarsiri@gmail.com>
2023-09-26 11:03:44 +01:00
Kraiem Taha Yassine
f9c3204ca1
Api v1.15.0 (#1478)
* refactor(chalice): upgraded dependencies
refactor(crons): upgraded dependencies
refactor(alerts): upgraded dependencies

* fix(chalice): return error when updating inexistant webhook

* feat(chalice): fixed delete webhook response

* feat(chalice): limit webhooks name length

* feat(chalice): upgraded dependencies
feat(alerts): upgraded dependencies
feat(crons): upgraded dependencies

* fix(chalice): remove urllib3 dependency

* feat(chalice): remove FOSS to pydantic v2

* fix(chalice): freeze urllib3 to not have conflicts between boto3 and requests

* feat(chalice): refactoring schema in progress

* feat(chalice): refactoring schema in progress

* feat(chalice): refactoring schema in progress

* feat(chalice): refactoring schema in progress
feat(chalice): upgraded dependencies

* feat(chalice): refactored schema

* feat(DB): transfer size support

* feat(chalice): support service account

* feat(chalice): support service account

* fix(chalice): fixed refactored PayloadSchema-name

* feat(chalice): path analysis

* feat(chalice): support service account 1/2

* feat(DB): timezone support

* feat(chalice): upgraded dependencies
feat(alerts): upgraded dependencies
feat(crons): upgraded dependencies
feat(assist): upgraded dependencies
feat(sourcemaps): upgraded dependencies

* feat(chalice): path analysis schema changes

* feat(chalice): path analysis query change

* feat(chalice): path analysis query change

* feat(chalice): ios replay support

* feat(chalice): ios replay support

* feat(chalice): path analysis changes

* feat(DB): ios events

* feat(chalice): upgraded dependencies

* feat(chalice): simple hide minor paths

* feat(chalice): path analysis density

* feat(chalice): session's replay ios events

* feat(chalice): fixed typo

* feat(chalice): support project's platform

* feat(DB): support project's platform

* feat(chalice): path analysis EE in progress

* feat(chalice): project's platform API

* feat(chalice): fixed create project

* feat(chalice): EE path analysis in progress

* feat(chalice): EE path analysis
refactor(chalice): support specific database name for clickhouse-client

* feat(chalice): upgraded dependencies
feat(chalice): path analysis specific event type for startPoint
feat(chalice): path analysis specific event type for endPoint
feat(chalice): path analysis specific event type for exclude

* refactoring(chalice): changed IOS click event type

* refactoring(chalice): upgraded dependencies
refactoring(alerts): upgraded dependencies
refactoring(crons): upgraded dependencies
refactoring(peers): upgraded dependencies
refactoring(assist): upgraded dependencies
refactoring(sourcemaps-reader): upgraded dependencies

* refactoring(chalice): upgraded dependencies
refactoring(alerts): upgraded dependencies
refactoring(crons): upgraded dependencies
refactoring(peers): upgraded dependencies
refactoring(assist): upgraded dependencies
refactoring(sourcemaps-reader): upgraded dependencies

* feat(chalice): upgraded dependencies
feat(alerts): upgraded dependencies
feat(crons): upgraded dependencies

* refactoring(chalice): refactored cards
refactoring(chalice): upgraded dependencies

* feat(chalice): get path-analysis issues list

* feat(chalice): changed crash_ios
feat(DB): changed crash_ios

* fix(chalice): fix crashlooping

* feat(chalice): support tap-rage
feat(DB): support tap-rage

* feat(chalice): Exp search support click-selector
feat(DB): CH support click-selector

* feat(chalice): refresh token
feat(DB): refresh token

* feat(chalice): refresh token changes

* feat(chalice): fixed authorizer context attribute changes

* feat(chalice): fixed refresh token path&age

* feat(chalice): fixed refresh token RTR

* feat(chalice): EE refresh token
feat(DB): EE refresh token

* feat(chalice): migrated EE refresh token

* feat(chalice): fixed crashing changes

* feat(chalice): fixed instant expiration

* feat(chalice): fix

* feat(chalice): fix

* feat(chalice): fix

* feat(chalice): refresh token debug

* feat(chalice): refresh token debug

* feat(chalice): refresh token debug

* feat(chalice): fix refresh token path

* feat(chalice): refresh token on signup

* feat(DB): refresh token
2023-09-25 18:29:27 +01:00
nick-delirium
7422a4919f fix(tracker): fix for {disableStringDict: true} 2023-09-25 16:08:54 +02:00
Shekar Siri
eae4513168 fix(ui): support source and sourceOperator in condition.filters 2023-09-25 16:08:11 +02:00
Shekar Siri
cb38718b5d fix(ui): check for token before request 2023-09-22 17:29:36 +02:00
nick-delirium
84ea141347 fix(ui): safe guard for html tag names in replayer 2023-09-22 14:58:09 +02:00
Taha Yassine Kraiem
6802b216b7 Revert "feat(chalice): refresh token"
This reverts commit 12a0af0862.
2023-09-21 15:52:04 +01:00