Commit graph

1252 commits

Author SHA1 Message Date
nick-delirium
464d4dfcd4 feat(backend/tracker): extract tabdata into separate message from batchmeta 2023-06-05 13:08:18 +02:00
Alexander Zavorotynskiy
f1a2874906 feat(backend): added support of multitabs 2023-06-05 13:08:18 +02:00
nick-delirium
54e95e252d feat(tracker): add support for multi tab sessions 2023-06-05 13:08:18 +02:00
Kraiem Taha Yassine
8286a57a73 Patch/api v1.12.0 (#1302)
* fix(chalice): changed base image to support SSO/xmlsec
* fix(chalice): fixed exp search null metadata

(cherry picked from commit 31e7d30d96)
2023-06-01 16:18:59 +02:00
Kraiem Taha Yassine
11a15f2e3a Patch/api v1.12.0 (#1301)
* fix(chalice): changed base image to support SSO/xmlsec

* fix(chalice): fixed exp search null metadata

(cherry picked from commit ab000751d2)
2023-06-01 15:52:08 +02:00
Kraiem Taha Yassine
a358bc5112 Patch/api v1.12.0 (#1299)
* fix(chalice): include metadata in sessions exp search

* fix(chalice): fixed sessions exp search wrong col name

* fix(chalice): removed cookies

* fix(chalice): changed base image to support SSO/xmlsec

* fix(chalice): changed Dockerfile to support SSO/xmlsec

* fix(chalice): changed Dockerfile to support SSO/xmlsec

(cherry picked from commit 4b8cf9742c)
2023-05-31 18:02:38 +02:00
Kraiem Taha Yassine
31aa051787 Patch/api v1.12.0 (#1298)
* fix(chalice): include metadata in sessions exp search

* fix(chalice): fixed sessions exp search wrong col name

* fix(chalice): removed cookies

* fix(chalice): changed base image to support SSO/xmlsec

* fix(chalice): changed Dockerfile to support SSO/xmlsec

(cherry picked from commit 8f98aaaca1)
2023-05-31 17:17:27 +02:00
Taha Yassine Kraiem
0ce417de88 fix(chalice): changed base image to support SSO/xmlsec 2023-05-31 16:28:52 +02:00
Taha Yassine Kraiem
2a623b351b fix(chalice): removed cookies 2023-05-31 16:28:52 +02:00
Taha Yassine Kraiem
65b7eb03d6 fix(chalice): fixed sessions exp search wrong col name 2023-05-31 16:28:52 +02:00
MauricioGarciaS
164232377d
fix(connector): Fixed small issues and added checkpoint method (#1251)
* fix(connector): fixed bug of cache dict size error

* fix(connector): Added method to save state in s3 for redshift if sigterm arise

* fix(connector): Added exit signal handler and checkpoint method

* Added sslmode selection for connection to database, added use_ssl parameter for S3 connection

* fix(connector): Handle error when broken session_id
2023-05-31 11:42:49 +02:00
Kraiem Taha Yassine
ae0f36aba8 fix(chalice): include metadata in sessions exp search (#1291)
(cherry picked from commit 07dd9da820)
2023-05-30 16:09:38 +02:00
Kraiem Taha Yassine
7873bc3ff9 fix(assist): use production environment (#1285)
fix(peers): use production environment
fix(sourcemaps-reader): use production environment
2023-05-26 12:10:29 +02:00
Shekar Siri
8d132edb58
feat(chalice) - feature flags (#1252)
* feat(api) - feature flags - schema

* feat(api) - feature flags - wip

* feat(api) - feature flags

* feat(api) - feature flags - set back root path

* feat(api) - feature flags

* feat(api) - feature flags

* feat(api) - feature flags - review

* feat(DB): feature flags DB structure

* feat(chalice): feature flags permissions support
feat(chalice): feature flags changed code

* feat(chalice): feature flags add permissions to DB

---------

Co-authored-by: Taha Yassine Kraiem <tahayk2@gmail.com>
2023-05-17 15:48:34 +02:00
Taha Yassine Kraiem
55040b2c76 feat(chalice): fixed trace payload parsing 2023-05-11 13:22:25 +02:00
rjshrjndrn
8878df5c1c chore(cron): Adding missing deps
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-09 16:21:08 +02:00
MauricioGarciaS
1a414d5764
fix(connector): Added checkpoints and sigterm handler (#1234)
* fix(connector): fixed bug of cache dict size error

* fix(connector): Added method to save state in s3 for redshift if sigterm arise

* fix(connector): Added exit signal handler and checkpoint method

* Added sslmode selection for connection to database, added use_ssl parameter for S3 connection
2023-05-09 11:35:50 +02:00
Kraiem Taha Yassine
6291749bb7
feat(crons): include fastapi (#1231) 2023-05-04 16:01:21 +02:00
MauricioGarciaS
41c0f19c62
fix(connector): fixed bug of cache dict size error (#1226) 2023-05-04 13:49:10 +02:00
Kraiem Taha Yassine
d0d47f4e6a
Api v1.12.0 (#1230)
* feat(chalice): include enforceSSO in signup status

* feat(chalice): changed 1-time health-check
2023-05-04 11:49:37 +02:00
Kraiem Taha Yassine
66c4f9c481
feat(chalice): include enforceSSO in signup status (#1228) 2023-05-03 19:45:10 +02:00
Kraiem Taha Yassine
4a347139ba
feat(chalice): reduce issues for replay (#1227) 2023-05-03 15:52:02 +02:00
MauricioGarciaS
298288301a
fix(connector): handle db connection drop (#1223)
* Added compatibility with SaaS, added reboot of connection if connection droped

* Small fix
2023-05-02 16:31:20 +02:00
Taha Yassine Kraiem
1bdfc2ecfc Merge remote-tracking branch 'origin/api-v1.12.0' into dev
# Conflicts:
#	api/chalicelib/core/health.py
#	api/chalicelib/core/jobs.py
#	api/chalicelib/core/sessions_devtool.py
#	api/chalicelib/core/sessions_mobs.py
#	api/chalicelib/utils/s3.py
#	api/routers/crons/core_dynamic_crons.py
#	ee/api/chalicelib/core/assist_records.py
#	ee/api/chalicelib/core/health.py
#	ee/api/chalicelib/core/sessions_devtool.py
#	ee/api/chalicelib/core/traces.py
#	ee/api/requirements-crons.txt
#	ee/api/routers/crons/core_dynamic_crons.py
#	ee/api/schemas_ee.py
2023-05-02 15:37:20 +02:00
MauricioGarciaS
28182b951e
Redshift connector (#1170)
* Updated dependancies for redshift connector, changed os module for python-decouple module

* Updated service and images

* Updated message protocol, added exception for BatchMetadata when version is 0 (we apply old read method)

* fixed load error from s3 to redshift. null values for string columns are now empty strings ("")

* Added file test consumer_async.py: reads every 3 minutes kafka raw and send task in background to upload to cloud

* Added method to skip messages that are not inserted to cloud

* Added logs into consumer_async. Changed urls and issues in sessions table from list to string

* Split between messages for sessions table and for events table

* Updated redshift tables

* Fixed small issue in query redshift_sessions.sql

* Updated Dockerfiles. Cleaned logs of consumer_async. Updated/Fixed tables. Transformed Nan as NULL for VARCHAR columns

* Added error handler for sql dropped connection

* chore(docker): Optimize docker builds

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* Variables renamed

* Adding compression libraries

* Set default value of count events to 0 (instead of NULL) when event did not occur

* Added support specific  project tracking. Added PG handler to connect to sessions table

* Added method to update values in db connection for sessions ended and restarted

* Removing intelligent file copying

* chore(connector): Build file

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>

* Adding connection pool for pg

* Renaming and optimizing

* Fixed issue of missing information of sessions

---------

Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-02 14:02:57 +02:00
Taha Yassine Kraiem
961ea99048 feat(chalice): refactored records list 2023-05-02 11:18:43 +02:00
Taha Yassine Kraiem
2751334876 feat(chalice): return all records if date is not specified 2023-05-02 11:18:43 +02:00
Taha Yassine Kraiem
668b9cb383 chore(build): testing EE cron-Jobs 2023-05-02 10:55:57 +02:00
Taha Yassine Kraiem
24c822c64e feat(chalice): changed corn-Job execution time 2023-05-02 10:55:57 +02:00
Taha Yassine Kraiem
5f1b97a3d8 feat(chalice): refactored Jobs
feat(chalice): added limits on Jobs
2023-05-02 10:55:57 +02:00
Taha Yassine Kraiem
fb7902c424 feat(chalice): configurable mobs expiration 2023-05-02 10:55:57 +02:00
Taha Yassine Kraiem
59905075c6 feat(chalice): fixing jobs execution 2023-05-02 10:55:57 +02:00
Taha Yassine Kraiem
9d6daf09a2 feat(chalice): fixed jobs execution 2023-05-02 10:55:57 +02:00
Rajesh Rajendran
eef776a13d fix(ee): chalice health check (#1142)
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-05-02 10:55:57 +02:00
Taha Yassine Kraiem
193030657a feat(chalice): skip mob existence verification 2023-05-02 10:54:24 +02:00
Taha Yassine Kraiem
6e2545692d feat(assist): updated dependencies
feat(sourcemaps-reader): upgraded dependencies
2023-04-28 16:44:57 +02:00
Taha Yassine Kraiem
bb114c6549 feat(chalice): fixed recordings response recursion error 2023-04-28 16:28:56 +02:00
Taha Yassine Kraiem
eb9fc2c4cb feat(chalice): changed recordings response
feat(chalice): updated dependencies
feat(crons): updated dependencies
feat(alerts): updated dependencies
2023-04-28 15:41:34 +02:00
Taha Yassine Kraiem
3dfa487ac5 feat(crons): fixed health check cron
feat(crons): refactored main
2023-04-28 14:34:12 +02:00
Taha Yassine Kraiem
753d1cac11 feat(chalice): changed recordings response 2023-04-28 12:00:01 +02:00
Taha Yassine Kraiem
93737f4ebb feat(chalice): format code 2023-04-27 18:20:50 +02:00
Kraiem Taha Yassine
5988607d36
Merge pull request #1072 from dgrah50/chalice-allow-windows-integrated-authentication-for-saml
(feat): Chalice - Allow Windows Integrated Authentication for SAML
2023-04-27 18:07:47 +02:00
Taha Yassine Kraiem
9bddd7def9 feat(crons): changed health-check response 2023-04-27 17:52:30 +02:00
Taha Yassine Kraiem
99dcc7cf78 feat(chalice): changed health-check response 2023-04-27 17:44:52 +02:00
Taha Yassine Kraiem
0ca7994672 feat(chalice): fixed typo 2023-04-27 17:36:16 +02:00
Taha Yassine Kraiem
ef2f6a90b9 feat(crons): reorganized crons 2023-04-27 17:30:37 +02:00
Taha Yassine Kraiem
2b4e5a5121 feat(chalice): changed projects stats for health-check
feat(crons): cahnged projects stats for health-check
chore(helm): projectStats cron every 18 min
chore(helm): projectStats-fix cron every Sunday at 5am
2023-04-27 17:03:44 +02:00
Taha Yassine Kraiem
be4161887b feat(chalice): projects stats for health-check
feat(DB): projects stats for health-check
feat(crons): projects stats for health-check
2023-04-27 15:43:56 +02:00
Taha Yassine Kraiem
489c9c12a1 feat(chalice): use experimental session search for metrics 2023-04-26 18:53:07 +02:00
Taha Yassine Kraiem
171373b73e feat(chalice): refactored projects code
feat(chalice): sessions-check-flag every hour
feat(chalice): sessions-check-delta set to 4 hours
2023-04-26 17:47:00 +02:00