Commit graph

1308 commits

Author SHA1 Message Date
MauricioGarciaS
440ebca03b
fix(connectors): small fix of varchar size (#1403) 2023-07-11 15:07:42 +02:00
MauricioGarciaS
ecbc42a03f
fix(connectors): Updated sql to varchar 8000 (#1402)
* fix(connectors): Changed sql from varchar to varchar 8000

* fix(connectors): changed cropping to size 8000 for str in worker task
2023-07-11 13:59:46 +02:00
Kraiem Taha Yassine
b2172cbaaa
Api v1.14.0 (#1401)
* fix(DB): changed version number
2023-07-11 10:55:21 +02:00
Kraiem Taha Yassine
4012f7d054
Api v1.14.0 (#1399)
* fix(chalice): fixed nested data response
2023-07-10 17:47:55 +02:00
Kraiem Taha Yassine
da627bdb9a
Api v1.14.0 (#1398)
* fix(chalice): cast note's session_id to string

* fix(chalice): cast all session_id to string

* fix(chalice): fixed content-length after cast all session_id to string
2023-07-10 17:01:28 +02:00
Shekar Siri
222bccfab8 fix(ui): update status endpoint for ee 2023-07-10 15:35:37 +02:00
MauricioGarciaS
b9b187d684
Redshift pool (#1397)
* fix(connectors): added try method for redshift replace in fill

* fix(connectors): adding userId only if not empty string

* fix(connectors): Added fix as a worker
2023-07-10 14:29:40 +02:00
MauricioGarciaS
efd562321e
fix(connectors): added try method for redshift replace in fill (#1396) 2023-07-10 11:10:42 +02:00
Kraiem Taha Yassine
065c139494
Api v1.14.0 (#1394)
* fix(chalice): cast note's session_id to string

* fix(chalice): cast all session_id to string

* fix(chalice): EE cast all session_id to string
2023-07-07 15:42:55 +02:00
MauricioGarciaS
4cf50b3066
fix(connector): Redshift pool fixes (#1393)
* fix(connector): set env variable for replace and set it to one minute default

* style(connector): different log for redshift and pg

* style(connector): different log for redshift select and replace

* fix(connector): replacing from oldest to newest to avoid blocking

* fix(connector): empty string changed to NN and fixed str issue for cron job

* Changing methods in connector

* fix(connectors): solved issues when replacing with null, reduced number of queries to redshift

* fix(connectors): fixed save method

* fix(connectors): fixed issue while saving event object
2023-07-07 15:33:22 +02:00
Kraiem Taha Yassine
8226e66299
Api v1.14.0 (#1391)
* refactored(chalice): refactored restore user
refactored(chalice): refactored add user

* fix(chalice): allow FastAPI to handel async automatically
fix(chalice): EE support of multiworkers
refactor(chalice): cleaned SSO

* fix(chalice): allow FastAPI to handel async automatically

* feat(DB): associate sessions to feature-flags

* feat(DB): CH associate sessions to feature-flags
2023-07-06 18:13:06 +02:00
Alexander Zavorotynskiy
b0de3fa6c9 fix(backend): fixed import issues related to ee version 2023-07-06 11:37:14 +02:00
Alexander
4b8f3bee25
Sessions refactoring (#1371)
* feat(backend): moved sql requests related to sessions table to one place

* feat(backend): refactoring in db.Saver handler

* feat(backend): hude refactoring in db/postgres module

* fix(backend): workable feature flags

* fix(backend): workable integrations

* fix(backend): workable sessions and projects modules

* fix(backend): added missed projects module to sessions

* feat(backend): renaming

* feat(backend): moved session struct to sessions module and split methods into interface, cache and storage levels

* feat(backend): moved project struct to projects module

* feat(backend): added projects model

* feat(backend): implemented new in memory cache for sessions and projects

* feat(backend): implemented new cache in projects

* feat(backend): there are 2 methods in cache module now: Get() and GetAndRefresh()

* feat(backend): added cache update operations

* fix(backend): fixed import cycle

* fix(backend): fixed panic in db message handler

* fix(backend): fixed panic in projects module

* fix(backend): fixed panic in sessions.GetDuration

* feat(backend): added direct call to get session duration if session is already in cache

* feat(backend): used pg pool everywhere except db service

* fix(backend): added missing part after rebase

* fix(backend): removed old sessions file

* feat(backend): added refactored redis client with produce/consume options

* feat(backend): added cache layer for projects

* fix(backend): added missing redis config

* fix(backend): added missing method for producer

* feat(backend): cache integration for sessions

* feat(backend): temporary method to get session directly from db

* feat(backend): adapt EE version of message handler

* fix(backend): fixed issue in fts realisation

* fix(backend): added redis cache to sessions module

* fix(backend): set 0 duration or hesitation time for inputs without focus event

* feat(backend): added cache for session updates and failover mechanism for batch.Insert() operation

* feat(backend): debug log

* feat(backend): more debug log

* feat(backend): removed debug log

* fix(backend): fixed an issue of tracking input events with empty label

* fix(backend): disabled debug log in projects cache

* fix(backend): renamed session updater

* fix(backend): fixed closed pool issue in DB service

* fix(backend): fixed dead lock in db Stop() method

* fix(backend): fixed panic in heuristics service

* feat(backend): enabled redis cache in projects

* feat(backend): clear cache on each update operation

* feat(backend): fully integrated cache layer with auto switch

* feat(backend): small refactoring in session updates

* fix(backend): fixed wrong events counter issue

* feat(backend): enabled full cache support in ender and http services

* fix(backend/ee): added missed import

* feat(backend): added second cache layer for db to speed up the service

* feat(backend): disable redis cache

* feat(backend): moved redis cache to ee
2023-07-06 10:55:43 +02:00
MauricioGarciaS
3479060d02
style(connectors): different prints for each script (fill, worker) (#1388) 2023-06-30 12:41:36 +02:00
Rajesh Rajendran
53081a9822
Improvements (#1387)
* fix for memory cleansing and added setup files for msgcodec build

* Kafka reader now calling only once to PG to verify sessionIds, updated fill missing user_ids script

* fix(connector): small error while reading from pg

---------

Co-authored-by: MauricioGarciaS <47052044+MauricioGarciaS@users.noreply.github.com>
2023-06-30 12:04:23 +02:00
rjshrjndrn
a5cf104ddc fix(docker): Base image name
Signed-off-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-06-23 16:07:37 +02:00
MauricioGarciaS
9108dd7f04
fix(connectors): Changed to consumer pool (#1368) 2023-06-23 15:33:43 +02:00
MauricioGarciaS
91921d622e
fix(connectors): Created module in Cython to speed up message decoding (#1338)
* Updated pg connector

* fix(player): fix first 8 byte checker

* fix(player): fix commit conflict

* Added pylint

* Removed pylint for incompatible license

* change(ui): check for sessions records state

* Patch/api v1.12.0 (#1299)

* fix(chalice): include metadata in sessions exp search

* fix(chalice): fixed sessions exp search wrong col name

* fix(chalice): removed cookies

* fix(chalice): changed base image to support SSO/xmlsec

* fix(chalice): changed Dockerfile to support SSO/xmlsec

* fix(chalice): changed Dockerfile to support SSO/xmlsec

(cherry picked from commit 4b8cf9742c)

* fix(ui): project fallback to recorded variable

* Patch/api v1.12.0 (#1301)

* fix(chalice): changed base image to support SSO/xmlsec

* fix(chalice): fixed exp search null metadata

(cherry picked from commit ab000751d2)

* change(ui): assist no content message styles and icons

* change(ui): revert menu disable

* fix(connector): Added method to save state in s3 for redshift if sigterm arise

* Rewriting python code in cython

* Added pyx module for messages

* Auto create pyx files

* Updated and fixed msgcodec.pyx

* Added new module to connector code

* Updated kafka lib for base image

* cleaned Docker and updated base image version for pandas

* cleaned prints

* Added code to fetch data from db and add it into redshift

* Updated consumer reading method. Async multithreading over sessionId

* Added split for country (Country,State,City)

* Fixed decoding issue for uint

* Created service able to fix data from redshift by reading from db

* Handle when process ended because of lost connection to pg, country set to country value only
2023-06-23 14:49:39 +02:00
Taha Yassine Kraiem
4b5c9fe08d fix(chalice): fixing restore member 2023-06-23 12:17:59 +01:00
Taha Yassine Kraiem
7f849dfab6 fix(chalice): fixed generate_presigned_url for assist-records 2023-06-22 17:03:53 +01:00
Alexander Zavorotynskiy
00ca3d6184 feat(backend): added user's state and city to CH 2023-06-22 14:26:31 +02:00
Taha Yassine Kraiem
d76c5ce6e2 feat(DB): feature-flags 2023-06-22 12:33:58 +01:00
Kraiem Taha Yassine
b98b30725f refactored(chalice): removed feature-flags (#1357) (#1358)
refactored(DB): removed feature-flags

(cherry picked from commit d6990a841c)
2023-06-22 12:15:46 +01:00
Taha Yassine Kraiem
10adc9d83d refactored(DB): removed feature-flags 2023-06-22 11:59:30 +01:00
Shekar Siri
9daac9480c fix(api): ee support city autocomplete 2023-06-21 16:18:48 +02:00
Shekar Siri
d9ff686c78 fix(api): city and state in ee 2023-06-20 15:29:43 +02:00
Alexander Zavorotynskiy
3b481232ac fix(assist): added checks for undefined variables 2023-06-20 09:18:22 +02:00
Alexander Zavorotynskiy
ca80f4071f fix(assist): fixed issue with agent back compatibility 2023-06-19 16:18:33 +02:00
Alexander Zavorotynskiy
5256615edc fix(assist): fixed issue with sessionUpdate event 2023-06-19 12:32:48 +02:00
Taha Yassine Kraiem
085514b73a refactor(chalice): upgraded dependencies 2023-06-16 15:04:04 +02:00
Kraiem Taha Yassine
84a731c8aa
Api v1.13.0 release (#1347)
* refactor(chalice): configurable documentation
2023-06-16 12:44:40 +02:00
Kraiem Taha Yassine
7271eacbdf
Api v1.13.0 release (#1346)
* fix(chalice): support SSO with custom port
2023-06-16 11:26:47 +02:00
Kraiem Taha Yassine
0e2a1d76da
Api v1.13.0 release (#1345)
* fix(chalice): fixed circular  import priority
fix(chalice): enabled SSO

* fix(chalice): fixed disabled routes
2023-06-14 15:03:28 +02:00
Kraiem Taha Yassine
de3976a27d
fix(chalice): check SMTP host:port (#1344)
fix(chalice): validate SMTP configuration
refactor(chalice): include Pipfile for similar dev-env
2023-06-14 13:21:22 +02:00
Kraiem Taha Yassine
1ce2990a70
Api v1.13.0 release (#1343)
* feat(DB): skip delta if wrong_version is detected without stopping global upgrade

* fix(chalice): return city&state in the search sessions response
2023-06-13 17:36:21 +02:00
Kraiem Taha Yassine
9c051c8412
Api v1.13.0 release (#1337)
* refactor(chalice): removed client endpoint
* refactor(chalice): removed unused schemas
2023-06-12 17:44:17 +02:00
Kraiem Taha Yassine
678bc33820
Api v1.13.0 release (#1336)
* fix(connectors): upgraded dependencies

* refactor(chalice): changed update account
2023-06-12 16:38:22 +02:00
Alexander Zavorotynskiy
378a44d9ed fix(assist): added missed method import in ws-cluster 2023-06-12 15:33:51 +02:00
Kraiem Taha Yassine
fdb833709d feat(DB): changed version (#1331) 2023-06-09 18:06:38 +02:00
Kraiem Taha Yassine
ffb6de18c1 feat(DB): removed tab_id column (#1330) 2023-06-09 18:06:38 +02:00
Kraiem Taha Yassine
f5a836e726
Api v1.13.0 (#1327)
* fix(chalice): fixed configurable health-check
2023-06-09 16:24:23 +02:00
Kraiem Taha Yassine
08f08c2b20
Api v1.13.0 (#1326)
* fix(chalice): fixed wrong import
2023-06-09 12:36:33 +02:00
Kraiem Taha Yassine
c7e8e8cdb4
Api v1.13.0 (#1325)
* fix(chalice): fixed wrong import
2023-06-09 12:09:11 +02:00
Kraiem Taha Yassine
b91899d067
Api v1.13.0 (#1324)
* fix(chalice): fixed mandatory AZURE_ACCOUNT_NAME issue

* fix(chalice): fixed mandatory CLOUD issue
2023-06-09 12:01:15 +02:00
Kraiem Taha Yassine
810e24dc71
Api v1.13.0 (#1323)
* style(chalice): enhanced reset-password email

* fix(chalice): fixed mandatory AZURE_ACCOUNT_NAME issue
2023-06-09 11:48:41 +02:00
Kraiem Taha Yassine
953bab9773
Api v1.13.0 (#1322)
* fix(chalice): changed base image
2023-06-09 11:08:37 +02:00
Kraiem Taha Yassine
c29a31e3e4
fix(chalice): fixed ObjectStorage Import (#1321) 2023-06-09 09:59:14 +02:00
Alexander
8e58c367dd
Fixed issue with wrong expiration timeout for projects (#1300)
* fix(backend): fixed issue with wrong expiration timeout for projects in cache layer

* fix(backend): removed direct call db.GetProject()

* feat(backend): set default PROJECT_EXPIRATION to 10 minutes
2023-06-08 18:08:53 +02:00
Kraiem Taha Yassine
0518619392
Api v1.13.0 (#1319)
* fix(chalice): changed base image

* fix(chalice): fixed health check
2023-06-08 17:54:44 +02:00
Kraiem Taha Yassine
903edb2f51
Api v1.13.0 (#1318)
* chore(actions): disable debugging tmate
* feat(chalice): allow health-check skip

---------

Co-authored-by: rjshrjndrn <rjshrjndrn@gmail.com>
2023-06-08 16:12:56 +02:00