Commit graph

13 commits

Author SHA1 Message Date
MauricioGarciaS
7ffcf79bf6
chore(recommendations): python modules updated and added airflow dag to save sessions features (#1979)
* fix(trainer): Updated requirements

* fix(recommendations): Downgraded pydantic to 1.10.12 and mlflow to 2.5

* Updated dag for updating database with feedbacks, changed feedback file from ml_service/core into common core

* fix(recommendations): fixed database update and added more features into DB

* Updated modules in recommendations trainer and server

* chore(recommendations): Updated python modules for trainer. Added script to save features from feedback sessions into ml database.

* updated requirements

* updated requirements
2024-04-24 15:10:18 +02:00
Kraiem Taha Yassine
612e41583e Api v1.15.0 (#1670)
* fix(chalice): fixed assist auto-complete
* fix(chalice): fixed exp-sessions without timezone

(cherry picked from commit e46df53ddc)
2023-11-20 16:15:12 +01:00
MauricioGarciaS
9915e0b3c8
chore(recommendations): mlflow update, pydantic update and others (#1450) 2023-08-22 09:23:08 -04:00
MauricioGarciaS
cea5eda985
feat(recommendations): Added services recommendation (ml_service) and trainer (ml_trainer) (#1275)
* Created two services: recommendation training and recommendation serving

* Deleted Docker temporary

* Added features based in signals information

* Added method to get sessions features using PG

* Added same utils and core elements into ml_trainer

* Added checks before training models, added handler for model serving

* Updated serving API and recommendation functions to use frontend signals features

* reorganized modules to have base image and for both serving and training

* Added Dockerfiles and base Dockerfile

* Solved issue while ordering sessions by relevance

* Added method to save user feedback of recommendations

* Added security authorization

* Updated Dockerfile

* fixed issues with secret insertion to API

* Updated feedback structure

* Added git for dags

* Solved issue of insertion on recommendation feedback

* Changed update method from def to async def and it is called during startup

* Solved issues of airflow running mlflow in dag

* Changes sanity checks and added middleware params

* base path renaming

* Changed update method to a interval method which loads one model each 10s if there are models to download

* Added sql files for recommendation service and trainer

* Cleaned files and added documentation for methods and classes

* Added README file

* Renamed endpoints, changed None into empty array and updated readme

* refactor(recommendation): optimized query

* style(recommendation): changed import to top file, renamed endpoints parameters, function optimization

* refactor(recommendation): .gitignore

* refactor(recommendation): .gitignore

* refactor(recommendation): Optimized Dockerfiles

* refactor(recommendation): changed imports

* refactor(recommendation): optimized requests

* refactor(recommendation): optimized requests

* Fixed boot for fastapi, updated some queries

* Fixed issues while downloading models and while returning json response from API

* limited number of recommendations and set a minimum score to present recommendations

* fix(recommendation): fixed some queries and updated prediction method

* Added env value to control number of predictions to make

* docs(recommendation): Added third party libraries used in recommendation service

* frozen requirements

* Update base_crons.py

added `misfire_grace_time` to recommendation crons

---------

Co-authored-by: Taha Yassine Kraiem <tahayk2@gmail.com>
2023-06-07 15:58:33 +02:00
MauricioGarciaS
fd7a4b80f1 Added function to select specific details from filters 2022-12-13 16:21:39 +01:00
MauricioGarciaS
574af2588d Airflow setup and workflow templates for training in script folder 2022-12-12 14:35:41 +01:00
MauricioGarciaS
77536c3153 clened recommendation files 2022-11-29 11:17:59 +01:00
MauricioGarciaS
dcc8ef5fb0 Added airflow worker, scheduler, trigger, webserver 2022-11-29 10:38:54 +01:00
MauricioGarciaS
2e9ff89976 Added queue method to Signals 2022-11-25 11:48:58 +01:00
MauricioGarciaS
1cadd08774 Changed scheduler method 2022-11-22 18:04:45 +01:00
MauricioGarciaS
9144606b08 Adding method to handle frontend responses in batches 2022-11-21 16:20:33 +01:00
MauricioGarciaS
b5bfc32f38 Testing queue method 2022-11-18 11:26:51 +01:00
MauricioGarciaS
d085b3583d API for signals in chalice ee, added folder for recommendation service 2022-11-17 16:34:45 +01:00