Commit graph

11 commits

Author SHA1 Message Date
MauricioGarciaS
9915e0b3c8
chore(recommendations): mlflow update, pydantic update and others (#1450) 2023-08-22 09:23:08 -04:00
MauricioGarciaS
cea5eda985
feat(recommendations): Added services recommendation (ml_service) and trainer (ml_trainer) (#1275)
* Created two services: recommendation training and recommendation serving

* Deleted Docker temporary

* Added features based in signals information

* Added method to get sessions features using PG

* Added same utils and core elements into ml_trainer

* Added checks before training models, added handler for model serving

* Updated serving API and recommendation functions to use frontend signals features

* reorganized modules to have base image and for both serving and training

* Added Dockerfiles and base Dockerfile

* Solved issue while ordering sessions by relevance

* Added method to save user feedback of recommendations

* Added security authorization

* Updated Dockerfile

* fixed issues with secret insertion to API

* Updated feedback structure

* Added git for dags

* Solved issue of insertion on recommendation feedback

* Changed update method from def to async def and it is called during startup

* Solved issues of airflow running mlflow in dag

* Changes sanity checks and added middleware params

* base path renaming

* Changed update method to a interval method which loads one model each 10s if there are models to download

* Added sql files for recommendation service and trainer

* Cleaned files and added documentation for methods and classes

* Added README file

* Renamed endpoints, changed None into empty array and updated readme

* refactor(recommendation): optimized query

* style(recommendation): changed import to top file, renamed endpoints parameters, function optimization

* refactor(recommendation): .gitignore

* refactor(recommendation): .gitignore

* refactor(recommendation): Optimized Dockerfiles

* refactor(recommendation): changed imports

* refactor(recommendation): optimized requests

* refactor(recommendation): optimized requests

* Fixed boot for fastapi, updated some queries

* Fixed issues while downloading models and while returning json response from API

* limited number of recommendations and set a minimum score to present recommendations

* fix(recommendation): fixed some queries and updated prediction method

* Added env value to control number of predictions to make

* docs(recommendation): Added third party libraries used in recommendation service

* frozen requirements

* Update base_crons.py

added `misfire_grace_time` to recommendation crons

---------

Co-authored-by: Taha Yassine Kraiem <tahayk2@gmail.com>
2023-06-07 15:58:33 +02:00
MauricioGarciaS
fd7a4b80f1 Added function to select specific details from filters 2022-12-13 16:21:39 +01:00
MauricioGarciaS
574af2588d Airflow setup and workflow templates for training in script folder 2022-12-12 14:35:41 +01:00
MauricioGarciaS
77536c3153 clened recommendation files 2022-11-29 11:17:59 +01:00
MauricioGarciaS
dcc8ef5fb0 Added airflow worker, scheduler, trigger, webserver 2022-11-29 10:38:54 +01:00
MauricioGarciaS
2e9ff89976 Added queue method to Signals 2022-11-25 11:48:58 +01:00
MauricioGarciaS
1cadd08774 Changed scheduler method 2022-11-22 18:04:45 +01:00
MauricioGarciaS
9144606b08 Adding method to handle frontend responses in batches 2022-11-21 16:20:33 +01:00
MauricioGarciaS
b5bfc32f38 Testing queue method 2022-11-18 11:26:51 +01:00
MauricioGarciaS
d085b3583d API for signals in chalice ee, added folder for recommendation service 2022-11-17 16:34:45 +01:00