Commit graph

14 commits

Author SHA1 Message Date
dependabot[bot]
804e4ba0c2
chore(deps): bump the pip group across 4 directories with 11 updates
Bumps the pip group with 7 updates in the /ee/connectors/deploy directory:

| Package | From | To |
| --- | --- | --- |
| [certifi](https://github.com/certifi/python-certifi) | `2022.09.24` | `2024.7.4` |
| [idna](https://github.com/kjd/idna) | `3.4` | `3.7` |
| [requests](https://github.com/psf/requests) | `2.28.1` | `2.32.2` |
| [urllib3](https://github.com/urllib3/urllib3) | `1.26.12` | `1.26.19` |
| [snowflake-connector-python](https://github.com/snowflakedb/snowflake-connector-python) | `3.0.4` | `3.13.1` |
| [pycryptodomex](https://github.com/Legrandin/pycryptodome) | `3.18.0` | `3.19.1` |
| [redshift-connector](https://github.com/aws/amazon-redshift-python-driver) | `2.0.915` | `2.1.7` |

Bumps the pip group with 3 updates in the /ee/intelligent_search directory: [certifi](https://github.com/certifi/python-certifi), [requests](https://github.com/psf/requests) and [pydantic](https://github.com/pydantic/pydantic).
Bumps the pip group with 1 update in the /ee/quickwit directory: [requests](https://github.com/psf/requests).
Bumps the pip group with 6 updates in the /ee/recommendation directory:

| Package | From | To |
| --- | --- | --- |
| [requests](https://github.com/psf/requests) | `2.31.0` | `2.32.2` |
| [urllib3](https://github.com/urllib3/urllib3) | `2.0.7` | `2.2.2` |
| [pydantic](https://github.com/pydantic/pydantic) | `2.6.3` | `2.11.5` |
| [scikit-learn](https://github.com/scikit-learn/scikit-learn) | `1.4.1.post1` | `1.5.1` |
| [mlflow](https://github.com/mlflow/mlflow) | `2.11.1` | `2.20.3` |
| [python-multipart](https://github.com/Kludex/python-multipart) | `0.0.6` | `0.0.18` |



Updates `certifi` from 2022.09.24 to 2024.7.4
- [Commits](https://github.com/certifi/python-certifi/compare/2022.09.24...2024.07.04)

Updates `idna` from 3.4 to 3.7
- [Release notes](https://github.com/kjd/idna/releases)
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst)
- [Commits](https://github.com/kjd/idna/compare/v3.4...v3.7)

Updates `requests` from 2.28.1 to 2.32.2
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.32.2)

Updates `urllib3` from 1.26.12 to 1.26.19
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.12...1.26.19)

Updates `snowflake-connector-python` from 3.0.4 to 3.13.1
- [Release notes](https://github.com/snowflakedb/snowflake-connector-python/releases)
- [Commits](https://github.com/snowflakedb/snowflake-connector-python/compare/v3.0.4...v3.13.1)

Updates `pycryptodomex` from 3.18.0 to 3.19.1
- [Release notes](https://github.com/Legrandin/pycryptodome/releases)
- [Changelog](https://github.com/Legrandin/pycryptodome/blob/master/Changelog.rst)
- [Commits](https://github.com/Legrandin/pycryptodome/compare/v3.18.0...v3.19.1)

Updates `redshift-connector` from 2.0.915 to 2.1.7
- [Release notes](https://github.com/aws/amazon-redshift-python-driver/releases)
- [Changelog](https://github.com/aws/amazon-redshift-python-driver/blob/master/CHANGELOG.md)
- [Commits](https://github.com/aws/amazon-redshift-python-driver/compare/v2.0.915...v2.1.7)

Updates `certifi` from 2023.7.22 to 2024.7.4
- [Commits](https://github.com/certifi/python-certifi/compare/2022.09.24...2024.07.04)

Updates `requests` from 2.31.0 to 2.32.2
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.32.2)

Updates `pydantic` from 2.3.0 to 2.4.0
- [Release notes](https://github.com/pydantic/pydantic/releases)
- [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md)
- [Commits](https://github.com/pydantic/pydantic/compare/v2.3.0...v2.4.0)

Updates `requests` from 2.31.0 to 2.32.2
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.32.2)

Updates `requests` from 2.31.0 to 2.32.2
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.32.2)

Updates `urllib3` from 2.0.7 to 2.2.2
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.12...1.26.19)

Updates `pydantic` from 2.6.3 to 2.11.5
- [Release notes](https://github.com/pydantic/pydantic/releases)
- [Changelog](https://github.com/pydantic/pydantic/blob/main/HISTORY.md)
- [Commits](https://github.com/pydantic/pydantic/compare/v2.3.0...v2.4.0)

Updates `scikit-learn` from 1.4.1.post1 to 1.5.1
- [Release notes](https://github.com/scikit-learn/scikit-learn/releases)
- [Commits](https://github.com/scikit-learn/scikit-learn/compare/1.4.1.post1...1.5.1)

Updates `mlflow` from 2.11.1 to 2.20.3
- [Release notes](https://github.com/mlflow/mlflow/releases)
- [Changelog](https://github.com/mlflow/mlflow/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mlflow/mlflow/compare/v2.11.1...v2.20.3)

Updates `python-multipart` from 0.0.6 to 0.0.18
- [Release notes](https://github.com/Kludex/python-multipart/releases)
- [Changelog](https://github.com/Kludex/python-multipart/blob/master/CHANGELOG.md)
- [Commits](https://github.com/Kludex/python-multipart/compare/0.0.6...0.0.18)

---
updated-dependencies:
- dependency-name: certifi
  dependency-version: 2024.7.4
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: idna
  dependency-version: '3.7'
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: requests
  dependency-version: 2.32.2
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: urllib3
  dependency-version: 1.26.19
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: snowflake-connector-python
  dependency-version: 3.13.1
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: pycryptodomex
  dependency-version: 3.19.1
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: redshift-connector
  dependency-version: 2.1.7
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: certifi
  dependency-version: 2024.7.4
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: requests
  dependency-version: 2.32.2
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: pydantic
  dependency-version: 2.4.0
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: requests
  dependency-version: 2.32.2
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: requests
  dependency-version: 2.32.2
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: urllib3
  dependency-version: 2.2.2
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: pydantic
  dependency-version: 2.11.5
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: scikit-learn
  dependency-version: 1.5.1
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: mlflow
  dependency-version: 2.20.3
  dependency-type: direct:production
  dependency-group: pip
- dependency-name: python-multipart
  dependency-version: 0.0.18
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-05-28 15:02:24 +00:00
MauricioGarciaS
7ffcf79bf6
chore(recommendations): python modules updated and added airflow dag to save sessions features (#1979)
* fix(trainer): Updated requirements

* fix(recommendations): Downgraded pydantic to 1.10.12 and mlflow to 2.5

* Updated dag for updating database with feedbacks, changed feedback file from ml_service/core into common core

* fix(recommendations): fixed database update and added more features into DB

* Updated modules in recommendations trainer and server

* chore(recommendations): Updated python modules for trainer. Added script to save features from feedback sessions into ml database.

* updated requirements

* updated requirements
2024-04-24 15:10:18 +02:00
Kraiem Taha Yassine
612e41583e Api v1.15.0 (#1670)
* fix(chalice): fixed assist auto-complete
* fix(chalice): fixed exp-sessions without timezone

(cherry picked from commit e46df53ddc)
2023-11-20 16:15:12 +01:00
MauricioGarciaS
9915e0b3c8
chore(recommendations): mlflow update, pydantic update and others (#1450) 2023-08-22 09:23:08 -04:00
MauricioGarciaS
cea5eda985
feat(recommendations): Added services recommendation (ml_service) and trainer (ml_trainer) (#1275)
* Created two services: recommendation training and recommendation serving

* Deleted Docker temporary

* Added features based in signals information

* Added method to get sessions features using PG

* Added same utils and core elements into ml_trainer

* Added checks before training models, added handler for model serving

* Updated serving API and recommendation functions to use frontend signals features

* reorganized modules to have base image and for both serving and training

* Added Dockerfiles and base Dockerfile

* Solved issue while ordering sessions by relevance

* Added method to save user feedback of recommendations

* Added security authorization

* Updated Dockerfile

* fixed issues with secret insertion to API

* Updated feedback structure

* Added git for dags

* Solved issue of insertion on recommendation feedback

* Changed update method from def to async def and it is called during startup

* Solved issues of airflow running mlflow in dag

* Changes sanity checks and added middleware params

* base path renaming

* Changed update method to a interval method which loads one model each 10s if there are models to download

* Added sql files for recommendation service and trainer

* Cleaned files and added documentation for methods and classes

* Added README file

* Renamed endpoints, changed None into empty array and updated readme

* refactor(recommendation): optimized query

* style(recommendation): changed import to top file, renamed endpoints parameters, function optimization

* refactor(recommendation): .gitignore

* refactor(recommendation): .gitignore

* refactor(recommendation): Optimized Dockerfiles

* refactor(recommendation): changed imports

* refactor(recommendation): optimized requests

* refactor(recommendation): optimized requests

* Fixed boot for fastapi, updated some queries

* Fixed issues while downloading models and while returning json response from API

* limited number of recommendations and set a minimum score to present recommendations

* fix(recommendation): fixed some queries and updated prediction method

* Added env value to control number of predictions to make

* docs(recommendation): Added third party libraries used in recommendation service

* frozen requirements

* Update base_crons.py

added `misfire_grace_time` to recommendation crons

---------

Co-authored-by: Taha Yassine Kraiem <tahayk2@gmail.com>
2023-06-07 15:58:33 +02:00
MauricioGarciaS
fd7a4b80f1 Added function to select specific details from filters 2022-12-13 16:21:39 +01:00
MauricioGarciaS
574af2588d Airflow setup and workflow templates for training in script folder 2022-12-12 14:35:41 +01:00
MauricioGarciaS
77536c3153 clened recommendation files 2022-11-29 11:17:59 +01:00
MauricioGarciaS
dcc8ef5fb0 Added airflow worker, scheduler, trigger, webserver 2022-11-29 10:38:54 +01:00
MauricioGarciaS
2e9ff89976 Added queue method to Signals 2022-11-25 11:48:58 +01:00
MauricioGarciaS
1cadd08774 Changed scheduler method 2022-11-22 18:04:45 +01:00
MauricioGarciaS
9144606b08 Adding method to handle frontend responses in batches 2022-11-21 16:20:33 +01:00
MauricioGarciaS
b5bfc32f38 Testing queue method 2022-11-18 11:26:51 +01:00
MauricioGarciaS
d085b3583d API for signals in chalice ee, added folder for recommendation service 2022-11-17 16:34:45 +01:00