Commit Graph

503 Commits (main)

Author SHA1 Message Date
Savely Krasovsky 3321c1a9df
feat(ml): update ONNX Runtime, OpenVINO and ROCm stack (#23458) 2026-01-01 12:17:55 -05:00
renovate[bot] e63e8e2517
chore(deps): update machine-learning (#24610)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-12-23 03:12:13 +00:00
github-actions 50d7956c07 chore: version v2.4.1 2025-12-19 15:03:03 +00:00
github-actions a02adbb828 chore: version v2.4.0 2025-12-17 17:44:24 +00:00
renovate[bot] 75b1ef2c57
chore(deps): update machine-learning (#24334)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-12-02 01:01:17 -05:00
Mert 6249996cdb
fix(ml): do not upscale preview (#24322)
do not upscale
2025-12-01 20:26:01 -06:00
renovate[bot] e699d8f170
chore(deps): update machine-learning (#23352) 2025-11-26 19:09:39 +00:00
Luka Prebil Grintal dd4169876c
fix(ml): Upgrade ONNX Runtime to v1.22.1 to fix ROCm build failures (#24045)
* fix: update ONNX runtime version to 1.21.0 to fix the failing checksum of 1.20.1

* update patch

* update to 1.22.1

---------

Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2025-11-25 13:27:21 -05:00
github-actions edbdc14178 chore: version v2.3.1 2025-11-20 02:20:16 +00:00
github-actions 45a0315606 chore: version v2.3.0 2025-11-19 17:46:53 +00:00
Alexander Sulfrian 5186092faa
fix: Update module name for rapidocr DownloadFile (#23838) 2025-11-12 18:43:00 +00:00
Mert 6913697ad1
feat(ml): multilingual ocr (#23527)
* handle other languages in ml server

* add variants to model selector

* no need to override path

* unused import
2025-11-06 12:58:41 -05:00
Mert a4ae86ce29
feat(ml): add preload and fp16 settings for ocr (#23576) 2025-11-06 17:55:11 +00:00
github-actions 28eb1bc13c chore: version v2.2.3 2025-11-04 03:14:34 +00:00
Mert 79d0e3e1ed
fix(ml): ocr inputs not resized correctly (#23541)
* fix resizing, use pillow

* unused import

* linting

* lanczos

* optimizations

fused operations

unused import
2025-11-03 07:21:30 +00:00
github-actions f5ff36a1f8 chore: version v2.2.2 2025-11-02 21:56:36 +00:00
dotlambda 7bdf0f6c50
chore(ml): remove setuptools from dependencies (#23446) 2025-10-31 21:34:10 +00:00
github-actions b35f00f768 chore: version v2.2.1 2025-10-31 18:04:27 +00:00
Mert 4abaad548a
fix(ml): ocr failing with rootless docker (#23402)
don't download font
2025-10-31 02:41:49 -04:00
github-actions 57c8378ca7 chore: version v2.2.0 2025-10-30 14:42:44 +00:00
Kang 02b29046b3
feat: ocr (#18836)
* feat: add OCR functionality and related configurations

* chore: update labeler configuration for machine learning files

* feat(i18n): enhance OCR model descriptions and add orientation classification and unwarping features

* chore: update Dockerfile to include ccache for improved build performance

* feat(ocr): enhance OCR model configuration with orientation classification and unwarping options, update PaddleOCR integration, and improve response structure

* refactor(ocr): remove OCR_CLEANUP job from enum and type definitions

* refactor(ocr): remove obsolete OCR entity and migration files, and update asset job status and schema to accommodate new OCR table structure

* refactor(ocr): update OCR schema and response structure to use individual coordinates instead of bounding box, and adjust related service and repository files

* feat: enhance OCR configuration and functionality

- Updated OCR settings to include minimum detection box score, minimum detection score, and minimum recognition score.
- Refactored PaddleOCRecognizer to utilize new scoring parameters.
- Introduced new database tables for asset OCR data and search functionality.
- Modified related services and repositories to support the new OCR features.
- Updated translations for improved clarity in settings UI.

* sql changes

* use rapidocr

* change dto

* update web

* update lock

* update api

* store positions as normalized floats

* match column order in db

* update admin ui settings descriptions

fix max resolution key

set min threshold to 0.1

fix bind

* apply config correctly, adjust defaults

* unnecessary model type

* unnecessary sources

* fix(ocr): switch RapidOCR lang type from LangDet to LangRec

* fix(ocr): expose lang_type (LangRec.CH) and font_path on OcrOptions for RapidOCR

* fix(ocr): make OCR text search case- and accent-insensitive using ILIKE + unaccent

* fix(ocr): add OCR search fields

* fix: Add OCR database migration and update ML prediction logic.

* trigrams are already case insensitive

* add tests

* format

* update migrations

* wrong uuid function

* linting

* maybe fix medium tests

* formatting

* fix weblate check

* openapi

* sql

* minor fixes

* maybe fix medium tests part 2

* passing medium tests

* format web

* readd sql

* format dart

* disabled in e2e

* chore: translation ordering

---------

Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
Co-authored-by: Alex Tran <alex.tran1502@gmail.com>
2025-10-27 14:09:55 +00:00
Mert bcfdb2f9df
fix(ml): pin cudnn version (#23110)
pin cudnn version
2025-10-20 18:18:09 -05:00
Mert 1b62c2ef55
feat(ml): coreml (#17718)
* coreml

* add test

* use arena by default in native installation

* fix tests

* add env to docs

* remove availability envs
2025-10-14 17:51:31 +00:00
github-actions 43eccca86a chore: version v2.1.0 2025-10-14 16:24:43 +00:00
Mert 5270107926
fix(ml): ipv6 check (#22735) 2025-10-07 12:24:23 -04:00
Cokodayo 51150a3ed1
fix(ml): Resolve IPv6 startup crash and healthcheck failure (#22387)
* fix(ml): Resolve IPv6 startup crash and healthcheck failure

Fixes #13782

* fix(ml): updated the fix to use the std lib

* Apply code formatting to __main__.py
2025-10-06 12:09:40 -04:00
github-actions bb72d723e2 chore: version v2.0.1 2025-10-03 15:12:12 +00:00
github-actions e4234af3b3 chore: version v2.0.0 2025-10-01 21:19:34 +00:00
github-actions f1f8c8e7a3 chore: version v1.144.1 2025-09-29 19:49:34 +00:00
bo0tzz d0a872622a
fix: bump ml pyproject.toml correctly (#22488)
* fix: bump ml pyproject.toml correctly

* fix: correct version in pyproject.toml
2025-09-29 14:45:27 -05:00
github-actions a498166cb6 chore: version v1.144.0 2025-09-29 18:52:32 +00:00
Aaron Liu 94a8bc5bce
fix(pump-version): fix immich-ml pyproject.toml path (#22372)
Since the migration to uv, this has not worked because the Python toml CLI has been looking for a pyproject.toml in the root folder.
2025-09-25 03:29:10 -04:00
renovate[bot] 0be71c82b3
chore(deps): update dependency pytest-cov to v7 (#22052)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-09-21 17:49:04 -04:00
Zack Pollard 01fddd58c6
chore: update ROCm image (#22034) 2025-09-15 20:42:17 -04:00
renovate[bot] 170306af1a
fix(deps): update machine-learning (#21704)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-09-10 14:51:11 -04:00
bo0tzz 50eae23f3a
fix: use specific uv version in ML dockerfile (#21611) 2025-09-05 20:15:29 +02:00
renovate[bot] 7d57fd1320
fix(deps): update machine-learning (#21296) 2025-09-01 19:44:19 -04:00
renovate[bot] e7e030279b
fix(deps): update machine-learning (#21044) 2025-08-18 21:55:49 -04:00
renovate[bot] b3fb831994
fix(deps): update machine-learning (#20878)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-08-13 11:24:09 -04:00
renovate[bot] adb55f3726
fix(deps): update machine-learning (#19803)
* fix(deps): update machine-learning

* typing fixes

---------

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2025-08-11 18:07:49 -04:00
bo0tzz 3a854d77ac
fix: use IMMICH_HOST env var in ML healthcheck (#19844)
Fixes #19843
2025-07-14 18:08:29 -04:00
renovate[bot] b00d44a00c
fix(deps): update machine-learning (#19647) 2025-07-03 20:28:34 +00:00
renovate[bot] 5f76cdddc7
chore(deps): update ghcr.io/astral-sh/uv:latest docker digest to 9653efd (#19530)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-25 20:37:53 +01:00
renovate[bot] bcfc967d77
fix(deps): update machine-learning (#19219) 2025-06-24 17:55:37 +03:00
Matthew Momjian d233a7d97a
fix(server): remove excessive inactivity log (#19306) 2025-06-19 19:13:13 +00:00
renovate[bot] f9ed314b37
fix(deps): update machine-learning (major) (#19067)
fix(deps): update machine-learning

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-09 12:26:36 -04:00
renovate[bot] ac0e94c003
chore(deps): update machine-learning (#19046)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-09 11:00:20 -04:00
renovate[bot] ecb16d9907
fix(deps): update machine-learning (#18880)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-06-07 01:06:32 +00:00
renovate[bot] 0205e89e34
fix(deps): update machine-learning (#18382) 2025-05-27 22:08:33 -04:00
bo0tzz 8f045bc602
feat: let renovate pick up on ML driver deps (#18319) 2025-05-16 14:10:21 -04:00
renovate[bot] 80dfe7a5e9
fix(deps): update machine-learning (#18248) 2025-05-13 09:18:42 -04:00
luzpaz b1e1362246
fix: various typos (grouped in to separate commits) (#18177) 2025-05-09 13:10:34 +00:00
renovate[bot] 61a3eba1bd
fix(deps): update machine-learning (#18118) 2025-05-06 15:27:34 +00:00
renovate[bot] 2c2dd01bf0
fix(deps): update machine-learning (#17951) 2025-04-29 20:02:58 +00:00
renovate[bot] 2c3658e642
fix(deps): update machine-learning (#17769) 2025-04-23 07:44:30 -04:00
renovate[bot] 8f8ff3adc0
fix(deps): update machine-learning (#17610) 2025-04-16 10:56:40 -04:00
Mitchell Pleune 9fd2c5220d
fix: test_sets_default_sess_options fails if compiling with globally enabled cuda (#17516)
Coming from nixos, this test fails when cuda is enabled. https://github.com/NixOS/nixpkgs/pull/382896

Solution as proposed by @mertalev
2025-04-10 13:06:33 -04:00
renovate[bot] 43e3075f93
fix(deps): update machine-learning (#17455) 2025-04-09 16:20:11 +00:00
renovate[bot] 5cb5fcbf62
fix(deps): update machine-learning (#17286) 2025-04-02 03:57:19 +00:00
Mert 9e7744a9ab
fix(ml): healthcheck (#17274) 2025-03-31 19:23:40 -04:00
Mert 6789c2ac19
feat(ml): better multilingual search with nllb models (#13567) 2025-03-31 11:06:57 -04:00
Mert 84c35e35d6
chore(ml): installable package (#17153)
* app -> immich_ml

* fix test ci

* omit file name

* add new line

* add new line
2025-03-27 19:49:09 +00:00
Mert f7d730eb05
chore(ml): remove exporter (#17182)
* remove exporter code

* update gha
2025-03-27 14:48:02 -04:00
renovate[bot] 6ba94ac2f2
fix(deps): update machine-learning (#17078)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-03-26 02:04:41 +00:00
Mert 4bfef2460a
docs: model benchmarks (#17036)
* model benchmarks

* minor fixes

* formatting

* docs build

* maybe fix reference

* clarify optimal

* use emojis

* wording

* wording

* clarify optimal wording

* bolding

* more detailed instructions

* clarify edge case fix

* early exit in dim loop
2025-03-24 12:02:33 -04:00
Mert 6a8e38042d
fix(ml): add librknnrt.so in rknn image (#17022)
add librknnrt.so
2025-03-21 16:57:14 -04:00
renovate[bot] bc90678276
fix(deps): update machine-learning (#16966) 2025-03-18 23:07:21 +00:00
renovate[bot] 564724b398
fix(deps): update machine-learning (#16960)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-03-18 20:55:43 +00:00
renovate[bot] 4d723f4b56
chore(deps): update dependency types-setuptools to v76 (#16949)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-03-18 15:02:25 -04:00
renovate[bot] 898b3e75c2
fix(deps): update machine-learning (#16935)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-03-18 17:09:46 +00:00
Mert 2b37caba03
feat(ml): rocm (#16613)
* feat(ml): introduce support of onnxruntime-rocm for AMD GPU

* try mutex for algo cache

use OrtMutex

* bump versions, run on mich

use 3.12

use 1.19.2

* acquire lock before any changes can be made

guard algo benchmark results

mark mutex as mutable

re-add /bin/sh (?)

use 3.10

use 6.1.2

* use composite cache key

1.19.2

fix variable name

fix variable reference

aaaaaaaaaaaaaaaaaaaa

* bump deps

* disable algo caching

* fix gha

* try ubuntu runner

* actually fix the gha

* update patch

* skip mimalloc preload for rocm

* increase build threads

* increase timeout for rocm

* Revert "increase timeout for rocm"

This reverts commit 2c4452f5d132198ed381a7b262b4a5cab5114b5f.

* attempt migraphx

* set migraphx_home

* Revert "set migraphx_home"

This reverts commit c121d3e48754b3bce100636f8d666deec58a44b7.

* Revert "attempt migraphx"

This reverts commit 521f9fb72dbe506dc6cb8faeb6494817d87265c6.

* migraphx, take two

* bump rocm

* allow cpu

* try only targeting migraphx

* skip tests

* migraph 

* known issues

* target gfx900 and gfx1102

* mention `HSA_USE_SVM`

* update lock

* set device id for rocm

---------

Co-authored-by: Mehdi GHESH <mehdi.ghesh@hotmail.fr>
2025-03-17 21:08:19 +00:00
Yoni Yang 14c3b99c0f
feat(ml): ML on Rockchip NPUs (#15241) 2025-03-17 12:04:08 -04:00
Mert 83ed03920e
fix(ml): dev environment dependencies (#16815)
use /opt/venv
2025-03-11 13:39:33 -05:00
renovate[bot] cb489a1aa9
chore(deps): pin ghcr.io/astral-sh/uv docker tag to 562193a (#16791) 2025-03-10 22:23:50 -04:00
renovate[bot] fe959b2f05
fix(deps): update machine-learning (#16594) 2025-03-10 14:48:53 +00:00
Mert 6da77600e5
chore(ml): uv (#16725)
* poetry to uv

* update ci

* remove caching

* add typeshed to dev

* no need for `--non-interactive`

* move backends to extras

* oopsie

* update ci
2025-03-09 21:30:16 -05:00
github-actions 31dd15ce8a chore: version v1.129.0 2025-03-05 19:47:50 +00:00
Mert 61c8237a4d
fix(ml): set face detection threshold correctly in locust (#13419)
* set minScore correctly

* cleanup

* remove outdated tag score
2025-03-04 20:52:07 +00:00
renovate[bot] c23c53bf6f
fix(deps): update machine-learning (#16560) 2025-03-04 01:42:35 +00:00
renovate[bot] 4b568dcbb3
chore(deps): update dependency black to v25 (#16033)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-03-03 11:57:46 +00:00
github-actions dc143046e3 chore: version v1.128.0 2025-02-28 18:54:08 +00:00
github-actions 5f7f88ff17 chore: version v1.127.0 2025-02-26 15:18:50 +00:00
renovate[bot] a3766b879e
fix(deps): update machine-learning (#16012)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-02-11 11:23:54 -06:00
github-actions 8794c84e9d chore: version v1.126.1 2025-02-10 17:54:02 +00:00
github-actions feba590de7 chore: version v1.126.0 2025-02-10 16:10:06 +00:00
bo0tzz 882163f545
chore: build metadata for ML container (#15831)
* chore: build metadata for ML container

* fix: build_image_url
2025-02-02 23:45:58 +01:00
github-actions 4fd8c1b3c1 chore: version v1.125.7 2025-01-29 17:41:38 +00:00
github-actions f44669447f chore: version v1.125.6 2025-01-28 02:58:27 +00:00
github-actions 64d926581f chore: version v1.125.5 2025-01-27 20:04:50 +00:00
github-actions e5794e6cfc chore: version v1.125.4 2025-01-27 18:44:12 +00:00
github-actions 72a55c13b6 chore: version v1.125.3 2025-01-26 14:14:48 +00:00
github-actions 9871a04d54 chore: version v1.125.2 2025-01-24 19:09:06 +00:00
github-actions 50a2f6193f chore: version v1.125.1 2025-01-23 16:52:23 +00:00
github-actions 49a16045bd chore: version v1.125.0 2025-01-23 16:23:47 +00:00
renovate[bot] 5171630b98
fix(deps): update machine-learning (#15494)
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
2025-01-21 13:17:55 -05:00
Daniel Dietzler 332a865ce6
refactor: migrate person repository to kysely (#15242)
* refactor: migrate person repository to kysely

* `asVector` begone

* linting

* fix metadata faces

* update test

---------

Co-authored-by: Alex <alex.tran1502@gmail.com>
Co-authored-by: mertalev <101130780+mertalev@users.noreply.github.com>
2025-01-21 13:12:28 -05:00
Tempest 1d0d4fc281
feat: Allow multiple ML models to be preloaded (#15418) 2025-01-20 21:39:14 -05:00
renovate[bot] 345791c0e6
chore(deps): update machine-learning (#15476) 2025-01-20 21:38:50 -05:00
Tempest d5a9294eeb
feat: Add additional env variables to ML container (#15398)
* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Update config.py

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Apply formatting

* minor update

* formatting

* root validator

* minor update

* minor update

* minor update

* change to support explicit models

* minor update

* minor change

* minor change

* minor change

* minor update

* add logs, resolve errors

* minor change

* add new enviornment variables

* minor revisons

* remove comments

* add additional variables to ML (fixed)

* add additional variables to ML (fixed)

* add additional variables to ML

* formatting

* remove comment

* remove mypy error

* remove unused module

* merge f strings
2025-01-17 17:22:05 -05:00
Tempest c5476a99b1
feat: Add additional env variables for Machine Learning (#15326)
* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Update config.py

* Add additional variables to preload part ML models

* Add additional variables to preload part ML models

* Apply formatting

* minor update

* formatting

* root validator

* minor update

* minor update

* minor update

* change to support explicit models

* minor update

* minor change

* minor change

* minor change

* minor update

* add logs, resolve errors

* minor change

* add new enviornment variables

* minor revisons

* remove comments
2025-01-14 22:06:01 +00:00