OC synology-photos-nlp-search: Search through Synology Photos using natural language captions

I save and backup all the photos on a Synology NAS instead of using one of the online providers. However Synology Photos doesn't have good search capabilities. So I built a project to search through the images using natural language captions, and found that it works really well.

I have published the project publicly with a GPL-3.0 license - synology-photos-nlp-search. Anyone is welcome to use and contribute to the project.

The project uses sentence_transformers clip-ViT-B-32 model to generate embeddings for all images on the NAS, and then finds the most similar images based on the embedding of the search term. It was really cool to see that I can try two search terms like food and eating, and the embeddings model would understand the difference and provide relevant images for both.

I have containerized the application to make it easier to deploy and use. That said, some programming experience might be needed as it's not an open-and-use application.

This is my first major project that I am publishing, and would welcome any feedback for improvements from the community.