Insane RAM Usage and Memory Leak

[MythicPalette]

Describe the bug
When generating thumbnails in a folder with many images, the RAM skyrockets by an insane amount. To test, I loaded a folder with 358 images in it. After creating all of the thumbnails, I am 14.4 GB of RAM usage (Shown below)

After reaching about 12-15GB on my PC, it then becomes unstable and frequently will to fail to create thumbnails, resulting in blank thumbnails.

Leaving the program to sit for even half an hour never decrease the RAM, indicating a garbage collection failure and memory leak. The only ways to reduce RAM is to refresh with F5 or restart the application entirely.

RAM usage is normal while browsing a folder with all thumbnails already generated as shown below.

To Reproduce
Steps to reproduce the behavior:

1. Load folder with lot of images.
2. Scroll Down
3. Check memory usage as thumbnails are created.

Expected behavior
I would expect that whatever objects in memory that were created to generate the thumbnails would be properly disposed of and removed from memory through garbage collection.

Screenshots
After Thumbnail Creation:

After Restarting in the same folder:

Allusion version

• 1.0.0-rc.10

Desktop OS
Windows 11

[MythicPalette]

Also, I forgot to mention, 14GB is roughly four times the entire size of the folder demonstrated.

[Antoine-lb]

• Are you reading from a folder connected to Google Drive?
• what image format are those images in? RAW?

[MythicPalette]

I'm reading from a virtual drive using Google's official Drive software. The software installs the Google Drive as a network drive similar to a NAS.
The images are JPEG.

[Antoine-lb]

On my mac Google Drive only works when I mirror my files, meaning I have them all on my computer. The other Google Drive mode (where it dynamically downloads the files) doesn't work with allusion, I don't know why. Note: even when mirroring my files there is a problem where Google Drives keeps thinking that I updated all of the files, I think it comes from reading the metadata, Drive thinks I modified the file

…

On 6 Nov 2024 at 22:40 -0300, MythicPalette ***@***.***>, wrote: I'm reading from a virtual drive using Google's official Drive software. The software installs the Google Drive as a network drive similar to a NAS. The images are JPEG. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: ***@***.***>

[MythicPalette]

Well, I installed the drive software which makes the drive a virtual disk on my PC.

Allusion is able to read it and access all of my Google Drive files without issue. It's only when generating thumbnails that it does this. Once the thumbnails are generated and the app restarted, it works great and the issue never resurfaces. Something about the thumbnail generation process is causing a memory leak.

[KiaArmani]

Running into the same issue here. Opening a folder with thousands of images which don't have a thumbnail yet lead to high memory usage and crash.