Open Hamedhm opened 2 years ago
Hi, Can you give some more details on the sizes (X, Y, Z, C, T) and formats of the images? And how are you importing them? Command-line, Insight client?
thanks @will-moore. Please see the chart below:
Hi @Hamedhm. How long has this been happening? Did anything change at about the time it began? (e.g. a move to a new server, a configuration change, a new file type)
The error you're getting looks to me like a system resource issue. Without knowing more, I'd guess a file descriptor limit (ulimit -n
).
Hi @joshmoore
Thank you for your reply. No nothing changed as far as I know.
I guess the issue is that Omero eats up all memory. For example, I restarted the Omero a few hours ago and it is using 17.6GB of virtual memory already. Yesterday, it was around 80GB.
for the command ulimit -n
I get 65000, not sure what this means
How much memory does this system have, @Hamedhm?
for the command
ulimit -n
I get 65000, not sure what this means
This is a reasonable setting, so :+1:
For example, I restarted the Omero a few hours ago and it is using 17.6GB of virtual memory already. Yesterday, it was around 80GB.
Interesting. Can you show the rest of that output? What python process is running under the java process with 1500m of memory.
Thanks @joshmoore
The machine has 32GB of memory.
The screenshot below is for when the machine is idle (like when I restart the machine). There is one task running on the machine but really nothing much.
and
Hi @Hamedhm,
Historically, the Java virtual memory consumption can be taken with a grain of salt, but 80GB definitely sounds like an issue. Also noting the Java version (1.6) I must make the plea for an upgrade.
As a sidenote: I don't recognize this get_omero_ids_from_csv_file.py
script. Do you know what is running it?
Hi,
We have an Omero server V5.3.1 (I know it is old!) to upload 100K+ images, and have recently encountered some issues with it.
Before I start, the config file looks like below:
The issue is that the server quickly becomes unavailable. The log below is produced by the process that may have some signals to specify the issue:
Please have you seen the same issue before?