search

PaulHancock / Aegean

The Aegean source finding program and associated tools
http://aegeantools.rtfd.io/
Other
47 stars 14 forks source link

Aegean test error #203

Open Deekshit-Vedula opened 11 months ago

Deekshit-Vedula commented 11 months ago

Hi,

I am trying to use Aegean for the first time and facing some issues. After running the setup.py I used the test command aegean tests/test_files.1904-66_SIN.fits to see if it works. I got the following error in the terminal

aegean:INFO This is Aegean 2.3.0-(2022-11-29)
aegean:INFO Found 8 cores
aegean:INFO Using 8 cores
aegean:INFO Finding sources.
source_finder:INFO Calculating background and rms data
Traceback (most recent call last):
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 370, in filter_mc_sharemem
    ibkg = SharedMemory(name=f'ibkg_{memory_id}', create=True, size=nbytes)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
OSError: [Errno 63] File name too long: '/ibkg_9397c36b-0353-42fa-a66e-dda9dec3e915'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/ananddeekshit/opt/anaconda3/bin/aegean", line 4, in <module>
    __import__('pkg_resources').run_script('AegeanTools==2.3.0', 'aegean')
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/pkg_resources/__init__.py", line 651, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/pkg_resources/__init__.py", line 1448, in run_script
    exec(code, namespace, namespace)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/EGG-INFO/scripts/aegean", line 12, in <module>
    sys.exit(aegean.main(sys.argv[1:]))
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/CLI/aegean.py", line 373, in main
    found = sf.find_sources_in_image(filename, outfile=options.outfile,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 2244, in find_sources_in_image
    self.load_globals(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 1321, in load_globals
    self._make_bkg_rms(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 1550, in _make_bkg_rms
    bkg, rms = filter_image(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 492, in filter_image
    bkg, rms = filter_mc_sharemem(im_name,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 398, in filter_mc_sharemem
    ibkg.close()
UnboundLocalError: local variable 'ibkg' referenced before assignment
(base) ananddeekshit@vedulas-air Aegean %
nedarajabpour commented 11 months ago

My problem was the same when I stopped AEGEAN, because it took a long time and after that Ive got an Error[17] and I fixed it. I think the previous version was faster. I changed these lines and it worked foe Error[17]. But unfortunately it took a long time again to find sources and I stopped it again, I solved my problem by changing these lines.

In this file AegeanTools/BANE.py I changed these two lines

ibkg = SharedMemory(name='ibkg', create=True, size=nbytes)

irms = SharedMemory(name='irms', create=True, size=nbytes)

I changed it to create=False for both and ran Aegean and then changed it back to True and it worked.

For Error[63] I changed te name of ibkg_{memoryid} and irms{memory_id} in this file .

Deekshit-Vedula commented 11 months ago

Thank you @nedarajabpour . I tried your suggestion and changed the name of ibkg_{memory_id} and irms_{memory_id} to just ibkg_ and irms_ but I got the following error.

aegean:INFO This is Aegean 2.3.0-(2022-11-29)
aegean:INFO Found 8 cores
aegean:INFO Using 8 cores
aegean:INFO Finding sources.
source_finder:INFO Calculating background and rms data
Traceback (most recent call last):
  File "/Users/ananddeekshit/opt/anaconda3/bin/aegean", line 4, in <module>
    __import__('pkg_resources').run_script('AegeanTools==2.3.0', 'aegean')
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/pkg_resources/__init__.py", line 651, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/pkg_resources/__init__.py", line 1448, in run_script
    exec(code, namespace, namespace)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/EGG-INFO/scripts/aegean", line 12, in <module>
    sys.exit(aegean.main(sys.argv[1:]))
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/CLI/aegean.py", line 373, in main
    found = sf.find_sources_in_image(filename, outfile=options.outfile,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 2244, in find_sources_in_image
    self.load_globals(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 1321, in load_globals
    self._make_bkg_rms(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 1550, in _make_bkg_rms
    bkg, rms = filter_image(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 492, in filter_image
    bkg, rms = filter_mc_sharemem(im_name,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 380, in filter_mc_sharemem
    pool = ctx.Pool(processes=cores, maxtasksperchild=1,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/spawn.py", line 183, in get_preparation_data
    main_mod_name = getattr(main_module.__spec__, "name", None)
AttributeError: module '__main__' has no attribute '__spec__'
(base) ananddeekshit@vedulas-air Aegean %
nedarajabpour commented 11 months ago

Thank you @nedarajabpour . I tried your suggestion and changed the name of ibkg_{memory_id} and irms_{memory_id} to just ibkg_ and irms_ but I got the following error.

aegean:INFO This is Aegean 2.3.0-(2022-11-29)
aegean:INFO Found 8 cores
aegean:INFO Using 8 cores
aegean:INFO Finding sources.
source_finder:INFO Calculating background and rms data
Traceback (most recent call last):
  File "/Users/ananddeekshit/opt/anaconda3/bin/aegean", line 4, in <module>
    __import__('pkg_resources').run_script('AegeanTools==2.3.0', 'aegean')
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/pkg_resources/__init__.py", line 651, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/pkg_resources/__init__.py", line 1448, in run_script
    exec(code, namespace, namespace)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/EGG-INFO/scripts/aegean", line 12, in <module>
    sys.exit(aegean.main(sys.argv[1:]))
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/CLI/aegean.py", line 373, in main
    found = sf.find_sources_in_image(filename, outfile=options.outfile,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 2244, in find_sources_in_image
    self.load_globals(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 1321, in load_globals
    self._make_bkg_rms(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/source_finder.py", line 1550, in _make_bkg_rms
    bkg, rms = filter_image(
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 492, in filter_image
    bkg, rms = filter_mc_sharemem(im_name,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/site-packages/AegeanTools-2.3.0-py3.9.egg/AegeanTools/BANE.py", line 380, in filter_mc_sharemem
    pool = ctx.Pool(processes=cores, maxtasksperchild=1,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/context.py", line 119, in Pool
    return Pool(processes, initializer, initargs, maxtasksperchild,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/pool.py", line 212, in __init__
    self._repopulate_pool()
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/pool.py", line 303, in _repopulate_pool
    return self._repopulate_pool_static(self._ctx, self.Process,
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/pool.py", line 326, in _repopulate_pool_static
    w.start()
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/process.py", line 121, in start
    self._popen = self._Popen(self)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/context.py", line 284, in _Popen
    return Popen(process_obj)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 32, in __init__
    super().__init__(process_obj)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/popen_fork.py", line 19, in __init__
    self._launch(process_obj)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/popen_spawn_posix.py", line 42, in _launch
    prep_data = spawn.get_preparation_data(process_obj._name)
  File "/Users/ananddeekshit/opt/anaconda3/lib/python3.9/multiprocessing/spawn.py", line 183, in get_preparation_data
    main_mod_name = getattr(main_module.__spec__, "name", None)
AttributeError: module '__main__' has no attribute '__spec__'
(base) ananddeekshit@vedulas-air Aegean %

Dear Deekshit,

I dont know actully what did you do.but I have changed to ibkg_1 and irms_1 in all of this file.I think this name is repeated two or three times in this file. Have you changed all of them?

PaulHancock commented 9 months ago

Hi Folks, I'm trying to diagnose the cause of this error. Can you let me know what OS you are using and the directory from which you are running Aegean? It would also be useful to see the output of aegean --version.

PaulHancock commented 9 months ago

Duplicate of #200

nedarajabpour commented 8 months ago

Dear Paul,

Currently, I'm using macOS Monterey and the latest version of Aegean.

When I run for big images, it takes a long time without any results. Could you please assist us with this? In the past, I used Aegean on the LMC image and it was very good, but now it doesn't work.

On Fri, Dec 15, 2023 at 4:15 PM Paul Hancock @.***> wrote:

Hi Folks, I'm trying to diagnose the cause of this error. Can you let me know what OS you are using and the directory from which you are running Aegean? It would also be useful to see the output of `aegean --version``.

— Reply to this email directly, view it on GitHub https://github.com/PaulHancock/Aegean/issues/203#issuecomment-1857290983, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACOQJHRSRUM7JQ4CEOLSYJDYJPMFRAVCNFSM6AAAAAA5B27QZCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJXGI4TAOJYGM . You are receiving this because you were mentioned.Message ID: @.***>

-- Regards Neda