cyriltasse / DynSpecMS

0 stars 3 forks source link

Exoplanets with MeerKAT #23

Open cyriltasse opened 7 months ago

cyriltasse commented 7 months ago

Build a merged exoplanetary systems catalog from

https://exoplanet.eu/home/

https://exoplanetarchive.ipac.caltech.edu/

And a Gaia dr3 comparison stars catalog:

https://gea.esac.esa.int/archive/

cyriltasse commented 7 months ago

Query gaia stuff

https://github.com/cyriltasse/AnalyseDynSpecMS/blob/ff622233396f8d45f6d5ab28b0754380d2c1dfe3/Catalogs/ClassGaiaQuery.py

cyriltasse commented 7 months ago

ms2dynspec.py --ms <you.ms> --data DATA --model PREDICT_SUB --rad 1. --noff 30 --DoTar 0 --OutDirName Test --NCPU 90 --srclist test.txt

with test.txt being the file containing the info for your targets: Src_Label(str), ra(deg), dec(deg), Src_Type(str)

bngcebetsha commented 4 months ago

my test.txt looks like this:

Proxima_Cen,217.4289583,-62.6795000,S200

Ran:

python3 ms2dynspec.py --ms ../1556208112_20190425-J1429_6240-corr.ms --data CORRECTED_DATA --model MODEL_DATA --rad 1. --noff 30 --NCPU 90 --srclist proxima_source.txt

Returns

Traceback (most recent call last):
  File "ms2dynspec.py", line 153, in <module>
    main(args)
  File "ms2dynspec.py", line 105, in main
    BeamNBand=args.BeamNBand)
  File "/data4/sirothia/proxima_btry/msdir/DynSpecMS/ClassDynSpecMS.py", line 90, in __init__
    self.InitFromCatalog()
  File "/data4/sirothia/proxima_btry/msdir/DynSpecMS/ClassDynSpecMS.py", line 198, in InitFromCatalog
    NOrig=self.PosArray.Name.shape[0]
IndexError: tuple index out of range
talonmyburgh commented 4 months ago

Will look to see if I can patch this tomorrow if @cyriltasse doesn't get to it first. Doesn't look like it will be too complicated.

talonmyburgh commented 4 months ago

@bngcebetsha are you on branch: MTilde_ASync_weights_mergeJones_merge

bngcebetsha commented 4 months ago

@talonmyburgh no, I'm on main

talonmyburgh commented 4 months ago

Use the branch I mentioned there and try again - I am unfortunately having connection issues with SARAO computers that I'm waiting on IT to solve :)

bngcebetsha commented 4 months ago

The problem I am now getting is caused by my MS - something I will need to sort out:

(venv) bngcebetsha@stevie:/data4/sirothia/proxima_btry/msdir/DynSpecMS$ python3 ms2dynspec.py --ms ../1556208112_20190425-J1429_6240-corr.ms --data DATA --model PREDICT_SUB --rad 1. --noff 30 --NCPU 90 --srclist proxima_source.csv 
 - 16:55:50 - AsyncProcessPool             | Fixing parent process to vthread 0
 - 16:55:50 - AsyncProcessPool             | Worker affinities not specified, leaving unset
 - 16:55:50 - ClassMS                      | found 1 MSs matching ../1556208112_20190425-J1429_6240-corr.ms
 - 16:55:50 - ClassMS                      | ../1556208112_20190425-J1429_6240-corr.ms: selecting DDID 0
 - 16:55:50 - ClassMS                      | ../1556208112_20190425-J1429_6240-corr.ms: selecting field 0
 - 16:55:50 - ClassMS                      | ../1556208112_20190425-J1429_6240-corr.ms: non-default column DATA
 - 16:55:50 - ClassMS                      | 1 MS section(s) selected
 - 16:55:50 - DynSpecMS                    | DynSpecMS version v1.0-115-g0c47a03 starting up
  Reading metadata...............   1/1 [==================================================] 100%  - 0'00" 
Traceback (most recent call last):
  File "ms2dynspec.py", line 198, in <module>
    main(args)
  File "ms2dynspec.py", line 133, in main
    options=args)
  File "/data4/sirothia/proxima_btry/msdir/DynSpecMS/ClassDynSpecMS.py", line 132, in __init__
    self.ReadMSInfos()
  File "/data4/sirothia/proxima_btry/msdir/DynSpecMS/ClassDynSpecMS.py", line 776, in ReadMSInfos
    self.NTimesGrid=int(np.ceil((tmax-tmin)/dtBin))
TypeError: unsupported operand type(s) for -: 'NoneType' and 'NoneType'
bngcebetsha commented 4 months ago

permission to fork repo so I can make changes to the branch @cyriltasse ? I updated a few imports

cyriltasse commented 4 months ago

Hi thanks, I had a similar problem lately but I fixed it, @bngcebetsha what branch are you using?

bngcebetsha commented 4 months ago

Hi thanks, I had a similar problem lately but I fixed it, @bngcebetsha what branch are you using?

@cyriltasse thanks for your response, I am running MTilde_ASync_weights_mergeJones_merge branch

cyriltasse commented 4 months ago

Can you try with SplitCatalog branch?

bngcebetsha commented 4 months ago

SplitCatalog

I still get the time resolution issue I reported here - https://github.com/cyriltasse/DynSpecMS/issues/23#issuecomment-2061463083

thanks I think I should have a closer look at this myself.

bngcebetsha commented 4 months ago

@cyriltasse - I was wondering when you will have time to chat about this method - https://github.com/cyriltasse/DynSpecMS/blob/fd32cac4d907383b8c9df4ff3e121fba64d604d1/ClassDynSpecMS.py#L989

Its raising an exception during processing.

o-smirnov commented 4 months ago

@bngcebetsha I can see this method appeared in later DDF branches. Try the UseAPP_kMS_MeerKLASS branch for instance.

cyriltasse commented 4 months ago

Yeah that could well be that you need a more recent version of DDFacet... @bngcebetsha maybe I can give you a singularity image that as all up to date branches?

bngcebetsha commented 4 months ago

@cyriltasse that would be nice, thanks @o-smirnov . I forked and hacked away at DynSpecMS till it produced something. I still need to understand the output fits files I got. Thanks for all the help and the tool