search

CAIDA / catalog-data

Repo which holds some panda solutions and papers
3 stars 6 forks source link

no descriptions #621

Open bhuffaker opened 1 year ago

bhuffaker commented 1 year ago

There is a list of files in catalog-data-caida that have no description. Please look at each item and add a description. After you get stuck, ask the author of the work.

You can get a list with the following command make caida

catalog-data-caida/sources/dataset/asymmetry-test.md
     warning: no description
catalog-data-caida/sources/dataset/bdk.md
     warning: no description
catalog-data-caida/sources/dataset/caidaspy.md
     warning: no description
catalog-data-caida/sources/dataset/datcat-oracle-dump.md
     warning: no description
catalog-data-caida/sources/dataset/gt-bgp.md
     warning: no description
catalog-data-caida/sources/dataset/hostip.md
     warning: no description
catalog-data-caida/sources/dataset/internetcensus2012.md
     warning: no description
catalog-data-caida/sources/dataset/isi-lander.md
     warning: no description
catalog-data-caida/sources/dataset/kleinberg-wikipedia.md
     warning: no description
catalog-data-caida/sources/dataset/netflow-sdsc.md
     warning: no description
catalog-data-caida/sources/dataset/timestamps.md
     warning: no description
catalog-data-caida/sources/dataset/wide.md
     warning: no description
catalog-data-caida/sources/media/2001_as_core_ipv4.json
     warning: no description
catalog-data-caida/sources/media/2020_dynamips_conext_video.json
     warning: no description
catalog-data-caida/sources/media/2020_unresolved_issues_imc_video.json
     warning: no description
catalog-data-caida/sources/media/2022_gmi3s_infosheet.json
     warning: no description
catalog-data-caida/sources/presentation/2005_mit_spoofer_project.json
     warning: no description
catalog-data-caida/sources/presentation/2009_spoofer_aims.json
     warning: no description
catalog-data-caida/sources/presentation/2009_spoofer_imc.json
     warning: no description
software:ioda
     warning: catalog-data-caida/sources/software/ioda.json duplicate of sources/software/ioda.json
jes089 commented 10 months ago

After running make fast now, an updated list of catalog-data-caida sources with no description:

catalog-data-caida/sources/dataset/amprnet-legit-networks-all-subnets.md
     warning: no description 
catalog-data-caida/sources/dataset/amprnet-legit-networks-bgp-announced.md
     warning: no description 
catalog-data-caida/sources/dataset/amprnet-legit-networks-slash24s.md
     warning: no description 
catalog-data-caida/sources/dataset/antonia.md
     warning: no description 
catalog-data-caida/sources/dataset/as-rank.md
       error: YAML:while parsing a block collection
  in "<unicode string>", line 4, column 2:
     - "https://www.w3.org/ns/csvw
     ^
expected <block end>, but found '<scalar>'
  in "<unicode string>", line 5, column 5:
     - "schema": "http://schema.org/"
        ^ 
catalog-data-caida/sources/dataset/asymmetry-test.md
     warning: no description 
catalog-data-caida/sources/dataset/bdk.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-defcon-events.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-defcon-traceroutes.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-defcon.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-edges-events.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-edges-traceroutes.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-moas-events.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-moas-traceroutes.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-peer-pfx-origins.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-redis.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-routed-space.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-submoas-events.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-submoas-traceroutes.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-submoas.md
     warning: no description 
catalog-data-caida/sources/dataset/bgp-hijacks-triplets-weekly.md
     warning: no description 
catalog-data-caida/sources/dataset/caidaspy.md
     warning: no description 
catalog-data-caida/sources/dataset/datcat-oracle-dump.md
     warning: no description 
catalog-data-caida/sources/dataset/dren-xfr-segments.md
     warning: no description 
catalog-data-caida/sources/dataset/dren-xfr.md
     warning: no description 
catalog-data-caida/sources/dataset/gt-bgp.md
     warning: no description 
catalog-data-caida/sources/dataset/hostip.md
     warning: no description 
catalog-data-caida/sources/dataset/internetcensus2012.md
     warning: no description 
catalog-data-caida/sources/dataset/isi-lander.md
     warning: no description 
catalog-data-caida/sources/dataset/kleinberg-wikipedia.md
     warning: no description 
catalog-data-caida/sources/dataset/netflow-sdsc.md
     warning: no description 
catalog-data-caida/sources/dataset/stardust-dist.md
     warning: no description 
catalog-data-caida/sources/dataset/stardust-spoki.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-ascii-rsdos.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-dos-crawler.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-meritnt-influx.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-pcap-live-encrypted.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-pcap-staged-encrypted-segments.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-pcap-staged-encrypted.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-pcap-staged.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-pcap-stats.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-reactive-pcap-live.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-reactive-pcap-stats.md
     warning: no description 
catalog-data-caida/sources/dataset/telescope-rsdos-daily-intermediate.md
     warning: no description 
catalog-data-caida/sources/dataset/timestamps.md
     warning: no description 
catalog-data-caida/sources/dataset/wide.md
     warning: no description 
catalog-data-caida/sources/media/2001_as_core_ipv4.json
     warning: no description 
catalog-data-caida/sources/media/2020_dynamips_conext_video.json
     warning: no description 
catalog-data-caida/sources/media/2020_unresolved_issues_imc_video.json
     warning: no description 
catalog-data-caida/sources/media/2022_gmi3s_infosheet.json
     warning: no description 
catalog-data-caida/sources/presentation/2005_mit_spoofer_project.json
     warning: no description 
catalog-data-caida/sources/presentation/2009_spoofer_aims.json
     warning: no description 
catalog-data-caida/sources/presentation/2009_spoofer_imc.json
     warning: no description
bhuffaker commented 10 months ago

@Phileodontist do these datasets all have names in thier anchor files?

Phileodontist commented 10 months ago

Yes, but looking at their markdown files, they don't have a name field. Realizes that most if not all of those catalog-data-caida/sources/dataset/* listed above dont have descriptions in either of their anchor/markdown files.

Most if not all of these datasets map to a container in swift, which I've created anchors/markdown files for them in bulk a few months back.

This is a data admin task; need to update both anchor and markdown files.

bhuffaker commented 7 months ago

@Phileodontist what is the status of this issue?

Phileodontist commented 7 months ago

@bhuffaker I was only able to fill in descriptions for a handful of them; updated anchor and markdown files. Need to find time with Dan and/or KC to identify the datasets and determine what their descriptions should be.