generate streaming json from preston extracted from dwca

jhpoelen commented 2 years ago

To help increase access to biodiversity data, suggest to make Preston stream DwC-A records in json line-by-line.

$ preston ls --remote https://deeplinker.bio | preston dwc-stream | head
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/taxa.txt","rowType":"http://rs.tdwg.org/dwc/terms/Taxon","http://purl.org/dc/terms/references":"http://treatment.plazi.org/id/CBB79C7983DC6B47F04E48319A6820CF","http://rs.tdwg.org/dwc/terms/originalNameUsageID":null,"http://rs.tdwg.org/dwc/terms/kingdom":"Animalia","http://gbif.org/dwc/terms/1.0/canonicalName":"Epocilla pakhtunkhwa","http://plazi.org/terms/1.0/combinationAuthors":null,"http://rs.tdwg.org/dwc/terms/taxonID":"CBB79C7983DC6B47F04E48319A6820CF.taxon","http://rs.tdwg.org/dwc/terms/parentNameUsageID":null,"http://rs.tdwg.org/dwc/terms/order":"Epocilla","http://rs.tdwg.org/dwc/terms/genus":"Epocilla","http://rs.tdwg.org/dwc/terms/scientificNameAuthorship":null,"http://plazi.org/terms/1.0/verbatimScientificName":"Epocilla pakhtunkhwa Ali & Maddison","http://rs.tdwg.org/dwc/terms/phylum":"Arthropoda","http://rs.tdwg.org/dwc/terms/class":"Arachnida","http://plazi.org/terms/1.0/combinationYear":null,"http://rs.tdwg.org/dwc/terms/taxonomicStatus":null,"http://rs.tdwg.org/dwc/terms/acceptedNameUsageID":null,"http://plazi.org/terms/1.0/basionymAuthors":null,"http://rs.tdwg.org/dwc/terms/scientificName":"Epocilla pakhtunkhwa","http://rs.tdwg.org/dwc/terms/nomenclaturalStatus":null,"http://rs.tdwg.org/dwc/terms/namePublishedIn":null,"http://plazi.org/terms/1.0/basionymYear":null,"http://rs.tdwg.org/dwc/terms/family":"Salticidae","http://rs.tdwg.org/dwc/terms/taxonRank":"species"}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/taxa.txt","rowType":"http://rs.tdwg.org/dwc/terms/Taxon","http://purl.org/dc/terms/references":"http://treatment.plazi.org/id/8F2BFEE188BACD1699A3588473B2181E","http://rs.tdwg.org/dwc/terms/originalNameUsageID":null,"http://rs.tdwg.org/dwc/terms/kingdom":"Animalia","http://gbif.org/dwc/terms/1.0/canonicalName":"Menemerus nigli","http://plazi.org/terms/1.0/combinationAuthors":"Wesolowska & Freudenschuss","http://rs.tdwg.org/dwc/terms/taxonID":"8F2BFEE188BACD1699A3588473B2181E.taxon","http://rs.tdwg.org/dwc/terms/parentNameUsageID":null,"http://rs.tdwg.org/dwc/terms/order":"Araneae","http://rs.tdwg.org/dwc/terms/genus":"Menemerus","http://rs.tdwg.org/dwc/terms/scientificNameAuthorship":"Wesolowska & Freudenschuss 2012","http://plazi.org/terms/1.0/verbatimScientificName":"Menemerus nigli Wesolowska & Freudenschuss, 2012","http://rs.tdwg.org/dwc/terms/phylum":"Arthropoda","http://rs.tdwg.org/dwc/terms/class":"Arachnida","http://plazi.org/terms/1.0/combinationYear":"2012","http://rs.tdwg.org/dwc/terms/taxonomicStatus":null,"http://rs.tdwg.org/dwc/terms/acceptedNameUsageID":null,"http://plazi.org/terms/1.0/basionymAuthors":null,"http://rs.tdwg.org/dwc/terms/scientificName":"Menemerus nigli Wesolowska & Freudenschuss 2012","http://rs.tdwg.org/dwc/terms/nomenclaturalStatus":null,"http://rs.tdwg.org/dwc/terms/namePublishedIn":null,"http://plazi.org/terms/1.0/basionymYear":null,"http://rs.tdwg.org/dwc/terms/family":"Salticidae","http://rs.tdwg.org/dwc/terms/taxonRank":"species"}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/taxa.txt","rowType":"http://rs.tdwg.org/dwc/terms/Taxon","http://purl.org/dc/terms/references":"http://treatment.plazi.org/id/738846FC302BC885A48DA787EB745D16","http://rs.tdwg.org/dwc/terms/originalNameUsageID":null,"http://rs.tdwg.org/dwc/terms/kingdom":"Animalia","http://gbif.org/dwc/terms/1.0/canonicalName":"Stenaelurillus mardanicus","http://plazi.org/terms/1.0/combinationAuthors":null,"http://rs.tdwg.org/dwc/terms/taxonID":"738846FC302BC885A48DA787EB745D16.taxon","http://rs.tdwg.org/dwc/terms/parentNameUsageID":null,"http://rs.tdwg.org/dwc/terms/order":"Araneae","http://rs.tdwg.org/dwc/terms/genus":"Stenaelurillus","http://rs.tdwg.org/dwc/terms/scientificNameAuthorship":null,"http://plazi.org/terms/1.0/verbatimScientificName":"Stenaelurillus mardanicus Ali & Maddison","http://rs.tdwg.org/dwc/terms/phylum":"Arthropoda","http://rs.tdwg.org/dwc/terms/class":"Arachnida","http://plazi.org/terms/1.0/combinationYear":null,"http://rs.tdwg.org/dwc/terms/taxonomicStatus":null,"http://rs.tdwg.org/dwc/terms/acceptedNameUsageID":null,"http://plazi.org/terms/1.0/basionymAuthors":null,"http://rs.tdwg.org/dwc/terms/scientificName":"Stenaelurillus mardanicus","http://rs.tdwg.org/dwc/terms/nomenclaturalStatus":null,"http://rs.tdwg.org/dwc/terms/namePublishedIn":null,"http://plazi.org/terms/1.0/basionymYear":null,"http://rs.tdwg.org/dwc/terms/family":"Salticidae","http://rs.tdwg.org/dwc/terms/taxonRank":"species"}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/media.txt","rowType":"http://eol.org/schema/media/Document","http://purl.org/dc/terms/contributor":"Pensoft via Plazi","http://purl.org/dc/terms/language":"en","http://ns.adobe.com/xap/1.0/rights/Owner":null,"http://rs.tdwg.org/dwc/terms/taxonID":"CBB79C7983DC6B47F04E48319A6820CF.taxon","http://rs.tdwg.org/dwc/terms/additionalInformationURL":"http://treatment.plazi.org/id/CBB79C7983DC6B47F04E48319A6820CF","http://purl.org/dc/terms/format":"text/html","http://iptc.org/std/Iptc4xmpExt/1.0/xmlns/CVterm":"http://rs.tdwg.org/ontology/voc/SPMInfoItems#GeneralDescription","http://purl.org/dc/terms/rights":"No known copyright restrictions apply. See Agosti, D., Egloff, W., 2009. Taxonomic information exchange and copyright: the Plazi approach. BMC Research Notes 2009, 2:53 for further explanation.","http://purl.org/dc/terms/title":"Epocilla pakhtunkhwa","http://purl.org/dc/terms/bibliographicCitation":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/type":"http://purl.org/dc/dcmitype/Text","http://purl.org/dc/terms/identifier":"CBB79C7983DC6B47F04E48319A6820CF.text","http://ns.adobe.com/xap/1.0/rights/UsageTerms":"Public Domain","http://purl.org/dc/terms/creator":"Ali, Pir Asmat;Maddison, Wayne P.;Zahid, Muhammad;Butt, Abida","http://purl.org/dc/terms/description":"<div><p>Epocilla pakhtunkhwa Ali &amp; Maddisonsp. n. Figs 1-4 </p><p>Holotype.</p><p> Male in UBC from Pakistan: Khyber Paktunkhwa: Malakand (Agra), 34.589&deg;N , 71.713&deg;E , 2500 m elevation, 7 July 2015, Pir Asmat Ali, from maize crop fields (specimen PAA#2015-07-146). </p><p>Etymology.</p><p>The name of the province of the type locality, treated as a noun in apposition.</p><p>Diagnosis.</p><p>Epocilla pakhtunkhwa is most similar to E. sirohi ( Caleb et al. 2017a ) in having a long embolus curving retrolaterally, but differs in having an expanded flange near the tip of the embolus (lacking in E. sirohi ; Caleb et al. 2017a ) and a narrower and deeper cleft between the embolus and tegulum. Two other species with a long embolus are E. aurantiaca and E. blairei , but these have an embolus that is sinuous, curving toward the retrolateral but then reversing the curve to point toward the tip of the cymbium ( Pr&oacute;szyński 1984  ; Żabka 1985  ). </p><p>Description.</p><p>Male (holotype): Measurements. Carapace length 2.63, width 2.35, height 1.50. Ocular area widest at AER; length 1.31, width of PLE row 1.54, width of PME row 1.50, AER width 1.59. Abdomen length 3.95, width 1.16. Leg I: coxa 0.94, trochanter 0.56, femur 2.06, patella 1.41, tibia 1.69, metatarsus 1.50, tarsus 0.56. Leg II: coxa 0.75, trochanter 0.27, femur 1.88, patella, 0.86; tibia, 1.69; metatarsus, 1.43, tarsus, 0.56. Leg III: coxa 0.75, trochanter 0.37, femur 1.88, patella 0.84, tibia 1.22, metatarsus 1.41, tarsus 0.75. Leg IV: coxa 0.93, trochanter 0.47, femur 1.97, patella 0.84, tibia 1.50, metatarsus 1.41, tarsus 0.75.</p><p> Structure. Ocular area with a distinct integumental bump in front of the fovea and between the PLE (Figure 1, triangle). Carapace sides extend laterally with gentle slope in thoracic and cephalic regions, making the thoracic area broad. Posterior to fovea, thoracic area slopes gently before sloping more abruptly near back margin. Chelicera with one simple retromarginal tooth and 2 promarginal teeth; basal segment more or less vertical, relatively long, narrowing toward the tip but then expanding just before the fang (Figure 1). Palp tibia swollen retrolaterally, with dual apophysis as typical of Epocilla . The more prolateral of these is the RTA itself, somewhat hidden (Figs 3, 4, &quot;RTA&quot;). End of cymbium fairly wide, blunt. Embolus long, with an expanded flange near the tip, though the tip itself is narrow and curves slightly toward the ventral. Leg I stout, with tibia ventrally having 4 pairs of macrosetae, the anterior of each of which is much larger. Abdomen squared at the anterior margin, somewhat cone-shaped to the posterior. </p><p> Figures 1-4. Epocilla pakhtunkhwa Ali &amp; Maddison, sp. n., male holotype (PAA#2015-07-146). 1 face 2 dorsal view 3 left palp, ventral view 4 left palp, retrolateral view. Scale bar: 0.1 mm (3, 4). Abbreviations: B = bump on tegulum, RTA = retrolateral tibial apophysis. Figures 1-4 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p>Colour. Carapace edges are dark brown, above which are broad lateral bands of yellow white scales extending from beneath the ALE on the clypeus to the posterior edge and lying over orange-brown integument. Centrally the thoracic region is reddish brown with a medial paler area, with traces of brown hairs and scales present. Ocular area black to dark brown, with fringe of orange hairs at front extending over the AER, appearing from the front as two eyebrows. Posterior to that is a patch of white scales centrally in the ocular area, surrounded by darker scales. Clypeus dark brown below AME, having a few orange hairs, contrasting strongly with white scales under ALE that belong to the lateral carapace bands. Chelicerae yellowish brown near fangs, darker brown otherwise. Palp coxa and trochanter light brown; femur, patella and tibia paler orange-yellow; cymbium brown with orange-yellow tip. Sternum whitish yellow with edges brown. Leg I medium brown except for a much darker longitudinal brown band along the prolateral side of the coxa, trochanter and femur, a lighter patch on the tibia, and pale yellow-white metatarsus and tarsus. Legs II, III, IV pale yellow-white. Abdomen longitudinally striped, with wide brown band running medially, lateral to which is a band of yellow-white scales, lateral and ventral to which are reflective transparent or grey scales. Spinnerets are yellow-brown with grey hairs.</p><p>Female: unknown.</p><p>Habitat.</p><p>Specimens were collected by hand picking from maize, both living and cut, in maize fields.</p><p>Additional material examined.</p><p> One male paratype from Pakistan: Khyber Paktunkhwa: Malakand (Manzari Baba), 34.49&deg;N , 71.71&deg;E , 1613 m elevation, 13 July 2015, Pir Asmat Ali (specimen PAA#2015-07-134). </p></div>"}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/media.txt","rowType":"http://eol.org/schema/media/Document","http://purl.org/dc/terms/contributor":"Pensoft via Plazi","http://purl.org/dc/terms/language":"en","http://ns.adobe.com/xap/1.0/rights/Owner":null,"http://rs.tdwg.org/dwc/terms/taxonID":"8F2BFEE188BACD1699A3588473B2181E.taxon","http://rs.tdwg.org/dwc/terms/additionalInformationURL":"http://treatment.plazi.org/id/8F2BFEE188BACD1699A3588473B2181E","http://purl.org/dc/terms/format":"text/html","http://iptc.org/std/Iptc4xmpExt/1.0/xmlns/CVterm":"http://rs.tdwg.org/ontology/voc/SPMInfoItems#GeneralDescription","http://purl.org/dc/terms/rights":"No known copyright restrictions apply. See Agosti, D., Egloff, W., 2009. Taxonomic information exchange and copyright: the Plazi approach. BMC Research Notes 2009, 2:53 for further explanation.","http://purl.org/dc/terms/title":"Menemerus nigli Wesolowska & Freudenschuss 2012","http://purl.org/dc/terms/bibliographicCitation":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/type":"http://purl.org/dc/dcmitype/Text","http://purl.org/dc/terms/identifier":"8F2BFEE188BACD1699A3588473B2181E.text","http://ns.adobe.com/xap/1.0/rights/UsageTerms":"Public Domain","http://purl.org/dc/terms/creator":"Ali, Pir Asmat;Maddison, Wayne P.;Zahid, Muhammad;Butt, Abida","http://purl.org/dc/terms/description":"<div><p> Menemerus nigli  Wesolowska &amp; Freudenschuss, 2012  Figs 5-13 </p><p>Notes.</p><p> This species was described by Wesołowska and Freudenschuss (2012)  based on a male from Baluchistan Province, Pakistan, and redescribed (also from the male) by Chatterjee et al. (2017) from India. In our collecting, we found a male matching M. nigli in close proximity and in similar habitat to a female of similar size and markings. As no other species of Menemerus has yet been collected from Pakistan, except the distinctly different M. bivittatus (Dufour, 1831) and M. marginatus (Kroneberg, 1875) ( Bauer et al. 2015 ), we interpret the female collected to be that of M. nigli . The female is described for the first time. </p><p>Description.</p><p> Male (from Pakistan: Khyber Paktunkhwa: Karak (Karak city), 33.11&deg;N , 71.08&deg;E , elev. 550 m, 29 July 2015, Pir Asmat Ali, specimen PAA#2015-07-081). Carapace length 2.72, width 2.06, height 1.12. Abdomen length 2.35, width 2.06. Palp as in the figures of Wesołowska and Freudenschuss (2012)  . Embolus longer than in most Menemerus species, curved. A membranous &quot;conductor&quot; beside the embolus leads to a membranous area that forms a groove separating the embolus from the tegulum. Tibial apophysis elongate and fairly thin, pointing somewhat ventrally (Figs 7-8). Prolateral side of tibia swollen ( Wesołowska and Freudenschuss 2012  , figure 6). Cymbium with short white setae; femur with long brown and white hairs. Body and face as in Figs 5-6. </p><p> Figures 5-13. Menemerus nigli . 5-8 male (PAA#2015-07-081). 5 face 6 dorsal view 7 left palp, ventral view 8 left palp, retrolateral view. 9-13 female (PAA#2015-07-086): 9 face 10 dorsal view 11 epigynum, ventral view 12 epigynum cleared, ventral view 13 copulatory ducts and spermathecae, dorsal view. Scale bars: 0.1 mm (7, 8, 10, 11). At = Atrium, F = fold in wall, CD = copulatory duct, FD = fertilization duct, Sp = spermatheca. Figures 5-13 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p> Female (from Pakistan: Khyber Paktunkhwa: Karak (Serekhawah), 33.27&deg;N , 71.21&deg;E , elev. 509 m., 29 July 2015, Pir Asmat Ali, specimen PAA#2015-07-086), Measurements: Carapace: length 2.82, width 2.06, height 1.31. Ocular area widest at AER; ocular area length 1.41, width of PLE row 1.59, width of PME row 1.50, AER width 1.76. Abdomen: length 3.76, width 2.16. Leg I: coxa 0.65, trochanter 0.47, femur 1.50, patella 0.84, tibia 1.03, metatarsus 0.75, tarsus 0.47. Leg II: coxa 0.56, trochanter 0.37, femur 1.31, patella 0.75, tibia 0.94, metatarsus 0.75, tarsus 0.37. Leg III: coxa 0.65, trochanter 0.37, femur 1.50, patella 1.08, tibia 1.22, metatarsus 0.47, tarsus 0.56. Leg IV: coxa 0.75, trochanter 0.37, femur 1.59, patella 0.84, tibia 1.41, metatarsus 1.12, tarsus 0.56. </p><p>Structure. Carapace flat in the cephalic region, dropping down to a lower thoracic area. Chelicerae stout, unidentate, with two promarginal teeth and long fangs. Posterior lateral spinnerets longer than others. Epigynum (Figs 11-13) with broad atria (Figure 11, &quot;At&quot;) opening toward the anterior, on the inner (dorsal) wall of which is a sharp fold (Figure 11, &quot;F&quot;), which may serve to guide the entrance of the embolus. The precise point at which the atrium becomes narrowed into the copulatory duct is unclear, but it appears that the path of the embolus (or sperm) would be toward the posterior initially in the broad atrium, then turning medially, and once at the midline then turning posteriorly, at that point clearly in the copulatory duct. Spermatheca touching at midline, overlapped. Fertilization duct long.</p><p>Colour (Figs 9). Carapace brown, with cephalic sides dark brown covered by brown and white bristles and a basal band of white hairs. Ocular area black with brown and white bristles. Face black with short and long white bristles; chelicera almost black. Sternum yellow-brown. Legs brown to yellowish brown, metatarsus and tarsus palest; leg I darkest. Dorsum of abdomen with indistinct brown to cream markings, in the anterior half forming a darker longitudinal medial band near the base flanked by two whitish bands, and in the posterior half having a medial whitish patch. Venter is grey with scattered white hairs. Spinnerets yellow.</p><p>Remarks.</p><p> The female of Menemerus nigli can be distinguished from other Menemerus species by the broad forward-opening atria from which extend distinctive folds (Figure 11, &quot;F&quot;). There are other species with broad atria that open more or less to the anterior, but in most the atria are less deep and more laterally-facing: Menemerus marginatus (Kroneberg, 1875) (see Bauer et al. 2015 ), Menemerus minshullaeWesołowska , 1999 (see Wesołowska 1999  ), and Menemerus rubicundus Lawrence, 1928 (see Wesołowska 1999  ). The epigynum of Menemerus namibicusWesołowska , 1999 is perhaps most similar to M. nigli , in that the atria face directly to the anterior, but they are not so spacious, and the distinctive fold of M. nigli is lacking ( Wesołowska 1999  ). </p></div>"}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/media.txt","rowType":"http://eol.org/schema/media/Document","http://purl.org/dc/terms/contributor":"Pensoft via Plazi","http://purl.org/dc/terms/language":"en","http://ns.adobe.com/xap/1.0/rights/Owner":null,"http://rs.tdwg.org/dwc/terms/taxonID":"738846FC302BC885A48DA787EB745D16.taxon","http://rs.tdwg.org/dwc/terms/additionalInformationURL":"http://treatment.plazi.org/id/738846FC302BC885A48DA787EB745D16","http://purl.org/dc/terms/format":"text/html","http://iptc.org/std/Iptc4xmpExt/1.0/xmlns/CVterm":"http://rs.tdwg.org/ontology/voc/SPMInfoItems#GeneralDescription","http://purl.org/dc/terms/rights":"No known copyright restrictions apply. See Agosti, D., Egloff, W., 2009. Taxonomic information exchange and copyright: the Plazi approach. BMC Research Notes 2009, 2:53 for further explanation.","http://purl.org/dc/terms/title":"Stenaelurillus mardanicus","http://purl.org/dc/terms/bibliographicCitation":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/type":"http://purl.org/dc/dcmitype/Text","http://purl.org/dc/terms/identifier":"738846FC302BC885A48DA787EB745D16.text","http://ns.adobe.com/xap/1.0/rights/UsageTerms":"Public Domain","http://purl.org/dc/terms/creator":"Ali, Pir Asmat;Maddison, Wayne P.;Zahid, Muhammad;Butt, Abida","http://purl.org/dc/terms/description":"<div><p>Stenaelurillus mardanicus Ali &amp; Maddisonsp. n. Figs 14-21, 22-26 </p><p>Holotype.</p><p> Male in UBC from Pakistan: Khyber Paktunkhwa: Mardan (Sarmalang), 34.374&deg;N , 72.372&deg;E , 1443 m elevation, 10 August 2016, Pir Asmat Ali, foothills of mountains (specimen PAA#2016-08-101). </p><p>Etymology.</p><p>Derived from the name of the district of the type locality.</p><p>Diagnosis.</p><p> The embolus of S. mardanicus is distinctive (Figs 18, 19), with a broad basal portion curving dorsally toward the cymbium then prolaterally, and a short terminal piece (with the opening) pointing distally. The embolus appears therefore as a hand, with the terminal piece like a thumb sticking up, and the basal portion like curved fingers. In ventral view, the base of the embolus appears as an embolar ledge (EL) (Figs 18, 19, 20, 21). An embolus of this shape is unique among known Stenaelurillus . Two species with a similar prolateral extension near the base of the embolus are S. triguttatus Simon 1886 from Nepal, and S. arambagensis (Biswas &amp; Biswas, 1992) from Pakistan, but in both of those species the extension points distally ( Wesołowska 2014a  ; Logunov and Azarkina 2018 ) and at least in S. arambagensis it is not part of the embolus, but rather of the functional tegulum ( Logunov and Azarkina 2018 : 20). The prolateral extension of S. mardanicus is clearly part of the embolic division (Figs 18, 19, 20). Stenaelurillus marusiki Logunov, 2001 also has an embolar ledge, but the embolus tip is much longer and narrower. Stenaelurillus gabrieli Prajapati, Murthappa, Sankaran &amp; Sebastian, 2016 from India also has a short distally-pointing embolus tip, but lacks the embolar ledge as in S. mardanicus . The epigynum of S. mardanicus resembles that of the African Stenaelurillus mirabilisWesołowska and Russell-Smith, 2000, with copulatory ducts relatively short, running from the small anteriorly-placed copulatory to join the spermathecae toward their posterior end (Figs 24, 25). S. mirabilis differs, however, in having a long pocket along the posterior margin ( Wesołowska and Russell-Smith 2000  ). </p><p> Figures 14-21. Stenaelurillus mardanicus sp. n., male paratype (specimen PAA#2015-07-154). 14 face 15 dorsal view 16 left palp, ventral view 17 left palp, retrolateral view 18 embolus of left palp, ventral view 19 embolus, dorsal view 20 embolus, retrolateral view 21 embolus, prolateral view. Scale bars: 0.1 mm. Abbreviations: E = embolus, El = embolar ledge. Figures 14-21 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p> Figures 22-26. Stenaelurillus mardanicus sp. n., Female paratypes (22 and 23 of specimen PAA#2016-08-120 24-26 of specimen PAA#2015-07-114), 22 body, dorsal view 23 face 24 epigynum, dorsal view 25 cleared epigynum, ventral view 26 cleared epigynum, dorsal view. Scale bars: 0.1 mm. Abbreviations: CO = copulatory opening, CD = copulatory duct, FD = fertilization duct, Sp = spermatheca. Figures 22-26 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p>Description.</p><p> Male (holotype and paratype PAA#2015-07-154, Pakistan: Khyber Paktunkhwa: Malakand, Palai 34.5353&deg;N , 72.0896&deg;E 841 m elev. 12 July 2015 Pir Asmat Ali; measurements from that paratype): Measurements. Carapace length 2.50, width 1.97. height 1.10. ocular area widest at AER; AE length 1.61, PME width 1.40, PLE 1.55. Abdomen length 1.79, width 1.48. Leg I: coxa 0.35, trochanter 0.30, femur 1.17, patella 0.35, tibia 0.55, metatarsus 0.50, tarsus 0.43. Leg II: coxa 0.43, trochanter 0.30, femur 1.05, patella 0.55; tibia 0.63; metatarsus 0.60; tarsus 0.41. Leg III: coxa 0.49; trochanter 0.51, femur 1.50, patella 0.65, tibia 0.92, metatarsus 1.31, tarsus 0.65. Leg IV: coxa 0.90, trochanter 0.41, femur 1.77, patella 0.74, tibia 1.34, metatarsus 1.31, tarsus 0.65. </p><p>Structure. Carapace elevated at cephalic region, sloping gently down in thoracic region then abruptly before the posterior margin. Cheliceral retromargin with one long tooth; promargin with two teeth. Leg I short. Abdomen square at anterior, widest at middle and narrowing toward anal tubercle. Palp tibia swollen and having two apophyses, ventral one (somewhat hidden) and the RTA. Cymbium wide at middle. Embolus as described in diagnosis, with a basal curved portion and a short, distally-pointing tip.</p><p>Colour. Carapace brown with black hairs except for a broad bands laterally along lower margin that are paler and with white hairs, and narrow longitudinal bands dorsally of white hairs just medial to the PLE and extending from PME to the thorax; brown recumbent hairs with black bristles in the ocular area. Lateral white bands extend onto clypeus, which is pale and with a mix of long white and some brown hairs. Chelicerae pale with long white hairs. Sternum pale; labium pale brown and paler anteriorly; maxilla pale brown; palp yellow; femur with long white hairs, cymbium brown and having black bristles and scales. First leg is darkest, with whitish yellow tarsus. Other legs pale with dark stains and black hairs, except ventral coxa of leg III and IV which are pale whitish. Front of abdomen square, with long grey bristles. Abdomen black above, with sub-basal transverse band of white hairs, and with three whitish pale spots: a pair near the middle and a single smaller posterior spot. Sides of abdomen with scattered pale hairs and black hairs. Venter pale with grey hairs. Spinnerets yellow with grey hairs.</p><p> Female (paratype, specimen PAA#2015-07-114, Pakistan: Khyber Paktunkhwa: Mardan (Baroch), 34.381&deg;N , 72.384&deg;E , elev. 1021 m elevation, 21 July 2015, Pir Asmat Ali, mountain edges): Measurements: Carapace length 2.63, width 2.03, height 1.30. Ocular area length 0.84, width 1.50, PLE width 1.50, PME width 1.41, AE 1.59. Abdomen length 2.63, width 1.88. Leg I: coxa 0.47, trochanter 0.37, femur 1.41, patella 0.65, tibia 0.65, metatarsus 0.37, tarsus 0.47. Leg II: coxa 0.47, trochanter 0.37, femur 1.12, patella 0.65, tibia 0.65, metatarsus 0.57, tarsus 0.37. Leg III: coxa 0.75, trochanter 0.55, femur 1.78, patella 0.74, tibia 1.22, metatarsus 1.41, tarsus 0.75. Leg IV: coxa 0.93, trochanter 0.47, femur 1.97, patella 0.84, tibia 1.50, metatarsus 1.41, tarsus 0.75. </p><p>Structure. Carapace elevated at cephalic region, sloping laterally and posteriorly in thoracic region. Chelicera with one long retromarginal tooth; promargin with two teeth. Leg I strong and short. Abdomen square at anterior, widening toward the posterior, then narrowing toward anal tubercle. Epigynum (Figs 24, 25) with a central pocket displaced slightly forward from the epigastric furrow. Copulatory openings are small, anterior. Copulatory ducts proceed from the openings toward the posterior to join the spermathecae, widening as they go. Spermathecae wide and round; fertilization ducts long and wide.</p><p>Colour. Carapace marked similarly to male: brown, with broad bands laterally along lower margin that are paler and with white hairs, and narrow longitudinal bands dorsally of white hairs just inside the PLE and extending from PME to the thorax. Ocular area black with recumbent brown hairs and bristles. Lateral white bands become narrower as they extend onto clypeus, which is pale and with a mix of white and brown long hairs. Chelicerae pale, with many white hairs and a few scattered black ones. All legs pale with dark markings and black hairs except ventral coxae of leg III and IV which are pale. Sternum pale; labium brown; maxillae pale brown with paler tips. Front of abdomen square, with long grey bristles. Abdomen black with a pair of white spots just posterior to the middle. Sides with pale band extending to the spinnerets. Venter pale yellow with scattered grey hairs. Spinnerets yellow with grey hairs.</p><p>Remark.</p><p>All observed females had epigynal plugs.</p><p>Habitat.</p><p>Specimens were found on mountain edges.</p><p>Additional material examined.</p><p> The following, all paratypes: Same data as holotype (female specimen PAA#2016-08-120, and 3 additional males); Pakistan: Khyber Paktunkhwa: Manzari baba (Malakand), 34.51&deg;N , 71.72&deg;E , elev. 2013 m, 13 July 2015, Pir Asmat Ali, mountain edges (1 female specimen PAA#2015-07-165); Pakistan: Khyber Paktunkhwa: Mardan, 34.354&deg;N , 72.382&deg;E , elev. 1430 m, 10 Aug 2016, Pir Asmat Ali (10 males, 2 females, 2 juveniles); Pakistan: Khyber Paktunkhwa: Alizai (Hangu), 33.58&deg;N , 71.28&deg;E , elev. 1678 m, 27 July 2015, Pir Asmat Ali, foothills of mountains (female specimen PAA#2015-07-087). </p></div>"}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt","rowType":"http://rs.gbif.org/terms/1.0/Description","http://purl.org/dc/terms/language":"en","http://rs.tdwg.org/dwc/terms/taxonID":"CBB79C7983DC6B47F04E48319A6820CF.taxon","http://purl.org/dc/terms/type":"etymology","http://purl.org/dc/terms/source":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/description":"Etymology. The name of the province of the type locality, treated as a noun in apposition."}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt","rowType":"http://rs.gbif.org/terms/1.0/Description","http://purl.org/dc/terms/language":"en","http://rs.tdwg.org/dwc/terms/taxonID":"CBB79C7983DC6B47F04E48319A6820CF.taxon","http://purl.org/dc/terms/type":"diagnosis","http://purl.org/dc/terms/source":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/description":"Diagnosis. Epocilla pakhtunkhwa is most similar to E. sirohi (Caleb et al. 2017 a) in having a long embolus curving retrolaterally, but differs in having an expanded flange near the tip of the embolus (lacking in E. sirohi; Caleb et al. 2017 a) and a narrower and deeper cleft between the embolus and tegulum. Two other species with a long embolus are E. aurantiaca and E. blairei, but these have an embolus that is sinuous, curving toward the retrolateral but then reversing the curve to point toward the tip of the cymbium (Proszynski 1984; Żabka 1985)."}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt","rowType":"http://rs.gbif.org/terms/1.0/Description","http://purl.org/dc/terms/language":"en","http://rs.tdwg.org/dwc/terms/taxonID":"CBB79C7983DC6B47F04E48319A6820CF.taxon","http://purl.org/dc/terms/type":"materials_examined","http://purl.org/dc/terms/source":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/description":"Additional material examined. One male paratype from Pakistan: Khyber Paktunkhwa: Malakand (Manzari Baba), 34.49 ° N, 71.71 ° E, 1613 m elevation, 13 July 2015, Pir Asmat Ali (specimen PAA # 2015 - 07 - 134)."}
{"contentId":"zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt","rowType":"http://rs.gbif.org/terms/1.0/Description","http://purl.org/dc/terms/language":"en","http://rs.tdwg.org/dwc/terms/taxonID":"738846FC302BC885A48DA787EB745D16.taxon","http://purl.org/dc/terms/type":"etymology","http://purl.org/dc/terms/source":"Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985","http://purl.org/dc/terms/description":"Etymology. Derived from the name of the district of the type locality."}

with

$ cat out.json | jq .
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/taxa.txt",
  "rowType": "http://rs.tdwg.org/dwc/terms/Taxon",
  "http://purl.org/dc/terms/references": "http://treatment.plazi.org/id/CBB79C7983DC6B47F04E48319A6820CF",
  "http://rs.tdwg.org/dwc/terms/originalNameUsageID": null,
  "http://rs.tdwg.org/dwc/terms/kingdom": "Animalia",
  "http://gbif.org/dwc/terms/1.0/canonicalName": "Epocilla pakhtunkhwa",
  "http://plazi.org/terms/1.0/combinationAuthors": null,
  "http://rs.tdwg.org/dwc/terms/taxonID": "CBB79C7983DC6B47F04E48319A6820CF.taxon",
  "http://rs.tdwg.org/dwc/terms/parentNameUsageID": null,
  "http://rs.tdwg.org/dwc/terms/order": "Epocilla",
  "http://rs.tdwg.org/dwc/terms/genus": "Epocilla",
  "http://rs.tdwg.org/dwc/terms/scientificNameAuthorship": null,
  "http://plazi.org/terms/1.0/verbatimScientificName": "Epocilla pakhtunkhwa Ali & Maddison",
  "http://rs.tdwg.org/dwc/terms/phylum": "Arthropoda",
  "http://rs.tdwg.org/dwc/terms/class": "Arachnida",
  "http://plazi.org/terms/1.0/combinationYear": null,
  "http://rs.tdwg.org/dwc/terms/taxonomicStatus": null,
  "http://rs.tdwg.org/dwc/terms/acceptedNameUsageID": null,
  "http://plazi.org/terms/1.0/basionymAuthors": null,
  "http://rs.tdwg.org/dwc/terms/scientificName": "Epocilla pakhtunkhwa",
  "http://rs.tdwg.org/dwc/terms/nomenclaturalStatus": null,
  "http://rs.tdwg.org/dwc/terms/namePublishedIn": null,
  "http://plazi.org/terms/1.0/basionymYear": null,
  "http://rs.tdwg.org/dwc/terms/family": "Salticidae",
  "http://rs.tdwg.org/dwc/terms/taxonRank": "species"
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/taxa.txt",
  "rowType": "http://rs.tdwg.org/dwc/terms/Taxon",
  "http://purl.org/dc/terms/references": "http://treatment.plazi.org/id/8F2BFEE188BACD1699A3588473B2181E",
  "http://rs.tdwg.org/dwc/terms/originalNameUsageID": null,
  "http://rs.tdwg.org/dwc/terms/kingdom": "Animalia",
  "http://gbif.org/dwc/terms/1.0/canonicalName": "Menemerus nigli",
  "http://plazi.org/terms/1.0/combinationAuthors": "Wesolowska & Freudenschuss",
  "http://rs.tdwg.org/dwc/terms/taxonID": "8F2BFEE188BACD1699A3588473B2181E.taxon",
  "http://rs.tdwg.org/dwc/terms/parentNameUsageID": null,
  "http://rs.tdwg.org/dwc/terms/order": "Araneae",
  "http://rs.tdwg.org/dwc/terms/genus": "Menemerus",
  "http://rs.tdwg.org/dwc/terms/scientificNameAuthorship": "Wesolowska & Freudenschuss 2012",
  "http://plazi.org/terms/1.0/verbatimScientificName": "Menemerus nigli Wesolowska & Freudenschuss, 2012",
  "http://rs.tdwg.org/dwc/terms/phylum": "Arthropoda",
  "http://rs.tdwg.org/dwc/terms/class": "Arachnida",
  "http://plazi.org/terms/1.0/combinationYear": "2012",
  "http://rs.tdwg.org/dwc/terms/taxonomicStatus": null,
  "http://rs.tdwg.org/dwc/terms/acceptedNameUsageID": null,
  "http://plazi.org/terms/1.0/basionymAuthors": null,
  "http://rs.tdwg.org/dwc/terms/scientificName": "Menemerus nigli Wesolowska & Freudenschuss 2012",
  "http://rs.tdwg.org/dwc/terms/nomenclaturalStatus": null,
  "http://rs.tdwg.org/dwc/terms/namePublishedIn": null,
  "http://plazi.org/terms/1.0/basionymYear": null,
  "http://rs.tdwg.org/dwc/terms/family": "Salticidae",
  "http://rs.tdwg.org/dwc/terms/taxonRank": "species"
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/taxa.txt",
  "rowType": "http://rs.tdwg.org/dwc/terms/Taxon",
  "http://purl.org/dc/terms/references": "http://treatment.plazi.org/id/738846FC302BC885A48DA787EB745D16",
  "http://rs.tdwg.org/dwc/terms/originalNameUsageID": null,
  "http://rs.tdwg.org/dwc/terms/kingdom": "Animalia",
  "http://gbif.org/dwc/terms/1.0/canonicalName": "Stenaelurillus mardanicus",
  "http://plazi.org/terms/1.0/combinationAuthors": null,
  "http://rs.tdwg.org/dwc/terms/taxonID": "738846FC302BC885A48DA787EB745D16.taxon",
  "http://rs.tdwg.org/dwc/terms/parentNameUsageID": null,
  "http://rs.tdwg.org/dwc/terms/order": "Araneae",
  "http://rs.tdwg.org/dwc/terms/genus": "Stenaelurillus",
  "http://rs.tdwg.org/dwc/terms/scientificNameAuthorship": null,
  "http://plazi.org/terms/1.0/verbatimScientificName": "Stenaelurillus mardanicus Ali & Maddison",
  "http://rs.tdwg.org/dwc/terms/phylum": "Arthropoda",
  "http://rs.tdwg.org/dwc/terms/class": "Arachnida",
  "http://plazi.org/terms/1.0/combinationYear": null,
  "http://rs.tdwg.org/dwc/terms/taxonomicStatus": null,
  "http://rs.tdwg.org/dwc/terms/acceptedNameUsageID": null,
  "http://plazi.org/terms/1.0/basionymAuthors": null,
  "http://rs.tdwg.org/dwc/terms/scientificName": "Stenaelurillus mardanicus",
  "http://rs.tdwg.org/dwc/terms/nomenclaturalStatus": null,
  "http://rs.tdwg.org/dwc/terms/namePublishedIn": null,
  "http://plazi.org/terms/1.0/basionymYear": null,
  "http://rs.tdwg.org/dwc/terms/family": "Salticidae",
  "http://rs.tdwg.org/dwc/terms/taxonRank": "species"
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/media.txt",
  "rowType": "http://eol.org/schema/media/Document",
  "http://purl.org/dc/terms/contributor": "Pensoft via Plazi",
  "http://purl.org/dc/terms/language": "en",
  "http://ns.adobe.com/xap/1.0/rights/Owner": null,
  "http://rs.tdwg.org/dwc/terms/taxonID": "CBB79C7983DC6B47F04E48319A6820CF.taxon",
  "http://rs.tdwg.org/dwc/terms/additionalInformationURL": "http://treatment.plazi.org/id/CBB79C7983DC6B47F04E48319A6820CF",
  "http://purl.org/dc/terms/format": "text/html",
  "http://iptc.org/std/Iptc4xmpExt/1.0/xmlns/CVterm": "http://rs.tdwg.org/ontology/voc/SPMInfoItems#GeneralDescription",
  "http://purl.org/dc/terms/rights": "No known copyright restrictions apply. See Agosti, D., Egloff, W., 2009. Taxonomic information exchange and copyright: the Plazi approach. BMC Research Notes 2009, 2:53 for further explanation.",
  "http://purl.org/dc/terms/title": "Epocilla pakhtunkhwa",
  "http://purl.org/dc/terms/bibliographicCitation": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/type": "http://purl.org/dc/dcmitype/Text",
  "http://purl.org/dc/terms/identifier": "CBB79C7983DC6B47F04E48319A6820CF.text",
  "http://ns.adobe.com/xap/1.0/rights/UsageTerms": "Public Domain",
  "http://purl.org/dc/terms/creator": "Ali, Pir Asmat;Maddison, Wayne P.;Zahid, Muhammad;Butt, Abida",
  "http://purl.org/dc/terms/description": "<div><p>Epocilla pakhtunkhwa Ali &amp; Maddisonsp. n. Figs 1-4 </p><p>Holotype.</p><p> Male in UBC from Pakistan: Khyber Paktunkhwa: Malakand (Agra), 34.589&deg;N , 71.713&deg;E , 2500 m elevation, 7 July 2015, Pir Asmat Ali, from maize crop fields (specimen PAA#2015-07-146). </p><p>Etymology.</p><p>The name of the province of the type locality, treated as a noun in apposition.</p><p>Diagnosis.</p><p>Epocilla pakhtunkhwa is most similar to E. sirohi ( Caleb et al. 2017a ) in having a long embolus curving retrolaterally, but differs in having an expanded flange near the tip of the embolus (lacking in E. sirohi ; Caleb et al. 2017a ) and a narrower and deeper cleft between the embolus and tegulum. Two other species with a long embolus are E. aurantiaca and E. blairei , but these have an embolus that is sinuous, curving toward the retrolateral but then reversing the curve to point toward the tip of the cymbium ( Pr&oacute;szyński 1984  ; Żabka 1985  ). </p><p>Description.</p><p>Male (holotype): Measurements. Carapace length 2.63, width 2.35, height 1.50. Ocular area widest at AER; length 1.31, width of PLE row 1.54, width of PME row 1.50, AER width 1.59. Abdomen length 3.95, width 1.16. Leg I: coxa 0.94, trochanter 0.56, femur 2.06, patella 1.41, tibia 1.69, metatarsus 1.50, tarsus 0.56. Leg II: coxa 0.75, trochanter 0.27, femur 1.88, patella, 0.86; tibia, 1.69; metatarsus, 1.43, tarsus, 0.56. Leg III: coxa 0.75, trochanter 0.37, femur 1.88, patella 0.84, tibia 1.22, metatarsus 1.41, tarsus 0.75. Leg IV: coxa 0.93, trochanter 0.47, femur 1.97, patella 0.84, tibia 1.50, metatarsus 1.41, tarsus 0.75.</p><p> Structure. Ocular area with a distinct integumental bump in front of the fovea and between the PLE (Figure 1, triangle). Carapace sides extend laterally with gentle slope in thoracic and cephalic regions, making the thoracic area broad. Posterior to fovea, thoracic area slopes gently before sloping more abruptly near back margin. Chelicera with one simple retromarginal tooth and 2 promarginal teeth; basal segment more or less vertical, relatively long, narrowing toward the tip but then expanding just before the fang (Figure 1). Palp tibia swollen retrolaterally, with dual apophysis as typical of Epocilla . The more prolateral of these is the RTA itself, somewhat hidden (Figs 3, 4, &quot;RTA&quot;). End of cymbium fairly wide, blunt. Embolus long, with an expanded flange near the tip, though the tip itself is narrow and curves slightly toward the ventral. Leg I stout, with tibia ventrally having 4 pairs of macrosetae, the anterior of each of which is much larger. Abdomen squared at the anterior margin, somewhat cone-shaped to the posterior. </p><p> Figures 1-4. Epocilla pakhtunkhwa Ali &amp; Maddison, sp. n., male holotype (PAA#2015-07-146). 1 face 2 dorsal view 3 left palp, ventral view 4 left palp, retrolateral view. Scale bar: 0.1 mm (3, 4). Abbreviations: B = bump on tegulum, RTA = retrolateral tibial apophysis. Figures 1-4 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p>Colour. Carapace edges are dark brown, above which are broad lateral bands of yellow white scales extending from beneath the ALE on the clypeus to the posterior edge and lying over orange-brown integument. Centrally the thoracic region is reddish brown with a medial paler area, with traces of brown hairs and scales present. Ocular area black to dark brown, with fringe of orange hairs at front extending over the AER, appearing from the front as two eyebrows. Posterior to that is a patch of white scales centrally in the ocular area, surrounded by darker scales. Clypeus dark brown below AME, having a few orange hairs, contrasting strongly with white scales under ALE that belong to the lateral carapace bands. Chelicerae yellowish brown near fangs, darker brown otherwise. Palp coxa and trochanter light brown; femur, patella and tibia paler orange-yellow; cymbium brown with orange-yellow tip. Sternum whitish yellow with edges brown. Leg I medium brown except for a much darker longitudinal brown band along the prolateral side of the coxa, trochanter and femur, a lighter patch on the tibia, and pale yellow-white metatarsus and tarsus. Legs II, III, IV pale yellow-white. Abdomen longitudinally striped, with wide brown band running medially, lateral to which is a band of yellow-white scales, lateral and ventral to which are reflective transparent or grey scales. Spinnerets are yellow-brown with grey hairs.</p><p>Female: unknown.</p><p>Habitat.</p><p>Specimens were collected by hand picking from maize, both living and cut, in maize fields.</p><p>Additional material examined.</p><p> One male paratype from Pakistan: Khyber Paktunkhwa: Malakand (Manzari Baba), 34.49&deg;N , 71.71&deg;E , 1613 m elevation, 13 July 2015, Pir Asmat Ali (specimen PAA#2015-07-134). </p></div>"
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/media.txt",
  "rowType": "http://eol.org/schema/media/Document",
  "http://purl.org/dc/terms/contributor": "Pensoft via Plazi",
  "http://purl.org/dc/terms/language": "en",
  "http://ns.adobe.com/xap/1.0/rights/Owner": null,
  "http://rs.tdwg.org/dwc/terms/taxonID": "8F2BFEE188BACD1699A3588473B2181E.taxon",
  "http://rs.tdwg.org/dwc/terms/additionalInformationURL": "http://treatment.plazi.org/id/8F2BFEE188BACD1699A3588473B2181E",
  "http://purl.org/dc/terms/format": "text/html",
  "http://iptc.org/std/Iptc4xmpExt/1.0/xmlns/CVterm": "http://rs.tdwg.org/ontology/voc/SPMInfoItems#GeneralDescription",
  "http://purl.org/dc/terms/rights": "No known copyright restrictions apply. See Agosti, D., Egloff, W., 2009. Taxonomic information exchange and copyright: the Plazi approach. BMC Research Notes 2009, 2:53 for further explanation.",
  "http://purl.org/dc/terms/title": "Menemerus nigli Wesolowska & Freudenschuss 2012",
  "http://purl.org/dc/terms/bibliographicCitation": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/type": "http://purl.org/dc/dcmitype/Text",
  "http://purl.org/dc/terms/identifier": "8F2BFEE188BACD1699A3588473B2181E.text",
  "http://ns.adobe.com/xap/1.0/rights/UsageTerms": "Public Domain",
  "http://purl.org/dc/terms/creator": "Ali, Pir Asmat;Maddison, Wayne P.;Zahid, Muhammad;Butt, Abida",
  "http://purl.org/dc/terms/description": "<div><p> Menemerus nigli  Wesolowska &amp; Freudenschuss, 2012  Figs 5-13 </p><p>Notes.</p><p> This species was described by Wesołowska and Freudenschuss (2012)  based on a male from Baluchistan Province, Pakistan, and redescribed (also from the male) by Chatterjee et al. (2017) from India. In our collecting, we found a male matching M. nigli in close proximity and in similar habitat to a female of similar size and markings. As no other species of Menemerus has yet been collected from Pakistan, except the distinctly different M. bivittatus (Dufour, 1831) and M. marginatus (Kroneberg, 1875) ( Bauer et al. 2015 ), we interpret the female collected to be that of M. nigli . The female is described for the first time. </p><p>Description.</p><p> Male (from Pakistan: Khyber Paktunkhwa: Karak (Karak city), 33.11&deg;N , 71.08&deg;E , elev. 550 m, 29 July 2015, Pir Asmat Ali, specimen PAA#2015-07-081). Carapace length 2.72, width 2.06, height 1.12. Abdomen length 2.35, width 2.06. Palp as in the figures of Wesołowska and Freudenschuss (2012)  . Embolus longer than in most Menemerus species, curved. A membranous &quot;conductor&quot; beside the embolus leads to a membranous area that forms a groove separating the embolus from the tegulum. Tibial apophysis elongate and fairly thin, pointing somewhat ventrally (Figs 7-8). Prolateral side of tibia swollen ( Wesołowska and Freudenschuss 2012  , figure 6). Cymbium with short white setae; femur with long brown and white hairs. Body and face as in Figs 5-6. </p><p> Figures 5-13. Menemerus nigli . 5-8 male (PAA#2015-07-081). 5 face 6 dorsal view 7 left palp, ventral view 8 left palp, retrolateral view. 9-13 female (PAA#2015-07-086): 9 face 10 dorsal view 11 epigynum, ventral view 12 epigynum cleared, ventral view 13 copulatory ducts and spermathecae, dorsal view. Scale bars: 0.1 mm (7, 8, 10, 11). At = Atrium, F = fold in wall, CD = copulatory duct, FD = fertilization duct, Sp = spermatheca. Figures 5-13 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p> Female (from Pakistan: Khyber Paktunkhwa: Karak (Serekhawah), 33.27&deg;N , 71.21&deg;E , elev. 509 m., 29 July 2015, Pir Asmat Ali, specimen PAA#2015-07-086), Measurements: Carapace: length 2.82, width 2.06, height 1.31. Ocular area widest at AER; ocular area length 1.41, width of PLE row 1.59, width of PME row 1.50, AER width 1.76. Abdomen: length 3.76, width 2.16. Leg I: coxa 0.65, trochanter 0.47, femur 1.50, patella 0.84, tibia 1.03, metatarsus 0.75, tarsus 0.47. Leg II: coxa 0.56, trochanter 0.37, femur 1.31, patella 0.75, tibia 0.94, metatarsus 0.75, tarsus 0.37. Leg III: coxa 0.65, trochanter 0.37, femur 1.50, patella 1.08, tibia 1.22, metatarsus 0.47, tarsus 0.56. Leg IV: coxa 0.75, trochanter 0.37, femur 1.59, patella 0.84, tibia 1.41, metatarsus 1.12, tarsus 0.56. </p><p>Structure. Carapace flat in the cephalic region, dropping down to a lower thoracic area. Chelicerae stout, unidentate, with two promarginal teeth and long fangs. Posterior lateral spinnerets longer than others. Epigynum (Figs 11-13) with broad atria (Figure 11, &quot;At&quot;) opening toward the anterior, on the inner (dorsal) wall of which is a sharp fold (Figure 11, &quot;F&quot;), which may serve to guide the entrance of the embolus. The precise point at which the atrium becomes narrowed into the copulatory duct is unclear, but it appears that the path of the embolus (or sperm) would be toward the posterior initially in the broad atrium, then turning medially, and once at the midline then turning posteriorly, at that point clearly in the copulatory duct. Spermatheca touching at midline, overlapped. Fertilization duct long.</p><p>Colour (Figs 9). Carapace brown, with cephalic sides dark brown covered by brown and white bristles and a basal band of white hairs. Ocular area black with brown and white bristles. Face black with short and long white bristles; chelicera almost black. Sternum yellow-brown. Legs brown to yellowish brown, metatarsus and tarsus palest; leg I darkest. Dorsum of abdomen with indistinct brown to cream markings, in the anterior half forming a darker longitudinal medial band near the base flanked by two whitish bands, and in the posterior half having a medial whitish patch. Venter is grey with scattered white hairs. Spinnerets yellow.</p><p>Remarks.</p><p> The female of Menemerus nigli can be distinguished from other Menemerus species by the broad forward-opening atria from which extend distinctive folds (Figure 11, &quot;F&quot;). There are other species with broad atria that open more or less to the anterior, but in most the atria are less deep and more laterally-facing: Menemerus marginatus (Kroneberg, 1875) (see Bauer et al. 2015 ), Menemerus minshullaeWesołowska , 1999 (see Wesołowska 1999  ), and Menemerus rubicundus Lawrence, 1928 (see Wesołowska 1999  ). The epigynum of Menemerus namibicusWesołowska , 1999 is perhaps most similar to M. nigli , in that the atria face directly to the anterior, but they are not so spacious, and the distinctive fold of M. nigli is lacking ( Wesołowska 1999  ). </p></div>"
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/media.txt",
  "rowType": "http://eol.org/schema/media/Document",
  "http://purl.org/dc/terms/contributor": "Pensoft via Plazi",
  "http://purl.org/dc/terms/language": "en",
  "http://ns.adobe.com/xap/1.0/rights/Owner": null,
  "http://rs.tdwg.org/dwc/terms/taxonID": "738846FC302BC885A48DA787EB745D16.taxon",
  "http://rs.tdwg.org/dwc/terms/additionalInformationURL": "http://treatment.plazi.org/id/738846FC302BC885A48DA787EB745D16",
  "http://purl.org/dc/terms/format": "text/html",
  "http://iptc.org/std/Iptc4xmpExt/1.0/xmlns/CVterm": "http://rs.tdwg.org/ontology/voc/SPMInfoItems#GeneralDescription",
  "http://purl.org/dc/terms/rights": "No known copyright restrictions apply. See Agosti, D., Egloff, W., 2009. Taxonomic information exchange and copyright: the Plazi approach. BMC Research Notes 2009, 2:53 for further explanation.",
  "http://purl.org/dc/terms/title": "Stenaelurillus mardanicus",
  "http://purl.org/dc/terms/bibliographicCitation": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/type": "http://purl.org/dc/dcmitype/Text",
  "http://purl.org/dc/terms/identifier": "738846FC302BC885A48DA787EB745D16.text",
  "http://ns.adobe.com/xap/1.0/rights/UsageTerms": "Public Domain",
  "http://purl.org/dc/terms/creator": "Ali, Pir Asmat;Maddison, Wayne P.;Zahid, Muhammad;Butt, Abida",
  "http://purl.org/dc/terms/description": "<div><p>Stenaelurillus mardanicus Ali &amp; Maddisonsp. n. Figs 14-21, 22-26 </p><p>Holotype.</p><p> Male in UBC from Pakistan: Khyber Paktunkhwa: Mardan (Sarmalang), 34.374&deg;N , 72.372&deg;E , 1443 m elevation, 10 August 2016, Pir Asmat Ali, foothills of mountains (specimen PAA#2016-08-101). </p><p>Etymology.</p><p>Derived from the name of the district of the type locality.</p><p>Diagnosis.</p><p> The embolus of S. mardanicus is distinctive (Figs 18, 19), with a broad basal portion curving dorsally toward the cymbium then prolaterally, and a short terminal piece (with the opening) pointing distally. The embolus appears therefore as a hand, with the terminal piece like a thumb sticking up, and the basal portion like curved fingers. In ventral view, the base of the embolus appears as an embolar ledge (EL) (Figs 18, 19, 20, 21). An embolus of this shape is unique among known Stenaelurillus . Two species with a similar prolateral extension near the base of the embolus are S. triguttatus Simon 1886 from Nepal, and S. arambagensis (Biswas &amp; Biswas, 1992) from Pakistan, but in both of those species the extension points distally ( Wesołowska 2014a  ; Logunov and Azarkina 2018 ) and at least in S. arambagensis it is not part of the embolus, but rather of the functional tegulum ( Logunov and Azarkina 2018 : 20). The prolateral extension of S. mardanicus is clearly part of the embolic division (Figs 18, 19, 20). Stenaelurillus marusiki Logunov, 2001 also has an embolar ledge, but the embolus tip is much longer and narrower. Stenaelurillus gabrieli Prajapati, Murthappa, Sankaran &amp; Sebastian, 2016 from India also has a short distally-pointing embolus tip, but lacks the embolar ledge as in S. mardanicus . The epigynum of S. mardanicus resembles that of the African Stenaelurillus mirabilisWesołowska and Russell-Smith, 2000, with copulatory ducts relatively short, running from the small anteriorly-placed copulatory to join the spermathecae toward their posterior end (Figs 24, 25). S. mirabilis differs, however, in having a long pocket along the posterior margin ( Wesołowska and Russell-Smith 2000  ). </p><p> Figures 14-21. Stenaelurillus mardanicus sp. n., male paratype (specimen PAA#2015-07-154). 14 face 15 dorsal view 16 left palp, ventral view 17 left palp, retrolateral view 18 embolus of left palp, ventral view 19 embolus, dorsal view 20 embolus, retrolateral view 21 embolus, prolateral view. Scale bars: 0.1 mm. Abbreviations: E = embolus, El = embolar ledge. Figures 14-21 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p> Figures 22-26. Stenaelurillus mardanicus sp. n., Female paratypes (22 and 23 of specimen PAA#2016-08-120 24-26 of specimen PAA#2015-07-114), 22 body, dorsal view 23 face 24 epigynum, dorsal view 25 cleared epigynum, ventral view 26 cleared epigynum, dorsal view. Scale bars: 0.1 mm. Abbreviations: CO = copulatory opening, CD = copulatory duct, FD = fertilization duct, Sp = spermatheca. Figures 22-26 are copyright &copy;2017 Pir Asmat Ali and Wayne Maddison, released under a Creative Commons Attribution (CC-BY) 3.0 license. </p><p>Description.</p><p> Male (holotype and paratype PAA#2015-07-154, Pakistan: Khyber Paktunkhwa: Malakand, Palai 34.5353&deg;N , 72.0896&deg;E 841 m elev. 12 July 2015 Pir Asmat Ali; measurements from that paratype): Measurements. Carapace length 2.50, width 1.97. height 1.10. ocular area widest at AER; AE length 1.61, PME width 1.40, PLE 1.55. Abdomen length 1.79, width 1.48. Leg I: coxa 0.35, trochanter 0.30, femur 1.17, patella 0.35, tibia 0.55, metatarsus 0.50, tarsus 0.43. Leg II: coxa 0.43, trochanter 0.30, femur 1.05, patella 0.55; tibia 0.63; metatarsus 0.60; tarsus 0.41. Leg III: coxa 0.49; trochanter 0.51, femur 1.50, patella 0.65, tibia 0.92, metatarsus 1.31, tarsus 0.65. Leg IV: coxa 0.90, trochanter 0.41, femur 1.77, patella 0.74, tibia 1.34, metatarsus 1.31, tarsus 0.65. </p><p>Structure. Carapace elevated at cephalic region, sloping gently down in thoracic region then abruptly before the posterior margin. Cheliceral retromargin with one long tooth; promargin with two teeth. Leg I short. Abdomen square at anterior, widest at middle and narrowing toward anal tubercle. Palp tibia swollen and having two apophyses, ventral one (somewhat hidden) and the RTA. Cymbium wide at middle. Embolus as described in diagnosis, with a basal curved portion and a short, distally-pointing tip.</p><p>Colour. Carapace brown with black hairs except for a broad bands laterally along lower margin that are paler and with white hairs, and narrow longitudinal bands dorsally of white hairs just medial to the PLE and extending from PME to the thorax; brown recumbent hairs with black bristles in the ocular area. Lateral white bands extend onto clypeus, which is pale and with a mix of long white and some brown hairs. Chelicerae pale with long white hairs. Sternum pale; labium pale brown and paler anteriorly; maxilla pale brown; palp yellow; femur with long white hairs, cymbium brown and having black bristles and scales. First leg is darkest, with whitish yellow tarsus. Other legs pale with dark stains and black hairs, except ventral coxa of leg III and IV which are pale whitish. Front of abdomen square, with long grey bristles. Abdomen black above, with sub-basal transverse band of white hairs, and with three whitish pale spots: a pair near the middle and a single smaller posterior spot. Sides of abdomen with scattered pale hairs and black hairs. Venter pale with grey hairs. Spinnerets yellow with grey hairs.</p><p> Female (paratype, specimen PAA#2015-07-114, Pakistan: Khyber Paktunkhwa: Mardan (Baroch), 34.381&deg;N , 72.384&deg;E , elev. 1021 m elevation, 21 July 2015, Pir Asmat Ali, mountain edges): Measurements: Carapace length 2.63, width 2.03, height 1.30. Ocular area length 0.84, width 1.50, PLE width 1.50, PME width 1.41, AE 1.59. Abdomen length 2.63, width 1.88. Leg I: coxa 0.47, trochanter 0.37, femur 1.41, patella 0.65, tibia 0.65, metatarsus 0.37, tarsus 0.47. Leg II: coxa 0.47, trochanter 0.37, femur 1.12, patella 0.65, tibia 0.65, metatarsus 0.57, tarsus 0.37. Leg III: coxa 0.75, trochanter 0.55, femur 1.78, patella 0.74, tibia 1.22, metatarsus 1.41, tarsus 0.75. Leg IV: coxa 0.93, trochanter 0.47, femur 1.97, patella 0.84, tibia 1.50, metatarsus 1.41, tarsus 0.75. </p><p>Structure. Carapace elevated at cephalic region, sloping laterally and posteriorly in thoracic region. Chelicera with one long retromarginal tooth; promargin with two teeth. Leg I strong and short. Abdomen square at anterior, widening toward the posterior, then narrowing toward anal tubercle. Epigynum (Figs 24, 25) with a central pocket displaced slightly forward from the epigastric furrow. Copulatory openings are small, anterior. Copulatory ducts proceed from the openings toward the posterior to join the spermathecae, widening as they go. Spermathecae wide and round; fertilization ducts long and wide.</p><p>Colour. Carapace marked similarly to male: brown, with broad bands laterally along lower margin that are paler and with white hairs, and narrow longitudinal bands dorsally of white hairs just inside the PLE and extending from PME to the thorax. Ocular area black with recumbent brown hairs and bristles. Lateral white bands become narrower as they extend onto clypeus, which is pale and with a mix of white and brown long hairs. Chelicerae pale, with many white hairs and a few scattered black ones. All legs pale with dark markings and black hairs except ventral coxae of leg III and IV which are pale. Sternum pale; labium brown; maxillae pale brown with paler tips. Front of abdomen square, with long grey bristles. Abdomen black with a pair of white spots just posterior to the middle. Sides with pale band extending to the spinnerets. Venter pale yellow with scattered grey hairs. Spinnerets yellow with grey hairs.</p><p>Remark.</p><p>All observed females had epigynal plugs.</p><p>Habitat.</p><p>Specimens were found on mountain edges.</p><p>Additional material examined.</p><p> The following, all paratypes: Same data as holotype (female specimen PAA#2016-08-120, and 3 additional males); Pakistan: Khyber Paktunkhwa: Manzari baba (Malakand), 34.51&deg;N , 71.72&deg;E , elev. 2013 m, 13 July 2015, Pir Asmat Ali, mountain edges (1 female specimen PAA#2015-07-165); Pakistan: Khyber Paktunkhwa: Mardan, 34.354&deg;N , 72.382&deg;E , elev. 1430 m, 10 Aug 2016, Pir Asmat Ali (10 males, 2 females, 2 juveniles); Pakistan: Khyber Paktunkhwa: Alizai (Hangu), 33.58&deg;N , 71.28&deg;E , elev. 1678 m, 27 July 2015, Pir Asmat Ali, foothills of mountains (female specimen PAA#2015-07-087). </p></div>"
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt",
  "rowType": "http://rs.gbif.org/terms/1.0/Description",
  "http://purl.org/dc/terms/language": "en",
  "http://rs.tdwg.org/dwc/terms/taxonID": "CBB79C7983DC6B47F04E48319A6820CF.taxon",
  "http://purl.org/dc/terms/type": "etymology",
  "http://purl.org/dc/terms/source": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/description": "Etymology. The name of the province of the type locality, treated as a noun in apposition."
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt",
  "rowType": "http://rs.gbif.org/terms/1.0/Description",
  "http://purl.org/dc/terms/language": "en",
  "http://rs.tdwg.org/dwc/terms/taxonID": "CBB79C7983DC6B47F04E48319A6820CF.taxon",
  "http://purl.org/dc/terms/type": "diagnosis",
  "http://purl.org/dc/terms/source": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/description": "Diagnosis. Epocilla pakhtunkhwa is most similar to E. sirohi (Caleb et al. 2017 a) in having a long embolus curving retrolaterally, but differs in having an expanded flange near the tip of the embolus (lacking in E. sirohi; Caleb et al. 2017 a) and a narrower and deeper cleft between the embolus and tegulum. Two other species with a long embolus are E. aurantiaca and E. blairei, but these have an embolus that is sinuous, curving toward the retrolateral but then reversing the curve to point toward the tip of the cymbium (Proszynski 1984; Żabka 1985)."
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt",
  "rowType": "http://rs.gbif.org/terms/1.0/Description",
  "http://purl.org/dc/terms/language": "en",
  "http://rs.tdwg.org/dwc/terms/taxonID": "CBB79C7983DC6B47F04E48319A6820CF.taxon",
  "http://purl.org/dc/terms/type": "materials_examined",
  "http://purl.org/dc/terms/source": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/description": "Additional material examined. One male paratype from Pakistan: Khyber Paktunkhwa: Malakand (Manzari Baba), 34.49 ° N, 71.71 ° E, 1613 m elevation, 13 July 2015, Pir Asmat Ali (specimen PAA # 2015 - 07 - 134)."
}
{
  "contentId": "zip:hash://sha256/8799c41e5d54fdc1ed07fbf30b9d5f67d2f30ff1ffa7430da9c043084e617c48!/description.txt",
  "rowType": "http://rs.gbif.org/terms/1.0/Description",
  "http://purl.org/dc/terms/language": "en",
  "http://rs.tdwg.org/dwc/terms/taxonID": "738846FC302BC885A48DA787EB745D16.taxon",
  "http://purl.org/dc/terms/type": "etymology",
  "http://purl.org/dc/terms/source": "Ali, Pir Asmat, Maddison, Wayne P., Zahid, Muhammad, Butt, Abida (2018): New chrysilline and aelurilline jumping spiders from Pakistan (Araneae, Salticidae). ZooKeys 783: 1-15, DOI: http://dx.doi.org/10.3897/zookeys.783.21985, URL: http://dx.doi.org/10.3897/zookeys.783.21985",
  "http://purl.org/dc/terms/description": "Etymology. Derived from the name of the district of the type locality."
}

jhpoelen commented 2 years ago

This enables streaming of all of GBIF by saying:

$ preston ls --remote https://deeplinker.bio | preston dwc-stream | gzip > gbif.json.gz

where all.json.gz is a giant super huge file with all records.

jhpoelen commented 2 years ago

Some more specific examples -

extract all scientificNames

preston ls --remote https://raw.githubusercontent.com/bio-guoda/preston-amazon/master/data/\
 | preston dwc-stream --remote https://raw.githubusercontent.com/bio-guoda/preston-amazon/master/data/\
 | jq --raw-output '.["http://rs.tdwg.org/dwc/terms/scientificName"]'\
 | grep -v null\
 > names.txt

with names.txt attached.

top 10 names.txt

$ head names.txt 
Chalceus guaporensis Zanata & Toledo-Piza 2004
Acestrorhynchus gr. lacustris (Lütken 1875)
Acestrorhynchus microlepis (Jardine 1841)
Laemolyta proxima (Garman 1890)
Pseudanos trimaculatus (Kner 1858)
Schizodon fasciatus Spix & Agassiz 1829
Cynopotamus gouldingi Menezes 1987
Moenkhausia lepidura (Kner 1858)
Tetragonopterus argenteus Cuvier 1816
Astyanax abramis (Jenyns 1842)

names.txt

then combine with Nomer or other taxonomic name matching tools to do name alignment .

jhpoelen commented 2 years ago

generating names and their associated exact locations of their original source

preston ls --remote https://raw.githubusercontent.com/bio-guoda/preston-amazon/master/data/\
 | preston dwc-stream --remote https://raw.githubusercontent.com/bio-guoda/preston-amazon/master/data/\
 | jq -c '. | select(has("http://rs.tdwg.org/dwc/terms/scientificName")) | { "http://rs.tdwg.org/dwc/terms/scientificName": ."http://rs.tdwg.org/dwc/terms/scientificName", contentId: .contentId } ' | head
{"http://rs.tdwg.org/dwc/terms/scientificName":"Chalceus guaporensis Zanata & Toledo-Piza 2004","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L2"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Acestrorhynchus gr. lacustris (Lütken 1875)","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L3"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Acestrorhynchus microlepis (Jardine 1841)","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L4"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Laemolyta proxima (Garman 1890)","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L5"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Pseudanos trimaculatus (Kner 1858)","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L6"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Schizodon fasciatus Spix & Agassiz 1829","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L7"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Cynopotamus gouldingi Menezes 1987","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L8"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Moenkhausia lepidura (Kner 1858)","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L9"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Tetragonopterus argenteus Cuvier 1816","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L10"}
{"http://rs.tdwg.org/dwc/terms/scientificName":"Astyanax abramis (Jenyns 1842)","contentId":"line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L11"}

with

$ preston cat 'line:zip:hash://sha256/97cbeae429fbc95d1859f7afa28b33f08ac64125ba72511c49c4b77ca66d2d66!/occurrence.txt!/L2'
1-37067-988 This work is licensed under a Creative Commons CCZero 1.0 License http://creativecommons.org/publicdomain/zero/1.0/legalcode and available according to the community norms at http://www.canadensys.net/norms. The data provider requests to be informed of publication 45 days in advance and can object to the use of the dataset within 30 days.    CIRA    The data provider requests to be informed of publication 45 days in advance and can object to the use of the dataset within 30 days.    BioFresh (publisher), Yukoni, T. and Torres L. V. (provider), Universidad Autónoma del Beni 'José Ballivian' (CIRA-UAB) (owner) (2015). Bolivian Amazon lowland fish metacommunity data. doi:10.13148/bfe105 Published on http://data.freshwaterbiodiversity.eu, accessed on [date].    doi:10.13148/bfe105 CIRA-UNAN   CIRA    PreservedSpecimen   waterBodyType=lake  1-37067-988 988 2   ML1-37067   25/06/01    2001    Site was sampled on 2 consecutive days. Date reported in the eventDate field is the first day of the visit. ML1 Manuripi    Bolivia Manuripi lake   -11.95204   -68.65672       Chalceus guaporensis Zanata & Toledo-Piza 2004  Animalia    Chalceidae  Chalceus    guaporensis species Zanata & Toledo-Piza 2004

the original line containing scientificName "Chalceus guaporensis Zanata & Toledo-Piza"

jhpoelen commented 2 years ago

example for extracting image urls for UC Santa Barbara's @seltmann invertebrate zoology collection -

preston track "https://serv.biokic.asu.edu/ecdysis/content/dwca/UCSB-IZC_DwC-A.zip"\
 | preston dwc-stream\
 | grep "http://rs.tdwg.org/ac/terms/Multimedia"\
 | jq --raw-output '.["http://rs.tdwg.org/ac/terms/goodQualityAccessURI"], .["http://rs.tdwg.org/ac/terms/accessURI"]'\
 | sort\
 | uniq
> ucsb-izc-image-urls.txt

with

$ cat ucsb-izc-image-urls.txt
45530
$ head  ucsb-izc-image-urls.txt
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC_00000001.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC00000001.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC_00000002.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC00000002.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC_00000003.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC00000003.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC_00000003_lg.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC_00000004.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC00000004.jpg
https://serv.biokic.asu.edu/imglib/ecdysis/UCSB_IZC/UCSB-IZC00000/UCSB-IZC_00000004_lg.jpg

ucsb-izc-image-urls.txt

Now, tracking all image urls . . . would be:

cat ucsb-izc-image-urls.txt\
| xargs -L100 preston track

So, putting it together, you'd be able to track the UCSB-IZC and its images using:

preston track "https://serv.biokic.asu.edu/ecdysis/content/dwca/UCSB-IZC_DwC-A.zip"\
>  | preston dwc-stream\
>  | grep "http://rs.tdwg.org/ac/terms/Multimedia"\
>  | jq --raw-output '.["http://rs.tdwg.org/ac/terms/goodQualityAccessURI"], .["http://rs.tdwg.org/ac/terms/accessURI"]'\
>  | sort\
>  | uniq\
>  | xargs -L100 preston track

jhpoelen commented 2 years ago

initial support introduced in https://github.com/bio-guoda/preston/releases/tag/0.3.5 . Suggest to report future improvement in separate issue.

bio-guoda / preston

generate streaming json from preston extracted from dwca #148