search

ipshipyard / waterworks-community

Discussion and documentation concerning the operation of the IPFS HTTP Gateway at https://ipfs.io/ipfs.
MIT License
0 stars 0 forks source link

delegated-ipfs.dev returning fewer results than local kubo #2

Closed aschmahmann closed 3 months ago

aschmahmann commented 7 months ago

When running against a node with "ExposeRoutingAPI": true and otherwise default routing I get less data than I can get by querying the underlying routing sources.

❯ curl -H "Accept: application/x-ndjson" http://127.0.0.1:8080/routing/v1/providers/bafkreifjjcie6lypi6ny7amxnfftagclbuxndqonfipmb64f2km2devei4
{"Addrs":["/ip4/192.210.228.133/udp/4001/quic-v1/p2p/12D3KooWEpavXh5sHac8tKdHehehyfYjtUfFKknmTTkggtzECKCU/p2p-circuit","/ip4/23.88.71.253/udp/4001/quic-v1/p2p/12D3KooWKZnHBMuV7PSAf8pfAbpqjcjb6RqJiaKVCiwHbHqCzUfP/p2p-circuit","/ip4/23.88.71.253/udp/4001/quic-v1/webtransport/certhash/uEiAfMqL-_P3yDYPTHQnhwomKpmmIm7TXqXRRr6gdJbfM8g/certhash/uEiCeaXLyt0mXAd4P-FRvHB5wQXh5j-r5vWnodFks1MaMdA/p2p/12D3KooWKZnHBMuV7PSAf8pfAbpqjcjb6RqJiaKVCiwHbHqCzUfP/p2p-circuit","/ip6/2a01:4f8:272:5c59::2/tcp/4001/p2p/12D3KooWKZnHBMuV7PSAf8pfAbpqjcjb6RqJiaKVCiwHbHqCzUfP/p2p-circuit","/ip4/192.210.228.133/udp/4001/quic/p2p/12D3KooWEpavXh5sHac8tKdHehehyfYjtUfFKknmTTkggtzECKCU/p2p-circuit","/ip4/192.210.228.133/udp/4001/quic-v1/webtransport/certhash/uEiD_Sq4lcBkLzJayjUqY4Po2cxcK57ITz6lO_v9a_Fj4_g/certhash/uEiBM8DHTyvqCFUuyjHtF7G5fmR-FpK0LDQ4gPzOfMQz0QQ/p2p/12D3KooWEpavXh5sHac8tKdHehehyfYjtUfFKknmTTkggtzECKCU/p2p-circuit","/ip6/2a01:4f8:272:5c59::2/udp/4001/quic-v1/webtransport/certhash/uEiAfMqL-_P3yDYPTHQnhwomKpmmIm7TXqXRRr6gdJbfM8g/certhash/uEiCeaXLyt0mXAd4P-FRvHB5wQXh5j-r5vWnodFks1MaMdA/p2p/12D3KooWKZnHBMuV7PSAf8pfAbpqjcjb6RqJiaKVCiwHbHqCzUfP/p2p-circuit","/ip4/23.88.71.253/tcp/4001/p2p/12D3KooWKZnHBMuV7PSAf8pfAbpqjcjb6RqJiaKVCiwHbHqCzUfP/p2p-circuit","/ip6/2a01:4f8:272:5c59::2/udp/4001/quic-v1/p2p/12D3KooWKZnHBMuV7PSAf8pfAbpqjcjb6RqJiaKVCiwHbHqCzUfP/p2p-circuit"],"ID":"12D3KooWFkR8nsG5pzffoAfMzmwBcSakXxnogVa6inRxUbpfN5ua","Schema":"peer"}
{"Addrs":["/ip4/66.45.255.142/tcp/4001/p2p/12D3KooWMrJLFERwzRLdtZ4aEd99b9qAvcpQfJ5E2vPA2StPwdKQ/p2p-circuit","/ip6/2604:a00:50:7e:aaa1:59ff:fec1:c893/tcp/4001/p2p/12D3KooWMrJLFERwzRLdtZ4aEd99b9qAvcpQfJ5E2vPA2StPwdKQ/p2p-circuit","/ip4/193.223.242.129/udp/4001/quic/p2p/12D3KooWNq61edigtZgYuU7H5v5Bfh3jWTR17e21xJh7u6uUNmG3/p2p-circuit","/ip4/193.223.242.129/udp/4001/quic-v1/p2p/12D3KooWNq61edigtZgYuU7H5v5Bfh3jWTR17e21xJh7u6uUNmG3/p2p-circuit","/ip6/2604:a00:50:7e:aaa1:59ff:fec1:c893/udp/4001/quic-v1/webtransport/certhash/uEiAf9yWvz6zx3RwQ33RFG5Yh0mcK3egIe5Kjp4WY0P_QDg/certhash/uEiCHZX22h6fqCt0oJOFmnoCursELx7tz4XVKdSF8Tf3zzA/p2p/12D3KooWMrJLFERwzRLdtZ4aEd99b9qAvcpQfJ5E2vPA2StPwdKQ/p2p-circuit","/ip4/66.45.255.142/udp/4001/quic-v1/p2p/12D3KooWMrJLFERwzRLdtZ4aEd99b9qAvcpQfJ5E2vPA2StPwdKQ/p2p-circuit","/ip4/66.45.255.142/udp/4001/quic-v1/webtransport/certhash/uEiAf9yWvz6zx3RwQ33RFG5Yh0mcK3egIe5Kjp4WY0P_QDg/certhash/uEiCHZX22h6fqCt0oJOFmnoCursELx7tz4XVKdSF8Tf3zzA/p2p/12D3KooWMrJLFERwzRLdtZ4aEd99b9qAvcpQfJ5E2vPA2StPwdKQ/p2p-circuit","/ip4/193.223.242.129/udp/4001/quic-v1/webtransport/certhash/uEiCzdqWyJ2aSr6HGpkT319knhye_hMm2j8bDvhXGIYeVEQ/certhash/uEiADfmnCyAaXcvOskoSDZ-02181HRZPrCnl7MBaYDq_VTg/p2p/12D3KooWNq61edigtZgYuU7H5v5Bfh3jWTR17e21xJh7u6uUNmG3/p2p-circuit","/ip6/2604:a00:50:7e:aaa1:59ff:fec1:c893/udp/4001/quic-v1/p2p/12D3KooWMrJLFERwzRLdtZ4aEd99b9qAvcpQfJ5E2vPA2StPwdKQ/p2p-circuit"],"ID":"12D3KooWMqSiDukubKNKrK7J4PaF3mfNnZFVAd3Lh7qj3Y3e5bcN","Schema":"peer"}
{"Addrs":["/ip4/3.87.76.9/udp/4001/quic","/ip4/3.87.76.9/tcp/4001","/ip6/64:ff9b::357:4c09/tcp/4001"],"ID":"QmSaXJRZVyKJNE1tN6hjFtKWSkmfzWWCEzbbnWmu6LJM7h","Schema":"peer"}
{"Addrs":["/ip4/54.237.232.109/tcp/4001","/ip4/54.237.232.109/udp/4001/quic"],"ID":"QmWboxuLjnFvZMErSbuGLZ3VLxZgWKDBX75AV8sZYacQTV","Schema":"peer"}
{"Addrs":["/ip6/64:ff9b::23ab:58d5/tcp/4001","/ip4/35.171.88.213/tcp/4001","/ip4/35.171.88.213/udp/4001/quic"],"ID":"Qmc6VMicD94JUeJXGFR75y3J1Da6fQsJSLCoU3wMffDSiK","Schema":"peer"}
{"Addrs":["/ip4/15.204.183.212/tcp/4001"],"ID":"12D3KooWB6RAWgcmHAP7TGEGK7utV2ZuqSzX1DNjRa97TtJ7139n","Schema":"peer"}
{"Addrs":["/ip4/141.95.66.35/tcp/4001"],"ID":"12D3KooWNRsVgwCE4jsWS7ZSGjRfkiiSdy5rmtyWvGnCENpevfoZ","Schema":"peer"}
{"Addrs":["/ip4/141.95.66.25/tcp/4001"],"ID":"12D3KooWL5rvBiZBE9NDWYfbCGSTfQpbScQPxDTfutLbVBjUot9R","Schema":"peer"}
{"Addrs":["/ip4/72.52.65.165/tcp/8888"],"ID":"12D3KooWLirG3i3uZicCBFK4b6oCVwDDc8mZUpuZwGJbLrTLnC7U","Schema":"peer"}
{"Addrs":["/dns4/elastic.dag.house/tcp/443/wss"],"ID":"QmQzqxhK82kAmKvARFZSkUVS6fo9sySaiogAnx5EnZ6ZmC","Schema":"peer"}
{"Addrs":["/ip4/108.89.91.150/tcp/8888"],"ID":"12D3KooWAEs8Zm3XMaTmk3b1jb9NTJzGE1KYpy4mdPiwiSAo9QJH","Schema":"peer"}
{"Addrs":["/ip4/109.199.233.7/tcp/8888"],"ID":"12D3KooWB6fUFjjLSYcWfM2iAd5ScgknqVP1Dbe6pff4Kqq64CLM","Schema":"peer"}
{"Addrs":["/dns/f010479.twinquasar.io/tcp/8888"],"ID":"12D3KooWDK1TfLegcZ2Gg3aZaZwiRFvL9pUCSYXKXWVznPBBXypZ","Schema":"peer"}
{"Addrs":["/ip4/76.219.232.45/tcp/24888"],"ID":"12D3KooWSoSgVaUvoguDQZu1doytze9RgnnANwJoiLw7KUcAXq8i","Schema":"peer"}
{"Addrs":["/ip4/163.47.51.218/tcp/28131"],"ID":"12D3KooWEfL19QqRGGLraaAYw1XA3dtDdVRYaHt6jymFxcuQo3Zm","Schema":"peer"}
{"Addrs":["/ip4/195.167.147.43/udp/8888/quic","/ip4/195.167.147.43/tcp/8888"],"ID":"12D3KooWK53GAx2g2UUYfJHHjxDbVLeDgGxNMHXDWeJa5KgMhTD2","Schema":"peer"}
{"Addrs":["/ip4/198.244.178.172/tcp/4001"],"ID":"12D3KooWENiDwDCPnbEQKHHsDnSsE5Y3oLyXnxuyhjcCEBK9TvkU","Schema":"peer"}
{"Addrs":["/ip4/127.0.0.1/udp/4001/quic","/ip6/::1/udp/4001/quic","/ip4/10.0.66.167/tcp/4001","/ip4/10.0.66.167/udp/4001/quic","/ip4/127.0.0.1/tcp/4001","/ip6/::1/tcp/4001","/ip6/64:ff9b::36e2:aa17/tcp/4001","/ip4/54.226.170.23/tcp/4001","/ip4/54.226.170.23/udp/4001/quic"],"ID":"QmaB2ZWdnsycNJnCCNSY6QWPfXnuiorKJFQaSdTv7V7e31","Schema":"peer"}
{"ID":"12D3KooWC9L4RjPGgqpzBUBkcVpKjJYofCkC5i5QdQftg1LdsFb2","Schema":"peer"}
{"ID":"12D3KooWFtNWJWT3UgqeGDiyz41zCuoWQ3BUfGRr32i9hNYFR9dr","Schema":"peer"}
{"Addrs":["/ip4/15.204.183.214/tcp/4001"],"ID":"12D3KooWH2m5yQJtQeTbJ3Q4pSuXKgKkrwn282cJrefM5p9bMFEW","Schema":"peer"}
{"Addrs":["/ip4/141.95.66.22/tcp/4001"],"ID":"12D3KooWNy2SmgY384B9EHVHdbSkvXEADwxjzd4ejXQqicxWpxxT","Schema":"peer"}
{"Addrs":["/ip4/141.95.85.123/tcp/4001"],"ID":"12D3KooWNWgNz5QSL2D2YxfKcYo6HyEpFuRnW2fRYewrDmjWJECi","Schema":"peer"}

From delegated-ipfs.dev I get:

❯ curl -H "Accept: application/x-ndjson" https://delegated-ipfs.dev/routing/v1/providers/bafkreifjjcie6lypi6ny7amxnfftagclbuxndqonfipmb64f2km2devei4
{"Addrs":["/ip4/72.52.65.165/tcp/8888"],"ID":"12D3KooWLirG3i3uZicCBFK4b6oCVwDDc8mZUpuZwGJbLrTLnC7U","Schema":"peer"}
{"Addrs":["/dns4/elastic.dag.house/tcp/443/wss"],"ID":"QmQzqxhK82kAmKvARFZSkUVS6fo9sySaiogAnx5EnZ6ZmC","Schema":"peer"}
{"Addrs":["/ip4/108.89.91.150/tcp/8888"],"ID":"12D3KooWAEs8Zm3XMaTmk3b1jb9NTJzGE1KYpy4mdPiwiSAo9QJH","Schema":"peer"}
{"Addrs":["/ip4/109.199.233.7/tcp/8888"],"ID":"12D3KooWB6fUFjjLSYcWfM2iAd5ScgknqVP1Dbe6pff4Kqq64CLM","Schema":"peer"}
{"Addrs":["/dns/f010479.twinquasar.io/tcp/8888"],"ID":"12D3KooWDK1TfLegcZ2Gg3aZaZwiRFvL9pUCSYXKXWVznPBBXypZ","Schema":"peer"}
{"Addrs":["/ip4/76.219.232.45/tcp/24888"],"ID":"12D3KooWSoSgVaUvoguDQZu1doytze9RgnnANwJoiLw7KUcAXq8i","Schema":"peer"}
{"Addrs":["/ip4/163.47.51.218/tcp/28131"],"ID":"12D3KooWEfL19QqRGGLraaAYw1XA3dtDdVRYaHt6jymFxcuQo3Zm","Schema":"peer"}
{"Addrs":["/ip4/195.167.147.43/udp/8888/quic","/ip4/195.167.147.43/tcp/8888"],"ID":"12D3KooWK53GAx2g2UUYfJHHjxDbVLeDgGxNMHXDWeJa5KgMhTD2","Schema":"peer"}

Not sure what's going on here (e.g. misconfigured node, caching, etc.)

lidel commented 3 months ago

I believe this is resolved by https://github.com/ipfs/someguy/pull/23 which is now released and deployed to delegated-ipfs.dev/routing/v1/