DNS issues: Covers, Artwork, TV Series image, rss feed fail to load (most of them)

x-cimo commented 11 years ago

I have been struggling with OpenElec on all my PC. I am using the Generic build. The issue is that anything that need to be fetched from tvdb etc fail to fetch.

My install are clean OpenElec 3.0.3 Generic build

In about ~100 movies, maybe 5-10 fetched their content.

I have been documenting this in a thread here: http://openelec.tv/forum/72-xbmc/64460-most-movie-cover-and-artwork-background-don-t-load#74575

I have found out that it's related to DNS. Dns are slow to resolve even with 8.8.8.8

ping google.ca take 10 sec before starting. however ping -4 google.ca works perfectly.

I have disabled ipv6, tried static ips, set google dns nothing worked.

As a last resort, I added the IPs for movie db and other image provided that xbmc use in my .config/hosts.conf and IT WORKED.

All my cover, preview, art work all started to load right away.

Here is what I added in hosts.conf 204.246.169.111 cf2.imgobject.com 204.246.169.231 cf1.imgobject.com 204.246.169.83 cf3.imgobject.com 190.93.253.95 thetvdb.com

Obviously hardcoding IP is bad... Does anyone have an idea what could be going wrong?

stefansaraev commented 11 years ago

likely a router misconfiguration

x-cimo commented 11 years ago

I spoke with seo on the chat, I will be trying a nightly tonight. More on this soon. Thanks!

x-cimo commented 11 years ago

So an update: I did a clean install of OpenELEC-Generic.i386-devel-20130501182857-r14160.tar.bz2

And everything is working well there! So there is something broken in 3.0.3

The install gui is nice. A bit difficult to navigate (sometimes unresponsive) but went through without issue.

I disabled ipv6 and setted a static IPv4 and that's it.

The only drawback is it's using Frodo 12.1.

Thanks you, looking forward to the release of this one!

x-cimo commented 11 years ago

I just downloaded the latest nightly and setted static IPv4/Disabled IPv6, and the issue is still present :( You may want to re-open this for investigation.

rezou commented 11 years ago

I can confirm this is happening to me too. Something is messed up with DNS as adding the above to my hosts file fixes the problem and it is lightning fast. OpenELEC 3.0.3 on an Xtreamer Ultra.

Calabashmc commented 11 years ago

I also have this same issue. Zotac Zbox ID81 with openelec 3.03 official release fresh install. Was working on 2.95 but I did a fresh install as that version kept hanging if left idel for too long or when playing music.

rezou commented 11 years ago

Just upgraded to 3.0.5 and the problem still exists. I also noticed I have a ton of issues using the RADIO add-on, which I believe to be related to this DNS issue too. Some stations just will not play and often crashes the UI to the point where I have to SSH and reboot the Xtreamer Ultra. Has there been any development on this?

rezou commented 11 years ago

Will upgrade to 3.0.6 tonight to see if this is fixed.

pstehr commented 11 years ago

I have similar problems. Addon repos are empty. Weather doesn't update. I am quite sure that there's something funky going on with the DNS resolution. I have SSH'ed into the openelec box, and tried to ping various addresses - common sites as well as add-on repo URLs. It appears, that URLs that do not start with a "www" mostly do not resolve.

www.yahoo.com resolves yahoo.com does not

addons.xbmc.org does not resolve www.xbmc.org does

Strangely, google.com resolves just as well as www.google.com, but it's so far the only exception that I have stumbled upon.

I'm sure that it's not a router problem, because the same addresses that I can't ping to from the Openelec boxes (one on ATV1, one on a generic PC), work just fine from a Mac connected on the same WIFI network/router.

HTH

rezou commented 11 years ago

Yea, I think it has been ruled out that it is a router configuration issue at this point. I've upgraded to 3.0.6 and issue is still there. I can't believe this issue is not more wide spread, seeing we are using different hardware. (Xtreamer Ultra) here. DEVS, has this been looked into at all yet? I'll help out providing more detailed log files if you tell me what you would like to look at.

tergo commented 11 years ago

I believe I am experiencing this too. When I run a library update, the newly added movies/shows don't have any artwork. (It fetches the movie name and plot, cast, director etc just fine)

Adding those IP addresses to the hosts file seemed to fix it. Removing them caused it to break again.

The problem is not constant; it comes and goes.

rezou commented 11 years ago

Is this happening with everyone using 8.8.8.8 / 8.8.4.4?

tergo commented 11 years ago

I set DNS via my router. But yes, my primary DNS is 8.8.8.8.

I tested and changing DNS to my ISP provided server makes no difference.

rezou commented 11 years ago

I question if it is DNS issue then because in my case everything resolves just fine during an ssh session. Some name resolutions do 'lag' for a few seconds before spitting back ping results though. While others happen almost instantly.

rezou commented 11 years ago

Also, I've seen issues posted by other users that are not using OPENELEC, so possibly might be an XBMC 12.2 issue?

rezou commented 11 years ago

I wiped by Xtreamer Ultra and installed XBMCbuntu 12.2 last night, all issues gone. Confirmed it is OpenELEC and not XBMC.

tergo commented 11 years ago

My logfile basically just contains this for every failed image: 15:07:11 T:139704045479680 DEBUG: GetImageHash - unable to stat url http://cf2.imgobject.com/t/p/original/5WJnxuw41sddupf8cwOxYftuvJG.jpg

Reference to same issue I am experiencing and he says he spoke to OE dev: http://forum.xbmc.org/showthread.php?tid=165502

tergo commented 11 years ago

Are you guys who experience the problem using ethernet or wifi?

x-cimo commented 11 years ago

With ethernet. On Jul 26, 2013 6:58 AM, "tergo" notifications@github.com wrote:

Are you guys who experience the problem using ethernet or wifi?

— Reply to this email directly or view it on GitHubhttps://github.com/OpenELEC/OpenELEC.tv/issues/2319#issuecomment-21614074 .

rezou commented 11 years ago

With ethernet, never tried it on WiFi.

tergo commented 11 years ago

That is strange because I experienced the problem much worse on wifi (when my powerline broke). Now that I got a new powerline, the problem seems to have gone away.

rezou commented 11 years ago

I ended up loading XBMCbuntu instead, but it really doesn't perform as good as OpenELEC did. Perhaps it is something to do with certain drivers only? XBMCbuntu works flawless concerning all the coverart, rss feeds, etc. I hope this gets fixed soon because I'd love to move back to OpenELEC.

x-cimo commented 11 years ago

I did the same, moved to xbmcbuntu. Why do you say it doesn't perform as good? Its been pretty good on my side. On Jul 26, 2013 10:33 AM, "rezou" notifications@github.com wrote:

I ended up loading XBMCbuntu instead, but it really doesn't perform as good as OpenELEC did. Perhaps it is something to do with certain drivers only? XBMCbuntu works flawless concerning all the coverart, rss feeds, etc. I hope this gets fixed soon because I'd love to move back to OpenELEC.

— Reply to this email directly or view it on GitHubhttps://github.com/OpenELEC/OpenELEC.tv/issues/2319#issuecomment-21624433 .

rezou commented 11 years ago

The menus are a little laggy and once in a while I get a brief 'skip' playing back some videos. I'm suing an Xtreamer Ultra.

tergo commented 11 years ago

Problem still exists in testing OpenELEC-ION.x86_64-3.1.7

Unable to resolve IP address for image URLs (eg cf1.imgobject.com) but scrapes text metadata (plot, year, genre etc) just fine. Something to do with the format of those URLs.

jenkins101 commented 11 years ago

Please make a clean install enable debug in xbmc reproduce and pastebin logs

this is probably a issue in your network setup and not in OpenELEC

stefansaraev commented 11 years ago

all dns issues after 3.0.x are either misconfiguration, RPi with bad power supply, broken router (some stupid dnsmasq wrongly cached an A record), cheap wifi adapters that drop random ip packets on their own, isp issues, or 8.8.8.8 (gogle dns I would not recommend for "production" usage).

@jenkins101 I would close this. all dns issues caused by connman are solved by removing connman's dnsproxy.

EDIT: and after 3.1.x ipv6 is disabled by default too. if not configured manualy.

tergo commented 11 years ago

@jenkins101: XBMC: http://pastebin.com/fLV56Rr0 Kernel: http://pastebin.com/Ri97pSxy Hardware: http://pastebin.com/x3zKV6X3 Network: http://pastebin.com/DcP4Hn6Q varlog: http://pastebin.com/5knwkVsP filesystem: http://pastebin.com/B2yGvgRV

I performed a library update, a few new episode were added (The Newsroom, Low Winter Sun). The text metadata (plot etc) scraped perfectly, no images were scraped.

jenkins101 commented 11 years ago

Hi,

Ok all looks good in the logs...

but as noted by @stefansaraev it is probably some kind of network problem in your environment try a different router or a different DNS server...

search for "unable to stat url" in your xbmc.log and try to download a file manually and see if that works. it could be that tvdb has a limit on files or so... your cache could be corrupted... try moving your .xbmc dir away and see what happens with a fresh one.

tergo commented 11 years ago

I can load the URLs mentioned in the log just fine.

The problem doesnt happen to XBMC on a Win7 machine on the same network, using the same router and same DNS server.

If it is related to a tvdb limit, then why does hardcoding the IP addresses fix it?

The comments from stefansaraev were not helpful, he just told everybody their router was misconfigured and there couldn't possibly be any DNS issues after 3.0.x. Lots of people report the same issue, do you think all of our routers have spontaneously become 'misconfigured' ? http://openelec.tv/forum/69-network/65205-weird-network-issue-in-3-x-x#85153 http://openelec.tv/forum/69-network/66743-network-connectivity-issue-with-all-3-x-versions

I count at least a dozen people here and on those threads who describe an identical problem. Fanart URLs are not resolving but some other URLs are.

x-cimo commented 11 years ago

There is an issue with dns in 3.0.x.

My network is in good shape and present no other problems. All other xbmc distro work fine.

Just look at the number of people with the same issue here.

Hard coded ip fix the problem for tvdb but its not a viable solution. On Sep 12, 2013 6:06 PM, "tergo" notifications@github.com wrote:

I can load the URLs mentioned in the log just fine.

The problem doesnt happen to XBMC on a Win7 machine on the same network.

If it is related to a tvdb limit, then why does hardcoding the IP addresses fix it?

The comments from stefansaraev were not helpful, he just told everybody their router was misconfigured and there couldn't possibly be any DNS issues after 3.0.x. Lots of people report the same issue, do you think all of our routers have spontaneously become 'misconfigured' ?

http://openelec.tv/forum/69-network/65205-weird-network-issue-in-3-x-x#85153

http://openelec.tv/forum/69-network/66743-network-connectivity-issue-with-all-3-x-versions

I count at least a dozen people here and on those threads who describe an identical problem. Fanart URLs are not resolving but some other URLs are.

— Reply to this email directly or view it on GitHubhttps://github.com/OpenELEC/OpenELEC.tv/issues/2319#issuecomment-24359779 .

jenkins101 commented 11 years ago

Hi,

That is strang indeed... have you tried with a fresh ".xbmc" dir also?

Is 3.2 working... :-)

johngi commented 11 years ago

Same issue here, I'm running 3.2.

I'm getting the following error:

09:34:20 T:140377893881600 DEBUG: GetImageHash - unable to stat url http://cf2.imgobject.com/t/p/original/btcmHDbnIbG4A0DrDujCVi9fgF.jpg

I tried to change the dns servers to google or opendns servers instead of my gateway, but didn't helped.

minimoe2 commented 11 years ago

I have the same problem since Openelec 3.0.3, I think. I get the same "GetImageHash - unable to stat url" messages in the log. I have a dual boot OL\Win7 system and XBMC on Win7 works perfectly.

I tried other DNS servers and a fixed IP but the only way to solve the problem was to hardcode the IPs.

jenkins101 commented 11 years ago

fresh .xbmc dir or try a live usb boot and check again please!

dukeczech commented 11 years ago

I have the same issue when i updated from 3.0.6 to 3.2.0. Before everything works well. When i add a new movie it downloads all names, titles, info... but not fanart. Log says: DEBUG: GetImageHash - unable to stat url ...

If i try to download image by wget, it works well. I have noticed strange ping behavior: if i run "ping 8.8.8.8" it starts right away, but if i run "ping google.com" it waits 4-5sec and then it runs. Plugins with internet connections works (youtube plugin...).

Hardcoding IP adress to hosts fix the problem.

jenkins101 commented 11 years ago

have you tried with a fresh .xbmc directory or a fresh install?

minimoe2 commented 11 years ago

I tried fresh installs of Generic i386 3.0.6 and 3.1.7 a couple of weeks ago but the problem remained. Then I upgraded to 3.2 which did not help.

jenkins101 commented 11 years ago

Hi, Then it has to be something in your network...

if you have a router doing dns caching set the dns server to your router.

OE doesn't cache dns any more because dns cache in connman is broken.

minimoe2 commented 11 years ago

If it was a problem with my network then XBMC on Win7 should have a problem as well. As I wrote a few days ago, XBMC on Win7 works flawlessly on the same HTPC (dual boot OL\Win7).

stefansaraev commented 11 years ago

sysctl -w net.ipv6.conf.all.disable_ipv6=1
sysctl -w net.ipv6.conf.default.disable_ipv6=1
sysctl -w net.ipv6.conf.lo.disable_ipv6=1

does this help ?

stefansaraev commented 11 years ago

@minimoe2 ping me in irc tomorrow and give me ssh access to your box. I'd bet it is some weird network setup but a closer look won't hurt. noone from the team can reproduce this. my irc nickname is seo. timezone GMT+3

minimoe2 commented 11 years ago

stefansaraev, you lost me a bit there! I'm not that familiar with linux. Thanks for the interest, I'll try to do that next week.

jenkins101 commented 11 years ago

@minimoe2 as I said OE does not cache dns entrys any more so it is not possible to compare to windows that does cache dns entrys...

dukeczech commented 11 years ago

@stefansaraev: disabling IPv6 doesnt help. I dont think its some kind of my network problem, because 3.0.6 worked well and other services now goes well.

vslavik commented 11 years ago

Another “me too”. I wouldn’t pollute the issue with such spam, if it weren’t for these ridiculous “it’s some network issue on your end” dismissals. All was well before updating to 3.2, all is well on all other boxes in the same network (including another Linux box), DNS is configured correctly and identically for everybody on the network, the DNS server is responsive and responding correctly to manual queries. Methinks it’s time to consider that maybe, just maybe there may actually be something a tiny bit wrong in OpenELEC here.

rezou commented 11 years ago

I agree with vslavik too. I have no other issues on my network related to dns and the problem went away when I switched the OS over to XBMCbuntu. I believe most of us have tried every suggestion posted here and I am pretty much certain it is a problem with something within OpenELEC. It is clearly not affecting everyone but it is affecting enough users. Maybe it has something to do with a certain hardware combination? That would sure explain why it is not happening on all users boxes!

stefansaraev commented 11 years ago

I still need ssh acces to one of the broken systems (with high "ping google.com" resolving delay). come on guys.

jenkins101 commented 11 years ago

could someone pastebin /etc/resolve.conf from broken system?

dukeczech commented 11 years ago

my /etc/resolv.conf:

# Generated by Connection Manager
nameserver 10.255.255.10
nameserver 10.255.255.20

i compiled bind tools for openelec and i tried a couple of resolves and they were quick without any problem:

OpenELEC:~/.xbmc/userdata/service.network.bind/bin # ./dig google.com

; <<>> DiG 9.9.4rc2 <<>> google.com
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 47630
;; flags: qr rd ra; QUERY: 1, ANSWER: 11, AUTHORITY: 4, ADDITIONAL: 5

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 4096
;; QUESTION SECTION:
;google.com.                    IN      A

;; ANSWER SECTION:
google.com.             211     IN      A       173.194.35.78
google.com.             211     IN      A       173.194.35.64
google.com.             211     IN      A       173.194.35.65
google.com.             211     IN      A       173.194.35.66
google.com.             211     IN      A       173.194.35.67
google.com.             211     IN      A       173.194.35.68
google.com.             211     IN      A       173.194.35.69
google.com.             211     IN      A       173.194.35.70
google.com.             211     IN      A       173.194.35.71
google.com.             211     IN      A       173.194.35.72
google.com.             211     IN      A       173.194.35.73

;; AUTHORITY SECTION:
google.com.             30097   IN      NS      ns1.google.com.
google.com.             30097   IN      NS      ns4.google.com.
google.com.             30097   IN      NS      ns3.google.com.
google.com.             30097   IN      NS      ns2.google.com.

;; ADDITIONAL SECTION:
ns1.google.com.         239300  IN      A       216.239.32.10
ns2.google.com.         224881  IN      A       216.239.34.10
ns3.google.com.         239300  IN      A       216.239.36.10
ns4.google.com.         239300  IN      A       216.239.38.10

;; Query time: 9 msec
;; SERVER: 10.255.255.10#53(10.255.255.10)
;; WHEN: Fri Sep 27 17:04:14 CEST 2013
;; MSG SIZE  rcvd: 351

if i try to ping google.com, it takes 5-6 second to start ping:

OpenELEC:~/.xbmc/userdata/service.network.bind/bin # ping google.com
==== now it takes 5-6 sec ====
PING google.com (173.194.35.78): 56 data bytes
64 bytes from 173.194.35.78: seq=0 ttl=57 time=13.905 ms
64 bytes from 173.194.35.78: seq=1 ttl=57 time=10.177 ms
64 bytes from 173.194.35.78: seq=2 ttl=57 time=8.089 ms
64 bytes from 173.194.35.78: seq=3 ttl=57 time=13.353 ms

but if i try to ping 173.194.35.78, it starts right away:

OpenELEC:~/.xbmc/userdata/service.network.bind/bin # ping 173.194.35.78
PING 173.194.35.78 (173.194.35.78): 56 data bytes
64 bytes from 173.194.35.78: seq=0 ttl=57 time=7.589 ms
64 bytes from 173.194.35.78: seq=1 ttl=57 time=7.655 ms
64 bytes from 173.194.35.78: seq=2 ttl=57 time=11.307 ms
64 bytes from 173.194.35.78: seq=3 ttl=57 time=7.240 ms

OpenELEC / OpenELEC.tv

DNS issues: Covers, Artwork, TV Series image, rss feed fail to load (most of them) #2319