Samba not showing all files in big folders

GoogleCodeExporter commented 8 years ago

What steps will reproduce the problem?
1. When I enter large catalog (e.g. my photos) on the mounted disk via NNS it 
does not show all my folders and files.
2. They do not show up in file/folder list but I can enter them by manually 
adding the catalogue name to the path. They are also accessible via FTP without 
any problems.

What is the expected output? What do you see instead?
I guess this is because of the old Samba version? Any ways to upgrade it?

What version of the product are you using? On what operating system?
3.0.3.0v-026 on RT-N56U and computer Windows 7/Ubuntu 12.10 (issue on both 
systems) @ Killer 1202

Original issue reported on code.google.com by sopello@sopello.pl on 16 Nov 2012 at 1:30

GoogleCodeExporter commented 8 years ago

I have the same problem, downgrading to 1.1.2.6-018 solves the problem for now.

Original comment by ranka...@gmail.com on 3 Dec 2012 at 9:13

GoogleCodeExporter commented 8 years ago

I have the same problem :(

Original comment by mago...@gmail.com on 3 Dec 2012 at 3:22

GoogleCodeExporter commented 8 years ago

Issue 621 has been merged into this issue.

Original comment by d...@soulblader.com on 4 Dec 2012 at 2:22

GoogleCodeExporter commented 8 years ago

Issue 590 has been merged into this issue.

Original comment by d...@soulblader.com on 4 Dec 2012 at 2:59

GoogleCodeExporter commented 8 years ago

This issue depended to NTFS driver Paragon ufsd.ko v8.6 (used from N65U 
specially for kernel-3.0.x). All files visible on ext2/3/4 partition, but 
partially visible on NTFS partition. I try to build samba-3.6.5 - no changes. I 
think ufsd.ko incorrect converting some symbols to UTF-8 and samba internal 
filter skip this files on dir listing.

Original comment by andy.pad...@gmail.com on 9 Dec 2012 at 8:52

GoogleCodeExporter commented 8 years ago

I am facing the same issues. For a while, I thought my PC was giving problems 
and that the copy has failed. However, the file actually exists on the disk. It 
is just not visible.

Original comment by dzei...@gmail.com on 11 Dec 2012 at 12:42

GoogleCodeExporter commented 8 years ago

Does using ext4 filesystem fix this? Or atleast remove trouble?

Original comment by nony...@gmail.com on 3 Jan 2013 at 8:35

GoogleCodeExporter commented 8 years ago

Yesterday I format my 1tb drive to ext3 and now it seems to fix my trouble... 
But not sure yet.

Original comment by nony...@gmail.com on 4 Jan 2013 at 3:46

GoogleCodeExporter commented 8 years ago

Same issue
Running Firmware 3.0.0.4.260 on ASUS RT-N65U. I have a 2 tbyte NTFS formatted 
Toshiba Canvio USB 3.0 external hard drive. I'm running Windows 7 on my main 
system and Windows XP on an a netbook. I've loaded approx. 250 Gbytes of flac 
files in separate folders. Regardless of whether I load them up plugging the 
hard drive directly into the desk top, or through the server, folders and their 
associated files are missing. When the hard drive is plugged directly into my 
desktop, I show 1,178 folders, but when I view the the same top folder over the 
network, I'm only seeing 984 folders. In other words, 194 folders have 
disappeared. As with another poster, they are accessible via FTP.

Original comment by Questing...@gmail.com on 23 Jan 2013 at 4:33

GoogleCodeExporter commented 8 years ago

Hello,

Trying to keep the thread alive.

I have a similar problem. In my limited research I've found that a lot of the 
described symptoms have the same main caus:e samba messing up file access 
privileges.

I have found comparable discussions here: 
https://code.google.com/p/rt-n56u/issues/detail?id=162 and here: 
http://forums.smallnetbuilder.com/archive/index.php?t-5700.html 

I have a 1TB WD external drive (with separate power) and:

- NTFS (no account set for access) - some files/folders are inexplicably locked 
and can't be deleted (only read, not write)
- NTFS (admin account set) - some folders do not appear visible - when 
attempting re-writes, the files are already there ("confirm overwrite?")
- EXT3 - (no account) - issues with copying content over (some files remain in 
0 bytes, some give "write protection" error)

It's quite frustrating, and frankly I've decided to sell the damn HDD, as in 
this state it currently useless - i have a portable USB3 seagate for much 
faster local, secure backups.

Original comment by adrian.r...@gmail.com on 27 Jan 2013 at 10:35

GoogleCodeExporter commented 8 years ago

This issue is referred to as a cross-linking error on this forum (although it's 
concerning the rt-n66u, the problem is the same one): 
http://forums.smallnetbuilder.com/showthread.php?t=7407

I've encountered this error on the following drives I've tried:

- Toshiba Canvio 2 TB NTFS USB 3.0 External HD 
- Western Digital 2 TB NTFS USB 3.0 External HD
- Lacie 500 GB NTFS USB 2.0 External HD

All these drives share one common feature: They all use an external power 
adapter.

However, when I use a 500 GB NTSF USB 2.0 powered (no power adapter) Western 
Digital Passport,all the files show up as they should and the cross-linking 
error disappears.

I'm not sure if this is coincidental, but I thought I'd post this to see if 
others have encountered this issue on a USB powered HD.

Original comment by Questing...@gmail.com on 28 Jan 2013 at 6:06

GoogleCodeExporter commented 8 years ago

Update:

I reformatted my 1 TB HD using FAT32FORMAT (to overcome the maximum 32 GB 
limit). Because my music files are all less than 4 GB in size, I'm not 
concerned about the FAT32 4 GB cluster size limit. The formatting took only 
seconds using the program available here: 
http://www.ridgecrop.demon.co.uk/index.htm?fat32format.htm

After loading up all 1,266 music folders, I was very happy to find that I was 
now able to see all the files over the network, and that none were hidden.

Sadly, according to the Asus's own website (Asus.com), they do not recommend 
using the NTFS format. To quote: 

"...we strongly recommend to use the file format EXT2 or EXT3 for best 
performance. We don't recommend using file format NTFS because the wireless 
Router/AP can't upload files to the NTFS disk due to NTFS file system's 
compatibility."

You can read more here: 
http://www.asus.com/support/Search-Result-Detail/24AE1421-ED83-53A8-3A5C-53D49D8
839AE/?keyword=file%20system%20support%20table

So, I guess that's that.

Original comment by Questing...@gmail.com on 29 Jan 2013 at 12:49

GoogleCodeExporter commented 8 years ago

Update. I think I found another workaround.

In addition to the crosslinking problem, I had an problem where I suffered a 
significant loss of bandwidth dropping from 14 Mbps to less than 1 Mpbs with 
four of the hard drives I tried: A 2 TB NTFS formatted USB 3.0 External HD 
Toshiba Canvio, 2 TB NTFS formatted USB 3.0 External HD Western Digital, 1 TB 
NTFS formatted USB 3.0 External HD, and 1 TB NTFS formatted USB 3.0 Western 
Digital hard drive with a Mediasonic ProBox enclosure.

My brother, who also has an RT-N65U, however, hasn't had any of the 
crosslinking or bandwidth problems I experienced. He has three types of hard 
drive enclosures and two 1 TB NTFS formatted hard drives.

At my request, he tested all three enclosures and both hard drives. To my 
surprise, his bandwidth remained consistent at approx. 17 Mbps down and 1.5 
Mbps up and he didn't experience any crosslinking issues with some folders 
remaining hidden across the network.

When inquiring further as to why he hadn't experienced the same errors I had, 
he determined that it was because all his HD enclosures also happen to be Linux 
compatible, unlike any of the hard drives (or enclosures) that I have. I assume 
that this may be because the router's firmware is based on the Linux kernel 
3.0.61?

Anyways, a Linux compatible HD or HD enclosure seems to be a good workaround 
for this problem.

Original comment by Questing...@gmail.com on 12 Feb 2013 at 1:36

GoogleCodeExporter commented 8 years ago

[deleted comment]

GoogleCodeExporter commented 8 years ago

[deleted comment]

GoogleCodeExporter commented 8 years ago

I just tested Rosewill METAS USB 3.0 Linux compatible External Enclosure and I 
can confirm that the crosslinking error was eliminated. All the files were 
showing up as they should.

However, after about 10 minutes, I experienced a significant decline in 
wireless data streaming and at one point my Speedtest program wouldn't even 
load. As soon as I disconnected the enclosure and reattached the USB 2.0 
non-powered drives, everything returned to normal.

So, even though the enclosure is Linux compatible, the router still has an 
issue with it and every other powered HD enclosure I've tried.

Original comment by Questing...@gmail.com on 20 Feb 2013 at 5:16

GoogleCodeExporter commented 8 years ago

I also face the same problem...
Can only display the 1st to 134th, and the 257th and after files

Sorry that I've opened another issue
http://code.google.com/p/rt-n56u/issues/detail?id=660&start=100

Original comment by cuckoo.c...@gmail.com on 20 Feb 2013 at 5:50

GoogleCodeExporter commented 8 years ago

I found the problem for me to be some special letters. I'm german and I suspect 
folders containing chars like ä,ö,ü or ß make the following folders 
'missing' (they are not displayed). As someone at the beginning of this thread 
posted and as I found in other forums, this is not the problem with samba but 
with different charsets. samba by default is using UTF8, which do not include 
those special letters.
By changing the charset to iso-8859-1 in /etc/smb.conf and then renaming one of 
the folders with those special files I seems to have solved the problem 
somehow, at least all folders are now displayed. But beware, the folder you're 
renaming will get an invalid name and remain 'hidden', so you may want to use 
an empty folder or save the content of this folder elsewhere.

Original comment by mails.gh...@gmail.com on 5 Mar 2013 at 11:55

GoogleCodeExporter commented 8 years ago

Reply #18:

I have just tried. It's not working
I've created a folder call "1", and it stored 256 files (001.jpg to 256.jpg, 
all 0 byte). Windows explorer can only show the first 149 files (001.jpg to 
149.jpg). However DOS command can show all the files

Original comment by cuckoo.c...@gmail.com on 8 Mar 2013 at 7:27

GoogleCodeExporter commented 8 years ago

I Google and found an old Samba related issue
http://samba.2283325.n4.nabble.com/Re-Fw-Missing-files-on-Windows-client-side-td
2407012.html

Original comment by cuckoo.c...@gmail.com on 26 Mar 2013 at 6:22

GoogleCodeExporter commented 8 years ago

Hi - Has anybody try RT-N65U with Probox drive bay? 
http://www.amazon.com/Mediasonic-HF2-SU3S2-ProBox-Drive-Enclosure/dp/B003X26VV4

The Rt-N65U only seem to read one drive.

Any help with be appreciated!

Rick -
rickseattle@hotmail.com

Original comment by riths...@gmail.com on 30 Apr 2013 at 10:59

GoogleCodeExporter commented 8 years ago

This issue is fixed in version 3.0.3.6-061
Thanks for the development team

Original comment by cuckoo.c...@gmail.com on 8 Jun 2013 at 9:32

GoogleCodeExporter commented 8 years ago

Unfortunately, I still have this issue. I am using a Toshiba Canvio 3TB drive 
formatted to exfat and it seems that only about 200 of the 1000 or so folders 
show up on the samba share. Any help would be awesome!

Thanks

Original comment by ilyaz.mu...@gmail.com on 13 Nov 2013 at 11:24

GoogleCodeExporter commented 8 years ago

Hello,
sorry for bringing this up again.
I have the same problem with two HDD both NTFS formatted. One Samsung portable 
(640 GB) without external power supply and one Seagate (500 GB) with external 
power supply.
Everything works fine, but with windows explorer I can not see all the files by 
using the network drive (Asus RT-N56U Router). By simply using a tablet or 
smartphone with samba access, there is no problem at all. Also ftp works fine.
I am using firmware 3.4.3.7-072. Will there be a solution in one of the next 
versions or how can I solve this problem?.

Thanks a lot for answering!

Original comment by oliver.h...@googlemail.com on 9 Jan 2014 at 1:18

GoogleCodeExporter commented 8 years ago

Correction!

I checked again: The Samsung HDD ist formated in FAT32 and still causes the 
problem. But when checking the properties of the network drive (Samsung) with 
Windows Explorer, it is identified as NTFS!
I really do not understand, why.
Any ideas?
I also find the error message "kernel: convert_uni_to_ch: fail to use nls" in 
the log.

Original comment by oliver.h...@googlemail.com on 9 Jan 2014 at 3:31

GoogleCodeExporter commented 8 years ago

I have the same problem with my ASUS RT-N66U, using a 3tb external harddrive 
with it's own powersource. Is there a fix out yet?

Original comment by Emanuel....@gmail.com on 13 Apr 2014 at 3:16

GoogleCodeExporter commented 8 years ago

Same problem here.
I have a WD Passport 2 TB, NTSF, no external power, connected via USB to an 
ASUS router RT-N65R.
I am using Windows 8.1
In each folder I cannot see past 134 files. If I try to copy a missing file, it 
acknowledges it as a duplicate. If I check the properties of the containing 
folder, it tells me the true number of files.
They're there if I connect the drive to my laptop.
I can see them via FTP.
Don't know what else to do, very annoying, I looked all over the internet

Original comment by parizi...@gmail.com on 12 Jul 2014 at 12:28

GoogleCodeExporter commented 8 years ago

The solution is to use EXT filesystem

Original comment by serge...@gmail.com on 12 Jul 2014 at 12:38

lixuewei / rt-n56u

Samba not showing all files in big folders #588