michaelogrant / macfusion

Automatically exported from code.google.com/p/macfusion
Other
1 stars 1 forks source link

ProFTPD 1.2.9 Server | FTP | beach balls | Keep Trying | Force Eject | etc. | kill -9 | did not kill curlftpfs- | remote sudo halt #152

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
Details to follow. 

Original issue reported on code.google.com by grahampe...@gmail.com on 24 May 2007 at 9:53

GoogleCodeExporter commented 8 years ago
<http://pastie.textmate.org/private/vrqa3tahwrpvi8mchn>

Original comment by grahampe...@gmail.com on 24 May 2007 at 9:53

GoogleCodeExporter commented 8 years ago
<ftp://gjp4@luna.brighton.ac.uk/>
MacFusion 1.1
MacFUSE 0.3.0
Mac OS X 10.4.9

Finder
attempt to copy two files to luna: 

  -.html
  ._._foo.bar

10:02:49 copy attempted
...
interim events are noted separately, 
available on request (probably to follow)
...
10:21:27 Force Eject
...
much later, 
kill -9 
did not kill curlftpfs-static
did not kill fuse_daemon

ultimately I had to ssh in remotely from a nearby desk then 
sudo halt 
but that didn't yield a proper halt, I had to press and hold the power button 
to force a stop. 

Logs to follow. 

Original comment by grahampe...@gmail.com on 24 May 2007 at 10:29

Attachments:

GoogleCodeExporter commented 8 years ago
[macbookpro03:~] gjp22% ftp gjp4@luna.bton.ac.uk
Connected to luna.bton.ac.uk.
220 ProFTPD 1.2.9 Server ready.
331 Password required for gjp4.
Password:
230 User gjp4 logged in.
Remote system type is UNIX.
Using binary mode to transfer files.
ftp> bye
221 Goodbye.

(From the command line, no problem.)

Original comment by grahampe...@gmail.com on 24 May 2007 at 5:40

GoogleCodeExporter commented 8 years ago
I'm adding an uncommon label 

  ProFTPD

I should test again using a more normal file

  test.txt

comprising two words

  hello world

Original comment by grahampe...@gmail.com on 24 May 2007 at 5:42

GoogleCodeExporter commented 8 years ago
Cyberduck copied 
test.txt
in a flash. 

Quit from Cyberduck. 

##

MacFusion FTP connection to the same server. 

Within around one second of the attempt, 
beach ball and 
stopped clock

Around three minutes later, I opted to Force Eject. 

Arising from that point are 
MacFusion issue 154 and 
MacFusion issue 155 

(I'm adding this comment after the event, don't be confused by the chronology.)

Original comment by grahampe...@gmail.com on 24 May 2007 at 7:31

GoogleCodeExporter commented 8 years ago
Probable action: draw this issue to the attention of MacFUSE Project.

Original comment by grahampe...@gmail.com on 24 May 2007 at 7:50

GoogleCodeExporter commented 8 years ago
Last login: Fri May 25 06:16:55 on ttyp1
Welcome to Darwin!
[grahamperrin:~] gjp22% ls -l /System/Library/Spotlight/
total 0
drwxr-xr-x    3 root     wheel         102 Feb 10  2006 Application.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 Audio.mdimporter
drwxr-xr-x    3 root     wheel         102 Feb 10  2006 Bookmarks.mdimporter
drwxr-xr-x    3 root     wheel         102 Mar  2  2006 Chat.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 Font.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 Image.mdimporter
drwxr-xr-x    3 root     wheel         102 Apr 14  2006 Mail.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 PDF.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 PS.mdimporter
drwxr-xr-x    3 root     wheel         102 Apr 14  2006 QuartzComposer.mdimporte
drwxr-xr-x    3 root     wheel         102 Apr 14  2006 QuickTime.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 14  2006 RichText.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 14  2006 SystemPrefs.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 iCal.mdimporter
drwxr-xr-x    3 root     wheel         102 Jan 13  2006 iPhoto.mdimporter
drwxr-xr-x    3 root     wheel         102 Apr 14  2006 vCard.mdimporter
[grahamperrin:~] gjp22% ls -l /Library/Spotlight/
total 0
drwxrwxr-x    3 root     admin         102 Jan 13  2006 AppleWorks.mdimporter
drwxrwxr-x    3 root     admin         102 Feb 14  2006 Keynote.mdimporter
drwxrwxr-x    3 gjp22    admin         102 May  8 21:55 Microsoft Entourage.mdim
drwxrwxr-x    3 root     admin         102 Feb 14  2006 Microsoft Office.mdimpor
drwxrwxr-x    3 root     admin         102 Feb 14  2006 Pages.mdimporter
drwxrwxr-x    3 root     admin         102 May 28  2005 SourceCode.mdimporter
drwxr-xr-x    3 root     admin         102 Nov 27 19:35 Ziplight.mdimporter
drwxrwxr-x    3 root     admin         102 Feb 10  2006 iMovie.mdimporter
drwxrwxr-x    3 root     admin         102 Feb 11  2006 iWeb.mdimporter
drwxr-xr-x    3 root     admin         102 Oct 22  2006 tarimporter.mdimporter
[grahamperrin:~] gjp22% ls -l ~/Library/Spotlight/
ls: /Users/gjp22/Library/Spotlight/: No such file or directory

Original comment by grahampe...@gmail.com on 25 May 2007 at 5:19

GoogleCodeExporter commented 8 years ago
In a system.log.0.gz I see 
May 24 07:56:09 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:56:34 grahamperrin kernel[0]: MacFUSE: starting (version 0.3.0, May  
6 2007, 23:01:47)
May 24 07:56:58 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file
May 24 07:57:25 grahamperrin mdimportserver[3272]: TarImporter: zip file

and so on

so I although I have not previously suspected a problem with TarImporter, I 
have moved all plug-ins from
/Library/Spotlight

and the revised comprehensive list of 
.mdimporter files is at
<http://pastie.textmate.org/private/ydtqrocatk8rd9lotc> 

I'll restart. 

Original comment by grahampe...@gmail.com on 25 May 2007 at 5:37

GoogleCodeExporter commented 8 years ago
Attached: 

Files that were probably created at around the time of this issue being opened, 
subsequently recovered from 
Trash.

Listed at 
<http://pastie.textmate.org/64478>

Original comment by grahampe...@gmail.com on 25 May 2007 at 5:41

Attachments:

GoogleCodeExporter commented 8 years ago
2007-05-25
UK times

07:30:00 attempted FTP connection luna.bton.ac.uk gjp4
07:30:03 clock stopped, beach ball
07:32:25 clock resumed, bounced back, mount successful

07:33    used Finder to create a hierarchy

/Volumes/luna/MacFUSE/MacFusion/152

-- very responsive. 

Working with a existing local file 
    text.txt 
comprising two words
    hello world
4 KB in data fork
     no resource fork

07:35:00 Finder copy text.txt to 
/Volumes/luna/MacFUSE/MacFusion/152

no beach ball, but I have to 
    Keep Trying
and Finder presents the following dialogue: 

> Copy
> Copying "test.txt" ton "152"
> progress bar at nil point
> 1 KB of 1 KB - About 5 seconds

!! 1 KB < 4 KB 

Whilst I 
    Keep Trying
I launch Cyberduck for alternative view of the remote directory. 

!! Sure enough, as I expected, two files: 

  ._test.txt  82 B
    test.txt  11 B

._test.txt 
includes the following human-readable text: 

2••• •••••••R••••TEXT!Rch

(gremlins replaced with • for legibility)

  test.txt
comprises the proper content
  hello world

07:42:45 

I hear a 'Finder copy complete' type of noise in the background
and the Copy dialogue has disappeared from view but when I
single-click on 
test.txt
in column view: 

  * the icon is incomplete
  * preview column is empty
  * Finder beach balls
  * and I repeatedly Keep Trying

time now: 

07:48:40

and this document is being saved to a SFTP server thanks to
TextWrangler so I need not worry about a forthcoming forced
shutdown; this record will be saved elsewhere :)

> TEXT!Rch

that is, 
file type    TEXT (self-explanatory)
file creator TextWrangler

!Rch mentioned at <http://daringfireball.net/2003/02/wrangly>.

At this point I'm reminded of 
<http://code.google.com/p/macfusion/issues/detail?id=6> and 
<http://code.google.com/p/macfusion/issues/detail?id=154> and I
wonder whether Finder would have been less likely to beach ball if
I had *not* attempted to select, in Finder, the 'unfinished'
remote copy of the file. 

Interesting to comare the type and creator codes here 
    TEXT!Rch
with type and creator codes at 
<http://code.google.com/p/macfuse/issues/detail?id=159#c23>
    brokMACS

Here, it's a text file created by TextWrangler. 
In MacFUSE issue_159 it was a 
busy (bzy) (brok) file created by Finder. 

I wonder about the differences between 
sshfs-static (which yields 
   brokMACS
in the event of a failed or failing copy) and 
curlftpfs-static (which yields 
   TEXT!Rch
in a similar event). 

I wonder whether we can collectively improve
MacFUSE and/or MacFusion and/or curlftpfs and/or 
all other plug-ins to adopt the 
   brokMACS
approach -- on the _assumption_ that 

    Finder will be 
    less likely to beach ball if it 
    _knows_ that a file is busy 
    when the user selects it in column view

    -- specifically: I imagine that because the 
    file is not marked as busy, Finder is 
    proceeding to preview the file, and 
    that's what may be causing such tricky 
    beach balls.

It's worth mentioning that I nearly always prefer column view in
Finder, so if other users don't suffer beach balls as serious as
me it could be because they are preferring a view that does not
attempt to read a file's contents at the moment of selection
(before a File | Open command).

08:07:45 I have waited more than long enough so I'll Force Eject and
be prepared for an un-killable process and a requirement to force
shutdown...

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:08

GoogleCodeExporter commented 8 years ago

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:08

GoogleCodeExporter commented 8 years ago
At aorund 08:10 I opted to 
Force Eject

This time, no need to force shutdown :)
and the mount point was removed :)

[grahamperrin:~] gjp22% ls -l /Volumes
total 0
lrwxr-xr-x    1 root     admin           1 May 25 06:49 MBP -> /

##

MacFusion Core: Loaded FTPFS filesystem from org.mgorbach.MacFusion.FTPFS
MacFusion Core: Loaded SSHFS filesystem from org.mgorbach.MacFusion.SSHFS
luna: Enter host password for user 'gjp4': 
luna: Error connecting to ftp: Access denied: 530 
luna: Mount Failed
luna: Enter host password for user 'gjp4': 
luna: kextload: /Library/Extensions/fusefs.kext loaded successfully 
luna: Mount OK
luna: Unmount OK

(Ignore the password rejections, I recently changed my password but forgot to 
save the changes to keychain 
prior to using MacFusion.)

## extract from system.log

May 25 07:14:42 grahamperrin mdimportserver[828]: *** Failed to decode  data, 
treating as binary
May 25 07:14:43 grahamperrin mdimportserver[828]: *** Failed to decode  data, 
treating as binary
May 25 07:20:10 grahamperrin kernel[0]: jnl: close: flushing the buffer cache 
(start 0x28b600 end 0x28f800)
May 25 07:30:03 grahamperrin kernel[0]: MacFUSE: starting (version 0.3.0, May  
6 2007, 23:01:47)
May 25 07:36:21 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:38:54 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:40:11 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:42:44 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:44:01 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:46:34 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:49:08 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:51:42 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:52:59 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:54:16 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:55:32 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 07:58:05 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 08:00:39 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 08:00:39 grahamperrin kernel[0]: MacFUSE: failed to get fh from strategy 
(err=13)
May 25 08:03:12 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 08:05:46 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 08:08:19 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 08:09:35 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=13)
May 25 08:10:26 grahamperrin kernel[0]: MacFUSE: OUCH! daemon did not give fh 
(type=0, err=57)
May 25 08:10:26 grahamperrin KernelEventAgent[50]: tid 00000000 received 
unknown event (33)
May 25 08:10:26 grahamperrin kernel[0]: MacFUSE: forcing unmount on dead file 
system

## nothing of interest in console.log

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:14

GoogleCodeExporter commented 8 years ago
During an earlier Jabber group chat with Robson and Michael, Robson observed: 

> Hm, the server has issues with extended passive mode

so to this issue I am adding an uncommon label

  ExtendedPassiveMode

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:18

GoogleCodeExporter commented 8 years ago
In Jabber chat I thought out loud: 

> If we at ~MacFusion respect Finder's *use* of 
> type codes and creator codes, and Finder's *use* of 
> ._ files
> 
> then I suspect... that a solution may be for the 
> *timing* of the two counterparts to be 
> more sensitive to MacFUSE environments, something like
> 
> 1) write then close 
>   ._foo.bar
>     to include, within the file, the string 
>     brokMACS
> 
> 2) write then close
>     foo.bar
> 
> 3) IF the source file had NO resource fork
>   THEN remove
>   ._foo.bar
>   
>   IF the source file DID have a resource fork
>   THEN write the matching type and creator string within 
>   ._foo.bar
> 
> foo.bar at the destination will require no legacy type code or creator
> code _within_ the file itself, because the (single-fork) destination
> file system does not support such attributes at that level. 
> 
> Summary
> -------
> 
> Accept the use of ._ files. 
> 
> Suggestion: alter the timing of writes (avoid concurrency).
> 
> Also, the developer of CurlFtpFS mentioned multiplexing. 

-- I am since advised that this would not necessarily work. 

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:50

GoogleCodeExporter commented 8 years ago
> but that would only work if the target server supports 
> resuming downloads/uploads

> also, it would leave the remote data in an 
> inconsistent state for a potentially long time

> ... my understanding of FTP is that each transfer requires 
> opening a new connection to the server ...

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:54

GoogleCodeExporter commented 8 years ago

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:56

GoogleCodeExporter commented 8 years ago

Original comment by grahampe...@gmail.com on 25 May 2007 at 7:57

GoogleCodeExporter commented 8 years ago
We're advised that the issue, for some types of FTP connection, relates to 
EPSV -- Extended Passive Mode, mentioned at 
<http://www.faqs.org/rfcs/rfc2428.html> -- and that 
EPSV may be relevant only in an IPv6 world. 

CurlFtpFS developer Robson Braga Araujo is working towards a fix for us :-)

Original comment by grahampe...@gmail.com on 26 May 2007 at 7:03

GoogleCodeExporter commented 8 years ago
Tested an anonymous FTP connection with MacFusion 1.2 Beta 1, 
-odisable_epsv
resolved the issue with this previously troublesome connection.

{
    FSType = FTPFS; 
    StoredObject = {
        advancedOptions = "-odisable_epsv"; 
        hostName = "ftp.oreilly.com"; 
        iconPath = "/Applications/MacFusion/MacFusion.app/Contents/PlugIns/FTPFS.plugin/Contents/
Resources/FTPFS.icns"; 
        login = ""; 
        mountOnStartup = 0; 
        name = OReilly; 
        path = ""; 
    }; 
}

Original comment by grahampe...@gmail.com on 23 Jun 2007 at 6:48

GoogleCodeExporter commented 8 years ago
Fixed by Michael in MacFusion 1.2 Beta 2, which uses the more recent curlftpfs.

Verified by Graham.

Original comment by grahampe...@gmail.com on 27 Jun 2007 at 4:30