Page 1 of 4 123 ... LastLast
Results 1 to 10 of 35

Thread: 13.1 freezes while copying files

  1. #1

    Default 13.1 freezes while copying files

    Hi all

    The system:

    It is an otherwise stable running openSUSE 13.1 64bit on a new hard disk with the latest updates made.
    Desktop is KDE.
    Dual-boot with win7.
    Core i5 with 8 GB RAM.
    ASUS motherboard.
    Intel onboard graphics.
    Traditional partition table (MBR).

    The job:

    Copy a bit more than one million files from a backup on an external 2TB USB 3.0 hard disk (formatted NTFS)
    to a freshly formatted 1.2TB NTFS partition - win7 'drive' D: .
    I started that job yesterday night.

    The symptoms:

    In the 'Digital Clock Settings' I did choose that the seconds are shown.
    But when I come back to the machine, the seconds aren't counted anymore by the 'Digital Clock',
    or only sporadically at intervals of sometimes more than 10 minutes.

    Further, I had the impression that copying had slowed down.

    I tried to cancel copying by clicking the 'stop' button in the notifications.

    Seconds not counted again by the 'Digital Clock'.

    15 mins later, copying actually stopped.

    Still the desktop was not responsive !

    I had to Ctrl-Alt-F1 and after login say 'shutdown -h now'.

    Any idea?
    Mike

  2. #2
    Join Date
    Jun 2008
    Location
    Netherlands
    Posts
    24,603

    Default Re: 13.1 freezes while copying files

    Rather good problem description. Only that fails from my point of view is how you started the copying (I would pobably do a form of the cp command, but you may do completely different).

    BTW (and purely personal amazement), is Linux realy better in doing this copying from a non-LInux fs to another non-Linux fs than a native to the fs's Windows system?
    Henk van Velden

  3. #3

    Default Re: 13.1 freezes while copying files

    Hi Henk!

    Quote Originally Posted by hcvv View Post
    Rather good problem description. Only that fails from my point of view is how you started the copying (I would pobably do a form of the cp command, but you may do completely different).
    I used the desktop, logged in as root, dragging the selected directories to the other Dolphin window.

    Quote Originally Posted by hcvv View Post
    BTW (and purely personal amazement), is Linux realy better in doing this copying from a non-LInux fs to another non-Linux fs than a native to the fs's Windows system?
    Apart from the point with the freezing:

    absolutely, yes, it is!

    Beforehand I tried to copy contents of the NTFS 'drive' D: to another external USB hard disk using win7.
    Those previous contents of 'drive' D: resulted from cloning (using dd) the failing internal hard disk
    that was present in the PC beforehand.

    For a few times win7 just refused to do the job.
    It aborted - while collecting the data to be copied - without any error message !

    Much worse: when I did choose to copy smaller amounts of the data, win7 did not abort,
    but after finishing the last copy, and re-booting, that external NTFS hard disk wasn't readable any more !!
    And win7 was not able to repair that.
    Obviously win7 had shot the NTFS on that external disk.

    I just never experienced such a behaviour under Linux,
    neither with Linux-native file systems, nor with NTFS or FAT ...

    In fact, using openSUSE, I could make a backup copy to a second external NTFS hard disk
    (and to a third external USB hard disk formatted ReiserFS)
    from which I wanted to restore the data now.

    Thanks
    Mike

  4. #4
    Join Date
    Jun 2008
    Location
    Netherlands
    Posts
    24,603

    Default Re: 13.1 freezes while copying files

    Quote Originally Posted by ratzi View Post
    I used the desktop, logged in as root, ...
    That realy shocks me. Was not able to read any further.
    Henk van Velden

  5. #5

    Default Re: 13.1 freezes while copying files

    Quote Originally Posted by hcvv View Post
    That realy shocks me. Was not able to read any further.
    The reason was that I didn't want to type (or copy/paste) dozens of directory names,
    while on the other hand I still need root privileges to write to NTFS partition D: .
    The latter may either be so because I didn't edit polkit settings yet,
    or because I checked "don't mount at startup" in the mount options of YaST's partitioner,
    or both.

    At least I unplugged the ethernet cable before proceeding.

  6. #6
    Join Date
    Jun 2008
    Location
    Netherlands
    Posts
    24,603

    Default Re: 13.1 freezes while copying files

    I do not know what the ethernet cable has to do with loging in as root in the GUI (or with all other self-inflicting injuries one might do on one's system), but I feel not authorized to get a complete image of what you have done and what the consequenses may be. In my working live I would have got a large quarrel with mu boss about such a situation. Now, being a volunteer, I stop where my expertise stops.

    Maybe others have more imagination.
    Henk van Velden

  7. #7
    Join Date
    Sep 2012
    Posts
    4,921

    Default Re: 13.1 freezes while copying files

    Quote Originally Posted by ratzi View Post
    I had to Ctrl-Alt-F1 and after login say 'shutdown -h now'.

    Any idea?
    Not really. If you were able to login to tty1, system was not frozen (contrary to subject). So what you had to do was to investigate - check current CPU load (using top would already provide some useful information), check memory and swap consumption, check disk activity. This would give some starting point. My best bet - program you used to copy files filled up all available memory so system started to swap heavily.

  8. #8
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: 13.1 freezes while copying files

    On 2014-06-02 12:06, ratzi wrote:
    >
    > Hi Henk!
    >
    > hcvv;2646893 Wrote:
    >> Rather good problem description. Only that fails from my point of view
    >> is how you started the copying (I would pobably do a form of the cp
    >> command, but you may do completely different).

    >
    > I used the desktop, logged in as root, dragging the selected directories
    > to the other Dolphin window.


    Login as root in the desktop is anathema here :-)

    You have been godwinated :-p


    For doing large copy jobs, I refuse to use Dolphin or anything similar.
    I simply use 'mc' in a terminal where I do "su -" first.


    (using windows for the copy)


    > For a few times win7 just refused to do the job.
    > It aborted - while collecting the data to be copied - without -any-
    > error message !


    Maybe one of those disks, source or destination, has the ntfs filesystem
    badly corrupted. See that both systems have problems. I would look at
    the Linux syslog during the problem period.


    > Much worse: when I did choose to copy smaller amounts of the data, win7
    > did not abort,
    > but after finishing the last copy, and re-booting, that external NTFS
    > hard disk wasn't readable any more !!


    Well, you do have problems with that disk.

    > And win7 was not able to repair that.
    > Obviously win7 had shot the NTFS on that external disk.


    I know of a certain proprietary application that does a good job of
    recovering files out of a bad ntfs partition, and it is not expensive,
    if that's what you want... (yes, I tried photorec first. Horrible).


    --
    Cheers / Saludos,

    Carlos E. R.
    (from 13.1 x86_64 "Bottle" at Telcontar)

  9. #9

    Default Re: 13.1 freezes while copying files

    Hi arvidjaar!

    Quote Originally Posted by arvidjaar View Post
    Quote Originally Posted by ratzi View Post
    I had to Ctrl-Alt-F1 and after login say 'shutdown -h now'.

    Any idea?
    Not really. If you were able to login to tty1, system was not frozen (contrary to subject). So what you had to do was to investigate - check current CPU load (using top would already provide some useful information), check memory and swap consumption, check disk activity. This would give some starting point. My best bet - program you used to copy files filled up all available memory so system started to swap heavily.
    That swap may have been used seems to be a very likely scenario.
    But it may not be the whole story.

    I finally decided to copy the data in smaller portions.

    That works quite well, but it doesn't solve every thing.

    Now I have a copy of 34'000 files (or 27 GB) running.

    Clicking on the chameleon in the lower left corner of the screen (or the 'Kickoff Application Launcher')
    the clock freezes again.

    Then I hit Ctrl-Alt-F1, and logged in as root, to enter 'top' and 'free'.

    The system again lags considerably - the login took time, and I had to wait minutes before the system returned to the desktop session after hitting Ctrl-Alt-F7 from there.

    Since that system is almost frozen I'm no longer able to copy outputs of 'top' and 'free' to an USB pen drive to transfer them to the machine that I'm using to write this. So I'm typing a few things by hand.

    'top' gives 7.3% of CPU for plasma-desktop, 3.3% for mount.ntfs-3g, and a few entries (Xorg, kio_file) just below 1%.
    The rest is negligible.

    'free' gives (again after some time)
    Code:
                total     used      free  shared  buffers   cached
    Mem:      7891596  7768600    122996   42444  3485388  3829696
    -/+ buffers/cache:  453516   7438080
    Swap:    16777212        0  16777212
    The program I used to copy the files is the file manager of KDE: dolphin.

    Disk activity: the LED indicating disk activity (signal provided by the ASUS motherboard)
    is flickering all the time at high frequency.

    Thanks
    Mike

  10. #10
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: 13.1 freezes while copying files

    On 2014-06-02 23:56, ratzi wrote:


    > The program I used to copy the files is the file manager of KDE:
    > dolphin.


    Use 'mc', in a terminal.

    [CODE]
    su -
    mc
    [CODE]


    > Disk activity: the LED indicating disk activity (signal provided by the
    > ASUS motherboard)
    > is flickering all the time at high frequency.


    Try "iotop -o" on tty1 or 2, as root. It will tell you what is using the
    disk, and how much.

    --
    Cheers / Saludos,

    Carlos E. R.
    (from 13.1 x86_64 "Bottle" at Telcontar)

Page 1 of 4 123 ... LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •