Results 1 to 7 of 7

Thread: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

  1. #1

    Default cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    I just upgraded (fresh install) to opensuse 12.3 64 bit. Using gnome 3 but also have kde installed.
    So
    when I copy a folder from one partition to another it sucked up all my cpu (quad core intel; see sig,desktop)
    I copied using dolphin. it was a ntfs-3g partition to a ext4 partition. I am using cfq I/O scheduler, but changed to deadline and noop without any improvement.

    So to test I also copied the same folder to another folder, same partition, and it also hogged up all my cpu. Granted it was a 39GB folder but I never had this in 12.2 32 bit
    Then to test some more I used cp and rsync and they too hogged up all my cpu (100%'s on all 4 cores most of the time)

    Also, a bit querky of gnome monitor, it shows cpu's are doing just fine like 2-12%
    ksysguard is telling a very different story.

    Also weird is that ksysguard AND gnome monitor both don't show which process is taking up all the cpu. In the process tab no process is taking up more than 1%

    And obviously, yes it is hogging the cpu because my computer is very very slow during those copy operations.
    The memory is fine 1.6GB of 3.8GB during those operations.

    I don't think I ever really had this problem before. I read somewhere it is more of a problem on 64bit.
    any info/suggestions.
    I mean the data is copied, but I don't want my system to be unusable later on during copy procedures.

    Thanks
    DESKTOP: Home built OS: opensuse 13.2 64 bit
    Asus p8h61-M LE/CSM | Intel i5-2500k 3.3Ghz Sandy Bridge | 4gb DDR3 | Intel integrated Video
    LAPTOP: Acer Aspire 4730z OS: opensuse 13.2 32 bit
    Intel Pentium dual-core 2.16Ghz T3400 | 3gb DDR2 | Intel Video

  2. #2
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    On 2013-03-17 01:06, cw9000 wrote:
    > So
    > when I copy a folder from one partition to another it sucked up all my
    > cpu (quad core intel; see sig,desktop)
    > I copied using dolphin. it was a ntfs-3g partition to a ext4
    > partition. I am using cfq I/O scheduler, but changed to deadline and
    > noop without any improvement.


    All your tests involved an ntfs partition?

    I ask because ntfs-3g can be quite CPU intensive. Test a large file copy
    without involving an ntfs partition, and see what happens.

    Just a comment: when I do large file copies and I fear that it will slow
    down my computer, I do it using "ionice -c 3 copy ...". It takes
    longer, of course, but I can keep working with faster desktop responses.

    --
    Cheers / Saludos,

    Carlos E. R.
    (from 11.4, with Evergreen, x86_64 "Celadon" (Minas Tirith))

  3. #3

    Default Re: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    All your tests involved an ntfs partition?

    I ask because ntfs-3g can be quite CPU intensive. Test a large file copy
    without involving an ntfs partition, and see what happens.

    Just a comment: when I do large file copies and I fear that it will slow
    down my computer, I do it using "ionice -c 3 copy ...". It takes
    longer, of course, but I can keep working with faster desktop responses.
    Thanks for the repsonse.

    No, I should have mentioned it was ext4 to ext4, same partition for the test.
    I ended up using
    ionice -c3 -p <pid of dolphin--found by (ps -a | grep dolphin | awk '{print $1}')>
    I noticed it changed I/O scheduler to idle in ksysguard (right-click process->set priority). I also (in ksysguard) brought down the cpu priority.
    it still lags, but not nearly as much. Even brought out the big dogs like Google earth. Skipping, definitely, but not as bad.

    just been having some problems with this install and the copy problem brought me to the forums.
    my next post "scim- problem with freezing up computer"

    ps do you know how I can automatically set any dolphin process with idle i/o priority and very low cpu priority? I mean other than monitoring ps -a | grep dolphin ?
    DESKTOP: Home built OS: opensuse 13.2 64 bit
    Asus p8h61-M LE/CSM | Intel i5-2500k 3.3Ghz Sandy Bridge | 4gb DDR3 | Intel integrated Video
    LAPTOP: Acer Aspire 4730z OS: opensuse 13.2 32 bit
    Intel Pentium dual-core 2.16Ghz T3400 | 3gb DDR2 | Intel Video

  4. #4
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    On 2013-03-17 02:26, cw9000 wrote:

    > ps do you know how I can automatically set any dolphin process with
    > idle i/o priority and very low cpu priority? I mean other than
    > monitoring ps -a | grep dolphin ?


    Just call dolphin from the ionice line. I mean, don't use use the PID,
    just a full command line that runs dolphin as a child of ionice. I have
    not done that, but it should work. I have tried dd, mc and it worked. If
    you also want low cpu priority, then chain "nice ionice -c 3 CLI line".

    Another utility is "cpulimit", if I got the the name right. It limits
    the percent of a given process by name, if I recall correctly. If the
    process dies, it stays waiting till another process of that name starts
    again, and then throttles it down as well. I found it useful with a
    problem I had time ago.

    I have not used it in a long time, so the version I have is old. A newer
    version may be different from what I just described.

    --
    Cheers / Saludos,

    Carlos E. R.
    (from 11.4, with Evergreen, x86_64 "Celadon" (Minas Tirith))

  5. #5
    Join Date
    May 2010
    Location
    Space Colony Lagrange Point 22° à, 77° Ƅ, 56° ɤ, 99° ɜ
    Posts
    3,166

    Default Re: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    Quote Originally Posted by cw9000 View Post
    ps do you know how I can automatically set any dolphin process with idle i/o priority and very low cpu priority? I mean other than monitoring ps -a | grep dolphin ?
    Before moving data(multiple sub folders,many small sized files in directories etc) around i archive those. Move the data and decompress those files. I found that archives give better transfer speeds than folders and files
    GNOME Version 3.20.2
    openSUSE Leap 42.3 64-bit

    www.vazhavandan.blogspot.com

  6. #6
    Join Date
    Jun 2008
    Location
    San Diego, Ca, USA
    Posts
    10,806
    Blog Entries
    1

    Default Re: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    Try seeing if a systemd Unit is hogging resources

    Code:
    systemd-cgtop
    Also, depending on how you're invoking your commands, you can nice or re-nice(preferred) to change the priority of running processes.

    If the offending app is invoked by a systemd Unit, you can modify the priority in the Unit configuration file.

    From what I've seen in the past though, file transfer operations can have problems that don't show up as CPU or RAM resources, only a deep analysis can see what is really happening.

    HTH,
    TSU

  7. #7

    Default Re: cp, rsync, dolphin all hogging up cpu during copy 12.3 64 bit

    Quote Originally Posted by tsu2 View Post
    Try seeing if a systemd Unit is hogging resources

    Code:
    systemd-cgtop
    Also, depending on how you're invoking your commands, you can nice or re-nice(preferred) to change the priority of running processes.

    If the offending app is invoked by a systemd Unit, you can modify the priority in the Unit configuration file.

    From what I've seen in the past though, file transfer operations can have problems that don't show up as CPU or RAM resources, only a deep analysis can see what is really happening.

    HTH,
    TSU
    I tried
    Code:
    systemd-cgtop
    during a file transfer ( poor computer keeps having to do the same operations over and over).
    Didn't seem like any systemd service was the culprit.

    @robin listas thank you for that. I set the Exec line in /usr/share/applications/kde4/dolphin.desktop to
    Code:
    nice -n 19 ionice -c3 dolphin %i -caption %c %u
    DESKTOP: Home built OS: opensuse 13.2 64 bit
    Asus p8h61-M LE/CSM | Intel i5-2500k 3.3Ghz Sandy Bridge | 4gb DDR3 | Intel integrated Video
    LAPTOP: Acer Aspire 4730z OS: opensuse 13.2 32 bit
    Intel Pentium dual-core 2.16Ghz T3400 | 3gb DDR2 | Intel Video

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •