Page 1 of 3 123 LastLast
Results 1 to 10 of 22

Thread: huge masses of cache files in KDE 4 slow down system - 18544 files in /home/(user)/.thumbnails

  1. #1

    Arrow huge masses of cache files in KDE 4 slow down system - 18544 files in /home/(user)/.thumbnails

    hi all,

    I'm just doing some backup of the data in my user directory /home/(user)/ prior to some installation of a more recent version of openSUSE.

    When trying to just copy all (hidden and non-hidden) data from there (only 6GB) it tells me that that would take more than 19 hours.

    By that way I discovered that there are more than 18500 thumbnails of partly quite old private photos in (invisible) directory .thumbnails in /home/(user)/ ,
    which seemed to have been stored during previews of these photos using KDE 4, but never removed.

    Because of the great number of files, entering that directory through KDE (which results in the listing of the files) takes much time, which on my PC (Pentium III) will be more obvious than on faster systems.

    Are there more features of that kind in KDE 4 ?

    E.g. during copying the system anyway hangs from time to time (sometimes even the clock stops counting the seconds).

    I'm running KDE 4.3.5 / openSUSE 11.2.

    Is this resolved in later versions of KDE 4 / openSUSE ?

    Or are there any tools like 'springcleaning' to remove obsolete files under KDE / openSUSE ?

    Best wishes
    Mike

  2. #2
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544files in /home/(user)/.thumbnails

    On 2012-05-13 17:46, ratzi wrote:
    > Because of the great number of files, entering that directory through
    > KDE (which results in the listing of the files) takes much time, which
    > on my PC (Pentium III) will be more obvious than on faster systems.


    I don't know how to limit the number of thumbnails, but you can browse it
    with another browser: use "mc", midnight commander. Text mode. You can
    erase all those thumbnails.

    --
    Cheers / Saludos,

    Carlos E. R.
    (from 11.4 x86_64 "Celadon" at Telcontar)

  3. #3
    Join Date
    Mar 2010
    Location
    Austin - Texas
    Posts
    10,140
    Blog Entries
    48

    Smile Re: huge masses of cache files in KDE 4 slow down system - 18544 files in /home/(user)/.thumbnails

    Quote Originally Posted by ratzi View Post
    hi all,

    I'm just doing some backup of the data in my user directory /home/(user)/ prior to some installation of a more recent version of openSUSE.

    When trying to just copy all (hidden and non-hidden) data from there (only 6GB) it tells me that that would take more than 19 hours.

    By that way I discovered that there are more than 18500 thumbnails of partly quite old private photos in (invisible) directory .thumbnails in /home/(user)/ ,
    which seemed to have been stored during previews of these photos using KDE 4, but never removed.

    Because of the great number of files, entering that directory through KDE (which results in the listing of the files) takes much time, which on my PC (Pentium III) will be more obvious than on faster systems.

    Are there more features of that kind in KDE 4 ?

    E.g. during copying the system anyway hangs from time to time (sometimes even the clock stops counting the seconds).

    I'm running KDE 4.3.5 / openSUSE 11.2.

    Is this resolved in later versions of KDE 4 / openSUSE ?

    Or are there any tools like 'springcleaning' to remove obsolete files under KDE / openSUSE ?

    Best wishes
    Mike
    So thumbnails in KDE 4 are kept in the hidden folder (where ~ is your home folder name)

    ~/.thumbnails

    I find two folders within called large and normal. WIth no program running that creates them, you can remove any of the png files held within. If needed, they will just be recreated for you.

    In Gwenview, as it can be used to create these, you can set it to: Configure -> Advanced -> Cache -> delete on exit, which will reduce the left over png files done by default. I found one person's description on when/how these are created for you:

    From the source code it seems as though the preview handler does the following checks to see if a cached thumbnail can be loaded:

    - is there a .thumbnail folder
    - is there a png-file in that folder with the correct name (an md5 hash of the path to the movie)
    - does the png contain a chunk (metadata) containing the correct timestamp
    - does the png contain a chunk with the full path to the movie
    Thank You,
    Last edited by jdmcdaniel3; 13-May-2012 at 09:03.
    My Blog: https://forums.opensuse.org/blogs/jdmcdaniel3/

    Software efficiency halves every 18 months, thus compensating for Moore's Law

    Its James again from Austin, Texas

  4. #4
    Join Date
    Mar 2009
    Location
    sri mayapur, west bengal, india
    Posts
    958

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544files in /home/(user)/.thumbnails

    On Sun, 13 May 2012 21:36:02 +0530, jdmcdaniel3
    <jdmcdaniel3@no-mx.forums.opensuse.org> wrote:

    >
    > ratzi;2462398 Wrote:
    >> hi all,
    >>
    >> I'm just doing some backup of the data in my user directory
    >> /home/(user)/ prior to some installation of a more recent version of
    >> openSUSE.
    >>
    >> When trying to just copy all (hidden and non-hidden) data from there
    >> (only 6GB) it tells me that that would take more than 19 hours.
    >>
    >> By that way I discovered that there are more than 18500 thumbnails of
    >> partly quite old private photos in (invisible) directory .thumbnails in
    >> /home/(user)/ ,
    >> which seemed to have been stored during previews of these photos using
    >> KDE 4, but never removed.
    >>
    >> Because of the great number of files, entering that directory through
    >> KDE (which results in the listing of the files) takes much time, which
    >> on my PC (Pentium III) will be more obvious than on faster systems.
    >>
    >> Are there more features of that kind in KDE 4 ?
    >>
    >> E.g. during copying the system anyway hangs from time to time
    >> (sometimes even the clock stops counting the seconds).
    >>
    >> I'm running KDE 4.3.5 / openSUSE 11.2.
    >>
    >> Is this resolved in later versions of KDE 4 / openSUSE ?
    >>
    >> Or are there any tools like 'springcleaning' to remove obsolete files
    >> under KDE / openSUSE ?
    >>
    >> Best wishes
    >> Mike

    >
    > So thumbnails in KDE 4 are kept in the hidden folder (where ~ is your
    > home folder name)
    >
    > ~/.thumbnails
    >
    > I find two folders within called large and normal. WIth no program
    > running that creates them, you can remove any of the png files held
    > within. If needed, they will just be recreated for you.
    >
    > In Gwenview, as it can be used to create these, you can set it to:
    > Configure -> Advanced -> Cache -> delete on exit, which will reduce the
    > left over png files done by default. I found one person's description
    > on when/how these are created for you:
    >
    >> From the source code it seems as though the preview handler does the
    >> following checks to see if a cached thumbnail can be loaded:
    >>
    >> - is there a .thumbnail folder
    >> - is there a png-file in that folder with the correct name (an md5 hash
    >> of the path to the movie)
    >> - does the png contain a chunk (metadata) containing the correct
    >> timestamp
    >> - does the png contain a chunk with the full path to the movie

    >



    i think it would be better to leave those cache folders (and links; under
    ~/.kde4/ there's links to various KDE folders under /tmp) out of your
    backup.

    if you do your backup manually, you only need a list of folders that don't
    have to be backed up. if you use rsync, it's pretty much the same --
    either from the command line, or via exclude file(s). i haven't used any
    dedicated backup applications, but believe they all allow you to exclude
    directories or file/type patterns.

    depending how often you do these backups, if you empty all caches every
    time, KDE will have to re-create those and take it's time to do so.

    --
    phani.

  5. #5
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544files in /home/(user)/.thumbnails

    On 2012-05-13 18:31, phanisvara das wrote:
    > depending how often you do these backups, if you empty all caches every
    > time, KDE will have to re-create those and take it's time to do so.


    Yes, but as the cache does not timeout, it can keep thumbnails of files
    that are no longer in the system. I don't know what it does with files that
    were moved elsewhere: are the thumbnails retained, or cleared somehow?

    --
    Cheers / Saludos,

    Carlos E. R.
    (from 11.4 x86_64 "Celadon" at Telcontar)

  6. #6
    Join Date
    Mar 2009
    Location
    sri mayapur, west bengal, india
    Posts
    958

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544files in /home/(user)/.thumbnails

    On Sun, 13 May 2012 22:18:06 +0530, Carlos E. R.
    <robin_listas@no-mx.forums.opensuse.org> wrote:

    > On 2012-05-13 18:31, phanisvara das wrote:
    >> depending how often you do these backups, if you empty all caches every
    >> time, KDE will have to re-create those and take it's time to do so.

    >
    > Yes, but as the cache does not timeout, it can keep thumbnails of files
    > that are no longer in the system. I don't know what it does with files
    > that
    > were moved elsewhere: are the thumbnails retained, or cleared somehow?
    >



    some of the stuff actually resides under /tmp, and that's cleared out
    whenever you tell it to.

    re. non-/tmp cache files under ~/.kde4, i don't know. but i never noticed
    the space increase into unmanageable proportions.

    i don't really care; these files don't need to be backed up, so i leave
    them out. they don't disturb me where they are, but if you want to make
    sure not to waste a few MB, you can clean them on the second friday of
    every month, or whatever. (backups should happen much more frequent than
    that, of course.)

    --
    phani.

  7. #7
    Join Date
    Jun 2008
    Location
    West Yorkshire, UK
    Posts
    3,431

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544files in /home/(user)/.thumbnails

    I never back up .cache or .local because all the things in them can easily be recreated; as they are normally recreated one at a time as you re-use them, the time taken is not significant unless you happen to go over something you did in the past which created a lot of them all at once.

    I have never suffered any adverse effects from this policy; others may have had different experiences.

  8. #8

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544 files in /home/(user)/.thumbnails

    Hi you,

    thank you for your advice!

    Leaving just the (now) empty folders, I just deleted all those 18500+ thumbnails, which set free 1.2 GB of disk space.

    jdmcdaniel3:

    thank you for the hint with respect to Gwenview !
    I use it for about 1-2 years now.

    Many of the (quite old) thumbnails must however been created by previews made using KDE.

    phanisvara, john_hudson:

    I now left aside all of the hidden folders for my backup, except for one: ~/.thunderbird .
    I always had doubts that it would make sense to save mails in a hidden directory,
    but that clearly would be a question to mozilla.

    The ~/.kde4 folder after a few years of using the system still isn't that large:
    517 files in 87 directories using only 22 MB of disk space.
    That's quite OK!

    And Carlos: Yes, truely:
    >> Yes, but as the cache does not timeout, it can keep thumbnails of files
    >> that are no longer in the system.

    I probably may even have some of those thumbnails left from an older version of openSUSE, since - during the installation of newer versions of openSUSE - I used to only delete the system partition, leaving the user partition as is (in order to avoid restoring my data).

    Best wishes
    Mike

  9. #9
    Join Date
    Mar 2010
    Location
    Austin - Texas
    Posts
    10,140
    Blog Entries
    48

    Smile Re: huge masses of cache files in KDE 4 slow down system - 18544 files in /home/(user)/.thumbnails

    Quote Originally Posted by ratzi View Post
    Hi you,

    thank you for your advice!

    Leaving just the (now) empty folders, I just deleted all those 18500+ thumbnails, which set free 1.2 GB of disk space.

    jdmcdaniel3:

    thank you for the hint with respect to Gwenview !
    I use it for about 1-2 years now.

    Many of the (quite old) thumbnails must however been created by previews made using KDE.

    phanisvara, john_hudson:

    I now left aside all of the hidden folders for my backup, except for one: ~/.thunderbird .
    I always had doubts that it would make sense to save mails in a hidden directory,
    but that clearly would be a question to mozilla.

    The ~/.kde4 folder after a few years of using the system still isn't that large:
    517 files in 87 directories using only 22 MB of disk space.
    That's quite OK!

    And Carlos: Yes, truely:
    >> Yes, but as the cache does not timeout, it can keep thumbnails of files
    >> that are no longer in the system.

    I probably may even have some of those thumbnails left from an older version of openSUSE, since - during the installation of newer versions of openSUSE - I used to only delete the system partition, leaving the user partition as is (in order to avoid restoring my data).

    Best wishes
    Mike
    Sounds like you found what you were looking for Mike. We do have a good bunch of guys (and Gals) here. We just need to all row in the same direction. Actually, it is often more like a herd of cats, but who is complaining. I was happy to help and happy to see you get what you needed.

    Thank You,
    My Blog: https://forums.opensuse.org/blogs/jdmcdaniel3/

    Software efficiency halves every 18 months, thus compensating for Moore's Law

    Its James again from Austin, Texas

  10. #10
    Join Date
    Feb 2009
    Location
    Spain
    Posts
    25,547

    Default Re: huge masses of cache files in KDE 4 slow down system - 18544files in /home/(user)/.thumbnails

    On 2012-05-14 03:36, ratzi wrote:

    > I now left aside all of the hidden folders for my backup, except for
    > one: ~/.thunderbird .
    > I always had doubts that it would make sense to save mails in a hidden
    > directory, but that clearly would be a question to mozilla.


    You can change where thunderbird really stores its mail. Most hidden
    directories are important for something or other, should not be deleted.


    > I probably may even have some of those thumbnails left from an older
    > version of openSUSE, since - during the installation of newer versions
    > of openSUSE - I used to only delete the system partition, leaving the
    > user partition as is (in order to avoid restoring my data).


    My home directory is the same since 1998. If I migrate to another computer,
    I copy my entire home folder, with all the hidden directories. No problem :-)


    --
    Cheers / Saludos,

    Carlos E. R.
    (from 11.4 x86_64 "Celadon" at Telcontar)

Page 1 of 3 123 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •