Page 1 of 3 123 LastLast
Results 1 to 10 of 24

Thread: Nepomuk

  1. #1
    Join Date
    Feb 2009
    Location
    UK
    Posts
    1,085

    Default Nepomuk

    There was a brief period during which nepomuk actually sort of worked for me (a bit). But that is now over, and once again I am wasting my life trying to get the appalling mess of interconnected bugfest to do something useful. When the new problems began, I asked on the KDE forums, hoping that the folks there would have more expertise and experience with fault-finding and de-bugging, but despite the valiant efforts of one helpful and patient individual, nepomuk still refuses to do anything to earn its HDD space and CPU cycles.

    I won't paste the entire conversation from KDE forums, but to save passing viewers having to go there I shall paraphrase it. For the whole thing:
    http://forum.kde.org/viewtopic.php?f=154&t=117408

    I got a warning that my /home was full. I found that my soprano-virtuoso.db was 20Gb of a 65Gb /home dir. I deleted it, but it came back, and is now at 30Gb
    If I do a htop I see a number of processes of the form:

    Code:
    4791 ?        SNl  248:40 /usr/bin/virtuoso-t +foreground +configfile /tmp/virtuoso_Cj4345.ini +wait
    Nepomuk is only set to index /home (not hidden files) and a 100Gb media store containing music and video (I have given up with kmail as it was broken) What is causing this db to bloat uncontrollably? Why are the instances of virtuoso -t hogging resources and hanging around for so long?

    (The above had been running for 4 hours)

    How do I stop this happening?
    Is there an alternative to the whole akonadi/strigi/nepomuk/virtuoso mess? ie a simple file indexer that can be relied upon?

    I use opensuse 12.3 with KDE 4.11
    In reply to this I was asked to delete the whole data directory, which I duly did.

    Just a FYI, I deleted the db and the dir in which it resides, as above, at approx 10:30.
    It has gradually grown since then, and is now 740Mb. (12:00)

    Also this morning I did a zypper up, and some virtuoso/nepomuk etc components were upgraded, so I am going to reboot and hope that (!) something has improved.

    I am not sure that I understood bcooksley's point re. htop, but here is another....



    edit/ps soprano-virtuoso.db now at 826Mb, grown that much whilst I was writing this..
    bcooksley advised me to check for symlinks which might be recursing, which I duly did, with no untoward results. I re-enabled nepomuk, but told it ONLY to 'look' at my 'media store'

    But now the behaviour changed; the db stopped growing, BUT it ONLY indexes NEW files, and refuses to index the files which are there already. Does anyone have any ideas? I did ask on #KDE on IRC, the advice there was unanimous, everyone there reported that they had nepomuk switched off. I would really really like a way to search my HDD's quickly and easily. There is a bug reported here:

    https://bugs.kde.org/show_bug.cgi?id=321796

    Which advises that a workaround is simply to disable/re-enabled the directories to be indexed, I have of course tried this a number of times, but my .db still only contains files added since the .db was deleted and restarted.

    Tumbleweed/KDE/Ati Radeon R9 270/AMD FX-6300/8Gb DDR3

  2. #2

    Default Re: Nepomuk

    I remember having nepomuk hang with virtuoso, switching to soprano-backend-redland fixed it IIRC.
    But this was long time ago (4.3 or 4.4), I had since completely removed nepomuk.

  3. #3
    Join Date
    Jun 2008
    Location
    Groningen, Netherlands
    Posts
    19,806
    Blog Entries
    14

    Default Re: Nepomuk

    Hi wakou.

    I honestly wouldn't know any other suggestions than the usual ones:
    - check whether all KDE packages come from one repo, if uncertain, post output of
    Code:
    zypper lr -d
    - create a new user, see if the problem exists for that new user. If not
    -- delete nepomuk* from both ~/.kde4/share/config and ~/.kde4/share/apps whilst not being logged in.

    EDIT: I don't see the issue on both my machines, db's are ~140MB, nepomuk running with defaults.
    Last edited by Knurpht; 02-Oct-2013 at 06:26.
    ° Appreciate my reply? Click the star and let me know why.

    ° Perfection is not gonna happen. No way.

    https://en.opensuse.org/openSUSE:Board#Members
    http://en.opensuse.org/User:Knurpht
    http://nl.opensuse.org/Gebruiker:Knurpht

  4. #4

    Default Re: Nepomuk

    I had another bash/bleat on the kde mailing list recently. I would say the answer is not to use it and frankly it looks like things may get worse. I run kdepim3 and so far no problems at all. Desktop indexing is also turned off but I get good search times.

    Why might it get worse - well even the digital clock is going get tied in.

    Couple of links

    Kontact-Nepomuk Integration: Why data from akonadi is indexed in nepomuk | Finding New Ways…

    Akonadi - KDE UserBase Wiki

    The indexing link up is so that some one can say right click on a date and set an appointment. Great idea maybe but as some one pointed out is it worth dragging the entire indexing shooting match in just to do that.

    Some years ago from comments on the forum some did wonder about bringing back a version of Kmail 1, KDE4 uses Kmail 2. Looks like it will never happen. On the other hand I wonder if kdepim3 is still about for enterprise users.

    There is a video on YouTube entitled "why linux sucks". It's a linux fest presentation video so not what it might seem. Interestingly. the use of Unity is mentioned. That uses OpenBox as the default desktop. That one is a C rewrite of something that went C++ and is very basic as is Unity. There are also some kernel people who want to put the entire C library in the kernel. I get the impression that there may be a revolt against the sort of coding / implementation that KDE and others represent at some point and good luck to them. On the other hand there is a lot excitement about the use of Qt so it all maybe around for a long time.

    People who don't appreciate Open Source's problems should watch the video. There is also another one "why linux doesn't suck".

    The comments about SuSe are interesting.

    Should add I have nothing against C++ etc but there are clear indications that some aspects are being misused.


    John
    -

  5. #5
    Join Date
    Feb 2009
    Location
    UK
    Posts
    1,085

    Default Re: Nepomuk

    Yet again Knurpht is the hero of the hour! I sacked my long-term admin assistant, Natasha McTest, and employed her younger sister Tessa McTest. With an empty profile and just defaults in /home/tessa, I set nepomuk to index /home/tessa and /mediastore (which is in fstab, a HDD with music and radio etc) Nepomuk went off and did its work, silently (1) and without putting too much drain on either CPU or HDD. The /mediastore is about 100Gb. After a few hours, the
    Code:
    /home/tessa/.kde4/share/apps/nepomuk/repository/main/data/virtuosobackend/soprano-virtuoso.db
    file is steady at approx 170Mb. Search in Dolphin ACTUALLY WORKS!! (which led to a potentially embarrassing moment, when I clicked on 'videos' How on earth did THAT get in there?? delete, delete.... )

    Now I have somehow to find which file in my own /home directory is causing the problems. I did not know that nepo put files in ~/.kde4/share/config as well as in ~/.kde4/share/nepo/foo/foo/etc so I shall begin by renaming those one at a time.

    Or maybe just wait until 13.1 goes gold, and start again with a new /home altogether.... (lazy option)

    (1) A question, which would not be needed if I 100% trusted that everything was perfect. I would rather that it was NOT silent, is there something I could place in the panel to show when nepo is working, and what % of CPU etc it is using, just to keep an eye for future problems? There used to be such a thing (?) I suppose, if I had a functioning brain-cell, I could write a wee plasmoidwidget or whatever they are called to do just that. #notgoingtohappen


    Tumbleweed/KDE/Ati Radeon R9 270/AMD FX-6300/8Gb DDR3

  6. #6
    Join Date
    Feb 2009
    Location
    UK
    Posts
    1,085

    Default Re: Nepomuk

    I just went back to my own user and looked at the virtuoso-soprano.db. It has somehow got to 1.9Gb, despite being broken so that it ONLY indexes new files, so that it has only indexed 20 .mp3 files, 8 small jpegs/pngs and about 50 small .txt files. So is it worth me trying to preserve/document this state to present a bug report somewhere? If so, how best to go about that? Or should I just be selfish and delete it all and try to solve it?

    Tumbleweed/KDE/Ati Radeon R9 270/AMD FX-6300/8Gb DDR3

  7. #7
    Join Date
    Sep 2013
    Location
    Norfolk, UK
    Posts
    1,217

    Default Re: Nepomuk

    Whilst not being able to offer any immediate solutions...

    From personal experience I've found that ~/.kde4/share/config/nepomukstrigirc is a good contender to start with. (Obviously you'll need to reselect directories for indexing.)

    There are also some additional config entries listed here Nepomuk/FileIndexer - KDE UserBase Wiki to further control indexing and startup scan behaviour, or to enable debug mode.

    On my own system nepomuk is actually working quite well

  8. #8
    Join Date
    Feb 2009
    Location
    UK
    Posts
    1,085

    Default Re: Nepomuk

    Quote Originally Posted by tannington View Post
    Whilst not being able to offer any immediate solutions...

    From personal experience I've found that ~/.kde4/share/config/nepomukstrigirc is a good contender to start with. (Obviously you'll need to reselect directories for indexing.)

    There are also some additional config entries listed here Nepomuk/FileIndexer - KDE UserBase Wiki to further control indexing and startup scan behaviour, or to enable debug mode.

    On my own system nepomuk is actually working quite well
    I just had a quick look at that file..... and well well!
    Code:
    [General]
    exclude filters=autom4te,*.rcore,CTestTestfile.cmake,*.o,*.omf,.hg,*.m4,*.orig,moc_*.cpp,conftest,.xsession-errors*,CMakeTmpQmake,*.tmp,po,.svn,.histfile.*,lzo,.bzr,.git,litmain.sh,cmake_install.cmake,CMakeFiles,*.pc,*.nvram,*.elc,*.la,CMakeCache.txt,confdefs.h,*.gmo,*.csproj,*.rej,config.status,lost+found,confstat,*.pyc,_darcs,CVS,*.part,libtool,*.aux,*.po,CMakeTmp,Makefile.am,*.lo,*.loT,*~,*.moc,*.vm*,*.class,core-dumps
    exclude filters version=2
    exclude folders[$e]=
    exclude mimetypes=text/css,text/x-c++src,text/x-c++hdr,text/x-csrc,text/x-chdr,text/x-python,text/x-assembly,text/x-java,text/x-objsrc,text/x-ruby,text/x-scheme,text/x-pascal,text/x-yacc,text/x-sed,text/x-haskell,text/asp,application/x-awk,application/x-cgi,application/x-csh,application/x-java,application/x-javascript,application/x-perl,application/x-php,application/x-python,application/x-sh,application/x-tex
    first run=false
    folders[$e]=/Store,$HOME
    index hidden folders=true
    strigiVersion=unknown
    
    [RemovableMedia]
    ask user=false
    index newly mounted=false
    
    [general]
    legacyCleaning=false
    This despite the fact that hidden folders are set to NOT be indexed from the configure desktop page. I suspect that this may well be the source of the grief! (Or at least some of it!)

    Tumbleweed/KDE/Ati Radeon R9 270/AMD FX-6300/8Gb DDR3

  9. #9
    Join Date
    Feb 2009
    Location
    UK
    Posts
    1,085

    Default Re: Nepomuk

    Although I was under the impression that strigi was no longer used?

    Tumbleweed/KDE/Ati Radeon R9 270/AMD FX-6300/8Gb DDR3

  10. #10

    Default Re: Nepomuk

    Quote Originally Posted by wakou View Post
    Although I was under the impression that strigi was no longer used?
    That's correct. Nepomuk doesn't use strigi anymore, but has its own file indexers now (since 4.10).

    But that config file wasn't renamed, for compatibility reasons I think.

Page 1 of 3 123 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •