nntp - web mismatches.

I know this point has been raised many times, but I will raise it again.

I have had three posts recently where the web side poster edited their
post, after it was send to the nntp gateway, causing wrong advice and
grievances, and having to give/ask excuses and forgiveness later.

Some recent samples:

View this
thread here

View this
thread here

Can not really something be done? Like if the post is edited, send it
again to the gateway? With a note that it has been resent because of edit?


Cheers / Saludos,

Carlos E. R.
(from 12.3 x86_64 “Dartmouth” at Telcontar)

On 07/14/2013 12:23 PM, Carlos E. R. wrote:
> Like if the post is edited, send it
> again to the gateway? With a note that it has been resent because of edit?

or, just not send it to the gateway until the edit timer has
expired…another way would be to disavow edits for the http side,
like it is on the nntp side…

as i understand it, the system is now set to allow http posters to
edit for ten minutes…and, messages are swept to the gateway once
each ten minutes (at 06, 16, 26 etc)…

which sounds great, unless a http writer begins the 10 minute edit
timeout clock at (say) 03 and his/her post is sweep through the
gateway at 06 and then the poster edits all the way up to 13…

then, everything after 06 is unseen by the nntp using helpers–of
which there are many.

i guess it won’t be fixed until the http users petition the forum to
provide help on what they finally post…rather than confusing
answers on what they had posted prior to the sweep…


dd

On Sun, 14 Jul 2013 10:23:08 +0000, Carlos E. R. wrote:

> Can not really something be done? Like if the post is edited, send it
> again to the gateway? With a note that it has been resent because of
> edit?

Not without a major rearchitecting of the gateway mechanisms. The web
interface software doesn’t let us restrict editing until specific times,
only for a specified interval.

The gateway software sees a new message and only tracks if it has gone
through the gateway, not the content of the message that’s sent through
the gateway.

It happens very occasionally, and is one of those things that we’ve
decided to just live with at this point.

Jim


Jim Henderson
openSUSE Forums Administrator
Forum Use Terms & Conditions at http://tinyurl.com/openSUSE-T-C

On 2013-07-14 19:09, Jim Henderson wrote:
> It happens very occasionally, and is one of those things that we’ve
> decided to just live with at this point.

3 times in a single month to me.


Cheers / Saludos,

Carlos E. R.
(from 12.3 x86_64 “Dartmouth” at Telcontar)

On Sun, 14 Jul 2013 22:03:07 +0000, Carlos E. R. wrote:

> On 2013-07-14 19:09, Jim Henderson wrote:
>> It happens very occasionally, and is one of those things that we’ve
>> decided to just live with at this point.
>
> 3 times in a single month to me.

Yes, very occasionally = rarely. 3 times out of 7115 posts since June
14, 2013.

Or 0.042% of the time it failed in the past month.

Put another way, 99.957% of the time, the messages matched.

While I DO appreciate your diligence, that kind of failure rate isn’t
really worth the time to try to correct. You’ve known for years by now
that the gateway isn’t perfect and the limitations of the edit window are
a compromise that sometimes - very, very, VERY rarely - a problem occurs
and an edit is made on the web side that doesn’t get through to the NNTP
side.

Do I need to explain the principle of diminishing returns? :wink:

Jim


Jim Henderson
openSUSE Forums Administrator
Forum Use Terms & Conditions at http://tinyurl.com/openSUSE-T-C

On 2013-07-15 01:31, Jim Henderson wrote:
> On Sun, 14 Jul 2013 22:03:07 +0000, Carlos E. R. wrote:
>
>> On 2013-07-14 19:09, Jim Henderson wrote:
>>> It happens very occasionally, and is one of those things that we’ve
>>> decided to just live with at this point.
>>
>> 3 times in a single month to me.
>
> Yes, very occasionally = rarely. 3 times out of 7115 posts since June
> 14, 2013.

I have not verified if those 7000 posts match, so make it 3 out of 100
at most, the rest are unknown; maybe right, maybe wrong.

> Do I need to explain the principle of diminishing returns? :wink:

To me, as I’m the affected party, it is a sore point.


Cheers / Saludos,

Carlos E. R.
(from 12.3 x86_64 “Dartmouth” at Telcontar)

On Sun, 14 Jul 2013 23:58:07 +0000, Carlos E. R. wrote:

> On 2013-07-15 01:31, Jim Henderson wrote:
>> On Sun, 14 Jul 2013 22:03:07 +0000, Carlos E. R. wrote:
>>
>>> On 2013-07-14 19:09, Jim Henderson wrote:
>>>> It happens very occasionally, and is one of those things that we’ve
>>>> decided to just live with at this point.
>>>
>>> 3 times in a single month to me.
>>
>> Yes, very occasionally = rarely. 3 times out of 7115 posts since June
>> 14, 2013.
>
> I have not verified if those 7000 posts match, so make it 3 out of 100
> at most, the rest are unknown; maybe right, maybe wrong.

I’m sure it’s a smaller number than 10 at the most, which is still not a
bad miss rate.

>> Do I need to explain the principle of diminishing returns? :wink:
>
> To me, as I’m the affected party, it is a sore point.

As the person whose time is involved in fixing gateway issues, I can tell
you that with the calculated miss rate based on the available data, it’s
not worth my time to re-architect the way the gateway works to account
for what is a very minor problem. I mean, we could turn off editing on
the web side, but we all know how well that would go over with the web-
based users.

So we have reached this particular compromise - they get 10 minutes to
edit posts (something many have said they’re not happy about), and we
occasionally have data that doesn’t match 100% what’s on the web side
(which you’ve said you’re not happy about). Everybody has something to
complain about. :wink:

But I appreciate the feedback. If I end up with a couple free hours with
nothing better to do, I’ll look into it and see if there’s a quick fix,
I’ll do that.

Jim

Jim Henderson
openSUSE Forums Administrator
Forum Use Terms & Conditions at http://tinyurl.com/openSUSE-T-C

On 07/15/2013 01:58 AM, Carlos E. R. wrote:
> To me, as I’m the affected party, it is a sore point.

but Carlos, you are not the most affected party. (the one trying to
follow your advice and in so doing may murder his/her system is the
most affected, by far!)

you wrote in the thread opener that this editing problem causes
“wrong advice and grievances, and having to give/ask excuses and
forgiveness later.”

but, nntp posters have no responsibility to give any excuse or beg
forgiveness!

because if incomplete or incorrect help is due to this documented
failure (which has been repeatedly judged by The Powers That Be to be
too inconsequential to fix), then it is up to TPTB to do all the
explaining, excusing and begging…

so, if/when it happens again, just report the ‘problem post’ (the one
where the user complains of your wrong advice) and let TPTB reply…

hmmmm, perhaps nntp using helpers should have a caveat in their sig.


dd
If you edited your post to the web forum, WARNING! The answer given
may be hazardous to your system/data. Possibly your post was
delivered to me (and others) in an incomplete form, thereby causing
faulty advice.

On Mon, 15 Jul 2013 09:41:07 +0000, dd wrote:

> hmmmm, perhaps nntp using helpers should have a caveat in their sig.

Your concerns are noted. If you’ve got some magic way to add more than
24 hours to a day, please feel free to share it.

If it’s a huge enough problem for you, until I have such time as to look
into it, I suggest using the web interface instead if you think it’s that
big of a problem.

Jim


Jim Henderson
openSUSE Forums Administrator
Forum Use Terms & Conditions at http://tinyurl.com/openSUSE-T-C

There is a way to resolve this Carlos and DD. Since your not happy with a 99.957%. Clearly you demand perfection. 100% success rate is what you require. See, in the real world a +/- rate of 10% is acceptable. I’ve known a +/- rate of more than 20% to be acceptable. So a failure rate of a tenth of a percent (+/-), most techs and engineers would not only call that acceptable, but pretty much perfect. As close to perfect as it’s going to get. However, I understand your need for perfection. So, the resolution would be to abolish NNTP. Just go straight web forums. But wait! What about the times when that goes down. Now we have to abolish the web forums to. What about when your computer crashes? Gotta abolish that to. What about when your wrong (good thing we don’t rate you on that), or when you make a typo? Well now, gotta abolish you!

If you think this is utterly foolish and silly, then your right. I did this to make a point. Get it?

don’t know as to how nntp works but I am curious as to why nntp doesn’t send updates of posts as mails to users

On 2013-07-16 05:46, vazhavandan wrote:
>
> don’t know as to how nntp works but I am curious as to why nntp doesn’t
> send updates of posts as mails to users

That is precisely what I ask for and they are saying “NO”, and they
laugh and ridicule us instead. :-/

Not via email, but via nntp, as another post with the modified post.


Cheers / Saludos,

Carlos E. R.
(from 12.3 x86_64 “Dartmouth” at Telcontar)

On 2013-07-15 02:26, Jim Henderson wrote:
> On Sun, 14 Jul 2013 23:58:07 +0000, Carlos E. R. wrote:

> So we have reached this particular compromise - they get 10 minutes to
> edit posts (something many have said they’re not happy about), and we
> occasionally have data that doesn’t match 100% what’s on the web side
> (which you’ve said you’re not happy about). Everybody has something to
> complain about. :wink:
>
> But I appreciate the feedback. If I end up with a couple free hours with
> nothing better to do, I’ll look into it and see if there’s a quick fix,
> I’ll do that.

Thanks, I appreciate that.


Cheers / Saludos,

Carlos E. R.
(from 12.3 x86_64 “Dartmouth” at Telcontar)

On 2013-07-15 11:41, dd wrote:
> On 07/15/2013 01:58 AM, Carlos E. R. wrote:
>> To me, as I’m the affected party, it is a sore point.
>
> but Carlos, you are not the most affected party. (the one trying to
> follow your advice and in so doing may murder his/her system is the most
> affected, by far!)
>
> you wrote in the thread opener that this editing problem causes “wrong
> advice and grievances, and having to give/ask excuses and forgiveness
> later.”
>
> but, nntp posters have no responsibility to give any excuse or beg
> forgiveness!

Perhaps, but I do feel bad about saying that somebody has said or not
said something, which turns out it is not true because he changed that
later. Maybe I should not, but I do.

> because if incomplete or incorrect help is due to this documented
> failure (which has been repeatedly judged by The Powers That Be to be
> too inconsequential to fix), then it is up to TPTB to do all the
> explaining, excusing and begging…
>
> so, if/when it happens again, just report the ‘problem post’ (the one
> where the user complains of your wrong advice) and let TPTB reply…

I know I have brought up the issue now and then, but it is brushed aside
as irrelevant. Irrelevant for them, but not for me.

> hmmmm, perhaps nntp using helpers should have a caveat in their sig.

Pfff! :-}


Cheers / Saludos,

Carlos E. R.
(from 12.3 x86_64 “Dartmouth” at Telcontar)

On Tue, 16 Jul 2013 09:48:06 +0000, Carlos E. R. wrote:

> On 2013-07-16 05:46, vazhavandan wrote:
>>
>> don’t know as to how nntp works but I am curious as to why nntp doesn’t
>> send updates of posts as mails to users
>
> That is precisely what I ask for and they are saying “NO”, and they
> laugh and ridicule us instead. :-/

Well, no, but at least for my part, I’ve tried to explain why some things
are more difficult to change than it might seem from the ‘outside’.

It is wearing to hear about minor little things (and let’s face it, 3
posts out of 7,000 is a minor thing) as if they’re show-stopping
problems.

All of the staff here (besides Kim) volunteer our time. This is what we
do in our spare time. We’re not paid or compensated in any way for what
we do. So these kind of nits, while raising them is fine, insisting that
they’re serious problems that must be addressed right now or the world is
going to end (and with that kind of hyperbole) really pushes buttons.

And there are a few people who use these forums who seem to delight in
finding ways to push those buttons, and then get mad when we try to
explain anything.

For me personally, it’s to the point where I’m tempted to just reply to
every such report with nothing but “thanks for the report” or “your
concerns are noted”, but because of how I’m wired, I have a hard time
limiting my replies like this.

> Not via email, but via nntp, as another post with the modified post.

Again, from the outside and not knowing how the gateway actually works,
the complexity of the database behind the web side, and everything, it
does look like a simple problem to solve. But because of how the
gateway was written originally (not by us) and the original maintainer no
longer maintains it - and in fact we’re one of two or three
implementations of vBulletin worldwide that even uses it any more -
because the upgrade to vBulletin v4 it completely broke the gateway, but
I managed to figure out how to get it working again.

The vBulletin database schema is very complex. So I hesitate to do
anything that could impact the integrity of that database. Fixing this
minor issue could result in unexpected database corruption, and you can
bet that people would get very angry if the forums became unreliable or
unusuable because the database was corrupted. Yes, I test on a sandbox
installation that I have myself (I gate to an INN server on my home
systems), but I can’t do the scale testing needed to deal with the kind
of message flow that we use.

The same gateway is used on the SUSE Forums, Novell Forums, and NetIQ
forums as well - so changes that I make to the gateway potentially affect
those as well - which would affect paying customers, too.

So messing with it to fix such a minor problem is about managing risk -
and in my judgement, the changes needed have an unacceptable risk to the
message database itself without a fair bit of work and testing. It isn’t
just about writing a fix - it’s about testing it enough, and regressing
the change to ensure we don’t completely screw the forums.

Now, if it seems that we get a little touchy when a report comes in like
this that really is not a huge issue (forum help is “best effort” for
any of us answering questions - and ultimately the risk falls to those
asking the questions, not those providing the answers), maybe you’ll
understand a little better why that is.

Jon’s response was maybe a bit OTT, but it’s indicative of the type of
frustration that these kinds of “demands” that we fix minor issues put on
all of the staff.

There are still more important things to be looking at, like why NNTP
posts don’t trigger e-mail alerts for subscriptions consistently.

But ultimately, and I know you and DD both get tired of hearing this, NNTP
is a secondary interface. It’s provided for your convenience. It isn’t
perfect, and we have repeatedly stated that. It ain’t gonna be perfect,
and if you need perfection, you’re going to have to use the web interface
and live with its limitations.

Every once in a while, we have to have a debate about whether or not it’s
worth keeping the NNTP interface, with its warts and all. In spite of
its shortcomings, I always want to see it maintained, which means that
when I do the risk analysis for whether or not an issue should be looked
into or fixed, I’m looking at it with an eye towards “if this screws
things up, would it be the nail in the NNTP coffin?”, and if I judge the
risk is at an unacceptable level, then I’m not going to look at making a
change. I would far rather have an imperfect NNTP gateway solution than
have one that breaks things to the point that we end up having to restore
from a backup and decide not to support the interface any more at all.

So yes, every time you start pushing the buttons for fixing something
that’s not got a significant impact, it’s probably not going to get
addressed, and if you keep pushing, you’re going to frustrate members of
staff here. We’re only human, after all. And when someone goes to the
lengths that DD did in his hypothetical “critical piece of information
wasn’t in the original post that went through the gateway and the advice
given blew their system away because we were missing that critical piece
of information that would have saved their system” post, well, that
really don’t make the situation any better. We can all construct wild
hypothetical situations where a system has been completely destroyed
because someone forgot something. I can also construct hypothetical
situations where the person reading the answer didn’t understand it
correctly, or the person answering didn’t explain something clearly
enough, or, or, or, or - and those hypothetical situations don’t do us
one bit of good. They just end up being “talking a lot without saying
anything”. (Cue the counter now the date I’m accused of saying that
about some specific forum member, another frequent SOP I see from certain
quarters - which I should also start a counter for being accused of
applying to someone specific - neither of which I’m doing, BTW - I’m
speaking in generalities.)

So now I’m going to go and reset the “days since having to explain in
great and excruciating detail why some minor issue isn’t going to get
addressed” counter to 0 again. :wink:

I actually do know what I’m doing with the gateway, and I do actually
care what the community sees as problems, and as much as possible I want
to see issues resolved (we all want continual improvement). But
mountains out of molehills doesn’t move things forward. Now, I can waste
more time explaining stuff in excruciating detail, or I can go and get
some paid work done so that I might be able to afford some free time to
look into problems that affect more than 3 posts out of 7,000. :wink:

Jim

Jim Henderson
openSUSE Forums Administrator
Forum Use Terms & Conditions at http://tinyurl.com/openSUSE-T-C

Guess better policy would be for nntp users to wait for 10mins before replying to any post made on the web.

On Tue, 16 Jul 2013 18:46:03 +0000, vazhavandan wrote:

> Guess better policy would be for nttp users to wait for 10mins before
> replying .

That wouldn’t change anything. Once the message is through the gateway,
it’s through the gateway.

Being an old hand at forums, I honestly don’t understand why posts even
need to be edited, but users of web forums have insisted that it’s a
necessary feature, so we compromised (and we used to have lots of
arguments about “well, can’t the edit window be an hour?”). We’ve had
all those debates and whatnot, and the current arrangement is what
ultimately the compromise was.

I don’t explain this to reopen that whole debate - that’s not going to
get changed, unless and until I can completely rewrite the gateway from
scratch. I’ve got an architecture in mind, but it’s a massive
undertaking, and as a contract/consulting employee on the work I do, I
have to get the paid hours in before I can look at the things I volunteer
my time for - and lately the work has been really good, but that means I
have less time to design, code, and test concepts behind a new gateway.
The design I have in mind would probably address these minor issues
entirely, though, if the architecture I’ve been kicking around in my head
is feasible.

Far more serious than edits after the gateway passes the message are
things like thread/message moves, deletions, and the like. Those have a
much larger impact - as the NNTP users in this thread can attest to -
getting a thread moved in a way that’s clear to NNTP users isn’t easy,
and as a manual process, consistency in how it’s done is not an easy
thing to achieve.

Jim


Jim Henderson
openSUSE Forums Administrator
Forum Use Terms & Conditions at http://tinyurl.com/openSUSE-T-C

…and with that comprehensive and reasonable answer Jim, I’d like to think that this ‘discussion’ can now come to an end. :slight_smile: