| *** Pali has quit IRC | 01:07 | |
| *** kolp_ has joined #maemo-meeting | 04:13 | |
| *** kolp has quit IRC | 04:16 | |
| *** M4rtinK has quit IRC | 04:22 | |
| *** kolp_ has quit IRC | 04:54 | |
| *** DocScrutinizer05 has quit IRC | 06:03 | |
| *** DocScrutinizer05 has joined #maemo-meeting | 06:03 | |
| *** freemangordon has joined #maemo-meeting | 08:52 | |
| *** freemangordon has left #maemo-meeting | 08:52 | |
| *** Pali has joined #maemo-meeting | 09:08 | |
| *** M4rtinK has joined #maemo-meeting | 12:14 | |
| *** lbt has quit IRC | 12:34 | |
| *** kolp has joined #maemo-meeting | 12:34 | |
| *** lbt has joined #maemo-meeting | 12:51 | |
| *** lbt has quit IRC | 12:51 | |
| *** lbt has joined #maemo-meeting | 12:51 | |
| DocScrutinizer05 | bergie: *.maemo.org down since 24h! | 16:06 |
|---|---|---|
| *** freemangordon has joined #maemo-meeting | 16:06 | |
| DocScrutinizer05 | X-Fade: : *.maemo.org down since 24h! | 16:06 |
| freemangordon | DocScrutinizer05: could you send it over the mailing lists too? | 16:07 |
| DocScrutinizer05 | HAHAHA | 16:07 |
| DocScrutinizer05 | which mailing lists? | 16:08 |
| freemangordon | hmm, good question | 16:08 |
| DocScrutinizer05 | what's left to us is IRC, and tmo - though for tmo it's unclear what's the sitaution after tomorrow | 16:09 |
| freemangordon | well, a mail to nemein guys with CC/BCC maemo-community. I guess HiFo might be uninformed of the situation | 16:10 |
| DocScrutinizer05 | maemo-community down | 16:10 |
| freemangordon | well, mail to SD69 and ivgalvez then | 16:11 |
| DocScrutinizer05 | honestly I don't see HiFo in first line to do *anything* about current situation | 16:11 |
| freemangordon | they can have some additional communication channels we're not aware of | 16:12 |
| DocScrutinizer05 | it's council in duty | 16:12 |
| DocScrutinizer05 | no, they don't | 16:12 |
| freemangordon | and you may CC all those(nemein guys) who were involved in some mails 1-2 weeks ago | 16:13 |
| DocScrutinizer05 | they even don't communicate with Nemein, apart from open mail every now and then, which Nemein doesn't answer | 16:13 |
| freemangordon | aah | 16:13 |
| DocScrutinizer05 | actually mail from Eero (Nemein) and from Ferenc to council/board ML been the only mail from Nemein to "maemo" during last 2 months, that I'm aware of. And of course Eero / mashiara here in this chan, and in private query with me. Bergie as well in private query with me | 16:15 |
| DocScrutinizer05 | last sign of life from Nemein: [2013-01-14 17:32:00] <mashiara> ok, I pack my stuff now and hope I don't miss the next train | 16:16 |
| DocScrutinizer05 | (^^^ CET, so 22h ago) | 16:16 |
| *** Ex-Opesa has joined #maemo-meeting | 16:22 | |
| *** Ex-Opesa has left #maemo-meeting | 16:22 | |
| *** GeneralAntilles has joined #maemo-meeting | 16:28 | |
| *** thedead1440 has joined #maemo-meeting | 16:30 | |
| *** Jaffa has joined #maemo-meeting | 16:31 | |
| bergie | we're still waiting for the DNS switch, AFAIK | 16:31 |
| bergie | before that we can't do anything | 16:31 |
| DocScrutinizer05 | bergie: nope, DNs switched yesterday (most of them) - since then stuff is dead | 16:32 |
| bergie | interesting, let me check with the guys then | 16:32 |
| *** brkn has joined #maemo-meeting | 16:34 | |
| DocScrutinizer05 | bergie: thanks! could you report back in 60min the latest please? | 16:36 |
| DocScrutinizer05 | bergie: we (council) at very least need to let know community about what's going on and what to expect | 16:37 |
| bergie | seems there is an issue with the firewall, I'm talking with our support guys ATM | 16:37 |
| DocScrutinizer05 | thanks | 16:38 |
| DocScrutinizer05 | please keep us up to date frequently - nothing worse and more devastating than a lack of info about what's going on 8or if anything at all is going on) | 16:39 |
| DocScrutinizer05 | s/8/(/ | 16:39 |
| bergie | BTW, for future situations, it is a lot faster to ping our support (support@nemein.com) than me on IRC ;-) | 16:41 |
| bergie | now it is up again: http://maemo.org/ | 16:42 |
| DocScrutinizer05 | good to know, thanks | 16:42 |
| bergie | but apparently there is something in routing that needs to be looked at | 16:42 |
| DocScrutinizer05 | >>Connection to Server Refused - Additional Information: maemo.org: Socket operation timed out<< | 16:43 |
| bergie | yep, the firewall is shutting down quite a few of the connections. We're talking with the ISP | 16:44 |
| *** mashiara has joined #maemo-meeting | 16:52 | |
| bergie | I'll let you know more as soon as I have the info | 16:54 |
| DocScrutinizer05 | thanks | 16:54 |
| qwazix | Is maemo.org still readonly? | 16:55 |
| bergie | qwazix: shouldn't be, I think that was just on the original servers | 16:56 |
| bergie | X-Fade would know the situation better | 16:56 |
| qwazix | on the downloads page there hasn't been an update with recent packages | 16:56 |
| qwazix | maybe we need to do something to re-sync extras and midgard | 16:57 |
| bergie | I think we need to check network reliability next | 16:57 |
| bergie | first, I mean | 16:57 |
| qwazix | ofc | 16:57 |
| bergie | mashiara is apparently working on it right now | 16:58 |
| bergie | (I'm in Berlin so I have a bit limited visibility to what happens in Helsinki) | 16:58 |
| mashiara | I just got away from a day of meetings unrelated to this. | 16:58 |
| mashiara | so I have just about zero knowledge of what has happened today | 16:59 |
| mashiara | I will do my best to find out where the problem is and then make a plan to rectify it, the fact that it's beyond normal working hours in Finland will not make this easier. | 17:00 |
| freemangordon | DocScrutinizer05: ping | 17:01 |
| freemangordon | DocScrutinizer05: ^^^ | 17:01 |
| mashiara | "we must do something, this is something, therefore it must be done" is *not* the way to proceed here. First I will get some data, then I will think, then I will see what is to be done. | 17:01 |
| DocScrutinizer05 | mashiara: nobody suggested "to do something ($random)" | 17:03 |
| DocScrutinizer05 | mashiara: the main issue is about information | 17:03 |
| mashiara | I have been pestered via other channels... | 17:03 |
| DocScrutinizer05 | mashiara: I easily can announce even a week of complete downtime, as long as I know what's going on | 17:04 |
| mashiara | I have no more data than yesterday yet, my hypothesis is that our bandwidth is not what I was led to believe it is, I have contacted the ISP to doublecheck | 17:05 |
| mashiara | and I will see if I can pull out some data from the network switches in the meantime | 17:06 |
| DocScrutinizer05 | thanks :-) | 17:06 |
| DocScrutinizer05 | please report about any news (even no news) here on a regular (I suggest at least hourly) schedule, so everybody has the pleasant feeling that things are moving | 17:07 |
| DocScrutinizer05 | if longer than 60min of "no news, so no message" are expected, please leave a time/date when next update will show up | 17:09 |
| DocScrutinizer05 | s/leave/announce/ | 17:10 |
| mashiara | gah the "switch" access info I got was for the maemo firewall not the main switch, waiting for access to the right hardware. | 17:31 |
| kerio | maemo.org still down for me | 17:39 |
| kerio | oh it's back | 17:42 |
| *** thedead1440 has left #maemo-meeting | 17:45 | |
| *** thedead1440 has joined #maemo-meeting | 17:45 | |
| DocScrutinizer05 | kerio: no it's not | 17:51 |
| DocScrutinizer05 | please don't spam the channel with short term findings | 17:51 |
| kerio | "slow enough to be unusable" is fairly important | 17:52 |
| DocScrutinizer05 | kerio: we all are aware of that, thanks | 17:54 |
| mashiara | I enabled traffick-shaping on the maemo-firewall but I have no real data yet to be able set correct parameters so current config is based on guesswork | 18:04 |
| kerio | TMO is still separate, right? | 18:07 |
| DocScrutinizer05 | yes | 18:08 |
| DocScrutinizer05 | until tomorrow probably | 18:08 |
| DocScrutinizer05 | mashiara: Date and Time: Tue 15 January 2013 17:09 Additional Information: garage.maemo.org: Socket operation timed out | 18:10 |
| DocScrutinizer05 | Date and Time: Tue 15 January 2013 17:09 Additional Information: wiki.maemo.org: Socket operation timed out | 18:11 |
| *** brkn has left #maemo-meeting | 18:36 | |
| *** freemangordon has quit IRC | 18:59 | |
| *** freemangordon has joined #maemo-meeting | 18:59 | |
| *** sunkan has joined #maemo-meeting | 19:05 | |
| mashiara | got more access, looking at things shortly, right now otherwise occupied | 19:10 |
| mashiara | I got some more info but not enough to make any better guesses at the problem than previously. I will hopefully get some real data tomorrow during office hours. | 20:13 |
| mashiara | I'm going to call it a night now. | 20:13 |
| *** mashiara has left #maemo-meeting | 20:14 | |
| DocScrutinizer51 | ok, so no real change in situation to be expected until <now>+12h | 20:27 |
| DocScrutinizer51 | IOW tomorrow 0700UTC | 20:29 |
| DocScrutinizer51 | my latest tests seem to indicate that repository and maemo.org are available in one out of 10 tries | 20:30 |
| *** Woody14619 has joined #maemo-meeting | 21:38 | |
| *** Woody14619 has quit IRC | 21:38 | |
| *** Woody14619 has joined #maemo-meeting | 21:38 | |
| DocScrutinizer05 | wiki.m.o stalled at 81%, rendered like no CSS, probably static.m.o missing | 22:15 |
| DocScrutinizer05 | http://repository.maemo.org just loaded fine | 22:16 |
| DocScrutinizer05 | http://maemo.org/ starts to render after ~80s | 22:17 |
| DocScrutinizer05 | allegedly finished now | 22:18 |
| qwazix | Is it high load or something else? Any indication? | 22:19 |
| DocScrutinizer05 | https://garage.maemo.org/projects/council/ starts rendering instantly | 22:19 |
| DocScrutinizer05 | actually even finishes just fine | 22:19 |
| freemangordon | does it? | 22:20 |
| freemangordon | not here | 22:20 |
| DocScrutinizer05 | qwazix: according to Eero it's due to firewall resp traffic shaping | 22:20 |
| qwazix | works, but definitely not instantly | 22:20 |
| DocScrutinizer05 | yes, all that still is "1 out of N times" | 22:21 |
| DocScrutinizer05 | wiki just rendered to 81% first time for me for the last 2 days | 22:22 |
| DocScrutinizer05 | actually hitting F5 it again rendered to already 21% | 22:23 |
| DocScrutinizer05 | even finished, but without CSS | 22:23 |
| DocScrutinizer05 | general load might go down in the late evening of EU, so the current traffic shaping settings might work a lil bit better | 22:24 |
| DocScrutinizer05 | currently I have 4 tabs with somewhat meaningful content on my browser: wiki, m.o, garage, repoi | 22:25 |
| kerio | so it's just load? | 22:25 |
| kerio | it's not a misconfiguration? | 22:25 |
| DocScrutinizer05 | kerio: it's traffic shaping resp firewall | 22:25 |
| DocScrutinizer05 | please read backscroll | 22:26 |
| DocScrutinizer05 | [2013-01-15 17:04:08] <mashiara> I enabled traffick-shaping on the maemo-firewall but I have no real data yet to be able set correct parameters so current config is based on guesswork | 22:26 |
| DocScrutinizer05 | [2013-01-15 19:13:11] <mashiara> I got some more info but not enough to make any better guesses at the problem than previously. I will hopefully get some real data tomorrow during office hours | 22:26 |
| *** MentalistTraceur has joined #maemo-meeting | 22:27 | |
| DocScrutinizer05 | I'd say it's not worse than on some famous weekends during last 3 years | 22:28 |
| DocScrutinizer05 | IOW some tuning might fix it, if we can speed up bandwidth and reliability by maybe factor 5 | 22:29 |
| MentalistTraceur | So is this why repos wouldn't update for me yesterday? The changes already started kicking in? | 22:29 |
| DocScrutinizer05 | yes | 22:29 |
| DocScrutinizer05 | hi MentalistTraceur | 22:29 |
| MentalistTraceur | Are people for the most part aware of the issue (those in the IRC at least?) | 22:30 |
| DocScrutinizer05 | given the current situation I'd like to suggest postponing of tmo migration planned for tomorrow | 22:31 |
| DocScrutinizer05 | chem|st: ^^^^ | 22:31 |
| MentalistTraceur | I would agree, but we don't know how soon it'll be resolved and reggie's limit is the 20th, right? | 22:32 |
| MentalistTraceur | Buys us at most four days? | 22:32 |
| MentalistTraceur | Better than nothing I suppose. | 22:32 |
| DocScrutinizer05 | I'd hope 4 days are sufficient for Nemein to sort stuff | 22:32 |
| DocScrutinizer05 | chem|st: nfc who requested change of DNS A talk.maemo.org to CNAME, anyway it points to internettablettalk or sth right now. So reggie is free to handle that domain DNS record to his liking | 22:34 |
| MentalistTraceur | I thought I remembered talk.maemo.org being just a redirect to itt. | 22:38 |
| MentalistTraceur | Wasn't that always the case? | 22:38 |
| DocScrutinizer05 | Reggie thought it been, but last time I checked I think it been a proper A record | 22:44 |
| *** lbt has quit IRC | 23:05 | |
| *** lbt has joined #maemo-meeting | 23:06 | |
| *** lbt has quit IRC | 23:06 | |
| *** lbt has joined #maemo-meeting | 23:06 | |
| *** lbt has quit IRC | 23:07 | |
| *** lbt has joined #maemo-meeting | 23:14 | |
| *** lbt has quit IRC | 23:14 | |
| *** lbt has joined #maemo-meeting | 23:14 | |
| *** MentalistTraceur has left #maemo-meeting | 23:27 | |
| *** MentalistTraceur has joined #maemo-meeting | 23:27 | |
| *** ZogG_laptop has quit IRC | 23:28 | |
| *** MentalistTraceur has quit IRC | 23:30 | |
| *** MentalistTraceur has joined #maemo-meeting | 23:31 | |
| MentalistTraceur | Sorry I keep connecting/disconnecting, messing with xchat settings and it keeps behaving not-how-I-want. | 23:33 |
| *** MentalistTraceur has quit IRC | 23:33 | |
| *** MentalistTraceur has joined #maemo-meeting | 23:34 | |
| *** Pali has quit IRC | 23:40 | |
Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!