IRC log of #maemo-meeting for Tuesday, 2016-04-19

*** Pali has quit IRC00:42
*** M4rtinK has quit IRC02:51
*** sixwheeledbeast^ has quit IRC05:37
*** sixwheeledbeast has joined #maemo-meeting05:40
*** Oksana has quit IRC06:48
*** Oksana_ has joined #maemo-meeting06:57
*** reinob has joined #maemo-meeting07:21
*** Oksana_ is now known as Oksana08:51
*** jskarvad has joined #maemo-meeting10:16
*** jskarvad has quit IRC12:33
*** jskarvad has joined #maemo-meeting13:49
reinobjuiceme: you there?16:23
reinobI'm on step (2) of your instructions (updating karma). However how I can I know who needs a manual karma update?16:23
reinobyour example (mosen with karma=0) is not even in the electorate table..16:24
reinobOK I've inserted mosen into electorate with the right karma and talk_id (I left creation_date as NULL, expected it would be automatically populated..)16:37
reinobfor the candidates I've also updated the karma, although it's not necessary16:37
reinobnow on to step (3) but at 17:0016:38
*** jskarvad has quit IRC17:10
reinobit's OK now. I had understood step (2) to refer to the electorate table instead of midgard_users;18:47
reinobsorry for the mixup18:47
*** freemangordon1 has quit IRC20:50
*** freemangordon has joined #maemo-meeting20:50
*** Pali has joined #maemo-meeting21:07
*** M4rtinK has joined #maemo-meeting21:46
*** Win7Mac has joined #maemo-meeting22:00
Win7Macknock knock...22:13
reinobhallo22:20
reinobin the end I've managed to do the election set-up today. I'm only missing the voting token generation, which is not so clear (to me)22:22
reinobhopefully juiceme can clear that up22:22
Win7Machi reinob!22:23
Win7Macthanks!22:23
reinobjust to confirm: we have 6 candidates: juiceme, win7mac, pichlo, eekkelund, mosen and reinob22:24
reinobthat about right? :)22:24
Win7Macyeah22:24
reinobOK. In any case juiceme will check the database to make sure I didn't mix up22:24
Win7Macyes, you should contact directly22:25
reinobI think he will show up here sooner or later22:25
Win7Macyes, I mean you probably shouldn't discuss it publicly22:26
Win7Macthe technical matters22:26
reinobah OK22:26
*** M4rtinK has quit IRC22:28
juicemehi!22:29
juicemereinob, Win7Mac,22:30
Win7Machi juiceme!22:30
reinobhey juiceme!22:30
reinobI was just answering your e-mail when I saw you pop-up here22:30
juicemereinob just checked database22:30
juicemeyes22:30
juicemereinob, so you actually inserted the record for mosen... odd22:31
juicemeit was not gathered from midgard ?22:31
reinobI inserted it in electorate, but then saw that it was already in midgard_users, so I deleted it and did step (3).22:31
reinobYes it was. I just mixed up one table with the other. I thought step (2) referred to electorate and not to midgard_users22:32
reinobit was all OK22:32
juicemeyes, the electorate update builds the midgard_users table22:32
juicemeok, good it was sorted out :)22:32
reinob(Win7Mac, Juiceme: OK to discuss technical matters here? no passwords of course..)22:32
juicemereinob true, if we need to discuss delicate things then we can go to maemo-admin channel or do 1to122:33
reinobOK22:33
juicemebut probably no need22:33
juicemeso, have you started to create the election nyet?22:34
reinobthe last step about the tokens, I'm not sure I did it correctly. election_anon_tokens where election_id=45 (the id of the new election) is empty22:34
Win7Macokunless delicate ;)22:34
reinobit's all done except the tokens22:34
juicemeI'll check the webfrontend, just a moment22:35
reinobaha, but election_tmp_tokens has the 5529 tokens. sounds right.22:36
juicemeso, have you done "Create New Election" yet?22:37
reinobyes! :)22:37
juicemeas I see no election in the list22:37
reinobin http://maemo.org/vote/admin.php you don't see "Community Council Election Q2 2016"?22:38
juicemenope22:38
juicemehmm22:38
reinob(cache issue?)22:38
juicememaybe I need to logout and in22:38
reinobit even has an id ;-) (45)22:38
juicemeheh, now I see it!22:39
Win7Macit's already online http://maemo.org/vote/22:39
juicemewas not really logged in, just had old tab open in firefox :)22:40
reinobOK!22:40
juicemeok, just a moment I'll check the content of the election :)22:40
juicemedates seem to be OK :)22:42
Win7Macnow wait a sec please22:44
juicemeWin7Mac, yes?22:44
Win7Mac23:59:59 UTC is for deadlines only, not for starting22:45
Win7Machere http://maemo.org/vote/ it reads *Starting 2016-04-25 23:59:59 UTC*22:45
juicemeah, that's true22:45
juicemeshould be 00:00:01 ?22:45
Win7Macyes22:46
Win7Macor 00:00:0022:46
reinobyup (or 00:00:00)22:46
reinob;)22:46
Win7Mac;)22:47
reinobI think I did it because I saw the one for Q2 2015 was like that (maybe I didn't see it right)22:47
juicemewell could be it was not correct there :)22:47
reinobshould I correct that (not that we do it both simultaneously)22:47
juicemereinob, do that, please, I am checking if the tempalte is OK.22:48
juicemetemplate I mean22:48
reinobdone22:49
juicemesince last time we kind-of botshed it, the system supports the new direct voting links but the template contained wrong url22:49
Win7Macprobably do a test election first?22:49
juicemeI am wuite sure I *did* correct the template but just to be sure...22:50
reinobdo you know where the e-mail template is stored? didn't find it in the db22:50
juicemeit is in the automailer directory :)22:50
juicemeyou bet I searched for it a *long* time the first time!22:50
Win7Macall this knowledge must be saved somehow22:51
juicemeyes, documentation helps but it is a pain to keep it up-to-date22:51
juicemereinob, check content of /usr/local/bin/cronmailer/templates/22:52
reinobfor now it seems to be well-documented. I've taken some notes and then I may update the wiki if anything is not clear enough22:52
reinobjuiceme: yes, that's the text I wrote (adapted)22:53
juicemeyes, I believe the link is correct. in the last election it was22:54
reinob5 members (because we're six candidates). 6 month. tmo thread OK. wiki link OK. login URL I don't know if correct or not22:54
juicemeURL: http://maemo.org/vote/?election_id=44&email=<email>&token=<token>22:54
reinob(it's taken from 2015Q2)22:54
juicemeand now it is22:54
juicemeURL: http://maemo.org/vote/vote.php?election_link=45&email=<email>&token=<token>22:54
juicemeand the new one looks correct to me :)22:54
Win7Macwhat about adding ending time so it displays here? http://maemo.org/vote/22:55
reinobif only we knew where the page is stored..22:56
juicemeWin7Mac it's automatic :)22:56
juicemeso if we want to change it, need to update scripts again :)22:57
reinobcould be done. I have a busy rest of the week but maybe @weekend22:58
Win7Macit'd be just a nice-to-have22:58
juicemeyes.22:59
juicemeOK, looks good to me.22:59
juicemeI think we should launch it now!22:59
reinobwhat about the tokens? I'm not sure where they should be. if you say it's OK then good.22:59
juicemeah, they should be OK, it says "This election has 5529 tokens"23:00
juicemebut just a minute I'll check the DB23:01
reinobah OK I didn't remember having seen that. I thought the interface still wanted something from me and I didn't know what exactly ;-)23:01
juicemeyep, seems OK;23:03
juicememysql>23:03
juicememysql> select count(*) from election_tmp_tokens where election_id=45;23:03
juiceme+----------+23:03
juiceme| count(*) |23:03
juiceme+----------+23:03
juiceme|     5529 |23:03
juiceme+----------+23:03
juiceme1 row in set (0.00 sec)23:03
juicememysql>23:03
reinobgo up to 21:36. I said that already. I love it when things double-check :)23:04
juicemeso go to the "Make/Clone/Mail Tokens" menu and hit "batch mail"23:04
juicemeah, of course :)23:05
juicemebut double-check is our motto here23:05
Win7Mac;)23:06
reinob"Tokens have been batched to mail"23:06
juicemeLovely!23:06
reinobyeah!23:06
reinobhow are the e-mails actually sent? is MTA running on same server?23:07
juicemeNow, as it happens there will probably be few persons crying that they do not receive the election mail.23:07
juicemeyes, cronmailer via smtp23:07
juicemebut as it happens, some people have lost/changed their mail (has happened before)23:08
juicemeans some people have no Garage account, only TMO (and still think they are able to vote)23:08
Win7Macguys, all links on this page are dead... http://maemo.org/vote/23:09
juicemeand some people have garage account OK, but have not linked to TMO and have Karma less than 10 in the books23:09
Win7Macoh sorry, not the important ones I guess23:09
juicemeWin7Mac?23:09
reinobonly 3 people have karma < 1023:09
juicemeah, you checked that already23:10
juicemedid you calculate what the karma should be?23:10
reinobnope23:10
juicemethe formula is on one of the election pages,23:10
reinobI don't know how (but something tells me I will learn that soon.. ;)23:10
juiceme:)23:10
reinobah you mean manually?23:10
juicemewell many things are taken into account23:11
juicemeyes23:11
reinobthen in principle I could do that23:11
juicemebut unless garage&TMO accounts are linked, karma gathers very slowly23:11
juicemesince TMO gives lots of karma easily23:11
juicemeTMO karma is calculated as sqrt(number-of-posts) + 8 * sqrt(number-of-thanks)23:12
reinobOK if linked all is OK and if unlinked then only TMO-karma has to be manually added. The non-TMO-karma is assumed to be always correct? (hope so!)23:13
juicemeotherwice, if not linked, you get karma only from wiki edits, package testing on garage, package uploads on garage, plus some other erelated actions23:13
juicemenon-TMO is always correct.23:14
juicemebut, the process to calculate it is fairly slow. There are about 30k accounts, and the Karma calculator slowly crawls thru all23:14
juicemeit takes more than 2 weeks to go thru all :)23:15
reinobmaybe I can optimize that someday23:15
juicemehopefully!23:15
reinobselect count(*) from outbound_email where formname="election-45"23:15
reinobgoes slowly (cronmailer sleeps 3 seconds per e-mail)23:15
juicemeI think there was some attempt to fix it, but it was not very succesful23:16
juicemecronmailer is fast compared to karma calulator23:16
reinobbut why >9000 e-mails for 5529 electorate?23:16
juicemeit is not bu cron, insteaad a midgard plugin :)23:16
reinobbut it sends via mail.maemo.org who should be doing the queueing. it makes no sense for cronmailer to be "polite" to mail.maemo.org. it's only submitting e-mails for transmission23:17
reinobplus it deletes from the table whether delivered or not (to MTA anyway). so there's a big risk of losing track of undelivered e-mails23:17
reinobgive me a week off and I'll clean up!!!23:17
juicemereinob, all this is correct!23:18
juicemeyou're welcome to fix it, if you have the time :)23:18
juicemewhat I think, it probably has some legacy reason why it works like that...23:18
juicemedating from when Maemo was hosted on different provider, maybe?23:19
reinobcould be..23:19
juicemeregarding why the email amount is > 5529...23:21
juicemegood question.23:21
juicemepossibility of duplicates?23:21
reinobI hope I didn't already click on the "batch mail" button already this afternoon?23:22
juicemewell...23:22
reinobyup lots of duplicates23:23
reinob(not all of them though..)23:23
juicememysql>23:23
juicememysql> select count(*) from outbound_email where username like "juiceme";23:23
juiceme+----------+23:23
juiceme| count(*) |23:23
juiceme+----------+23:23
reinobmy sql-fu doesn't help much now23:23
juiceme|        2 |23:23
juiceme+----------+23:23
juiceme1 row in set (0.05 sec)23:23
juicememysql>23:23
juicemeyes, duplicates23:23
reinobI did select * order by email23:23
juicemebut hey, no problem23:24
reinobshit. I thought I'd never become a spammer23:24
reinobI feel dirty now :)23:24
juicemeit'll just send a reminder email :)23:24
juicemedont' be, can happen to anybody :)23:24
juicemeI guess people will understand23:25
juicemejust blame the computer!23:25
reinobquick: how can I delete all dups right now so that most people will only get a single email?23:25
juicemehmm... can't remember offhand23:27
juicemesure a sql query exists to do that, google might help23:28
juiceme"mysql how to delete duplicates" maybe?23:29
reinobdid that but all replies seem to be pretty complicated23:29
juicemebut have to specify duplicate of key "username" for example, not exact duplicate row23:29
juicemeI'll check if I can meke sense of that23:30
*** M4rtinK has joined #maemo-meeting23:31
reinobsomething like select distinct ... into a temp table and then swap temp with real23:31
juicemewell yes, but it could be done in place I think23:33
reinobwould be better but..23:33
reinobif you want I can try doing create temporary table as (select distinct email,username,tmp_token,formname from outbound_email;23:33
reinoband then wipe the table and repopulate it from the temp table23:34
reinobhoping that cronmailer won't get confused23:34
juicemewhat about "delete from outbound_email using outbound_email, outbound_email e1 where outbound_email.id > e1.id and outbound_email.username = e1.username;"23:36
reinobI have created unique_email table. only no id field23:36
reinobmy sql is too rusty to comprehend that :) looks OK though and I have a backup in my unique_email table so lets go wild23:36
juicemeyour method is probably better23:36
reinobyour place or my place?23:36
juicemecronmailer won't be confused23:37
reinobso I do: delete from outbound_email;23:37
reinoband then how to a insert from unique_email into outbound_email?23:37
juicemeas it takes a batch of rows and then waits, just check when that happens and then quickly do the swap23:37
reinobbut my knowledge is not enough to do the actual swap..23:38
reinobI'm more like a theoretical engineer23:38
juiceme:)23:38
reinobah insert into newtable (col1,col2) select (col1,col2) from oldtable23:39
reinobsounds OK23:39
reinobI'll go for it now23:39
juicemeah, you mean how to insert content of your unique table back into email table?23:39
reinobyes23:39
juicemeyes, that does it23:39
reinobshit23:40
reinob(elections@db) [maemoelections]> insert into outbound_email (email,username,tmp_token,formname) select (email,username,tmp_token,formname) from unique_email;23:40
reinobERROR 1241 (21000): Operand should contain 1 column(s)23:40
reinobnow it worked!23:41
reinobdidn't need (..) on the right-hand side23:41
reinobit worked!!!!!!!23:41
juicemeyes, you have now 5529 entries in the table :)23:41
juicemeah, somebody is going to be double-mailed anyway :)23:42
reinobyeah but we spotted it soon enough and thank god for that 3-second delay! :)23:42
juicemetrue again23:43
reinobBTW do you know who has access to mail.maemo.org?23:43
juicemenot too many mails got sent on the 1st roung23:43
reinobwould like to throw an eye in there..23:43
juicemeask on #maemo-admin?23:43
reinobyup. maybe I shouldn't get too much into this. separation of powers and such23:44
juicemethis is community effort, I'd not be too worried23:44
reinobanyway, it's getting late and tomorrow I have a hearing with (against) Microsoft, so I need to be awake :)23:45
reinobGA meeting announcement?23:45
juicemetrue. time to go to bed23:45
juicemeyes, I thnk that needs to be done still before this council says goodbye23:46
juicemereinob, good luck with the Microsofties! :)23:46
reinobpeterleinchen, Win7Mac: I think we needed some german-fu for this :)23:46
juicemeyes, that is what I thought23:47
reinobcronmailer does every 5 minutes 40 e-mails with 3-second delay23:48
reinobdo you mind if I tweak that a bit?23:48
reinoblike every 5 minutes 200 e-mails with 1-second delay?23:48
juicemeI think it could be speeded up a little23:48
juicemeit does only 480 mails per hour23:49
juicemewhich means that 5500 mails takes 11h23:49
Win7Macyes, I'll ask peterleinchen about progress with GA announcement23:50
juicemewell not too bad I think... I thought it could take longer23:50
reinobwith 200 e-mails per 5-minutes it's 2400 per hour, so a bit more than 2 hours23:50
juicemeso maybe not tweak that yet23:50
reinobdeal?23:50
juicemeaaa I mnot sure23:50
juiceme:)23:50
reinobI leave it light it is then23:50
juiceme11h is not that bad23:50
juicemesince there's a week to go23:51
reinobgood. Then someday I can check with techstaff about limits and queues23:51
juicemelet's just keep it that way23:51
juicemeyes23:51
juicemebesides, 480 mails per hour, that sounds a bit like 480mph23:52
reinob:)23:52
juicemeand that's quite a speed23:52
juiceme:P23:52
juicemeanywa, time for bed23:52
reinobyup me too. good night. WIn7Mac if you still there: good night as well!23:52
juicemenite all!23:53
Win7Macthanks & gnite23:54

Generated by irclog2html.py 2.15.1 by Marius Gedminas - find it at mg.pov.lt!