Monday, April 13th, 2020, 00:09 UTC | ||
[00:09:54] | mad_enz (mad_enz!~mad_enz@2606:6d00:135:9d84:9836:969b:b1e:5486) has quit (Remote host closed the connection) | |
[00:10:49] | mad_enz (mad_enz!~mad_enz@2606:6d00:135:9d84:9c22:93a7:dbcc:7d70) has joined #mythtv | |
[01:39:54] | mad_enz (mad_enz!~mad_enz@2606:6d00:135:9d84:9c22:93a7:dbcc:7d70) has quit (Remote host closed the connection) | |
[05:23:24] | hampton (hampton!~dhampton@mythtv/developer/hampton) has quit (Quit: Leaving.) | |
[05:35:25] | hampton (hampton!~dhampton@static-68-134-82-17.bltmmd.fios.verizon.net) has joined #mythtv | |
[05:35:25] | hampton (hampton!~dhampton@static-68-134-82-17.bltmmd.fios.verizon.net) has quit (Changing host) | |
[05:35:25] | hampton (hampton!~dhampton@mythtv/developer/hampton) has joined #mythtv | |
[05:35:25] | Mode for #mythtv by ChanServ!ChanServ@services. : +v hampton | |
[05:49:28] | markspieth (markspieth!~yaaic@mythtv/developer/markspieth) has quit (Ping timeout: 250 seconds) | |
[05:52:59] | markspieth (markspieth!~yaaic@mythtv/developer/markspieth) has joined #mythtv | |
[05:52:59] | Mode for #mythtv by ChanServ!ChanServ@services. : +v markspieth | |
[06:11:29] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:ee71:6a0b:4f4e:9706) has joined #mythtv | |
[06:11:30] | Mode for #mythtv by ChanServ!ChanServ@services. : +v Steve-Goodey | |
[06:26:44] | Tobbe5178 (Tobbe5178!~asdf@81-235-210-78-no62.tbcn.telia.com) has joined #mythtv | |
[06:45:02] | markspieth2 (markspieth2!~yaaic@mythtv/developer/markspieth) has joined #mythtv | |
[06:45:02] | Mode for #mythtv by ChanServ!ChanServ@services. : +v markspieth2 | |
[06:48:02] | markspieth (markspieth!~yaaic@mythtv/developer/markspieth) has quit (Ping timeout: 252 seconds) | |
[06:50:00] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has quit (Quit: WeeChat 2.3) | |
[06:51:25] | brfransen (brfransen!~brfransen@47.42.26.155) has quit (Ping timeout: 265 seconds) | |
[07:01:18] | peterbennett (peterbennett!~pi@2601:183:100:5f6:ea65:7e3e:f829:d088) has joined #mythtv | |
[07:01:19] | peterbennett (peterbennett!~pi@2601:183:100:5f6:ea65:7e3e:f829:d088) has quit (Changing host) | |
[07:01:19] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv | |
[07:01:19] | Mode for #mythtv by ChanServ!ChanServ@services. : +v peterbennett | |
[07:15:27] | SteveGoodey (SteveGoodey!~steve@host86-138-103-159.range86-138.btcentralplus.com) has joined #mythtv | |
[07:15:32] | Mode for #mythtv by ChanServ!ChanServ@services. : +v SteveGoodey | |
[09:13:58] | MythBuild: | Build [#577](https://code.mythtv.org/buildbot/#builders/41/builds/577) of `master-freebsd11–64bit` completed successfully. |
[09:17:23] | MythBuild: | Build [#703](https://code.mythtv.org/buildbot/#builders/45/builds/703) of `master-freebsd12–64bit` completed successfully. |
[09:37:25] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:ee71:6a0b:4f4e:9706) has quit (Quit: Konversation terminated!) | |
[09:37:37] | Tobbe5178 (Tobbe5178!~asdf@81-235-210-78-no62.tbcn.telia.com) has quit (Read error: Connection reset by peer) | |
[09:43:00] | SteveGoodey (SteveGoodey!~steve@host86-138-103-159.range86-138.btcentralplus.com) has quit (Quit: Konversation terminated!) | |
[09:55:36] | Tobbe5178 (Tobbe5178!~asdf@81-235-210-78-no62.tbcn.telia.com) has joined #mythtv | |
[10:01:43] | paul-h (paul-h!~paul@cpc112433-pres20-2-0-cust645.18-3.cable.virginm.net) has joined #mythtv | |
[10:01:44] | Mode for #mythtv by ChanServ!ChanServ@services. : +v paul-h | |
[10:05:25] | paul-h: | stuarta: re: smolt it looks to me like the server is failing to handout new or regenerated public uuids |
[10:06:44] | paul-h: | for example this should return a new uuid in json format http://smolt.mythtv.org/client/regenerate_pub . . . dd521d30e212 but it always fails |
[10:10:48] | paul-h: | This is what the frontend runs if you want to test /usr/share/mythtv/hardwareprofile/sendProfile.py --submitOnly -a |
[10:12:11] | paul-h: | if you have a system where that previously worked then it will re-submit your profile but if it's a new system it will fail |
[10:15:12] | paul-h: | you can find your hardware and public uuids in ~/.mythtv/HardwareProfile/ if you have a uuiddb.cfg file then it must have previously worked and you should be able to re-submit your profile |
[10:15:55] | paul-h: | if it's missing like on a new install I can't find a way to get it to work |
[10:17:45] | paul-h: | All this is new to me so I could be misunderstanding how it is supposed to work. Who is our smolt expert? |
[10:22:48] | paul-h: | '/usr/share/mythtv/hardwareprofile/sendProfile.py -n' should generate a new public uuid but always seems to fail even on installs that it must have worked in the past so definitely looks like a server fault to me but like I say I'm no expert |
[11:17:08] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:ee71:6a0b:4f4e:9706) has joined #mythtv | |
[11:17:09] | Mode for #mythtv by ChanServ!ChanServ@services. : +v Steve-Goodey | |
[11:35:43] | MythBuild: | Build [#438](https://code.mythtv.org/buildbot/#builders/121/builds/438) of `master-f31–64bit` failed. |
[11:35:47] | MythBuild: | Build [#430](https://code.mythtv.org/buildbot/#builders/107/builds/430) of `master-f30–64bit` failed. |
[11:35:52] | MythBuild: | Build [#106](https://code.mythtv.org/buildbot/#builders/156/builds/106) of `master-f32–64bit` failed. |
[11:35:53] | MythBuild: | Build [#668](https://code.mythtv.org/buildbot/#builders/27/builds/668) of `master-centos7–64bit` failed. |
[11:35:53] | MythBuild: | Build [#646](https://code.mythtv.org/buildbot/#builders/105/builds/646) of `master-debian-buster-64bit` failed. |
[11:35:54] | MythBuild: | Build [#661](https://code.mythtv.org/buildbot/#builders/48/builds/661) of `master-f29–64bit` failed. |
[11:36:04] | MythBuild: | Build [#643](https://code.mythtv.org/buildbot/#builders/76/builds/643) of `master-osx-64bit` failed. |
[12:33:52] | warpme_ (warpme_!uid391875@gateway/web/irccloud.com/x-egdcnripvpeonykp) has joined #mythtv | |
[13:39:59] | SteveGoodey (SteveGoodey!~steve@host86-138-103-159.range86-138.btcentralplus.com) has joined #mythtv | |
[13:39:59] | Mode for #mythtv by ChanServ!ChanServ@services. : +v SteveGoodey | |
[13:47:01] | SteveGoodey (SteveGoodey!~steve@host86-138-103-159.range86-138.btcentralplus.com) has quit (Quit: Konversation terminated!) | |
[14:11:16] | markspieth2 (markspieth2!~yaaic@mythtv/developer/markspieth) has quit (Ping timeout: 250 seconds) | |
[14:24:56] | markspieth (markspieth!~yaaic@mythtv/developer/markspieth) has joined #mythtv | |
[14:24:56] | Mode for #mythtv by ChanServ!ChanServ@services. : +v markspieth | |
[14:50:07] | bill6502 (bill6502!~bill@205.178.24.168) has joined #mythtv | |
[14:50:46] | bill6502: | paul-h: that looks like one I missed when trying to convert to python v3 |
[14:50:55] | bill6502: | I'll take a look at it |
[14:51:29] | bill6502: | I assume you're seeing: TypeError: must be str or None, not bytes |
[14:53:13] | paul-h: | bill6502: yeah I do see that but I think it's because the server is returning an HTML error page rather than the json |
[14:53:38] | paul-h: | The script should handle that better though |
[15:24:42] | mad_enz (mad_enz!~mad_enz@2606:6d00:135:9d84:cd61:2083:8a9a:f5) has joined #mythtv | |
[15:35:18] | markspieth (markspieth!~yaaic@mythtv/developer/markspieth) has quit (Ping timeout: 252 seconds) | |
[15:39:52] | markspieth (markspieth!~yaaic@mythtv/developer/markspieth) has joined #mythtv | |
[15:39:52] | Mode for #mythtv by ChanServ!ChanServ@services. : +v markspieth | |
[15:46:31] | mad_enz (mad_enz!~mad_enz@2606:6d00:135:9d84:cd61:2083:8a9a:f5) has quit (Read error: Connection timed out) | |
[15:47:28] | mad_enz (mad_enz!~mad_enz@2606:6d00:135:9d84:cd61:2083:8a9a:f5) has joined #mythtv | |
[16:33:44] | MythBuild: | Build [#662](https://code.mythtv.org/buildbot/#builders/48/builds/662) of `master-f29–64bit` completed successfully. |
[16:34:16] | MythBuild: | Build [#439](https://code.mythtv.org/buildbot/#builders/121/builds/439) of `master-f31–64bit` completed successfully. |
[16:34:16] | MythBuild: | Build [#107](https://code.mythtv.org/buildbot/#builders/156/builds/107) of `master-f32–64bit` completed successfully. |
[16:41:18] | MythBuild: | Build [#431](https://code.mythtv.org/buildbot/#builders/107/builds/431) of `master-f30–64bit` completed successfully. |
[16:49:06] | MythBuild: | Build [#644](https://code.mythtv.org/buildbot/#builders/76/builds/644) of `master-osx-64bit` completed successfully. |
[16:58:05] | MythBuild: | Build [#647](https://code.mythtv.org/buildbot/#builders/105/builds/647) of `master-debian-buster-64bit` completed successfully. |
[17:04:23] | MythBuild: | Build [#669](https://code.mythtv.org/buildbot/#builders/27/builds/669) of `master-centos7–64bit` completed successfully. |
[17:13:28] | hampton: | This is new for me when building for android: java.io.FileNotFoundException ~/android/sample-release.keystore |
[17:24:47] | hampton: | Nevermind. An update of the packaging repo fixed it. |
[18:09:44] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:ee71:6a0b:4f4e:9706) has quit (Ping timeout: 246 seconds) | |
[18:31:45] | ooshlablu (ooshlablu!~ooshlablu@2601:18d:4600:43f0:9ce7:b6fc:760c:8030) has quit (Ping timeout: 272 seconds) | |
[18:43:58] | ooshlablu (ooshlablu!~ooshlablu@98.217.124.239) has joined #mythtv | |
[18:46:08] | markk__ (markk__!~mark@host109-149-186-102.range109-149.btcentralplus.com) has joined #mythtv | |
[19:16:13] | SteveGoodey (SteveGoodey!~steve@host86-138-103-159.range86-138.btcentralplus.com) has joined #mythtv | |
[19:16:14] | Mode for #mythtv by ChanServ!ChanServ@services. : +v SteveGoodey | |
[19:27:05] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has quit (Ping timeout: 246 seconds) | |
[19:28:22] | stuarta: | paul-h: thanks for the info, i will do some testing. re smolt expert, that is now me, as i've been reimplementing the backend for that (WIP) |
[19:29:10] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv | |
[19:29:11] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
[19:29:11] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv | |
[19:29:11] | Mode for #mythtv by ChanServ!ChanServ@services. : +v peterbennett | |
[19:30:36] | stuarta: | bill6502: let me know if you find something re new smolt entries after the python3 conversion |
[19:33:01] | hampton: | markk__: Could you hold off on more tree reorganizations for a couple of day? I've been trying to merge a batch of cleanups and I keep colliding with your changes and having to remerge. |
[19:39:30] | SteveGoodey (SteveGoodey!~steve@host86-138-103-159.range86-138.btcentralplus.com) has quit (Quit: Konversation terminated!) | |
[19:41:12] | markk__: | hampton: just pushed one last change – all done for now:) apologies for the noise – going to get back to some coding that requires thought now:) |
[19:42:32] | stuarta: | oh you have got to be joking. the backend when queried for the timezone, goes and looks in /etc/timezone for the current timezone (seems logical), but not even the tools for setting the timezone will update that, so if it got set wrong at system build time, then the backend will respond to QUERY_TIME_ZONE with the crap from /etc/timezone, rather than using the actual system time, which it seems to do |
[19:42:38] | stuarta: | everywhere else |
[19:42:41] | stuarta: | FFS |
[19:43:38] | stuarta: | this has taken days to sort out |
[19:44:05] | stuarta: | surely there is just a bloody Qt call to use to get this... |
[19:45:33] | bill6502: | stuarta: I've got a fix, need to test on v2, v3 works. The fix will prevent the exception. The html response (as opposed to the expected json) will print: Error contacting server: 'Critical: UUID Not Found – be3b3318–1e46–425d-b614–17a23e65f4e7' |
[19:45:45] | bill6502: | the endpoint used here is: smoonURL + 'client/regenerate_pub_uuid?uuid=%s' % self.host.UUID |
[20:17:01] | eharris (eharris!~eharris@unaffiliated/eharris) has quit (Remote host closed the connection) | |
[20:20:15] | paul-h: | bill6502: so have you managed to get that endpoint to return a new uuid? |
[20:21:30] | paul-h: | All I could get was the error response even for hardware uuid's that must have worked in the past |
[20:40:38] | markk__ (markk__!~mark@host109-149-186-102.range109-149.btcentralplus.com) has quit (Ping timeout: 265 seconds) | |
[20:45:09] | stuarta: | bill6502: interesting, i'll see if there are any errors on the server side |
[20:48:13] | bill6502: | stuarta: no, I always get the Error contacting server message. I tried deleting $MYTHCONFDIR/HardwareProfile/hw-uuid and that causes a new UUID, but I get the same error. |
[20:48:56] | bill6502: | if I understand the -n option (Request a new public UUID), would the server generate a new one? |
[20:49:20] | stuarta: | in theory yes |
[20:49:39] | stuarta: | it does seem to be working, there are plenty of 200 reponses to the question in the logs |
[20:50:20] | stuarta: | in fact today, 37/37 successful |
[20:52:35] | bill6502: | I can see the 200 coming back too, but always with the error in an html response. success would be in json |
[20:53:19] | stuarta: | ah right, so i can't actually see it from the logs :( |
[21:00:29] | bill6502: | this is what I'm getting back: https://pastebin.com/SdUtTKvY |
[21:04:14] | stuarta: | i'm getting a compressed html reponse, which i'm guessing expands to what you have |
[21:09:39] | brfransen (brfransen!~brfransen@97-95-233-51.dhcp.sffl.va.charter.com) has joined #mythtv | |
[21:10:34] | bill6502: | if I take sendProfile out of the picture and just use a browser, this also displays an error: http://smolt.mythtv.org/client/regenerate_pub . . . d5b3e330eba0 |
[21:10:56] | stuarta: | yep it'll be the backend |
[21:15:29] | stuarta: | ah hang on. i have a vague recollection of some hand waving that needs doing for it to work |
[21:24:09] | stuarta: | bah, this stuff is hung together with horse shit and duct tape |
[21:26:38] | stuarta: | https://github.com/MythTV/mythtv/blob/master/ . . . eprofile.cpp <- this is where it actually happens. looks like the '-n' flag is never used |
[21:29:44] | stuarta: | only seems to use, either '-p' or '--submitOnly -a' |
[21:37:45] | Warped_ (Warped_!~Warped@108.85.160.119) has joined #mythtv | |
[21:39:13] | Warped (Warped!~Warped@unaffiliated/warped) has quit (Ping timeout: 272 seconds) | |
[21:40:36] | bill6502: | wondering if the -p in HardwareProfile::GenerateUUIDs(void) was supposed to be -n |
[21:41:49] | bill6502: | for today's tests, I was running sendProfile -n directly, sounds like now two problems now |
[21:42:18] | stuarta: | tbh, provided --submitOnly works (which it seems to here on a new uuid) |
[21:42:28] | stuarta: | then it doesn't really matter if anything else is broken |
[21:43:01] | stuarta: | i have a replacement backend already written, which works a treat, it just needs a UI |
[21:43:34] | stuarta: | https://github.com/stuarta/smolt2 |
[21:50:05] | Warped_ (Warped_!~Warped@108.85.160.119) has quit (Quit: ChatZilla 0.9.92-rdmsoft [XULRunner 35.0.1/20150122214805]) | |
[21:51:41] | paul-h: | Like I said this morning if you have already successfully submitted a profile in the past then you already have a public uuid it will work it's when you have your private hardware uuid but need to query the server for a new public one that it fails |
[21:52:11] | stuarta: | paul-h: as in the server side doesn't know your uuid? |
[21:53:27] | paul-h: | try doing what bill6502 said and force a new one by deleting $MYTHCONFDIR/HardwareProfile/hw-uuid |
[21:55:42] | stuarta: | paul-h: okay, so that works for the only use case i can actually find in our code (--submitOnly -a) |
[21:56:10] | stuarta: | even with an existing hw-uuid, but no pub-uuid, it still breaks |
[21:56:57] | stuarta: | '-n' is most likely broken server side, but we don't actually use it that i can find |
[21:58:16] | paul-h: | So if you remove hw-uuid it works for you? |
[21:58:33] | stuarta: | yes, with "--submitOnly -a" |
[21:58:53] | stuarta: | '-n' breaks even if i have an existing hw uuid |
[22:00:08] | paul-h: | strange "--submitOnly -a" always fails for me on a new vm setup to test this |
[22:00:20] | stuarta: | hmmm |
[22:01:48] | paul-h: | I think it calls the same code as -n to get the new public uuid if you don't already have one |
[22:07:36] | stuarta: | yes i believe so |
[22:09:59] | paul-h: | The hw-uuid is also stored in the database settings I wonder if since your system has worked in the passed it's using that one rather than actually creating a new one |
[22:11:01] | paul-h: | HardwareProfileUUID and HardwareProfilePublicUUID in the settings table |
[22:14:02] | paul-h: | I can see from my DB that 3 of the 4 frontends are failing to get a public uuid |
[22:14:46] | paul-h: | The one that is working is the oldest one |
[22:15:38] | stuarta: | okay, that could definitely be the case |
[22:15:55] | stuarta: | would have to do what you have done, and get completely standalone system |
[22:17:48] | paul-h: | What UI does smolt2 need? |
[22:18:11] | stuarta: | some basic crap like what the web interface already has |
[22:18:29] | stuarta: | shouldn't be too much effort to pull together |
[22:19:05] | stuarta: | tbh, i only plan to add "recent" and "stats" |
[22:19:11] | stuarta: | everything else is a waste |
[22:20:26] | bill6502: | paul-h: in programs/scripts/hardwareprofile/smolt.py about 1316, change except (FileNotFoundError, IOError): to except Exception: |
[22:21:20] | bill6502: | to see if it runs on the 'new' hosts |
[22:21:58] | bill6502: | i was able to cause an error by removing all 3 files in $MYTHCONFDIR/HardwareProfile |
[22:23:09] | stuarta: | ok, so it's definitely broken for new hosts |
[22:23:22] | stuarta: | how the hell did this crap ever work |
[22:26:03] | bill6502: | that one's on me, i was trying to remove (poorly written, imho) naked exceptions and adding the real things that could fail. turns out that FileNotFoundError isn't portable between v2 and v3 |
[22:26:39] | stuarta: | bill6502: i thought from what paul-h had seen it's a server side issue? is this not correct? |
[22:28:05] | bill6502: | i was assuming that on a new host, the files weren't there, so i (re)tested it and found my error, |
[22:28:34] | bill6502: | paul-h: please retest to see if that changes your results on the 'new' hosts |
[22:29:03] | bill6502: | could be more than one issue |
[22:34:26] | paul-h: | bill6502: still not working I get 'Error contacting Server ([batch_]add_json): HTTP Error 500: Internal error' |
[22:35:06] | stuarta: | paul-h: is that with '-n' or '--submitOnly -a' ?? |
[22:35:17] | paul-h: | That was testing with --submitOnly -a |
[22:35:31] | stuarta: | ok |
[22:39:00] | stuarta: | paul-h: i have seen whilst analyzing the behaviour of the backend, the submit part failing in a small percentage of cases |
[22:39:08] | stuarta: | this looks like what is happening to you |
[22:41:26] | stuarta: | hmm, but it is throwing the error in session.flush |
[22:51:03] | paul-h: | is there a database on the server that contains the hw-uuids? Can you see new ones being added? |
[22:52:23] | paul-h: | Are new public uuid being created? |
[22:55:21] | paul-h: | Anyway it's late time for bed – night all :) |
[22:55:30] | stuarta: | will look into it |
[22:55:40] | paul-h (paul-h!~paul@cpc112433-pres20-2-0-cust645.18-3.cable.virginm.net) has quit (Quit: Konversation terminated!) | |
[23:06:46] | stuarta: | so it's dying when trying to commit to the db |
[23:06:57] | stuarta: | throws an exception which it doesn't catch |
[23:36:15] | stuarta: | correction. it throws an error which just prints the stack trace |
[23:36:38] | stuarta: | i have tweaked the code so that hopefully it prints the exception data as well as the stack trace |
[23:46:29] | stuarta: | anyway, it's way past bed time |
IRC Logs collected by
BeirdoBot.
Please use the above link to report any bugs.