| Monday, February 10th, 2020, 00:00 UTC | ||
| [00:00:07] | EtherMan (EtherMan!~quassel@unaffiliated/ether-man/x-1546665) has quit (Quit: No Ping reply in 60 seconds.) | |
| [00:00:27] | EtherMan (EtherMan!~quassel@unaffiliated/ether-man/x-1546665) has joined #mythtv-users | |
| [00:04:27] | xxyyvvg: | Hi, I've run Myth for about 9 years and I'm having trouble diagnosing a mythfilldatabase issue using schedules direct--running .30. The database fill doesn't happen automatically (it is enabled properly) but the larger problem appears if I run it manually. The update process deadlocks the mysql databas--sometimes it completes, sometimes it doesn't. When looking at the program table in mysql, I notice that there are 120K+ rows. |
| [00:04:27] | xxyyvvg: | I believe this is causing the deadlock issue (as the DB rows grow it's more frequent). I've enabled debug logging and see nothing interesting. What's the best way to troubleshoot this? |
| [00:07:42] | xxyyvvg: | the machine it is running on is very powerful and I don't believe disk/CPU/memory would be the bottleneck (512GB RAM/40threads/raid10 24 platters w/8GB nvcache). All other functions within mythtv work perfectly. The only change I've made from a default install is a different DB name/user with proper grants. Permissions all look good. Is there any configuration to specify how mythfilldatabase runs other than within mythtv-setup? |
| [00:35:05] | peterbennett: | xxyyvvg: Is the system perhaps running out of memory – if using the xmltv interface with mythfilldatabase it can use gigabytes of memory – you can split the run into smaller pieces to avoid this. |
| [00:36:15] | peterbennett: | xxyyvvg: There used to be a problem with the database thrashing when it tried to flush the buffers too often, I think that issue has been resolved in new versions of database. |
| [00:36:20] | xxyyvvg: | peterbennett: It is not, this system has 512GB memory and a TB of swap. Memory usage looks good. |
| [00:36:38] | xxyyvvg: | however CPU on mysqld is very high when the deadlock occurs |
| [00:36:49] | peterbennett: | 512GB – wow |
| [00:37:21] | xxyyvvg: | I pretty much have to drop the program table and dd-grab-all to get things working for a few more weeks/month before it returns. |
| [00:37:48] | xxyyvvg: | Yes it's overkill but had some extra memory sitting around :) |
| [00:38:41] | peterbennett: | There is a plan with a future version to get rid of the SD feed code and only support xmltv – so you may want to try that and get ahead of it. |
| [00:39:33] | peterbennett: | the xmltv uses more memory but never 512 GB – it may need 4 GB if you do not split up your run. |
| [00:40:15] | peterbennett: | Old stuff should be getting dropped from the program table after a week or two. |
| [00:40:25] | xxyyvvg: | Yeah I think that's the main problem actually. |
| [00:40:36] | xxyyvvg: | I've seen it get up to a million rows for the program. |
| [00:40:41] | xxyyvvg: | program table* |
| [00:40:48] | peterbennett: | Gotta go now |
| [00:40:55] | xxyyvvg: | What could cause this? Oh well thanks for the chat. |
| [00:41:34] | peterbennett: | Mine gets dropped but I am using the xmltv json feed |
| [00:42:02] | xxyyvvg: | I'll try that. thanks again. Or I will look at putting in a bug report. |
| [01:04:45] | xxyyvvg (xxyyvvg!~yxxxsss@c-66-41-181-135.hsd1.mn.comcast.net) has quit (Quit: Leaving) | |
| [01:26:15] | trumee (trumee!~rajlon.dy@106.51.140.38) has quit (Quit: ZNC 1.7.1 - https://znc.in) | |
| [01:31:27] | trumee (trumee!~rajlon.dy@106.51.140.38) has joined #mythtv-users | |
| [01:35:10] | p71 (p71!~chatzilla@68-187-65-81.dhcp.ftwo.tx.charter.com) has joined #mythtv-users | |
| [04:10:27] | [R] ([R]!~rbox@unaffiliated/rbox) has quit (Ping timeout: 240 seconds) | |
| [05:31:32] | [R] ([R]!~rbox@unaffiliated/rbox) has joined #mythtv-users | |
| [06:15:08] | [R] ([R]!~rbox@unaffiliated/rbox) has quit (Quit: Leaving) | |
| [06:49:00] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has quit (Quit: WeeChat 2.3) | |
| [07:00:47] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [07:00:47] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [07:00:47] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [07:00:47] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [07:12:56] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d90:bc01:9be6:831c:4ed8:495d) has joined #mythtv-users | |
| [07:12:56] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v Steve-Goodey | |
| [07:40:11] | markk_ (markk_!~mark@host109-149-186-43.range109-149.btcentralplus.com) has joined #mythtv-users | |
| [07:44:26] | Overlordz (Overlordz!~Overlordz@50.35.126.95) has joined #mythtv-users | |
| [09:03:43] | SteveGoodey (SteveGoodey!~steve@host86-150-60-252.range86-150.btcentralplus.com) has joined #mythtv-users | |
| [09:03:43] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v SteveGoodey | |
| [10:04:05] | SteveGoodey (SteveGoodey!~steve@host86-150-60-252.range86-150.btcentralplus.com) has quit (Quit: Konversation terminated!) | |
| [10:10:40] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d90:bc01:9be6:831c:4ed8:495d) has quit (Quit: Konversation terminated!) | |
| [10:45:52] | frobnic (frobnic!fb@b2b-130-180-11-14.unitymedia.biz) has quit (Ping timeout: 256 seconds) | |
| [10:46:31] | frobnic (frobnic!fb@b2b-130-180-11-14.unitymedia.biz) has joined #mythtv-users | |
| [10:54:57] | user798645 (user798645!~User@user-10mt7in.cable.mindspring.com) has joined #mythtv-users | |
| [11:03:39] | user798645 (user798645!~User@user-10mt7in.cable.mindspring.com) has quit (Ping timeout: 240 seconds) | |
| [11:26:07] | croppa (croppa!~stuart@2406:3400:21e:b1b0:4e72:b9ff:fe4e:d449) has quit (Ping timeout: 240 seconds) | |
| [11:26:09] | croppa_ (croppa_!~stuart@26.84.233.220.static.exetel.com.au) has joined #mythtv-users | |
| [11:33:42] | ink0gnito (ink0gnito!~ink0gnito@185.132.133.69) has quit (Quit: ZNC - 1.7.0 - http://znc.in) | |
| [11:34:43] | ink0gnito (ink0gnito!~ink0gnito@185.132.133.69) has joined #mythtv-users | |
| [13:15:47] | vesper11 (vesper11!~ves@217.138.196.54) has quit (Ping timeout: 272 seconds) | |
| [13:15:54] | vesper (vesper!~ves@74.119.145.52) has joined #mythtv-users | |
| [14:26:45] | romanar (romanar!uid295339@gateway/web/irccloud.com/x-ygwwlijkdwwfntow) has joined #mythtv-users | |
| [15:04:16] | psymin (psymin!~psymin@69.146.8.222) has joined #mythtv-users | |
| [15:04:16] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v psymin | |
| [16:10:42] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d90:bc01:9be6:831c:4ed8:495d) has joined #mythtv-users | |
| [16:10:42] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v Steve-Goodey | |
| [16:36:07] | romanar (romanar!uid295339@gateway/web/irccloud.com/x-ygwwlijkdwwfntow) has quit (Quit: Connection closed for inactivity) | |
| [17:04:33] | markk_ (markk_!~mark@host109-149-186-43.range109-149.btcentralplus.com) has quit (Ping timeout: 246 seconds) | |
| [17:06:28] | SteveGoodey (SteveGoodey!~steve@host86-150-60-252.range86-150.btcentralplus.com) has joined #mythtv-users | |
| [17:06:28] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v SteveGoodey | |
| [17:22:05] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d90:bc01:9be6:831c:4ed8:495d) has quit (Quit: Konversation terminated!) | |
| [17:26:39] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d90:bc01:9be6:831c:4ed8:495d) has joined #mythtv-users | |
| [17:26:51] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v Steve-Goodey | |
| [17:37:29] | markk_ (markk_!~mark@host109-149-186-43.range109-149.btcentralplus.com) has joined #mythtv-users | |
| [19:54:30] | markk_ (markk_!~mark@host109-149-186-43.range109-149.btcentralplus.com) has quit (Ping timeout: 265 seconds) | |
| [21:00:41] | xxyyvvg (xxyyvvg!~yxxxsss@c-66-41-181-135.hsd1.mn.comcast.net) has joined #mythtv-users | |
| [21:01:14] | xxyyvvg: | When creating a new mythtv database, what is the suggested storage engine to use for mysql? |
| [21:07:21] | psymin: | Interesting that it isn't mentioned here: https://www.mythtv.org/wiki/Database_Setup#Se . . . ial_database |
| [21:07:32] | psymin: | I believe I'm using the default, InnoDB |
| [21:08:04] | xxyyvvg: | Interesting... |
| [21:08:39] | psymin: | looks like XtraDB might be mariadb's new default |
| [21:08:47] | psymin: | s/new/old/ |
| [21:08:52] | xxyyvvg: | I've looked all over and I see references from 2005ish that specifies the default is Myisam. This is what I see when I do a new install. |
| [21:09:59] | xxyyvvg: | However it is causing major problems with the program table. Once I alter to innodb, it's extremely fast. Do all of your tables use Innodb? I found out by running : SELECT table_name, engine FROM information_schema.tables where table_schema = 'mythtv_db'; |
| [21:10:35] | psymin: | I don't currently have remote access to query my server :( |
| [21:11:03] | xxyyvvg: | No worry, I'm just wondering if converting to innodb is 'supported' I suppose. |
| [21:11:41] | xxyyvvg: | The page you referenced seems to hint that they should my myisam however it's from 2012... |
| [21:12:19] | xxyyvvg: | actually: https://www.mythtv.org/wiki/Tune_MySQL |
| [21:13:05] | psymin: | good find :) |
| [21:24:37] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d90:bc01:9be6:831c:4ed8:495d) has quit (Quit: Konversation terminated!) | |
| [21:34:05] | xxyyvvg (xxyyvvg!~yxxxsss@c-66-41-181-135.hsd1.mn.comcast.net) has quit (Quit: Leaving) | |
| [21:36:42] | Tobbe5178 (Tobbe5178!~asdf@81-235-210-78-no62.tbcn.telia.com) has joined #mythtv-users | |
| [21:48:23] | oozer (oozer!~oozer@user-10mt7in.cable.mindspring.com) has joined #mythtv-users | |
| [22:05:45] | markk_ (markk_!~mark@host109-149-186-43.range109-149.btcentralplus.com) has joined #mythtv-users | |
| [22:57:11] | markk_ (markk_!~mark@host109-149-186-43.range109-149.btcentralplus.com) has quit (Ping timeout: 272 seconds) | |
| [23:48:48] | Overlordz (Overlordz!~Overlordz@50.35.126.95) has quit (Quit: Leaving) | |
| [23:53:23] | user798645 (user798645!~User@user-10mt7in.cable.mindspring.com) has joined #mythtv-users | |
IRC Logs collected by
BeirdoBot.
Please use the above link to report any bugs.