| Tuesday, September 1st, 2020, 00:35 UTC | ||
| [00:35:27] | RokLobsta (RokLobsta!~Dirkka@121-200-12-5.79c80c.mel.nbn.aussiebb.net) has quit (Quit: Leaving) | |
| [01:30:00] | dashs (dashs!~dave@dashs.denver.co.us) has quit (Quit: Leaving) | |
| [02:02:52] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:6032:9caa:16d4:6ffa) has joined #mythtv-users | |
| [02:02:52] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v Steve-Goodey | |
| [03:09:52] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:6032:9caa:16d4:6ffa) has quit (Quit: Konversation terminated!) | |
| [05:16:45] | seekr (seekr!~seekr@unaffiliated/seekr) has quit (Ping timeout: 240 seconds) | |
| [05:30:00] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has quit (Quit: WeeChat 2.3) | |
| [05:31:52] | peterbennett (peterbennett!~pi@2601:183:100:6a:f1e0:d1e4:326b:fdd5) has joined #mythtv-users | |
| [05:31:52] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [05:31:52] | peterbennett (peterbennett!~pi@2601:183:100:6a:f1e0:d1e4:326b:fdd5) has quit (Changing host) | |
| [05:31:52] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [07:05:30] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [07:05:30] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [07:22:04] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:6032:9caa:16d4:6ffa) has joined #mythtv-users | |
| [07:22:04] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v Steve-Goodey | |
| [07:50:54] | SteveGoodey (SteveGoodey!~steve@host86-149-198-216.range86-149.btcentralplus.com) has joined #mythtv-users | |
| [07:50:54] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v SteveGoodey | |
| [08:09:58] | bpmedley (bpmedley!~bpm@2601:246:8201:8e0:4541:fbd9:92fb:5659) has quit (Ping timeout: 244 seconds) | |
| [09:06:26] | pppingme (pppingme!~pppingme@unaffiliated/pppingme) has quit (Ping timeout: 240 seconds) | |
| [09:06:55] | gigem (gigem!~david@mythtv/developer/gigem) has quit (Ping timeout: 240 seconds) | |
| [09:07:18] | gigem (gigem!~david@47.183.238.94) has joined #mythtv-users | |
| [09:07:18] | gigem (gigem!~david@mythtv/developer/gigem) has joined #mythtv-users | |
| [09:07:18] | gigem (gigem!~david@47.183.238.94) has quit (Changing host) | |
| [09:07:19] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v gigem | |
| [09:20:26] | pppingme (pppingme!~pppingme@unaffiliated/pppingme) has joined #mythtv-users | |
| [09:39:09] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [10:08:17] | SteveGoodey (SteveGoodey!~steve@host86-149-198-216.range86-149.btcentralplus.com) has quit (Quit: Konversation terminated!) | |
| [10:16:30] | Steve-Goodey (Steve-Goodey!~steve@2a00:23c5:7d83:6501:6032:9caa:16d4:6ffa) has quit (Remote host closed the connection) | |
| [10:16:31] | Steve_Goodey (Steve_Goodey!~steve@2a00:23c5:7d83:6501:6032:9caa:16d4:6ffa) has joined #mythtv-users | |
| [10:16:31] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v Steve_Goodey | |
| [10:35:58] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 256 seconds) | |
| [10:51:39] | user798645 (user798645!~User@user-10mt7in.cable.mindspring.com) has joined #mythtv-users | |
| [11:11:58] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [12:54:14] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 260 seconds) | |
| [13:02:01] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [13:40:09] | cybrNaut: | i tried running https://www.mythtv.org/wiki/Remove_duplicate_videos.py and it gives "ImportError: No module named MythTV" |
| [13:40:32] | cybrNaut: | do scripts need to be in a particular location? |
| [13:54:04] | bill6502 (bill6502!~bill@205.178.24.168) has joined #mythtv-users | |
| [13:55:36] | bill6502: | cybrNaut: probably not a script issue, but a module one. see what: python --version returns (guessing version 2.7) |
| [13:57:43] | bill6502: | v31 is likely using python 3.x and the modules are (for example) in /usr/local/lib/python3.8/dist-packages/MythTV |
| [13:59:51] | bill6502: | that script hasn't seen any changes since: This page was last modified on 29 April 2011, at 05:03. and would need updating for Python3 |
| [14:03:03] | bill6502: | at the very least, the initial line: #!/usr/bin/env python should be #!/usr/bin/python3 and prints are a built-in function so: print "blah" becomes: print("blah") |
| [14:05:16] | bill6502: | author's should update their scripts on the Wiki, but the original one hasn't been active for years, so feel free to test and update |
| [14:05:22] | cybrNaut: | Python 2.7.17 |
| [14:06:40] | cybrNaut: | bill6502: thanks for the information |
| [14:07:57] | bill6502: | yw, you're probably running v31 from a distribution (or built from source) with the default configuration for Python, which is python3 |
| [14:10:38] | cybrNaut: | i don't know python and that script is a bit over my head. Not sure where it's getting the "hash" that it uses as a basis for comparison. I'll probably write a bash script that looks for dupes in the DB based on the long description |
| [14:15:19] | cybrNaut: | i just lost a day of recordings. looks like the ownership of /var/lib/mythtv/recordings was changed to "root:www-data" |
| [14:15:48] | cybrNaut: | not sure how that happened, but i just changed it to "mythtv:mythtv".. does that sound correct? |
| [14:17:12] | cybrNaut: | same thing happened to /var/lib/mythtv/videos |
| [14:21:41] | bill6502: | mythtv:mythtv is very common for things that mythbackend uses (as it's most often run as user mythtv) |
| [14:24:22] | bill6502: | your choice, not much Python skill required, just the 1st line which I gave above and 4 print statements |
| [14:25:13] | bill6502: | you might like to install pylint, it flags issues. run with the -E option to print errors only |
| [14:42:25] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 240 seconds) | |
| [14:50:50] | bpmedley (bpmedley!~bpm@2601:246:8201:8e0:b03e:3d30:a377:7a81) has joined #mythtv-users | |
| [15:04:22] | cybrNaut: | bill6502: your suggestions seem to work. It runs and says "No Duplicates Found!" |
| [15:05:01] | cybrNaut: | i guess the script is running properly, but it's simply not finding dupes using the hash comparison. So I guess I still need to do a bash script |
| [15:24:08] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [16:10:25] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 240 seconds) | |
| [16:12:33] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [17:31:38] | bill6502: | cybrNaut: not sure what you're looking for, but the script gets all videos, sorts them by hash value, then looks for duplicate hashes. |
| [17:32:33] | bill6502: | if you ran it without the -s (--dry-run) option, it should have removed any duplicates. |
| [17:33:02] | bill6502: | any run after that should report "No Duplicates Found!" |
| [17:44:58] | bill6502 (bill6502!~bill@205.178.24.168) has quit (*.net *.split) | |
| [17:44:59] | SleePy (SleePy!~SleePy@simplemachines/siteteam/SleePy) has quit (*.net *.split) | |
| [17:44:59] | mack- (mack-!~mack-@cpe-70-119-42-141.tx.res.rr.com) has quit (*.net *.split) | |
| [17:44:59] | clever (clever!~clever@NixOS/user/clever) has quit (*.net *.split) | |
| [17:44:59] | ghoti (ghoti!~paul@ip-24-156-185-66.user.start.ca) has quit (*.net *.split) | |
| [17:46:32] | bill6502 (bill6502!~bill@205.178.24.168) has joined #mythtv-users | |
| [17:46:32] | gigem (gigem!~david@mythtv/developer/gigem) has joined #mythtv-users | |
| [17:46:32] | SleePy (SleePy!~SleePy@simplemachines/siteteam/SleePy) has joined #mythtv-users | |
| [17:46:33] | mack- (mack-!~mack-@cpe-70-119-42-141.tx.res.rr.com) has joined #mythtv-users | |
| [17:46:33] | clever (clever!~clever@NixOS/user/clever) has joined #mythtv-users | |
| [17:46:33] | ghoti (ghoti!~paul@ip-24-156-185-66.user.start.ca) has joined #mythtv-users | |
| [17:46:33] | Mode for #mythtv-users by tepper.freenode.net : +v gigem | |
| [18:13:18] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 260 seconds) | |
| [18:20:35] | trumee (trumee!~rajlon.dy@49.205.217.71) has quit (Ping timeout: 240 seconds) | |
| [18:20:49] | trumee (trumee!~rajlon.dy@223.226.105.181) has joined #mythtv-users | |
| [18:47:58] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [19:17:31] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has quit (Quit: WeeChat 2.3) | |
| [19:19:39] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [19:19:40] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [19:19:40] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [19:19:40] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [19:58:54] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 260 seconds) | |
| [20:01:12] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [20:01:12] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [20:01:12] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [20:01:12] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [20:15:26] | user798645 (user798645!~User@user-10mt7in.cable.mindspring.com) has quit (Ping timeout: 240 seconds) | |
| [20:31:22] | cybrNaut: | i used --dry-run every time i ran it |
| [20:32:47] | cybrNaut: | if it's taking a hash of the recorded content, that will differ every time even for the exact same episode |
| [20:55:55] | Steve_Goodey (Steve_Goodey!~steve@2a00:23c5:7d83:6501:6032:9caa:16d4:6ffa) has quit (Quit: Konversation terminated!) | |
| [21:15:59] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [21:15:59] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [21:15:59] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [21:15:59] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [21:29:07] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [21:29:07] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [21:29:07] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [21:29:07] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [21:29:38] | bill6502: | cybrNaut: a reasonable guess, but wrong. I don't recall the method, but it's something like hash of initial n bytes + hash of trailing n bytes, no seed |
| [21:30:30] | bill6502: | much discussed in the past and the author had some reason for not changing. I do recall using the 1st and trailing bytes only, |
| [21:31:00] | bill6502: | just because hashing a 6GB file would take a lot of time. |
| [21:34:49] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [21:34:49] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [21:34:49] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [21:34:49] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [21:38:22] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [21:38:22] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [21:38:22] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [21:38:22] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [21:41:12] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has joined #mythtv-users | |
| [21:41:12] | peterbennett (peterbennett!~pi@mythtv/developer/peterbennett) has joined #mythtv-users | |
| [21:41:12] | peterbennett (peterbennett!~pi@c-75-67-203-208.hsd1.ma.comcast.net) has quit (Changing host) | |
| [21:41:12] | Mode for #mythtv-users by ChanServ!ChanServ@services. : +v peterbennett | |
| [21:42:42] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has joined #mythtv-users | |
| [21:48:55] | cybrNaut: | when you have a recording of a scheduled program, the very first second would always differ. My computer's clock would not lose or gain time at the exact same rate as the broadcaster's. Even if 1 pixel differs it's sufficient to change the hash. |
| [21:50:30] | cybrNaut: | i've worked on projects where we have automated tests that compare two still images that are machine generated. Even then, there were often false positives of a failed test even though the images would appear identical to the naked eye. |
| [21:58:06] | mack-: | I've never had the need to look at myth's hash matching either in the code or the discussions, but the operative word is probably "fuzzy" |
| [22:09:13] | blahdodo (blahdodo!~blahdodo@69.172.190.84) has quit (Quit: Bye bye) | |
| [22:16:12] | blahdodo (blahdodo!~blahdodo@69.172.190.84) has joined #mythtv-users | |
| [22:17:37] | markk_ (markk_!~mark@host86-161-98-168.range86-161.btcentralplus.com) has quit (Ping timeout: 264 seconds) | |
| [23:13:00] | bill6502: | cybrNaut: https://lists.archive.carbon60.com/mythtv/users/610359#610359 (one of many) has a link to the algorithm. although I didn't look up the MythTV implementation. 1st and last 65536 bytes |
| [23:18:26] | mack-: | boo, no fuzz except in the most technical definition of cutting out the middle. |
| [23:21:56] | bill6502: | cybrNaut: videos, e.g. DVDs ripped more than once will have the same hash, again. as mentioned earlier, not sure what you're looking for |
| [23:22:15] | bill6502: | but this doesn't sound like the right tool for the job |
IRC Logs collected by
BeirdoBot.
Please use the above link to report any bugs.